Friday, 2017-09-29

openstackgerritdave kormann proposed openstack/openstack-helm master: Ceph OSD disk targeting  https://review.openstack.org/45775401:14
portdirectanticw / gagehugo: looks like something is not right with zuul cloner since the move to v301:28
portdirecthttp://logs.openstack.org/54/457754/67/check/legacy-openstack-helm-aio-basic-ovs-radosgw/cd21d38/job-output.txt.gz#_2017-09-29_01_23_05_35158301:28
SamYapleportdirect: it borked loci builds too01:31
SamYaplegotta switch to required-projects01:31
SamYapleala https://github.com/openstack-infra/openstack-zuul-jobs/blob/master/zuul.d/zuul-legacy-jobs.yaml#L6401:32
*** yamamoto has joined #openstack-helm01:36
*** yamamoto has quit IRC01:44
portdirecthttps://etherpad.openstack.org/p/cvedg2Y74g01:44
* portdirect gets ready for an evening of writing new gates01:45
SamYapleand drinking01:46
SamYapledont forget drinking01:46
portdirectplease, I began with drinking - I do live in STL :P01:46
SamYapleits either drinking or stabbing01:47
SamYaplethe occassional car fire to keep warm01:47
portdirectlol - The stabbyness of this place is over-rated01:47
portdirectbut then I hardly ever leave the compound these days01:48
SamYaplequite pete you are depressing me01:48
portdirectle Quel est le panda triste?01:49
SamYaplehttps://i.imgur.com/hSd0iTC.gif01:53
portdirectamateur: http://www.blog.thehoya.com/wp-content/uploads/2015/04/giphy-1.gif01:57
*** lukepatrick has joined #openstack-helm01:58
SamYaplesays the guy that moves to the us.... to STL02:02
*** kevzha01 has joined #openstack-helm02:20
*** lukepatrick has quit IRC02:20
*** lukepatrick has joined #openstack-helm02:28
*** yamamoto has joined #openstack-helm02:36
*** lukepatrick has quit IRC02:43
openstackgerritPete Birley proposed openstack/openstack-helm master: Neutron: Move Nova credentials to endpoints in values.yaml  https://review.openstack.org/50752102:50
openstackgerritPete Birley proposed openstack/openstack-helm master: Nova: Move Neutron credentials to endpoints in values.yaml  https://review.openstack.org/50751902:51
*** lukepatrick has joined #openstack-helm02:55
*** lukepatrick has quit IRC03:02
*** lukepatrick has joined #openstack-helm03:44
openstackgerritMerged openstack/openstack-helm master: Neutron: Move Nova credentials to endpoints in values.yaml  https://review.openstack.org/50752104:04
openstackgerritMerged openstack/openstack-helm master: Nova: Move Neutron credentials to endpoints in values.yaml  https://review.openstack.org/50751904:04
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add postgresql chart  https://review.openstack.org/50823204:06
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add gnocchi chart  https://review.openstack.org/50824504:06
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add mongodb chart  https://review.openstack.org/50824704:06
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add ceilometer chart  https://review.openstack.org/50825004:06
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: enable publishing of events for core OpenStack Components  https://review.openstack.org/50825704:07
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add aodh chart  https://review.openstack.org/50826404:07
*** coolsvap has joined #openstack-helm04:42
openstackgerritmnayakbomman@juniper.net proposed openstack/openstack-helm master: [WIP] Opencontrail charts for openstack-helm  https://review.openstack.org/50840304:50
anticwportdirect: aye, the whole gerrit upgrade thing hasn't gone as well as hoped05:20
*** julim has quit IRC05:26
*** julim_ has joined #openstack-helm05:27
*** lukepatrick has quit IRC05:36
*** MarkBaker has joined #openstack-helm05:45
*** yamamoto_ has joined #openstack-helm05:53
*** yamamoto has quit IRC05:57
openstackgerritMateusz Blaszkowski proposed openstack/openstack-helm master: RBAC authorization support  https://review.openstack.org/46463006:19
*** NikoHerEricsson has joined #openstack-helm07:14
*** pprokop_ has quit IRC07:58
*** MarkBaker has quit IRC08:10
*** pprokop has joined #openstack-helm08:14
*** kevzha01 has quit IRC08:36
*** yamamoto_ has quit IRC09:01
*** pprokop has quit IRC09:22
*** yamamoto has joined #openstack-helm09:29
*** yamamoto has quit IRC09:32
*** yamamoto has joined #openstack-helm09:40
*** yamamoto has quit IRC09:54
*** yamamoto has joined #openstack-helm10:01
openstackgerritSungil Im proposed openstack/openstack-helm-addons master: WIP: Fluent-logging helm chart  https://review.openstack.org/50702310:18
*** RuiChen has quit IRC10:42
openstackgerritSungil Im proposed openstack/openstack-helm-addons master: WIP: Fluent-logging helm chart  https://review.openstack.org/50702311:15
*** MarkBaker has joined #openstack-helm11:43
*** NikoHerEricsson has left #openstack-helm12:05
*** jaypipes has joined #openstack-helm12:48
*** jaypipes is now known as leakypipes13:04
openstackgerritSungil Im proposed openstack/openstack-helm-addons master: WIP: Fluent-logging helm chart  https://review.openstack.org/50702313:22
*** dansmith is now known as superdan13:34
openstackgerritJaesuk Ahn proposed openstack/openstack-helm-addons master: Fluent-logging helm chart  https://review.openstack.org/50702313:43
*** gouthamr has joined #openstack-helm13:44
*** coolsvap has quit IRC14:10
*** MarkBaker has quit IRC14:40
osh-chatbot1<v1k0d3n> hey all…are the zuul issues preventing code from being merged in (when wf is +1)?14:50
osh-chatbot1<v1k0d3n> https://review.openstack.org/#/c/507259/14:50
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Zuulv3 gate  https://review.openstack.org/50853414:55
portdirectv1k0d3n: I should have fixed that last night14:57
portdirectbut a few things will need to be workflowed again14:57
portdirectif its not merged would be good to sort anticw's comment in that ps14:57
osh-chatbot1<v1k0d3n> yeah, i just wf’ed on my end…to see if that would help. zuul kicked some emails i noticed, but in the history in gerrit it seems to appear/disappear with a refresh. sort of strange.14:58
openstackgerritDarla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart  https://review.openstack.org/49101514:59
portdirectjust fallout from the change to v3 - most things from yesterday will need rechecked/workflowed to kick them back into life15:01
osh-chatbot1<v1k0d3n> make sense. if there are ones you need or want me to kick, let me know. i can try to help push some of them back through if needed.15:02
portdirectI'm back to playing with ansible - w00t (I think?) hand hopt to have v3 native gates in review by eod15:02
osh-chatbot1<v1k0d3n> lol15:02
*** MarkBaker has joined #openstack-helm15:03
*** lrensing has joined #openstack-helm15:05
openstackgerritMerged openstack/openstack-helm master: Adding database drop jobs  https://review.openstack.org/50725915:07
openstackgerritDarla Ahlert proposed openstack/openstack-helm master: [WIP] Add Tempest Chart  https://review.openstack.org/49892915:08
*** lukepatrick has joined #openstack-helm15:09
*** lukepatr_ has joined #openstack-helm15:10
*** lukepatrick has quit IRC15:13
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-addons master: WIP - Prometheus Monitoring Stack  https://review.openstack.org/48112115:16
*** yamamoto has quit IRC15:18
*** v1k0d3n has quit IRC15:19
*** v1k0d3n has joined #openstack-helm15:20
*** ChanServ sets mode: +o v1k0d3n15:20
*** lukepatr_ has quit IRC15:31
*** lukepatrick has joined #openstack-helm15:31
gagehugoportdirect https://review.openstack.org/#/c/508511/15:40
*** MarkBaker has quit IRC15:56
*** yamamoto has joined #openstack-helm16:18
*** yamamoto has quit IRC16:24
openstackgerritDarla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart  https://review.openstack.org/49101516:42
osh-chatbot1<v1k0d3n> is @rootfs around by chance?16:56
osh-chatbot1<v1k0d3n> have some ceph questions, and some strange issues i can’t seem to track down either.16:56
osh-chatbot1<v1k0d3n> @portdirect, maybe you could help direct me too…joggle my brain a bit?16:56
osh-chatbot1<v1k0d3n> i am using bootkube to stand up kubernetes.16:57
osh-chatbot1<v1k0d3n> and following the multi-docs…however sort of following the path of a genesis host…16:57
osh-chatbot1<v1k0d3n> does the OSD have a hard requirements for number of nodes?16:58
portdirectno16:58
osh-chatbot1<v1k0d3n> everything appears fine. but i do get an msg: “Use journal_force_aio to force use of aio anyway”16:59
osh-chatbot1<v1k0d3n> on OSD16:59
portdirectthough you should have an odd number really for a sucessfull qorum16:59
portdirect2 sec16:59
portdirectthats pretty normal afiak: http://logs.openstack.org/57/508257/2/check/legacy-openstack-helm-aio-basic-ovs-swift/e61ab23/logs/k8s/pods/ceph-ceph-osd-tp0xq-osd-pod.txt17:00
osh-chatbot1<v1k0d3n> yeah it’s acting as AIO at the moment.17:00
portdirectthat line is referring to the journal being aio with the data on that osd afaik17:01
portdirecta bit confusing (so many AIO's :) ) but not related to the number of osds17:02
*** gouthamr has quit IRC17:10
openstackgerritLuke Philips proposed openstack/openstack-helm master: FQDN Support - add doc and config props  https://review.openstack.org/50829117:15
osh-chatbot1<rootfs> v1k0d3n: yes, that msg is benign17:18
*** yamamoto has joined #openstack-helm17:20
*** yamamoto has quit IRC17:25
*** gouthamr has joined #openstack-helm17:34
osh-chatbot1<luke_> hey @portdirect RE: fqdn understood the `public: null` config is not required. intentionally trying to place it there for awareness.  thoughts? against convention?17:36
portdirectI'm concerned that having unrequired values in the default config will make auditing etc hard - we really should have only the minimal requirements in them to make the service functional.17:37
portdirectthe doc you have is a great way to explain/highlight the functionaility i think17:38
osh-chatbot1<luke_> cool. thanks for clarifying.17:41
osh-chatbot1<portdirect> np :slightly_smiling_face:17:41
openstackgerritLuke Philips proposed openstack/openstack-helm master: FQDN Support - add doc and config props  https://review.openstack.org/50829117:43
openstackgerritChris Wedgwood proposed openstack/openstack-helm master: libvirt: fix operation when ceph is disabled  https://review.openstack.org/50819718:00
osh-chatbot1<v1k0d3n> hey @rootfs getting some a strange and hard to trace condition with ceph. i can send some logs for you.18:00
osh-chatbot1<v1k0d3n> one thing that bothers me is this message from `kubectl describe`…18:00
osh-chatbot1<v1k0d3n> File uploaded https://kubernetes.slack.com/files/U0A333J23/F7AEPD8M6/-.txt / https://slack-files.com/T09NY5SBT-F7AEPD8M6-a884304fc418:02
osh-chatbot1<v1k0d3n> everything else…logs in the container, etc…all look ok. the dirs are being cleaned out properly, etc.18:02
osh-chatbot1<v1k0d3n> this is a single node, annotated/labeled to be a worker.18:03
osh-chatbot1<portdirect> what ip is the kubelet reporting as its own?18:05
osh-chatbot1<portdirect> if its diff from the ip that the osd is serving on you'll hit that18:06
osh-chatbot1<portdirect> dave is working on a solultion to this atm18:06
osh-chatbot1<portdirect> but in the meantime if you ensure they align you should be good to go (i Hope)18:06
*** lrensing has quit IRC18:09
*** lukepatrick has quit IRC18:21
*** yamamoto has joined #openstack-helm18:22
*** yamamoto has quit IRC18:26
*** mariusv has quit IRC18:56
*** mariusv has joined #openstack-helm18:56
openstackgerritDarla Ahlert proposed openstack/openstack-helm master: [WIP] Add Rally Chart  https://review.openstack.org/49101519:07
*** lrensing has joined #openstack-helm19:10
*** lukepatrick has joined #openstack-helm19:12
*** yamamoto has joined #openstack-helm19:23
*** lrensing has quit IRC19:23
*** yamamoto has quit IRC19:28
*** lrensing has joined #openstack-helm19:42
osh-chatbot1<v1k0d3n> @portdirect should be fine i believe. i’m overriding the kubelet name to the ip address.19:46
osh-chatbot1<v1k0d3n> File uploaded https://kubernetes.slack.com/files/U0A333J23/F7C2YLM1U/-.txt / https://slack-files.com/T09NY5SBT-F7C2YLM1U-36b8325ecb19:47
osh-chatbot1<v1k0d3n> that’s what i’ve used before…a lot of work has gone into ceph though, even removing some need for previous requirements (which is really awesome to see). that’s the current config for kubelet. ip address on this host is 192.168.4.81.19:48
*** yamamoto has joined #openstack-helm20:24
*** yamamoto has quit IRC20:29
osh-chatbot1<alraddarla> vc           yuhuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuj'20:34
osh-chatbot1<alraddarla> ^^ my cat says hello20:34
portdirecthello cat20:35
lrensinghi20:35
osh-chatbot1<v1k0d3n> suuuuure20:35
osh-chatbot1<v1k0d3n> :cat:20:35
osh-chatbot1<alraddarla> lololol20:36
osh-chatbot1<luke_> https://i.imgur.com/4dSv0jH.gif20:37
osh-chatbot1<renmak> @v1k0d3n Hey Brandon, how are you doing? Yeah that Liveness probe changes was recently checked in to 457754 by Dave. Code works fine before his changes.20:38
osh-chatbot1<renmak> if you share what's going on may be i can share with Dave. He did mentioned that he tested Liveness changes in his env and it worked fine.20:39
osh-chatbot1<alraddarla> @luke_ that is accurate20:40
osh-chatbot1<alraddarla> have a great weekend everyone!20:40
osh-chatbot1<v1k0d3n> @renmak what’s up man! no complaints really. except for this cold weather out in d-land :slightly_smiling_face:20:47
osh-chatbot1<renmak> :slightly_smiling_face: :+1:20:49
*** julim_ has quit IRC21:07
*** julim has joined #openstack-helm21:07
*** julim has quit IRC21:12
*** wxy has quit IRC21:13
*** lukepatrick has quit IRC21:14
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add postgresql chart  https://review.openstack.org/50823221:14
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add mongodb chart  https://review.openstack.org/50824721:16
openstackgerritPete Birley proposed openstack/openstack-helm master: Telemetry: add gnocchi chart  https://review.openstack.org/50824521:17
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Zuulv3 gate  https://review.openstack.org/50853421:21
*** yamamoto has joined #openstack-helm21:25
osh-chatbot1<portdirect> @v1k0d3n that snippet above does not force the kubelet to use `192.168.4.81` as the nodeip21:30
osh-chatbot1<portdirect> you may  have more luck with the following:21:30
osh-chatbot1<portdirect> ``` [Unit] Description=Kubernetes Kubelet Documentation=https://kubernetes.io/docs/admin/kubelet/ [Service] ExecStartPre=/bin/mkdir -p /etc/kubernetes/manifests ExecStart=/usr/local/bin/kubelet \     --kubeconfig=/etc/kubernetes/kubeconfig \     --require-kubeconfig \     --cni-conf-dir=/etc/cni/net.d \     --cni-bin-dir=/opt/cni/bin \     --network-plugin=cni \     --lock-file=/var/run/lock/kubelet.lock \21:30
osh-chatbot1--exit-on-lock-contention \     --pod-manifest-path=/etc/kubernetes/manifests \     --allow-privileged \     --cluster_dns=10.96.0.10,8.8.4.4,8.8.8.8 \     --cluster_domain=cluster.local \     --node-labels= \     --hostname-override=192.168.4.81 \     --v=2 Restart=on-failure RestartSec=5 [Install] WantedBy=multi-user.target ```21:30
osh-chatbot1<portdirect> lol - 2 sec21:31
*** yamamoto has quit IRC21:31
osh-chatbot1<portdirect> ``` [Unit] Description=Kubernetes Kubelet Documentation=https://kubernetes.io/docs/admin/kubelet/ [Service] ExecStartPre=/bin/mkdir -p /etc/kubernetes/manifests ExecStart=/usr/local/bin/kubelet \     --kubeconfig=/etc/kubernetes/kubeconfig \     --require-kubeconfig \     --cni-conf-dir=/etc/cni/net.d \     --cni-bin-dir=/opt/cni/bin \     --network-plugin=cni \     --lock-file=/var/run/lock/kubelet.lock \21:31
osh-chatbot1--exit-on-lock-contention \     --pod-manifest-path=/etc/kubernetes/manifests \     --allow-privileged \     --cluster_dns=10.96.0.10,8.8.4.4,8.8.8.8 \     --cluster_domain=cluster.local \     --node-labels= \     --node-ip=192.168.4.81 \     --hostname-override=192.168.4.81 \     --v=2 Restart=on-failure RestartSec=5 [Install] WantedBy=multi-user.target ```21:31
osh-chatbot1<portdirect> note the `--node-ip` flag21:32
osh-chatbot1<portdirect> this has caught out a few other people running multiple nics - though your issue may be different :S21:32
osh-chatbot1<portdirect> all the above is presuming your cidr for ceph things is "192.168.x.y/z" if not you'd need to adjust accordingly until daves ps is in.21:34
*** lrensing has quit IRC21:37
*** yamamoto has joined #openstack-helm22:27
osh-chatbot1<v1k0d3n> Ahh...total oversight on my part @portdirect! glad you pointed that out...super helpful. Thank you!!22:28
osh-chatbot1<v1k0d3n> Ceph has changed so many times, that it’s hard keeping up, even being fairly close to the project.22:29
*** gouthamr has quit IRC22:29
osh-chatbot1<v1k0d3n> May be helpful to change the cidr that the Calico manifest uses for the pod ip range, just so there’s no confusion.22:29
osh-chatbot1<v1k0d3n> Meaning, in the multinode, the pod cidr and the host ranges are set to 192.168.0.0/16.22:30
osh-chatbot1<v1k0d3n> I’m on mobile...may explain later if I’m not explaining this well.22:31
*** yamamoto has quit IRC22:32
osh-chatbot1<mattmceuen> Hey, I thought we had a helper script that would do a (one-time, up-front) generation of a project's values.yaml conf based on its corresponding oslo config.  I can't find it or its docs -- anyone know?23:18
srwilkersHey matt. The Oslo genconfig tool was removed. We’re handling the config files differently now23:20
osh-chatbot1<mattmceuen> I know yaml->config is all template magic now.  Can you point me to the initial config->yaml mapping?23:21
srwilkershttps://github.com/openstack/openstack-helm/blob/master/keystone/templates/configmap-etc.yaml#L4123:21
srwilkersGets values from this tree: https://github.com/openstack/openstack-helm/blob/master/keystone/values.yaml#L25423:22
osh-chatbot1<mattmceuen> My question is -- where does that tree come from23:23
osh-chatbot1<mattmceuen> Used to be a script (iirc!) that would do some kolla things and spit out yamlized config for a project23:23
srwilkersIt’s just declared in values by hand. the conf.service.whatever entries correspond to the Config sections in the service.conf files23:24
osh-chatbot1<mattmceuen> Ok, I must have made that up then,  Thanks Steve!23:25
srwilkersCheers dude23:26
osh-chatbot1<v1k0d3n>  Cheers! 8)23:27
osh-chatbot1<mattmceuen> yo @v1k0d3n!23:27
osh-chatbot1<v1k0d3n> :beer:🥂:tropical_drink::wine_glass:🥃<< cheers after the workday!23:27
portdirectThis may be of use too: http://openstack-helm.readthedocs.io/en/latest/devref/oslo-config.html23:27
*** yamamoto has joined #openstack-helm23:29
srwilkersThe gangs all here23:29
srwilkersThe bands getting back together!23:29
osh-chatbot1<mattmceuen> Thanks @portdirect.  Yep that one I'm aware of.  I may just be misremembering a convenience script to generate the service.conf itself23:29
* srwilkers may be a pitcher of margaritas in23:30
osh-chatbot1<mattmceuen> :guitar::drum-with-stick::microphone:23:30
portdirectIt was removed as part of the ps that put that doc in :)23:30
portdirect808 drum machine here23:30
osh-chatbot1<mattmceuen> :robot_face:23:31
*** yamamoto has quit IRC23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!