| mnaser | i think i might have a clue at the root cause of tripleo gate problem | 00:00 |
|---|---|---|
| mnaser | http://paste.openstack.org/show/621372/ | 00:00 |
| mnaser | the self.instances stuff works, i wrote a small .rb file and it functionally shows the write stuff | 00:00 |
| mnaser | https://review.openstack.org/#/c/501669/4/lib/puppet/provider/nova.rb | 00:01 |
| mnaser | i suspect the cause here is "#{Puppet::Util.which('nova-manage')} #{args.join(' ')}" | 00:01 |
| mnaser | im guessing the questionmarks and the ampersand is fucking things up | 00:01 |
| mnaser | woops, forgive my language there :> | 00:02 |
| mnaser | command (Array<String>, String) — the command to execute. If it is an Array the first element should be the executable and the rest of the elements should be the individual arguments to that executable. | 00:02 |
| *** ebarrera has quit IRC | 00:03 | |
| mnaser | i think we should be doing the array stuff instead of args.join | 00:03 |
| *** oanson has quit IRC | 00:08 | |
| *** oanson has joined #tripleo | 00:09 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 00:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 00:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 00:10 |
| openstackgerrit | Matthew Thode proposed openstack/diskimage-builder master: Update Gentoo element for element changes https://review.openstack.org/503844 | 00:11 |
| openstackgerrit | Mohammed Naser proposed openstack/tripleo-heat-templates master: DNM, change to test lp 1717545 https://review.openstack.org/504947 | 00:12 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] https://launchpad.net/bugs/1717545 | 00:12 |
| mnaser | thats an attempt | 00:14 |
| larsks | If anyone's around...how do I "bundle exec rake spec" a single spec | 00:16 |
| larsks | ? | 00:16 |
| larsks | Just adding a path (bundle exec rake spec path/to/spec.rb) doesn't seem to do it. | 00:17 |
| *** chlong has joined #tripleo | 00:20 | |
| larsks | Ah SPEC_OPTS="-P path/to/spec.rb" | 00:28 |
| *** dmacpher has quit IRC | 00:47 | |
| *** bfournie has joined #tripleo | 00:51 | |
| *** bfournie has quit IRC | 00:52 | |
| *** tiswanso has joined #tripleo | 00:58 | |
| *** ipsecguy has quit IRC | 01:08 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 01:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 01:10 |
| *** jwb has quit IRC | 01:16 | |
| *** tiswanso has quit IRC | 01:19 | |
| *** tiswanso has joined #tripleo | 01:20 | |
| *** thrash is now known as thrash|g0ne | 01:21 | |
| *** cshastri has joined #tripleo | 01:21 | |
| *** sshnaidm has joined #tripleo | 01:22 | |
| *** apetrich has quit IRC | 01:23 | |
| *** liverpooler has quit IRC | 01:24 | |
| *** apetrich has joined #tripleo | 01:25 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Set repo setup release in playbook https://review.openstack.org/504939 | 01:25 |
| *** yamahata has quit IRC | 01:29 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Actually sort mount-point list https://review.openstack.org/504819 | 01:30 |
| *** dmacpher has joined #tripleo | 01:37 | |
| *** itlinux has joined #tripleo | 01:48 | |
| *** chlong has quit IRC | 02:03 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 02:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 02:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 02:10 |
| *** ipsecguy has joined #tripleo | 02:15 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Add --set argument to prepare command https://review.openstack.org/497745 | 02:19 |
| mnaser | https://review.openstack.org/#/c/504977/ - please have a look to resolve tripleo gates | 02:30 |
| *** ramishra has joined #tripleo | 02:30 | |
| *** itlinux has quit IRC | 02:37 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: test image update with loop https://review.openstack.org/504992 | 02:40 |
| *** sshnaidm is now known as sshnaidm|off | 02:41 | |
| -openstackstatus- NOTICE: Gerrit is being restarted to feed its insatiable memory appetite | 02:42 | |
| *** tzumainn has joined #tripleo | 02:57 | |
| *** tzumainn has quit IRC | 03:02 | |
| *** daidv has joined #tripleo | 03:07 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 03:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 03:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 03:10 |
| *** tongl has joined #tripleo | 03:30 | |
| *** rlandy|brb is now known as rlandy | 03:32 | |
| *** dbecker has quit IRC | 03:54 | |
| *** tzumainn has joined #tripleo | 03:57 | |
| *** ykarel has joined #tripleo | 04:01 | |
| *** tzumainn has quit IRC | 04:01 | |
| *** itlinux has joined #tripleo | 04:03 | |
| *** ykarel_ has joined #tripleo | 04:03 | |
| *** ykarel has quit IRC | 04:05 | |
| *** dbecker has joined #tripleo | 04:07 | |
| *** aditya_r has joined #tripleo | 04:09 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 04:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 04:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 04:10 |
| *** udesale has joined #tripleo | 04:16 | |
| *** shreshtha has joined #tripleo | 04:21 | |
| *** pdeore has joined #tripleo | 04:27 | |
| *** janki has joined #tripleo | 04:32 | |
| *** dmacpher has quit IRC | 04:35 | |
| *** itlinux has quit IRC | 04:36 | |
| *** skramaja has joined #tripleo | 04:39 | |
| janki | Hi. Can I get +1 for workflow for https://review.openstack.org/#/c/498383/ plz | 04:42 |
| *** aditya_ra has joined #tripleo | 04:56 | |
| *** aditya_r has quit IRC | 04:59 | |
| *** marios has joined #tripleo | 05:00 | |
| *** aditya_ra has quit IRC | 05:04 | |
| *** agurenko has joined #tripleo | 05:04 | |
| *** aditya_r has joined #tripleo | 05:04 | |
| jaosorior | janki: I could but... gotta check if the gate isn't broken anymore | 05:09 |
| jaosorior | janki: it's been broken for days | 05:09 |
| jaosorior | janki: is it working yet? | 05:09 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 05:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 05:10 |
| janki | jaosorior, not sure. I did see someone asking about it yesterday here. | 05:10 |
| jaosorior | janki: well, http://tripleo.org/cistatus.html | 05:10 |
| jaosorior | seems pretty broken to me | 05:11 |
| *** skramaja_ has joined #tripleo | 05:12 | |
| *** skramaja has quit IRC | 05:14 | |
| janki | jaosorior, ya.... | 05:14 |
| jaosorior | janki: soo.... no +W yet :( | 05:15 |
| janki | jaosorior, lets see tomorrow. this is important for ODL deployment :( | 05:15 |
| jaosorior | janki: this might be a fix though https://review.openstack.org/#/c/504977 | 05:17 |
| *** mdnadeem has joined #tripleo | 05:18 | |
| *** abregman has joined #tripleo | 05:25 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-docs master: Add step for overcloud DNS setup in TLS everywhere doc https://review.openstack.org/505058 | 05:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Only inject cloud-init in CentOS 7.3 https://review.openstack.org/504850 | 05:32 |
| *** dpawar has joined #tripleo | 05:35 | |
| openstackgerrit | zenghui.shi proposed openstack/tripleo-specs master: Tripleo PTP (Precision Time Protocol) support https://review.openstack.org/483227 | 05:37 |
| *** masco has joined #tripleo | 05:39 | |
| *** sshnaidm|off has quit IRC | 05:40 | |
| *** psahoo has joined #tripleo | 05:43 | |
| *** aditya_r has quit IRC | 05:43 | |
| *** aditya_r has joined #tripleo | 05:44 | |
| *** abregman has quit IRC | 05:45 | |
| *** ratailor has joined #tripleo | 05:47 | |
| *** ykarel_ is now known as ykarel | 05:53 | |
| *** jfrancoa has joined #tripleo | 05:58 | |
| *** udesale has quit IRC | 05:59 | |
| *** jtomasek has joined #tripleo | 06:00 | |
| *** udesale has joined #tripleo | 06:00 | |
| *** jfrancoa has quit IRC | 06:05 | |
| *** abishop has quit IRC | 06:05 | |
| *** rbrady has quit IRC | 06:05 | |
| *** afazekas has quit IRC | 06:05 | |
| *** brault has quit IRC | 06:05 | |
| *** numans has quit IRC | 06:05 | |
| *** jproqueDell has quit IRC | 06:05 | |
| *** StevenK has quit IRC | 06:05 | |
| *** vila_grcalka has quit IRC | 06:05 | |
| *** dr_gogeta86 has quit IRC | 06:05 | |
| *** spredzy has quit IRC | 06:05 | |
| *** Tengu has quit IRC | 06:05 | |
| *** tdasilva has quit IRC | 06:05 | |
| *** mwhahaha has quit IRC | 06:05 | |
| *** melwitt has quit IRC | 06:05 | |
| *** rajinir has quit IRC | 06:05 | |
| *** Ng has quit IRC | 06:05 | |
| *** Tengu has joined #tripleo | 06:05 | |
| *** melwitt has joined #tripleo | 06:05 | |
| *** StevenK has joined #tripleo | 06:05 | |
| *** afazekas has joined #tripleo | 06:05 | |
| *** dr_gogeta86 has joined #tripleo | 06:05 | |
| *** dr_gogeta86 has quit IRC | 06:05 | |
| *** dr_gogeta86 has joined #tripleo | 06:05 | |
| *** rbrady has joined #tripleo | 06:05 | |
| *** rbrady has joined #tripleo | 06:05 | |
| *** abishop has joined #tripleo | 06:05 | |
| *** Ng has joined #tripleo | 06:05 | |
| *** ChanServ sets mode: +v Ng | 06:05 | |
| *** melwitt is now known as Guest36641 | 06:06 | |
| *** numans has joined #tripleo | 06:06 | |
| *** mwhahaha has joined #tripleo | 06:06 | |
| *** panda|bbl has quit IRC | 06:08 | |
| *** mrunge has quit IRC | 06:08 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: App config and I18n selectors refactor https://review.openstack.org/494141 | 06:09 |
| *** mrunge has joined #tripleo | 06:09 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 06:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 06:10 |
| *** jfrancoa has joined #tripleo | 06:10 | |
| *** brault has joined #tripleo | 06:10 | |
| *** jproqueDell has joined #tripleo | 06:10 | |
| *** vila_grcalka has joined #tripleo | 06:10 | |
| *** spredzy has joined #tripleo | 06:10 | |
| *** tdasilva has joined #tripleo | 06:10 | |
| *** rajinir has joined #tripleo | 06:10 | |
| *** panda has joined #tripleo | 06:11 | |
| *** mnaser has quit IRC | 06:12 | |
| *** mnaser has joined #tripleo | 06:13 | |
| *** mnaser has joined #tripleo | 06:13 | |
| *** tongl has quit IRC | 06:15 | |
| *** jprovazn has joined #tripleo | 06:19 | |
| *** jchhatbar has joined #tripleo | 06:22 | |
| *** jchhatbar has quit IRC | 06:23 | |
| *** jchhatbar has joined #tripleo | 06:23 | |
| *** janki has quit IRC | 06:24 | |
| *** janki has joined #tripleo | 06:28 | |
| *** jchhatbar has quit IRC | 06:31 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Added a new role definition for SR-IOV Compute role https://review.openstack.org/501999 | 06:35 |
| *** jlinkes has joined #tripleo | 06:37 | |
| *** paramite has joined #tripleo | 06:38 | |
| *** pgadiya has joined #tripleo | 06:38 | |
| *** jaganathan has joined #tripleo | 06:41 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Format and send the retry-limit reached message https://review.openstack.org/504387 | 06:41 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Handle nodes that failed to start introspection https://review.openstack.org/504907 | 06:41 |
| *** ccamacho has joined #tripleo | 06:49 | |
| *** florianf has joined #tripleo | 06:49 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: docker: add logging(source & groups) https://review.openstack.org/499529 | 06:50 |
| ccamacho | morning folksd | 06:56 |
| *** dpawar has quit IRC | 06:58 | |
| *** ebarrera has joined #tripleo | 07:01 | |
| janki | marios, you there? | 07:03 |
| *** jprovazn has quit IRC | 07:06 | |
| *** abregman has joined #tripleo | 07:07 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 07:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 07:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 07:10 |
| *** tmorin has joined #tripleo | 07:10 | |
| *** anshul has joined #tripleo | 07:14 | |
| *** yprokule has joined #tripleo | 07:14 | |
| *** iranzo has joined #tripleo | 07:15 | |
| *** rcernin has joined #tripleo | 07:18 | |
| *** skramaja_ is now known as skramaja_afk | 07:21 | |
| *** pcaruana has joined #tripleo | 07:22 | |
| *** dpawar has joined #tripleo | 07:22 | |
| jbadiapa | jaosorior, are you around? | 07:24 |
| *** tesseract has joined #tripleo | 07:24 | |
| -openstackstatus- NOTICE: Post jobs are not executed currently, do not tag any releases | 07:25 | |
| *** ChanServ changes topic to "Post jobs are not executed currently, do not tag any releases" | 07:25 | |
| *** liverpooler has joined #tripleo | 07:31 | |
| *** dpawar has quit IRC | 07:32 | |
| *** cschwede has joined #tripleo | 07:34 | |
| *** dpawar has joined #tripleo | 07:34 | |
| *** jpena|off is now known as jpena | 07:35 | |
| *** amoralej|off is now known as amoralej | 07:36 | |
| *** threestrands has quit IRC | 07:36 | |
| *** ffiore has joined #tripleo | 07:36 | |
| jaosorior | jbadiapa: yep | 07:37 |
| jaosorior | jbadiapa: what's up? | 07:37 |
| *** fandrieu_ has joined #tripleo | 07:39 | |
| *** fandrieu has quit IRC | 07:39 | |
| *** fandrieu_ is now known as fandrieu | 07:39 | |
| jbadiapa | jaosorior, I saw your question regarding the -1 on the https://review.openstack.org/#/c/499529/ late in the evening, | 07:39 |
| jaosorior | right | 07:40 |
| jbadiapa | I set -1 because lars had blocked the the patch before, so I wanted to talked to him to unlocked | 07:41 |
| jaosorior | ok | 07:41 |
| jaosorior | jbadiapa: so what did he say? | 07:41 |
| jaosorior | owalsh: any idea what could cause this http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_06_59_03_212 ? | 07:41 |
| jbadiapa | jaosorior, he had implemented a transformation for avoid setting the logs on every docker service, that's why he blocked to patch. | 07:43 |
| jaosorior | oh | 07:43 |
| jaosorior | jbadiapa: so... is the patch still valid then? or should it be abandoned in favor of this transformation? | 07:44 |
| *** janki is now known as janki|lunch | 07:45 | |
| jbadiapa | jaosorior, the new implementation is using that approach and making the logs visible on the docker service, so it's valid and needed when docker fluentd will merge | 07:45 |
| jaosorior | jbadiapa: got a link to it? | 07:46 |
| jbadiapa | the patch we were talking about https://review.openstack.org/#/c/499529/ | 07:46 |
| jbadiapa | it depends on the dcoker fluentd patch | 07:47 |
| jbadiapa | jaosorior, https://review.openstack.org/#/c/467072/ | 07:47 |
| jaosorior | jbadiapa: checking it out | 07:47 |
| jbadiapa | jaosorior, lars transformation https://review.openstack.org/#/c/502501/ | 07:47 |
| jaosorior | jbadiapa: yep. Was following the depends-on rabbit hole :D | 07:48 |
| *** sid1 has joined #tripleo | 07:49 | |
| jaosorior | jbadiapa: is this something we want to add to the defaul roles file? https://review.openstack.org/#/c/467072/22 | 07:49 |
| jaosorior | oh | 07:49 |
| jaosorior | it's there already | 07:49 |
| jaosorior | great | 07:49 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-specs master: Instance HA Specification https://review.openstack.org/389103 | 07:49 |
| jaosorior | jbadiapa: well, it looks good to me; I assume you already tried it out locally, right? | 07:50 |
| jaosorior | jbadiapa: or should I try to deploy it? | 07:50 |
| jbadiapa | yes, it worked | 07:51 |
| jaosorior | jbadiapa: I saw a lot of folks only +1ed the transformation patch, any idea why? | 07:52 |
| jaosorior | oooh yeah | 07:52 |
| jaosorior | unit tests | 07:52 |
| jbadiapa | jaosorior, Emilien was requesting some unit test | 07:52 |
| jaosorior | jbadiapa: any idea if those are coming soon? | 07:52 |
| *** egonzalez has joined #tripleo | 07:52 | |
| *** fzdarsky has joined #tripleo | 07:53 | |
| jbadiapa | I hope so, lars was working on them | 07:53 |
| *** sid2 has joined #tripleo | 07:54 | |
| jaosorior | jbadiapa: well, if you want we could pair up and work on those. | 07:54 |
| *** mrunge has quit IRC | 07:54 | |
| *** sid1 has quit IRC | 07:55 | |
| jbadiapa | jaosorior, It would be great, but I have to warm you that I do not have much idea about puppet | 07:57 |
| *** mcornea has joined #tripleo | 07:57 | |
| jaosorior | jbadiapa: no worries | 07:57 |
| *** mrunge has joined #tripleo | 07:57 | |
| jaosorior | jbadiapa: ok, gimme some minutes and I'll be back. | 07:58 |
| jbadiapa | jaosorior, np | 07:58 |
| *** d0ugal has quit IRC | 08:01 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates master: Allow Sensu to connect to RabbitMQ cluster https://review.openstack.org/495149 | 08:01 |
| chandankumar | Hello | 08:02 |
| chandankumar | How can i run featureset006 on rdocloud using ovb? | 08:03 |
| chandankumar | it is giving https://paste.fedoraproject.org/paste/Kpy4Ke8~~C6crk2lruNUDQ | 08:03 |
| chandankumar | error | 08:03 |
| *** shardy has joined #tripleo | 08:04 | |
| *** d0ugal has joined #tripleo | 08:09 | |
| jaosorior | shardy: hey! good morning! any idea what could cause this http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_06_59_03_212 ? | 08:09 |
| *** janki|lunch is now known as janki | 08:09 | |
| janki | mandre, hey, you there? | 08:10 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 08:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 08:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 08:10 |
| *** jpich has joined #tripleo | 08:11 | |
| *** ykarel is now known as ykarel|lunch | 08:11 | |
| *** bogdando has joined #tripleo | 08:11 | |
| shardy | jaosorior: it looks like it failed building the config drive, is there a hard limit on the size of that? | 08:12 |
| shardy | http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/df.txt.gz | 08:12 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Correct template names from ocata to pike. https://review.openstack.org/500465 | 08:12 |
| shardy | that shows it as full | 08:12 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates master: Change template names to queens https://review.openstack.org/500451 | 08:12 |
| shardy | does that job inject a bunch of data via user-data for cloud-init? | 08:13 |
| openstackgerrit | Merged openstack/tripleo-docs master: Add step for overcloud DNS setup in TLS everywhere doc https://review.openstack.org/505058 | 08:13 |
| janki | shardy, hey. I have 1 more question about minor update - would there be nay donwtime? | 08:16 |
| jaosorior | shardy: it does inject stuff into cloud-init | 08:17 |
| jaosorior | shardy: not a lot, but it does. | 08:17 |
| jaosorior | shardy: it wasn't failing until last week though, so I wonder if something changed. | 08:17 |
| shardy | janki: the idea is you update one node at a time, so it's a rolling update and no downtime (other than restarting the services on each controller potentially) | 08:17 |
| shardy | janki: basically it's the same as the old update from a downtime perspective, where we'd update packages and restart services | 08:17 |
| shardy | now we just update containers and restart those instead | 08:17 |
| jaosorior | shardy: what's extra that we do inject is just this https://github.com/openstack/novajoin/blob/master/files/cloud-config-novajoin.json which is 1.5K | 08:18 |
| shardy | but previously it was done via yum_update.sh, now it's done via update_tasks followed by the normal deploy steps | 08:18 |
| jaosorior | jbadiapa: alright, bluejeans? | 08:18 |
| shardy | jaosorior: ack, yeah I guess something changed but I'm not sure what tbh | 08:18 |
| janki | shardy, any specific minutes that we can guess that. I am suspecting the time puppet takes to configure the services | 08:18 |
| shardy | janki: well the service is up while we run puppet etc, it's only down while we restart the container | 08:19 |
| shardy | so in theory the downtime on each node is less than before | 08:19 |
| shardy | where we'd stop everything then run puppet to bring it back up | 08:19 |
| shardy | I don't have any comparative benchmarks though | 08:19 |
| janki | shardy, like a minute or 2 or something? | 08:19 |
| shardy | if anyone has time to do some testing those would be useful numbers | 08:19 |
| jbadiapa | jaosorior, sure | 08:20 |
| shardy | janki: I don't have any comparative benchmarks | 08:20 |
| shardy | if the exact time is important, you'll have to test it | 08:20 |
| *** jprovazn has joined #tripleo | 08:20 | |
| shardy | but it should be at least as good (probably better) than our old minor update without containres | 08:20 |
| shardy | in theory bouncing each container should be very fast | 08:21 |
| *** aufi has joined #tripleo | 08:21 | |
| janki | shardy, ahh, ohk. Maybe I can try measuring it once I have the setup and figure out the steps | 08:21 |
| shardy | janki: yeah, if you do then please share the results, I'm sure other folks will ask similar questions | 08:21 |
| shardy | I've just not had time to test it myself yet | 08:22 |
| janki | shardy, sure will do | 08:22 |
| shardy | mcornea, marios: ^^ aware of any testing ref downtime for minor updates yet? | 08:22 |
| marios | shardy: same shardy matbu is the only one with a green run on the very latest workflow afaik (it was being updated last week) so not sure there are that many folks with numbers yet :) | 08:23 |
| marios | yprokule: may have run it (end to end update? time estimate?) | 08:23 |
| marios | shardy: janki the initial stack update takes 15mins ish (depending on hardware) to get the ansible playbooks | 08:24 |
| social | marios: hey | 08:24 |
| social | marios: https://review.openstack.org/#/c/487488/12/tripleoclient/v1/overcloud_update.py | 08:24 |
| yprokule | marios: so far images ain't updated | 08:24 |
| yprokule | marios: yesterday's issue | 08:24 |
| social | marios: the container file just gets uploaded to swift but do we merge it into environment? We need to update stack parameters there | 08:24 |
| shardy | marios: ack, I think the query was about service downtime, which I assume is negligble provided the LB fails over when we take each service down? | 08:25 |
| shardy | marios: I wasn't too clear re the pacemaker managed things in that case but I assume it's at least equivalent to our old model | 08:25 |
| *** mrunge has quit IRC | 08:26 | |
| marios | janki: shardy: running them not sure .. the update_playbooks right now don't have much (just yum update) so that one should be pretty fast... then the deployment steps playbook so that one at the moment should take the 'longest' i guess (there will be more update tasks but pacemaker ones are still being reviewed https://review.openstack.org/486567) | 08:26 |
| marios | yprokule: social ack | 08:26 |
| *** mrunge has joined #tripleo | 08:26 | |
| marios | yprokule: yeah i suspected it was something like that (we discussed briefly yesterday) so it may just be that the env file isn't being passed through to the stack update even though matbu added the cli param | 08:26 |
| shardy | marios: ack - for non pacemaker things I think most of the deploy steps time isn't actually taking services down, we spend time generating config and pulling images, then bounce the services at the end of each step | 08:27 |
| shardy | similar to the systemctl approach with packages I guess | 08:27 |
| janki | shardy, marios so it should be the time deployment steps take? won't puppet tasks be taking time. we need to configure services inside new containers | 08:27 |
| shardy | janki: we don't run puppet in the container where the service runs | 08:28 |
| shardy | we run a container with puppet inside, then write out the config files | 08:29 |
| marios | social: can you add a comment on the review so we can update it (tried pinging matbu on hangout to see if his travel adventures are over but haven't heard yet ) | 08:29 |
| shardy | then afterwards we run another container and pass those config files in | 08:29 |
| shardy | janki: so the downtime is unrelated to how long it takes to run puppet | 08:29 |
| shardy | which may be an improvement on the old model in some cases | 08:29 |
| shardy | janki: the downtime for each service is basically just how long it takes paunch/docker to restart the container | 08:30 |
| social | marios: we found typo in our flow :) | 08:30 |
| marios | social: i think it is related to what yprokule was saying i.e. indeed we need to wire the --container-registry-file | 08:30 |
| social | marios: the process is very error firendly | 08:30 |
| janki | shardy, ohk....let me try to measure it and I will share the results | 08:30 |
| janki | shardy, marios thanks for all the explanation. its really helpful :) | 08:31 |
| marios | np janki thanks to shardy :) | 08:31 |
| shardy | janki: if you want to simulate it, you can change TRIPLEO_CONFIG_HASH in the json file we write from docker_puppet.py | 08:32 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/docker/docker-puppet.py#L378 | 08:32 |
| shardy | see /var/lib/tripleo-config/hashed-docker-container-startup-config-step_*.json' | 08:33 |
| *** jaosorior has quit IRC | 08:33 | |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps-tasks.yaml#L53 | 08:33 |
| shardy | janki: you could then re-run paunch like in the deploy steps ^^ | 08:33 |
| shardy | and you should see just the container where the config hash changed get restarted | 08:34 |
| paramite | Hey guys, just wanted to ask here. For ~last two weeks my deployments sometimes fails with https://paste.fedoraproject.org/paste/~Dbojk3wcEUxHV7MB7fxKA . The solution for this is to re-run deployment few times and in the end it passes. Is this a known issue or should I create a bug? | 08:34 |
| *** jaosorior has joined #tripleo | 08:34 | |
| shardy | that doesn't quite simulate the case where there's a new image, but it should give you an estimate | 08:34 |
| *** aditya_r is now known as aditya_r|lunch | 08:34 | |
| janki | shardy, i will give that a try. thanks for pointing | 08:35 |
| shardy | paramite: it looks like a bug, what errors are there starting the nova services? | 08:35 |
| paramite | shardy, this is a whole output: https://paste.fedoraproject.org/paste/8~ys6skHK~h8YS1n~VFkXQ | 08:36 |
| shardy | paramite: sorry it's failing running docker-puppet.py - I'd try running that manually perhaps | 08:36 |
| paramite | shardy, didn't find any other error than that | 08:37 |
| paramite | shardy, ok, will do that when I will hit it again | 08:37 |
| bandini | jaosorior: thoughts on my last comments re https://review.openstack.org/#/c/489132/ ? | 08:38 |
| shardy | paramite: http://paste.openstack.org/show/621399/ looks like the relevant part, I think we shouldn't be trying to connect to any db when running docker-puppet, as it's supposed to apply only the puppet tags that write the config files | 08:41 |
| shardy | paramite: so it probably is a bug I think - I'm unclear why it's not persistent though | 08:41 |
| shardy | paramite: perhaps owalsh or lyarwood may have some ideas - I've not seen that issue before myself | 08:41 |
| jaganathan | d0ugal, shardy, please look into https://review.openstack.org/#/c/486425/ | 08:43 |
| paramite | shardy, yeah the problem is not persistent. Usually 3 reruns and deployment passes | 08:43 |
| shardy | paramite: weird, maybe you could try running docker-puppet just for that service, and/or in single process mode trying to reproduce | 08:45 |
| shardy | https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/tips_tricks.html#debugging-docker-puppet-py | 08:45 |
| paramite | shardy, ack, will do next time it hit's me. I've did rerun deploy before asking unfortunately | 08:46 |
| *** ykarel|lunch is now known as ykarel | 08:47 | |
| openstackgerrit | Merged openstack/tripleo-common stable/ocata: Remove machine-id from image https://review.openstack.org/493685 | 08:48 |
| *** udesale has quit IRC | 08:50 | |
| lyarwood | shardy / paramite ; odd, I can't think why puppet-nova would call out to ovs-vsctl like that, owalsh might have more insight. | 08:51 |
| shardy | lyarwood: ack, thanks for looking anyway :) | 08:51 |
| chandankumar | arxcruz: hello | 08:52 |
| *** mrch has joined #tripleo | 08:54 | |
| *** iranzo has quit IRC | 08:57 | |
| *** udesale has joined #tripleo | 09:03 | |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-quickstart master: Increase default size of extra disks to 3G https://review.openstack.org/505122 | 09:03 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Allow log path transformation in fluentd glue https://review.openstack.org/502501 | 09:04 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add unit tests for fluentd profile https://review.openstack.org/505124 | 09:04 |
| *** udesale has quit IRC | 09:05 | |
| *** udesale has joined #tripleo | 09:05 | |
| *** milan has joined #tripleo | 09:07 | |
| jaosorior | bandini: so, the issue with the ansible based approach is that currently if we do it via "host_prep_tasks" or "upgrade_tasks" (or however those are actually called), they | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 09:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 09:10 |
| jaosorior | they're ran on each node individually | 09:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 09:10 |
| *** udesale__ has joined #tripleo | 09:10 | |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 09:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 09:10 |
| jaosorior | bandini: so we would need to generate the key via heat, or before that if we want them to be the same | 09:10 |
| openstackgerrit | Jan Provaznik proposed openstack/tripleo-common master: Allow nfs-ganesha setup in ceph-ansible workbook https://review.openstack.org/505126 | 09:10 |
| bandini | jaosorior: right. but if we create the key via heat and never use it *except* on upgrade, how would that sound for you? | 09:10 |
| jaosorior | bandini: that's fine for me | 09:10 |
| bandini | jaosorior: ack | 09:11 |
| *** udesale has quit IRC | 09:12 | |
| *** salmankhan has joined #tripleo | 09:12 | |
| *** skramaja_afk is now known as skramaja | 09:13 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: [WIP] Add all services to multinode-containers-scenarios https://review.openstack.org/501872 | 09:14 |
| openstackgerrit | Siyi Luo proposed openstack/tripleo-quickstart master: Update the documentation link for doc migration https://review.openstack.org/505127 | 09:15 |
| tmorin | Hi EmilienM, yolanda, rnoriega_ : had you seen my question yesterday about gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet , that systematically fails since last Thursday and prevents us from merging anything in networking-bgpvpn... ? | 09:21 |
| *** achadha has joined #tripleo | 09:22 | |
| *** abregman is now known as abregman|mtg | 09:24 | |
| shardy | tmorin: Is it due to https://bugs.launchpad.net/tripleo/+bug/1717550 perhaps? | 09:25 |
| openstack | Launchpad bug 1717550 in tripleo "Repositories have unresolved dependencies in centos 7.4" [Critical,In progress] - Assigned to Lars Kellogg-Stedman (larsks) | 09:25 |
| *** aditya_r|lunch is now known as aditya_r | 09:26 | |
| shardy | there's a fix posted, I'm testing it locally right now, hopefully we can merge it asap | 09:26 |
| *** achadha has quit IRC | 09:26 | |
| tmorin | shardy: I don't know, here are the logs of a failed run: http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/ | 09:28 |
| sri_ | shardy: Hi , I am trying to deploy overcloud with multi nic, In my setup, I've 10 physical servers with two nics attached, and I've deployed undercloud in physical server, all other servers running one kvm for server with two nics attached, So I am trying to use first nic for provisining and second nic for external. I've used (cybertron/tripleo-scripts) GUI tool to generate a heat templates https://pasteboard.co/GL4dvIf.png. I am not | 09:28 |
| sri_ | after deploying overcloud second nic in my vms not getting any IP address. this is all of my configuration http://paste.openstack.org/show/621403/ | 09:28 |
| tmorin | shardy: how can I tell if the failure is related to bug 1717550 ? | 09:28 |
| openstack | bug 1717550 in tripleo "Repositories have unresolved dependencies in centos 7.4" [Critical,In progress] https://launchpad.net/bugs/1717550 - Assigned to Lars Kellogg-Stedman (larsks) | 09:28 |
| tmorin | shardy: looking at the logs it seems that perhaps tempest tests are failing on undercloud ( end of http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/quickstart_install.txt.gz ): is this something possible ? | 09:30 |
| shardy | tmorin: yeah it doesn't seem to be the same issue, sec digging through the logs | 09:30 |
| shardy | http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/undercloud/home/jenkins/tempest_output.log.txt.gz | 09:32 |
| shardy | tmorin: yeah seems to be a tempest failure | 09:32 |
| tmorin | shardy: yes, I see this as well | 09:32 |
| *** gfidente has joined #tripleo | 09:33 | |
| *** gfidente has quit IRC | 09:33 | |
| *** gfidente has joined #tripleo | 09:33 | |
| tmorin | shardy: this perhaps would be the root: http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/subnode-2/var/log/nova/nova-api.log.txt.gz#_2017-09-19_08_08_27_382 | 09:34 |
| shardy | tmorin: yeah that doesn't look too good | 09:35 |
| shardy | http://tripleo.org/cistatus.html shows that job has passed recently though which is surprising | 09:35 |
| * shardy wonders why the nova-api logs refer to a mysql config file..?! | 09:36 | |
| tmorin | shardy: it's not what I see (all blue/orange since last Friday) or am I looking at the wrong place ? | 09:36 |
| *** tosky has joined #tripleo | 09:37 | |
| shardy | http://tripleo.org/cistatus.html has a pass of scenario004-multinode-oooq at 2017-09-19 06:18:29 | 09:37 |
| tmorin | shardy: nova sqlalchemy instantiates a pymysql that parses my.cnf (to know the parameters to access the DB I guess ?) | 09:37 |
| tmorin | shardy: the problematic job is gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet | 09:38 |
| shardy | tmorin: aha, that sounds... ugly | 09:38 |
| tmorin | shardy: not gate-tripleo-ci-centos-7-scenario004-multinode-ooq | 09:38 |
| shardy | I thought we gave nova a connection string instead, that coupling seems less than ideal | 09:38 |
| shardy | but thanks for clarifying | 09:38 |
| tmorin | I googled and found this : https://github.com/PyMySQL/PyMySQL/issues/548 | 09:38 |
| tmorin | shardy: ^ .. which has mentions of tripleo in comments btw | 09:38 |
| shardy | tmorin: so is gate-tripleo-ci-centos-7-scenario004-multinode-ooq a different scenario 004? | 09:39 |
| tmorin | shardy: yes, it must look at this file for other things, suprising indeed | 09:39 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Listen for messages from internal introspect workflow https://review.openstack.org/504035 | 09:39 |
| shardy | tmorin: Ok well bandini ^^ reported that so lets ask him about it :) | 09:39 |
| shardy | https://github.com/openstack/puppet-tripleo/commit/28853dba9d3d1f5f7fcbca58963489789641ae04 | 09:40 |
| * bandini appears | 09:40 | |
| bandini | tmorin: what's the question exactly? | 09:41 |
| tmorin | bandini: looking at the cause for sytematical failure of gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet since last Friday | 09:41 |
| shardy | puppet-tripleo-8.0.0-0.20170914233515.9939df4.el7.centos.noarch in http://logs.openstack.org/84/502684/8/check/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/459ab11/logs/rpm-qa.txt.gz | 09:42 |
| shardy | so should have your patch bandini? | 09:42 |
| tmorin | shardy: yes, I found bug 1663181 as well | 09:42 |
| openstack | bug 1663181 in tripleo "Longer term fix for VIP failover issue and clash with cellsv2" [High,Fix released] https://launchpad.net/bugs/1663181 - Assigned to Michele Baldessari (michele) | 09:42 |
| tmorin | well no 1663181 is not directly related, although mentioned in https://github.com/openstack/puppet-tripleo/commit/28853dba9d3d1f5f7fcbca58963489789641ae04 | 09:43 |
| shardy | bandini: in the scrollback there's a link to the CI job where nova-api breaks trying to parse my.cnf | 09:43 |
| shardy | that's going to be fun when someone deploys nova-api on a different node to the DB cluster | 09:43 |
| *** fandrieu has quit IRC | 09:44 | |
| shardy | but anyway ;) | 09:44 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates stable/pike: Change to boolean for boolean type params https://review.openstack.org/505139 | 09:44 |
| bandini | shardy: the problem is described exactly here https://bugs.launchpad.net/tripleo/+bug/1717545/comments/14 | 09:44 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 09:44 |
| bandini | shardy: apparently https://review.openstack.org/#/c/504977/ fixes it | 09:44 |
| bandini | tmorin: ^ | 09:45 |
| shardy | bandini: ack, thanks for the info :) | 09:46 |
| bandini | np ;) | 09:46 |
| panda | yeah, the revert did not work properly, and it wouldn't be merged anyway | 09:46 |
| chandankumar | panda: hello | 09:47 |
| chandankumar | panda: How i can featureset006 scenario jobs using ovb on rdocloud? | 09:47 |
| chandankumar | panda: each time i am hitting this erro https://paste.fedoraproject.org/paste/r5g-qFmMELvrsh7N0K~-UQ | 09:48 |
| panda | chandankumar:can you paste the complete command ? | 09:50 |
| tmorin | bandini: I'm happy if there is a fix in flight, but the relation between effects and fix is not obvious without digging | 09:50 |
| tmorin | bandini, shardy: I'll follow https://review.openstack.org/#/c/504977/ and recheck when it merges | 09:50 |
| chandankumar | panda: bash devmode.sh -n -o -d -c featureset006 | 09:50 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-common master: Add ODL repo to override template https://review.openstack.org/502915 | 09:50 |
| bandini | tmorin: ack. If you need additional explanation as to what the heck is going on there, do let me know | 09:51 |
| chandankumar | panda: i tried this also export CONFIG=ovb-ha-multiple-nics and then run the command | 09:51 |
| chandankumar | each time same error | 09:51 |
| *** salmankhan has quit IRC | 09:53 | |
| *** salmankhan has joined #tripleo | 09:53 | |
| panda | chandankumar: featureset006 is not compatible with OVB, it's a multinode scenario | 09:56 |
| chandankumar | ah | 09:56 |
| tmorin | bandini, shardy: what would have been nice, in an ideal world, would have been to file a bug in networking-bgpvpn and networking-l2gw (people affected by failures of the job) so that the people there can track resolution progress | 09:57 |
| openstackgerrit | Merged openstack/tripleo-validations master: Fix name of controller token validation https://review.openstack.org/500555 | 09:57 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/newton: Migrate Swift ring handling from tripleo-heat-templates to puppet-tripleo https://review.openstack.org/503810 | 09:58 |
| shardy | tmorin: yeah that's a good idea - it was tagged with ci, but we could do better for sure | 10:00 |
| shardy | tmorin: I think what we're missing is a matrix of which jobs run where, as I don't think it would necessarily be clear to everyone that scenario004 runs in the gate for that repo | 10:01 |
| shardy | without digging in project-config etc | 10:01 |
| *** aditya_r has quit IRC | 10:03 | |
| *** aditya_r has joined #tripleo | 10:05 | |
| bandini | right, I had no idea either (but am not too versed in CI) | 10:06 |
| openstackgerrit | Chandan Kumar proposed openstack/tripleo-quickstart master: Add compute-feature-enabled.attach_encrypted_volume to True https://review.openstack.org/499928 | 10:09 |
| tmorin | shardy: yep, agreed, the info is in zuul/layout.xml but needs to be crossed with other tools to achieve that... | 10:09 |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 10:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 10:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 10:10 |
| shardy | tmorin: yeah, or perhaps per-scenario tags in launchpad or something | 10:10 |
| *** abregman|mtg is now known as abregman | 10:18 | |
| *** aditya_r has quit IRC | 10:20 | |
| *** fandrieu has joined #tripleo | 10:20 | |
| jaosorior | panda: any idea if something changed in OVB or in the jobs lately? I'm getting errors such as this: http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/6406830/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_06_59_03_212 | 10:21 |
| *** fandrieu_ has joined #tripleo | 10:22 | |
| *** mrunge has quit IRC | 10:23 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Set Ceph pgp_num after pg_num https://review.openstack.org/505153 | 10:24 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add unit tests for fluentd profile https://review.openstack.org/505124 | 10:24 |
| *** fandrieu has quit IRC | 10:25 | |
| *** fandrieu_ is now known as fandrieu | 10:25 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Set Ceph pgp_num after pg_num https://review.openstack.org/505153 | 10:25 |
| *** mrunge has joined #tripleo | 10:25 | |
| skramaja | shardy marios is there any open items regarding upgrade o->p.. i hit with a gnochi related issues earlier and turned out to disable telemetry altogether.. now step1 is complete. failing on computedpdk upgade (step2).. | 10:28 |
| skramaja | shardy: marios this is error i am getting | 10:29 |
| skramaja | ERROR! the playbook: overcloud-compute-0/tripleo-JbK7PV-config/upgrade_steps_playbook.yaml could not be found | 10:29 |
| skramaja | looks like the upgrade_steps_playbook.yaml file is not found in the config downloaded folder.. | 10:30 |
| *** udesale__ has quit IRC | 10:32 | |
| *** udesale has joined #tripleo | 10:32 | |
| *** jtomasek has quit IRC | 10:33 | |
| *** jtomasek has joined #tripleo | 10:34 | |
| bandini | skramaja: does your python-tripleoclient have https://review.openstack.org/#/c/485732/ ? | 10:36 |
| bandini | I hit that issue as well and my tripleoclient package did not have that review (which then fixed things) | 10:36 |
| skramaja | thanks bandini, i dont have this patch. gonna apply and try it. | 10:38 |
| skramaja | bandini: any other related patches that you are aware of? | 10:38 |
| bandini | skramaja: not off the top of my head, no | 10:38 |
| *** hjensas has quit IRC | 10:39 | |
| skramaja | thanks bandini. will try with it. | 10:39 |
| *** hjensas has joined #tripleo | 10:39 | |
| marios | skramaja: o/ sorry was on a call reading back | 10:40 |
| marios | skramaja: so if there is no upgrade steps playbook then you may be missing some tht patch (can you do openstack stack output show RoleConfig OK?) | 10:41 |
| marios | skramaja: && that patch bandini points out for client | 10:41 |
| *** jkilpatr has quit IRC | 10:42 | |
| skramaja | marios: i am going to try with this patch and will update you for the command.. | 10:42 |
| *** tzumainn has joined #tripleo | 10:43 | |
| panda | jaosorior: not in upstream, that I know of. The images changed to centos 7.4 | 10:43 |
| *** chem has joined #tripleo | 10:43 | |
| *** oidgar has joined #tripleo | 10:47 | |
| *** timothyb89 has quit IRC | 10:48 | |
| openstackgerrit | Jose Luis Franco proposed openstack/python-tripleoclient stable/pike: Increase timeout in get_deprecated_parameters workflow https://review.openstack.org/505166 | 10:50 |
| *** thrash|g0ne is now known as thrash | 10:50 | |
| *** iranzo has joined #tripleo | 10:50 | |
| *** iranzo has quit IRC | 10:50 | |
| *** iranzo has joined #tripleo | 10:50 | |
| *** marios has quit IRC | 10:53 | |
| *** udesale has quit IRC | 10:54 | |
| *** udesale has joined #tripleo | 10:55 | |
| *** iranzo is now known as iranzo|AFK | 10:56 | |
| *** iranzo|AFK is now known as iranzo | 10:57 | |
| *** dtantsur|afk is now known as dtantsur | 10:58 | |
| *** salmankhan has quit IRC | 10:58 | |
| *** salmankhan has joined #tripleo | 10:58 | |
| *** morazi has quit IRC | 11:00 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Update panko port in env ssl yaml files to correct one https://review.openstack.org/500957 | 11:08 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 11:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 11:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 11:10 |
| *** abregman is now known as abregman|mtg | 11:12 | |
| *** cshastri has quit IRC | 11:13 | |
| *** jaganathan has quit IRC | 11:13 | |
| *** jkilpatr has joined #tripleo | 11:15 | |
| *** abishop has quit IRC | 11:18 | |
| *** aufi has quit IRC | 11:18 | |
| *** ffiore has quit IRC | 11:20 | |
| *** sri_ has quit IRC | 11:23 | |
| *** sri_ has joined #tripleo | 11:27 | |
| *** pdeore has quit IRC | 11:27 | |
| *** jjoyce|gone is now known as jjoyce | 11:27 | |
| *** sri_ has quit IRC | 11:30 | |
| *** aufi has joined #tripleo | 11:32 | |
| dtantsur | mwhahaha: hi! could you please review these blueprints for queens too: https://blueprints.launchpad.net/tripleo/+spec/ansible-deploy and https://blueprints.launchpad.net/tripleo/+spec/ironic-direct-deploy | 11:36 |
| *** abregman|mtg is now known as abregman | 11:36 | |
| *** kopec_piotr has joined #tripleo | 11:37 | |
| dtantsur | I may have a few more coming; all are mostly integration work and have low impact on stability and other features | 11:37 |
| kopec_piotr | Hi all, I have a simple question: in undercloud.conf paramete undercloud_admin_host should be set to IP/FQDN from the provisioning network and undercloud_public_host should be set to IP/FQDN from the external network, correct? | 11:39 |
| *** jpena is now known as jpena|lunch | 11:40 | |
| jaosorior | kopec_piotr: they use the same network. those parameters will result in the keystone endpoints (if SSL is used) that will be terminated by HAProxy. | 11:41 |
| jaosorior | kopec_piotr: note that it'll only affect the undercloud. | 11:41 |
| *** aufi has quit IRC | 11:44 | |
| kopec_piotr | jaosorior: ok, I thought that overcloud nodes are using those endpoints to get configuration (from undercloud's swift, i guess) | 11:45 |
| *** pgadiya has quit IRC | 11:45 | |
| *** dpawar has quit IRC | 11:46 | |
| *** morazi has joined #tripleo | 11:46 | |
| jaosorior | kopec_piotr: undercloud.conf is for the undercloud deployment. | 11:46 |
| jaosorior | kopec_piotr: you modify or customize your overcloud configuration via heat parameters | 11:47 |
| *** rbowen has joined #tripleo | 11:47 | |
| jaosorior | kopec_piotr: so, for instance, lets say that you want to use TLS in the public endpoints, and use IP addresses, you would modify a parameter called EndpointMap, with a file such as this one https://github.com/openstack/tripleo-heat-templates/blob/master/environments/tls-endpoints-public-ip.yaml | 11:48 |
| jaosorior | kopec_piotr: if you would want to use hostnames instead of IPs for the public endpoints, and TLS, you would use a file such as this one https://github.com/openstack/tripleo-heat-templates/blob/master/environments/tls-endpoints-public-dns.yaml | 11:49 |
| *** jaganathan has joined #tripleo | 11:49 | |
| *** nyechiel has joined #tripleo | 11:50 | |
| *** shreshtha has quit IRC | 11:54 | |
| *** shreshtha has joined #tripleo | 11:54 | |
| *** abishop has joined #tripleo | 11:56 | |
| *** marios has joined #tripleo | 11:57 | |
| *** adarazs is now known as adarazs_brb | 11:57 | |
| kopec_piotr | jaosorior: ok, make sense, however I still don't get why I am getting this error https://pastebin.com/9JmdBcur on overcloud nodes during deployment | 11:57 |
| *** dpawar has joined #tripleo | 11:57 | |
| *** aufi has joined #tripleo | 11:57 | |
| jaosorior | that's funky | 11:58 |
| jaosorior | kopec_piotr: are you sure that comes from an overcloud deployment? | 11:58 |
| jaosorior | oh wait | 11:58 |
| jaosorior | reading again | 11:58 |
| jaosorior | kopec_piotr: well, that could be several things | 11:58 |
| jaosorior | kopec_piotr: I suppose you're deploying with network isolation, right? | 11:59 |
| kopec_piotr | jaosorior: correct | 11:59 |
| jaosorior | kopec_piotr: why are those undercloud endpoints resolving to an IP in the external network? | 11:59 |
| jaosorior | kopec_piotr: I suggest you use an address in the ctlplane or provisioning network. | 12:00 |
| jaosorior | you generally don't want to give accessibility to the undercloud from the external network, since it contains a lot of sensitive information. | 12:00 |
| *** adarazs_brb is now known as adarazs | 12:01 | |
| jaosorior | brb | 12:02 |
| *** jaosorior has quit IRC | 12:02 | |
| *** nyechiel has quit IRC | 12:03 | |
| *** bfournie has joined #tripleo | 12:04 | |
| *** panda is now known as panda|lunch | 12:05 | |
| *** liverpooler has quit IRC | 12:06 | |
| *** liverpooler has joined #tripleo | 12:08 | |
| mnaser | http://status.openstack.org/zuul/ -- could anyone here abandon/unabandon the changes above the stack to change puppet-nova #504977 | 12:08 |
| mnaser | they will fail and they're just gonna add another 4-6 hours before anything merges | 12:08 |
| *** bfournie has quit IRC | 12:08 | |
| mnaser | mwhahaha when/if you're around ^ :> | 12:09 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 12:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| *** ffiore has joined #tripleo | 12:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 12:10 |
| *** jschlueter is now known as jschlueter|afk | 12:11 | |
| *** raildo has joined #tripleo | 12:13 | |
| *** dprince has joined #tripleo | 12:16 | |
| *** MVenesio has joined #tripleo | 12:19 | |
| *** rlandy has joined #tripleo | 12:19 | |
| *** pchavva has joined #tripleo | 12:20 | |
| *** shreshtha has quit IRC | 12:22 | |
| *** trown|outtypewww is now known as trown | 12:23 | |
| *** skramaja has quit IRC | 12:25 | |
| *** atoth has joined #tripleo | 12:25 | |
| *** jaganathan has quit IRC | 12:26 | |
| *** pblaho has joined #tripleo | 12:26 | |
| *** aputtur has joined #tripleo | 12:30 | |
| mcornea | shardy: hi! I have a question about deprecated_params in https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L167-L172 - in case we have custom roles what should we set them to? let's say in case there's a custom compute role called ComputeAlt? | 12:31 |
| *** sid2 has quit IRC | 12:35 | |
| *** sid1 has joined #tripleo | 12:37 | |
| *** jschlueter|afk is now known as jschlueter | 12:37 | |
| *** sshnaidm has joined #tripleo | 12:38 | |
| *** jaganathan has joined #tripleo | 12:38 | |
| *** amoralej is now known as amoralej|lunch | 12:39 | |
| *** bfournie has joined #tripleo | 12:41 | |
| *** ansmith has joined #tripleo | 12:41 | |
| *** jpena|lunch is now known as jpena | 12:42 | |
| *** suuuper has joined #tripleo | 12:43 | |
| *** sshnaidm has quit IRC | 12:47 | |
| *** leitan has joined #tripleo | 12:48 | |
| *** catintheroof has joined #tripleo | 12:49 | |
| *** pblaho has quit IRC | 12:52 | |
| jistr | flaper87: hi, i just gave a try to the kube installation patch and i'm getting [error=Size of 'output' is 4907KB which exceeds the limit of 4096KB, action=tripleo.ansible-playbook, task=deploy_kubernetes] -- have you seen that before? | 12:53 |
| jistr | looks like ansible stdout is too long so mistral refuses to save it | 12:53 |
| *** tmorin has quit IRC | 12:53 | |
| *** pblaho has joined #tripleo | 12:55 | |
| *** jmelvin has joined #tripleo | 12:55 | |
| jistr | i guess ceph-ansible could potentially that too /cc gfidente fultonj | 12:55 |
| *** cdearborn has joined #tripleo | 12:56 | |
| *** jcoufal has joined #tripleo | 12:56 | |
| gfidente | jistr whohooo | 12:57 |
| gfidente | we're using verbosity: 0 | 12:57 |
| gfidente | fwiw | 12:57 |
| *** Goneri has joined #tripleo | 12:57 | |
| gfidente | but I remember mistral was a string | 12:57 |
| gfidente | mistral db type I mean | 12:57 |
| jistr | ack thanks, i'll try setting that locally too | 12:57 |
| fultonj | jistr: yes, if you crank up verbosity you run that risk | 12:58 |
| *** ratailor has quit IRC | 12:58 | |
| fultonj | we need a better fix, verbosity=0 is a workaround | 12:58 |
| gfidente | :D | 12:58 |
| gfidente | now we're talking | 12:58 |
| d0ugal | Should I put up a patch to increase the db col? | 12:58 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Add feature sets for containerized overcloud and network isolation https://review.openstack.org/503812 | 12:58 |
| fultonj | d0ugal: that would be great | 12:58 |
| d0ugal | jistr: do you have a traceback from the mistral logs? | 12:59 |
| jistr | d0ugal: http://paste.openstack.org/show/621419/ | 13:00 |
| d0ugal | thanks. | 13:01 |
| jistr | thank you :) | 13:01 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-common master: DO NOT MERGE - Add no-op change for containers update testing https://review.openstack.org/498898 | 13:03 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add redux-form-validators dependency https://review.openstack.org/504902 | 13:03 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Refactor Register nodes dialog to use redux-form https://review.openstack.org/504903 | 13:03 |
| *** jaganathan has quit IRC | 13:04 | |
| fultonj | has anyone recently installed quickstart? when I do I have a package conflict: http://paste.openstack.org/show/621421 | 13:04 |
| larsks | fultonj: https://bugs.launchpad.net/tripleo/+bug/1717550 | 13:05 |
| openstack | Launchpad bug 1717550 in tripleo "Repositories have unresolved dependencies in centos 7.4" [Critical,In progress] - Assigned to Lars Kellogg-Stedman (larsks) | 13:05 |
| fultonj | thanks larsks | 13:05 |
| openstackgerrit | Chenghui Yu proposed openstack/puppet-tripleo master: Update openstackdocstheme to latest version https://review.openstack.org/505224 | 13:05 |
| jistr | re ansible logs, we might also move the ansible logs elsewhere (ARA?) if/when we move towards the `config download` method rather than executing via Heat, but nevertheless 4KB seems quite limiting stdout capture that should be generally usable | 13:06 |
| gfidente | jistr I think that's what slagle is proposing as well | 13:07 |
| jistr | *... quite limiting for stdout capture ... | 13:07 |
| *** abregman has quit IRC | 13:08 | |
| jistr | yea i read that. I like the idea. It's kind of a prerequisite to be able to do the SW part of split stack outside heat. IIUC we cannot really go for `config download` + external execution, unless we move 100% of the SW config to support this. | 13:09 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 13:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 13:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 13:10 |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| *** kopec_piotr has left #tripleo | 13:11 | |
| shardy | fultonj: note that if you apply locally you have to use --no-clone and rm -fr ~/.quickstart | 13:11 |
| *** kopec_piotr has joined #tripleo | 13:12 | |
| *** kopec_piotr has left #tripleo | 13:12 | |
| fultonj | shardy: ok, i'll try that | 13:12 |
| hamzy | I am now seeing "ERROR heat.engine.resource ResourceInError: Went to status ERROR due to "Message: No valid host was found. There are not enough hosts available., Code: 500" | 13:12 |
| hamzy | how do I debug this heat failure further? http://paste.openstack.org/show/621424/ | 13:12 |
| slagle | jistr: yea that's what i'm working on atm fwiw | 13:13 |
| *** bfournie has quit IRC | 13:13 | |
| hamzy | mwhahaha, ? | 13:13 |
| jistr | gfidente: i was wondering if we want to pull the extraconfig playbooks (ceph-ansible, kubespray) into a "common main ansible run", or maybe execute ansible-playbook from ansible-playbook. So far i'm leaning towards the latter. It seems a bit weird to nest it like this, but imo it's better than munging too many unrelated playbooks together (e.g. it might be better to separate inventories, extra_vars etc. | 13:13 |
| jistr | between those playbooks) | 13:13 |
| slagle | jistr: i'd rather not build upon the model of Heat->Mistral if we can avoid it. is there anything in the kubernetes install steps that require it to be interleaved in the templates? | 13:13 |
| fultonj | hamzy: i do this http://blog.johnlikesopenstack.com/2016/01/check-nova-scheduler-if-triple-o-tells.html?q=no+valid+host+found | 13:13 |
| shardy | hamzy: https://docs.openstack.org/ironic/latest/admin/troubleshooting.html#nova-returns-no-valid-host-was-found-error may help? | 13:14 |
| shardy | hamzy: normally it means either the ironic nodes are in the wrong state (not available, in maintenance mode), or you have a mismatch with your flavors and/or node/profile tagging | 13:14 |
| hamzy | there are no ironic errors | 13:14 |
| gfidente | jistr slagle man I am looking forward | 13:15 |
| hamzy | ironic deployed both baremetal nodes | 13:15 |
| gfidente | for those days when we deploy the openstack services via apb | 13:15 |
| gfidente | and pull in from heat only composable tasks describing which plyabook to run | 13:15 |
| jistr | slagle: flaper87 might know better but i think at the very least we need docker stood up, and we do it via puppet/services/docker.yaml (see the service list https://review.openstack.org/#/c/471759/66/ci/environments/scenario006-multinode.yaml ) | 13:15 |
| gfidente | so then ceph-ansible will be just leading the group :D | 13:15 |
| fultonj | shardy: i figure i would also need to use a modified version of oooq w/ larsks's patch | 13:15 |
| fultonj | until it lands | 13:15 |
| shardy | hamzy: well no valid host means ironic couldn't find a valid host - if that error came from an overcloud deploy, it means there was a lack of valid hosts | 13:15 |
| shardy | hamzy: were you trying to scale out an existing deployment? | 13:15 |
| *** gbarros has joined #tripleo | 13:16 | |
| shardy | hamzy: failing that I'd check those docs and the nova-scheduler logs | 13:16 |
| hamzy | shardy, https://fedoraproject.org/wiki/User:Hamzy/TripleO_mixed_undercloud_overcloud_try7 | 13:17 |
| slagle | jistr: ack. i'm hoping flaper87 will reply to my mail with how the future apb stuff would fit into that model :) | 13:17 |
| *** udesale has quit IRC | 13:17 | |
| *** mjturek has joined #tripleo | 13:17 | |
| jistr | slagle: btw WDYT about the way we should be executing the "inner playbooks"? pulling them into one big ansible-playbook run, or executing multiple separate (nested?) ansible-playbook runs? (re what i wrote at xx:13 above) | 13:18 |
| *** chlong has joined #tripleo | 13:19 | |
| gfidente | slagle jistr I think has to be a subcall to ansible-playbook | 13:19 |
| gfidente | because ceph-ansible and kubernetes | 13:19 |
| *** toure_biab is now known as toure|ptg | 13:19 | |
| gfidente | need a differently formatted inventory file | 13:19 |
| *** toure|ptg is now known as toure | 13:19 | |
| jistr | right, that's what i was thinking | 13:19 |
| gfidente | so I was thinking about adding per-service IPs into validations inventory build | 13:19 |
| gfidente | to see if we can share one | 13:20 |
| shardy | hamzy: I don't think the heat-engine error corresponds to the overcloud deploy error, that says overcloud.ComputeAllNodesValidationDeployment.0 failed, which means there's probably something up with the networking so it can't ping the gateway listed in the output | 13:20 |
| slagle | jistr: yea, i think separate ansible-playbook is fine. it's what we talked about at ptg for the ceph-ansible case | 13:20 |
| fultonj | +1 on supporting diff inventories | 13:20 |
| shardy | Ping to 172.16.0.18 failed. Retrying... | 13:20 |
| shardy | that's why it failed | 13:20 |
| hamzy | shardy, could it also be because the heat didn't create a VM that uses the address of 172.16.0.18? | 13:21 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart master: Change devmode to deploy containerized services by default https://review.openstack.org/472412 | 13:21 |
| jistr | ok cool re separate inventories (and extra_vars, etc.) | 13:21 |
| *** mjturek has quit IRC | 13:21 | |
| *** bfournie has joined #tripleo | 13:22 | |
| slagle | is there an ansible module for ansible-playbook? :) | 13:22 |
| slagle | if not, it could be a separate execution | 13:22 |
| jistr | i looked, but didn't find one | 13:22 |
| slagle | or just done via "command" module | 13:22 |
| jistr | at least not among the builtins | 13:22 |
| *** abregman has joined #tripleo | 13:23 | |
| shardy | hamzy: I suspect it's the port for the tenant network on the controller? | 13:24 |
| shardy | hamzy: each node tried to ping the relevant IP on the controller to ensure the isolated networks aren't broken | 13:25 |
| *** aditya_r has joined #tripleo | 13:25 | |
| jistr | slagle: yea imo command would be fine to start with, and we could expand on it (e.g. write a playbook module if there indeed is none -- i haven't searched for 3rd party one yet | 13:25 |
| jistr | ) | 13:25 |
| shardy | hamzy: I think that's in the default range gor the Tenant network | 13:25 |
| shardy | see environments/network-environment.yaml | 13:25 |
| *** panda|lunch is now known as panda | 13:25 | |
| hamzy | shardy, "openstack subnet list" does show "| 02e2adf9-cfe9-4452-bbaf-5ee09226d3dd | tenant_subnet | 6a0be84a-26af-4383-a65a-fe14d97d941a | 172.16.0.0/24 |" | 13:26 |
| shardy | hamzy: Ok, so I'd start digging there, log onto the compute node and check the tenant network is up, I guess it's not because the ping fails | 13:26 |
| owalsh | shardy, paramite, lyarwood: https://paste.fedoraproject.org/paste/8~ys6skHK~h8YS1n~VFkXQ line 334 looks suspect, OOM possibly? | 13:27 |
| *** gbarros has quit IRC | 13:27 | |
| *** owalsh is now known as owalsh_biab | 13:27 | |
| shardy | owalsh_biab: Hmm yeah that's definitely a good thing to check, thanks! | 13:28 |
| *** toure is now known as toure_biab | 13:28 | |
| *** tiswanso has quit IRC | 13:33 | |
| *** abregman has quit IRC | 13:36 | |
| gfidente | slagle should do it the hard way | 13:37 |
| gfidente | and start writing the module first! | 13:37 |
| *** mjturek has joined #tripleo | 13:37 | |
| gfidente | I'll send chocolate | 13:37 |
| *** abregman has joined #tripleo | 13:37 | |
| *** dtantsur is now known as dtantsur|lunch | 13:38 | |
| *** dpawar has quit IRC | 13:39 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui master: Exclude outdated validation results from list https://review.openstack.org/501214 | 13:41 |
| *** jobewan has joined #tripleo | 13:44 | |
| hamzy | shardy, there seems to be a vlan for that network http://paste.openstack.org/show/621427/ do you know how to show more information on it? | 13:45 |
| slagle | gfidente: come on man, you know chocolate is not the way to bribe me | 13:50 |
| openstackgerrit | Chenghui Yu proposed openstack/puppet-pacemaker master: Update openstackdocstheme to latest version https://review.openstack.org/505267 | 13:52 |
| *** dmarlin has quit IRC | 13:52 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add centos base yum repo to upgrade role https://review.openstack.org/505268 | 13:52 |
| gfidente | slagle I think if we let this go unseen it's better now | 13:54 |
| mwhahaha | meeting in 6 mins, please update the agenda if you have something https://etherpad.openstack.org/p/tripleo-meeting-items | 13:54 |
| *** masco has quit IRC | 13:54 | |
| atoth | mwhahaha, is meeting here or on the openstack meeting channel now? | 13:57 |
| mwhahaha | here | 13:57 |
| atoth | thanks | 13:57 |
| *** lblanchard has joined #tripleo | 13:58 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add centos base yum repo to upgrade role https://review.openstack.org/505268 | 13:58 |
| *** dsariel has quit IRC | 14:00 | |
| mwhahaha | #startmeeting tripleo | 14:00 |
| mwhahaha | #topic agenda | 14:00 |
| mwhahaha | * review past action items | 14:00 |
| mwhahaha | * one off agenda items | 14:00 |
| mwhahaha | * bugs | 14:00 |
| mwhahaha | * Projects releases or stable backports | 14:00 |
| mwhahaha | * CI | 14:00 |
| mwhahaha | * Specs | 14:00 |
| openstack | Meeting started Tue Sep 19 14:00:29 2017 UTC and is due to finish in 60 minutes. The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| mwhahaha | * open discussion | 14:00 |
| mwhahaha | Anyone can use the #link, #action and #info commands, not just the moderatorǃ | 14:00 |
| mwhahaha | Hi everyone! who is around today? | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: tripleo)" | 14:00 | |
| openstack | The meeting name has been set to 'tripleo' | 14:00 |
| *** openstack changes topic to "agenda (Meeting topic: tripleo)" | 14:00 | |
| beagles | o/ | 14:00 |
| shardy | o/ | 14:00 |
| fultonj | o/ | 14:00 |
| jpich | o/ | 14:00 |
| slagle | hi | 14:00 |
| atoth | o/ | 14:00 |
| marios | o/ | 14:00 |
| oidgar | o/ | 14:01 |
| jfrancoa | o/ | 14:01 |
| *** shreshtha has joined #tripleo | 14:01 | |
| rasca | o/ | 14:01 |
| trown | o/ | 14:01 |
| cdearborn | o/ | 14:01 |
| gfidente | o/ | 14:01 |
| *** owalsh_biab is now known as owalsh | 14:02 | |
| mwhahaha | #topic review past action items | 14:02 |
| openstackgerrit | Janki Chhatbar proposed openstack/tripleo-common master: Add healthcheck for ODL container https://review.openstack.org/504864 | 14:02 |
| *** openstack changes topic to "review past action items (Meeting topic: tripleo)" | 14:02 | |
| mwhahaha | drop alert on Bug 1713832 and ping storage/zaqar people to investigate | 14:02 |
| openstack | bug 1713832 in tripleo "Object PUT failed for zaqar_subscription" [Critical,In progress] https://launchpad.net/bugs/1713832 - Assigned to Marios Andreou (marios-b) | 14:02 |
| mwhahaha | so we dropped the alert but I think it's still open | 14:02 |
| mwhahaha | the last update points to https://bugs.launchpad.net/swift/+bug/1715177 | 14:02 |
| openstack | Launchpad bug 1715177 in OpenStack Object Storage (swift) "Container cache management is racy" [Medium,Confirmed] | 14:02 |
| marios | mwhahaha: yeah i had a look and therve had a lead at some point but we still didn't find the root | 14:02 |
| *** Guest36641 is now known as melwitt | 14:03 | |
| marios | mwhahaha: i can revisit though i didn't look there all of last week | 14:03 |
| matbu | o/ | 14:03 |
| mwhahaha | marios: it looks like it's a swift problem so we should poke the storage folks | 14:03 |
| marios | mwhahaha: is it still relatively infrequent? (1/day?) /me fetches elastic recheck query | 14:03 |
| mwhahaha | yea i don't think it's happening as much as it used to | 14:03 |
| chem | o/ | 14:03 |
| marios | http://status.openstack.org/elastic-recheck/#1713832 this one | 14:03 |
| *** thrash has quit IRC | 14:04 | |
| mwhahaha | looks like it's still a problem so we just need to track it in swift | 14:04 |
| *** mrch has quit IRC | 14:04 | |
| mwhahaha | moving on to the next item | 14:04 |
| mwhahaha | shardy to look into version impacts in ci jobs related to Bug 1714361 | 14:04 |
| openstack | bug 1714361 in tripleo "Mistral on gates is old and does not have the required patches" [Critical,Fix released] https://launchpad.net/bugs/1714361 - Assigned to Alex Schultz (alex-schultz) | 14:04 |
| mwhahaha | shardy: i think we fixed that with the priority on repos | 14:05 |
| shardy | mwhahaha: Yeah I think we did that | 14:05 |
| mwhahaha | mwhahaha to retarget rc2 bugs if not release critical - i believe this was done but I will double check today | 14:05 |
| mwhahaha | shardy to look at how to reduce # of services deployed on ovb | 14:05 |
| therve | mwhahaha, I found the issue, but it's stuck lacking tests | 14:05 |
| mwhahaha | therve: ok let me know if there's anything we can do to help | 14:06 |
| shardy | mwhahaha: I made a start on that but need to revisit | 14:06 |
| mwhahaha | shardy: ok | 14:06 |
| mwhahaha | #action shardy to look at how to reduce # of services deployed on ovb (continued) | 14:06 |
| therve | mwhahaha, https://review.openstack.org/500978 | 14:06 |
| shardy | #link https://review.openstack.org/#/c/500942/ WIP ovb testing | 14:06 |
| mwhahaha | that's it on the past action items | 14:07 |
| therve | mwhahaha, Maybe they can relax the constraints so that we merge the fix | 14:07 |
| mwhahaha | therve: since that's the upstream swift stuff they'd have to sign off on that unfortunately. | 14:07 |
| *** thrash has joined #tripleo | 14:08 | |
| *** thrash has joined #tripleo | 14:08 | |
| therve | Yeah | 14:08 |
| shardy | cschwede: ^^ | 14:08 |
| therve | mwhahaha, We could disable the cache middleware in swift, but it might makes things slow(er) | 14:08 |
| mwhahaha | therve: since this is on the undercloud, how much perf impact? | 14:08 |
| therve | mwhahaha, Hard to know really... | 14:09 |
| therve | We use quite a bit between the templates and zaqar | 14:09 |
| jtomasek | o/ | 14:09 |
| cschwede | shardy: will have another look later today, thx! | 14:09 |
| adarazs | o/ | 14:09 |
| mwhahaha | ok moving on | 14:10 |
| mwhahaha | #topic one off agenda items | 14:10 |
| mwhahaha | #link https://etherpad.openstack.org/p/tripleo-meeting-items | 14:10 |
| *** openstack changes topic to "one off agenda items (Meeting topic: tripleo)" | 14:10 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 14:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 14:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 14:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] - Assigned to Alan Pevec (apevec) | 14:10 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Parse pcs auth output with all pcs versions https://review.openstack.org/505284 | 14:10 |
| *** monashington has joined #tripleo | 14:10 | |
| tdasilva | mwhahaha, shardy: regarding the swift issue, couldn't the client be modified to make sure to create the container first? | 14:10 |
| *** monashington has left #tripleo | 14:10 | |
| marios | mwhahaha: for https://bugs.launchpad.net/tripleo/+bug/1717274 weshay posted https://review.openstack.org/#/c/505268/ | 14:10 |
| therve | tdasilva, It does create the container first :) | 14:10 |
| mwhahaha | marios: ok i'll take a look after the meeting | 14:11 |
| marios | mwhahaha: seems to just be missing base repo for the ethtool package which is a dependency (yum update fails) | 14:11 |
| therve | tdasilva, I didn't get a nice workaround for it, but I'm opened to suggestions | 14:11 |
| marios | mwhahaha: thanks (kudos jpena who called that last week already see comment #2 ) | 14:11 |
| tdasilva | therve: can you share the client side code? | 14:12 |
| therve | tdasilva, https://github.com/openstack/zaqar/blob/master/zaqar/storage/swift/utils.py#L45 | 14:12 |
| mwhahaha | moving on | 14:14 |
| mwhahaha | #topic bugs | 14:14 |
| mwhahaha | #link https://launchpad.net/tripleo/+milestone/queens-1 | 14:14 |
| *** openstack changes topic to "bugs (Meeting topic: tripleo)" | 14:14 | |
| mwhahaha | we're into queens so please take a look at the bugs since we're going for stability this cycle | 14:14 |
| *** ratailor has joined #tripleo | 14:14 | |
| mwhahaha | any specific bugs people wish to talk about (besides that upgrade bug) | 14:15 |
| *** jprovazn has quit IRC | 14:16 | |
| mwhahaha | i'll take that as a no | 14:16 |
| mwhahaha | #topic projects releases or stable backports | 14:17 |
| *** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)" | 14:17 | |
| mwhahaha | Anyoen have any backports they need reviews on? | 14:17 |
| trown | is infra still hosed wrt releases? | 14:18 |
| mwhahaha | i believe so | 14:18 |
| mwhahaha | i saw mention of that this morning | 14:18 |
| tdasilva | therve: ack, taking a look | 14:18 |
| mwhahaha | speaking of things that are hosed | 14:19 |
| mwhahaha | #topic CI | 14:19 |
| *** openstack changes topic to "CI (Meeting topic: tripleo)" | 14:19 | |
| trown | lol | 14:19 |
| mwhahaha | the puppet-nova fix for the nova_manage command is in the gate | 14:19 |
| mwhahaha | so that should merge soon (~30 mins) | 14:20 |
| mwhahaha | so that should clear up some of the failures | 14:20 |
| mwhahaha | any other outstanding issues that folks can talk about? | 14:20 |
| *** tongl has joined #tripleo | 14:20 | |
| trown | only other issue is in the periodic pipeline we are setting up on rdo infra | 14:20 |
| mwhahaha | i saw there some bugs around images in the pipeline | 14:21 |
| mwhahaha | has that been addressed? | 14:21 |
| trown | needs a new infra image, but that is blocked by some new project that was created without a repo | 14:21 |
| trown | https://git.openstack.org/cgit/openstack/networking-lagopus | 14:21 |
| mwhahaha | nice | 14:21 |
| trown | when that resolves we can rebuild the image in rdoproject and hopefully get the pipeline working | 14:22 |
| mwhahaha | any other CI items? | 14:23 |
| mwhahaha | sounds like no | 14:24 |
| mwhahaha | #topic specs | 14:24 |
| mwhahaha | #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open | 14:24 |
| *** openstack changes topic to "specs (Meeting topic: tripleo)" | 14:24 | |
| mwhahaha | please take some time to review any open specs | 14:24 |
| mwhahaha | also retarget specs that might still be pointed to pike | 14:24 |
| mwhahaha | additionally if there were any larger items from the PTG that probably should have a spec, now would be the time to propose it | 14:25 |
| mwhahaha | anyone have a specific spec they would like to point out? | 14:25 |
| *** jwb has joined #tripleo | 14:26 | |
| *** tongl has quit IRC | 14:27 | |
| mwhahaha | moving on | 14:28 |
| mwhahaha | #topic open discussion | 14:28 |
| *** openstack changes topic to "open discussion (Meeting topic: tripleo)" | 14:28 | |
| mwhahaha | anything else? | 14:28 |
| mwhahaha | if not i'll close in 2 mins | 14:28 |
| mnaser | thoughts on moving logic of containerized deployments up to the puppet modules for the services specifically? | 14:29 |
| mwhahaha | probably not | 14:29 |
| mwhahaha | at the moment we only really using the providers for the config generation | 14:29 |
| mnaser | so the actual docker container is created/deployed without puppet? | 14:30 |
| mwhahaha | yea we're using kolla for the container build process but puppet for the config of the containers | 14:30 |
| mwhahaha | and then we have a tool for running the containers themselves | 14:31 |
| mnaser | mmkay. i was hoping we can work together so to have service_name => docker type of thing | 14:31 |
| *** psahoo has quit IRC | 14:31 | |
| mnaser | i wanna see what a poc looks like first but it was just an idea :> | 14:31 |
| mwhahaha | that might simplify what we have | 14:31 |
| mwhahaha | but we don't actually use the serivce items anymore | 14:32 |
| mwhahaha | https://github.com/openstack/tripleo-heat-templates/blob/b5c18ded6a6122053fb3a6557c063a44a90e41b9/docker/docker-puppet.py | 14:33 |
| shardy | mnaser: https://github.com/openstack/tripleo-heat-templates/blob/master/common/deploy-steps-tasks.yaml shows the overview of our deploy steps now | 14:33 |
| shardy | we use ansible to drive a tool called paunch, which consumes some json files and starts docker containers | 14:33 |
| shardy | so it's kind of moving in the direction of only using puppet for config generation at this point | 14:34 |
| shardy | (it is also used for some bootstrapping) | 14:34 |
| shardy | mnaser: always good to discuss any ideas tho :) | 14:35 |
| mnaser | i think containers are here to stay (kolla or whatever) but there is many ways of orchestrating them, given you have a ton of existing puppet infra, it might be easier than you having to maintain one more tool | 14:35 |
| *** ykarel has quit IRC | 14:35 | |
| mnaser | i'm sure it'll present a few challenges but i plan to take sometime to do a poc of a simpler puppet service and then show it and see what it looks like (and gather feedback) | 14:36 |
| *** janki has quit IRC | 14:36 | |
| *** shreshtha has quit IRC | 14:36 | |
| mnaser | ideally i'd love to see it adopted by tripleo so catering to that use case and avoiding duplicating effort would be nice :> | 14:36 |
| shardy | mnaser: yeah, understood - in this case paunch was derived from some code we already had in the heat docker-cmd hook | 14:37 |
| shardy | mnaser: seeing the poc would be good, but it does kinda sound like a different direction than where we're headed at this point | 14:37 |
| mnaser | gotcha, i'll take feedback anyways "this is where we shot ourself in the foot when we were taking this approach" is helpful :) | 14:37 |
| mwhahaha | good questions | 14:39 |
| mwhahaha | anything else? | 14:39 |
| *** jrist has quit IRC | 14:41 | |
| mwhahaha | ok thanks everyone | 14:41 |
| mwhahaha | #endmeeting | 14:41 |
| *** openstack changes topic to "Post jobs are not executed currently, do not tag any releases" | 14:41 | |
| openstack | Meeting ended Tue Sep 19 14:41:17 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:41 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-09-19-14.00.html | 14:41 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-09-19-14.00.txt | 14:41 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tripleo/2017/tripleo.2017-09-19-14.00.log.html | 14:41 |
| *** raildo has quit IRC | 14:44 | |
| *** jaosorior has joined #tripleo | 14:48 | |
| *** sid2 has joined #tripleo | 14:49 | |
| jaosorior | mwhahaha: hey, you around? | 14:50 |
| *** jprovazn has joined #tripleo | 14:50 | |
| mwhahaha | jaosorior: do i have to be? :D | 14:50 |
| *** sid1 has quit IRC | 14:51 | |
| jaosorior | mwhahaha: lol | 14:51 |
| jaosorior | mwhahaha: hey, I tried doing some unit tests https://review.openstack.org/#/c/505124/ and it's failing saying that the fluentd class is missing | 14:51 |
| jaosorior | mwhahaha: any idea why? is there a dependency missing or something of the sort? | 14:51 |
| mwhahaha | jaosorior: because it's not it Puppetfile_extras | 14:51 |
| jaosorior | I onticed that the fluentd repo is missing from Puppetfile_extras, would that be an issue? | 14:51 |
| mwhahaha | jaosorior: also it won't work | 14:52 |
| mwhahaha | jaosorior: i talked with larsks last night | 14:52 |
| mwhahaha | there are problems | 14:52 |
| jaosorior | :( | 14:52 |
| jaosorior | why won't it work? | 14:52 |
| mwhahaha | jaosorior: we need https://review.openstack.org/#/c/505002/ | 14:52 |
| *** achadha has joined #tripleo | 14:52 | |
| *** achadha has quit IRC | 14:52 | |
| mwhahaha | jaosorior: the fluentd module uses the $fact[...] array and the version of rspec-puppet we use doesn't properly populate it | 14:52 |
| jaosorior | ouh | 14:53 |
| mnaser | tripleo gate fix is in - https://review.openstack.org/#/c/504977/ | 14:53 |
| mwhahaha | jaosorior: so it's complicated | 14:53 |
| *** achadha has joined #tripleo | 14:53 | |
| jaosorior | mwhahaha: ok, thanks for the explanation | 14:53 |
| jaosorior | mwhahaha: also, what do you think of https://review.openstack.org/#/c/505192/ ? | 14:53 |
| jaosorior | mwhahaha: an operator at the PTG was mentioning that our defaults are wrong; so I decided to give it a go at changing them. | 14:54 |
| mwhahaha | jaosorior: sounds good | 14:54 |
| jaosorior | great | 14:55 |
| jaosorior | finally | 14:55 |
| jaosorior | mwhahaha, beekneemech: The TLS everywhere gate is broken :( | 14:55 |
| mnaser | https://review.openstack.org/#/c/505294/ and https://review.openstack.org/#/c/505295/ will help fix the stable periodic jobs | 14:55 |
| mwhahaha | jaosorior: well un break it :D | 14:56 |
| jaosorior | mwhahaha, beekneemech: I submitted this https://review.openstack.org/#/c/504850/ to address one of the issues | 14:56 |
| jaosorior | mwhahaha, beekneemech: BUT, now I'm running into some nova issue where it breaks trying to allocate the config-drive | 14:56 |
| *** beekneemech is now known as bnemec | 14:56 | |
| * bnemec notes that it's not Friday anymore | 14:56 | |
| mwhahaha | jaosorior: might that be related to the puppet-nova thing? | 14:56 |
| mwhahaha | mnaser: http://logs.openstack.org/92/505192/1/check/gate-puppet-openstacklib-puppet-beaker-rspec-centos-7/01076c2/console.html#_2017-09-19_12_07_01_496405 we're using the kilo repo for puppet-openstacklib for some reason | 14:57 |
| jaosorior | mwhahaha, bnemec: Which is this http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/0905689/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-09-19_11_59_32_854 | 14:57 |
| jaosorior | mwhahaha: I actually have a depends-on with the nova patch. | 14:57 |
| mnaser | mwhahaha beaker :( | 14:57 |
| *** anshul has quit IRC | 14:57 | |
| mnaser | gonna bet that the acceptance has the wrong release | 14:57 |
| mnaser | lets ee | 14:57 |
| mwhahaha | mnaser: yea its in rabbitmq_spec | 14:57 |
| jaosorior | mwhahaha, bnemec: Any idea what would cause an exception like that? I'm quite stuck :( | 14:58 |
| mnaser | mwhahaha ill push up a fix | 14:58 |
| mwhahaha | jaosorior: you check the ironic logs? | 14:58 |
| jaosorior | mwhahaha: yeah, it complains something about the vif | 14:58 |
| jaosorior | mwhahaha: http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/0905689/logs/undercloud/var/log/ironic/app.txt.gz#_2017-09-19_11_59_34_786 | 14:59 |
| * mwhahaha points at dtantsur|lunch | 14:59 | |
| bnemec | jaosorior: AttributeError: 'Env' object has no attribute 'domain' | 15:00 |
| jaosorior | bnemec: huh? | 15:00 |
| jaosorior | whaaa | 15:00 |
| jaosorior | where? | 15:00 |
| bnemec | From http://logs.openstack.org/50/504850/3/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-fakeha-caserver/0905689/logs/undercloud/var/log/novajoin/novajoin-server.txt.gz | 15:00 |
| *** ecerquei has joined #tripleo | 15:00 | |
| jaosorior | dafuq | 15:00 |
| jaosorior | that shouldn't be an issue | 15:00 |
| *** dmarlin has joined #tripleo | 15:00 | |
| jaosorior | aaah | 15:01 |
| jaosorior | regression maybe | 15:01 |
| jaosorior | let me investigate | 15:01 |
| bnemec | From right above where you linked: Error from dynamic vendordata service join at http://192.168.24.1:9090/v1/: Internal Server Error (HTTP 500): InternalServerError: Internal Server Error (HTTP 500) | 15:01 |
| jaosorior | bnemec: thanks dude! | 15:01 |
| bnemec | np | 15:01 |
| *** ccamacho has quit IRC | 15:03 | |
| *** trown is now known as trown|brb | 15:03 | |
| mnaser | jaosorior / mwhahaha - https://review.openstack.org/#/c/505299/ | 15:03 |
| mnaser | you can rebase to that and it should fix it | 15:04 |
| *** rbowen has quit IRC | 15:07 | |
| *** trown|brb is now known as trown | 15:08 | |
| jaosorior | bnemec: also https://review.openstack.org/#/c/505192/ :D that was what we were talking about that in the hallway last week. I forgot the name of the dude that you were talking to though. | 15:08 |
| mnaser | mwhahaha also, there seems to be no gate-tripleo-ci scenario jobs for puppet-nova .. we would have caught that issue had there been one, is there a reason why there isn't one? | 15:09 |
| *** rbowen has joined #tripleo | 15:09 | |
| *** aditya_r has quit IRC | 15:09 | |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 15:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 15:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 15:10 |
| *** aditya_r has joined #tripleo | 15:10 | |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 15:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 15:10 |
| mwhahaha | mnaser: i'm not aware of any reason why not other than perhaps ci capacity reasons | 15:10 |
| mnaser | we should probably add a job just to avoid this sort of breakage in the future again, could someone add at least 1 job (i mean, we're running scenarios for gnocchi but not nova, if anything id prefer nova getting gating in terms of priority :p) | 15:11 |
| mwhahaha | yea let me take a look | 15:11 |
| mwhahaha | i thought we were | 15:11 |
| bnemec | jaosorior: Sean probably? I actually don't remember for sure myself. :-) | 15:11 |
| bnemec | ETOOMANYNAMES | 15:11 |
| jaosorior | lol | 15:11 |
| jaosorior | we'll call him Sean then | 15:12 |
| jaosorior | or billy bob, you decide | 15:12 |
| bnemec | Although in this case it's more that I don't remember who else was actually there, not that I don't remember their name. | 15:12 |
| mwhahaha | pfft names | 15:13 |
| mwhahaha | "that guy" | 15:13 |
| bnemec | There's a reason I rarely use people's names in conversation. | 15:13 |
| mwhahaha | ditto | 15:13 |
| jaosorior | using the word "dude" tends to work for me :D you don't have to remember anything | 15:13 |
| bnemec | That way if I forget, nobody knows. | 15:13 |
| bnemec | Gets a little awkward if you have to introduce people though... | 15:13 |
| mwhahaha | mnaser: so we had the ovb job on puppet-nova. it seems like that should have covered it or was it only in scenario multinode jobs | 15:14 |
| mnaser | mwhahaha only scenario ones were failing at the time but i recall soemone saying something along the lines of that job not running tempest so not catching it.. i dont know tripleo ci as well | 15:15 |
| mwhahaha | mnaser: oh so it was only showing up in tempest | 15:15 |
| mnaser | https://review.openstack.org/#/c/501669/ the failing test passed here so i dont know | 15:16 |
| *** toure_biab is now known as toure | 15:17 | |
| mwhahaha | mnaser: yea ovb doesn't run tempest | 15:17 |
| *** ebarrera has quit IRC | 15:17 | |
| mwhahaha | bnemec: any reason why we shouldn't switch ovb to use tempest? | 15:18 |
| mwhahaha | bnemec: seems like it actually tests things better or is it a timing/resource thing | 15:18 |
| bnemec | mwhahaha: Time has always been the reason. I don't know how what we're doing with tempest now compares to the pingtest though. | 15:19 |
| *** ccamacho has joined #tripleo | 15:21 | |
| bnemec | On the other hand the ovb jobs are already timing out, so how much worse could it be? | 15:21 |
| * bnemec also enjoys poking bears in his free time ;-) | 15:21 | |
| jaosorior | lol | 15:21 |
| sai | dsneddon: hey, i have the storagenetworkvlanid and storageipsubnet defined in the template for a compute node but stack create fails on this 2017-09-19 15:05:41Z [0]: CREATE_FAILED Resource CREATE failed: resources.StoragePort: Resource CREATE failed: Unable to find network wi│···················································· | 15:22 |
| sai | th name or id 'storage' | 15:22 |
| sai | any pointers? | 15:22 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic https://review.openstack.org/476704 | 15:23 |
| *** raildo has joined #tripleo | 15:24 | |
| *** mdnadeem has quit IRC | 15:24 | |
| mwhahaha | sai: what version | 15:24 |
| sai | mwhahaha: osp11 | 15:24 |
| mwhahaha | sai: do you not have the OS:Tripleo::Network::Storage defined anywhere? https://github.com/openstack/tripleo-heat-templates/blob/stable/ocata/environments/network-isolation.yaml#L8 | 15:25 |
| * mwhahaha guesses with the best of them | 15:25 | |
| *** monashington has joined #tripleo | 15:27 | |
| bandini | mwhahaha: if you have a min https://review.openstack.org/#/c/505284/ (note that tripleo does not use that puppet-pacemaker code, but it needs merging to fix CI). Thanks ;) | 15:27 |
| sai | mwhahaha: thanks a lot looks like the network-isolation file wasnt being passed to the deploy command, that could have caused this right? | 15:28 |
| bnemec | sai: Yes | 15:28 |
| sai | bnemec: thanks! | 15:28 |
| * sai helping a firend out.. | 15:29 | |
| sai | so i guess the first question i should have asked for is the deploy command | 15:29 |
| * sai keeps that in mind | 15:29 | |
| *** MVenesio has quit IRC | 15:30 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui master: Exclude outdated validation results from list https://review.openstack.org/501214 | 15:31 |
| *** aufi has quit IRC | 15:32 | |
| *** jaosorior has quit IRC | 15:32 | |
| *** ffiore has quit IRC | 15:33 | |
| *** gbarros has joined #tripleo | 15:35 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-quickstart master: Change default network isolation type to multi-nic https://review.openstack.org/476704 | 15:35 |
| *** iranzo is now known as iranzo|AFK | 15:35 | |
| *** raildo has quit IRC | 15:39 | |
| openstackgerrit | Merged openstack/puppet-pacemaker master: Parse pcs auth output with all pcs versions https://review.openstack.org/505284 | 15:41 |
| *** gbarros has quit IRC | 15:42 | |
| *** jaganathan has joined #tripleo | 15:44 | |
| *** aditya_r is now known as aditya_r|dinner | 15:44 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-puppet-elements stable/newton: Add remove-machine-id element https://review.openstack.org/505305 | 15:46 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-common stable/newton: Remove machine-id from image https://review.openstack.org/505310 | 15:48 |
| *** tongl has joined #tripleo | 15:53 | |
| *** DrBacchus has joined #tripleo | 15:53 | |
| *** fandrieu has quit IRC | 15:54 | |
| *** rbowen has quit IRC | 15:54 | |
| *** raildo has joined #tripleo | 15:55 | |
| *** agurenko has quit IRC | 15:56 | |
| *** gbarros has joined #tripleo | 15:59 | |
| *** florianf has quit IRC | 15:59 | |
| *** dtantsur|lunch is now known as dtantsur | 16:00 | |
| *** DrBacchus has quit IRC | 16:00 | |
| *** rbowen has joined #tripleo | 16:01 | |
| *** agurenko has joined #tripleo | 16:01 | |
| *** dprince has quit IRC | 16:02 | |
| *** oidgar has quit IRC | 16:03 | |
| *** yprokule has quit IRC | 16:03 | |
| *** egonzalez has quit IRC | 16:03 | |
| *** dprince has joined #tripleo | 16:04 | |
| dtantsur | mwhahaha: anything I can help with? | 16:04 |
| *** suuuper has quit IRC | 16:05 | |
| mwhahaha | dtantsur: I don't think so anymore. looks like we figured out the vif errors being seen are possibly unrelated. thanks though | 16:05 |
| *** jmelvin has quit IRC | 16:06 | |
| *** rbowen has quit IRC | 16:06 | |
| *** rbowen has joined #tripleo | 16:07 | |
| dtantsur | ah, cool | 16:07 |
| dtantsur | mwhahaha: then please check the blueprint I posted earlier today :) | 16:08 |
| mwhahaha | dtantsur: which one? | 16:08 |
| dtantsur | mwhahaha: https://blueprints.launchpad.net/tripleo/+spec/ansible-deploy and https://blueprints.launchpad.net/tripleo/+spec/ironic-direct-deploy (for queens) | 16:08 |
| mwhahaha | dtantsur: ok i'll take a look. I remember the ironic ansible one but wasn't sure the status of it | 16:09 |
| *** ratailor has quit IRC | 16:09 | |
| mwhahaha | dtantsur: so you're good on those two for this cycle? | 16:09 |
| dtantsur | mwhahaha: yeah, should be easy wins, both. most of the work is in ironic, and most of it is done already | 16:10 |
| mwhahaha | dtantsur: ok | 16:10 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 16:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 16:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 16:10 |
| *** hamzy has quit IRC | 16:11 | |
| *** oidgar has joined #tripleo | 16:11 | |
| *** itlinux has joined #tripleo | 16:11 | |
| *** monashington has quit IRC | 16:14 | |
| dsneddon | sai: You probably aren't instantiating all the networks. See the file in TripleO Heat templates environments/network-isolation.yaml to see how networks are instantiated. Include that file with the deployment to include all networks, or edit the file to modify which ports are created for which roles. Then take a look at the environments/network-environment.yaml to see how those subnets are defined. | 16:15 |
| *** dmacpher has joined #tripleo | 16:15 | |
| *** iranzo|AFK has quit IRC | 16:16 | |
| *** dmacpher has quit IRC | 16:17 | |
| *** milan has quit IRC | 16:18 | |
| *** mjturek has quit IRC | 16:19 | |
| *** agurenko has quit IRC | 16:19 | |
| *** stee_3_ has joined #tripleo | 16:21 | |
| *** bugzy_ has joined #tripleo | 16:21 | |
| *** bugzy has quit IRC | 16:24 | |
| *** stee_3 has quit IRC | 16:24 | |
| *** monashington has joined #tripleo | 16:27 | |
| *** rwsu has quit IRC | 16:28 | |
| *** nyechiel has joined #tripleo | 16:28 | |
| *** rwsu has joined #tripleo | 16:30 | |
| *** rwsu has joined #tripleo | 16:30 | |
| *** achadha has quit IRC | 16:31 | |
| *** jfrancoa has quit IRC | 16:31 | |
| *** thrash is now known as thrash|lunch | 16:32 | |
| Ng | dprince: I think you should get a specially engraved one :D http://amzn.to/2xeFsKt | 16:32 |
| dprince | Ng: Yes! | 16:35 |
| *** mjturek has joined #tripleo | 16:35 | |
| *** tongl has quit IRC | 16:35 | |
| *** dprince has quit IRC | 16:35 | |
| *** jmelvin has joined #tripleo | 16:36 | |
| *** jpich has quit IRC | 16:36 | |
| *** aditya_r|dinner has quit IRC | 16:37 | |
| *** aditya_r has joined #tripleo | 16:37 | |
| *** pcaruana has quit IRC | 16:38 | |
| *** abregman has quit IRC | 16:41 | |
| *** monashington has quit IRC | 16:42 | |
| sai | dsneddon: thanks! bnemec and mwhahaha helped me with it. The deploy command was wrong, wasnt passing entwork-isolation.yaml | 16:43 |
| *** trown is now known as trown|lunch | 16:49 | |
| *** jpena is now known as jpena|away | 16:49 | |
| *** bogdando has quit IRC | 16:51 | |
| *** rcernin has quit IRC | 16:52 | |
| *** tesseract has quit IRC | 16:52 | |
| *** achadha has joined #tripleo | 16:54 | |
| *** yamahata has joined #tripleo | 16:55 | |
| jistr | flaper87: fyi if you still keep hacking on kubernetes installation, you'll probably need this to make kubelet work: https://github.com/kubernetes-incubator/kubespray/pull/1677 | 16:55 |
| jistr | with it the kubespray playbook finised for me | 16:56 |
| *** dprince has joined #tripleo | 16:56 | |
| *** aditya_ra has joined #tripleo | 16:57 | |
| *** nmathew has joined #tripleo | 16:57 | |
| dprince | mwhahaha: hi, why marking this as low? https://blueprints.launchpad.net/tripleo/+spec/containerized-undercloud | 16:57 |
| mwhahaha | dprince: because that's a nice to have but honestly not a requirement for queens | 16:58 |
| *** achadha has quit IRC | 16:58 | |
| mwhahaha | dprince: we talked about this at the ptg | 16:58 |
| nmathew | @shardy, one question | 16:58 |
| *** achadha has joined #tripleo | 16:58 | |
| *** aditya_ra has quit IRC | 16:59 | |
| *** aditya_ra has joined #tripleo | 16:59 | |
| nmathew | @shardy, will you be able to look at this jinja2 template http://paste.openstack.org/show/uIrvvqhoZd5d5MMmHWl9/ | 16:59 |
| mwhahaha | dprince: a containerized undercloud isn't a requirement, the fully containerized overcloud is. there are more peices to containerizing the undercloud (and replace existing undercloud install) that I don't think we'll fully get in queens. | 16:59 |
| *** aditya_ra has joined #tripleo | 17:00 | |
| nmathew | @shardy, code around {% if role.name == CsdnComputeConfig[roledata].name %} | 17:00 |
| *** aditya_r has quit IRC | 17:00 | |
| *** aditya_ra has quit IRC | 17:01 | |
| *** liverpooler has quit IRC | 17:02 | |
| *** aditya_r has joined #tripleo | 17:02 | |
| dprince | mwhahaha: "containerized undercloud isn't a requirement" doesn't exactly align w/ the goals of the containers squad fwiw | 17:05 |
| dprince | mwhahaha: full containerization in queens is the goal I think | 17:05 |
| mwhahaha | dprince: at no point did i say no | 17:05 |
| *** hamzy has joined #tripleo | 17:05 | |
| dprince | mwhahaha: perhaps this needs more clarification | 17:05 |
| mwhahaha | dprince: low means make progress and lets see if we can get it | 17:05 |
| mwhahaha | dprince: my understanding is that the overcloud is the fully containerized target | 17:05 |
| dprince | mwhahaha: right, my understanding was the ask is full containerization | 17:06 |
| *** eck` is now known as eck`gone | 17:06 | |
| mwhahaha | dprince: if your progress to fully containerized overcloud brings undercloud, excellent | 17:06 |
| *** eck`gone has quit IRC | 17:06 | |
| *** dalvarez has quit IRC | 17:06 | |
| dprince | mwhahaha: I would have left it a medium fwiw | 17:06 |
| mwhahaha | dprince: that's not my understanding for this cycle. containerizing the undercloud needs more work and testing than I think we have | 17:07 |
| mwhahaha | dprince: we can move it up to medium, it's just a option. | 17:07 |
| dprince | mwhahaha: containerizing the undercloud I think should have been done first | 17:07 |
| dprince | mwhahaha: much of the testing, in particular the scenarios could be accomplished on a single VM upstream | 17:08 |
| dprince | mwhahaha: I would argue we are already paying a cost for not having done this first | 17:08 |
| * dprince thinks it really is a bigger deal than it seems | 17:08 | |
| mwhahaha | dprince: i don't disagree and would like to see more effort on that | 17:08 |
| *** radez has quit IRC | 17:09 | |
| mwhahaha | dprince: infra would also like to see that :D so let's get some additional progress on testing that we can do on the undercloud jobs | 17:09 |
| mwhahaha | dprince: does your undercloud-containers job run tempest? | 17:09 |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 17:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 17:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 17:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 17:10 |
| *** jpena|away has quit IRC | 17:10 | |
| *** amoralej has quit IRC | 17:10 | |
| dprince | mwhahaha: no, it doesn't yet. but like the puppet CI jobs it could if we wire in the right services | 17:10 |
| mwhahaha | dprince: so that seems like a good way to check that the containerized undercloud is working right and gets us additional service coverage w/ a single node | 17:11 |
| mwhahaha | dprince: do you think the containers squad could make some progress on that in the next 2-3 weeks? | 17:12 |
| dprince | perhaps. The existing arch could be used for this even | 17:15 |
| *** eck`gone has joined #tripleo | 17:15 | |
| mwhahaha | i'm not expecting a full array of tests | 17:15 |
| mwhahaha | just like one basic one to prove the concept | 17:15 |
| mwhahaha | then we can itterate the rest of the cycle | 17:15 |
| mwhahaha | just like a basic tempest test per service that we deploy | 17:16 |
| *** fzdarsky is now known as fzdarsky|afk | 17:17 | |
| *** ccamacho has quit IRC | 17:18 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add the option to run the container-check script https://review.openstack.org/501028 | 17:18 |
| *** eck`gone is now known as eck` | 17:19 | |
| *** jlinkes has quit IRC | 17:19 | |
| *** ecerquei has quit IRC | 17:24 | |
| *** anshul has joined #tripleo | 17:24 | |
| * mwhahaha wanders off to lunch | 17:24 | |
| *** udesale has joined #tripleo | 17:27 | |
| *** milan has joined #tripleo | 17:28 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Check that network interface exsits before adjusting MTU https://review.openstack.org/504419 | 17:29 |
| *** dalvarez has joined #tripleo | 17:30 | |
| *** udesale has quit IRC | 17:31 | |
| *** marios has quit IRC | 17:32 | |
| *** ecerquei has joined #tripleo | 17:32 | |
| *** sid2 has quit IRC | 17:32 | |
| *** tosky has quit IRC | 17:34 | |
| *** nyechiel has quit IRC | 17:41 | |
| *** nmathew has quit IRC | 17:41 | |
| *** liverpooler has joined #tripleo | 17:42 | |
| *** mjturek has quit IRC | 17:42 | |
| *** shardy has quit IRC | 17:44 | |
| *** mcornea has quit IRC | 17:44 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ocata: Add option for innodb_flush_log_at_trx_commit = 2 for Galera only https://review.openstack.org/496790 | 17:48 |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Increase timeout in get_deprecated_parameters workflow https://review.openstack.org/505166 | 17:48 |
| *** MVenesio has joined #tripleo | 17:49 | |
| *** tosky has joined #tripleo | 18:02 | |
| mwhahaha | i like how stable/ocata upgrade jobs are passing and i don't think we changed anything | 18:02 |
| *** aditya_r has quit IRC | 18:06 | |
| *** akrivoka has quit IRC | 18:08 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 18:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 18:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 18:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 18:10 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add more debug information to the logs https://review.openstack.org/505353 | 18:13 |
| *** salmankhan has quit IRC | 18:14 | |
| *** salmankhan has joined #tripleo | 18:15 | |
| *** liverpooler has quit IRC | 18:15 | |
| *** thrash|lunch is now known as thrash | 18:17 | |
| *** salmankhan has quit IRC | 18:20 | |
| *** itlinux has quit IRC | 18:22 | |
| *** trown|lunch is now known as trown | 18:22 | |
| *** iranzo has joined #tripleo | 18:23 | |
| *** rhallisey has quit IRC | 18:24 | |
| *** rhallisey has joined #tripleo | 18:24 | |
| *** cdearborn_ has joined #tripleo | 18:26 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/pike: Change to boolean for boolean type params https://review.openstack.org/505139 | 18:28 |
| *** liverpooler has joined #tripleo | 18:31 | |
| *** liverpooler has quit IRC | 18:31 | |
| *** liverpooler has joined #tripleo | 18:32 | |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-heat-templates master: Use conditional to set heat-engine workers https://review.openstack.org/481236 | 18:33 |
| *** jaganathan has quit IRC | 18:33 | |
| *** iranzo has quit IRC | 18:35 | |
| weshay | mwhahaha, we need this cherry picked to pike right? https://review.openstack.org/#/c/504977/ | 18:36 |
| mwhahaha | weshay: there's an open one yea | 18:36 |
| mwhahaha | weshay: https://review.openstack.org/#/c/505295/1 | 18:36 |
| mwhahaha | weshay: along with the original patch https://review.openstack.org/#/c/505294 | 18:36 |
| weshay | thanks | 18:36 |
| *** rbowen has quit IRC | 18:40 | |
| *** dtantsur is now known as dtantsur|afk | 18:40 | |
| *** rbowen has joined #tripleo | 18:41 | |
| *** cdearborn has quit IRC | 18:43 | |
| *** mjturek has joined #tripleo | 18:44 | |
| openstackgerrit | Merged openstack/python-tripleoclient stable/pike: Add -n/--networks-data option https://review.openstack.org/504008 | 18:47 |
| *** abregman has joined #tripleo | 18:52 | |
| *** cschwede has quit IRC | 18:55 | |
| *** itlinux has joined #tripleo | 18:59 | |
| weshay | things seem to moving back to green afaict.. http://zuul-status.tripleo.org/?queue=check | 19:01 |
| *** paramite has quit IRC | 19:04 | |
| *** mjturek has quit IRC | 19:05 | |
| itlinux | hello guys does anyone have any suggestions on this error http://paste.openstack.org/show/621472/ | 19:06 |
| itlinux | thanks | 19:06 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 19:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 19:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 19:10 |
| *** dsariel has joined #tripleo | 19:12 | |
| openstackgerrit | Sai Sindhur Malleni proposed openstack/tripleo-heat-templates master: Bump fs.inotify.max_user_instances for scale https://review.openstack.org/505381 | 19:13 |
| *** pchavva has quit IRC | 19:17 | |
| *** aputtur has quit IRC | 19:17 | |
| *** mjturek has joined #tripleo | 19:19 | |
| *** jrist has joined #tripleo | 19:26 | |
| *** jrist has joined #tripleo | 19:26 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart-extras master: add more debug information to the logs https://review.openstack.org/505353 | 19:26 |
| *** bugzy_ is now known as bugzy | 19:28 | |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart master: use tempest in fs001 vs ping test https://review.openstack.org/504444 | 19:31 |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: WIP: Disruption detection and some stack update roles https://review.openstack.org/497950 | 19:34 |
| *** jtomasek has quit IRC | 19:35 | |
| *** rbowen has quit IRC | 19:35 | |
| *** rhallisey has quit IRC | 19:38 | |
| *** rhallisey has joined #tripleo | 19:38 | |
| *** rbowen has joined #tripleo | 19:39 | |
| *** radez has joined #tripleo | 19:51 | |
| *** raildo has quit IRC | 19:57 | |
| *** rhallisey has quit IRC | 20:02 | |
| *** ecerquei has quit IRC | 20:03 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 20:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 20:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 20:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 20:10 |
| *** mjturek has quit IRC | 20:12 | |
| mwhahaha | weshay: do we know if https://bugs.launchpad.net/tripleo/+bug/1717959 is resolved since that repo is now created? | 20:13 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 20:13 |
| weshay | mwhahaha, last time I looked today it was not, the jobs kick every 4 hours will check now | 20:14 |
| *** rcernin has joined #tripleo | 20:14 | |
| mwhahaha | doesn't look like it | 20:15 |
| weshay | mwhahaha, still there https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset005-pike/113/console | 20:15 |
| * weshay asks in rdo channel | 20:15 | |
| *** raildo has joined #tripleo | 20:17 | |
| *** jkilpatr has quit IRC | 20:18 | |
| *** gbarros has quit IRC | 20:20 | |
| *** dtrainor has quit IRC | 20:22 | |
| *** dtrainor has joined #tripleo | 20:23 | |
| weshay | mwhahaha, we'll know next build, a new image has uploaded | 20:25 |
| mwhahaha | k | 20:26 |
| -openstackstatus- NOTICE: Zuul and Gerrit are being restarted to address issues discovered with the Gerrit 2.13 upgrade. review.openstack.org will be inaccessible for a few minutes while we make these changes. Currently running jobs will be restarted for you once Zuul and Gerrit are running again. | 20:28 | |
| *** mjturek has joined #tripleo | 20:29 | |
| *** jprovazn has quit IRC | 20:30 | |
| *** ansmith has quit IRC | 20:33 | |
| *** _milan_ has joined #tripleo | 20:37 | |
| *** milan has quit IRC | 20:38 | |
| *** Goneri has quit IRC | 20:42 | |
| *** jkilpatr has joined #tripleo | 20:42 | |
| *** jrist has quit IRC | 20:43 | |
| *** salmankhan has joined #tripleo | 20:45 | |
| *** leitan has quit IRC | 20:47 | |
| *** thrash is now known as thrash|g0ne | 20:48 | |
| *** leitan has joined #tripleo | 20:48 | |
| *** leitan has joined #tripleo | 20:48 | |
| *** leitan has quit IRC | 20:49 | |
| *** leitan has joined #tripleo | 20:49 | |
| *** catintheroof has quit IRC | 20:50 | |
| *** catintheroof has joined #tripleo | 20:50 | |
| *** oneswig has joined #tripleo | 20:50 | |
| *** catintheroof has quit IRC | 20:51 | |
| *** bfournie has quit IRC | 20:52 | |
| *** jcoufal has quit IRC | 20:53 | |
| *** leitan has quit IRC | 20:53 | |
| *** tongl has joined #tripleo | 20:55 | |
| *** itlinux has quit IRC | 20:56 | |
| *** itlinux has joined #tripleo | 20:56 | |
| *** itlinux has quit IRC | 20:58 | |
| *** itlinux has joined #tripleo | 20:59 | |
| dprince | mwhahaha: hi, are you aware of a gerrit outage? | 21:06 |
| dprince | mwhahaha: http://tripleo.org/cistatus.html is empty | 21:07 |
| mwhahaha | you mean the message before yours indicating they are restarting gerrit? | 21:07 |
| dprince | ah, sorry. I got dissconnected | 21:07 |
| mwhahaha | <+openstackstatus> NOTICE: Zuul and Gerrit are being restarted to address issues discovered with the Gerrit 2.13 upgrade. review.openstack.org will be inaccessible for a few minutes while we make these changes. Currently running jobs will be restarted for you once Zuul and Gerrit are running again. | 21:07 |
| mwhahaha | :D | 21:07 |
| dprince | mwhahaha: thanks | 21:08 |
| dprince | mwhahaha: I figured that could be the only cause of it | 21:08 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 21:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 21:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 21:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 21:10 |
| *** trown is now known as trown|outtypewww | 21:10 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Run gnocchi statsd and metrcd at step 5 https://review.openstack.org/505403 | 21:10 |
| *** stee_3_ has quit IRC | 21:11 | |
| *** stee_3 has joined #tripleo | 21:12 | |
| *** achadha has quit IRC | 21:14 | |
| *** mjturek has quit IRC | 21:14 | |
| *** achadha has joined #tripleo | 21:15 | |
| *** lblanchard has quit IRC | 21:16 | |
| *** abishop has quit IRC | 21:21 | |
| *** itlinux has quit IRC | 21:21 | |
| *** atoth has quit IRC | 21:22 | |
| *** achadha has quit IRC | 21:24 | |
| *** achadha has joined #tripleo | 21:25 | |
| *** itlinux has joined #tripleo | 21:25 | |
| *** anshul has quit IRC | 21:27 | |
| *** abregman has quit IRC | 21:28 | |
| *** noslzzp has quit IRC | 21:31 | |
| *** rhallisey has joined #tripleo | 21:33 | |
| *** ebarrera has joined #tripleo | 21:33 | |
| *** noslzzp has joined #tripleo | 21:35 | |
| *** mkovacik__ has joined #tripleo | 21:36 | |
| *** dougbtv__ has joined #tripleo | 21:36 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Move neutron api services to ControllerOpenstack https://review.openstack.org/505415 | 21:37 |
| *** _milan_ has quit IRC | 21:39 | |
| *** raildo has quit IRC | 21:40 | |
| *** jistr has quit IRC | 21:41 | |
| *** noslzzp has quit IRC | 21:41 | |
| *** noslzzp has joined #tripleo | 21:44 | |
| openstackgerrit | Ian Main proposed openstack/tripleo-docs master: Update containerized deployment docs. https://review.openstack.org/505416 | 21:44 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Move neutron api services to ControllerOpenstack https://review.openstack.org/505415 | 21:45 |
| *** dsariel has quit IRC | 21:45 | |
| *** morazi has quit IRC | 21:47 | |
| *** salmankhan has quit IRC | 21:49 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Move neutron api services to ControllerOpenstack https://review.openstack.org/505415 | 21:50 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Check that network interface exsits before adjusting MTU https://review.openstack.org/504419 | 21:53 |
| *** jistr has joined #tripleo | 22:01 | |
| *** cdearborn_ has quit IRC | 22:03 | |
| *** jcoufal has joined #tripleo | 22:05 | |
| *** jcoufal has quit IRC | 22:06 | |
| *** noslzzp has quit IRC | 22:07 | |
| *** noslzzp has joined #tripleo | 22:09 | |
| *** dprince has quit IRC | 22:09 | |
| *** rlandy is now known as rlandy|bbl | 22:09 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 22:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 22:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 22:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 22:10 |
| *** MVenesio has quit IRC | 22:12 | |
| *** noslzzp has quit IRC | 22:13 | |
| *** noslzzp has joined #tripleo | 22:15 | |
| *** rhallisey has quit IRC | 22:15 | |
| *** oneswig has quit IRC | 22:16 | |
| *** chem has quit IRC | 22:18 | |
| *** noslzzp has quit IRC | 22:18 | |
| *** noslzzp has joined #tripleo | 22:21 | |
| *** chlong has quit IRC | 22:21 | |
| *** tongl has quit IRC | 22:23 | |
| *** jwb has quit IRC | 22:24 | |
| *** noslzzp has quit IRC | 22:25 | |
| *** achadha has quit IRC | 22:26 | |
| *** achadha has joined #tripleo | 22:26 | |
| *** achadha has quit IRC | 22:27 | |
| *** achadha has joined #tripleo | 22:28 | |
| *** noslzzp has joined #tripleo | 22:28 | |
| *** zshi has quit IRC | 22:31 | |
| *** achadha has quit IRC | 22:32 | |
| *** achadha has joined #tripleo | 22:32 | |
| *** noslzzp has quit IRC | 22:33 | |
| *** zshi has joined #tripleo | 22:34 | |
| -openstackstatus- NOTICE: Gerrit is being restarted to address some final issues, review.openstack.org will be inaccessible for a few minutes while we restart | 22:34 | |
| *** noslzzp has joined #tripleo | 22:35 | |
| *** achadha_ has joined #tripleo | 22:35 | |
| *** noslzzp has quit IRC | 22:35 | |
| *** _milan_ has joined #tripleo | 22:37 | |
| *** achadha has quit IRC | 22:37 | |
| *** achadha has joined #tripleo | 22:37 | |
| *** mkovacik__ has quit IRC | 22:39 | |
| *** dciabrin has quit IRC | 22:39 | |
| *** achadha_ has quit IRC | 22:39 | |
| *** dciabrin has joined #tripleo | 22:41 | |
| *** achadha has quit IRC | 22:42 | |
| *** catintheroof has joined #tripleo | 22:45 | |
| *** openstackgerrit has quit IRC | 22:47 | |
| *** itlinux has quit IRC | 22:49 | |
| *** dmarlin has quit IRC | 22:52 | |
| *** gfidente has quit IRC | 22:53 | |
| *** ansmith has joined #tripleo | 22:54 | |
| *** ebarrera has quit IRC | 22:59 | |
| *** achadha has joined #tripleo | 23:00 | |
| *** ebarrera has joined #tripleo | 23:05 | |
| *** achadha has quit IRC | 23:05 | |
| *** ebarrera has quit IRC | 23:05 | |
| *** brian83 has joined #tripleo | 23:07 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1716914 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717274 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717279 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717545 | 23:10 |
| openstack | Launchpad bug 1716914 in tripleo "CI: all periodic jobs fail to install undercloud: No resource and no name in property hash in nova_manage instance" [Critical,Triaged] | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1717959 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1717274 in tripleo "ocata2pike: broken package dependency during upgrade" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 23:10 |
| openstack | Launchpad bug 1717279 in tripleo "RDO registry denies images uploads" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1717545 in tripleo "nova populates incomplete cell_mappings" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1717959 in tripleo "RDO upstream-centos-7 nodepool image is out of date" [Critical,Triaged] | 23:10 |
| *** rcernin has quit IRC | 23:11 | |
| *** tosky has quit IRC | 23:23 | |
| *** jmelvin has quit IRC | 23:25 | |
| *** jobewan has quit IRC | 23:36 | |
| *** mkovacik__ has joined #tripleo | 23:36 | |
| *** _milan_ has quit IRC | 23:39 | |
| *** ChanServ changes topic to "open discussion (Meeting topic: tripleo)" | 23:42 | |
| -openstackstatus- NOTICE: Gerrit is once again part of normal puppet config management. Problems with Gerrit gitweb links and Zuul post jobs have been addressed. We currently cannot create new gerrit projects (fixes in progress) and email sending is slow (being debugged). | 23:42 | |
| *** threestrands has joined #tripleo | 23:51 | |
| rook | anyone around that can help diagnose a mistral error? | 23:58 |
| rook | while executing openstack baremetal configure boot, i get | 23:58 |
| rook | Waiting for messages on queue '6057b641-d969-438f-8609-b76bc6e78b14' with no timeout. | 23:59 |
| rook | [u'dictionary update sequence element #0 has length 1; 2 is required'] | 23:59 |
| rook | This is with 97 nodes | 23:59 |
| rook | not that this should matter | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
