Friday, 2018-06-29

openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722400:00
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044500:00
*** bfournie has joined #tripleo00:06
*** dmacpher has quit IRC00:09
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970700:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897400:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910800:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)00:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)00:10
*** khyr0n has joined #tripleo00:26
*** khyr0n_ has joined #tripleo00:28
*** rpioso is now known as rpioso|afk00:29
*** khyr0n has quit IRC00:30
*** rwsu has quit IRC00:48
*** khyr0n_ has quit IRC00:50
*** khyr0n has joined #tripleo00:51
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud""  https://review.openstack.org/57533000:54
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970701:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897401:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910801:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)01:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)01:10
*** mdnadeem has joined #tripleo01:10
*** Petersingh has joined #tripleo01:13
*** mrsoul_ has joined #tripleo01:18
*** mschuppert has quit IRC01:21
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move localloop to exec_sudo  https://review.openstack.org/57861601:23
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Call kpartx remove in umount, not cleanup  https://review.openstack.org/57865701:23
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Only detach device if all partitions have been cleaned  https://review.openstack.org/57687601:23
*** yamahata has quit IRC01:34
*** dmacpher has joined #tripleo01:40
*** itlinux has joined #tripleo01:43
*** mdnadeem has quit IRC01:45
*** Petersingh is now known as Petersingh|afk01:46
*** itlinux has quit IRC01:58
*** zshi has joined #tripleo01:58
*** mdnadeem has joined #tripleo02:00
*** mdnadeem_ has joined #tripleo02:02
*** lblanchard has quit IRC02:03
*** mdnadeem has quit IRC02:06
*** ohochman has quit IRC02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970702:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897402:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910802:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)02:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)02:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)02:10
*** pmannidi has quit IRC02:10
*** pmannidi has joined #tripleo02:18
*** Petersingh|afk is now known as Petersingh02:32
*** psachin has joined #tripleo02:42
*** dxiri has quit IRC02:58
*** dxiri has joined #tripleo02:59
*** skramaja_ has quit IRC03:06
*** skramaja has joined #tripleo03:08
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970703:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897403:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910803:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)03:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)03:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)03:10
*** dhill_ has joined #tripleo03:10
*** dhill_ has quit IRC03:16
*** ramishra has joined #tripleo03:25
*** rh-jelabarre has quit IRC03:29
*** itlinux has joined #tripleo03:32
*** skramaja has quit IRC03:34
*** ykarel has joined #tripleo03:35
*** itlinux has quit IRC03:37
*** psachin has quit IRC03:37
*** Petersingh is now known as Petersingh|afk03:45
*** udesale has joined #tripleo03:46
*** ehengtan has joined #tripleo03:51
*** pdeore has joined #tripleo03:53
*** shreshtha has joined #tripleo03:54
openstackgerritTony Breeds proposed openstack/tripleo-common master: IPMI doesn't mandate a username or password so tripleo shouldn't either  https://review.openstack.org/50193703:56
openstackgerritTony Breeds proposed openstack/tripleo-common master: Allow platform in instackenv.json  https://review.openstack.org/53561403:56
openstackgerritTony Breeds proposed openstack/tripleo-common master: Import image name functions and update_nodes_deploy_data from tripleoclient  https://review.openstack.org/53776803:56
openstackgerritTony Breeds proposed openstack/tripleo-common master: WiP: Use update_nodes_deploy_data  https://review.openstack.org/53776903:56
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Introduce trivial helpers to manage image_files and names  https://review.openstack.org/53561603:56
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Always define properties for image even if empty  https://review.openstack.org/53561703:56
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Add --architecture support when uploading images  https://review.openstack.org/53561803:56
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Add --platform support when uploading images  https://review.openstack.org/53561903:56
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Actually use the arch and platform to select appropriate images  https://review.openstack.org/53562003:56
openstackgerritTony Breeds proposed openstack/python-tripleoclient master: Switch to using assert_has_calls() instead of assertEqual()  https://review.openstack.org/53562103:56
*** shreshtha has quit IRC04:06
*** shreshtha has joined #tripleo04:07
*** Petersingh|afk is now known as Petersingh04:08
*** shreshtha_ has joined #tripleo04:08
*** rh-jelabarre has joined #tripleo04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970704:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897404:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910804:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)04:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)04:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)04:10
*** shreshtha has quit IRC04:12
*** skramaja has joined #tripleo04:18
openstackgerrityatin proposed openstack/tripleo-quickstart master: Switch to containerized undercloud net config  https://review.openstack.org/57905104:26
*** ratailor has joined #tripleo04:33
*** ykarel has quit IRC04:35
openstackgerritTony Breeds proposed openstack/tripleo-heat-templates master: Add a ComputePPC64LR role  https://review.openstack.org/54024104:46
openstackgerritTony Breeds proposed openstack/tripleo-heat-templates master: Add a ComputePPC64LE role  https://review.openstack.org/54024104:46
*** aufi has joined #tripleo04:55
openstackgerritSteve Baker proposed openstack/python-tripleoclient master: Create docker group and find gid in tripleo deploy  https://review.openstack.org/57905404:57
openstackgerritSteve Baker proposed openstack/tripleo-heat-templates master: Add docker group to mistral executor  https://review.openstack.org/57901804:58
*** rh-jelabarre has quit IRC04:58
*** ykarel has joined #tripleo05:02
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Switch to workflow driven image prepare  https://review.openstack.org/57347605:05
*** raghava has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970705:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897405:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910805:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)05:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)05:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)05:10
raghavaHi Team, I am trying to deploy overcloud, we could see that PXE boot is not working in the overcloud node. DHCP req are offered but there is no ack received by the server. Can anyone please help me on this05:11
*** atarlov has joined #tripleo05:12
*** dxiri has quit IRC05:12
tonybraghava: do you see thre DHCP requests on the pxe server?  could that being blocked at the network layer?05:12
raghavatonyb: First time i am setting up deployment using director. Can you please help me how to debug that05:14
tonybraghava: run tcpdump on the director node and ensure you're seeing the DHCP requesst from the nodes as they're booting.05:15
tonybraghava: I assume that the introspection was successful, as you said you're trying to deploy the overcloud05:15
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: Invokes derive parameters for all deployments  https://review.openstack.org/57270105:19
*** yprokule has joined #tripleo05:20
*** pcaruana has joined #tripleo05:20
raghavatonyb: I have executed "openstack overcloud node import --introspect --provide instackenv.json" and it says successfull. But later status of a node says "Introspection timeout"05:23
tonybraghava: What does openstack baremetal node list say?05:25
tonybcan you pastebin it at https://paste.openstack.org ?05:26
*** atarlov has quit IRC05:30
*** paramite has joined #tripleo05:30
*** atarlov has joined #tripleo05:30
*** janki has joined #tripleo05:31
*** quiquell|off is now known as quiquell|rover05:31
*** atarlov has quit IRC05:34
ehengtanHow do i restart the services of undercloud? I can access to the director dashboard but it shows mistral API error and zaqar websocket error05:35
*** cshastri has joined #tripleo05:36
tonybehengtan: They're just systemd services so log in as root and do soemthigin like systemd status openstack-zaqar05:36
*** zshi has quit IRC05:38
ehengtanI cant grep any openstack services. But i can access to the director ui and add nodes05:38
*** atarlov has joined #tripleo05:43
*** skramaja_ has joined #tripleo05:44
*** skramaja has quit IRC05:47
*** ksambor has joined #tripleo05:51
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add a PartitionTableNode to graph  https://review.openstack.org/57905905:52
*** khyr0n has quit IRC05:53
*** khyr0n has joined #tripleo05:53
*** ccamacho has joined #tripleo05:59
*** jbadiapa has joined #tripleo06:04
*** atarlov has quit IRC06:04
*** atarlov has joined #tripleo06:05
openstackgerritMerged openstack/tripleo-common stable/queens: Let TripleO generate ODLPassword  https://review.openstack.org/57850406:05
raghavatonyb: openstack baremetal node list says following output https://pastebin.com/8AeiJAtE06:07
*** holser_ has joined #tripleo06:07
*** holser_ has quit IRC06:08
openstackgerritMerged openstack/tripleo-common master: filter available role by tags  https://review.openstack.org/57681406:08
openstackgerritMerged openstack/tripleo-ui master: Add general error message to NodesAssignmentForm  https://review.openstack.org/56722106:08
*** holser_ has joined #tripleo06:08
*** atarlov has quit IRC06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970706:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897406:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910806:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)06:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)06:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)06:10
*** lvdombrkr has joined #tripleo06:11
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Set ODL API restart policy to unless-stopped  https://review.openstack.org/57855506:11
*** lvdombrkr89 has joined #tripleo06:13
*** dparkes has joined #tripleo06:14
*** lvdombrkr has quit IRC06:16
*** ccamacho has quit IRC06:20
*** ccamacho has joined #tripleo06:20
*** mrsoul_ is now known as mschuppert06:20
openstackgerritQuique Llorente proposed openstack/tripleo-quickstart-extras master: Revert "set container variables when needed"  https://review.openstack.org/57906206:24
raghavatonyb: Openstack baremetal node list gives following output http://paste.openstack.org/show/724567/06:25
*** pmannidi has quit IRC06:28
Tenguhello there :)06:29
*** bfournie1 has joined #tripleo06:30
*** mdnadeem has joined #tripleo06:31
*** mdnadeem_ has quit IRC06:31
*** bfournie has quit IRC06:31
*** quiquell|rover is now known as quique|rover|bbl06:31
*** psachin has joined #tripleo06:37
*** yolanda__ has joined #tripleo06:42
*** yolanda__ is now known as yolanda06:43
*** Petersingh is now known as Petersingh|afk06:47
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Add ability to set openshift container images  https://review.openstack.org/57644106:48
openstackgerritMerged openstack/paunch master: Refactor docker run arg building  https://review.openstack.org/57857206:50
openstackgerritMerged openstack/paunch master: Implement stop_signal, stop_grace_period  https://review.openstack.org/57861406:50
openstackgerritMerged openstack-infra/tripleo-ci master: Add new abstract base job and nodeset to zuul configuration  https://review.openstack.org/57843206:50
openstackgerritMerged openstack-infra/tripleo-ci master: Add new run playbook  https://review.openstack.org/57844206:50
openstackgerritMerged openstack/tripleo-quickstart master: Include python{2,3}-tripleo-common from delorean current  https://review.openstack.org/57877606:50
*** bogdando has joined #tripleo06:53
ehengtanDo anyone know how to restart zaqar and mistral services after rebooting undercloud?06:57
*** raghava__ has joined #tripleo06:59
*** raghava__ has quit IRC06:59
*** raghava__ has joined #tripleo07:00
*** Petersingh|afk is now known as Petersingh07:00
*** fzdarsky|afk has joined #tripleo07:00
*** quique|rover|bbl is now known as quiquell|rover07:02
*** raghava has quit IRC07:03
*** amoralej|off is now known as amoralej07:07
*** fzdarsky|afk has quit IRC07:07
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970707:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897407:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177926307:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)07:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)07:10
openstackLaunchpad bug 1779263 in tripleo ""AnsibleUndefinedVariable: 'dict object' has no attribute 'overcloud'"} at periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)07:10
*** tesseract has joined #tripleo07:10
*** dmacpher has quit IRC07:13
*** raghava__ has quit IRC07:14
*** cylopez has joined #tripleo07:16
*** atarlov has joined #tripleo07:16
openstackgerritBogdan Dobrelya proposed openstack/tripleo-quickstart master: Switch to the containerized services defaults  https://review.openstack.org/57908007:19
*** atarlov has quit IRC07:20
*** fzdarsky|afk has joined #tripleo07:22
*** jpich has joined #tripleo07:27
*** ratailor_ has joined #tripleo07:29
*** mdnadeem has quit IRC07:31
*** tosky has joined #tripleo07:32
*** ratailor has quit IRC07:32
*** Petersingh is now known as Petersingh|afk07:34
*** Petersingh|afk is now known as Petersingh|lunch07:36
*** athomas has joined #tripleo07:38
*** mdnadeem has joined #tripleo07:39
openstackgerritMerged openstack/tripleo-docs master: Update ha docs  https://review.openstack.org/57846607:47
*** cylopez has quit IRC07:49
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Handle blank lines followed by comment in nic conversion script  https://review.openstack.org/57895607:51
*** ratailor_ has quit IRC07:53
*** fzdarsky|afk is now known as fzdarsky07:54
*** ratailor has joined #tripleo07:55
*** jpena|off is now known as jpena07:56
*** florianf has joined #tripleo07:57
*** ratailor_ has joined #tripleo07:58
*** dtrainor has quit IRC07:58
*** dtrainor has joined #tripleo07:58
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Align roles file to become a normalized path  https://review.openstack.org/57240407:59
*** ratailor_ has quit IRC07:59
*** ratailor has quit IRC07:59
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722408:00
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Handle blank lines followed by comment in nic conversion script  https://review.openstack.org/57895608:02
*** gkadam has joined #tripleo08:02
*** d0ugal has joined #tripleo08:03
openstackgerritBogdan Dobrelya proposed openstack/tripleo-docs master: Document containers system config options  https://review.openstack.org/57805608:06
*** ratailor has joined #tripleo08:06
openstackgerritClark Chen proposed openstack/tripleo-ha-utils master: Fix iptables insert command from -A to -I  https://review.openstack.org/57908708:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970708:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897408:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927108:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)08:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)08:10
bogdandoPTAL https://review.openstack.org/#/q/topic:bug/1778505+(status:open+OR+status:merged)08:10
bogdandohttps://review.openstack.org/#/c/575742/ also please08:11
*** skramaja_ has quit IRC08:13
*** skramaja_ has joined #tripleo08:15
*** ykarel is now known as ykarel|lunch08:16
*** shardy has joined #tripleo08:20
*** raghava has joined #tripleo08:20
openstackgerritJaganathan Palanisamy proposed openstack/python-tripleoclient master: Invokes derive parameters for all deployments  https://review.openstack.org/57270108:24
*** ehengtan has quit IRC08:25
openstackgerritCarlos Goncalves proposed openstack/tripleo-heat-templates master: Upload amphora image in RAW format if RBD backend  https://review.openstack.org/57757908:29
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/57909608:34
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Get ctlplane interface config from the subnet  https://review.openstack.org/56954708:40
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Refactor the inventory generation  https://review.openstack.org/57871508:40
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Add the ability to scaleup the openshift stack  https://review.openstack.org/57828508:40
*** lyarwood is now known as lyaaaaaaaarwood08:42
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Refactor the inventory generation  https://review.openstack.org/57871508:42
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Add the ability to scaleup the openshift stack  https://review.openstack.org/57828508:42
*** gkadam_ has joined #tripleo08:43
*** gkadam_ has quit IRC08:43
*** fzdarsky has quit IRC08:45
*** gkadam has quit IRC08:46
openstackgerritHarald Jensås proposed openstack/tripleo-quickstart-extras master: Remove ctlplane data from CI network-environment  https://review.openstack.org/57778608:49
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Add a PartitionTableNode to graph  https://review.openstack.org/57905908:50
openstackgerritIan Wienand proposed openstack/diskimage-builder master: Move LVM cleanup phase into cleanup  https://review.openstack.org/57910208:50
*** derekh has joined #tripleo08:50
shardyjtomasek: Hey good morning08:53
shardyjtomasek: thanks for the feedback on https://review.openstack.org/#/c/577127 - I added a question re the folder name vs the plan-environment.yaml name08:53
jtomasekshardy: Hi08:53
shardythe latter is not necessarily going to be unique08:53
shardye.g there could be multiple "overcloud" named plans in different directories like openstack, openstack_dpdk, etc08:54
shardyI wasn't sure if we could even change that name, because it's probably used for the stack name?08:54
*** panda|off is now known as panda08:54
shardyor at least it'd be confusing as historically stack name == plan name, I'm not sure mismatching them will work08:55
*** Petersingh|lunch is now known as Petersingh08:57
openstackgerritMerged openstack/tripleo-heat-templates master: Role specific derive parameters workflow parameter  https://review.openstack.org/57877808:57
jtomasekshardy: ah, I was thinking about it too, it would be safer, ideal returned structure would be an array of plan type objects: [{ name: 'openstack', contents: "yaml string", plan-environment: "plan-samples/openstack/plan-environment.yaml}, ...]08:57
jtomasekshardy: that would require no additional non standard manipulation on the GUI side08:58
shardyjtomasek: Ok I'll rework it to output that format08:58
shardyI was thinking a map of name: <contents> but a list should be fine08:59
jtomasekshardy: list gives us ordering in case we need it08:59
shardyat some point we should probably look at the use of the "name" field in the plan-environment, as I'm not sure it's consistently applied atm08:59
jtomasekshardy: I hope it won't cause yaql headache for you :)08:59
shardye.g you can create an "overcloud" plan then override the plan/stack name with --stack foo09:00
shardyjtomasek: hehe yeah I may need another coffee before attempting this yaql wrangling :D09:00
jtomaseklol09:00
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Delete default ODL Password  https://review.openstack.org/57850509:01
openstackgerritMerged openstack/tripleo-heat-templates master: Add release note link in README  https://review.openstack.org/57867909:01
openstackgerritMerged openstack/tripleo-heat-templates master: Make BIND listen address configurable  https://review.openstack.org/57582209:01
openstackgerritMerged openstack/tripleo-ui master: Sanitize messages in FormErrorList  https://review.openstack.org/57504109:01
*** numans_ has joined #tripleo09:02
*** numans_ has quit IRC09:02
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment  https://review.openstack.org/56636609:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Add Recover deployment status button and actions  https://review.openstack.org/56909209:03
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: [WIP] List deployment failures on deployment failure  https://review.openstack.org/57871209:03
*** colonwq has quit IRC09:03
*** skramaja_ has quit IRC09:09
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970709:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897409:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927109:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)09:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)09:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)09:10
*** zoli is now known as zoli|lunch09:13
*** spsurya has quit IRC09:14
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations  https://review.openstack.org/57844709:15
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Migrating 2-nodes jobs to the new base configuration  https://review.openstack.org/57845609:15
*** colonwq has joined #tripleo09:15
numansshardy, Hi, can you please add this to your review queue - https://review.openstack.org/#/c/578788/09:15
*** skramaja has joined #tripleo09:16
*** cylopez has joined #tripleo09:17
shardynumans: ack will do09:20
*** fzdarsky has joined #tripleo09:26
openstackgerritKamil Sambor proposed openstack/python-tripleoclient master: Reduce number of mock in tests  https://review.openstack.org/57875109:32
openstackgerritMerged openstack/instack-undercloud stable/queens: Set undercloud nova notification_format to 'unversioned'  https://review.openstack.org/57779009:41
d0ugaljpich: did you see this patch? https://review.openstack.org/#/c/578751/09:47
d0ugaljpich: I thought you might appreciate it, I think you were one of the people I spoke with about this...09:48
jankiHi. Can I get some reviews plz https://review.openstack.org/#/c/575416/09:51
jankishardy, skramaja jistr mandre ^09:52
jpichd0ugal: You did! Very nice, hadn't seen the patch09:52
*** akrivoka has joined #tripleo09:53
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Drop example in config file comments  https://review.openstack.org/57817309:53
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Drop example in config file comments  https://review.openstack.org/57817209:54
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Drop example in config file comments  https://review.openstack.org/57817309:56
*** sshnaidm is now known as sshnaidm|off10:02
*** ykarel|lunch is now known as ykarel10:05
openstackgerritHarald Jensås proposed openstack/instack-undercloud master: Drop example in config file comments  https://review.openstack.org/57817310:06
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Drop example in config file comments  https://review.openstack.org/57817210:06
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Option to upload Octavia amphora img in RAW format  https://review.openstack.org/57757310:06
*** fzdarsky has quit IRC10:07
*** cylopez has quit IRC10:09
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970710:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897410:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927110:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)10:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)10:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)10:10
*** holser_ has quit IRC10:12
*** bfournie1 has quit IRC10:13
*** bfournie has joined #tripleo10:20
*** holser_ has joined #tripleo10:22
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Replace 'raise StopIteration' with 'return'  https://review.openstack.org/57911610:27
d0ugaljpich: ^10:27
*** derekh has quit IRC10:29
*** Petersingh has quit IRC10:30
*** derekh has joined #tripleo10:30
*** holser_ has quit IRC10:32
*** dobson has quit IRC10:42
*** dtantsur|afk is now known as dtantsur10:43
*** pchavva has joined #tripleo10:44
*** skramaja has quit IRC10:45
*** panda is now known as panda|ko10:53
*** dobson has joined #tripleo10:54
Tengujaganathan: heya! fine for me for your proposed time. Care to schedule some BJ talk in google calendar? That would be nice of you.10:56
*** kopecmartin has joined #tripleo11:01
yolandadtantsur, about https://review.openstack.org/#/c/577799/11:03
*** d0ugal_ has joined #tripleo11:03
yolandado you prefer that i add some argument to specify the image type to be uploaded?11:04
yolandai thought about that path, but looked more complex to me, as i had to include that set of types11:04
jaganathanTengu, hi11:04
*** d0ugal has quit IRC11:05
Tengujaganathan: just poping out now - it's lnuch break ;).11:05
jaganathanTengu, will schedule it. thanks11:06
*** jpena is now known as jpena|lunch11:06
Tengujaganathan: thank you :). see you on Tuesday then ;). Have a nice weekend i nthe meanwhile.11:06
jaganathanTengu, thanks, Have a nice weekend. bye11:06
*** gfidente has joined #tripleo11:09
*** gfidente has quit IRC11:09
*** gfidente has joined #tripleo11:09
*** cylopez has joined #tripleo11:09
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970711:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897411:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927111:10
*** ooolpbot has quit IRC11:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)11:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)11:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)11:10
*** zoli|lunch is now known as zoli11:10
*** fzdarsky has joined #tripleo11:15
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic  https://review.openstack.org/57785511:16
*** abishop has joined #tripleo11:18
dtantsuryolanda: it would be a bit more explicit, yes. but I'm kind of +0 on the current patch11:22
yolandai posted a comment there, can you check? i don't mind amending it11:22
*** udesale has quit IRC11:24
owalshjistr: are pre_upgrade_rolling_tasks run on computes at the beginning of an upgrade?11:26
yolandaanyway, i'll try to reproduce again locally11:29
yolandaagh, bad channel11:29
*** pdeore has quit IRC11:29
*** sshnaidm|off has quit IRC11:29
*** edmondsw has joined #tripleo11:32
*** ratailor has quit IRC11:32
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: OVN: Remove environment files which deploy OVN dbs in non HA  https://review.openstack.org/57878811:34
pradkCan someone please review these - https://review.openstack.org/#/q/topic:cors-config+(status:open+OR+status:merged)11:36
*** mdnadeem has quit IRC11:38
*** trown|outtypewww is now known as trown11:49
*** pchavva has quit IRC11:49
*** holser_ has joined #tripleo11:50
*** zshi has joined #tripleo11:51
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Migrate undercloud jobs to the new base configurations  https://review.openstack.org/57844711:51
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Migrating 2-nodes jobs to the new base configuration  https://review.openstack.org/57845611:51
openstackgerritFlavio Percoco proposed openstack/puppet-tripleo master: Add openshift API to haproxy LB configuration  https://review.openstack.org/57912811:55
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Refactor the inventory generation  https://review.openstack.org/57871512:01
openstackgerritFlavio Percoco proposed openstack/tripleo-heat-templates master: Add the ability to scaleup the openshift stack  https://review.openstack.org/57828512:01
*** pchavva has joined #tripleo12:04
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Use correct release file for periodic jobs  https://review.openstack.org/57879312:05
*** jpena|lunch is now known as jpena12:07
*** cylopez has quit IRC12:07
*** cylopez has joined #tripleo12:07
owalshbogdando: NB we didn't have tripleo support for nova instances on NFS, but we know it's being used in production12:07
openstackgerritSaverio Proto proposed openstack/diskimage-builder master: Add support for Fedora 28  https://review.openstack.org/57913112:07
bogdandoowalsh: ack, thanks12:07
owalshbogdando: worked fine prior to containers, so it's kindof a regression12:08
bogdandoI'm mostly concerned for the testing the change12:08
owalshbogdando: I'm testing the hell of out this :-) -W until I'm done12:08
bogdandook, thanks! )12:08
owalshbogdando: will look at oooq and infrared support for NFS soon12:09
owalshbogdando: upgrade to containers is still an issue... expect we will need to take down the nova-compute services for the entire upgrade12:09
owalsh... when we detect NFS is used12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970712:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897412:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927112:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)12:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)12:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)12:10
jistrowalsh: re pre_upgrade_rolling_tasks being run -- not presently i think. I think we wanted to introduce them because of Neutron containerization but i think they weren't needed in the end, so the playbook didn't get plugged into the framework.12:10
owalshjistr: damn... that would have been useful. TL;DR expect I'll need to stop nova-compute systemd service on all hosts before upgrading to containers when NFS is used12:11
owalshjistr: think the best I can do is just fail in upgrade tasks if nova-compute is running with NFS https://review.openstack.org/57790712:13
owalshjistr: operator could then stop the nova-compute services everywhere12:14
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Use correct release file for periodic jobs  https://review.openstack.org/57879312:15
*** d0ugal_ has quit IRC12:15
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: Add ability to set openshift container images  https://review.openstack.org/57644112:16
*** d0ugal_ has joined #tripleo12:17
jistrowalsh: we could plug in the rolling tasks too if that helps. But we should make sure that we only stop the nova-compute when necessary, as normally after Controller upgrade is done, the cloud is manageable again. With stopped nova-compute services, that wouldn't be the case.12:17
openstackgerritQuique Llorente proposed openstack-infra/tripleo-ci master: Use correct release file for periodic jobs  https://review.openstack.org/57879312:17
quiquell|roverHello there12:18
quiquell|roverDo we now if there any issue with limestone cloud provider ?12:18
quiquell|roverMost of the timeouts are hitting it12:18
bogdandoquiquell|rover, weshay: folks, It seems that making tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates voting was not good idea12:20
bogdandogiven that it timeouts like always12:20
bogdandopretty*12:20
bogdandonow we have tones of all-green-but-one-timeout patches12:21
bogdando:)12:21
ykareland gate queue 16+ hr12:21
ykarelno 17+ :)12:22
quiquell|roverbogdando: Just th etimeouts ?12:22
bogdandoquiquell|rover: not sure12:22
*** raildo has joined #tripleo12:22
quiquell|rovertripleo-ci-centos-7-containers-multinode12:22
quiquell|roverIs failint too12:22
quiquell|roveral related containers12:22
bogdandoykarel: that's what I call recheck storms12:22
quiquell|roverand most of them running at limestone cloud provider12:23
bogdandoquiquell|rover: OSError: [Errno 101] Network is unreachable I can see for https://review.openstack.org/#/c/579080/ example12:23
bogdandobut the exec time of 3h 17m made me thinking its a timeout12:23
bogdandooh, it is http://logs.openstack.org/80/579080/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/fe4c213/job-output.txt.gz#_2018-06-29_10_42_30_113162 que12:24
bogdandoquiquell|rover: ^^12:24
quiquell|roverbogdando: 143 == 012:24
quiquell|roverrc 143 is timeout12:24
bogdandoyes12:24
bogdandothat's what I meant12:24
bogdandosee the link12:25
quiquell|roverand again is limestone provider12:25
quiquell|roverhttp://logs.openstack.org/80/579080/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/fe4c213/zuul-info/inventory.yaml12:25
* bogdando sigh12:25
quiquell|roverundercloud 2:15 hours12:25
quiquell|roverhttp://logs.openstack.org/80/579080/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/fe4c213/logs/ara_oooq/12:25
bogdandoit's normal time is 80 min12:25
weshaybogdando, hrm.. making anything vote is not12:25
bogdando:)12:26
weshaybogdando, I have not seen a pattern w/ that job12:26
quiquell|roverweshay: Do you have a minute, I have to show you something12:26
weshayquiquell|rover, I have 412:26
quiquell|rover2 is enough12:26
weshayhttps://bluejeans.com/u/whayutin/12:26
weshaybogdando, mwhahaha we need to clear the queue, merge some patches and move on12:26
*** lblanchard has joined #tripleo12:27
openstackgerritMerged openstack/tripleo-common master: Set deployment_status on error in get_blacklisted_hostnames  https://review.openstack.org/57871712:27
*** vpickard_ is now known as vpickard12:27
owalshjistr: yea, only if /var/lib/nova/instances is an NFS mount. Looking at the ansible_mounts fact to check this12:28
bogdandoquiquell|rover, weshay: stats for the 143 timeout winners https://pastebin.com/fsbDD0eS12:28
*** rcernin has quit IRC12:29
jistrowalsh: if you want to test the pre_upgrade_rolling_tasks approach, the playbook should already be generated i think, you should be able to just plug it in here before upgrade_steps_playbook https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/constants.py#L5412:30
*** dhill_ has joined #tripleo12:30
jistrowalsh: actually... it will only be run on the nodes that we're upgrading12:31
*** raghava has quit IRC12:32
jistrthe difference between upgrade_tasks and pre_upgrade_rolling_tasks is the rolling aspect12:32
jistrbut the ansible --limit still applies to both12:32
mschuppertanyone can tell me if there is a special recheck command to just rerun zuul gate, or do I have to trigger a full recheck?12:33
quiquell|roverbogdando: http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1&var-influxdb_filter=job_name%7C%3D~%7C%2Fcontainer%2F12:33
quiquell|rovercontainer jobs per cloud/region12:33
quiquell|roverbogdando: Sorry this one http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1&var-influxdb_filter=job_name%7C%3D%7Ctripleo-ci-centos-7-containers-multinode12:34
bogdandomschuppert: yes, there is no a single-job recheck button, that option had a strong pushback in the past12:34
mschuppertbogdando: ok, thx. then a full recheck12:35
*** holser_ has quit IRC12:35
owalshjistr: hrmm, ok... going to test this now. Might not need to do anything - once the chown occurs on the NFS export (first compute node is upgraded) I expect the old nova-compute services will fail with permissions issues12:36
*** dprince has joined #tripleo12:37
owalshjistr: but it would be nicer to fail in the upgrade task and warn the operator at least12:37
*** zul has joined #tripleo12:38
*** ccamacho has quit IRC12:38
*** holser_ has joined #tripleo12:39
owalshjistr: is it possible to pass custom facts to the upgrade tasks? Might be nicer than having to set a heat param and re-create the ansible tasks12:39
quiquell|roverbogdando: Do you know where to ask about cloud providers ?12:39
bogdandoquiquell|rover: #openstack-infra12:39
quiquell|roverbogdando: Humm already there12:40
*** quiquell|rover is now known as quique|rover|lch12:40
*** cylopez has quit IRC12:41
owalshjistr: whatever I do, it needs to be backportable to OSP12 (maybe just queens upstream) when we switch to containers12:42
*** rlandy has joined #tripleo12:42
*** mvenesio has joined #tripleo12:45
*** peereb has joined #tripleo12:46
*** ccamacho has joined #tripleo12:46
*** root__ has joined #tripleo12:47
*** openstackgerrit has quit IRC12:49
*** lvdombrkr89 has quit IRC12:50
*** mvenesio has quit IRC12:51
*** thrash|g0ne is now known as thrash12:52
*** karthiks has joined #tripleo12:54
*** lvdombrkr89 has joined #tripleo12:55
*** root__ has quit IRC12:58
rookslagle: hey - if i wanted to try Config-download w/ queens, is there steps to do so?12:58
slaglerook: yes, you need to pass --config-download and -e /usr/share/openstack-tripleo-heat-templates/environments/config-download-environment.yaml13:02
slaglerook: or, you can just pass the -e environment, and then go through the config-download steps manually13:02
slaglerook: that's roughly doc'd here: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/ansible_config_download.html#ansible-playbook-manual-execution13:03
*** holser_ has quit IRC13:04
weshaymwhahaha, I think we could consider promotion if we landed this patch https://review.openstack.org/#/c/578292/13:05
weshaymwhahaha, /me looking at https://review.rdoproject.org/zuul/13:05
*** cylopez has joined #tripleo13:07
jistrowalsh: you mean custom variables, like ansible --extra-vars?13:08
owalshjistr: yea, just need a way for the user to disable the check13:08
*** toure|gone is now known as toure13:09
owalshjistr: so could have something like when: user_has_set_this_fact_in_extra_vars|default(false)13:09
jankijistr, hey13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970713:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897413:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910813:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927113:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)13:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)13:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell)13:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)13:10
*** nenad has joined #tripleo13:12
jistrowalsh: there's no "proper" way that end users, just basically using tripleo-config-download and ansible-playbook instead of the normal CLI13:12
jistrs/that/for/13:12
*** d0ugal_ has quit IRC13:12
*** amoralej is now known as amoralej|lunch13:13
*** d0ugal has joined #tripleo13:13
*** d0ugal has quit IRC13:13
*** d0ugal has joined #tripleo13:13
jistrjanki: hi13:13
owalshjistr: could use a heat param I guess (what I have right now)13:13
jankijistr, that post_update patch is owrking. I tested :)13:13
jankibut found another error13:13
jankijistr,  \\"upgradeInProgress\\": false } }\\" -H \\"Content-Type: application/json\\" http://:8081/restconf/config/genius-mdsalutil:config", "delta": "0:00:00.017184", "end": "2018-06-29 13:30:37.861569", "msg": "non-zero return code", "rc": 6, "start": "2018-06-29 13:30:37.844385", "stderr": "* Could not resolve host: ; Unknown error\\n* Closing connection 0", "stderr_lines": ["* Could not resolve host: ; Unknown error", "* Closing13:14
jankiconnection 0"], "stdout": "", "stdout_lines": []}13:14
*** udesale has joined #tripleo13:14
jankiI figured out the reason for ODL_USERNAME but can't figure out the ODL_URI13:14
*** zul_ has joined #tripleo13:15
*** zul has quit IRC13:18
nenadHi everyone, sorry for an obvious question perhaps, but I am configuring the undercloud and would like it to have the UI enabled and accessible from a NIC which is not inside provisioning network. Can I just use the external IP address of the undercloud which is set on that NIC - the same one I am using to SSH into my baremetal undercloud?13:19
mwhahahaweshay: so it's friday and i see you're pinging me before 7am, whats broken now13:19
weshaysoryr13:20
weshaysorry13:20
shardynenad: yes I think if you enable SSL then the UI will listen on the external interface by default13:21
jankijistr, details - https://pastebin.com/FRqi5H8Y13:21
*** tcw has quit IRC13:21
nenadshardy so I can just put that IP under undercloud_public_host, or should I lerave all that default and just configure the cert parts?13:22
nenads/lerave/leave13:22
mwhahahaweshay: gah these timeouts13:22
jistrowalsh: yea i guess that's as good as it can get if we require manual intervention. Re-running `upgrade prepare` essentially.13:23
*** mcornea has joined #tripleo13:23
shardynenad: IIRC you need to enable SSL for undercloud_public_host to work, the option says "Only used with SSL"13:24
shardynenad: so you probably want to set generate_service_certificate = True13:24
*** zul_ has quit IRC13:24
shardynenad: the other option is to tunnel to the provisioning network via SSH13:25
*** zul has joined #tripleo13:25
nenadshardy: yeah, the undercloud_public_host expects a value, it's not a boolean, so I suppose I can put the public IP of the external NIC there (along with the generate_service_certificate and that ...)13:25
jistrjanki: hm yea there must be malformed entry for ODL in the endpoint map. It outputs port but no IP13:26
nenadshardy: I guess the gist of my question is: can I set my public IP as a undercloud_public_host, setting the SSL parameters as required, and expect it to work? :)13:26
jankijistr, yes. and the protocol too. just not IP. where to check what IP address in formed in that endpoint?13:27
*** openstackgerrit has joined #tripleo13:27
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: [WIP] Add a standalone role for creating the zuul-hosts file  https://review.openstack.org/57915413:27
mwhahahaweshay: fyi for the selinux issue https://review.openstack.org/#/q/topic:bug/1779005+(status:open+OR+status:merged)13:27
*** derekh has quit IRC13:28
weshayaye.. saw the patches13:28
weshaythanks13:28
*** derekh has joined #tripleo13:29
shardynenad: IIRC undercloud_public_host is a VIP so you may want to use a different IP than the nic IP13:29
*** tcw has joined #tripleo13:29
*** zul_ has joined #tripleo13:29
weshaymwhahaha, re: timeouts http://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=1&var-influxdb_filter=job_name%7C%3D%7Ctripleo-ci-centos-7-scenario000-multinode-oooq-container-updates13:29
weshayupdate job is failing only on one upstream provider13:29
mwhahahanow with charts!13:29
mwhahahathat's the infracloud isn't it?13:30
mwhahahalimestone13:30
nenadshardy: so then I need to get another IP 'attached' there from the public IP range13:30
weshayI think13:30
weshayya.. and limestone is killing us13:30
weshayRegionOne13:31
jistrjanki: in code it's here https://github.com/openstack/tripleo-heat-templates/blob/07822d782ff5b61a9c72588ea106d49107a8c653/overcloud.j2.yaml#L33913:31
*** agopi has quit IRC13:31
jistrso it would be querying heat api for info in the resources13:31
*** ohochman has joined #tripleo13:31
jistrjanki: probably somehting like `openstack stack resource show overcloud EndpointMap`13:31
weshaymwhahaha, do you want to promote w/ the undercloud idempotency issue? and merge the fix asap?13:32
mwhahahaweshay: we fixed the idempotency problem, it was the bad config wasn't it?13:32
weshaythere is an old ironic call in the validation13:33
weshayhttps://review.openstack.org/#/c/578292/13:33
jistrjanki: and it's also in outputs https://github.com/openstack/tripleo-heat-templates/blob/07822d782ff5b61a9c72588ea106d49107a8c653/overcloud.j2.yaml#L97513:33
weshaythat's the only thing failing in master for promotion that we care about atm13:33
*** quiquell|tmp has joined #tripleo13:33
mwhahahaweshay: yea but that's not idempotency, that should merge today tho13:33
jistrjanki: so `openstack stack output show overcloud EndpointMap` i think13:33
weshaymy suggestion is to promote and get that patch merged13:33
nenadshardy: and a small side-note, does this mean that I would have to assign it a public undercloud_admin_host IP as well (not to have them half in provisioning and half in external networks)?13:34
*** zul has quit IRC13:34
mwhahahaweshay: yea but we use that in ci right? we can't promote w/o it13:34
weshayyes.. we have a job that will fail as well..13:34
mwhahahai think we just need to let the gate take it's course and try and figure out the timeout stuff13:35
mwhahahaor drop the updates job13:35
weshaynack on dropping it13:35
weshayit's not even the only job causing the timeouts13:35
quiquell|tmpContainers jobs in general13:36
weshaymwhahaha, bogdando I would like to know more about your analysis of that job13:36
quiquell|tmpNot onlu updates13:36
weshayI think you guys may not have it right13:36
ykarelweshay, mwhahaha for ironic introspection issue fix:- https://review.openstack.org/#/c/579051/13:36
ykarelfs02013:36
*** dparkes has quit IRC13:36
ykarelafter this we have to see only tempest issues if any13:37
ykarelfor my local run 2 tests failed, that may be transient13:37
ykarelswift tests13:37
weshaythanks ykarel13:37
weshaymwhahaha, bogdando the upstream queue is going to go over 24 hr today for sure13:38
weshayquiquell|tmp, can you show me the new dashboard again if you have a sec13:42
* weshay has questions13:42
quiquell|tmphttp://38.145.34.131:3000/d/2kHMNHvik/exploration?orgId=113:43
quiquell|tmpYou can filter by the fields13:43
shardynenad: I think undercloud_public_host and undercloud_admin_host could potentially be in some other range then you can route to that from your public nic13:43
quiquell|tmpLimestone is alwas high durations13:44
shardynenad: they're added to the bridge on the undercloud, so they don't necessarily have to be additional ips from the public range I think13:44
shardybut they could be13:44
nenadshardy: by default they are in Provisioning range, but I will not be able to access the UI from the provisioning range.13:44
weshayquiquell|tmp, sure.. but re: job builds count per cloud13:44
weshayquiquell|tmp, where is the status of those builds13:44
nenadshardy: ok.. but they can't really match my IP address set on a physical NIC13:45
shardynenad: if you enable SSL you can access the UI from the public IP13:45
beaglesmwhahaha, if we land a "docker-container-shutdown" service in rocky, is that something that we would consider backporting to queens?13:45
* beagles weighing strategies for queens13:45
quiquell|tmpWeshay let me take the keys and we talk about it13:45
weshayquiquell|tmp, and for "job build duration per cloud", can I get that in minutes not hours13:45
nenadshardy: Yeah so that is what I need. In order to enable SSL I just neet to generate certs?13:45
weshayquiquell|tmp, k13:45
nenadshardy: and leave the rest as it is in the conf file, ie. commented out.13:45
shardynenad: yes or let the undercloud install generate self-signed certs by setting generate_service_certificate = True13:46
*** bnemec has joined #tripleo13:46
mwhahahabeagles: it might be, though i think the correct thing is to backport the paunch bits13:46
weshayoh.. I see failing > 3h13:46
mwhahahabeagles: and fix the THT for the services13:46
nenadshardy: right! Cool, I will try that (was considering self-signed anyway.)13:46
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multionode reproducer tasks  https://review.openstack.org/57916113:46
nenadshardy: thanks a lot, I will give it a shot :)13:46
shardynenad: Depending on the build you might have to use chrome, as there was a bug specific to firefox w/self-signed certs13:46
*** bnemec is now known as beekneemech13:46
openstackgerritRyan Brady proposed openstack/python-tripleoclient master: Changes Creation Of overcloudrc File to Call Workflow  https://review.openstack.org/54535113:47
nenadshardy: it is the OSP 13 .. i forget the name13:47
*** quiquell__ has joined #tripleo13:47
bogdandoweshay: there is also elastic recheck CLI, see the results for the 143 error: https://pastebin.com/fsbDD0eS . Is that what you have asked for?13:47
shardynenad: https://bugzilla.redhat.com/show_bug.cgi?id=155163513:47
openstackbugzilla.redhat.com bug 1551635 in certmonger "Can't log in to the director UI with Firefox" [Urgent,On_qa] - Assigned to rcritten13:47
nenadshardy: oh.. Ok. Will use Chrome then. thanks for the heads-up!13:48
*** ksambor has left #tripleo13:48
beaglesmwhahaha, paunch bits?13:48
weshaybogdando, ya.. I'm familiar w/ the recheck CLI and what we can see there13:48
beaglesmwhahaha, sorry I was talking about https://bugs.launchpad.net/tripleo/+bug/1778913 but maybe you are referring to having paunch update the service file?13:48
openstackLaunchpad bug 1778913 in tripleo "containers are not gracefully stopped on shutdown/reboot" [High,Triaged]13:48
mwhahahabeagles: https://review.openstack.org/#/c/578614/13:48
weshaybogdando, I gave up using it alot because nothing ever merged there13:48
weshayEVER13:48
beaglesoooohh13:49
mwhahahabeagles: i think if we launch the containers with the correct times it'll shutdown correctly13:49
* mwhahaha hasn't gotten to test it yet13:49
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Improve nova statedir ownership logic  https://review.openstack.org/57785513:49
mwhahahabeagles: but i think that's what happening is that docker issues the stop and some services stop but systemd gives up after a specific time and kills it.  i'd like to see if setting the time correctly fixes it or if we need a dummy service13:50
*** quiquell|tmp has quit IRC13:50
mwhahahabeagles: my dummy service is a hack so i'd rather we fix it correctly if possible :D13:50
beaglesmwhahaha, ah okay I'll update and see what happens with that patch in place13:50
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: [WIP] Add a standalone role for creating the zuul-hosts file  https://review.openstack.org/57915413:50
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates stable/queens: Add option to override confirmation in yaml-nic-config-2-script.py  https://review.openstack.org/57916413:50
beaglesmwhahaha, ah okay, I didn't realize shutting down the docker service actually stops any docker containers13:51
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multionode reproducer tasks  https://review.openstack.org/57916113:51
mwhahahabeagles: it normally doesn't but i'm not sure what exactly is happening at shutdown13:51
mwhahahabeagles: if we update it and we find that it still doesn't stop then we can add in my dummy service13:52
beaglesmwhahaha, k I'll find out !13:52
jankijistr, 'OpenDaylightInternal': {u'p13:53
jankirotocol': u'http', u'host_nobrackets': u'', u'uri': u'http://:8081', u'uri_no_suffix': u'http://:8081', u'host': u'', u'port': u'8081'}, IP is not in endpointmap13:53
jistrjanki: and is it present for other services?13:54
*** jistr is now known as jistr|mtg13:54
jankijistr|mtg, yes13:55
*** ksambor has joined #tripleo13:55
*** bogdando has quit IRC13:56
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/network/service_net_map.j2.yaml#L7513:58
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/network/endpoints/endpoint_map.yaml#L712713:58
jistr|mtgjanki: and are you using the default value for ServiceNetMap ODL network?13:58
jistr|mtghttps://github.com/openstack/tripleo-heat-templates/blob/stable/queens/network/service_net_map.j2.yaml#L7313:58
shardyjanki, jistr|mtg: is it because there's a case mismatch between the service_net_map and the endpoint_data?13:59
shardyOpendaylight vis OpenDaylight13:59
jistr|mtgshardy: ah yea that's probably it, nice catch13:59
shardyI think the endpoint_data.yaml needs to be updated and the endpoint_map regenerated13:59
jankishardy, jistr|mtg doing that and trying again14:00
*** gfidente is now known as gfidente|pto14:00
*** agopi has joined #tripleo14:02
*** agopi_ has joined #tripleo14:03
*** agopi_ has quit IRC14:03
*** quiquell__ has quit IRC14:04
*** agopi_ has joined #tripleo14:05
*** quique|rover|lch is now known as quiquell|rover14:06
*** agopi has quit IRC14:06
*** jistr|mtg is now known as jistr14:09
*** ccamacho has quit IRC14:09
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970714:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897414:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910814:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927114:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)14:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)14:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,Fix committed] - Assigned to Quique Llorente (quiquell)14:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)14:10
*** d0ugal has quit IRC14:15
openstackgerritJiri Stransky proposed openstack/tripleo-heat-templates master: Update and upgrade tasks for services deployed via external deploy tasks  https://review.openstack.org/57917014:15
larsksDoes anyone have any hints on what's necessary to get rspec tests running sucessfully? I keep hitting ruby version issues or weird errors.  What works for you?14:16
mwhahahalarsks: rvm with ruby 2.1 works for me, i've had others report issues on fedora2814:16
mwhahahalarsks: you should be able to get away with a centos vm if you install the upstream puppet package14:17
mwhahahathat's what we do in ci14:17
larsksmwhahaha: yeah.  Yesterday I tried centos 7/f28/ubuntu 18.10/ubuntu 17.10 with no luck.  I haven't worked with rvm before; I'll give that a shot.14:17
*** d0ugal has joined #tripleo14:17
larsksI'll try centos 7 with upstream puppet (does that include a newer ruby?)14:17
larsksThere was some package in 'bundle install' that didn't like the stock version of ruby in centos...14:18
mwhahahalarsks: the upstream packages bundle ruby14:18
larsksAwesome.  Let me give that a shot.14:18
ykarelmwhahaha, when u say report issues, do you mean something like https://tickets.puppetlabs.com/browse/PUP-889214:21
ykareli filed this some days back14:21
mwhahahaykarel: i mean people mentioning it :D but yea that's a way to get that resolved upstream14:21
mwhahahathough puppet folks aren't terribly responsinve14:22
*** amoralej|lunch is now known as amoralej14:22
*** cshastri has quit IRC14:23
ykarelmwhahaha, ack issue is with ruby 2.5 and as per them ruby 2.5 support would not be there for puppet 414:23
mwhahahai know there was work to get puppet5 in rdo14:23
mwhahahanot sure the state of that14:23
*** ccamacho has joined #tripleo14:27
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multinode reproducer tasks  https://review.openstack.org/57916114:28
larsksmwhahaha: with centos 7 + upstream puppet repository, I get puppet from puppetlabs but ruby 2.0 from centos, and 'bundle install' for puppet-keystone fails with "Gem::InstallError: public_suffix requires Ruby version >= 2.1.".  I'm grabbing puppet from https://yum.puppetlabs.com/puppet/14:30
larsksCan you point me at the ci setup?14:31
mwhahahalarsks: https://github.com/openstack/puppet-openstack-integration14:31
larsksThanks.14:31
*** shreshtha_ has quit IRC14:33
* Tengu has his Red Hat and access card «o/14:33
*** lvdombrkr89 has quit IRC14:38
dpeacockTengu: congrats!14:39
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Update config docs  https://review.openstack.org/57917814:40
Tengudpeacock: I'll be back Monday for the real work. Annnnd... I guess I'll ask you some time in order to get a proper hand on bugzilla, if possible :)14:40
Tenguheard you're one of the right persons to ask.14:41
*** leanderthal has joined #tripleo14:42
*** vpickard has left #tripleo14:42
*** psachin has quit IRC14:42
dpeacockTengu: sure thing :-)14:43
*** mjturek has joined #tripleo14:44
Tengugreat :).14:44
Tenguwe'll stay in touch. My flight should be announced soon.14:44
dpeacockBon voyage Tengu!  Talk to you Monday. :-)14:44
dpeacockWait, Tuesday; holiday here in Canada.14:45
Tenguthank you :). have a nice weekend in the meanwhile.14:45
Tengudpeacock: ok :). Profit!14:45
Tengudon't eat too much poutine :)14:45
Tengu(if you have that kind of... dish... in your area ;))14:45
dpeacockTengu: lol14:46
dpeacock(we do)14:46
Tengu:D14:47
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Correct ODL network spelling at service_net_map  https://review.openstack.org/57918214:48
jankishardy, jistr ^14:48
openstackgerritRyan Brady proposed openstack/tripleo-common master: Fixes ordering of environment files in a deployment plan  https://review.openstack.org/57021514:48
*** yprokule has quit IRC14:50
*** kopecmartin has quit IRC14:51
*** mjturek has quit IRC14:52
*** rpioso|afk is now known as rpioso14:55
*** d0ugal has quit IRC14:55
openstackgerritJiri Stransky proposed openstack/tripleo-docs master: Developer docs for updates  https://review.openstack.org/57806914:56
*** shardy has quit IRC14:58
*** beagles is now known as beagles_mtg14:58
*** ksambor has quit IRC14:58
*** d0ugal has joined #tripleo15:01
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: Add pipefail when running overcloud upgrade scripts  https://review.openstack.org/57918915:03
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970715:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897415:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910815:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927115:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)15:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)15:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)15:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)15:10
*** aufi has quit IRC15:12
*** leanderthal has quit IRC15:14
*** janki has quit IRC15:16
*** noslzzp has quit IRC15:18
*** openstack has quit IRC15:22
*** openstack has joined #tripleo15:23
*** ChanServ sets mode: +o openstack15:23
*** afazekas is now known as afazekas|pto15:29
owalshchem, kforde asking me about bad things happening when CloudDomain is changed. That's the issue with nova/neutron host changing IIUC15:30
owalshchem: get anywhere with this? I've not been keeping track15:31
chemowalsh: working on the nova/neutron/ceilometer immutable on upgrade right now15:32
*** d0ugal_ has quit IRC15:32
*** d0ugal__ has joined #tripleo15:32
chemowalsh: it's going that way https://review.openstack.org/579183 + https://review.openstack.org/55573215:32
chemowalsh: (555732 needs to be adjusted)15:32
owalshchem: ack. Know of any other side-effects? Seem to recall that the HA services don't like this either15:33
chemowalsh: and we don't need https://review.openstack.org/562876 anymore15:33
*** sai_p has joined #tripleo15:33
owalshchem: that's a lot of -1s :-)15:34
owalshbut it was a bit evil :-)15:34
sai_pHi can someone please review and give workflow for these cherrypicks15:34
sai_phttps://review.openstack.org/#/c/577339/15:34
sai_phttps://review.openstack.org/#/c/577340/15:34
chemowalsh: I don't know other side effects than lost of fip and vm migration impossible(this one you told me, never tested myself)15:35
chemowalsh: well this copy config inside docker was evil for sure :)15:36
chemowalsh: but it's kind of hard as well to tell puppet to not change a value, but a bit less evil15:36
*** slaweq has quit IRC15:36
*** slaweq has joined #tripleo15:37
owalshchem: ok... thanks. I'll take a closer look on Monday...15:38
chemowalsh: yeah, and then we won't have to care about host name change, I hope.15:39
*** pblaho has quit IRC15:39
*** mschuppert has quit IRC15:39
*** ykarel is now known as ykarel|afk15:40
*** tesseract has quit IRC15:42
*** d0ugal__ has quit IRC15:42
*** janki has joined #tripleo15:44
*** ccamacho has quit IRC15:44
*** erlon_ has quit IRC15:45
*** zoli is now known as zoli|gone15:46
*** zoli|gone is now known as zoli15:46
openstackgerritMichele Baldessari proposed openstack/puppet-pacemaker master: Initial support for adding cluster nodes to an existing cluster  https://review.openstack.org/56753715:46
*** edmondsw has quit IRC15:48
*** edmondsw has joined #tripleo15:52
*** rwsu has joined #tripleo15:55
*** sshnaidm|off has joined #tripleo15:55
*** thrash has quit IRC15:57
openstackgerritRedHat RDO CI proposed openstack/tripleo-heat-templates stable/queens: GATE CHECK for TripleO  https://review.openstack.org/56722416:00
*** cylopez has quit IRC16:01
*** dxiri has joined #tripleo16:01
*** moguimar_ has joined #tripleo16:04
fultonji am still running into https://bugs.launchpad.net/tripleo/+bug/1777896 though I have the fixing patch16:04
openstackLaunchpad bug 1777896 in tripleo " "AnsibleUndefinedVariable: 'container_build_id' is undefined"}"" [High,Fix released] - Assigned to wes hayutin (weshayutin)16:04
*** moguimar_ has quit IRC16:04
fultonji think i can address it by setting a container_build_id but does anyone know of a working ID or tag?16:05
fultonjweshay: ^ ?16:05
*** beekneemech has quit IRC16:09
*** akrzos has quit IRC16:09
*** weshay has quit IRC16:09
*** dbecker has quit IRC16:09
*** mfedosin has quit IRC16:09
*** honza has quit IRC16:09
*** wilken[m] has quit IRC16:09
*** gchamoul has quit IRC16:09
*** zoli has quit IRC16:09
*** mugsie has quit IRC16:09
*** kambiz has quit IRC16:09
*** dtantsur has quit IRC16:09
*** moguimar has quit IRC16:09
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970716:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897416:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910816:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927116:10
*** ooolpbot has quit IRC16:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)16:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)16:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)16:10
*** dtantsur has joined #tripleo16:14
*** beekneemech has joined #tripleo16:14
*** akrzos has joined #tripleo16:14
*** weshay has joined #tripleo16:14
*** dbecker has joined #tripleo16:14
*** mfedosin has joined #tripleo16:14
*** honza has joined #tripleo16:14
*** wilken[m] has joined #tripleo16:14
*** gchamoul has joined #tripleo16:14
*** zoli has joined #tripleo16:14
*** mugsie has joined #tripleo16:14
*** kambiz has joined #tripleo16:14
*** dtantsur has quit IRC16:14
*** dtantsur has joined #tripleo16:14
*** bcafarel has quit IRC16:14
*** kambiz has quit IRC16:14
*** kambiz has joined #tripleo16:15
*** udesale has quit IRC16:15
*** csmart has quit IRC16:17
*** wilken[m] has quit IRC16:17
*** jtomasek has quit IRC16:18
*** nenad has quit IRC16:19
*** dtantsur has quit IRC16:19
*** dtantsur has joined #tripleo16:23
*** dparkes has joined #tripleo16:25
*** dtantsur is now known as dtantsur|afk16:25
mwhahahaugh paunch is capped in rdo16:25
*** derekh has quit IRC16:27
*** invsblduck has quit IRC16:27
ykarel|afkhmm looks like gate going to reset again16:29
mwhahahathe job is successful?16:29
*** jpich has quit IRC16:30
*** jpich has joined #tripleo16:30
mwhahahaoh the 3rd job failed16:30
ykarel|afkhttps://review.openstack.org/#/c/576867/ failed16:30
mwhahahathe first two should merge16:30
ykarel|afkyes16:30
*** ramishra has quit IRC16:30
*** jpich has quit IRC16:30
*** dparkes has quit IRC16:30
ykarel|afkwe need the 8th one for master promotion16:31
*** trown is now known as trown|lunch16:31
*** ykarel|afk is now known as ykarel|away16:31
*** khyr0n has quit IRC16:32
openstackgerritTim Rozet proposed openstack/puppet-tripleo master: Updates OpenDaylight HA Proxy backend check  https://review.openstack.org/57901116:36
*** ykarel|away has quit IRC16:37
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: Add paunch to the includpkgs  https://review.openstack.org/57921816:37
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: [DNM] Add local network-environment file for fs001  https://review.openstack.org/57723016:37
openstackgerritTim Rozet proposed openstack/tripleo-heat-templates stable/queens: Add OPNFV scenario environment  https://review.openstack.org/57900216:39
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: Add paunch to the includpkgs  https://review.openstack.org/57921816:39
*** pcaruana has quit IRC16:40
*** dparkes has joined #tripleo16:40
openstackgerritMerged openstack/puppet-tripleo stable/queens: Update DellEMC Manila VNX driver  https://review.openstack.org/57882316:42
openstackgerritMerged openstack/puppet-tripleo stable/queens: Update DellEMC Manila Unity driver  https://review.openstack.org/57882416:42
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo master: Make host param for nova/neutron/ceilometer immutable during upgrade  https://review.openstack.org/55573216:42
*** rlandy is now known as rlandy|brb16:43
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart master: Add pauch to the includepkgs  https://review.openstack.org/57922116:43
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo master: Make host param for nova/neutron/ceilometer immutable during upgrade  https://review.openstack.org/55573216:44
openstackgerritAlex Schultz proposed openstack/tripleo-quickstart-extras master: Add pauch to the includepkgs  https://review.openstack.org/57922316:44
*** dparkes has quit IRC16:50
*** jpena is now known as jpena|off17:00
openstackgerritFlorian Fuchs proposed openstack/tripleo-validations master: [WIP]Add a OpenShift on OpenStack HW validation  https://review.openstack.org/57574917:01
*** wilken[m] has joined #tripleo17:02
*** florianf has quit IRC17:11
*** khyr0n has joined #tripleo17:11
*** openstack has quit IRC17:11
*** openstack has joined #tripleo17:12
*** ChanServ sets mode: +o openstack17:12
*** rlandy|brb is now known as rlandy17:16
*** jfrancoa has quit IRC17:19
*** csmart has joined #tripleo17:21
*** gfidente|pto has quit IRC17:26
openstackgerritAlan Bishop proposed openstack/puppet-tripleo master: Run cinder's db sync only on bootstrap node  https://review.openstack.org/57923417:28
*** atarlov has joined #tripleo17:28
*** trown|lunch is now known as trown17:41
*** slaweq has quit IRC17:47
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Clean up env files for Cinder's Netapp backend  https://review.openstack.org/57923717:59
*** raildo has quit IRC18:06
*** raildo has joined #tripleo18:07
*** slaweq has joined #tripleo18:10
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970718:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897418:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910818:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927118:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)18:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)18:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)18:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)18:10
mwhahahabeagles_mtg: so i tested it, setting the stop time doesn't actually help in the reboot case. We'll probably need my service18:11
*** kbyrne has quit IRC18:14
*** pchavva has quit IRC18:19
*** invsblduck has joined #tripleo18:19
*** rwsu has quit IRC18:38
*** rpioso is now known as rpioso|reboot18:40
*** beagles_mtg is now known as beagles18:41
beaglesmwhahaha, ack18:41
mwhahahabeagles: now i'm trying to find the best place to wedge it in :/18:41
*** ykarel|away has joined #tripleo18:42
*** atarlov has quit IRC18:42
*** atarlov has joined #tripleo18:42
*** atarlov has quit IRC18:47
beaglesmwhahaha, meaning what mechanism to get into onto the nodes?18:47
mwhahahabeagles: yea18:47
mwhahahabeagles: i think tripleo-common gets installed on the overcloud nodes so that might be the spot18:48
* beagles nods18:49
larsksIs there a way to disable the coverage report when running rspec? The list of "untounched resources" scrolls the result straight off the screen.18:49
*** jaganathan has quit IRC18:50
mwhahahalarsks: | less18:50
larsksmwhahaha: yeah, doing that already.18:50
*** jaganathan has joined #tripleo18:50
larsksI was just wondering if there was some sort of --no-coverage flag.18:50
mwhahahalarsks: no it's include in the conf18:50
larsksOkay. Bummer.18:50
*** zaneb has quit IRC18:51
*** dprince has quit IRC18:56
mwhahahalarsks: if you're working on a single test you can do "bundle exec rspec spec/classes/file.rb"18:57
larsksThanks, I had spotted that one.  I'm running the full suite right now because some of the provider changes I made are making a bunch of additional tests fail.  In unclear and confusing ways, but I'm slowly getting there...18:58
*** rpioso|reboot is now known as rpioso18:58
*** khyr0n has quit IRC19:06
*** khyr0n has joined #tripleo19:06
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multinode reproducer tasks  https://review.openstack.org/57916119:07
*** peereb has quit IRC19:07
*** dpeacock has quit IRC19:09
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970719:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897419:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910819:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927119:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)19:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)19:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)19:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)19:10
mwhahahabeagles: nope, we don't have any tripleo util type packages that we install on the overcloud19:12
beagleshrm19:12
openstackgerritSam Doran proposed openstack/tripleo-common master: Make config-download directory a git repository  https://review.openstack.org/57903019:12
mwhahahabeagles: we could include it as part of paunch19:12
mwhahahabeagles: as it's related to our launching of services over there19:13
mwhahahaand that's on the overcloud19:13
* mwhahaha patches paunch19:13
*** dpeacock has joined #tripleo19:13
*** atarlov has joined #tripleo19:13
beaglesmwhahaha, related question we still run some puppet on the overcloud node don't we? like puppet-tripleo for firewall rules? or does that get there some other way?19:15
mwhahahabeagles: yea it still runs19:15
beaglesmwhahaha, k19:15
mwhahahabeagles: things like the kernel stuff is still via puppet, so we have normal puppet config steps still19:16
* beagles would've ended up doing some kind of file thing in puppet - wouldn't thought of patching paunch19:16
beaglesah right of course19:17
mwhahahait goes with paunch conceptually because it's the thing launching the containers19:17
beaglesyep19:17
mwhahahai didn't want to manage systemd service unit files via puppet unless i have to :D19:17
beagleslol - not ansible? :)19:18
mwhahahaand i definately didn't want to do it via ansible :D19:19
beaglesLOL I figured :D19:19
*** yolanda_ has joined #tripleo19:19
*** d0ugal__ has joined #tripleo19:19
mwhahahabecause you know file copying couldn't be made harder except if trying to do it via ansible19:19
* mwhahaha shakes fist at ansible modules19:19
*** toure is now known as toure|gone19:22
*** yolanda__ has joined #tripleo19:22
*** yolanda has quit IRC19:23
*** yolanda_ has quit IRC19:24
*** atarlov has quit IRC19:26
*** atarlov has joined #tripleo19:26
*** d0ugal__ has quit IRC19:28
openstackgerritAndy Smith proposed openstack/tripleo-docs master: Document updates to messaging configuration  https://review.openstack.org/57925819:30
*** atarlov has quit IRC19:30
*** fzdarsky has quit IRC19:30
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Run tempest on standalone  https://review.openstack.org/57840319:31
*** khyr0n has quit IRC19:34
*** khyr0n has joined #tripleo19:35
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multinode reproducer tasks  https://review.openstack.org/57916119:36
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multinode reproducer tasks  https://review.openstack.org/57916119:38
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Always run mysql init bundle  https://review.openstack.org/57822919:39
openstackgerritMerged openstack/tripleo-heat-templates master: use versioned keystone endpoint in OPENSTACK_KEYSTONE_URL  https://review.openstack.org/57624619:39
weshaywoooho19:40
fultonjweshay: i have a question about https://bugs.launchpad.net/tripleo/+bug/177789619:41
openstackLaunchpad bug 1777896 in tripleo " "AnsibleUndefinedVariable: 'container_build_id' is undefined"}"" [High,Fix released] - Assigned to wes hayutin (weshayutin)19:41
fultonji am using the released fix, but still hitting the issue19:41
weshayfultonj, hrm.. is the fix in your local working dir for quickstart?19:42
fultonjyes19:42
weshayfultonj, can you tmate me in?19:42
fultonji rm -rf'd .quickstart19:42
weshayk19:42
* fultonj never hosted a tmate but could try it19:42
fultonji'd like to understand a few things about this param if you don't mind19:43
*** fzdarsky has joined #tripleo19:43
weshaysure19:43
fultonjweshay: when you use oooq do you set container_build_id ?19:43
fultonjif so, what do you set it to?19:43
weshayso fultonj the build_id refers to the dlrn_hash which is obviously what set of rpms we're using but also the tag on the container19:44
weshayfultonj, in absence of a dlrn_hash build id... it should default to current_tripleo or current_tripleo_rdo19:44
weshaywhich I had a test patch up to default to.. to ENSURE no one would hit this again. However folks were reporting success and it just worked for me as well19:45
weshayso I don't think I pushed on it19:45
weshayfultonj, https://hub.docker.com/r/tripleomaster/centos-binary-keystone/tags/19:45
weshayyou can see the tags here19:45
weshayatm19:45
weshaycurrent-tripleo is 9f3a41c2c752bd68a84b6bd72add18e8bc6f4c76_f1a4ee5a19:46
weshayfultonj, https://trunk.rdoproject.org/centos7-master/current-tripleo/delorean.repo19:46
weshayfultonj, can you pass me what you executed to recreate the issue19:47
weshay./quickstart.sh etc...19:47
fultonjweshay: https://github.com/fultonj/oooq/blob/master/under/config.yaml19:47
fultonjwhich i passed to the quickstart script like this19:47
fultonjhttps://github.com/fultonj/oooq/blob/master/under/deploy.sh#L36-L4119:47
fultonjweshay: since it wasn't getting defined, i wanted to see if i could just override it in the config.yaml19:48
fultonjcontainer_build_id: current_tripleo19:48
fultonj^ for example19:49
fultonjto poke at it to see what might be happening19:49
weshayfultonj, FYI.. not this bug obviously does not hit any upstream workflow.. just when you invoke quickstart.sh19:50
weshayfultonj, so for a ceph job... as run by upstream19:50
*** zaneb has joined #tripleo19:50
weshaycan use the reproducer too.19:50
weshayfultonj, I will run through your script though19:50
weshayand recreate19:50
fultonjweshay: yeah, i'm just trying to make an env to develop in19:51
fultonjmay not be this bug, but seems to be the same error19:51
weshayhttp://logs.openstack.org/82/579182/1/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/a389de3/logs/reproducer-quickstart.sh19:51
weshayand update zuul_changes19:51
weshaybut let me look at your workflow.. need a few19:52
fultonjthanks19:53
fultonjis "container_build_id: current_tripleo" a valid input?19:53
fultonjwould usr/local/share/ansible/roles/overcloud-prep-containers/templates/overcloud-prep-containers.sh.j2 be happy with it?19:54
*** zul_ has quit IRC19:59
*** atarlov has joined #tripleo20:00
*** edmondsw has quit IRC20:02
*** atarlov has quit IRC20:04
*** atarlov has joined #tripleo20:04
*** edmondsw has joined #tripleo20:09
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970720:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177897420:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910820:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927120:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)20:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1778974 in tripleo "reproduce-quickstart.sh broken by 576834, no such file" [Critical,In progress] - Assigned to John Trowbridge (trown)20:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)20:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)20:10
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Default environment/services/* to docker  https://review.openstack.org/56780020:11
openstackgerritMerged openstack/tripleo-quickstart-extras master: Remove "-oooq" from toci script name  https://review.openstack.org/57853320:11
openstackgerritMerged openstack/tripleo-quickstart-extras master: Use openstack CLI for ironic  https://review.openstack.org/57829220:11
openstackgerritMerged openstack/tripleo-common master: Verify the Swift container exists with a small utility workflow  https://review.openstack.org/52821320:11
*** edmondsw has quit IRC20:14
*** rwsu has joined #tripleo20:16
mwhahahaweshay: the ironic change landed, so maybe promotion at some point?20:18
weshaynah20:18
mwhahahanow with more failures? :D20:18
*** ykarel|away has quit IRC20:19
*** abishop has quit IRC20:20
*** paramite has quit IRC20:21
*** raildo has quit IRC20:26
*** edmondsw has joined #tripleo20:31
weshaymwhahaha, sounds like a new cereal... NOW WITH MORE FAILURES!20:32
mwhahahapretty much20:32
mwhahahaTripleOs, now with even MORE failures!20:32
weshaymwhahaha, nothing new yet.. just sayin20:32
weshaylolz20:32
*** mwhahaha changes topic to "Welcome to Rocky. CI status: PLAID - TripleOs, now with even MORE failures! random time outs, debug in process | https://docs.openstack.org/tripleo-docs/latest"20:33
*** atarlov has quit IRC20:36
weshayfultonj, we should probably update https://github.com/openstack/tripleo-quickstart/commits/master/config/general_config/featureset049.yml20:36
weshayfultonj, and get that running upstream20:36
*** atarlov has joined #tripleo20:36
weshayfultonj, is it just the additional environment files for ceph-ansible?20:37
weshayfultonj, oh.. and set_root_device20:38
weshayetc20:38
fultonjweshay: it uses ceph-ansible but so do other scenarios20:39
weshayfultonj, https://github.com/openstack/tripleo-heat-templates/blob/master/README.rst#service-testing-matrix20:39
weshaywhich one?20:39
fultonjscenario001 and scenario004 use ceph-ansible20:40
weshayfultonj, ok.. we're not specifying those env files in scenario01/0420:40
fultonjrbd --> ceph20:40
*** akrivoka has quit IRC20:40
*** atarlov has quit IRC20:40
weshayfultonj, why not just use the libvirt repro for scen001 / 00420:41
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: [WIP]: Add zuul v3 vxlan setup for multinode reproducer tasks  https://review.openstack.org/57916120:41
weshayfultonj, still looking into the issue, but saying.. using a ci'd know good setup will lead to less pain20:42
fultonjweshay: so my original question, where i'm trying to get oooq developed with my own config.yaml, i think you're asking why i bother with that file20:43
fultonji guess i could switch20:43
fultonji never got the libvrit repro working, it was on my list20:43
weshayfultonj, well.. what you are doing is fine, it's harder as things are always changing and if you have something custom you'll have to keep that custom config updated all the time20:43
fultonjyeah20:44
weshayfultonj, if we're missing something upstream w/ ceph.. let's start upstream and work towards getting that going there20:44
fultonjweshay: we're not missing anything upstream with ceph20:44
weshayk20:45
weshayfultonj, we haven't been able to properly ci quickstart.sh invocations since mid pike20:45
* weshay wants to kill it20:45
fultonjwow20:45
weshayya.. ci.centos is TOO SLOW20:46
weshayso we just run the undercloud install and have to stop there20:46
* fultonj looks in backlog in case you gave me the command to do the 001 scenario...20:47
fultonjhttp://logs.openstack.org/82/579182/1/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/a389de3/logs/reproducer-quickstart.sh20:48
weshayfultonj, aye.. run that directly on your dev box http://logs.openstack.org/82/579182/1/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/a389de3/logs/README-reproducer-quickstart.html20:49
weshayw/ -l20:49
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: DNM: Add doc for the libvirt reproducer  https://review.openstack.org/56615520:50
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Add doc for the libvirt reproducer  https://review.openstack.org/56615520:52
*** slaweq has quit IRC20:52
*** slaweq has joined #tripleo20:54
fultonjweshay: how did you get that script?20:55
fultonji'm clicking around in other jobs20:55
fultonjhttp://logs.openstack.org/56/577956/6/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/c864264/logs/20:55
fultonje.g. ^20:55
weshayfultonj, wget?20:55
weshaywget http://logs.openstack.org/82/579182/1/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/a389de3/logs/reproducer-quickstart.sh20:56
fultonjlol20:56
weshay:)20:56
fultonjno, not that20:56
fultonji don't want scenario004 for one thing20:56
fultonjso i go to a run of scenario001 from another review20:56
weshayfultonj, wget http://logs.openstack.org/56/577956/6/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/c864264/logs/reproducer-quickstart.sh20:56
fultonjyep20:57
weshayfultonj, note.. the first few bits of this are ALSO not ci'd20:57
* weshay goes back to host his bake sale20:57
weshaypretty small chunk of code that is not ci'd though20:58
fultonjok, so I ran that with -l20:58
openstackgerritJiri Stransky proposed openstack/tripleo-docs master: Developer docs for updates  https://review.openstack.org/57806920:58
weshayfultonj, aye20:58
fultonji just ....20:59
fultonjthere's things i don't like about that job for my work20:59
fultonje.g. i want more servers20:59
weshayhttps://review.openstack.org/#/c/566155/20:59
fultonji just want to get an undercloud and then deploy with my own stuff20:59
weshayfultonj, ok.. I'll get the other path unblocked too20:59
fultonji guess i'm just not use to working this way20:59
fultonji was just trying to use oooq the old way i guess21:00
openstackgerritJanki Chhatbar proposed openstack/tripleo-heat-templates master: Edit some post update tasks logic  https://review.openstack.org/57918221:00
fultonji imagine i could take the reproducer script and build on it e.g. increase the hosts and not deploy the overcloud in full21:00
fultonjweshay++ thanks for the reproducer help21:01
fultonji have been meaning to get that going21:01
*** slaweq has quit IRC21:01
weshaynp.. sorry for the stupid bugs.. just limited on what we can do about it21:03
weshayatm21:03
fultonjnp21:03
*** cdearborn has joined #tripleo21:04
fultonji was at a tripleo workshop in brno a few weeks ago and we had people use a similar script'21:05
*** trown is now known as trown|outtypewww21:05
fultonjhttps://github.com/redhat-openstack/tripleo-workshop/blob/master/oooq/oooq-lab.txt21:05
fultonjweshay: ^21:05
fultonjnot that i'm saying it has to be supported..21:05
fultonji'm just thinking it would have been better if we had showed the reproducer magic you showed me21:06
weshay:(21:07
weshaymasta21:07
weshayfultonj, well.. I tried to go but couldnt21:07
weshaysshnaidm|off, ^21:07
* fultonj not blaming21:07
fultonjsshnaidm|off: did point out the reproducer too21:07
fultonji was just thinking of having people do it as an exercise21:07
weshayalso in the contributor guide :) http://tripleo.org/21:08
*** agopi_ is now known as agopi21:08
fultonjls: cannot access /opt/stack/tripleo-ci/toci_gate_test-oooq.sh: No such file or directory21:09
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970721:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910821:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927121:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)21:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)21:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)21:10
* fultonj will look at doc more to figure out that issue21:11
fultonjhttp://tripleo.org/contributor/reproduce-ci.html#how-to-execute-the-reproducer-quickstart-script21:11
*** atarlov has joined #tripleo21:11
*** dougbtv_ has quit IRC21:13
*** janki has quit IRC21:17
*** liverpooler has quit IRC21:24
fultonjmy toci gate script is missing21:29
fultonjtoci_gate_test.sh vs toci_gate_test-oooq.sh21:30
fultonjslight doc bug21:31
*** zaneb has quit IRC21:35
stevebakerfultonj: I think oooq.sh is gone, but the other one works for me21:37
fultonjstevebaker: i'm running toci_gate_test.sh, and it seems to be working21:37
fultonji think i'll just file a bug so it can get fixed eventually21:37
*** trozet is now known as trozet|off21:38
*** agopi is now known as agopi|off21:39
weshayfultonj, ya.. the doc issue should be merged now21:40
fultonjweshay: is the review handy?21:40
weshayhttps://review.openstack.org/#/c/578533/21:40
weshaymaybe we also need it the upstream tripleo doc21:40
weshayfultonj, oh... and rlandys21:41
fultonjweshay: thanks!21:41
* fultonj stops opening that bug21:41
fultonjwould have been a dup anyway21:41
mwhahahaweshay: is there anything pressing in terms of failures or is it just timeouts21:41
weshaymwhahaha, just time outs.. afaik.. the periodic job have been running and running.. we need to fix some tempest bs there for fs2021:42
weshaybut it doesn't impact you21:42
mwhahahak21:42
mwhahahai'm giving up for the week21:42
* mwhahaha needs a nap21:42
weshayhttps://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/1031/21:42
weshayrunning for 4hr 22min21:43
weshaymwhahaha, good night sweet heart.. it's time to go21:43
weshaydoooo dooo dooo dooo..21:43
fultonjlol21:43
mwhahahaweshay: it's been propping images for how long? :o21:43
mwhahahaweshay: https://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/1031/console or is the console just lagged21:43
weshaymwhahaha, it's mining bitcoin for me21:43
mwhahahak, plz share21:43
*** agopi|off has quit IRC21:44
weshayshiat21:44
mwhahahaweshay: oh wait it's introspection :D21:44
weshayya21:44
weshaymwhahaha, go to sleep21:44
mwhahahahttps://review.openstack.org/#/c/579051/21:45
mwhahahathat one21:45
mwhahahasome day it'll merge21:45
* mwhahaha wanders off21:45
*** eggmaster has quit IRC21:45
*** owalsh has quit IRC21:45
fultonjso my "Write containers-prepare-parameter.yaml" task didn't fail with the reproducer21:46
fultonjthough i want to know why21:46
*** owalsh has joined #tripleo21:46
weshayfultonj, two different playbooks21:49
weshaysame roles..21:49
*** pradk has quit IRC21:51
weshayfultonj, /me needs to buy some hardware to keep up w/ you :)21:57
fultonjha21:58
fultonji did buy this hardware21:58
fultonjshould work though with 1 control + 1 compute + 1 ceph21:58
weshaygiven it a go21:59
fultonjhttps://pcpartpicker.com/user/fultonj/saved/v9KLD321:59
fultonj^ spent my own $ to run quickstart faster :)22:00
openstackgerritMerged openstack/tripleo-common master: Add recover_deployment workflow  https://review.openstack.org/56669922:02
* weshay needs to get my bm nodes going22:02
*** dtantsur|afk has quit IRC22:06
*** dtantsur has joined #tripleo22:07
fultonjweshay: thanks for your help. i have to stop for now (it's family time)22:08
fultonjsee you monday22:08
weshayaye.. have a good weekend22:08
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970722:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910822:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927122:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)22:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)22:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)22:10
*** atarlov has quit IRC22:11
openstackgerritMerged openstack/puppet-tripleo master: Discover the gid of the docker group for mistral  https://review.openstack.org/57558322:14
*** matbu has quit IRC22:17
*** agopi|off has joined #tripleo22:18
*** khyr0n has quit IRC22:23
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Switch scenario00{1,2,3,4,7} to containerized undercloud""  https://review.openstack.org/57533022:28
*** mcornea has quit IRC22:30
*** fzdarsky has quit IRC22:32
*** beekneemech has quit IRC22:34
*** thrash is now known as thrash|g0ne22:46
*** lblanchard has quit IRC22:52
*** pradk has joined #tripleo22:53
*** rwsu has quit IRC22:55
*** pradk has quit IRC22:59
*** atarlov has joined #tripleo23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/174970723:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177910823:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177927123:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1749707 in tripleo "ironic errors out during overcloud-deploy" [Critical,Triaged] - Assigned to Quique Llorente (quiquell)23:10
openstackLaunchpad bug 1779108 in tripleo "Wrong release files for periodic jobs" [Critical,In progress] - Assigned to Quique Llorente (quiquell)23:10
openstackLaunchpad bug 1779271 in tripleo "periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens Details: volume c414293d-eb0f-4d74-8b4d-f9a15e23d399 failed to reach in-use status (current available) within the required time (500 s)." [Critical,Triaged] - Assigned to Quique Llorente (quiquell)23:10
*** atarlov has quit IRC23:24
*** atarlov has joined #tripleo23:24
*** rpioso is now known as rpioso|afk23:29
*** rlandy has quit IRC23:41
*** dxiri has quit IRC23:53
*** atarlov has quit IRC23:55
*** atarlov has joined #tripleo23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!