Friday, 2017-02-03

*** sanagikoki has quit IRC00:09
*** ooolpbot has joined #tripleo00:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124200:11
*** ooolpbot has quit IRC00:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]00:11
*** dmacpher_ has quit IRC00:16
jaosoriorbnemec: still around?00:29
openstackgerritMerged openstack/diskimage-builder master: Unify tidy up logs in lib/img-functions  https://review.openstack.org/42031800:29
*** bkopilov_ has quit IRC00:33
openstackgerritMerged openstack/tripleo-heat-templates master: Switch item notation to jinja format  https://review.openstack.org/42829300:38
openstackgerritMerged openstack/puppet-tripleo master: Revert "set innodb_file_per_table to ON for MySQL / Galera"  https://review.openstack.org/42843500:38
*** rbrady-afk has quit IRC00:42
*** jaosorior has quit IRC00:46
openstackgerritIan Main proposed openstack/tripleo-heat-templates master: Containerized Swift Services.  https://review.openstack.org/42543400:58
openstackgerritMerged openstack/puppet-tripleo master: Fix style nits in contrail manifests  https://review.openstack.org/42789000:58
openstackgerritMerged openstack/puppet-tripleo master: Delete the unnecessary word in numvfs_persistence.pp  https://review.openstack.org/42391801:00
openstackgerritMerged openstack/puppet-tripleo stable/newton: Call VF configuration from udev rules  https://review.openstack.org/42331201:00
openstackgerritMerged openstack/puppet-tripleo master: add cache to object-expirer pipeline  https://review.openstack.org/42100601:01
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs  https://review.openstack.org/42847601:02
openstackgerritMerged openstack/puppet-tripleo master: Add initial profiles for rest of Octavia services  https://review.openstack.org/41142201:02
openstackgerritMerged openstack/puppet-tripleo master: Use transport_url for rabbitmq connection parameters in heat  https://review.openstack.org/41033301:03
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Enable Debug: True on OVB jobs  https://review.openstack.org/42847601:04
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs  https://review.openstack.org/35921501:05
*** ooolpbot has joined #tripleo01:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124201:11
*** ooolpbot has quit IRC01:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]01:11
*** skramaja_ has joined #tripleo01:16
*** skramaja has quit IRC01:19
*** ansmith has joined #tripleo01:20
dtrainorcan i get some reviews on https://review.openstack.org/#/c/424909/ and https://review.openstack.org/#/c/424903 please01:21
openstackgerrityunfeng zhou proposed openstack/instack master: Add 6 spaces before url.  https://review.openstack.org/41269601:21
openstackgerrityunfeng zhou proposed openstack/instack master: Add 6 spaces before url.  https://review.openstack.org/41269601:22
*** twiggy has quit IRC01:23
*** owalsh has joined #tripleo01:28
*** sdake has joined #tripleo01:28
*** owalsh-afk has quit IRC01:28
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata  https://review.openstack.org/42836201:28
*** dmacpher has joined #tripleo01:34
*** kberger has quit IRC01:44
*** tbonds has quit IRC01:44
*** rbrady-afk has joined #tripleo01:54
*** twiggy_ has joined #tripleo01:54
*** ansmith has quit IRC02:09
*** ooolpbot has joined #tripleo02:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124202:11
*** ooolpbot has quit IRC02:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]02:11
*** rajinir has quit IRC02:26
*** skramaja_ has quit IRC02:28
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker memcached service  https://review.openstack.org/42854602:35
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Enable docker services in the registry  https://review.openstack.org/42156702:36
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker heat services  https://review.openstack.org/41763902:42
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker ironic services  https://review.openstack.org/42151702:43
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker neutron services  https://review.openstack.org/42299902:44
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker mistral services  https://review.openstack.org/42574402:44
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker zaqar service  https://review.openstack.org/42597602:45
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker nova services  https://review.openstack.org/42092102:46
*** mburned_out is now known as mburned02:46
*** kbyrne has quit IRC02:47
*** brault has quit IRC02:49
*** kbyrne has joined #tripleo02:50
*** pmannidi has quit IRC02:57
*** pmannidi has joined #tripleo02:58
*** brault has joined #tripleo03:00
*** yamahata has quit IRC03:02
*** ramishra has joined #tripleo03:09
*** ooolpbot has joined #tripleo03:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124203:11
*** ooolpbot has quit IRC03:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]03:11
*** mrunge has quit IRC03:12
*** mrunge has joined #tripleo03:17
*** owalsh has quit IRC03:33
*** owalsh_ has joined #tripleo03:33
*** sdake has quit IRC03:41
*** owalsh_ is now known as owalsh-afk04:01
*** psahoo has joined #tripleo04:03
openstackgerritNuman Siddique proposed openstack/tripleo-heat-templates master: OVN bridge mappings for tripleo  https://review.openstack.org/40229304:07
*** sdake has joined #tripleo04:08
*** ooolpbot has joined #tripleo04:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124204:11
*** ooolpbot has quit IRC04:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]04:11
*** sdake_ has joined #tripleo04:11
*** tzumainn has quit IRC04:11
*** nmathew has joined #tripleo04:12
*** sdake has quit IRC04:12
*** udesale has joined #tripleo04:13
*** remix_tj has quit IRC04:14
*** jaganathan has joined #tripleo04:15
*** remix_tj has joined #tripleo04:17
*** gkadam has joined #tripleo04:26
*** yamahata has joined #tripleo04:43
*** sudipto has joined #tripleo04:58
*** sudipto_ has joined #tripleo04:59
*** psahoo_ has joined #tripleo05:09
*** ooolpbot has joined #tripleo05:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124205:11
*** ooolpbot has quit IRC05:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]05:11
*** pgadiya has joined #tripleo05:11
*** sudipto_ has quit IRC05:13
*** sudipto has quit IRC05:13
*** prateek has joined #tripleo05:25
*** skramaja has joined #tripleo05:30
*** anshul has quit IRC05:31
*** psahoo_ has quit IRC05:36
*** yamahata has quit IRC05:43
*** rlandy has quit IRC05:49
*** zoli|pto has quit IRC06:03
*** cschwede has quit IRC06:03
*** cschwede has joined #tripleo06:05
*** zoli has joined #tripleo06:08
*** ooolpbot has joined #tripleo06:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124206:11
*** ooolpbot has quit IRC06:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]06:11
*** saneax-_-|AFK is now known as saneax06:18
*** dmacpher has quit IRC06:32
openstackgerritJason E. Rist proposed openstack/tripleo-ui master: Add release notes for Ocata 3.0.0  https://review.openstack.org/42597906:37
*** jbadiapa has quit IRC06:43
*** sdake_ has quit IRC06:52
*** jbadiapa has joined #tripleo06:55
openstackgerritgecong proposed openstack/tripleo-incubator master: Delete H803 from ignore list  https://review.openstack.org/42860106:55
openstackgerritgecong proposed openstack/os-apply-config master: Delete H803 from ignore list  https://review.openstack.org/42860307:01
*** ebarrera has joined #tripleo07:05
openstackgerritgecong proposed openstack/os-cloud-config master: Delete H803 from ignore list  https://review.openstack.org/42860507:07
*** brault has quit IRC07:08
*** ooolpbot has joined #tripleo07:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124207:11
*** ooolpbot has quit IRC07:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]07:11
*** rasca has joined #tripleo07:14
*** brault has joined #tripleo07:15
*** ealcaniz has joined #tripleo07:18
*** tesseract has joined #tripleo07:20
*** twiggy has joined #tripleo07:21
*** twiggy_ has quit IRC07:21
*** tremble has joined #tripleo07:21
*** tremble has joined #tripleo07:21
*** twiggy_ has joined #tripleo07:22
*** twiggy has quit IRC07:22
*** iranzo has joined #tripleo07:23
*** dsariel has joined #tripleo07:23
openstackgerritgecong proposed openstack/os-refresh-config master: Delete H803 from ignore list  https://review.openstack.org/42860907:24
*** twiggy has joined #tripleo07:24
*** flepied has quit IRC07:24
*** rcernin has joined #tripleo07:26
*** twiggy_ has quit IRC07:27
*** florianf has joined #tripleo07:27
*** athomas has joined #tripleo07:28
*** aufi has joined #tripleo07:32
*** aufi has quit IRC07:32
*** aufi has joined #tripleo07:34
*** nyechiel has joined #tripleo07:41
openstackgerritgecong proposed openstack/os-collect-config master: Delete H803 from ignore list  https://review.openstack.org/42861807:43
openstackgerritgecong proposed openstack/tripleo-puppet-elements master: Delete H803 from ignore list  https://review.openstack.org/42861907:47
*** nyechiel has quit IRC07:47
*** yprokule has joined #tripleo07:49
openstackgerritgecong proposed openstack/tripleo-image-elements master: Delete H803 from ignore list  https://review.openstack.org/42862207:51
*** hjensas has quit IRC07:54
*** psahoo has quit IRC07:57
*** panda|zZ is now known as panda07:57
*** cylopez has joined #tripleo07:57
openstackgerritMartin André proposed openstack/tripleo-quickstart master: Fix initialization of novaclient  https://review.openstack.org/42810508:04
*** flepied has joined #tripleo08:05
*** ooolpbot has joined #tripleo08:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124208:11
*** ooolpbot has quit IRC08:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]08:11
*** flepied has quit IRC08:11
*** jlinkes has joined #tripleo08:14
*** twiggy has quit IRC08:21
*** twiggy has joined #tripleo08:22
*** amoralej|off is now known as amoralej08:26
*** hjensas has joined #tripleo08:29
*** hjensas has quit IRC08:29
*** hjensas has joined #tripleo08:29
*** jpich has joined #tripleo08:32
*** hjensas has quit IRC08:36
*** flepied has joined #tripleo08:36
*** jaganathan has quit IRC08:38
*** cylopez has quit IRC08:44
*** sudipto has joined #tripleo08:48
*** sudipto_ has joined #tripleo08:48
*** paramite has joined #tripleo08:51
*** cylopez has joined #tripleo08:53
*** fzdarsky has joined #tripleo08:53
*** shardy has joined #tripleo08:54
*** jaganathan has joined #tripleo08:55
*** zzzeek has quit IRC09:00
*** zzzeek has joined #tripleo09:00
*** pgadiya has quit IRC09:02
*** hjensas has joined #tripleo09:03
*** hjensas has quit IRC09:03
*** hjensas has joined #tripleo09:03
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled  https://review.openstack.org/41988609:06
*** ooolpbot has joined #tripleo09:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124209:11
*** ooolpbot has quit IRC09:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]09:11
*** suuuper has joined #tripleo09:11
*** derekh has joined #tripleo09:13
*** anshul has joined #tripleo09:15
*** pgadiya has joined #tripleo09:17
shardymarios: Hey, 'morning!09:17
shardymarios: ^^ looks good, I can give it a try if you're busy again today09:18
shardymarios: I had an idea to run the ansible tasks via a similar script, so I may write a follow-up patch based on yours that does that for discussion09:18
shardythen we can over time migrate the shell script logic into the service template tasks09:19
openstackgerritMerged openstack/tripleo-heat-templates master: Moving the validation for using the template alias version for all templates  https://review.openstack.org/42806209:20
*** yprokule has quit IRC09:22
*** flepied has quit IRC09:23
*** dtantsur|afk is now known as dtantsur09:23
jpichhttps://review.openstack.org/#/c/428146/ looks like it will fix the tripleoclient gate failures, if someone familiar with tripleo-image-elements would like to take a peek and comment09:23
mariosshardy: unfortunately am on this call again and probably going to be for all of today :(09:26
mariosshardy: not sure how much time i'll get to work on that today09:26
*** karimb has joined #tripleo09:27
shardymarios: Ok no worries, I'll test it and push the follow-up ansible patch I mentioned09:28
*** udesale__ has joined #tripleo09:28
shardymarios: I'm not in next week but you can pick up the ansible patch if you feel it's useful09:28
*** udesale has quit IRC09:30
openstackgerritLuke Hinds proposed openstack/tripleo-heat-templates master: Added further security functionality in release notes.  https://review.openstack.org/42866609:31
lhindsshardy / marios: I guess that won't need an FFE ^ ?09:32
lhindsits not code, just some additional release note info.09:32
shardylhinds: no anything release notes related is fine09:32
lhindsthanks shardy09:32
*** athomas has quit IRC09:34
matbushardy: marios i'm also the 3 reviews pacemaker nova and yours (marions)09:36
matbumarios: shardy do you think it would be possible to try to merge the nova review today (or maybe pacemaker but probably needs an update in the CI)09:37
matbu(s/marions/marios/ sorry :))09:37
*** lucas-afk is now known as lucasagomes09:38
*** chlong has quit IRC09:38
mariosshardy: thanks matbu will try and help with reviews later still on this call for now09:39
shardymatbu: well I'd be happy to see the nova patch land, it needs rebasing09:39
shardymatbu: ah, I see you just did it :)09:39
shardymatbu: oh, the recheck won't work - it needs rebasing, I'll do it now09:40
mariosmatbu: but yes the pacemaker one needed some update then we should land them09:40
matbushardy: ack, yes i just recheck the CI :)09:40
shardymatbu: it won't work, it'd based on a broken version of https://review.openstack.org/#/c/424905/ I think?09:40
matbumarios: k i'll make a review in tripleo-ci09:40
* shardy rebases09:40
matbumarios: hm your review looks broken09:41
*** salmankhan has joined #tripleo09:42
matbumaybe we should add a jinja lint or something that gate that09:42
b00tcathi, let's assume that I needed a step 6 in my tripleo deployment, would that be possible without altering the tripleo codebase?09:42
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524109:42
mariosmatbu: damn yeah i was meant to test it yesterday ....09:42
mariosmatbu: thanks for looking anyway will try and get to it later09:43
shardySo we now have two patches rebased on https://review.openstack.org/#/c/424905/ (the nova one and marios's patch to deliver upgrade scripts)09:43
mariosmatbu: but which one you mean? the ini scripts one right https://review.openstack.org/#/c/419886/09:43
shardyit's passing CI so can I get reviews on that, then we won't block those two patches?09:43
matbumarios: hm not sure09:44
matbushardy: yep, i add a timeout for nova db sync yesterday09:44
shardyb00tcat: currently no, but we could consider making it configurable via a jinja variable09:44
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/post.j2.yaml#L5909:44
matbulike Michael was mentionned it09:44
*** udesale__ has quit IRC09:46
*** udesale has joined #tripleo09:46
*** udesale has quit IRC09:46
b00tcatshardy: ok thanks!09:47
shardyb00tcat: actually, there is a way, but it would involve overriding the rendered puppet/post.yaml with a file containing the extra steps09:47
shardywhich I was assuming you wouldn't want to do09:47
shardyprobably adding some j2 variables to control both deploy and upgrade steps would be a good idea09:48
b00tcatshardy: your assumption is right, I'll try to workaround it for now :D09:48
shardywe just don't have anywhere to input them right now09:48
*** udesale has joined #tripleo09:52
*** hjensas has quit IRC09:57
*** gfidente has joined #tripleo09:58
*** gfidente has quit IRC09:58
*** gfidente has joined #tripleo09:58
*** akrivoka has joined #tripleo09:59
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Fix descriptions on bonding templates  https://review.openstack.org/42867210:00
*** bogdando has joined #tripleo10:01
karimbhello folks, what can cause overcloud deployment to hang when scheduling nodes deployment?10:01
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Fix descriptions on bonding templates  https://review.openstack.org/42867210:01
karimbmy nodes were properly introspected and assigned profiles. i launch stack and dont get no valid hosts, but my nodes still dont start booting.....10:02
gfidentekarimb possibly ironic failing to powerup/boot the nodes?10:02
karimbgfidente introspection worked well so this part does work10:02
gfidenteprobably the flavor doesn't match the node's specs then?10:03
karimbgfidente it rather feels like the message to boot those nodes dont reach ( i guess nova-compute)10:03
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Add monitoring and logging agents deployment to CI  https://review.openstack.org/41021010:03
karimbgfidente if it was the flavor, i would get a no valid hosts found10:03
karimband the nodes wouldnt appear as scheduling i d say10:03
gfidenteoh you mean they are in scheduling state in nova?10:04
gfidentethen maybe you have something in the nova conductor logs?10:05
*** ooolpbot has joined #tripleo10:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124210:11
*** ooolpbot has quit IRC10:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]10:11
*** jaganathan has quit IRC10:17
*** twiggy_ has joined #tripleo10:21
*** twiggy__ has joined #tripleo10:24
*** twiggy_ has quit IRC10:24
*** twiggy has quit IRC10:24
*** yprokule has joined #tripleo10:24
*** twiggy has joined #tripleo10:24
*** mcornea has joined #tripleo10:25
*** twiggy__ has quit IRC10:28
*** bogdando has quit IRC10:28
*** udesale__ has joined #tripleo10:30
*** jaganathan has joined #tripleo10:32
*** flepied has joined #tripleo10:33
*** udesale__ has quit IRC10:33
*** udesale has quit IRC10:33
*** owalsh-afk is now known as owalsh10:35
openstackgerritMartin André proposed openstack/tripleo-quickstart master: Fix initialization of novaclient  https://review.openstack.org/42810510:39
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Explicitly configure credentials used by ironic to access other services  https://review.openstack.org/42868010:41
openstackgerritSaravanan KR proposed openstack/puppet-tripleo master: Add support to changing the Rabbitmq password on update  https://review.openstack.org/40206110:46
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Fix and improve 'flake8' test.  https://review.openstack.org/42868910:50
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: [WIP] Explicitly configure credentials used by ironic to access other services  https://review.openstack.org/42868010:51
dtantsurfolks, could you check https://review.openstack.org/428052 please? ironic overcloud support can get broken at any moment, if we don't merge it (or something)10:54
*** dtantsur is now known as dtantsur|bbl10:55
*** jaganathan has quit IRC10:59
shardydtantsur|bbl: Thanks for the fix, but I think it needs to move to ServiceNetMap like all the other service->network mappings?11:02
shardyI can push the adjustment if you agree11:03
*** salmankhan has quit IRC11:03
dtantsur|bblshardy, do you realize that this is an **overcloud** network?11:04
*** salmankhan has joined #tripleo11:05
dtantsur|bblI thought we only put undercloud networks to ServiceNetMap...11:05
dtantsur|bbland do not touch overcloud objects at all (otherwise the code would be quite different)11:05
shardydtantsur|bbl: well did you realize that network names like "external" will get replaced with the bind IP of that network on overcloud nodes?11:05
shardydtantsur|bbl: the ServiceNetMap defines the networks for overcloud services11:06
dtantsur|bbllike, for all fields? Oo11:06
shardydtantsur|bbl: yeah for every key in config_settings11:06
dtantsur|bblso if I happen to have a value called "external" somewhere, it will get replaced?11:06
shardyso you'll get the bind IP for the external nic11:06
shardydtantsur|bbl: right now, yes, because we had a chicken/egg problem with the service templates11:07
shardymany services need a bind_ip, but you don't know it when the service templates are instantiated11:07
dtantsur|bblugh, this is super ugly11:07
shardyso we use the network names e.g "internal_api" as a placeholder (read from the ServiceNetMap)11:07
dtantsur|bbldo we have a way to force this behavior to not happen? like some dummy string operation?11:08
shardydtantsur|bbl: it does exact matching so " external" would probably defeat the replacement11:08
shardyI agree it's ugly but it's the only solution we could find at the time11:08
*** yolanda has quit IRC11:08
dtantsur|bblok, thanks for catching this.. I'll fix when I come back.11:09
*** salmankhan has quit IRC11:09
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/controller-role.yaml#L47711:10
* dtantsur|bbl wishes we actually created a default network in the overcloud neutron, then he could just use it11:10
*** yolanda has joined #tripleo11:10
shardydtantsur|bbl: thanks ^^ is where that happens, perhaps we could implement a blacklist/whitelist or something11:10
shardyI'll think about how that might work11:10
dtantsur|bblthanks!11:10
* dtantsur|bbl disappears again11:11
*** ooolpbot has joined #tripleo11:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124211:11
*** ooolpbot has quit IRC11:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]11:11
*** jaganathan has joined #tripleo11:11
gfidentedtantsur|bbl sorry but when you say an overcloud network, you mean a network provisioned on the nodes where ironic is running, or a network provisioned in the overcloud neutron?11:15
*** anshul has quit IRC11:15
*** sdake has joined #tripleo11:18
*** panda is now known as panda|brb11:19
*** athomas has joined #tripleo11:21
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Fix and improve 'flake8' test.  https://review.openstack.org/42868911:21
*** thrash|g0ne is now known as thrash11:22
*** ansmith has joined #tripleo11:23
*** jaganathan has quit IRC11:23
*** twiggy_ has joined #tripleo11:24
*** twiggy has quit IRC11:24
*** flepied has quit IRC11:25
*** jprovazn has joined #tripleo11:25
*** twiggy has joined #tripleo11:25
*** twiggy__ has joined #tripleo11:27
*** anshul has joined #tripleo11:28
*** twiggy_ has quit IRC11:28
*** twiggy has quit IRC11:30
openstackgerritRaoul Scarazzini proposed openstack/tripleo-quickstart-extras master: WIP Remove tags and use vars everywhere  https://review.openstack.org/42724311:30
*** cdearborn has joined #tripleo11:33
*** jaganathan has joined #tripleo11:36
*** salmankhan has joined #tripleo11:37
*** jkilpatr has quit IRC11:38
*** panda|brb is now known as panda11:40
*** sdake_ has joined #tripleo11:42
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs  https://review.openstack.org/42834911:44
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Disable batch upgrade deployments for disabled roles  https://review.openstack.org/42834811:44
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490511:44
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Simplify/fix config enabled conditions for upgrades  https://review.openstack.org/42830911:44
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Reduce number of steps for upgrades  https://review.openstack.org/42831011:44
*** adarazs is now known as adarazs_lunch11:45
*** salmankhan has quit IRC11:45
*** salmankhan has joined #tripleo11:46
d0ugalso many FFE emails11:46
*** sdake has quit IRC11:46
*** salmankhan1 has joined #tripleo11:47
*** salmankhan has quit IRC11:50
*** salmankhan1 is now known as salmankhan11:50
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs  https://review.openstack.org/42834911:50
*** ansmith has quit IRC11:51
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809311:52
*** pmannidi has quit IRC11:54
*** jkilpatr has joined #tripleo11:57
*** lucasagomes is now known as lucas-hungry11:57
*** salmankhan has quit IRC12:00
*** salmankhan has joined #tripleo12:03
*** pkovar has joined #tripleo12:03
b00tcatis it possible to deploy overclouds with centos 7.3?12:03
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Add batch upgrade configs to output & clarify disabled configs  https://review.openstack.org/42834912:03
*** jkilpatr has quit IRC12:04
shardyb00tcat: yes, all of the upstream CI jobs are running centos 7.3, I'm deploying on 7.3.1611 locally12:06
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix and improve flake8 test.  https://review.openstack.org/42871012:06
b00tcatshardy: ah ok, I was being hit by https://bugs.launchpad.net/nova/+bug/164952712:06
openstackLaunchpad bug 1649527 in OpenStack Compute (nova) newton "nova creates an invalid ethernet/bridge interface definition in virsh xml" [Medium,Fix committed] - Assigned to Roman Podoliaka (rpodolyaka)12:06
*** salmankhan1 has joined #tripleo12:07
*** sudipto has quit IRC12:07
*** sudipto_ has quit IRC12:07
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service  https://review.openstack.org/42808912:08
*** salmankhan has quit IRC12:09
*** salmankhan1 is now known as salmankhan12:09
*** rhallisey has joined #tripleo12:10
*** ooolpbot has joined #tripleo12:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124212:11
*** ooolpbot has quit IRC12:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]12:11
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates master: Remove openstack-ceilometer-expirer check  https://review.openstack.org/42871112:12
*** dougbtv has quit IRC12:15
*** jkilpatr has joined #tripleo12:17
*** dougbtv has joined #tripleo12:19
*** pgadiya has quit IRC12:20
*** michapma_alt has quit IRC12:21
*** dougbtv_ has joined #tripleo12:24
*** morazi has quit IRC12:26
*** panda is now known as panda|lch12:26
*** dougbtv has quit IRC12:27
*** jaganathan has quit IRC12:27
*** sdake has joined #tripleo12:27
*** sdake_ has quit IRC12:30
*** rcernin has quit IRC12:31
EmilienMbonjour12:39
*** skramaja has quit IRC12:43
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: implement a collectd composable service  https://review.openstack.org/41104812:44
EmilienMpanda|lch: fyi, we've got a promotion mainly because we reverted again nova and pin it to ocata-312:44
EmilienMpanda|lch: oh I saw your comment on Trello, so I guess you know that, my bad :)12:45
EmilienMcan someone review this patch to enable debug everywhere in our OVB CI? https://review.openstack.org/#/c/428476/12:46
d0ugaljtomasek: "I am quite convinced that there have been good reasons to not to do this and use Mistral environment."12:46
d0ugaljtomasek: I am not convinced. What are the reasons? :)12:46
jtomasekd0ugal: hmm, you probably know the answer better, I thought that mistral environment is better accessible from mistral actions/workflows and has been used as a natural fit12:48
d0ugaljtomasek: I think I thought it would be, but it isn't really.12:48
d0ugalIn some ways it is harder to access than swift :)12:48
jtomasekd0ugal: whereas swift was intended to be used just as a storage12:48
d0ugaljtomasek: right, but we use the mistral environment as storage and it wasn't designed for that :)12:49
jtomasekd0ugal: I am ok with either solution, but we should stick to one, rather than having the plan 'state' stored in mistral environment and swift files12:49
d0ugaljtomasek: agreed, I just replied to your email anyway12:49
*** nrado has joined #tripleo12:49
jtomasekd0ugal: thanks!12:49
d0ugalsomebody might be able to remind me why we are using Mistral envs.12:49
d0ugalbut AFAICT a mistral environment, as we use it, is no better than a json file in swift.12:50
jtomasekd0ugal: ok, good to know, I think I was looking for this answer:)12:50
*** adarazs_lunch is now known as adarazs12:52
*** athomas has quit IRC12:52
*** athomas has joined #tripleo12:52
openstackgerritRicardo Noriega proposed openstack/tripleo-heat-templates master: Add BGPVPN composable service  https://review.openstack.org/42808912:54
therveEmilienM, Hey, want to chat about https://bugs.launchpad.net/tripleo/+bug/1661412 ?12:55
openstackLaunchpad bug 1661412 in tripleo "NetworkDeployment is executed even if NetworkDeploymentActions is set to ["CREATE"] only" [High,Triaged]12:55
*** fzdarsky is now known as fzdarsky|lunch12:55
*** rhallisey has quit IRC12:56
*** salmankhan has quit IRC12:56
EmilienMtherve: yeah, I'm still figuring out why I have that12:56
therveEmilienM, it's a newton to ocata upgrade?12:57
EmilienMtherve: exactly12:57
therveEmilienM, Does the resource exist in newton?12:58
EmilienMtherve: yes, the overcloud is deployed on Newton, it only fails when I run stack update12:58
*** lucas-hungry is now known as lucasagomes12:59
*** dmarlin has quit IRC12:59
shardythe SoftwareConfig resource is changing though12:59
therveEmilienM, I mean, is there a NetworkDeployment resource in the newton template?12:59
shardytherve: yeah the NetworkDeployment should be the same, only the config changes12:59
therveOK12:59
therveLooking at the log, we get into replace phase12:59
slaglethe config gets mapped to a new nested stack actually13:00
therveThat's why we re-create it, and don't respect the actions13:00
slaglebut the actions on the Deployment are ["CREATE"]13:00
shardyslagle: does the upgrade switch the dummy server to the new DeployedServer resource?13:00
*** milan has joined #tripleo13:01
slagleshardy: yes, i think so13:01
shardyif the server ID changes, the deployment gets replaced13:01
shardyso that may be why13:01
shardyhttp://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Heat::SoftwareDeployment-prop-server13:01
*** ccamacho is now known as ccamacho|lunch13:02
slagleok, so then we need to set NetworkDeploymentActions to [] on update13:02
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809313:02
slaglethat should fix it for this case?13:02
*** jaganathan has joined #tripleo13:02
shardyOr ensure the server ID doesn't change (which would be the normal update case, as the nova server isn't changing)13:02
*** jayg|g0n3 is now known as jayg13:04
*** rlandy has joined #tripleo13:05
ansiwenmatbu: so, https://review.openstack.org/#/c/405241 includes the pre-upgrade safety online_data_migration... but it doesn't include the post-db-sync online_data_migration. do you have plans to include that somewhere else, so it will be executed during the service running?13:08
ansiwenmatbu: and can I help somehow?13:08
*** ealcaniz has quit IRC13:09
matbuansiwen: the post-db-sync should be run when the package nova-api is updated and running ?13:10
matbuansiwen: i think it could be add at the end of the step513:10
*** ooolpbot has joined #tripleo13:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124213:11
*** ooolpbot has quit IRC13:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]13:11
shardymatbu: we can't start nova-api via ansible because we need it reconfiguring for httpd via puppet13:11
shardymatbu, ansiwen: so I think the post-start sync has to go in puppet-nova?13:11
ansiwenmatbu: the idea of "online_data_migration" is to extract migration steps from db_sync, that could be executed in the running system, to keep the db-sync as short as possible and have a short downtime. so it is not _necessary_ to run the online_data_migration in the running system, but it's possible and would therefore reduce the downtime. does that make sense?13:12
shardyprobably we should remove all the syncs that aren't migrations not handled by puppet13:12
shardybut yeah if it's not handled by puppet, and nova-api doesn't need to be runing we can do it in step513:13
*** jaganathan has quit IRC13:13
ansiwenshardy: yeah, it doesn't need to be running.13:13
*** dmarlin has joined #tripleo13:14
ansiwenmatbu, shardy: in case you missed it, I created an etherpad to get a kind of overview of the whole situation:  https://etherpad.openstack.org/p/tripleo-nova-online-data-migration13:14
matbuansiwen: thx13:14
therveslagle, It sound like not changing the server ID will be tough13:16
therveIt ought to be the correct thing, because we may have other unexpected issue by not reusing it13:17
matbuansiwen: so we run the online_data_migration at step 5 (line 205) so this part should be run at the end of the dbs sync (nova db and api db?)13:17
ansiwenshardy, matbu: however, to keep downtime during upgrade short, the online_data_migration is designed to be run in the running system, that's why it's called "online". so optimal would be a background process after the system is up and running, that does the online_data_migration, and marks the system as fully "upgraded" once it's finished. subsequest updates could then check for that "upgrade-mark", but that is a bit over-engineered13:18
ansiwenprobebly, because a very quick upgrade over two major versions is not a common usecase I assume.13:18
*** morazi has joined #tripleo13:18
matbuansiwen: do you know how long could it take on a production environment ?13:19
*** bfournie has quit IRC13:20
*** sudipto has joined #tripleo13:20
*** sudipto_ has joined #tripleo13:20
ansiwenmatbu: no idea... but it was done, beccause for large deployments a db-sync took to long, so they decided to split it up into an offline-part (db-sync) and an online part (online_data_migrations), so it's a fair assumtions, that it takes too long as that you wanna wait for it to finish before you restart the system.13:21
*** hjensas has joined #tripleo13:21
*** hjensas has quit IRC13:21
*** hjensas has joined #tripleo13:21
EmilienMshardy, slagle, therve, thanks guys. It seems we have 2 solutions, maybe I can start with James's solution first and maybe do shardy's one too, to be safer13:21
therveEmilienM, *potential* solutions :)13:22
therveBut yeah the action restrictions sound easier to try at least13:22
EmilienMright, it's worst a try13:22
*** dprince has joined #tripleo13:23
matbuansiwen: hmm yep, idk what shardy thinks about that, imho we could keep the review as is in a first pass and then itterate to make an async process to the online_data db sync13:23
matbuansiwen: actually we can do that easily with ansible13:25
*** morazi has quit IRC13:25
shardyYeah that sounds like something we can consider after we get the initial with-downtime workflow proven13:26
shardymatbu, ansiwen: So, are we OK to land https://review.openstack.org/#/c/405241/ as it is, then iterate on any fixes, or do we need to wait?13:27
*** panda|lch is now known as panda13:27
EmilienMslagle: do you have an example in THT where we set a resource for a specific action?13:27
shardyI'd like to add it to the upgrades CI job, but we can do that as a followup if it's been proven locally13:27
matbushardy: i think we can use the async option on this task, and make the poll configurable, so if we want to "launch and forget the db sync" we just have to set the poll to 013:28
*** gkadam has quit IRC13:28
nradoCan someone please help me concerning the tripleo-image-elements: https://github.com/openstack/tripleo-image-elements/blob/master/elements/seed-stack-config/install.d/01-seed-stack-heat-metadata13:28
nradoI want to change the auth_url in /etc/etc/os-collect-config.conf, because it points to an internal VIP which is not accessible for VMs deployed with my Heat stack.13:28
nradoHow do the params come into the config file I sent in the link above?13:28
EmilienMshardy: my question is why does it fail for me in scenarios and not for your job?13:28
matbushardy: i'm in favor of landing if all reviewer are agree13:28
matbushardy: and then work on another pass13:28
matbuEmilienM: do you have an example ?13:29
EmilienMmatbu: +1 on landing nova13:29
EmilienMwe can iterate later13:29
*** jaganathan has joined #tripleo13:29
* shardy pulls and tries locally13:29
EmilienMmatbu: see https://bugs.launchpad.net/tripleo/+bug/1661412 - it seems like you're not hiting this bug in your upgrade job13:29
openstackLaunchpad bug 1661412 in tripleo "NetworkDeployment is executed even if NetworkDeploymentActions is set to ["CREATE"] only" [High,Triaged]13:29
shardyOk I'll do a test locally then approve if it works13:29
shardyEmilienM: honestly I'm not sure - are we using the master deployed-server config in the current CI job?13:30
shardyEmilienM: I'll check and compare the logs when I've tested this nova patch13:30
EmilienMok, let me look that13:30
matbumarios: may i update your review (https://review.openstack.org/419886) to fix the jinja rendering or do you prefer me to comment on the review the things which failed the rendering ?13:30
*** arxcruz has quit IRC13:30
ansiwenshardy, matbu: so if you want to have a fully working upgrade with increased downtime, you need to add a last online_data_mitration step that is executed on at least on controller node with database connection. without it, the upgrade is not complete.13:32
*** rhallisey has joined #tripleo13:32
*** trown|outtypewww is now known as trown13:32
shardyansiwen: Ok, and that needs to happen after the package update, but can happen before the nova services are started?13:33
*** pradk has joined #tripleo13:33
ansiwenshardy, matbu: but if you accept that the upgrade process is not complete yet with this change, then you can merge as is, and add the online_data_migration elsewhere13:33
ansiwenshardy: after the db sync13:33
shardyansiwen: please comment on the review and I'll try it - we can decide if we post a follow up patch or modify this one13:33
shardyansiwen: thanks for the feedback :)13:34
slagleEmilienM: it's setting a parameter13:34
ansiwenshardy: ok, I'll do13:34
*** shardy is now known as shardy_mtg13:34
*** Vijayendra has quit IRC13:37
*** flepied has joined #tripleo13:37
*** arxcruz has joined #tripleo13:38
ansiwenshardy_mtg: done13:38
*** morazi has joined #tripleo13:38
*** ansmith has joined #tripleo13:39
slagleEmilienM: i'd use the version of net-config-multinode.yaml from tripleo-ci instead of tripleo-heat-templates13:39
slaglethat's what we are using in the upgrades job13:39
nradoany advice?13:41
*** jpena is now known as jpena|lunch13:42
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart-extras master: [overcloud-ssl] fix library to work with ocata  https://review.openstack.org/42872613:43
matbuansiwen: yes thanks for the feedback13:43
*** prateek_ has joined #tripleo13:43
matbuansiwen: but just a question does the L205 is required at this stage ?13:44
ansiwenshardy_mtg, matbu: you're very welcome, actually I'm here not only for feedback, but I can actually do work, so if you tell me what is the right approach I can actually get my hands dirty13:45
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809313:46
*** fzdarsky|lunch is now known as fzdarsky13:46
ansiwenmatbu: oh, no, that's wrong!, didn't notice it! I will comment on it13:46
EmilienMslagle: ok13:46
matbuansiwen: hehe thanks then :)13:46
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix and improve flake8 test.  https://review.openstack.org/42871013:47
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add ReNo support for managing release notes in TripleO-Quickstart-Extras  https://review.openstack.org/42872913:47
ansiwenmatbu: commented13:49
*** anshul has quit IRC13:49
matbuansiwen: awesome thank you :)13:49
trownweshay: can you use the example of centosci/ocata.yml (pulled into that patch via rebase) to add repo configs for the other releases being added in that patch? https://review.openstack.org/42836213:50
*** bfournie has joined #tripleo13:50
weshaytrown++ ya np13:51
ansiwenmatbu: I can prepare a patchset now, if you are busy with other stuff, what do you think?13:51
openstackgerritMerged openstack/tripleo-quickstart master: Add repo configuration to release configs  https://review.openstack.org/42421213:51
honzajtomasek: Did I understand your comments correctly that you wanted me to rewrite the dist/ patch using HtmlWebpackPlugin?13:52
jtomasekhonza: yes, if you agree13:52
honzajtomasek: I don't care either way.  Happy to redo it.13:52
jtomasekhonza: my thinking is that we'll need to do that sooner or later anyway13:52
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix and improve flake8 test.  https://review.openstack.org/42871013:52
matbuansiwen: you mean for the online_data_migration on a running system ?13:53
openstackgerritMerged openstack/tripleo-quickstart master: Fix initialization of novaclient  https://review.openstack.org/42810513:53
matbuansiwen: i'm about to move the L205 to the end13:53
ansiwenmatbu: no, as an intermediate step I would move the wrong one to the end with a comment that this is a intermediate solution, until we have a background solution13:54
ansiwenmatbu: ok, that's what I would have done as well, ok :-)13:54
matbuansiwen: ha ok, i'm pushing a new change so13:54
*** jpich has quit IRC13:55
matbuansiwen: i'm wondering if we need to make it async ?13:55
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Add nova service support for composable upgrades  https://review.openstack.org/40524113:55
jtomasekhonza: re https://review.openstack.org/#/c/424547/7/src/js/utils/nodes.js13:56
honzajtomasek: saw the email, haven't read the comments yet13:56
*** kberger has joined #tripleo13:56
jtomasekhonza: ok, no rush, I'll wait for your feedback and update the patch accordingly13:56
ansiwenmatbu: what exactly?13:57
*** tzumainn has joined #tripleo13:58
matbuansiwen: the online_data_migration task13:58
ansiwenmatbu: the last online_data_migration step?13:58
matbuansiwen: yep13:58
ansiwenmatbu: what does it mean exactly? it would be started in the background, and then the service would be started no matter if it finished?13:59
ansiwenmatbu: actually that would be sufficient I giess, but I would like to ask out nova-core about that first...14:00
matbuansiwen: ansible will execute the data migration , forked in background and then the upgrade process will continue14:00
ansiwenmatbu: what I mean is, then we would not need any other solution...14:00
*** dtantsur|bbl is now known as dtantsur14:00
*** salmankhan has joined #tripleo14:03
*** rbrady-afk is now known as mock-hates-me14:04
*** nrado has left #tripleo14:04
larsksEmilienM: mmagr's patch at https://review.openstack.org/#/c/410210/ has a depends-on for that tripleo-ci patch, but look at the console log it doesn't appear to be running with that patch active.14:06
larsksI'm looking at http://logs.openstack.org/10/410210/6/check/gate-tripleo-ci-centos-7-scenario001-multinode/50b6998/console.html#_2017-02-03_10_10_14_878067.14:06
dtantsurgfidente, (late response) network provisioned in the overcloud neutron14:06
gfidentedtantsur so if it has to be in the overcloud neutron and you want just a string there?14:07
dtantsuryep, this is a future network, that users will create (yes, I realize how it sounds)14:08
*** dsavineau has left #tripleo14:10
EmilienMslagle: I think I found why, see https://review.openstack.org/#/c/404831/76/heat-templates/net-config-multinode.yaml14:10
EmilienMslagle: you were right, something went wrong in the "ip"command14:10
mariosmatbu: hey man, am still on this call14:10
mariosmatbu: please feel free to update it if you can/have time thanks very much14:11
*** ooolpbot has joined #tripleo14:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166124214:11
*** ooolpbot has quit IRC14:11
openstackLaunchpad bug 1661242 in tripleo "undercloud upgrade fails: novaclient.exceptions.Unauthorized" [Critical,Triaged]14:11
mariosmatbu: otherwise i will try and update it later if you want to add a comment14:11
*** mock-hates-me is now known as rbrady14:11
*** shardy_mtg is now known as shardy14:11
*** dsavineau has joined #tripleo14:12
rbradyshardy: ping https://bugs.launchpad.net/tripleo/+bug/164487514:12
openstackLaunchpad bug 1644875 in tripleo "Plan isn't purged of roles_data on a new create" [High,Triaged] - Assigned to Dougal Matthews (d0ugal)14:12
*** jmelvin has joined #tripleo14:12
shardyrbrady: Hi!14:12
rbradyshardy: I was reading this bug and thinking about the previous desire to decouple plans from stacks14:13
matbumarios: ack, thank you, i have few things to update but i still have some weird behavior14:14
matbubut will do14:14
shardyrbrady: Yeah, maybe the answer is to somehow enforce running plan delete or overcloud delete14:15
rbradyshardy: is there still a desire to separate plans from stacks?  if so should we be looking at creating something else that manages the state of what plans were used to create stacks14:15
shardyrbrady: I always expected them to be a bit less coupled than they are, but I think the current model is working OK so I'm not pushing too hard to change it :)14:17
shardyrbrady: I think the main problem is that we overwrite the roles_data.yaml in the default t-h-t, instead I think we need the process_templates logic be able to pick up a user defined roles_data file (either from the swift container or the mistral env)14:19
shardybut then default to the tht/roles-data.yaml if the user doesn't pass -r on a new deployment14:19
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: Provide a default value for Ironic cleaning_network configuration  https://review.openstack.org/42805214:19
dtantsurshardy, let's try this ^^^14:19
openstackgerritDmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic  https://review.openstack.org/42805314:20
shardythen we could still consume updates to the --templates directory without clobbering the users roles_data.yaml14:20
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: net-config-multinode: make controlplane int idempotent  https://review.openstack.org/42874714:20
*** athomas has quit IRC14:20
EmilienMshardy, slagle ^14:20
*** ccamacho|lunch is now known as ccamacho14:20
*** adarazs is now known as adarazs_afk14:20
shardydtantsur: so, this is really just a placeholder, which will be updated when the network is created in the overcloud neutron?14:21
*** Goneri has joined #tripleo14:22
dtantsurshardy, essentially yes. the docs will recommend creating a network with this name, so in simplest case an update will not be needed14:22
* dtantsur is sad with this, but he does not see a better way out14:22
shardydtantsur: Ok thanks for clarifying, I was confused by the "and should be changed to an actual UUID" part14:23
*** colonwq has quit IRC14:23
shardyin the parameter description14:23
shardymaybe that can be reworded to say it can be a network name, so no update is required if the names match?14:23
shardydtantsur: FYI I was talking with beagles about a very similar requirement for octavia14:24
shardythat requires overcloud neutron resources to be created, then wired into the octavia config14:24
dtantsurshardy, I don't want to recommend using names for non-PoC cases, as names in neutron are not unique14:25
shardyperhaps we can discuss at the PTG possible ways to make those steps integrate more cleanly14:25
shardydtantsur: ack, Ok no worries14:25
*** owalsh is now known as owalsh-brb14:25
*** jtomasek has quit IRC14:25
dtantsurshardy, ++ for PTG discussion14:25
*** hjensas has quit IRC14:26
*** jtomasek has joined #tripleo14:26
*** athomas has joined #tripleo14:26
*** tobias_fiberdata has quit IRC14:27
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud stable/newton: export OS_BAREMETAL_API_VERSION in stackrc  https://review.openstack.org/42875614:27
*** colonwq has joined #tripleo14:28
*** tobias_fiberdata has joined #tripleo14:28
dtantsurmay I have this backport please ^^^?14:29
*** owalsh-brb has quit IRC14:29
*** ealcaniz has joined #tripleo14:29
*** liverpooler has joined #tripleo14:32
*** owalsh-brb has joined #tripleo14:32
EmilienMdtantsur: please add bug reference and we're good14:33
*** tobias_fiberdata has quit IRC14:34
dtantsurEmilienM, creating a bug as we speak14:34
EmilienMdtantsur: cool14:35
*** jcoufal has joined #tripleo14:35
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled  https://review.openstack.org/41988614:36
*** ealcaniz has quit IRC14:36
*** tobias_fiberdata has joined #tripleo14:36
EmilienMany thoughts on enabling more Debug in CI? https://review.openstack.org/#/c/428476/14:36
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud stable/newton: export OS_BAREMETAL_API_VERSION in stackrc  https://review.openstack.org/42875614:36
*** lblanchard has joined #tripleo14:36
dtantsurdone ^^^14:37
*** tobias_fiberdata has quit IRC14:37
*** tobias_fiberdata has joined #tripleo14:39
*** salmankhan has quit IRC14:40
*** amoralej is now known as amoralej|lunch14:40
*** jpena|lunch is now known as jpena14:40
EmilienMlarsks: let me look in a bit14:41
larsksEmilienM: the dependency worked for the collectd job, so maybe mmagr just needs a recheck.14:41
larsksWe'll do that first.14:41
EmilienMok14:41
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780214:42
weshaymatbu, do you have an estimate of when you will have the upgrade validation check in a review for oooq?14:43
weshaymatbu, we'd like to start reviewing and merging the upgrade role14:44
weshayand I think that is the only item left14:44
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: Add scenario005 job (4nodes)  https://review.openstack.org/41809814:45
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Add scenario005 scenario  https://review.openstack.org/41809914:45
matbuweshay: i will add a new role in a different review14:46
matbuweshay: as i said in by email, i think that should not block the review since it will be in another review14:47
matbuweshay: and + the time and work for maintaining and rebasing the both review will be very useless14:47
matbuweshay: and btw i think this kind of sanity checks, is more global and not limited to only the upgrade scope14:48
*** fultonj has joined #tripleo14:49
openstackgerritDmitry Tantsur proposed openstack/tripleo-docs master: Update bare metal cleaning documentation with latest changes  https://review.openstack.org/42806614:50
dtantsurshardy, docs bit for this ironic issue ^^^14:50
d0ugalthrash: the downside is that the CLI currently just ignored any messages that are not from the "parent" workflow.14:51
d0ugaltherve: https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/plugin.py#L152-L15314:51
d0ugaloops, sorry therve - you'd think I would learn14:51
thrashd0ugal: yeah.. that would make that unuseful. :D14:51
d0ugalthrash: ^ that link shows where the CLI drops it.14:51
matbuweshay: but to answer to your question, i'll try to push something by the end of this week or the begining of next week14:52
thrashd0ugal: I'll base my patch on your multimessage patch14:52
d0ugalthrash: I wouldn't, yet :)14:52
d0ugalthrash: because I hit issues and I wont be able to fix them for a week14:52
d0ugalthrash: (but now that there is a use case, I have more motivation!)14:53
*** paramite has quit IRC14:53
weshaymatbu, we can't merge the work w/o a functional gate14:53
d0ugalthrash: you could always just hack in a print in that loop so you can see them all for testing purposes.14:53
weshaypart of the gate is the validation14:53
*** jeckersb_gone is now known as eck`14:53
thrashd0ugal: haha14:53
weshaymatbu, if you need someone else to write the validation I can facilitate that.. but we're looking for a cut/paste of what is in tripleo-ci atm14:53
thrashd0ugal: noted.14:54
thrashbiab14:54
*** thrash is now known as thrash|biab14:54
*** salmankhan has joined #tripleo14:56
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata  https://review.openstack.org/42836215:01
*** adarazs_afk is now known as adarazs15:05
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: add quickstart release files for ocata  https://review.openstack.org/42836215:09
*** pcaruana has quit IRC15:11
*** fultonj has quit IRC15:11
jtomasekakrivoka: plan import export is planned for pike, right?15:12
akrivokajtomasek: yes15:13
*** Vijayendra has joined #tripleo15:13
EmilienMshardy: quick heads-up on nova upgrades15:16
EmilienMshardy: with nova trunk we hit: https://bugs.launchpad.net/nova/+bug/166136015:16
openstackLaunchpad bug 1661360 in OpenStack Compute (nova) "tempest test fails with "Instance not found" error" [Undecided,In progress] - Assigned to Dan Smith (danms)15:16
EmilienMshardy: they're trying to fix it with https://review.openstack.org/#/c/428415/ but I'm not sure it will make it on time for ocata15:16
EmilienMshardy: another option is to revert nova/wsgi in tripleo and deploy eventlet again (like we did in Mitaka)15:17
*** pcaruana has joined #tripleo15:17
EmilienMshardy: I think Juan implemented it during Ocata so we might just need to revert the patches15:18
shardyEmilienM: Ok thanks for the update, reverting to eventlet seems saest to me15:18
shardysafest I mean15:18
EmilienMok I'll check with Dan Smith15:18
*** dmacpher has joined #tripleo15:18
shardybut yeah lets chat with jaosorior as I got the impression the tls-everywhere stuff was somehow coupled to moving the services under wsgi15:19
*** saneax is now known as saneax-_-|AFK15:19
shardy"Since those deployments are risking instability anyway"15:19
shardywhat does that mean?15:20
shardyis httpd not reccomended/supported for nova?15:20
shardyprobably need to clarify that with dansmith15:20
*** flepied has quit IRC15:20
EmilienMmriedem | given we haven't really flushed out testing with that, i think it's prudent at this point in ocata15:22
EmilienMshardy: ^15:22
EmilienMNova PTL suggest we switch WSGi off for nova api15:22
shardyEmilienM: Ok, thanks - I guess that tells us what we need to do15:22
EmilienMI'm on it15:22
shardyack, thanks EmilienM15:22
*** fultonj has joined #tripleo15:23
*** chlong has joined #tripleo15:23
*** prateek has quit IRC15:23
*** prateek_ has quit IRC15:23
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled  https://review.openstack.org/41988615:24
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Move libvirt_uri to common role  https://review.openstack.org/42431915:25
*** owalsh-brb is now known as owalsh15:28
*** tobias_fiberdata has quit IRC15:28
pandaderekh: mh http://66.187.229.139/builds/current-tripleo/ overcloud-full.tar image is missing15:30
*** tobias_fiberdata has joined #tripleo15:31
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42877815:32
*** Vijayendra has quit IRC15:33
EmilienMamoralej|lunch: fyi ^15:33
*** amoralej|lunch is now known as amoralej15:34
amoralejufff15:34
*** jcoufal_ has joined #tripleo15:34
dtrainorcan i get some reviews on https://review.openstack.org/#/c/424909/ and https://review.openstack.org/#/c/424903 please?15:35
*** rajinir has joined #tripleo15:36
pandaI think this is a red alert ...15:36
pandathe gates are not using the promoted images15:36
*** vpickard has joined #tripleo15:36
*** jcoufal has quit IRC15:36
pandathey are rebuilding new images everytime15:37
pandabecause there is not promoted image in the mirror15:37
amoralejEmilienM, is that intended just temporal to be fixed before ocata GA?15:37
EmilienMamoralej: I don't think it will be fixed by GA15:38
amoralejwe don't rely on httpd for SSL termination, right?15:38
amoralejwe always do it with haproxy, iirc15:38
EmilienMamoralej: right15:39
EmilienMunless you use TLS everywhere15:39
*** tremble has quit IRC15:39
EmilienMJuan will hate me15:39
amoralejand for newton -> ocata migrations, we'll need to undo the apache part15:40
*** jaosorior has joined #tripleo15:40
EmilienMamoralej: in newton, nova api was not in wsgi15:40
amoralejoh, i thought it was15:40
jaosorioramoralej: I thought it was as well15:41
amoralejfrankly, i think it's the best we can do, while it's not tested in nova gate15:41
jaosoriorat least it was for the undercloud15:41
pandaEmilienM: bnemec derekh https://bugs.launchpad.net/tripleo/+bug/166165615:41
openstackLaunchpad bug 1661656 in tripleo "CI: promoted overcloud-full image is missing in the mirror" [Critical,Triaged]15:41
bnemecpanda: I literally just discovered that myself. :-)15:41
bnemecpanda: The mirror server is full.15:42
* panda facepalms15:43
* panda runs to the rack with his 500G hard drive15:43
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42878315:43
jaosorior:(15:43
*** mcornea has quit IRC15:43
pandabnemec: I guess we are not removing old images then ...15:43
bnemecpanda: Doesn't look like it.15:44
bnemecderekh: Did you have any sort of a cleanup script for the mirror server?15:44
pandabnemec: EmilienM the problem is we've lost the promoted overcloud image from today15:45
pandaso we'll have to start manual promotion again.15:45
jaosoriorEmilienM: so there was no other solution?15:46
EmilienMjaosorior: nova PTL and Dan Smith strongly suggested us to not deploy nova APi in WSGI with Apache15:47
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: Explicitly configure credentials used by ironic to access glance  https://review.openstack.org/42868015:47
EmilienMjaosorior: moreover, there are some bugs related to it15:47
EmilienMat this point of the cycle, I'm reverting this work so we can go back on nova trunk one day15:47
EmilienMsorry15:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Cleanup nova-api workaround for wsgi/eventlet  https://review.openstack.org/42878415:47
pandayeah if it's not supported nor gated, will be a pain to maintain15:48
EmilienMjaosorior: I would ask you to ASAP review https://review.openstack.org/#/q/topic:bug/1661360+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%2215:48
EmilienMand let me know if I did something wrong15:48
EmilienMjaosorior: feel free to take over the patches also15:48
EmilienMjaosorior: if possible I want to merge it today15:48
jaosoriorEmilienM: ok, lets do that15:50
jaosoriorEmilienM: lets wait for it to pass CI15:50
pandacan someone merge this so I can be more helpful in the infra next time ? https://review.openstack.org/410157 thanks.15:50
jaosorioron a quick review it looks good to me15:50
pandabnemec: will this give me access to the mirror server too ? ^15:50
EmilienMjaosorior: ok thx15:50
EmilienMpanda: approved15:50
pandaEmilienM: thanks.15:51
bnemecpanda: It should, yes.15:53
pandagreat15:53
openstackgerritmathieu bultel proposed openstack/tripleo-heat-templates master: Delivers upgrade scripts where upgrade steps are disabled  https://review.openstack.org/41988615:54
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42878515:55
openstackgerritMerged openstack/tripleo-image-elements master: Follow HTTP/HTTPS redirects  https://review.openstack.org/42814615:56
ansiwenshardy, matbu: ok, it's getting more complicated. :-(15:57
ansiwenshardy, matbu: online_data_migrations is not guaranteed to succeed in a single executed, so it must be an after upgrade task, that is repeated until the tool reports the successfull migrations of everything.15:58
ansiwenso, the overcloud is fully functional already then, but still the online migrations have to be done.15:59
matbuansiwen: ack, and until how many times we can considere it as failed ?16:01
matbuansiwen: cause we can make retry easily depending on the output, but how many times ?16:02
*** jcoufal_ has quit IRC16:03
bnemecpanda: I've cleaned up some of the old images on the mirror server and copied the last good image to the current-tripleo directory, so hopefully we're back up and running again.16:03
*** jcoufal has joined #tripleo16:03
*** aufi has quit IRC16:04
pandabnemec: ok I'll kick a manual promotion16:04
ansiwenmatbu: there is no limit :-/16:05
jaosoriorEmilienM: commented to the nova patch16:05
shardyansiwen: that makes no sense, how can nova have a tool which requires infinite retries until it works?16:05
shardythat retry logic should depend on some state, and the state should be inspected inside the tool16:06
bnemecOops, except I had the file owned as root.  Now it should be working.  I see jobs requesting the image and getting it.16:06
shardythis is a horrible experience for operators IMO16:06
jaosoriorbnemec: hey dude, did you have time to test the VNC bits yesterday?16:06
EmilienMjaosorior: can you do it please?16:06
pandabnemec: yeah, even I can download it16:06
EmilienMjaosorior: you know better the options than I do16:06
jaosoriorEmilienM: sure man16:06
EmilienMthx16:07
ansiwenshardy: well... there are all kinds of reasons why migrations are deferred, so there is no hard limit.16:07
bnemecjaosorior: I did, and it worked for me, so I think that's good to go.16:07
ansiwenshardy: and I didn't design that, so I will not defend it :-)16:07
bnemecI just haven't had a chance yet today to get back and leave feedback.16:07
ansiwenshardy: this whole tooling was developed with human operators in mind16:07
*** jcoufal_ has joined #tripleo16:07
*** sdake_ has joined #tripleo16:07
*** rhallisey has quit IRC16:08
*** rhallisey has joined #tripleo16:08
ansiwenshardy: read this article, that step is even called "homework" ;-) http://www.danplanet.com/blog/2015/06/26/upgrading-nova-to-kilo-with-minimal-downtime/16:08
shardyansiwen: how many sysadmins want to manually retry a tool which is expected to fail an indeterminate number of times?16:08
*** sdake has quit IRC16:08
shardyansiwen: ack, thanks16:08
ansiwenshardy: again, I can't defend that...16:08
shardyansiwen: I appreciate it's not your fault, I'm just observing that this doesn't seem to have been designed with real-world operators in mind at all ;)16:09
*** sdake has joined #tripleo16:09
*** jcoufal has quit IRC16:09
shardyI guess we'll test it and pick a number based on the number of retries observed16:09
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42878316:10
ansiwenshardy: that is highly depending on the size of the deployment16:10
*** yamahata has joined #tripleo16:10
ansiwenshardy: if you have 1000s of compute nodes, the likelyhood that some are not migratable is pretty high and it will need a lot more retries16:10
*** ccamacho has quit IRC16:11
*** jcoufal has joined #tripleo16:11
*** ooolpbot has joined #tripleo16:11
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:11
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/166165616:11
openstackLaunchpad bug 1661656 in tripleo "CI: promoted overcloud-full image is missing from the mirror" [Critical,Triaged]16:11
*** ooolpbot has quit IRC16:11
bnemecpanda: ^ is not critical IMHO.  Jobs still work, they just take a little longer because they have to build the image themselves.16:11
*** sdake has quit IRC16:12
ansiwenshardy: I think we need a periodic taks, like a cronjob or something, which will run until everything is migrated and send out warnings until it's finished.16:12
openstackgerritJuan Antonio Osorio Robles proposed openstack/puppet-tripleo master: nova/libvirt: switch vnc server binding  https://review.openstack.org/42733916:12
jaosoriorbnemec: what about that? ^^16:12
*** sdake_ has quit IRC16:12
shardyansiwen: I guess that's an option, but that will mean it's not integrated with the upgrades workflow16:12
ansiwenshardy: or better we need an ansible task or puppet thing that periodically retries until it succeeds16:12
pandabnemec: it's not critical, I wanted to warn people that they weren't having the protection of the promotion16:13
*** ccamacho has joined #tripleo16:13
bnemecpanda: We're still fine.  The images built in the jobs still use current-tripleo, so you're getting the same packages either way.16:13
bnemecIt just takes less time when we start from the cached image.16:13
*** jcoufal_ has quit IRC16:13
ansiwenshardy: right, we need two notions of "upgrade finished", first the offline stuff, and then a "soft" part, that will finish during runtime16:13
weshayyolanda, leifmadsen greetings.. wondering if you guys have additional git repos that you use alongside oooq I can poke at?16:14
*** priley has joined #tripleo16:15
yolandahi weshay . Well, i also rely on the ansible-role-tripleo-image-builder to construct OSP images16:15
weshayyolanda, anything specific for your network testing?16:16
yolandaweshay not at the moment, because we mostly rely on virtualized deploys16:17
*** ebarrera has quit IRC16:17
*** [1]cdearborn has joined #tripleo16:17
*** jaganathan has quit IRC16:17
*** thrash|biab is now known as thrash16:17
openstackgerritDmitry Tantsur proposed openstack/instack-undercloud master: Explicitly configure credentials used by ironic to access glance and neutron  https://review.openstack.org/42868016:18
matbuansiwen: shardy i agree w/ shardy , it's really a bad user experience, and even with an infinite cron job16:18
*** tzumainn has quit IRC16:18
matbuansiwen: shardy imagine, it never finished ?16:18
*** tzumainn has joined #tripleo16:18
matbuwe will provide to customer an infinite loop on the controller, and + it can consume a bunch of memories16:19
derekhpanda: did ye find the missing image? sorry was on a call16:20
matbuansiwen: shardy i think maybe it would be nice to open a LP about this "infinite" part and just leave the review as is16:20
matbuansiwen: shardy i can implement the retries, test it and discuess in the LP bug16:20
pandaderekh: no, we've lost it, storage full16:20
matbuim running the upgrade patch atm with a catch of the log output from online_data_migration to see more details about that16:21
shardymatbu: +1 if the current patch works enough to enable folks to start testing I agree, lets fix this in a followup16:21
pandaderekh: bnemec freed some space and copied yesterday's image16:22
matbuansiwen: do you want to open the LP or i can do it16:22
*** egafford has joined #tripleo16:22
ansiwenmatbu, shardy: one condition for online_data_migration to succeed is, that all compute nodes are upgraded already, is this guaranteed at that point in time?16:22
pandaderekh: and we rekicked a promotion. All good :)16:22
*** panda is now known as panda|bbl16:23
shardyansiwen: No, we upgrade the control plane first16:23
matbuansiwen: nop16:23
shardythen operators drive the compute upgrades16:23
shardythen we do a final overcloud "converge" update16:23
shardyperhaps we just have to document this as part of the operator driven steps16:23
derekhpanda|bbl: ok, there was a clean up script that should have been deleting old images16:23
matbushardy: yep maybe16:24
matbuin all case i think having all details in a LP would help to figure out that part16:24
ansiwenshardy: do we have such steps? that would be certainly the easiest option, if there are manual steps anyway16:25
matbuwe can add an extra step which would be applied during the converge btw16:25
ansiwenmatbu: I have to go AFK now, but I could do it later16:25
*** nmathew has quit IRC16:25
matbuansiwen: yep we have some manual intervention in some cases16:25
matbuansiwen: at least some sanity checks from the operator for pacemaker for example16:26
matbuansiwen: no pb, thanks for all your input16:26
matbuansiwen: assign the LP to me if you want16:26
*** fultonj has quit IRC16:27
openstackgerritGael Chamoulaud proposed openstack/tripleo-quickstart master: Fix and improve flake8 test.  https://review.openstack.org/42868916:27
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add registry and role service list entries for Octavia  https://review.openstack.org/41859616:29
openstackgerritAndy Smith proposed openstack/puppet-tripleo master: WIP Use rpc and notify transport_url for oslo_messaging backends  https://review.openstack.org/42548416:31
*** cdearborn has quit IRC16:31
*** bnemec is now known as beekneemech16:33
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42878316:33
dtrainorjrist, I remember you talking about some troubles you were having with reno the other day - did you ever figure that out?16:33
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42877816:34
jristdtrainor: mostly? heh16:35
jristdtrainor: there are some patches to rearrange so the reno stuff works16:35
jristdtrainor: have a look and do some reviews if you can16:36
*** chlong has quit IRC16:36
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: nova: disable API in WSGI by default  https://review.openstack.org/42880716:36
dtrainorreading16:37
*** jlinkes has quit IRC16:43
gfidenteshardy shall we merge from https://review.openstack.org/#/c/428348/ and below?16:46
shardygfidente: yes, please (unless anyone else has any objections)16:47
shardymarios, matbu: ^^16:47
gfidenteshardy I went through the reviews16:47
gfidenteit's complicated to understand what is happening after jinja is compiled but seems good to me16:47
shardyI'm on PTO next week so would be good to clear those16:47
gfidenteack16:47
shardygfidente: ./tools/process-templates.py in tht builds the rendered versions16:48
shardyso you can check it out if you like :)16:48
gfidenteshardy yeah exactly16:48
gfidentetks16:48
EmilienMshardy: wait what16:48
EmilienMno you can't leave us16:49
shardyhehe, I'm sure you'll manage ;)16:49
mariosshardy: still didn't get a chance to check those to be honest16:50
mariosshardy: but yeah lets land things i mean we've already said this... there is no current 10-11 workflow so we aren't breaking anything yet16:51
shardymarios: Ok cool - they're passing CI and I've locally tested (mostly single node), are you OK to land then deal with any fixes?16:51
shardymarios: ack, thanks16:51
*** chlong has joined #tripleo16:51
*** d0ugal is now known as d0ugal|skiing16:54
*** priley has quit IRC17:03
*** yolanda has quit IRC17:03
dtantsurEmilienM, sorry to distract, but which job uses https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode-3nodes.yaml ? may we put ironic there on Controller role?17:03
*** suuuper has quit IRC17:04
*** athomas has quit IRC17:04
*** yolanda has joined #tripleo17:06
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy novajoin in the TLS-everywhere job  https://review.openstack.org/42748117:06
openstackgerritJuan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE - testing TLS everywhere job (novajoin)  https://review.openstack.org/42748217:06
mariosshardy: land this simple one ? https://review.openstack.org/#/c/427218/17:06
mariosshardy: would be nice to have this as at least some minor improvement to the script17:07
*** cylopez has quit IRC17:09
larsksslagle: do you have a moment for a question re: https://review.openstack.org/#/c/427802/5/scripts/tripleo.sh?17:11
*** Vijayendra has joined #tripleo17:12
openstackgerritDimitri Savineau proposed openstack/tripleo-quickstart-extras master: Tempest: ensure heat_stack_owner is present  https://review.openstack.org/42089617:12
shardymarios: lgtm17:12
EmilienMdtantsur: 3nodes-multinode-nv , see http://tripleo.org/cistatus.html17:12
shardymarios: hey sorry I didn't get as far as I expected on the script running ansible thing I mentioned17:12
EmilienMdtantsur: why would we add ironic? they are multinode jobs, we wouldn't test ironic correctly17:12
shardymarios: I'll add some notes to your patch explaining what I was thinking & you can decide if it's worth persuing next week17:12
dtantsurEmilienM, we can't quite test ironic without heat resources for it anyway, no?17:13
dtantsurso I thought we can at least put it somewhere to test it still starts..17:13
larsksEmilienM: do you have a couple of minutes re: overcloud images and tripleo.sh?17:14
EmilienMlarsks: it's not a good time no, I'm dealing with release blockers issue at this time17:14
openstackgerritMerged openstack-infra/tripleo-ci master: Add gcerami to tripleo-cd-admins  https://review.openstack.org/41015717:14
larsksEmilienM: I understand. Sorry for bugging you.17:14
EmilienMnp17:14
*** rwsu has quit IRC17:15
dtantsurI'm kind of worried that ironic is probably the only service we support that does not have any CI coverage whatsoever17:15
* dtantsur may be wrong in the "only" part17:15
mariosshardy: thanks. me approaching eod (hopefully soon) we are still on this call ... mostly waiting now for the compute reboots but my brain is pretty much fried at this point17:15
larskstrown: got a sec, also re tripleo.sh?17:16
*** chlong has quit IRC17:16
trownlarsks: sure, heading to lunch soon, but maybe I can get you unblocked quickly17:16
larskstrown: I hope so. I'm looking at the patch to tripleo.sh, https://review.openstack.org/#/c/427802/5/scripts/tripleo.sh17:17
larsksThere is a change in the overcloud_images function...but that is only called when tripleo.sh gets called with --overcloud-images.17:17
larsksAnd *that* doesn't happen as part of the gate jobs (e.g., those failing on https://review.openstack.org/#/c/411048/25).17:17
larsksmmagr and I both have patches blocked on this...what do I need to do to get our jobs to see images that have the appropriate packages?17:18
openstackgerritBen Nemec proposed openstack/instack-undercloud master: Clear any previous environment in stackrc  https://review.openstack.org/42882117:18
*** Vijayendra has quit IRC17:19
*** b00tcat has quit IRC17:20
trownlarsks: ah right the multinode jobs are using cached images...17:21
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780217:23
larskstrown: okay.  So, how do we get new cached images? :)17:23
trownlarsks: hmm... that is a good (but tough question)... how do we make changes that require a change in the cached image...17:23
*** rasca has quit IRC17:23
trownlarsks: the cached images are updated via the periodic jobs when they promote a repo17:23
larskstrown: presumably we need to https://review.openstack.org/#/c/427802/ to merge, then, before it will have any impact?17:24
trownlarsks: ya, it would need to merge, and then we would need to promote ... but that means we cant get real CI on the patch17:24
larsksYay! EmilienM ^^^^^17:24
*** dtantsur is now known as dtantsur|afk17:25
larskstrown: I am at a loss on what to do here.17:25
beekneemechtrown: larsks: You can get CI on the patch by adding a depends-on in a patch to a repo involved in image building (tripleo-common, tripleoclient, any of the elements projects).17:25
beekneemechThose jobs don't use cached images.17:25
trownbeekneemech: that could work... but then if we merge this opstools patch the multinode scenario001 will fail until we promote anywhere we dont build images17:26
beekneemechStrictly speaking tripleo-ci probably shouldn't either, but those jobs already eat up a huge amount of our capacity so I ignore it.17:26
beekneemechtrown: multinode doesn't use images at all.  How would that matter?17:26
larsksbeekneemech: taking a step back...if multinode isn't using images, then maybe I just need to fix my patch to tripleo.sh.17:27
larsksDo you have a second to look?17:27
*** charliejllewelly has joined #tripleo17:27
charliejllewellyHey all...does anyone know if it is possible to use output from one resource in another in the same file?17:28
trownlarsks: ah right... repo setup should take care of all you need for multinode, but the repo is not there http://logs.openstack.org/02/427802/5/check/gate-tripleo-ci-centos-7-nonha-multinode/1cf73de/logs/subnode-2/etc/yum.repos.d/17:28
trownlarsks: oh... wait that is not scenario00117:29
larskstrown: this goes back to my initial question: we have some code that's in the overcloud_images function.  Should that just be moved?17:29
larskstrown: @ line 54617:30
*** cdearborn has joined #tripleo17:30
beekneemechAre we sure the variable is getting set correctly?17:30
openstackgerritArx Cruz proposed openstack/tripleo-quickstart-extras master: Send mail tool  https://review.openstack.org/42334017:30
trownlarsks: no that is needed in all cases, it does not help you though17:30
beekneemechThe tripleo.sh change looks right to me.17:30
*** derekh has quit IRC17:30
trownbeekneemech: larsks ya I think the tripleo.sh patch looks right, but we need to actually run the scenario001 job to test it17:31
larsksbeekneemech: trown: we are!  And it's failing.17:31
*** jkilpatr_ has joined #tripleo17:31
trownthat is the only case where the code in that patch is turned on17:31
larskshttp://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/a7b4100/console.html17:31
larsksYou can see that's using the patched toci_gate_test.sh script, e.g., at http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/a7b4100/console.html#_2017-02-03_14_53_48_28433617:31
trownok, the repo isnt showing up on the subnode... http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/a7b4100/logs/subnode-2/etc/yum.repos.d/17:32
larsks...but it doesn't result in the centos-opstools repository getting enabled.17:32
trownso something is not working17:32
larskstrown: right, hence my questions :)17:32
trown:)17:32
*** jkilpatr has quit IRC17:32
beekneemechOh wait.17:32
beekneemechThat variable isn't getting added to deploy.env.17:32
beekneemechlarsks: trown: ^17:32
beekneemechSo it won't show up on the subnode at all.17:32
trownah, that is it ^17:32
larskswhich variable where?17:33
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker keystone service  https://review.openstack.org/41660517:33
beekneemechlarsks: The enable opstools variable needs to be added to http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n31717:33
larsksbeekneemech: awesome.  Let me give that a shot.17:34
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780217:34
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/newton: net-config-multinode: make controlplane int idempotent  https://review.openstack.org/42882817:34
*** trown is now known as trown|lunch17:35
larskstrown|lunch: thanks!17:36
*** lucasagomes is now known as lucas-afk17:36
*** flepied has joined #tripleo17:37
*** shardy has quit IRC17:38
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809317:41
*** [1]cdearborn has quit IRC17:41
EmilienMjaosorior: https://review.openstack.org/#/c/428785/ is ready for review17:42
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809317:42
EmilienMjaosorior: oh wait no17:43
*** ccamacho has quit IRC17:43
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42878517:43
EmilienMjaosorior: I forgot to remove the upgrade bits17:43
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add html-webpack-plugin dependency  https://review.openstack.org/42814917:44
*** gbarros has quit IRC17:44
EmilienMpanda|bbl, sshnaidm|off, weshay, bkero: can you please review https://review.openstack.org/#/c/428476/ from a oooq point of view?17:44
*** dprince has quit IRC17:50
*** jmelvin has quit IRC17:50
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: Stop deploying Nova API in WSGI with Apache  https://review.openstack.org/42878317:50
*** nrado has joined #tripleo17:53
*** yamahata has quit IRC17:53
*** gbarros has joined #tripleo17:54
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Remove dist/ directory  https://review.openstack.org/42815617:54
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add html-webpack-plugin dependency  https://review.openstack.org/42814917:54
bkeroEmilienM: I think debug might have gotten disabled for multinode oooq jobs. Someone had the opinion that it made the log unreadable17:54
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: nova: disable API in WSGI by default  https://review.openstack.org/42880717:55
EmilienMbkero: that's what our users want17:55
EmilienMto have more debug17:55
*** EmilienM has quit IRC17:56
*** dr_gogeta86 has quit IRC17:56
*** rodrigods has quit IRC17:56
*** gmann has quit IRC17:56
*** Nakato has quit IRC17:56
*** matbu has quit IRC17:56
*** bandini has quit IRC17:56
*** r2bit has quit IRC17:56
*** george_goh has quit IRC17:56
*** chandankumar has quit IRC17:56
*** dr_gogeta86 has joined #tripleo17:56
*** dr_gogeta86 has quit IRC17:56
*** dr_gogeta86 has joined #tripleo17:56
*** rodrigods has joined #tripleo17:56
*** r2bit has joined #tripleo17:56
*** andreaf has quit IRC17:56
*** jmiu has quit IRC17:56
*** matbu has joined #tripleo17:56
*** mjblack has quit IRC17:56
*** cinerama has quit IRC17:56
*** shadower has quit IRC17:56
*** lyarwood has quit IRC17:56
*** dmsimard has quit IRC17:56
*** lyarwood has joined #tripleo17:56
*** jmiu has joined #tripleo17:56
*** chandankumar has joined #tripleo17:56
bkerookay17:56
*** EmilienM has joined #tripleo17:56
*** cinerama has joined #tripleo17:56
*** shadower has joined #tripleo17:56
*** dmsimard has joined #tripleo17:57
bkeroEmilienM: Oh, right. I was thinking ansible debug, which is nasty. Definitely +1 on THT/overcloud deploy debug17:57
*** gmann has joined #tripleo17:57
*** Nakato has joined #tripleo17:57
*** george_goh has joined #tripleo17:57
*** mjblack has joined #tripleo17:57
*** bandini has joined #tripleo17:58
*** andreaf has joined #tripleo17:58
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Add html-webpack-plugin dependency  https://review.openstack.org/42814918:02
*** Vijayendra has joined #tripleo18:03
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Composable services support for Cinder Dell EMC PS Series  https://review.openstack.org/42586118:03
openstackgerritRicardo Noriega proposed openstack/puppet-tripleo master: Add support for BGPVPN service plugin  https://review.openstack.org/42766918:04
*** yprokule has quit IRC18:04
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Composable service support for Cinder Dell EMC Storage Center  https://review.openstack.org/42586618:04
weshayEmilienM, it's not everyday I get to -1 your patches :)18:05
EmilienMweshay: :-O18:07
bkerohehe bnemec just +2d him saying the same thing18:07
*** sudipto has quit IRC18:07
*** sudipto_ has quit IRC18:07
EmilienMI'll change it18:07
EmilienMyou guys are rude18:08
EmilienMlol18:08
weshaylolz18:08
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Composable service support for Cinder Dell EMC Storage Center  https://review.openstack.org/42586618:08
EmilienMjoking18:08
EmilienMmore seriously, weshay: https://github.com/openstack/tripleo-heat-templates/commits/master/environments/debug.yaml is not in stable/newton and stable/mitaka18:08
EmilienMnot a big deal I guess18:08
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Composable services support for Cinder Dell EMC PS Series  https://review.openstack.org/42586118:09
EmilienMweshay: commented18:09
*** salmankhan has quit IRC18:10
*** fzdarsky is now known as fzdarsky|afk18:10
weshayah I see18:11
openstackgerritAlex Schultz proposed openstack/instack-undercloud master: Increase sync timeout for nova db syncs  https://review.openstack.org/42884318:11
openstackgerritDan Radez proposed openstack/tripleo-heat-templates master: adding Congress Support  https://review.openstack.org/33005018:12
openstackgerritRajini Ram proposed openstack/tripleo-heat-templates master: Enables support for configuring Cinder with Dell EMC ScaleIO storage backend.  https://review.openstack.org/42223818:12
openstackgerritMerged openstack/tripleo-heat-templates master: Disable puppet on upgrade for roles not upgrading  https://review.openstack.org/42490518:13
*** flepied has quit IRC18:15
*** priley has joined #tripleo18:15
*** priley has quit IRC18:15
*** flepied has joined #tripleo18:17
openstackgerritMerged openstack/instack-undercloud stable/newton: export OS_BAREMETAL_API_VERSION in stackrc  https://review.openstack.org/42875618:17
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "Revert "set innodb_file_per_table to ON for MySQL / Galera""  https://review.openstack.org/42884618:18
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "Revert "set innodb_file_per_table to ON for MySQL / Galera""  https://review.openstack.org/42884618:19
mwhahahagotta love those revert reverts18:19
*** dprince has joined #tripleo18:20
*** florianf has quit IRC18:21
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/newton: Backport new environment for debug  https://review.openstack.org/42884818:21
*** akuznetsov has joined #tripleo18:22
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/mitaka: Ensure working compute node during the whole migration.  https://review.openstack.org/42809318:22
dtrainorhaha18:23
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/mitaka: Backport new environment for debug  https://review.openstack.org/42884918:23
weshayEmilienM, ok.. backported it18:25
EmilienMweshay: you didn't git cherry-pick ...18:25
EmilienMweshay: you have a nice button in Gerrit18:25
EmilienMplease use it18:26
weshayah crud18:26
weshayk..18:26
*** akuznetsov has quit IRC18:26
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Make network-isolation environment rendered for all roles  https://review.openstack.org/40992018:28
jrist<318:29
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/newton: Add new environment for debug  https://review.openstack.org/42884818:31
*** priley has joined #tripleo18:31
openstackgerritMerged openstack/tripleo-heat-templates master: net-config-multinode: make controlplane int idempotent  https://review.openstack.org/42874718:33
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates stable/mitaka: Add new environment for debug  https://review.openstack.org/42884918:34
*** yamahata has joined #tripleo18:34
weshayEmilienM, :P18:34
weshayyolanda, so to follow back up.. do you have your own general_configs that you use for nfv deployments?18:35
weshaythere has to be some diff18:35
*** jcoufal_ has joined #tripleo18:35
EmilienMweshay: thx sir18:36
*** nrado has quit IRC18:38
*** chlong has joined #tripleo18:38
*** tesseract has quit IRC18:38
*** jcoufal has quit IRC18:38
*** priley1 has joined #tripleo18:42
*** priley has quit IRC18:42
*** prateek_ has joined #tripleo18:42
*** prateek has joined #tripleo18:42
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: Add optional Sphinx build verification  https://review.openstack.org/42586818:43
*** jmelvin has joined #tripleo18:43
*** Goneri has quit IRC18:43
jaosoriorbeekneemech: do you know where the os-collect-config logs are in the overcloud nodes?18:44
jaosoriorbeekneemech: oh, I'm also seeing this in the logs:18:46
beekneemechjaosorior: I  just look in /var/log/messages.18:46
beekneemechIt's in the journal file too if you download it, but that's a PITA.18:46
*** priley1 has quit IRC18:46
jaosoriorJob os-collect-config.service/start deleted to break ordering cycle starting with multi-user.target/start18:46
* beekneemech impotently shakes his fist at monolithic blob log files18:46
jaosoriorbeekneemech: Thing is, I see the NetworkDeployment of all the nodes in the overcloud stall, and I'm trying to figure out why :/18:47
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780218:47
beekneemechjaosorior: Hmm, sounds like something is wrong with the os-collect-config service file.18:47
jaosoriorbeekneemech: where can I check that?18:48
*** trown|lunch is now known as trown18:48
beekneemechjaosorior: I think service files are shipped as part of the package.18:49
jaosoriorbeekneemech: actually, we're updating cloud-init in these images18:49
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: Add composable deployment config files and mixed release  https://review.openstack.org/41083118:52
beekneemechjaosorior: You lost me.  What does that have to do with occ?18:52
jaosoriorbeekneemech: nothing, but it does depend on the multi-user.target/start18:53
beekneemechjaosorior: Oh, so maybe new cloud-init created a cycle?18:53
jaosoriorright18:54
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746818:55
*** gfidente is now known as gfidente|afk18:56
jaosoriorbeekneemech: these are the errors I see in the log http://paste.openstack.org/show/597607/18:56
*** sdake has joined #tripleo18:56
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: Ensure gate jobs verify sphinx output  https://review.openstack.org/42593618:58
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart-extras master: Fix overcloud-scale failure msg and regression  https://review.openstack.org/42535219:02
jaosoriorbeekneemech: hey dude, got a running system?19:03
*** pkovar has quit IRC19:04
beekneemechjaosorior: Several.19:05
jaosoriorbeekneemech: could you get the output of the cloud-* service files? I wanna compare it with this one http://paste.openstack.org/show/597609/ (that's the failing system)19:06
beekneemechjaosorior: http://paste.openstack.org/show/597610/19:08
*** flepied has quit IRC19:09
*** chlong has quit IRC19:11
jidaris there any way to do baremetal provision as part of a tripleO overcloud deployment? Like have all of the heat resources available to a template for a straight up baremetal node? I want to add some other services to my cloud as part of provision19:14
*** ansmith has quit IRC19:15
*** nrado has joined #tripleo19:16
*** jkilpatr_ has quit IRC19:18
*** jkilpatr has joined #tripleo19:20
EmilienMany review on https://review.openstack.org/#/q/topic:bug/1661360+status:open+owner:%22Emilien+Macchi+%253Cemilien%2540redhat.com%253E%22 would be welcome, thanks19:20
EmilienMowalsh: please ping me when you around, it seems like we have a nova/ironic problem with the tripleo common patch you did19:20
*** Vijayendra has quit IRC19:21
*** chlong has joined #tripleo19:21
*** pblaho has quit IRC19:23
*** milan has quit IRC19:23
EmilienMbeekneemech: do you mind looking https://review.openstack.org/#/c/428828/ please?19:24
*** chlong has quit IRC19:27
*** prateek_ has quit IRC19:33
*** prateek has quit IRC19:33
yolandahi weshay so we have everything in https://github.com/redhat-nfvpe19:34
yolandathere is ansible-cira, that is the playbook that orchestrates everything, and then jenkins-jobs and job-configs, with the jobs and settings we use19:34
yolandathe most relevant thing, is that we have OSP deploys relying on subscriptions, not on internal RedHat VPN19:35
weshayvery cool19:35
* weshay looking19:35
yolandathe OSP deploys are still a bit wip... i'm working on the repos and image local sync19:36
yolandaweshay, btw, i was hitting this error on a server today:  /sys/module/kvm_intel/parameters/nested: No such file or directory19:37
yolandado you know what can be going on?19:37
*** jcoufal_ has quit IRC19:37
*** jcoufal has joined #tripleo19:37
weshayyolanda, hrm.. haven't seen any errors like that, trown have you? ^19:38
*** b00tcat has joined #tripleo19:38
*** gbarros has quit IRC19:39
yolandai'm thinking in maybe virtualization not being enabled19:40
weshayyolanda, send us more details if you have them19:40
*** chlong has joined #tripleo19:40
yolandai cannot modprobe kvm or intel, says is not supported19:40
trownseem likely to be here https://github.com/openstack/tripleo-quickstart/blob/5d751760ab868a72b8efc27a62fd21b2612b6e01/roles/parts/kvm/tasks/main.yml#L3319:41
yolandai'm trying to reboot and see bios19:41
trownmaybe that should only run if the cpu has nested support19:42
openstackgerritMerged openstack/tripleo-quickstart-extras master: [overcloud-ssl] fix library to work with ocata  https://review.openstack.org/42872619:42
*** charliejllewelly has quit IRC19:43
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746819:44
openstackgerritDan Trainor proposed openstack/puppet-tripleo master: Proxy API endpoints that UI uses  https://review.openstack.org/42490919:45
*** Vijayendra has joined #tripleo19:47
yolandaweshay, trown , so i cannot find my server ipmi access, so hard to check... but modprobe is not working, that's what i can tell19:49
openstackgerritAlex Schultz proposed openstack/puppet-tripleo master: Revert "Revert "set innodb_file_per_table to ON for MySQL / Galera""  https://review.openstack.org/42884619:50
*** jcoufal has quit IRC19:53
*** jcoufal has joined #tripleo19:53
EmilienMbeekneemech: I see a lot of timeouts: http://logs.openstack.org/49/428349/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8dda071/console.html#_2017-02-03_19_32_27_13051219:54
*** iranzo has quit IRC20:00
*** gbarros has joined #tripleo20:00
beekneemechEmilienM: jaosorior was talking about an issue with os-collect-config earlier that might be related.20:01
*** gbarros has quit IRC20:02
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: docker: new hybrid deployment architecture and configuration  https://review.openstack.org/41642120:05
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add docker_puppet_tasks initialization on primary node  https://review.openstack.org/42656520:05
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Containerized Swift Services.  https://review.openstack.org/42543420:05
*** gbarros has joined #tripleo20:05
*** jcoufal has quit IRC20:06
*** jcoufal has joined #tripleo20:06
*** gbarros has quit IRC20:07
*** flepied has joined #tripleo20:08
EmilienMbeekneemech, jaosorior: have we some WIP? any bug reported?20:08
*** amoralej is now known as amoralej|off20:08
jaosoriorEmilienM, beekneemech what's up?20:10
EmilienMjaosorior: I see a lot of ovb jobs timing out20:11
jaosoriorEmilienM: on what step?20:11
jaosoriorEmilienM: was cloud-init updated?20:11
EmilienMjaosorior: http://logs.openstack.org/49/428349/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha/8dda071/console.html#_2017-02-03_19_32_27_13051220:11
*** sasha21 has joined #tripleo20:11
EmilienMmight need help on this one, I'm already debugging another nova issue, blocking our release20:11
sasha21Hi all, my undercloud deployment with quickstart fails with "Error: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]/returns: change from notrun to 0 failed: neutron-db-manage  upgrade heads returned 1 instead of one of"20:12
sasha21trown: ^ known issue?20:12
weshaysasha21, lot's talk about that issue on list https://trello.com/c/CcMIA0LB/54-cix-nova-rdophase2-uc-install-fails-during-nova-db-sync20:12
jaosoriorEmilienM: I'm not sure if it's related, here the node is actually created, but running any software config times out cause os-collect-config fails to start20:13
beekneemechjaosorior: That's pretty much exactly what I'm seeing the ci jobs.20:13
beekneemechThe node is deployed, but then the deployment times out without running anything further.20:13
jaosorioroh20:14
beekneemechLet me check the package version.20:14
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Enable docker services in the registry  https://review.openstack.org/42156720:14
*** gfidente|afk has quit IRC20:14
*** panda|bbl is now known as panda20:15
beekneemechcloud-init-0.7.5-10.el7.centos.1.x86_6420:15
*** Vijayendra has quit IRC20:15
beekneemechHmm, that matches a job that passed though.20:15
sasha21weshay: that's another issue20:17
sasha21weshay: I filed the bz for the one in trello card20:17
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add release notes for Ocata 2.0.0  https://review.openstack.org/42902620:17
sasha21weshay: the bz in the cards is for nova, while here it's neutron :)20:18
trownEmilienM: do you have the etherpad handy for ocata releasenote status tracking?20:18
trownfinally got to putting something up for quickstart20:19
EmilienMtrown: the only thing I have is https://docs.google.com/spreadsheets/d/1qsp528xrYtTt5s6kdHrLEhIqFekbV4IxAFkfjGozH74/edit#gid=020:19
trownEmilienM: awesome... that is why I couldnt find it :) it is not an etherpad20:19
*** Goneri has joined #tripleo20:20
*** jprovazn has quit IRC20:21
*** dsneddon is now known as dsneddon_afk20:21
trownEmilienM: should I mark tht as green? I followed https://review.openstack.org/#/c/424365/6 as an example, so seems like it is done20:21
sasha21trown: are we aware of this error "Error: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]/returns: change from notrun to 0 failed: neutron-db-manage  upgrade heads returned 1 instead of one of" upon deploying undercloud? not related to the one in trello card20:22
EmilienMtrown: is it merged?20:22
trownEmilienM: ya20:22
*** jcoufal_ has joined #tripleo20:22
EmilienMtrown: GREEN !20:23
*** jcoufal has quit IRC20:23
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780220:26
jaosoriorbeekneemech: Can you run this for getting the service files? so we get a similar output like in the original paste: tail -n +1 -- cloud-*20:26
*** rajinir has quit IRC20:26
trownsasha21: I have not seen that20:26
openstackgerritLars Kellogg-Stedman proposed openstack-infra/tripleo-ci master: allow centos-opstools repo to be enabled for multinode jobs  https://review.openstack.org/42780220:27
beekneemechjaosorior: http://paste.openstack.org/show/597621/20:29
sasha21trown: ack, https://bugs.launchpad.net/tripleo/+bug/166173620:31
openstackLaunchpad bug 1661736 in tripleo "Error: neutron-db-manage upgrade heads returned 1 instead of one of [0] during undercloud deployment" [Undecided,New]20:31
jaosoriorbeekneemech: so this is the difference with the cloud init version we tried it with https://www.diffchecker.com/eg4siAPT20:31
jaosoriorbeekneemech: red is the original20:31
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add release notes for Ocata 2.0.0  https://review.openstack.org/42902620:34
jaosoriorbeekneemech: oh, so cloud-init didn't change20:34
jaosoriorwell, crap20:34
jaosoriorbeekneemech: might this be an issue with os-collect-config then?20:35
*** spredzy has quit IRC20:35
beekneemechNo, doesn't look like that's the problem here.20:35
jaosoriorbeekneemech: can you pass me the logs of a job that failed?20:35
*** fzdarsky|afk has quit IRC20:35
*** b00tcat has quit IRC20:38
beekneemechjaosorior: http://logs.openstack.org/39/427339/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/94f4204/logs/20:38
*** gbarros has joined #tripleo20:38
jaosoriorbeekneemech: it's not the same issue. In this case os-collect-config did start20:39
*** agurenko has joined #tripleo20:39
beekneemechWTF?  That job had epel enabled.20:40
openstackgerritJohn Trowbridge proposed openstack/tripleo-quickstart master: Add release notes for Ocata 2.0.0  https://review.openstack.org/42902620:40
*** sasha21 has quit IRC20:40
*** karimb has quit IRC20:42
*** karimb has joined #tripleo20:43
*** spredzy has joined #tripleo20:43
*** agurenko has quit IRC20:47
*** karimb has quit IRC20:48
jaosoriorbeekneemech: so, what packages changed?20:49
beekneemechjaosorior: A lot.  It almost looks like we used a stable/mitaka image in a master job.20:50
beekneemechjaosorior: https://www.diffchecker.com/7ZPJ9jVo20:51
beekneemechThe openstack package versions are all way back.20:51
openstackgerritPetr Kovar proposed openstack/tripleo-docs master: Fix all sphinx errors & warnings  https://review.openstack.org/42903820:51
jaosoriorholy siht20:52
jaosorior*shit20:52
EmilienMwhat?20:52
beekneemechI don't understand.  The patch is clearly against master.20:53
jaosoriorbeekneemech: so the openstack packages seem to be older actually20:53
jaosoriorEmilienM: ^^20:53
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: nova/api: more cleanup  https://review.openstack.org/42903920:54
EmilienMmwhahaha, jaosorior ^ fyi20:54
EmilienMbeekneemech: everywhere or in one job?20:54
*** dsneddon has joined #tripleo20:55
beekneemechEmilienM: All of the timeout jobs I've looked at.20:55
EmilienMI checked multinode jobs and they are fine (I know they are not image based but at least something that works)20:55
EmilienMovh-ha undercloud has ocata packages20:55
EmilienMovercloud too20:56
beekneemechOkay, it's only jobs using the cached image: https://review.openstack.org/#/c/428821/120:56
EmilienMbeekneemech: in the link you gave, openstack-nova-api-15.0.0-0.20170203000238.f9d7b38.el7.centos.noarch20:56
EmilienMit's ocata20:56
EmilienMon the undercloud20:56
beekneemechThe two where we rebuilt images passed, the one that uses cached images failed with a timeout.20:57
EmilienMopenstack-nova-api-13.1.3-0.20170103124634.d726e0d.el7.centos.noarch20:57
EmilienMdamn you're right20:57
beekneemechI'm wondering if the image I copied into the mirror server this morning was bad, but I can't imagine why we would have had any image that old there.20:59
EmilienM(I have no idea tbh)20:59
beekneemechOr the last promotion job uploaded a bad image somehow.20:59
beekneemechHmm, that could be it.  The first instance of this failure that I can find is about 2.5 hours after I fiddled with the mirror server.21:01
beekneemechHuh? http://paste.openstack.org/show/597626/21:04
beekneemechWhat promotion job would have run a combination of mitaka and ocata jobs?21:04
beekneemechThat's the problem though.  This is the image I copied over this morning.21:04
beekneemechIt should be fixed now.  We had a promotion since then and that one appears to be right.21:05
*** sdake has quit IRC21:06
EmilienMbeekneemech: sorry for the question, but what did you do on the mirror server this morning?21:10
beekneemechEmilienM: I copied a previously cached overcloud-full image into the current-tripleo directory because the server's disk had filled up so we lost the one from the last promotion.21:11
*** eck` is now known as jeckersb_gone21:11
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Deploy the undercloud with Heat  https://review.openstack.org/35135121:12
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Add heat_launcher module to help launch heat-all  https://review.openstack.org/42753021:12
openstackgerritDan Prince proposed openstack/python-tripleoclient master: Add fake_keystone class  https://review.openstack.org/42753121:12
beekneemechApparently we had run a promotion job that wasn't against master though, and that was the most recent image I found.21:12
EmilienMbeekneemech: I see21:14
EmilienMbeekneemech: do we have rotations?21:14
EmilienMto cleanup automatically21:14
bkeroEmilienM: If you have some time, I'm encountering this error in the scenario multinode-oooq jobs, and I'm not sure why. http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/postci.txt.gz#_2017-02-03_20_34_10_00021:16
jaosoriorbkero: ceph::profile::params::client_keys in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/nova/compute/libvirt.pp:36:2221:19
jaosorior:/21:19
EmilienMError: Evaluation Error: Error while evaluating a Function Call, Could not find data item ceph::profile::params::client_keys in any Hiera data file and no default supplied at /etc/puppet/modules/tripleo/manifests/profile/base/nova/compute/libvirt.pp:36:22 on node centos-7-2-node-osic-cloud1-disk-7108731-411498[0m21:20
EmilienM2017-02-03 20:34:10.000 | +(./..//tripleo-ci/scripts/common_functions.sh:189): postci(): eval sudo journalctl --ou21:20
jaosoriorbkero: so one of this $rbd_ephemeral_storage or $rbd_persistent_storage is evaluating to true, and in that case, you need that hiera key to be avialable21:21
bkeroI wonder why that is the case, I'm not touching puppet params at all21:21
jaosoriorbkero: what's the change?21:21
*** jayg is now known as jayg|g0n321:21
jaosoriorbkero: and is the deployment supposed deploy rbd persistent storage?21:21
bkerojaosorior: just adding -e scenario001-multinode.yml to the tripleo-quickstart multinode job. https://review.openstack.org/#/c/427468/21:22
bkeroEmilienM: Yeah, I saw the error before. I'm just having a hard time figuring out why it popped up when I started testing scenario001, and why I can't replicate with tripleo-quickstart outside a multinode environment.21:23
beekneemechEmilienM: Not that I know of, and at this point I'm kind of afraid to try to write one since I clearly don't understand all the ways this server is being used.21:23
*** rwsu has joined #tripleo21:23
EmilienMbeekneemech: can I have a review on https://review.openstack.org/#/c/428778/2 please21:23
EmilienMI want to land it over the week end21:23
bkeroLine 77 of scenario001-multinode.yaml contains   CephClientKey: 'AQC+vYNXgDAgAhAAc8UoYt+OTz5uhV7ItLdwUw=='21:23
EmilienMI figured it will help us to promote nova in our CI21:24
bkerojaosorior: Should that ^ end up in hiera for use with the modules?21:24
EmilienMbeekneemech: same for https://review.openstack.org/#/c/428785/21:24
jaosoriorbkero: right, but does that end up in the hiera key?21:24
jaosoriorbkero: no idea, I haven't touched the ceph bits :/21:24
bkeroNeither have I21:24
jaosoriorbkero: can you check the resulting hiera?21:25
bkerojaosorior: Do you know that's stored in job logs somewhere?21:25
jaosoriorbkero: /etc/puppet/hieradata/service_config.yaml21:25
bkerohttp://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/etc/puppet/hieradata/21:26
jaosoriorbkero: that's the undercloud21:26
bkerohttp://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/oooq/collected_logs/subnode-1/etc/puppet/hieradata/service_configs.json.txt.gz21:26
bkeroI don't actually see a ceph:: section in there21:27
jaosoriorbkero: so, seems that ceph isn't being deployed21:27
jaosoriorand that's the issue21:27
bkeroYou mean that the ceph config bits in the heat templates aren't getting entered into the heira data?21:28
*** gbarros has quit IRC21:28
jaosoriorbkero: this is what's being deployed http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/oooq/collected_logs/subnode-1/etc/puppet/hieradata/service_names.json.txt.gz21:28
*** gbarros has joined #tripleo21:28
jaosoriorbkero: nothing ceph-related seems to be deployed21:28
jaosoriorbkero: I think that job is not using the needed environment that sets the services to be deployed, and it goes for the defaults21:29
jaosoriornot sure21:29
bkeroOS::TripleO::Services::CephClient is in the heat template21:29
jaosoriorbkero: where is it?21:30
jaosoriorbkero: and are you sure that's being taken into account?21:30
jaosoriorthe list sure doesn't show it21:30
bkerojaosorior: This is a passing job using the same heat template: http://logs.openstack.org/48/411048/25/check/gate-tripleo-ci-centos-7-scenario001-multinode/f0e8afb/console.html#_2017-02-03_19_19_53_58274221:30
bkerojaosorior: and here is the overcloud deploy of the failing job: http://logs.openstack.org/68/427468/8/experimental/gate-tripleo-ci-centos-7-scenario001-multinode-oooq-nv/13eee6a/logs/oooq/collected_logs/undercloud/home/jenkins/overcloud-deploy.sh21:30
jaosoriorbkero: they are using different environments21:32
jaosoriorthe passing one is using /usr/share/openstack-tripleo-heat-templates/ci/environments/scenario001-multinode.yaml21:32
jaosoriorthe failing one is using this one /usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml21:32
bkerojaosorior: Oh I see. The non-scenario template isn't used in scenario tests.21:33
jaosoriorbkero: yep, and that's the issue21:33
*** spredzy has quit IRC21:33
jaosoriorbkero: oh crap21:34
jaosoriornevermind21:34
openstackgerritBen Kero proposed openstack-infra/tripleo-ci master: WIP: Add scenario testing for multinode-oooq jobs  https://review.openstack.org/42746821:34
bkero?21:34
jaosoriorbkero: I misread21:34
jaosoriorboth are using the scenario001 template21:34
jaosoriorI mean21:34
jaosoriorenvironment21:34
jaosoriordamn21:34
jaosoriornow I'm puzzled21:34
bkeroThe working job sitll doesn't include /usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml21:35
jaosoriortrue that21:35
bkeroand the ordering is different21:35
bkeroThat could affect things with overrides I imagine21:35
jaosoriorbkero: well, ideally stuff shouldn't be overlapping21:36
*** liverpooler has quit IRC21:36
bkeroThat would be ideal21:36
*** spredzy has joined #tripleo21:37
openstackgerritMerged openstack/tripleo-heat-templates master: Configure VNC Server listen address through t-h-t  https://review.openstack.org/42790821:40
*** bfournie has quit IRC21:41
openstackgerritZane Bitter proposed openstack/tripleo-heat-templates master: Use an OS::Heat::Value resource inside EndpointMap  https://review.openstack.org/42791521:41
openstackgerritZane Bitter proposed openstack/tripleo-heat-templates master: Don't recalculate EndpointMap to get outputs  https://review.openstack.org/42783621:41
openstackgerritMerged openstack/tripleo-heat-templates master: Simplify/fix config enabled conditions for upgrades  https://review.openstack.org/42830921:41
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: net-config-multinode: make controlplane int idempotent  https://review.openstack.org/42882821:42
openstackgerritMerged openstack/tripleo-heat-templates master: Reduce number of steps for upgrades  https://review.openstack.org/42831021:42
openstackgerritMerged openstack/tripleo-heat-templates master: Disable batch upgrade deployments for disabled roles  https://review.openstack.org/42834821:42
*** chlong has quit IRC21:44
openstackgerritMatt Young proposed openstack/tripleo-quickstart-extras master: virthost-full-cleanup: Fix typo in README.md  https://review.openstack.org/42905521:44
owalshEmilienM: hey, what's up21:45
EmilienMowalsh: brb 1 min21:45
*** ebarrera has joined #tripleo21:50
*** ebarrera has quit IRC21:50
EmilienMbeekneemech: I'm cleaning up in https://review.openstack.org/#/c/429039/121:51
openstackgerritMerged openstack/tripleo-docs master: Fix a TBD, broken links and markup  https://review.openstack.org/42833321:52
*** jcoufal has joined #tripleo21:53
beekneemechEmilienM: Ack, thanks.  Didn't see that.21:53
* beekneemech wants it to be the weekend already21:53
EmilienMbeekneemech: ahah me too21:53
EmilienMbeekneemech: and not think about nova21:54
EmilienMoops osrry21:54
openstackgerritEmilien Macchi proposed openstack/puppet-tripleo master: nova/api: more cleanup  https://review.openstack.org/42903921:54
*** jcoufal_ has quit IRC21:54
EmilienMowalsh: ok back21:55
EmilienMowalsh: so we decided to revert the change in tripleo that switched nova to be deployed in WSGI with Apache21:55
EmilienMowalsh: because Nova team doesn't support it21:56
EmilienMthey say it's experimental21:56
owalshEmilienM: yea...21:56
EmilienMI've been testing tripleo without nova/wsgi + nova from trunk (like master) and it pass on multinode job: https://review.openstack.org/#/c/429008/21:56
EmilienMit's waiting for OVB job now21:56
EmilienMbut I saw some ironic failures this morning21:56
EmilienMlet me find logs21:56
EmilienMowalsh: and nova team thought it could be related to the patch in tripleo-common21:57
*** rlandy has quit IRC21:57
owalshEmilienM: err, really? how?21:58
EmilienMowalsh: http://logs.openstack.org/15/428415/1/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/92a342e/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-02-03_01_06_01_04921:58
EmilienMsee Total disk: 40 GB, used: 0.00 GB21:59
EmilienMand then Total disk: 40 GB, used: 40.00 GB21:59
EmilienMon http://logs.openstack.org/15/428415/1/experimental-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/92a342e/logs/undercloud/var/log/nova/nova-compute.txt.gz#_2017-02-03_01_06_02_01621:59
EmilienMI don't know if it has a relation with cells thing21:59
EmilienMbut they think it's tripleo related21:59
EmilienMI might be wrong21:59
owalshStill don't see the connection to running host discovery...22:01
EmilienMowalsh: I'm watching 429008 in zuul22:01
EmilienMowalsh: if OVB pass on it we can dance22:01
EmilienMit means that disabling Nova WSGI fixed out issues with nova trunk22:02
EmilienMowalsh: FYI right now we pin nova-ocata-322:02
owalshEmilienM: ok... in my change mistral is polling nova until the ironic nodes are in the resource tracker22:05
owalshEmilienM: but it's happening just after the state change to available...22:05
*** jcoufal has quit IRC22:06
EmilienMoh wait22:07
EmilienMsee https://bugs.launchpad.net/nova/+bug/134142022:07
openstackLaunchpad bug 1341420 in OpenStack Compute (nova) "gap between scheduler selection and claim causes spurious failures when the instance is the last one to fit" [Wishlist,New] - Assigned to Yingxin (cyx1231st)22:07
EmilienMsounds like ironic gate has similar thing22:07
EmilienMmaybe it's something else, dunno22:08
EmilienMbeekneemech: can we close https://bugs.launchpad.net/tripleo/+bug/1661656 ?22:08
openstackLaunchpad bug 1661656 in tripleo "CI: promoted overcloud-full image is missing from the mirror" [Critical,Triaged]22:08
openstackgerritEmilien Macchi proposed openstack-infra/tripleo-ci master: toci_gate_test: allow to run upgrade jobs for scenarios  https://review.openstack.org/42637022:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Switch to net-config-multinode  https://review.openstack.org/42637222:09
*** jcoufal has joined #tripleo22:10
slagledtrainor: EmilienM : i've not seen any FFE request for https://blueprints.launchpad.net/tripleo/+spec/proxy-undercloud-api-services22:11
slagledid it happen?22:11
slaglewas about to approve https://review.openstack.org/#/c/424903/22:11
slaglebut didn't want to get my hand slapped :)22:12
EmilienMslagle: I've granted it to dtrainor after a chat on IRC22:13
EmilienMI should have formalized it on openstack-dev, my fault22:13
EmilienMslagle: good question for tabs lol22:14
slaglei checked stackoverflow about puppet style22:14
slaglei dunno, they told me to get lost22:14
*** karimb has joined #tripleo22:14
EmilienMlol22:14
EmilienMdtrainor: there is a whitespace on https://review.openstack.org/#/c/424903/7/releasenotes/notes/add-additional-endpoints-96cb28a13c79e9d9.yaml22:14
EmilienMbut I won't block it, approved22:15
*** karimb has quit IRC22:17
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: Add optional Sphinx build verification  https://review.openstack.org/42586822:23
*** dprince has quit IRC22:24
*** trown is now known as trown|outtypewww22:25
EmilienMI'm off22:26
*** nrado has left #tripleo22:26
bkeroo/22:27
jaosoriorhave a good one22:27
owalshEmilienM: have a good weekend22:28
*** gbarros has quit IRC22:30
*** sdake has joined #tripleo22:31
*** sdake has quit IRC22:32
*** morazi has quit IRC22:33
*** sdake has joined #tripleo22:33
*** gbarros has joined #tripleo22:35
*** gbarros has quit IRC22:37
*** jcoufal has quit IRC22:39
*** owalsh is now known as owalsh-afk22:40
*** jcoufal has joined #tripleo22:40
*** flepied has quit IRC22:40
*** chlong has joined #tripleo22:42
*** cdearborn has quit IRC22:48
*** jcoufal has quit IRC22:50
*** jcoufal has joined #tripleo22:51
*** jkilpatr has quit IRC22:51
*** karimb has joined #tripleo22:52
*** jaosorior has quit IRC22:52
openstackgerritZane Bitter proposed openstack/tripleo-heat-templates master: Use an OS::Heat::Value resource inside EndpointMap  https://review.openstack.org/42791522:52
openstackgerritZane Bitter proposed openstack/tripleo-heat-templates master: Don't recalculate EndpointMap to get outputs  https://review.openstack.org/42783622:52
openstackgerritMerged openstack/instack-undercloud master: Stop setting deprecated enable_setting_ipmi_credentials option  https://review.openstack.org/42720222:55
*** nrado has joined #tripleo22:57
*** nrado has left #tripleo22:59
*** jcoufal has quit IRC23:06
*** dsneddon has quit IRC23:07
dtrainorEmilienM++ slagle++ thanks :)23:07
dtrainori23:08
dtrainori'll make a note to get that whitespace23:08
dtrainorslagle, re: tabs i couldn't find an answer either23:09
dtrainorpuppet doesn't provide the tests, it's not a puppet manifest, so i'm not sure23:09
*** jcoufal has joined #tripleo23:09
dtrainorwell no that's kind of a lie - i meant to say, i couldn't find anything on puppet tests that's critical either way of spaces23:10
*** sdake has quit IRC23:11
*** dsneddon has joined #tripleo23:14
*** jmelvin has quit IRC23:17
jidarlint is typically how you'd find white space23:17
jidarI believe anyhow23:17
openstackgerritMerged openstack/instack-undercloud master: Add additional proxy and config endpoints for UI  https://review.openstack.org/42490323:17
*** panda is now known as panda|Zz23:18
*** pmannidi has joined #tripleo23:20
*** jcoufal has quit IRC23:21
*** jcoufal has joined #tripleo23:21
*** jkilpatr has joined #tripleo23:25
*** pmannidi has quit IRC23:26
mwhahahagenerally no tabs.  techincally it's not a lint issue, just a best practice23:27
dtrainorme too, but i saw no errors23:27
dtrainorright, i don't disagree23:27
*** pmannidi has joined #tripleo23:29
*** gbarros has joined #tripleo23:30
*** pradk has quit IRC23:30
*** kbyrne has quit IRC23:32
jidar> puppet-lint --no-trailing_whitespace-check path/to/file.pp23:33
*** kbyrne has joined #tripleo23:34
*** saneax-_-|AFK is now known as saneax23:35
*** dbecker has quit IRC23:36
*** dsariel has quit IRC23:38
dtrainorthx23:39
dtrainori pulled the change down.  vim doesn't see it, and even deleting all the whitespace in that line and replacing it with spaces, git doesn't see a change in the file23:41
*** akrivoka has quit IRC23:43
*** gbarros has quit IRC23:44
*** karimb has quit IRC23:45
*** rbrady has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!