Tuesday, 2018-05-15

*** nyechiel has quit IRC00:09
EmilienMstevebaker: hey oh hi!00:12
EmilienMstevebaker: https://review.openstack.org/#/c/568375/1 approved - but where do we deploy the rpm now?00:12
stevebakerEmilienM: helooo00:12
EmilienMsecond question: https://review.openstack.org/#/c/566769/2/puppet/services/mistral-base.yaml00:14
stevebakerEmilienM: for local dev which requires full kolla builds, just install openstack-kolla. For build pipelines they will need to install openstack-kolla in their provision script. But is there anywhere which installs a full undercloud so they can build images?00:15
EmilienMstevebaker: not that I'm aware of00:15
EmilienMstevebaker: I think your patch is good and we shouldn't deploy the rpm by default00:16
stevebakerEmilienM: https://review.openstack.org/#/c/566769/200:17
EmilienMstevebaker: the namespace is wrong00:20
EmilienMyou used mistral::executor::docker_group00:20
EmilienMit should be tripleo::profile::base::mistral::executor::docker_group00:20
openstackgerritMerged openstack/ansible-role-container-registry master: Don't install kolla  https://review.openstack.org/56837500:21
stevebakerEmilienM: ok, I'll fix it up. thank00:21
stevebakers00:21
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Expose parameter MistralDockerGroup  https://review.openstack.org/56676900:22
EmilienMstevebaker: ^00:22
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Expose parameter MistralDockerGroup  https://review.openstack.org/56676900:22
EmilienMstevebaker: we *could* handle the kolla rpm in the THT service00:24
EmilienMstevebaker: like in the docker-registry service, with a parameter, and use deploy_step_tasks to deploy the rpm00:24
*** bfournie has quit IRC00:25
*** bfournie has joined #tripleo00:26
*** artom has quit IRC00:27
stevebakerEmilienM: there is a good argument for not though, we want to encourage folk consuming tested RDO images00:27
EmilienMstevebaker: fine by me00:29
weshaymwhahaha, ya.. we got 99 problems https://bugs.launchpad.net/tripleo/+bug/177123300:29
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]00:29
EmilienMstevebaker: in that case I would remove enable_container_images_build in tripleoclient ok?00:29
EmilienMsince we're switching to ansible and stop using puppet-tripleo for deploying docker00:29
*** bfournie has quit IRC00:30
EmilienMstevebaker: https://git.openstack.org/cgit/openstack/python-tripleoclient/tree/tripleoclient/config/undercloud.py#n245 becomes useless, right?00:31
stevebakerEmilienM: way ahead of you, and it turns out it was never wired in to do anything! https://review.openstack.org/#/c/568384/00:31
EmilienMthe parameter is even not used00:31
EmilienMyeah00:31
EmilienMstevebaker: lol ahead of me00:31
mwhahahaweshay: meh00:31
EmilienMstevebaker: -1 is ahead of you :P00:32
stevebakerEmilienM: also I change the default for this https://review.openstack.org/#/c/568376/00:32
EmilienMstevebaker: +200:32
EmilienMstevebaker: nice progress on the image prepare stuff :)00:32
*** weshay changes topic to "Welcome to Rocky. CI status: YELLOW (OVB failing) | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest"00:33
EmilienMstevebaker: are we moving https://github.com/steveb/ansible-role-tripleo-modify-image to OpenStack ?00:33
stevebakerEmilienM: yes, just need to take the first step. I think it is ready00:36
*** slaweq has quit IRC00:46
*** bfournie has joined #tripleo00:47
*** psahoo has joined #tripleo00:53
*** slaweq has joined #tripleo00:53
*** threestrands has quit IRC01:00
*** ramishra has joined #tripleo01:01
*** dmacpher has quit IRC01:06
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123301:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]01:10
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once  https://review.openstack.org/52862101:25
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Move BUILD_ID setting logic out of template  https://review.openstack.org/56839601:25
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Use "openstack tripleo container image prepare"  https://review.openstack.org/56840301:25
*** ramishra has quit IRC01:25
openstackgerritMerged openstack/tripleo-common master: Use Designate Worker container for config  https://review.openstack.org/56404901:27
*** ramishra has joined #tripleo01:27
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Use "openstack tripleo container image prepare"  https://review.openstack.org/56840301:31
openstackgerritShuo Liu proposed openstack/tripleo-heat-templates master: fix spelling misktake  https://review.openstack.org/56840501:39
EmilienMstevebaker: ok, let me know if you need any help01:56
stevebakerEmilienM: ok thanks01:57
*** ramishra has quit IRC02:05
*** ramishra has joined #tripleo02:09
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123302:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]02:10
*** ooolpbot has quit IRC02:10
*** abishop has quit IRC02:12
*** tzumainn has quit IRC02:16
*** ramishra has quit IRC02:17
*** ramishra has joined #tripleo02:18
*** adrianreza has joined #tripleo02:21
*** ramishra has quit IRC02:26
*** dciabrin has quit IRC02:30
*** dciabrin has joined #tripleo02:30
*** bfournie has quit IRC02:33
*** bfournie has joined #tripleo02:34
*** bfournie has quit IRC02:38
*** rcernin has quit IRC02:46
*** dbecker has quit IRC02:47
*** rcernin has joined #tripleo02:50
*** dougbtv_ has quit IRC02:56
*** anilvenkata has quit IRC02:58
*** dbecker has joined #tripleo02:59
*** itlinux has joined #tripleo03:03
*** psachin has joined #tripleo03:03
*** ramishra has joined #tripleo03:03
*** itlinux has quit IRC03:03
*** fragatina has quit IRC03:06
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123303:10
*** ooolpbot has quit IRC03:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]03:10
*** udesale has joined #tripleo03:10
openstackgerritMerged openstack/tripleo-heat-templates master: Enable default polling interval override  https://review.openstack.org/56824103:13
*** ramishra has quit IRC03:18
*** udesale has quit IRC03:19
*** dmacpher has joined #tripleo03:26
openstackgerritMerged openstack/python-tripleoclient master: Include docker and undercloud environments first  https://review.openstack.org/56705303:30
openstackgerritMerged openstack/puppet-tripleo master: Add s3api support  https://review.openstack.org/49856403:30
openstackgerritMerged openstack/puppet-tripleo master: Trivial: fix a comment typo  https://review.openstack.org/56078203:30
*** udesale has joined #tripleo03:31
*** ramishra has joined #tripleo03:32
*** links has joined #tripleo03:37
*** pdeore has joined #tripleo03:52
*** gyankum has joined #tripleo03:59
Tenguhello there04:05
*** fragatina has joined #tripleo04:05
*** fragatina has quit IRC04:06
*** fragatina has joined #tripleo04:06
*** fragatin_ has joined #tripleo04:07
jillrmorning Tengu04:09
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123304:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]04:10
Tengujillr: good evening :)04:10
Tenguor afternoon?04:10
*** fragatina has quit IRC04:10
jillrevening indeed  :)04:11
*** fragatin_ has quit IRC04:13
*** janki has joined #tripleo04:16
*** cshastri has joined #tripleo04:16
*** udesale has quit IRC04:28
*** anilvenkata has joined #tripleo04:29
*** pcaruana has joined #tripleo04:31
*** linhnm has joined #tripleo04:38
*** udesale has joined #tripleo04:39
jaosoriorgood morning folks!04:40
jaosoriorTengu: dammit! I thought I was logging in early04:40
Tengu:)04:40
Tengujaosorior: I still wake up at 5:30 - but now I just need a shower, and starting up the laptop :)04:41
*** fragatina has joined #tripleo04:41
jaosoriorEmilienM, bandini: If you're around, I need a review here https://review.openstack.org/#/c/554926/04:41
jaosoriorwow04:41
jaosoriorTengu: I wake up at 6:30, then coffee :P04:42
jaosoriorpriorities04:42
Tengujaosorior: uhu04:42
linhnm11:45pm in Vietnam04:43
linhnm11:45am :D04:43
jaosoriorlinhnm: that's not too bad :D04:44
jaosoriorit's 7:44 here in Helsinki04:44
linhnmanyone use diskimage-builder to create CentOS 604:45
jaosoriorlinhnm: I don't think so. At least not that I know of.04:45
EmilienMjaosorior: looking04:47
*** udesale has quit IRC04:49
*** udesale has joined #tripleo04:50
jaosoriorEmilienM: thanks04:51
EmilienMjaosorior: anytime04:52
EmilienMjaosorior: not sure why update jobs fail04:55
EmilienMjaosorior: consistently04:56
EmilienMhttp://logs.openstack.org/40/568340/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/65fa484/logs/undercloud/home/zuul/overcloud_update_run_Controllertripleorolename.log.txt.gz04:56
EmilienMI think I know why04:57
EmilienMthe log file name is wrong I wonder why (looking at it now)04:57
jaosoriorwhaa04:58
jaosoriorControllertripleorolename04:58
*** fragatina has quit IRC04:58
EmilienMhttps://git.openstack.org/cgit/openstack/tripleo-upgrade/tree/tasks/update/overcloud_update_run.yml#n704:59
jaosoriorI don't see the issue there :/05:00
jaosorioroc_roles05:01
jaosoriorlets see where that comes from05:01
EmilienMhttps://git.openstack.org/cgit/openstack/tripleo-upgrade/tree/tasks/update/create-update-scripts.yaml#n4305:02
EmilienMpfiou05:02
EmilienMthat's... improvable :D05:03
jaosoriorEmilienM: cmoes from this     tripleo-ansible-inventory --plan {{ overcloud_stack_name }} {% if overcloud_ssh_user != '' %} --ansible_ssh_user {{ overcloud_ssh_user }} {% endif %} --static-yaml-inventory /tmp/fake-oc-hosts.yaml ;05:03
jaosorior    awk -F':' '/role_name/ {gsub("[[:space:][:punct:]]", "", $2); print $2}' /tmp/fake-oc-hosts.yaml05:03
jaosorioroh05:03
jaosoriorlol05:03
jaosorioryou got it too05:03
jaosoriorEmilienM: interesting that tripleo-upgrades doesn't use the dynamic inventory from the start05:04
*** linhnm has quit IRC05:04
*** marios has joined #tripleo05:08
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: Use tripleo_role_name instead of role_name  https://review.openstack.org/56844305:08
jaosoriorEmilienM: seems to me that the patch won't work05:09
jaosoriorsince at that point we don't have tripleo_role_name yet05:09
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory  https://review.openstack.org/56834005:09
*** fragatina has joined #tripleo05:09
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory  https://review.openstack.org/56834005:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps: switch to tripleo_role_name  https://review.openstack.org/56834305:09
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: (cleanup) remove usage of role_name  https://review.openstack.org/56834705:09
*** ooolpbot has joined #tripleo05:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123305:10
*** ooolpbot has quit IRC05:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]05:10
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Docker via Ansible and not Puppet  https://review.openstack.org/56137705:10
EmilienMjaosorior: https://review.openstack.org/568443 that should do it05:10
EmilienMbut in long term we really need to clean that code05:10
*** saneax-_-|AFK is now known as saneax05:10
*** ykarel has joined #tripleo05:10
EmilienMjaosorior: also https://review.openstack.org/56834005:11
EmilienMthey need to land together05:11
* EmilienM out05:13
EmilienMjaosorior: thx05:14
*** agurenko has joined #tripleo05:19
*** fragatina has quit IRC05:20
*** fragatina has joined #tripleo05:26
*** linhnm has joined #tripleo05:26
*** yprokule has joined #tripleo05:26
*** zshi has quit IRC05:27
*** zshi has joined #tripleo05:27
*** agurenko has quit IRC05:30
*** fragatina has quit IRC05:31
openstackgerritSaravanan KR proposed openstack/tripleo-heat-templates master: NFV: Support for config-download to deploy node with kernel args  https://review.openstack.org/56076705:31
*** agurenko has joined #tripleo05:32
*** pgadiya has joined #tripleo05:34
*** paramite has joined #tripleo05:35
*** paramite has quit IRC05:35
*** udesale_ has joined #tripleo05:36
*** udesale has quit IRC05:39
*** udesale_ has quit IRC05:40
*** udesale has joined #tripleo05:40
*** elgxl has quit IRC05:41
*** elgxl has joined #tripleo05:41
*** linhnm has quit IRC05:56
*** fragatina has joined #tripleo05:58
*** jbadiapa has quit IRC06:00
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123306:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]06:10
*** ooolpbot has quit IRC06:10
*** radeks has joined #tripleo06:12
*** radeks_ has joined #tripleo06:20
*** radeks has quit IRC06:20
*** radeks has joined #tripleo06:21
*** linhnm has joined #tripleo06:22
ykarelchandankumar, u were correct ^^06:22
ykarelreported 5hours back06:23
*** radeks__ has joined #tripleo06:34
*** masco has joined #tripleo06:36
*** radeks has quit IRC06:37
*** udesale has quit IRC06:38
*** bogdando has joined #tripleo06:40
*** udesale has joined #tripleo06:40
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: [WIP] Fix validation for A/P services  https://review.openstack.org/56830106:49
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Pass overcloud stack name to upgrade run.  https://review.openstack.org/56846806:51
*** ubijtsa has joined #tripleo06:54
*** ubijtsa is now known as assassin06:54
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade master: Call L3 checks before/after Role upgrade.  https://review.openstack.org/56624906:58
*** brault has quit IRC07:01
*** mburned is now known as mburned_out07:02
*** fragatina has quit IRC07:03
*** brault has joined #tripleo07:06
*** sshnaidm has joined #tripleo07:09
*** ffiore has joined #tripleo07:09
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177123307:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1771233 in tripleo "te-broker errors in tripleo 3rd party jobs" [Critical,Triaged]07:10
*** rcernin has quit IRC07:13
*** tesseract has joined #tripleo07:13
*** wolverineav has joined #tripleo07:14
*** pcaruana has quit IRC07:17
*** pcaruana has joined #tripleo07:17
*** paramite has joined #tripleo07:18
*** pcaruana has quit IRC07:18
openstackgerritMarios Andreou proposed openstack/tripleo-common stable/queens: Add special 'all' for deploy_on_servers server name to match all  https://review.openstack.org/56753807:18
openstackgerritChandan Kumar proposed openstack/tripleo-heat-templates master: Enable logging for tempest container  https://review.openstack.org/56636407:18
*** florianf has joined #tripleo07:18
*** afazekas|pto is now known as afazekas07:18
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart-extras master: Enable tempest.log in /var/log/tempest for container  https://review.openstack.org/56652607:19
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true  https://review.openstack.org/56633207:19
openstackgerritChandan Kumar proposed openstack/tripleo-quickstart master: Enable undercloud_enable_tempest to true  https://review.openstack.org/56633207:19
*** holser__ has joined #tripleo07:20
chandankumarsshnaidm: Hello07:20
chandankumarsshnaidm: please have a look at this https://review.openstack.org/#/c/566686/07:21
*** sshnaidm is now known as sshnaidm|rover07:21
*** pmannidi has quit IRC07:22
sshnaidm|roverchandankumar, +w07:23
*** pcaruana has joined #tripleo07:23
chandankumarsshnaidm|rover: thanks :-)07:23
*** skramaja has joined #tripleo07:23
*** kopecmartin has joined #tripleo07:24
*** lvdombrkr has joined #tripleo07:27
*** aufi has joined #tripleo07:29
*** akrivoka has joined #tripleo07:32
*** linhnm has quit IRC07:36
*** cylopez has joined #tripleo07:37
*** ramishra has quit IRC07:39
*** ramishra has joined #tripleo07:40
bogdandoo/ PTAL https://review.openstack.org/#/c/565233/07:42
bogdandojaosorior: ^^ please07:42
openstackgerritMartin André proposed openstack/tripleo-common master: Stop assuming all containers are plans  https://review.openstack.org/56634507:43
bogdandoone more https://review.openstack.org/#/c/566333/07:43
*** dmacpher has quit IRC07:43
*** tosky has joined #tripleo07:49
dciabrinjaosorior, hey o/07:56
*** olap has joined #tripleo07:58
openstackgerritRedHat RDO CI proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/56044508:00
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Add ability to pre-assign IPs by role on ctlplane  https://review.openstack.org/56850508:03
*** lucas-afk is now known as lucasagomes08:04
*** dbecker has quit IRC08:05
*** dbecker has joined #tripleo08:05
openstackgerritMartin André proposed openstack/tripleo-common stable/queens: Run yum clean to reduce size of docker image layer  https://review.openstack.org/56850808:06
openstackgerritMartin André proposed openstack/tripleo-common stable/pike: Run yum clean to reduce size of docker image layer  https://review.openstack.org/56851008:07
openstackgerritMichael Chapman proposed openstack/tripleo-quickstart-extras master: Add opendaylight to collect-logs  https://review.openstack.org/49404308:09
*** shardy has joined #tripleo08:09
*** pdeore has quit IRC08:10
*** gfidente has joined #tripleo08:10
*** gfidente has quit IRC08:10
*** gfidente has joined #tripleo08:10
*** nyechiel has joined #tripleo08:12
*** mdnadeem has joined #tripleo08:12
*** holser__ has quit IRC08:13
*** athomas has joined #tripleo08:13
*** holser__ has joined #tripleo08:13
*** psachin has quit IRC08:14
*** ykarel is now known as ykarel|lunch08:15
*** dhill_ has quit IRC08:15
openstackgerritDmitry Tantsur proposed openstack/tripleo-common master: Convert classic drivers to hardware types on enrollment  https://review.openstack.org/56790008:15
*** mdnadeem has quit IRC08:16
*** salmankhan has joined #tripleo08:23
*** nyechiel_ has joined #tripleo08:23
*** nyechiel has quit IRC08:23
akrivokahey d0ugal do you think we could merge this? https://review.openstack.org/#/c/393775/08:25
d0ugalakrivoka: I think so, but I forget what the rules are for merging specs...08:25
bogdandofolks, PTAL https://review.openstack.org/#/c/566333/ and https://review.openstack.org/#/c/565233/08:26
akrivokaoh I didn't know they were different than for normal patches08:26
d0ugalakrivoka: could check in the meeting today08:28
akrivokad0ugal: there's this https://specs.openstack.org/openstack/tripleo-specs/specs/policy/spec-review.html08:28
d0ugalakrivoka: but I believe you can start working on it anyway, there is enough agreement for that.08:28
d0ugalakrivoka: yeah, I looked at that too. I don't see anything specific to specs there (I think there should be)08:28
d0ugaloh08:28
d0ugalsorry, I can't realy08:28
*** mdnadeem has joined #tripleo08:28
d0ugalread08:28
d0ugal(I may be juggling a baby)08:28
akrivoka:)08:29
akrivokathat's a really good excuse :)08:29
*** psachin has joined #tripleo08:29
*** pdeore has joined #tripleo08:30
d0ugalakrivoka: so it seems there isn't a hard rule, but maybe worth getting somebody else to review? maybe shardy since he looked at it previously08:31
d0ugalReally not sure. Or we could check in the meeting today08:31
akrivokad0ugal: sure08:31
akrivokad0ugal: sounds good08:31
akrivokathanks!08:32
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates master: FFU Add cinder-backup missing fast_forward_upgrade_tasks  https://review.openstack.org/56852008:32
akrivokaflorianf: could you also review https://review.openstack.org/#/c/393775/ please? not much has changed since the last iterations08:32
*** ssbarnea_ has joined #tripleo08:34
florianfakrivoka: yep08:34
jaosoriordciabrin: sup08:37
dciabrinjaosorior, i'm having trouble to deploy a tls env with master rocky, any chance you can have a quick look at my config later today?08:37
jaosoriorsure08:37
jaosoriorI can check it out now08:37
dciabrincool thx08:38
*** florianf has quit IRC08:40
openstackgerritSergii Golovatiuk proposed openstack/tripleo-heat-templates master: fix spelling misktake  https://review.openstack.org/56840508:43
*** florianf has joined #tripleo08:44
*** derekh has joined #tripleo08:45
openstackgerritNir Magnezi proposed openstack/tripleo-common master: Make lb-mgmt-subnet a class B subnet  https://review.openstack.org/56808908:51
*** gkadam has joined #tripleo08:51
*** ykarel|lunch is now known as ykarel08:51
*** trown|outtypewww has quit IRC08:52
Tengushardy: hello! do you have a spare minute for a small question regarding heat?08:52
openstackgerritNir Magnezi proposed openstack/tripleo-heat-templates master: Make lb-mgmt-subnet a class B subnet  https://review.openstack.org/56813808:52
*** cylopez has left #tripleo08:52
*** trown has joined #tripleo08:53
jaosoriorTengu: you can also ask ramishra and therve about heat08:55
Tengujaosorior: oh, great, thank you :).08:55
Tengusooo ramishra or therve - does one of you have a spare minute? It's related to https://review.openstack.org/#/c/566228/ - I'd like to know if a Parameter could call another Parameter value for its default :).08:56
Tenguin order to avoid ugly code duplication -.-. the current test is apparently working, but.... not really happy with the fact we have to duplicated some values in multiple files.08:57
therveTengu: A paramater, as in something in the parameters section?08:57
Tengutherve: wait, picking up links from github to illustrate.08:58
shardyTengu: No a parameter can't reference another parameter08:58
jaosoriorTengu: you can't do that in a parameter declaration, but you can when passing a parameter in the resources section.08:58
shardyyeah you could perhaps use a conditional or something, an example would help advise further :)08:59
Tengushardy: fuuu :(.08:59
*** salmankhan has quit IRC08:59
Tengushardy: therve for example: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L66-L70  you see the default value08:59
therveYes08:59
TenguI need to override it when we use Docker, because log path is different.08:59
Tenguin order to do so, I've pushed this (WIP) patch: https://review.openstack.org/#/c/566228/4/docker/services/nova-api.yaml09:00
Tengubut it duplicates code, and if for some reason we're to change the tag for example, or logfile name, we'll need to ensure we do that change in at least two files instead of only one.09:00
therveSo, just redefine NovaApiLoggingSource in the docker file?09:00
TenguI was thinking about split the "path" in "dirname" and "logfile" or something09:01
jaosoriorshardy: did we come to any agreement on still supporting the baremetal templates? Would sure be nice to start merging them09:01
Tengutherve: in the service in docker, yep09:01
Tenguso that it will generate correctly the hiera content for fluentd09:01
shardyjaosorior: No, I proposed merging them but dprince was against it, due to the possibility of supporting baremetal all-in-one deployments09:01
jaosorior:(09:01
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Increase services project quotas when deploying Octavia  https://review.openstack.org/56764109:01
shardyTengu: that approach will work, but you're hard-coding the parameter that's supposed to be user configurable09:02
shardywill comment on the patch09:02
Tengushardy: thank you. I confess, I'm not happy wth that proposal, that's why I only edited one file :)09:02
therveHum I don't get it09:02
therveTengu: Why not define NovaApiLoggingSource in docker.yaml.?09:02
jaosoriortherve: I think that'll cause an error in the pep8 gate.09:03
therveI don't get why you want to get the default from the other parameter, as you want another default09:03
jaosoriortherve: we check that the parameter declarations are the same09:03
jaosoriorof course, that's not a blocker; just mentioning that needs to be fixed :)09:03
thervejaosorior: You can't have a parameter with different value?09:04
therveOr because you use parameter_defaults all of the place...09:04
jaosoriortherve: I think it's the parameter_defaults thing09:04
shardyYeah I agree with therve, you should just copy the parameter declaration to the docker template and change the default09:05
Tengutherve: thought about it as well, but wasn't sure how to do that. I'm not that used to heat things. Hence the question :)09:05
shardyand yeah we'd need to work out the pep8 check thing09:05
* therve checks09:05
Tengushardy: thank you for your comment, now I see a bit more.09:06
*** salmankhan has joined #tripleo09:06
TenguI'll update the patch with in order to ensure I'm correct, and will do the others once it's valid.09:06
shardyAnother possibly cleaner approach might be to move the definition of tripleo_fluentd_sources_nova_api so it's set in docker/services/nova-api.yaml09:06
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for some of OC deploy jobs  https://review.openstack.org/56853609:06
shardye.g don't pass the value via the nova-base template at all09:06
shardyhttps://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-api.yaml#L18509:06
Tengushardy: hm. that's.. well, way out of reach for me now I guess :(09:06
shardyTengu: why?09:07
therveOK it does indeed fail09:07
Tengushardy: hmm, maybe I don't understand your cleaner solution in fact09:07
*** nyechiel_ has quit IRC09:08
*** nyechiel_ has joined #tripleo09:08
shardyTengu: Ok sec let me push a patch to illustrate09:08
Tenguthank you.09:08
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for UC containers upgrades  https://review.openstack.org/56827509:09
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for some of OC deploy jobs  https://review.openstack.org/56832609:09
openstackgerritNir Magnezi proposed openstack/tripleo-heat-templates master: Make lb-mgmt-subnet a class B subnet  https://review.openstack.org/56813809:11
openstackgerritNir Magnezi proposed openstack/tripleo-common master: Make lb-mgmt-subnet a class B subnet  https://review.openstack.org/56808909:11
*** linhnm has joined #tripleo09:11
therveThere is PARAMETER_DEFINITION_EXCLUSIONS which can work around the pep8 thing09:12
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: WIP Correct log location in container environment for Fluentd  https://review.openstack.org/56854009:12
shardyyeah that's definitely solvable09:13
Tengutherve: care to show me that pep8 thing? so that I can learn a bit more (new at redhat, started yesterday)09:13
shardyTengu: ^^ that was what I was thinking09:13
shardythere's a little bit of duplication but it's fairly clear09:13
therveTengu: http://paste.openstack.org/show/720982/09:13
therveshardy: Your patch will fail pep8 right09:14
shardytherve: yeah I'll have to add your fix09:14
shardyif we're going with that approach09:14
* shardy adds it09:14
*** jbadiapa has joined #tripleo09:15
Tengushardy: hmm so yep, confirm: out of reach for now :). Not that used to heat and its ways. That will come.09:15
Tengutherve: hm, ok. Can't really see what is impacted in fact. will dig in the code and its validation.09:16
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd  https://review.openstack.org/56854009:16
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Add CI triggers for OC deploy jobs to depend on UC  https://review.openstack.org/56853609:16
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for UC containers upgrades  https://review.openstack.org/56827509:16
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Optimize CI triggers for some of OC deploy jobs  https://review.openstack.org/56832609:16
shardyTengu: we run tools/yaml-validate.py in the gate, which has some checks that ensure parameters are consistently defined09:16
Tengushardy: therve so I guess I'll need to update in the same way all the services yaml file right?09:17
shardyas therve points out, there's a way to escape that check when you intentionally diverge the parameter definitions09:17
Tengushardy: ok09:17
shardyTengu: yes if the log path is wrong in all of them I guess so09:17
Tenguwell, it actually is -.-'09:17
therveTengu: is it always the same schema?09:17
Tenguas logs have been moved from /var/log/<service> to /var/log/containers/<service>09:18
shardysed ftw! ;)09:18
shardyTengu: aren't they all symlinked tho?09:18
Tenguand http logs are in /var/log/containers/httpd/<service>09:18
Tengushardy: nope09:18
therveYeah the problem is if it was user defined09:18
shardyhrm09:18
Tenguthere's a nice readme in the old location09:18
Tengushowing the new location09:18
*** shreshtha_ has quit IRC09:18
shardyOk, well we could create a symlink for each service in host_prep_tasks, or change the path like in my patch for all services which require it09:19
Tengusymlink might cause issues with logrotate or might override the old logs.09:19
cgoncalvesshardy, bogdando: hi. could you please review https://review.openstack.org/#/c/566913/ ?09:20
shardyTengu: ack, probably best to update the config then I guess09:20
Tengushardy: think so. Already thought about symlink, but due to the state possible issues...09:20
Tengushardy: may I take back your patch in my own review and work on it, or is it better I push updates to yours instead?09:21
shardyTengu: you're welcome to take it and update your review09:21
shardythen I'll abandon my review09:21
Tengushardy: thank you :).09:21
shardynp! :)09:21
shardycgoncalves: ack, one question added09:22
Tengushardy: cherry-picked it in my own branch. I'll continue the patches then.09:23
*** leanderthal has joined #tripleo09:23
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Replace logging with oslo_log for upgrade classes  https://review.openstack.org/56781909:23
bogdandoshardy: heh, telepathy in action09:24
bogdandohttps://review.openstack.org/#/c/566913/4/playbooks/roles/octavia-undercloud/tasks/main.yml09:24
bogdandoshardy: could you please take a look https://review.openstack.org/#/c/566333/ ?09:25
shardybogdando: ack, done!09:28
cgoncalvesshardy, bogdando: replied. thanks for your reviews!09:30
openstackgerritSergii Golovatiuk proposed openstack/python-tripleoclient master: Make standalone role name configurable  https://review.openstack.org/56837809:31
openstackgerritBogdan Dobrelya proposed openstack-infra/tripleo-ci master: Delay deployment jobs until the pep8/unit passes  https://review.openstack.org/56854309:32
*** udesale_ has joined #tripleo09:33
*** udesale has quit IRC09:34
openstackgerritSergii Golovatiuk proposed openstack-infra/tripleo-ci master: Fix deprecation warnings for te-broker  https://review.openstack.org/54704509:34
*** shreshtha has joined #tripleo09:41
*** linhnm has quit IRC09:42
*** shreshtha_ has joined #tripleo09:43
*** shreshtha_ has quit IRC09:44
*** shreshtha_ has joined #tripleo09:45
*** shreshtha has quit IRC09:45
Tenguhmmm. apparently "designate" service isn't known by fluentd. At least, nothing seems to export its log directory for fluentd in the various heat templates.09:55
Tenguthat's the DNSaaS right?09:55
*** jaosorior has quit IRC10:00
*** paramite has quit IRC10:00
*** jaosorior has joined #tripleo10:01
*** udesale_ has quit IRC10:01
*** udesale has joined #tripleo10:03
*** zoli is now known as zoli|lunch10:05
*** shreshtha_ has quit IRC10:05
*** wolverineav has quit IRC10:09
*** wolverineav has joined #tripleo10:10
*** tosky has quit IRC10:11
*** tosky has joined #tripleo10:12
*** paramite has joined #tripleo10:12
*** wolverineav has quit IRC10:15
*** paramite_ has joined #tripleo10:16
*** shreshtha has joined #tripleo10:17
*** rh-jelabarre has joined #tripleo10:17
*** paramite has quit IRC10:20
*** psahoo has quit IRC10:21
sshnaidm|roverbogdando, for rechecking only OVB you need "check-rdo"10:21
Tenguhmmm. does anyone has a containerized overcloud? Care to check if neutron logs are in /var/log/containers/neutron? apparently, that service isn't using this location, but I'm unable to check that on a live system -.-'. Not enough power on my laptop, and no access to rdocloud )10:21
sshnaidm|roverbogdando, "recheck ..." will recheck everything10:21
*** zoli|lunch is now known as zoli10:24
*** pkovar has joined #tripleo10:28
*** pdeore has quit IRC10:40
*** tesseract is now known as info10:41
*** info is now known as tesseract10:41
openstackgerritMerged openstack/puppet-tripleo stable/newton: Ensure the CephX Manila keyring permissions are only set when needed  https://review.openstack.org/56785410:42
*** mburned_out is now known as mburned10:44
*** nyechiel has joined #tripleo10:47
*** nyechiel_ has quit IRC10:47
shardyTengu: yes looks like it ref http://paste.openstack.org/show/720985/10:49
shardyTengu: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/neutron-api.yaml#L117 is confusing though10:50
shardymaybe that is wrong10:50
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo stable/newton: [Newton Only] Fix getting live value of nova/neutron during update.  https://review.openstack.org/56855210:59
*** nyechiel_ has joined #tripleo10:59
*** nyechiel has quit IRC11:00
*** vpickard_ is now known as vpickard11:05
Tengushardy: guess this is used by kolla inside the container in fact11:11
Tengushardy: I've asked a former colleague to check on my former lab, and apparently the logs are in the containers subdir. So it's OK. I was confused because I didn't see the volume11:12
openstackgerritAthlan-Guyot sofer proposed openstack/puppet-tripleo stable/newton: [Newton Only] Fix getting live value of nova/neutron during update.  https://review.openstack.org/56855211:12
*** zoli is now known as zoli|afk-tpb11:13
*** dtantsur|afk is now known as dtantsur11:14
Tenguduh.. ok. should rebase master in fact. apparently there was a file name change.11:16
*** atoth has joined #tripleo11:20
*** wolverineav has joined #tripleo11:26
*** jcoufal has joined #tripleo11:26
*** ansmith has quit IRC11:26
*** nyechiel_ has quit IRC11:27
*** vpickard has quit IRC11:28
*** ffiore has quit IRC11:29
*** vpickard has joined #tripleo11:30
*** holser__ has quit IRC11:32
*** holser___ has joined #tripleo11:32
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd  https://review.openstack.org/56854011:37
Tenguargh11:37
Tenguthe cherry-pick wasn't a good idea -.-.11:38
Tengushardy: well, I guess I'll continue working on your own change in fact.11:38
Tenguor.. hmm.11:38
* Tengu twisting git11:41
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Correct log location in container environment for Fluentd  https://review.openstack.org/56622811:41
*** abishop has joined #tripleo11:41
Tengushardy: you can abandon your change, sorry for the noise. I didn't take the right ID in my amend -.-'.11:42
*** rodolof has joined #tripleo11:42
*** mdnadeem has quit IRC11:44
*** mdnadeem has joined #tripleo11:45
*** pchavva has joined #tripleo11:46
*** agopi has quit IRC11:46
*** dprince has joined #tripleo11:49
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates stable/queens: Add ability to control Glance's enabled_import_methods  https://review.openstack.org/56783311:57
Tengujaosorior: I think you kind of broke pep8 on t-h-t :]. Not sure though. But as it talks about endpoints and TLS... :)11:59
*** zoli|afk-tpb is now known as zoli11:59
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Enable config-download deployment tracking  https://review.openstack.org/55902212:00
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Chain ansible messages in deployment progress  https://review.openstack.org/56473312:00
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment  https://review.openstack.org/56636612:00
Tengujaosorior: http://paste.openstack.org/show/720989/  care to have a look ?12:00
*** skramaja has quit IRC12:01
*** skramaja_ has joined #tripleo12:01
*** raildo has joined #tripleo12:01
Tenguunless I don't know how to invoke the tool in fact.12:01
Tenguok. have to pass the correct directory apparently. my bad :)12:02
jaosoriorno biggie12:03
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Correct log location in container environment for Fluentd  https://review.openstack.org/56622812:04
Tenguhmm. still.. the script is complaining :)12:04
Tengubut not anymore with my stupide typos :)12:04
*** liverpooler has joined #tripleo12:06
jaosoriorhow is it complaining?12:06
openstackgerritMerged openstack/tripleo-heat-templates master: Expose parameter MistralDockerGroup  https://review.openstack.org/56676912:07
Tengujaosorior: same message as in my previous paste :/12:07
Tengudon't know if zuul launches the test with some specific options, I don't think it does seeing its log.12:08
*** nyechiel_ has joined #tripleo12:09
Tenguanyway. going back to work on that patch - I've done only the half of the files I think -.-'.12:09
jaosoriorTengu:12:09
jaosoriorjosorior@pickle ~/d/o/tripleo-heat-templates> pwd12:09
jaosorior/home/josorior/development/openstack/tripleo-heat-templates12:09
jaosoriorjosorior@pickle ~/d/o/tripleo-heat-templates> ./tools/yaml-validate.py12:09
jaosoriorI launch it from the t-h-t base dir12:09
Tengujaosorior: hmm. ok.12:09
Tenguok, now I see other errors. And those are related to my patch. Thanks for the head up :)12:11
openstackgerritMerged openstack/python-tripleoclient master: deploy/upgrade: include tripleo_role_name  https://review.openstack.org/56834212:11
openstackgerritMerged openstack/tripleo-common master: TLS by default for the overcloud  https://review.openstack.org/55492612:11
*** tiswanso has quit IRC12:12
*** udesale_ has joined #tripleo12:18
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: Add .deployment.v1.deploy_on_servers to ffwd-upgrade prepare  https://review.openstack.org/56633612:18
*** udesale has quit IRC12:19
dtantsurfolks, is this a known problem? http://logs.openstack.org/86/567886/1/check/tripleo-ci-centos-7-containers-multinode/d523823/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-05-15_09_35_3212:20
*** bfournie has joined #tripleo12:20
*** gyankum has quit IRC12:25
chandankumarEmilienM: jaosorior mwhahaha I need some help on this review https://review.openstack.org/#/q/topic:tempest_log+(status:open+OR+status:merged)12:26
cgoncalvesbeagles, shardy:  want to discuss https://review.openstack.org/566913 now?12:27
chandankumartempest container logging is not happening12:27
openstackgerritJiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow  https://review.openstack.org/56624612:27
chandankumarI am not sure where I am doing wrong12:27
beaglescgoncalves: on a call a the moment12:28
beaglescgoncalves: I'll be free in 30 minutes12:28
openstackgerritMerged openstack/tripleo-heat-templates master: Change default endpoint map entries to use TLS  https://review.openstack.org/55842412:28
openstackgerritMerged openstack/tripleo-common master: Add special 'all' for deploy_on_servers server name to match all  https://review.openstack.org/56657612:28
*** tzumainn has joined #tripleo12:28
cgoncalvesbeagles, ack. I've a call in 30 minutes. let's chat in 1 hour if you're available12:28
*** numans has quit IRC12:31
*** dougbtv_ has joined #tripleo12:32
*** artom has joined #tripleo12:32
*** rlandy has joined #tripleo12:33
*** numans has joined #tripleo12:35
mandredtantsur: I suspect it has something to do new promoted hash being used before container images are all uploaded to the dockerhub, I've seen the same thing happening in https://review.openstack.org/#/c/566246/12:38
beaglesk12:38
dtantsursigh12:38
beaglescgoncalves: well, if shardy is available ;)12:38
shardybeagles, cgoncalves: Hey yes I'm around, I just wanted to understand when we expect yum to fail, to ensure we're not just confusing the operator by hiding an actual error then doing nothing12:39
shardylike, if I messed up my repo config I'd probably rather know about it than have something just not happen without any warning?12:40
shardyOr perhaps there's something I'm missing :)12:40
*** dougbtv_ has quit IRC12:40
*** tiswanso has joined #tripleo12:41
*** tiswanso has quit IRC12:41
cgoncalvesshardy, well if one messes up the repo config we can't help much there :)12:42
*** tiswanso has joined #tripleo12:42
shardycgoncalves: well, we can tell them yum failed and not ignore the resulting errors...12:42
shardymaybe there was a temporary network outage, or a mirror was down, then boom you get no warning and stuff just gets skipped12:43
cgoncalvesshardy, in case yum fails the user can still easily install the rpm and upload the image to glance12:43
shardycgoncalves: yes but how do they know they need to do it?12:43
shardywhat about if we test this in CI and a mirror goes down?12:43
cgoncalvesshardy, I'd argue that, in case of network outage, it would be better to ignore error and finish deployment than having to redeploy again12:43
beaglesshardy: I'll try to boil down my reasons to be as concise as possible: 1. afaik we don't normally install anything on install so introducing a dependency like this is new and we havent' the time to sort out all of the implications 2. the deploy completes fine without the package, the user will need to upload the amphora image afterwards and 3. the failure would happen really late and that sucks12:44
shardycgoncalves: well you could say that about any error I suppose, but in this case I just worry that there's no warning, so the operator thinks everything is fine12:44
shardyonly, sometimes, it's not12:44
shardyugh12:44
beagles"install anything on deploy" not "install" ;)12:44
beaglesshardy: yeah, that's right12:44
shardybeagles: if it's a temporary thing while we let repos catch up or something then I get it12:45
cgoncalvesshardy, we could add a 'debug' with msg task but the user would hardly see it in the (long) log12:45
shardycgoncalves: yeah, or we could just say, hey we couldn't install and tell them there was an error12:45
shardythen they can re-run it manually and work out why12:45
shardybeagles: I'm not blocking on it, it just seems like an obscure bug report waiting to happen ;)12:46
beaglesshardy: :) that's true - mmmm12:46
beaglesshardy: I'm vascillating  :)12:46
cgoncalvesI'm sort of okay with either approach :)12:46
beaglesshardy: I'm weighing the alternatives -12:47
beagles"a wtf" issue from a customer  - why wasn't there an error12:47
beaglesor "a wtf" what do you mean I have to redeploy12:47
cgoncalves+1 :)12:48
shardywell they have to run the command again, or you could print something in the error which says "maybe you got unlucky, try running this manually" I guess12:48
shardybut, like, if yum install fails, something is probably broken right?12:48
shardyAs an operator I think I'd rather know12:48
shardyanyway, I'll remove my vote and we can get some other opinions on it12:49
beaglesshardy: cgoncalves: okay here's my proposal - let it fail late (remove ignore_errors) and document that where network connectivity to repos on the undercloud is limited for whatever reason that the rpm should be installed before hand12:50
shardybeagles: that sounds reasonable - the other approach would be to add it to the undercloud install by default?12:50
shardyhow big is the image?12:50
*** ansmith has joined #tripleo12:50
beaglesshardy: good question - not sure atm. That would actually be the ideal thing. We avoided this u/s but maybe that's an option elsewhere12:51
cgoncalvesshardy, 649MB RPM12:51
shardycgoncalves: ouch12:51
*** rh-jelabarre has quit IRC12:52
*** nmagnezi has joined #tripleo12:52
beaglescgoncalves: in any case give assaf a heads up and let's remove the ignore_errors , sound k?12:53
cgoncalvesbeagles, ack. I'll be meeting with him in 7 minutes :)12:53
shardywith such a large package it's probably even more important to not ignore errors, e.g it may fail due to filling up the disk12:53
*** rh-jelabarre has joined #tripleo12:54
*** mcornea has joined #tripleo12:55
beaglesmmm.. it's going to fail anyways if that breaks the bank ;)12:55
beaglesbut that's a good point :)12:55
beaglesshardy: Seems like we can move this up in steps with external steps in rocky yeah?12:56
beaglesexternal_workflow_tasks I mean12:57
beagles(sorry I'm multitasking meetings)12:57
beaglesshardy: we could do it now but we want to backport this revision12:57
shardybeagles: yup it should move to external_deploy_tasks for rocky as we've switched to config-download by default12:59
shardywhich I think will mean the old workflow tasks don't work anymore12:59
beaglesshardy: yes, that's right.. I was just mentioning that we probably want to look at moving some of these things up some steps to allow for failing earlier13:00
myoung|ruckhrm...whichever route is chosen on this one I would like to ensure that in CI we're looking for.  we see issues around mirrors and/or infra connectivity quite a bit.  If there's a summary of what was problematic in a know parsable place, 1we can add bits to look for it (and then fail the CI job in an informative fashion).  Anything we can do to reduce the time to diagnose issues is a \o/13:00
beaglesshardy: e.g. certs stuff and yum install can be done pretty early13:00
beagles(it'll means massaging ansible though I guess)13:00
shardybeagles: ack - I guess another approach would be to install the image on the first controller and do the bootstrapping there13:00
*** elgxl_ has joined #tripleo13:01
beaglesshardy: I toyed with idea - but it forces development environments to configure masquerading or similar to get access to the outside. I don't do it myself unnecessarily...13:02
beaglesshardy: which actually has been handy for some issues13:02
beaglesshardy: but meh13:02
shardybeagles: Hmm, I thought we configured a route with masquerading via the undercloud by default anyway13:02
beaglesshardy: I think you need to tell it to13:03
shardyyeah, not a big deal, I just got burned very recently corruping a VM based undercloud due to running out of disk space ;)13:03
beaglesshardy: lol13:03
beaglesshardy: I've been there *a lot*13:03
shardybeagles: :D13:03
beagles(my undercloud vms are pretty long lived)13:04
*** elgxl has quit IRC13:04
beaglessometimes I think I test undercloud updates more than anyone13:04
beagleswell actually not so much because I now pretty much nuke the previous one13:04
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd  https://review.openstack.org/56622813:05
Tengupfiou. that's the bigest patch I've ever pushed until now :).13:05
Tengupretty sure it won't merge easily -.-.13:06
*** Goneri has joined #tripleo13:06
*** elgxl_ has quit IRC13:07
*** elgxl has joined #tripleo13:08
*** eck` is now known as eck`gone13:08
gfidentemwhahaha it wasn't obvious to me why we had to abandon/restore some submissions last week to resolve the CI issue but, can you tell if https://review.openstack.org/#/c/567275/ one of those affected or should I just recheck?13:11
*** eck`gone is now known as eck`13:11
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd  https://review.openstack.org/56622813:12
mwhahahagfidente: we had to clear the gate, that was not one of them. since those ci results are from this morning looks like fresh problems13:12
gfidentemwhahaha ack recheck then :D13:14
mwhahahamight not be helpful but sure13:14
mwhahahalooks like pacemaker problems across the board13:14
mwhahahadciabrin, bandini -^13:14
mwhahahahttp://logs.openstack.org/75/567275/1/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/b27465d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-15_11_20_3813:14
toskyarxcruz: "Send tempest results by mail" failed again (Connection refused)13:14
mwhahahatosky: i don't think that bit has worked in a long time (i've seen errors for weeks)13:14
mwhahahatosky: we should probably turn it off13:14
toskymwhahaha: I'd say fix it13:15
arxcruztosky: yes, i had to turn off yesterday because dns was taking too long to resolve13:15
arxcruzand weshay needed a job to pass13:15
toskymwhahaha: we are slowly trying to have it working, shutting it down permanently would not make things better13:15
toskytbarron, vkmc: ^^13:15
mwhahahaconsidering it's been failing for weeks13:15
mwhahahait's not something that should be on13:15
mwhahahasure fix it13:16
mwhahahabut if no one is looking, don't leave it on13:16
arxcruzmwhahaha: i'm looking into it :)13:16
*** dhill_ has joined #tripleo13:16
Tengu\o/ pep8 is happy now :). thank you shardy and therve for the hints/examples :).13:17
Tengunow is time for the next checks.13:17
tbarrontosky: ty13:18
tbarronmwhahaha: I think no one looks at the broadly targeted something failed somewhere and we thought you should know emails but tosky is developing a quite targeted notifier13:19
arxcruztosky: fyi i turn the server on, fix the dns problem, let's see how it behaves now13:19
arxcruzmwhahaha: tbarron ^13:20
tbarronarxcruz: ack13:20
toskyarxcruz: thanks, let me recheck; let's see in 3 hours13:20
arxcruztosky: k, let's keep talking :)13:20
arxcruzwell, we are talking constantly on tempestconf so ;)13:20
*** elgxl has quit IRC13:25
*** elgxl has joined #tripleo13:26
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add linter jobs for releases file script  https://review.openstack.org/56828713:26
*** gyankum has joined #tripleo13:28
*** dougbtv_ has joined #tripleo13:28
openstackgerritJiri Tomasek proposed openstack/tripleo-common master: Add new undeploy_plan workflow  https://review.openstack.org/56624613:33
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/queens: FFU Add cinder-backup missing fast_forward_upgrade_tasks  https://review.openstack.org/56858413:33
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add python script to dynamically compose releases  https://review.openstack.org/56752113:34
*** lblanchard has joined #tripleo13:37
Tenguhmm, might a patch close multiple LP issues?13:39
Tenguor refer at least ?13:39
openstackgerritCédric Jeanneret proposed openstack/tripleo-heat-templates master: Correct log location in container environment for Fluentd  https://review.openstack.org/56622813:41
*** elgxl has quit IRC13:44
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Help generate playbook commnands  https://review.openstack.org/56574013:44
*** elgxl has joined #tripleo13:45
*** cdearborn has joined #tripleo13:45
TenguPTAL ? :) https://review.openstack.org/#/c/566276/13:45
Tengumissing one CR+2 and WF+1 :)13:46
*** fragatina has joined #tripleo13:46
*** rh-jelabarre has quit IRC13:46
*** bkopilov has quit IRC13:47
*** colonwq has quit IRC13:47
*** colonwq has joined #tripleo13:49
openstackgerritSagi Shnaidman proposed openstack-infra/tripleo-ci master: Help generate playbook commnands  https://review.openstack.org/56574013:49
*** rh-jelabarre has joined #tripleo13:49
abishopmarios, gfidente: https://review.openstack.org/567667 is happy now, please +W13:49
*** elgxl has quit IRC13:50
Tengubogdando: thank you :)13:52
*** agopi has joined #tripleo13:54
*** elgxl has joined #tripleo13:55
*** pblaho has joined #tripleo13:56
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory  https://review.openstack.org/56834013:58
*** elgxl has quit IRC13:59
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps: switch to tripleo_role_name  https://review.openstack.org/56834313:59
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Docker via Ansible and not Puppet  https://review.openstack.org/56137713:59
mwhahaha#startmeeting tripleo14:00
mwhahaha#topic agenda14:00
mwhahaha* Review past action items14:00
mwhahaha* One off agenda items14:00
mwhahaha* Squad status14:00
mwhahaha* Bugs & Blueprints14:00
openstackMeeting started Tue May 15 14:00:11 2018 UTC and is due to finish in 60 minutes.  The chair is mwhahaha. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
mwhahaha* Projects releases or stable backports14:00
mwhahaha* Specs14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
mwhahaha* open discussion14:00
mwhahahaAnyone can use the #link, #action and #info commands, not just the moderatorǃ14:00
mwhahahaHi everyone! who is around today?14:00
*** openstack changes topic to " (Meeting topic: tripleo)"14:00
openstackThe meeting name has been set to 'tripleo'14:00
*** openstack changes topic to "agenda (Meeting topic: tripleo)"14:00
EmilienMo/14:00
dpeacocko714:00
florianfo/14:00
mwhahahahappy tuesday14:00
marioso/14:00
dpeacockHappy Tuesday :-)14:00
beagleso/14:00
chemo/14:00
jristo/14:01
myoung|rucko/14:01
matbuo/14:01
*** skramaja_ is now known as skramaja14:02
skramajahello14:02
holser___o/14:02
mwhahahaalright let's go14:02
mwhahaha#topic review past action items14:02
*** openstack changes topic to "review past action items (Meeting topic: tripleo)"14:02
mwhahahamwhahaha to send a note about just cutting all of tripleo over to storyboard - DONE14:02
mwhahaha#link http://lists.openstack.org/pipermail/openstack-dev/2018-May/130333.html14:02
mwhahahanot a whole lot of feedback on that one14:02
mwhahahaif there are no objections i'm going to start working with infra to do the migration of bugs to stories14:03
EmilienMso we stop doing squad by squad?14:03
mwhahahabut we'll need the other action item first14:03
mwhahahayea14:03
EmilienMhmm ok14:03
mwhahahait's not beneficial to do it that way because it doubles work14:04
*** rbrady has joined #tripleo14:04
mwhahahaand it a pain trying to figure out how to wedge the squad bugs into storyboard14:04
openstackgerritCarlos Goncalves proposed openstack/tripleo-common master: Install Octavia amphora image if Red Hat  https://review.openstack.org/56691314:04
*** rbrady is now known as Guest1533414:04
*** elgxl has joined #tripleo14:04
EmilienMso we'll have "one" project in SB, 'tripleo' for all repos?14:04
*** Guest15334 is now known as rbrady_14:04
*** rbrady_ has joined #tripleo14:04
mwhahahait's likely that we'll use either THT or tripleo-common14:05
mwhahahabut yea14:05
cgoncalvesbeagles, shardy, bogdando: https://review.openstack.org/#/c/566913/14:05
mwhahahawe'll need to figure that out with the infra folks14:05
mwhahahaanyway the other action item which is along those lines14:06
mwhahahaweshay & co to ensure tooling is storyboard friendly14:06
weshay0/14:06
mwhahahaweshay, myoung|ruck: i know ci is/was on fire, did you get a chance to look at using storyboard as the source for the CIX scripts and bots?14:06
weshayI wish14:06
EmilienMbefore the tooling we need to get humans familiar with it :D14:06
myoung|ruckmwhahaha: what weshay said14:06
EmilienMI'm not sure 5% of us know the syntax in commit message to close a bug (or a task/story)14:06
mwhahahait's been mailed out, but we can send a note14:07
Tenguwould be great for new comers :).14:07
mwhahahait's not that complex14:07
Tengueither send a note, or point a wiki link14:07
mwhahahaStory: or Task: instead of Closes-Bug:14:07
myoung|ruckHas a quickstart / show-n-tell already been recorded?14:07
jtomaseko/14:07
myoung|ruck(for sb)14:08
mwhahahaeither way that's on folks need to take it upon themselves to look14:08
owalsho/14:08
mwhahahawe can't force people to read14:08
*** elgxl has quit IRC14:08
Tengujust don't forget to update https://docs.openstack.org/infra/manual/developers.html#development-workflow  - I always refer to it in case of doubt :)14:08
openstackgerritHarald Jensås proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-templates  https://review.openstack.org/45158414:08
Tenguand it's already updated. so all's good14:09
*** elgxl has joined #tripleo14:09
mwhahahaweshay: ok any chance on getting some eyes on the storyboard bits this week?14:09
mwhahahatrying to nail down some dates so we can push a bit on this14:10
weshaywill try14:10
openstackgerritHarald Jensås proposed openstack/tripleo-specs master: blueprint tripleo-routed-networks-templates  https://review.openstack.org/45158414:10
mwhahahak14:10
mwhahahamoving on14:11
mwhahaha#topic one off agenda items14:11
mwhahaha#link https://etherpad.openstack.org/p/tripleo-meeting-items14:11
*** openstack changes topic to "one off agenda items (Meeting topic: tripleo)"14:11
mwhahahaFYI open for discussion, debate other ideas regarding preflighting CentOS updates to our CI jobs14:11
mwhahahanot sure who added that topic14:11
mwhahahaweshay: was that you?14:12
weshayyes14:12
weshayso to describe this a bit14:12
*** elgxl has quit IRC14:12
*** bkopilov has joined #tripleo14:12
*** elgxl has joined #tripleo14:12
*** gkadam has quit IRC14:12
weshayI think we can have a periodic job that runs once or twice a week.. w/ the cr centos repo continuous delivery rpms that move to base14:13
bogdandosounds like a perfect plan14:13
weshaytwo jobs or so that consume that repo w/o image and container rebuild.. and a couple jobs that run after the image and containers have been rebuilt w/ the cr repo14:13
openstackgerritJiri Tomasek proposed openstack/tripleo-ui master: Run undeploy_plan workflow to delete deployment  https://review.openstack.org/56636614:13
weshayso .. I think we'd get the before and after promotion picture w/ regards to base updates14:13
EmilienMthat + humans actually watching and pro-active on this job, which means we need a process of regular surveillance for this job14:14
weshayya14:14
*** gkadam has joined #tripleo14:14
myoung|ruckit's a (good) canary, but doesn't stop the train...so ya active monitoring14:14
EmilienMsomething we check every week in our weekly meeting or in CI call or anything regular really14:14
EmilienMstupid question: so there is a centos repo that offers cd rpms?14:15
dprinceEmilienM: testing?14:16
dprinceEmilienM: if we enabled the testing repos it might get some coverage there...14:16
weshayEmilienM, yes.. I think I pasted into the agenda14:16
weshayhttps://wiki.centos.org/AdditionalResources/Repositories/CR14:16
EmilienMah cool, til14:17
EmilienMso yeah, maybe a periodic multinode + a periodic ovb might do the job14:17
mwhahahaok sounds like there isn't any general objection14:19
mwhahahaweshay: is this going on the backlog for the CI squad?14:19
bogdandoeven a single node undercloud deploy could prolly show if any update issues14:19
bogdandowhy waste CI resources for more nodes?14:20
*** rajinir has joined #tripleo14:20
mwhahahaif it's a periodic it's beneficial to get see the ovb problems14:20
bogdandook makes sense14:20
mwhahahasince that's a more complete test14:20
*** rpioso|afk is now known as rpioso14:20
EmilienMthe good news is we're not in hurry before next centos major upgrade14:21
mwhahahaalright anything else on this topic?14:21
myoung|ruckmwhahaha: bogdando: will capture this as a backlog item.  Will design / discuss / prioritize / crush with PM/UA/TC per process14:21
mwhahahaplz make sure to also circulate plans on the ML so we can get infra input as well14:22
myoung|ruckmwhahaha: ack and indeed.14:22
mwhahahacool moving on14:22
mwhahahaDeep dive about containerized undercloud! WANTED14:22
mwhahahanot sure who added that one either14:22
mwhahahaput your name on things people :D14:22
bogdandosome one who wants to run it?14:22
EmilienMyes, we should make it I agree14:22
EmilienMwhen I get my voice back I can run it14:22
dprincemwhahaha: when is the deep dive?14:23
EmilienMthere is no deep dive14:23
EmilienMbut it seems people are asking for it14:23
*** itlinux has joined #tripleo14:23
dprinceI can help run it14:23
dprinceif it helps14:23
EmilienMawesome, yeah14:23
mwhahaha#action dprince, EmilienM plan a containerized undercloud deep dive14:23
*** elgxl has quit IRC14:23
mwhahahatag your it14:23
dprincemwhahaha: perhaps lets wait a week or so after summit though14:24
mwhahahaindeed14:24
EmilienMyes ^14:24
mwhahahathe action item is just a plan :D so if the plan doesn't start for 3 weeks, that's fine14:24
mwhahahaalright we'll get that going in the next few weeks14:25
mwhahahaany other questions/issues around this?14:25
mwhahahaok moving on14:27
mwhahahaCI Community Meeting starts immediately upon this meeting closing. All are welcome, Add to agenda (or just join), https://bluejeans.com/7050859455, https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L2814:27
mwhahahayes, ci meeting after this one. feel free to join and discuss issues14:27
mwhahahaany questions?14:27
myoung|ruckwe don't bite14:27
*** itlinux has quit IRC14:27
mwhahahaa likely story14:28
*** elgxl has joined #tripleo14:29
mwhahahaok moving on14:29
*** elgxl has quit IRC14:29
mwhahaha#topic Squad status14:29
mwhahahaci14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting14:29
mwhahahaupgrade14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status14:29
*** openstack changes topic to "Squad status (Meeting topic: tripleo)"14:29
mwhahahacontainers14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-containers-squad-status14:29
mwhahahaconfig-download14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-config-download-squad-status14:29
mwhahahaintegration14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-integration-squad-status14:29
mwhahahaui/cli14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status14:29
mwhahahavalidations14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-validations-squad-status14:29
mwhahahanetworking14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-networking-squad-status14:29
mwhahahaworkflows14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-workflows-squad-status14:29
mwhahahasecurity14:29
mwhahaha#link https://etherpad.openstack.org/p/tripleo-security-squad14:29
*** lvdombrkr89 has joined #tripleo14:30
jristwill update ours shortly14:30
*** elgxl has joined #tripleo14:30
mwhahahaany status related items for discussion?14:31
EmilienMditto14:31
mwhahahalooks like most are up to date14:31
*** lvdombrkr has quit IRC14:32
openstackgerritDoug Szumski proposed openstack/diskimage-builder master: Remove duplicate GRUB command line entry  https://review.openstack.org/56860014:32
Tenguhmm. I think I have some sound issue with bluejeans -.-14:33
mwhahahaok moving on14:34
Tenguahh14:34
mwhahaha#topic bugs & blueprints14:34
mwhahaha#link https://launchpad.net/tripleo/+milestone/rocky-214:34
mwhahahaFor Rocky we currently have 55 (+1) blueprints and about 705 (+20) open Launchpad bugs.  694 rocky-2, 11 rocky-3.  101 (+0) open Storyboard bugs.14:34
mwhahaha#link https://storyboard.openstack.org/#!/project_group/7614:34
*** openstack changes topic to "bugs & blueprints (Meeting topic: tripleo)"14:34
mwhahahaso we've had two large increases in the bug count for the last two weeks +17 and +2014:34
EmilienMI wanted to rise https://bugs.launchpad.net/tripleo/+bug/177117114:34
openstackLaunchpad bug 1771171 in tripleo "ansible 2.5 takes internal role_name var seriously" [Critical,In progress] - Assigned to Emilien Macchi (emilienm)14:34
EmilienMI'm working on it: https://review.openstack.org/#/q/topic:bug/177117114:34
EmilienMnot sure if it's just my patches but multinode jobs are quite unstable14:35
*** dxiri_ has quit IRC14:35
mwhahahai don't think it's just your job, i think we have issues with pacemaker with the 7.5 bits14:35
*** dxiri has joined #tripleo14:35
*** apetrich has quit IRC14:36
*** cshastri has quit IRC14:37
*** trown is now known as trown|brb14:37
mwhahahaalso looked like some container download issues14:37
mwhahahaany other bugs?14:37
openstackgerritAlex Schultz proposed openstack/tripleo-common master: (cleanup) remove usage of role_name  https://review.openstack.org/56834714:37
EmilienMjust a note14:38
EmilienMif we merge https://review.openstack.org/568443 we really need to land https://review.openstack.org/568340 at the same time14:38
*** gbarros has joined #tripleo14:38
EmilienMor gate will break14:38
mwhahahasounds like we need to line those up carefully14:39
EmilienMyeah, I'll sync the merges14:40
*** tosky has quit IRC14:40
mwhahahaalright anything else?14:40
*** trown|brb is now known as trown14:41
mwhahaha#topic projects releases or stable backports14:41
*** openstack changes topic to "projects releases or stable backports (Meeting topic: tripleo)"14:41
mwhahahaEmilienM: so it was mentioned last week that we should do a tripleoclient release at some point14:42
mwhahahashould we do it after the role name stuff lands or can we just do it now14:42
*** tosky has joined #tripleo14:44
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/queens: Add compute node L3 agent container for DVR  https://review.openstack.org/56860214:44
*** rbrady__ has joined #tripleo14:44
EmilienMmwhahaha: yes I planned to do it after this role_name thing14:44
mwhahahak14:44
EmilienM#action EmilienM to release tripleoclient after role_name bug is fixed14:45
mwhahahaalso as a reminder M2 is in ~3 weeks14:45
mwhahahamoving on14:45
mwhahaha#topic specs14:45
mwhahaha#link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open14:45
*** openstack changes topic to "specs (Meeting topic: tripleo)"14:45
openstackgerritSteven Hardy proposed openstack/tripleo-heat-templates master: Decouple OpenShiftGlusterDisks from openshift-master.yaml  https://review.openstack.org/56860314:45
mwhahahawe've got a handful of open specs14:46
mwhahahaplease take some time to review them14:46
mwhahahai'll be merging any with appropriate +2s at the end of the week if there are no objections14:46
mwhahaha#topic open discussion14:46
*** openstack changes topic to "open discussion (Meeting topic: tripleo)"14:46
mwhahahaanything else?14:46
*** rbrady_ has quit IRC14:47
*** apetrich has joined #tripleo14:48
openstackgerritMerged openstack/python-tripleoclient master: Consume deployed t-h-t from the working output dir  https://review.openstack.org/56523314:49
openstackgerritMerged openstack/python-tripleoclient master: Use predictable name for generated hiera overrides  https://review.openstack.org/56633314:49
openstackgerritMerged openstack/tripleo-upgrade master: Call L3 checks before/after Role upgrade.  https://review.openstack.org/56624914:49
openstackgerritMerged openstack/tripleo-validations master: Add documentation links to README  https://review.openstack.org/56822614:49
openstackgerritMarios Andreou proposed openstack/python-tripleoclient stable/queens: Add .deployment.v1.deploy_on_servers to ffwd-upgrade prepare  https://review.openstack.org/56860414:49
mwhahahasounds like nope14:49
*** lvdombrkr89 has quit IRC14:49
mwhahahathanks everyone14:49
mwhahaha#endmeeting14:49
*** openstack changes topic to "Welcome to Rocky. CI status: YELLOW (OVB failing) | http://tripleo.org/ | https://docs.openstack.org/tripleo-docs/latest"14:49
openstackMeeting ended Tue May 15 14:49:43 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:49
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-05-15-14.00.html14:49
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-05-15-14.00.txt14:49
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2018/tripleo.2018-05-15-14.00.log.html14:49
*** masco has quit IRC14:50
openstackgerritYurii Prokulevych proposed openstack/tripleo-upgrade stable/queens: Call L3 checks before/after Role upgrade.  https://review.openstack.org/56860614:51
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Store UC hosts/portmaps heat params in output_dir  https://review.openstack.org/56413514:52
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860814:53
chandankumarEmilienM: please have a look at this patch https://review.openstack.org/#/q/topic:tempest_log+(status:open+OR+status:merged) It is related to enable logging in tempest container, But my changes is not working, I am not sure where I can doing wrong, please have a look14:59
openstackgerritAlex Schultz proposed openstack/tripleo-validations stable/ocata: Validate that there should not be XFS volumes with ftype=0  https://review.openstack.org/56473814:59
openstackgerritBogdan Dobrelya proposed openstack/python-tripleoclient master: Persist generated undercloud parameters t-h-t  https://review.openstack.org/56576415:00
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:00
chemmarios: matbu, hey I introduced a last minute bug in my osp9/10 upgrade and ill tested it, so if you could have a look at https://review.openstack.org/#/c/568552/15:00
EmilienMchandankumar: I can't now but will do asap15:00
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Drop default inclusion of undercloud.yaml  https://review.openstack.org/56838615:01
chemmarios: matbu, this was the last patchset that introduced the tempfile and my test env didn't take it into account15:01
*** ykarel is now known as ykarel|afk15:02
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:03
*** apetrich has quit IRC15:06
*** bdodd has joined #tripleo15:06
mwhahahamyoung|ruck, sshnaidm|rover, weshay: did we ever build pike containers? it looks like they are failing on pacemaker still15:14
mwhahahahttp://logs.openstack.org/98/564698/2/check/tripleo-ci-centos-7-containers-multinode/50e7e2d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-05-15_09_27_2915:14
weshaymwhahaha, my understanding is that queens and pike are still down due to no promotion.. pike was close15:15
* weshay looks15:15
mwhahahak15:15
mwhahahaplz let me know if we need reviews/fixes15:15
*** apetrich has joined #tripleo15:15
weshaymwhahaha, pike status on last attempt15:15
weshayhttps://review.rdoproject.org/jenkins/job/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset002-pike-upload/179/15:16
weshaythe image upload job timed out I think15:16
weshayhopefully getting a queens promotion in a few hours15:16
mwhahaha2018-05-15 04:07:03,339 - testenv-client - INFO - Received job : Couldn't retrieve env15:16
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:16
* mwhahaha shakes fist at tebroker and rdocloud15:16
sshnaidm|rovermwhahaha, it was problem at morning, not it's solved15:17
sshnaidm|rovers/not/now15:17
weshaysshnaidm|rover, is da man15:17
sshnaidm|rovermwhahaha, pike is running once a day, so tonight we'll see15:17
mwhahahak15:17
*** skramaja has quit IRC15:18
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:18
*** eck` is now known as eck`gone15:20
*** eck`gone is now known as eck`15:20
*** links has quit IRC15:21
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:22
chemmwhahaha: hey, I forgot to port some changes from my test env to the review, hence https://review.openstack.org/#/c/568552/ ... it's a short one .. and sorry about that.15:24
*** udesale_ has quit IRC15:25
mwhahahachem: k15:25
chemmwhahaha: thanks15:25
*** aufi has quit IRC15:25
*** elgxl_ has joined #tripleo15:26
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:26
*** yprokule has quit IRC15:29
*** elgxl has quit IRC15:30
*** sshnaidm|rover is now known as sshnaidm|bbl15:31
*** elgxl_ has quit IRC15:31
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Make standalone role name configurable  https://review.openstack.org/56837815:31
*** elgxl has joined #tripleo15:32
*** saneax is now known as saneax-_-|AFK15:33
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Add ability to use a different release per playbook  https://review.openstack.org/56656515:36
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860815:36
*** ykarel|afk is now known as ykarel|away15:39
*** ykarel|away has quit IRC15:44
*** agurenko has quit IRC15:44
toskyarxcruz: this time the notification email worked!15:45
arxcruztosky: ;)15:46
*** tiswanso_ has joined #tripleo15:49
*** olap has quit IRC15:50
*** tiswanso has quit IRC15:52
*** tiswanso_ has quit IRC15:57
abishopmyoung|ruck: I think my tht stable/queens patch is hitting https://bugs.launchpad.net/tripleo/+bug/1770692, should I hold off rechecking?15:57
openstackLaunchpad bug 1770692 in tripleo "potential for pacemaker version mismatch (BM vs.container) is a risk for OC deploy failures in gates" [Critical,Triaged]15:57
*** tiswanso has joined #tripleo15:58
*** sanjay__u has quit IRC15:59
myoung|ruckabishop: https://review.openstack.org/#/c/567833 ?16:01
*** dprince has quit IRC16:01
* myoung|ruck looks16:01
EmilienMmcornea: need your help if you have 5 min16:01
*** salmankhan has quit IRC16:01
mcorneaEmilienM: sure, what's up?16:01
EmilienMmcornea: https://review.openstack.org/#/c/568340/ (looking at zuul), still failing in the update job: 2018-05-15 15:59:40.246637 | primary | failed: [undercloud] (item={'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> /home/zuul/overcloud_update_run_Controllertripleorolename.log', u'end': u'2018-05-15 15:59:39.815935',16:01
EmilienM'_ansible_no_log': False, u'stdout': u'', '_ansible_item_result': True, u'changed': True, u'start': u'2018-05-15 15:59:21.700823', u'failed': True, u'delta': u'0:00:18.115112', 'item': u'Controllertripleorolename', u'rc': 1, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u'bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &>16:01
EmilienM/home/zuul/overcloud_update_run_Controllertripleorolename.log', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [], u'stderr': u'', u'msg': u'non-zero return code'}) => {"changed": false, "failed": true, "item": {"changed": true, "cmd": "bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> /home/zuul/overcloud_update_run_Controllertripleorolename.log",16:01
EmilienM"delta": "0:00:18.115112", "end": "2018-05-15 15:59:39.815935", "failed": true, "invocation": {"module_args": {"_raw_params": "bash /home/zuul/overcloud_update_run-Controllertripleorolename.sh &> /home/zuul/overcloud_update_run_Controllertripleorolename.log", "_uses_shell": true, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item":16:01
EmilienM"Controllertripleorolename", "msg": "non-zero return code", "rc": 1, "start": "2018-05-15 15:59:21.700823", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}, "msg": "Overcloud minor update execution step failed..."}16:01
EmilienMoops sorry for that16:02
EmilienMI really though it would be short :O16:02
EmilienManyway, do you know if depends-on tripleo-upgrades repo is supposed to work?16:02
EmilienMmcornea: see https://review.openstack.org/#/c/568443/16:02
abishopmyoung|ruck: yup, that one16:02
*** bogdando has quit IRC16:03
abishopmyoung|ruck: got 2 timeouts, and 3 overcloud deployment errors w/ same failure16:03
mcorneaEmilienM: overcloud_update_run-Controllertripleorolename.sh doesn't look good to me, I think it should be overcloud_update_run-Controller.sh16:04
EmilienMyeah right16:04
EmilienMmcornea: which is what I'm supposed to fix in https://review.openstack.org/#/c/568443/16:05
EmilienM(I thought)16:05
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860816:06
*** bcafarel|pto is now known as bcafarel16:06
mcorneaEmilienM: what's the link to the job for https://review.openstack.org/#/c/568340/ ?16:06
EmilienMmcornea: http://zuul.openstack.org/stream.html?uuid=2808950efa6c43338738645c4c2147f0&logfile=console.log16:07
myoung|ruckdciabrin, trozet, looks like abishop is also hitting https://bugs.launchpad.net/tripleo/+bug/1770692 in https://review.openstack.org/#/c/568443/16:07
openstackLaunchpad bug 1770692 in tripleo "potential for pacemaker version mismatch (BM vs.container) is a risk for OC deploy failures in gates" [Critical,Triaged]16:07
EmilienMmcornea: logs are being updated16:07
*** anilvenkata has quit IRC16:07
EmilienMmcornea: first thing I want to check is if we checked out my tripleo-upgrade patch16:07
*** trown is now known as trown|lunch16:08
myoung|ruckabishop: I need to dash for a lunch meeting, back in a bit.  I would recheck for the data points...load isn't intense in the queues atm16:08
abishopmyoung|ruck: ack, will recheck and see16:09
*** lucasagomes is now known as lucas-afk16:09
mcorneaEmilienM: yeah, /tmp/fake-oc-hosts.yaml  would also be useful, or can you run tripleo-ansible-inventory with this change applied locally? we can then run the awk command against the resulting inventory file to make sure it's doing the right thing16:09
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Update HostnameMap generation  https://review.openstack.org/56795116:09
EmilienMmcornea: logs are here http://logs.openstack.org/40/568340/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/2808950/16:11
EmilienMmcornea: why we do this thing really?16:12
EmilienMmcornea: this code is terrible, imho16:13
EmilienMmcornea: we should use the tripleo inventory no?16:13
mcorneaEmilienM: it's mostly to discover what roles are being deployed since we need to run different commands per role16:14
EmilienMawk -F':' '/tripleo_role_name/ {gsub("[[:space:][:punct:]]", "", $2); print $2}' /tmp/fake-oc-hosts.yaml16:15
EmilienMreally? :-)16:15
mcorneaEmilienM: /tmp/fake-oc-hosts.yaml is generated by tripleo inventory though :)16:17
openstackgerritGabriele Cerami proposed openstack-infra/tripleo-ci master: Add ability to use a different release per playbook  https://review.openstack.org/56656516:17
EmilienMmcornea: do you see in logs if we use https://review.openstack.org/#/c/568443/ ?16:17
EmilienMI'm not even sure16:17
mcorneaEmilienM: ZUUL_CHANGES=openstack/tripleo-upgrade:master:refs/changes/43/568443/1^openstack/tripleo-common:master:refs/changes/40/568340/516:18
EmilienMyeah but it doesn't tell you if we checkout it at the place where the role is used16:18
mcorneaEmilienM: can you show me how the inventory looks like with https://review.openstack.org/#/c/568340/ applied?16:19
mcorneato run the awk against it16:19
EmilienMmcornea: I don't have an env right now16:20
*** ramishra has quit IRC16:20
*** tesseract has quit IRC16:21
mcorneaEmilienM: give me a minute to if I can apply it on one of my envs16:21
EmilienMweshay: we shouldn't use Wiki, it's deprecated and will be removed one day AFIK, we should keep our doc at the same place: https://wiki.openstack.org/wiki/Tripleo-upgrades-fs-variables16:21
EmilienMweshay: please remove that page16:21
EmilienMmcornea: thx16:21
weshayEmilienM, aye.. that is a fine plan16:21
EmilienMweshay: like always ;-) please just don't use it16:22
weshayuse it16:22
weshay?16:22
EmilienMthe wiki is deprecated and will be removed one day16:22
EmilienMall our doc has been done in tripleo-docs16:23
EmilienMwe should really be consistent at some point16:23
weshayaye aye16:23
weshayroger that16:23
*** rodolof has quit IRC16:23
weshay10-416:23
*** rodolof has joined #tripleo16:23
*** zoli is now known as zoli|gone16:26
*** zoli|gone is now known as zoli16:26
*** panda is now known as panda|bbl16:29
EmilienMmcornea: I'll use a random inventory http://logs.openstack.org/33/566333/3/gate/tripleo-ci-centos-7-containers-multinode/298dde4/logs/undercloud/var/lib/mistral/b1b0226f-b8c1-4b66-bff0-c9af481baf29/tripleo-ansible-inventory.yaml.txt.gz16:30
*** jaosorior has quit IRC16:31
EmilienMmcornea: I could reproduce16:31
EmilienMmcornea: we shouldn't parse YAML from bash, really...16:32
*** dtantsur is now known as dtantsur|afk16:33
mcorneaEmilienM: how? on my env it appears to work correctly http://paste.openstack.org/show/721025/16:33
*** pcaruana has quit IRC16:33
EmilienMmcornea: you didn't change the inventory16:33
EmilienMmcornea: role_name: Controller, tripleo_role_name: Controller}16:33
EmilienMchange the line ^16:33
EmilienMI found the problem, fixingf16:34
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: Use tripleo_role_name instead of role_name  https://review.openstack.org/56844316:36
EmilienMmcornea: ^ see ($3 instead of $2)16:37
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: Use tripleo_role_name instead of role_name  https://review.openstack.org/56844316:37
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Include 'tripleo_role_name' in the inventory  https://review.openstack.org/56834016:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: deploy-steps: switch to tripleo_role_name  https://review.openstack.org/56834316:38
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy Docker via Ansible and not Puppet  https://review.openstack.org/56137716:38
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: (cleanup) remove usage of role_name  https://review.openstack.org/56834716:38
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: (cleanup) remove usage of vars when calling ansible  https://review.openstack.org/56834616:38
mcorneaEmilienM: what better option do we have for discovering the roles from an existing deloyment?16:38
EmilienMmcornea: everything except parsing YAML/JSON from bash16:39
EmilienMthis is super sensible16:39
*** mdnadeem has quit IRC16:40
*** marios has quit IRC16:41
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Add basics for standalone node  https://review.openstack.org/56641916:41
*** suuuper has joined #tripleo16:41
trozetmyoung|ruck: yeah I did this workaround that I'm testing now: https://gerrit.opnfv.org/gerrit/#/c/56981/26/lib/ansible/playbooks/prepare_overcloud_containers.yml16:42
*** gfidente has quit IRC16:45
*** mdnadeem has joined #tripleo16:54
*** dprince has joined #tripleo16:56
*** derekh has quit IRC17:00
*** tiswanso_ has joined #tripleo17:02
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860817:05
*** tiswanso has quit IRC17:05
*** gkadam has quit IRC17:07
*** thrash is now known as thrash|biab17:08
*** yolanda_ has quit IRC17:09
openstackgerritMerged openstack/puppet-tripleo stable/ocata: Ensure the CephX Manila keyring permissions are only set when needed  https://review.openstack.org/56764217:10
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Pass overcloud stack name to upgrade run.  https://review.openstack.org/56846817:10
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860817:10
openstackgerritAde Lee proposed openstack/tripleo-upgrade master: Add config_change role  https://review.openstack.org/56730017:12
sai_dsneddon: hey, i have a typical situation. Although I set use_dhcp: fals eto all other interfaces except provisioning in my tempaltes, I see hte other itnerfaces also picking up dhcp addresses instead of the values fro mthe nic-configs. I verfified the interface config files and they are all set to bootproto=none. Not sure how they are dhcping. Anything from the template/tripleo side i can do to avoid this17:12
*** shardy has quit IRC17:12
EmilienMmcornea: if we had to treat this kind of data, we should use Python or Ansible native features, not bash, imho.17:12
EmilienMmcornea: we really need to come up with best practices in tripleo-upgrades repo17:13
mcorneaEmilienM: yeah, I'm looking into how to do that, I agree that bash is not ideal but for now it did the job17:13
sai_dsneddon: sorry, i still see bootproto-dhcp inspite of using use_dhcp: fals ein templates17:14
*** janki has quit IRC17:14
*** mdnadeem has quit IRC17:15
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing zuul kicking custom tox per file  https://review.openstack.org/56860817:16
*** kopecmartin has quit IRC17:17
*** rodolof has quit IRC17:17
dsneddonsai_, Why are you even including those interfaces in the template if you don't want to use them?17:17
dsneddonsai_, Or are they supposed to be used, but not get DHCP? Are they supposed to get a static IP?17:18
sai_dsneddon: they are dhcping into the control plane pool. Im using them for other networks like tenhant/internalapi etc. So setting them to use_dhcp: false17:18
sai_dsneddon: correct17:18
dsneddonsai_, Can you show me your nic config templates?17:19
sai_dsneddon: one sec.17:19
*** yolanda_ has joined #tripleo17:20
dsneddonsai_, If you are getting the control plane IP on other interfaces, that isn't because of DHCP, it17:20
dsneddonsai_, It's because you forgot to instantiate the ports for the other networks, so they fallback to the control plane IP. Did you include network-isolation.yaml?17:21
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add releases script pytest tests to tox.ini  https://review.openstack.org/56764917:21
*** tiswanso_ has quit IRC17:22
*** tiswanso has joined #tripleo17:22
sai_dsneddon: yes, including the isolation file in deploy command17:22
sai_dsneddon: http://elk.browbeatproject.org:9090/~smalleni/osp13-full-lab/nic-configs/r630-controller.yaml17:22
*** trown|lunch is now known as trown17:22
openstackgerritAde Lee proposed openstack/tripleo-quickstart master: Add job to test password changes  https://review.openstack.org/56788817:24
*** psachin has quit IRC17:24
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add releases script pytest tests to tox.ini  https://review.openstack.org/56764917:25
sai_dsneddon: also, a bit of background, since we have nodes with varying number of nics and we want to use as many nics as available on each system, we use qinq where the service provider vlan is same for all ports, however we use the custoemr vlan for network isolation17:25
sai_SamYaple: that is why the other nics are able to dhcp...however i would expect them not to dhcp when setting use_dhcp: false17:26
openstackgerritAde Lee proposed openstack-infra/tripleo-ci master: Add password change job  https://review.openstack.org/56789717:26
dsneddonsai_, Can you grab the bridge ifcfg files from /etc/sysconfig/network-scripts/ifcfg-br-* and tell me if they have the correct IP in them?17:27
sai_dsneddon: : that is why the other nics are able to dhcp...however i would expect them not to dhcp when setting use_dhcp: false17:27
sai_dsneddon: ok one sec17:27
sai_dsneddon: bridge interface config files havent even been created17:28
sai_dsneddon: by the time deploy fails17:28
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add releases script pytest tests to tox.ini  https://review.openstack.org/56764917:28
dsneddonsai_, That's your problem. os-net-config is failing, probably because of a problem with your NIC config, so a fallback service dhcp-all-interfaces runs. This causes DHCP on all interfaces, so you can log in and find out what went wrong. Can you pastebin /etc/os-net-config/config.json?17:29
sai_dsneddon: https://imgur.com/3Rq4L6g17:30
sai_dsneddon: sorry couldnt copy from the management console, hence screenshot17:31
*** elgxl_ has joined #tripleo17:31
*** masco has joined #tripleo17:32
*** tosky has quit IRC17:33
*** elgxl has quit IRC17:34
dsneddonsai_, OK, the screenshot doesn't let me validate the JSON. Can you maybe run "sudo os-net-config --debug -c /etc/os-net-config/config.json" and tell me what the error is?17:34
EmilienMmcornea: is https://review.openstack.org/#/c/568443/ ok for you?17:35
EmilienMmcornea: I'll clean that up when the old var is removed17:35
*** elgxl_ has quit IRC17:36
*** agurenko has joined #tripleo17:36
sai_dsneddon: that command returned successfully..shocking :)17:36
*** masco has quit IRC17:37
mcorneaEmilienM: yes, looks good to me17:37
dsneddonsai_, Do you now have ifcfg-br-* files in /etc/sysconfig/network-scripts?17:37
sai_dsneddon: everythign is *fixed* now in the sense the vlan interfaces are created17:37
sai_dsneddon: yes17:37
dsneddonsai_, OK, I don't know what happened, then. Hard to say.17:37
*** tosky has joined #tripleo17:38
dsneddonsai_, You might check the /var/log/messages file for os-net-config and see if there was an error before.17:38
sai_dsneddon: in case my tempaltes were wrong etc, runing os-net-config should have shown an error right?17:40
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add linter jobs for releases file script  https://review.openstack.org/56828717:42
dsneddonsai_, Yes, I would expect so.17:42
sai_dsneddon: this is a 290 node deployment, not a great way to start :-)17:43
dsneddonsai_, The only thing I can think is that maybe the switch was acting weird when it first ran, or it was a fluke, etc.17:43
dsneddonsai_, BTW, you only need bridges on the interfaces where you are hosting Neutron tenant or provider VLANs.17:43
dsneddonsai_, You don't need a bridge on the Storage Management or Storage networks17:44
dsneddonsai_, What we usually do is just have an interface and a VLAN, and the VLAN has "device: <interface>" to indicate which interface the VLAN goes on.17:44
sai_dsneddon: ack, will keep in mind17:45
sai_dsneddon: i see error running /var/lib/heat-config/heat-config-script/32e7213e-4bc3-4e27-b336-b1f5017:46
sai_0b0999b17:46
sai_and looking athe filke17:46
sai_it seems to be doing the ent-config17:46
dsneddonsai_, Like this: http://paste.openstack.org/show/721036/17:47
dsneddonsai_, That will be the run-os-net-config.sh script running17:48
sai_dsneddon: can i run that manually and see what the error is? maybe theres abug here?17:49
dsneddonsai_, What that script does is write /etc/os-net-config/config.json and runs os-net-config.17:51
*** holser__ has joined #tripleo17:51
sai_hmm this is weird now, unsure how to proceed, deployment failed three times at same step17:51
*** holser___ has quit IRC17:51
*** thrash|biab is now known as thrash17:52
dsneddonsai_, Clearly the first part is happening (writing to os-net-config).17:52
dsneddonsai_, Wait a minute, you have the addresses: under the VLAN, those should be under the bridge17:53
*** elgxl has joined #tripleo17:53
dsneddonsai_, Or do I misunderstand your setup? All the networks are delivered over VLANs, but on different NICs?17:53
*** gyankum has quit IRC17:55
dsneddonsai_, No, you said they were Q-in-Q, so I guess that's intentional17:55
*** holser__ has quit IRC17:56
sai_dsneddon: yeh, this might not even be a switch issue right? doesnt even get to the point of pinging?17:56
EmilienMweshay: do we have someone looking at https://bugs.launchpad.net/tripleo/+bug/1768997 during this sprint?17:56
openstackLaunchpad bug 1768997 in tripleo "containerized-undercloud-upgrades: dlrn tasks don't run" [Critical,Triaged]17:56
weshayEmilienM, yes.. that is one of the use cases they are solving17:57
sai_dsneddon: all ports are in same serviceporivider vlan, just using customer vlan to isolate networks..maybe that is the issue? what if i have the other interfaces totally isolated from the provisioning interface, so they cant even dhcp?17:57
dsneddonsai_, You have the right idea (use_dhcp: false on the bridge), but I don't know why it's failing when it runs the script.17:58
*** elgxl has quit IRC17:58
dsneddonsai_, Try grepping recursively for os-net-config in /var/log17:59
dsneddonsai_, Or in the journalctl output17:59
*** tiswanso_ has joined #tripleo18:00
*** links has joined #tripleo18:00
dsneddonsai_, You can always modify run-os-net-config.sh script in tripleo-heat-templates/network/script if it turns out you need a sleep delay for the switch or something.18:00
sai_dsneddon: also, i have use_dhcp: fasle at bridge elvel and interface level..do i need it at both places (i gues si do right)18:01
*** salmankhan has joined #tripleo18:02
dsneddonsai_, Honestly it's just to make it clear what's happening. Unless you have use_dhcp: true, it defaults to false.18:02
sai_dsneddon: no errors :/ https://gist.githubusercontent.com/smalleni/72597bd0f2e2a4afa66a7bcfc22605d5/raw/0df657aacd970ade04abe8ee9749ac72a26ffc43/gistfile1.txt18:03
sai_dsneddon: ah ok18:03
*** tiswanso has quit IRC18:04
sai_dsneddon:  (heat-config) [ERROR] Error running /var/lib/heat-config/heat-config-script/32e7213e-4bc3-4e27-b336-b1f500b0999b doesnt say what the error was :/18:06
dsneddonsai_, To be clear, this node has em1, em2, em3, em4, p2p1, p2p2, p2p3, and p2p4, but only em1-em4 are supposed to be used, correct?18:10
sai_dsneddon: yes18:11
sai_other nics arent wired18:11
*** dougbtv_ has quit IRC18:11
*** ykarel|away has joined #tripleo18:12
*** florianf has quit IRC18:16
openstackgerritMerged openstack/tripleo-heat-templates master: Add fast_forward_upgrade_tasks in ironic services.  https://review.openstack.org/56784918:17
dsneddonsai_, It looks like the initial run of os-net-config failed to make 192.168.0.1 pingable: "echo '192.168.0.1 is not pingable."18:19
dsneddonsai_, So because of that, it ran this a few minutes later: os-net-config -c /etc/os-net-config/dhcp_all_interfaces.yaml -v --detailed-exit-codes --cleanup18:19
sai_dsneddon: so it tries to ping only once?18:20
sai_dsneddon: maybe when i reran the os-net-config command it succceded as ping was successful then18:21
*** ykarel|away has quit IRC18:22
dsneddonsai_, No, it tried and failed 10 times18:23
dsneddonsai_, I don't think that just running os-net-config will run the ping test, so it's possible that when you ran os-net-config by hand that 192.168.0.1 still isn't pingable18:24
*** holser__ has joined #tripleo18:28
*** dprince has quit IRC18:30
*** dprince has joined #tripleo18:30
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706018:32
*** holser__ has quit IRC18:32
dsneddonsai_, Can you check to see if 192.168.0.1 is pingable now that you ran os-net-config by hand?18:37
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: DNM: Stop openstack services before undercloud upgrade  https://review.openstack.org/56866718:39
sai_dsneddon: blew awa ythe env, will check on redeployment18:40
*** agopi has quit IRC18:41
dsneddonsai_, Do these nodes boot off of em2? I noticed that is where you are placing the control plane IP18:46
sai_dsneddon: yes, they pxe off em218:51
*** tiswanso_ has quit IRC18:52
*** tiswanso has joined #tripleo18:54
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add python script to dynamically compose releases  https://review.openstack.org/56752118:57
openstackgerritJohn Trowbridge proposed openstack-infra/tripleo-ci master: Add method for getting dlrn_hash from release and hash_name  https://review.openstack.org/56732018:57
*** suuuper has quit IRC18:57
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures  https://review.openstack.org/56867318:57
*** tiswanso has quit IRC18:58
*** dmsimard|off is now known as dmsimard18:58
*** ansmith has quit IRC18:59
*** pkovar has quit IRC18:59
openstackgerritJames Slagle proposed openstack/tripleo-common master: Ansible json error callback plugin  https://review.openstack.org/56693819:00
openstackgerritJames Slagle proposed openstack/tripleo-common master: Workflow and action for deployment failures  https://review.openstack.org/56731819:00
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment status  https://review.openstack.org/56434119:00
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures  https://review.openstack.org/56867319:00
openstackgerritJames Slagle proposed openstack/tripleo-common master: Ansible json error callback plugin  https://review.openstack.org/56693819:03
openstackgerritJames Slagle proposed openstack/tripleo-common master: Workflow and action for deployment failures  https://review.openstack.org/56731819:03
myoung|ruckweshay, mwhahaha: (queens) 2018-05-15 19:06:07,912 28001 INFO     promoter Promoting the container images for dlrn hash a7fbaca2a97adda856c3ba5d5166fb1665f02bc0 on queens to current-tripleo19:08
weshaynice19:08
myoung|ruck^^ if you have the blood of a chicken or a vial of unicorn tears to offer to the infra gods...now isn't a terrible time...19:09
myoung|ruck /me grins19:10
*** agopi has joined #tripleo19:10
*** holser__ has joined #tripleo19:11
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706019:15
*** holser__ has quit IRC19:16
openstackgerritJames Slagle proposed openstack/tripleo-common master: Set deployment_status from config_download_deploy  https://review.openstack.org/56695319:16
openstackgerritJames Slagle proposed openstack/tripleo-common master: Add workflow for plan deployment status  https://review.openstack.org/56431519:16
openstackgerritJames Slagle proposed openstack/tripleo-common master: Ansible json error callback plugin  https://review.openstack.org/56693819:16
openstackgerritJames Slagle proposed openstack/tripleo-common master: Workflow and action for deployment failures  https://review.openstack.org/56731819:16
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment status  https://review.openstack.org/56434119:16
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures  https://review.openstack.org/56867319:16
slaglei'm gettin good at git19:18
*** radeks__ has quit IRC19:19
*** radeks_ has quit IRC19:20
*** links has quit IRC19:20
*** tiswanso has joined #tripleo19:20
*** jaosorior has joined #tripleo19:21
*** tiswanso has quit IRC19:21
*** tiswanso has joined #tripleo19:21
*** agurenko has quit IRC19:25
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates stable/queens: Enable default polling interval override  https://review.openstack.org/56867719:26
bnemecHmm, undercloud install is failing on certmonger today: http://paste.openstack.org/show/721042/19:27
*** alee is now known as alee_afk19:27
*** cylopez has joined #tripleo19:29
EmilienMmwhahaha: can we approve https://review.openstack.org/#/c/568443/ and https://review.openstack.org/#/c/568340/ in the same time please?19:29
mwhahahak19:30
* mwhahaha rolls the dice with the CI gods19:30
EmilienMlol19:30
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing  https://review.openstack.org/56867919:31
*** cylopez has quit IRC19:31
EmilienMmwhahaha: and https://review.openstack.org/#/c/568343/19:31
EmilienMam I alone to have tempest failures today? http://logs.openstack.org/77/561377/78/check/tripleo-ci-centos-7-containers-multinode/3715d6c/logs/tempest.html.gz19:32
EmilienMmyoung|ruck ^ is there an ongoing issue?19:32
openstackgerritEmilien Macchi proposed openstack/tripleo-upgrade master: Cleanup on oc_roles var  https://review.openstack.org/56868019:37
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: (cleanup) remove usage of role_name  https://review.openstack.org/56834719:38
*** salmankhan has quit IRC19:39
myoung|ruckEmilienM: we've been working on a number of issues, i'm not certain about that specific tempest failure.   although last night we had a missing container that caused a gates failures so you might be tip of the spear...not sure yet19:42
*** shreshtha has quit IRC19:42
abishopmyoung|ruck: same failures after recheck http://logs.openstack.org/33/567833/2/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/f54dafa/logs/subnode-2/var/log/journal.txt.gz#_May_15_18_10_5419:44
EmilienMmyoung|ruck: ack I'll keep an eye19:44
*** shreshtha has joined #tripleo19:44
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706019:45
mcorneaEmilienM: fyi I started https://review.openstack.org/#/c/568679/ to replace the awk, I need to test it and replace all the occurences19:47
EmilienMwoot19:48
EmilienMmcornea: thanks :)19:48
EmilienMmcornea: really better19:48
EmilienMthanks19:48
weshayEmilienM, looks like neutron timed out creating the virt interface19:49
*** jtomasek has quit IRC19:51
weshayEmilienM, myoung|ruck ya.. so I would not expect queens to work until this promotion is done https://review.openstack.org/#/c/567833/19:52
weshayre: this review19:52
weshayEmilienM, queens and pike are DOWN19:53
weshayabishop, ^19:53
abishopweshay: I think https://review.openstack.org/568550 was the critical one19:53
weshayabishop, ok.. well that can be cherry picked in19:54
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Add basics for standalone node  https://review.openstack.org/56641919:54
myoung|ruckweshay, abishop, EmilienM: re queens promotion it's chugging along with container push now...it's pulled from rdoproject and has started to push containers --> docker.io19:55
abishopweshay: It was merged to queens, and the issue it fixed was never on pike19:55
weshayabishop, aye.. that's fine.. it's a puppet change no longer checked by tripleo until promotion jobs anyhooo19:55
weshayabishop, so when I say queens is down, I'm referring to the tripleo repos only19:56
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706020:01
openstackgerritEmilien Macchi proposed openstack/tripleo-quickstart master: Revert "Revert "Deploy container-multinode (fs010) with a containerized undercloud""  https://review.openstack.org/56026420:11
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Make standalone role name configurable  https://review.openstack.org/56837820:13
*** lblanchard has quit IRC20:16
EmilienMweshay: yeah: http://logs.openstack.org/77/561377/78/check/tripleo-ci-centos-7-containers-multinode/3715d6c/logs/subnode-2/var/log/containers/nova/nova-compute.log.txt.gz#_2018-05-15_19_05_13_68220:18
*** fragatina has quit IRC20:20
*** fragatina has joined #tripleo20:20
weshayEmilienM, yup20:20
weshaybut queens is fubar'd until we get new containers up20:20
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706020:23
*** agopi has quit IRC20:25
*** holser__ has joined #tripleo20:27
*** pchavva has quit IRC20:31
*** rbowen has quit IRC20:34
*** sshnaidm|bbl is now known as sshnaidm|rover20:42
*** gbarros has quit IRC20:46
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: Add dry run option to toci_quickstart  https://review.openstack.org/56706020:48
*** oneswig has joined #tripleo20:52
*** leanderthal has quit IRC20:53
*** raildo has quit IRC20:59
*** trown is now known as trown|outtypewww21:05
weshaydam.. all of metrics and monitoring is in europe21:10
weshayminus prad21:10
*** paramite_ has quit IRC21:10
weshaymwhahaha, can we skip list autoscale? http://logs.openstack.org/45/560445/29/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/6c9f8c0/logs/stackviz/#/stdin21:10
weshayscen01/02 are failing21:10
mwhahahayou mean the only test that actually tests something21:10
mwhahahasure21:10
mwhahahalet's just return 021:10
weshaylolz21:11
weshayok.. just asking21:11
mwhahahaurllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)21:11
weshaymwhahaha, you don't have to get Alex Schultz on me ;P21:11
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing  https://review.openstack.org/56869621:12
openstackgerritDan Sneddon proposed openstack/tripleo-heat-templates master: Add ability to pre-assign IPs by role on ctlplane  https://review.openstack.org/56850521:12
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing  https://review.openstack.org/56869621:13
mwhahahaweshay: i'd prefer we turned of ssl over disabling the test21:15
mwhahahathen we can throw things at juan tomorrow21:15
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing  https://review.openstack.org/56869621:15
mwhahahaweshay: it's likely something is supposed to be ssl enabeld but isn't. though this is happening in the gate right? or promotion21:16
weshaycheck and gate21:16
weshayafaict21:16
mwhahahaso what did we merge21:17
mwhahahawhen did it start21:17
weshaymyoung|ruck, fyi ^21:17
* weshay traces it back21:17
openstackgerritRoman Gorshunov proposed openstack/diskimage-builder master: Allow to rebuild arbitrary images  https://review.openstack.org/56869721:17
openstackgerritMarius Cornea proposed openstack/tripleo-upgrade master: WIP: Load roles list from yaml instead of awk parsing  https://review.openstack.org/56869621:18
weshaythis may help https://review.openstack.org/#/c/567667/221:19
weshayworked in check, failed in gate21:19
mwhahahaso something that merged today21:20
mwhahahaso nothing21:21
mwhahahabecause nothing merged between then21:21
*** holser__ has quit IRC21:21
mwhahahawhat the hell21:21
*** abishop has quit IRC21:21
mwhahahahttps://review.openstack.org/#/c/558424/21:21
mwhahahai bet it was that21:21
weshaymwhahaha, I'm checking on if containers changed at that time too21:22
mwhahahano it's probably that default endpoint map21:22
mwhahahagimme a bug so i can revert it21:22
weshaymyoung|ruck, ^21:22
weshayso that is tht21:22
weshayk.. may I update the files: config in zuul there?21:23
mwhahahayes21:23
weshayword up21:23
mwhahahanetwork/endpoints/ should get everything21:23
* myoung|ruck surfaces from logs and reads scrollback21:24
mwhahahai'll create a bug21:25
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Revert "Change default endpoint map entries to use TLS"  https://review.openstack.org/56869921:27
mwhahahaweshay, myoung|ruck -^21:27
weshaymyoung|ruck, the number is important, the details can come in a follow up21:29
myoung|ruckweshay: i might just be fuzzy because it's approaching dinner but I'm trying to parse that21:30
myoung|ruckyou mean a LP #?21:30
weshayya21:30
myoung|ruckk21:30
mwhahahai filed one21:32
mwhahahahttps://bugs.launchpad.net/tripleo/+bug/177143521:32
openstackLaunchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)21:32
weshaymwhahaha, thanks21:32
mwhahahaalready tagged that change with it as well21:33
openstackgerritwes hayutin proposed openstack/tripleo-heat-templates master: update tht jobs to include network/endpoints  https://review.openstack.org/56870021:33
* mwhahaha throws things at jaosorior 21:33
weshaymwhahaha, check my math on that21:33
myoung|ruck177143721:33
weshaymyoung|ruck, alex opened one21:33
* myoung|ruck gives up and picks up his kid21:33
myoung|ruckI'll be back in an hour21:33
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Run "overcloud container image prepare" only once  https://review.openstack.org/52862121:36
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Move BUILD_ID setting logic out of template  https://review.openstack.org/56839621:36
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: WIP Use "openstack tripleo container image prepare"  https://review.openstack.org/56840321:36
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Disable repo centos-qemu-ev  https://review.openstack.org/56870121:36
*** ssbarnea_ has quit IRC21:36
stevebakerweshay: hey, are you aware of this issue with the repo file for centos-qemu-ev? ^^21:37
*** ansmith has joined #tripleo21:37
weshaystevebaker, yes me checks on that21:38
weshaythere is a lp21:38
weshaystevebaker, think this is it https://bugs.launchpad.net/tripleo/+bug/177109021:39
openstackLaunchpad bug 1771090 in tripleo "Kolla fails to build containers for tripleo in Ci build-container job" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)21:39
*** akrivoka has quit IRC21:39
myoung|ruckweshay, stevebaker, yes https://bugs.launchpad.net/tripleo/+bug/1771090 is the qemu-ev issue21:42
openstackLaunchpad bug 1771090 in tripleo "Kolla fails to build containers for tripleo in Ci build-container job" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)21:42
weshaystevebaker would it be better to stat.. /etc/yum.re/CentOS-QEMU-EV.repo and if present disable? vs.. when: inventory_hostname == "subnode-021:42
stevebakerweshay: or maybe lets just populate /etc/yum/vars/contentdir21:43
*** dmsimard is now known as dmsimard|off21:43
weshayhrm.. not sure what you mean21:43
*** jcoufal has quit IRC21:44
stevebakerweshay: the problem is that $contentdir doesn't resolve to "centos" in that repo file, so maybe we can just write out "centos" to /etc/yum/vars/contentdir if that file is missing21:45
weshayk sec just educating myself21:46
*** tvignaud has quit IRC21:46
weshayit takes the cost of a cup of coffee you  know21:46
*** tvignaud has joined #tripleo21:47
stevebakeronly too well21:47
weshayah k21:48
weshaysimiliar to what I'm seeing... arch, basearch, infra etc21:48
weshayin http://logs.openstack.org/24/558424/30/check/tripleo-ci-centos-7-containers-multinode/9ab75d0/logs/undercloud/etc/yum/vars/21:48
stevebakerweshay: also, maybe this would go away if there was a centos 7.5 image tagged as latest in the RDO glance?21:50
weshaystevebaker, let me check if they released a qcow2 image21:50
weshayI don't think they did a few days ago.. that was part of our beef21:50
weshaydon't see one here http://cloud.centos.org/centos/7/images/21:52
weshayre: contentdir https://lists.centos.org/pipermail/centos-devel/2018-March/016542.html21:52
*** myoung|ruck is now known as myoung|ruck|afk21:53
*** Goneri has quit IRC21:53
weshaystevebaker, not sure if we know enough to populate the var atm w/o potentially breaking the ppc work coming up.. wdyt?  Seems like stage 1 safest is to disable the repo if detected21:54
*** dprince has quit IRC21:55
weshaybbl have to roll21:55
stevebakerweshay: yep ok, I'll give it a go21:56
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: Actually print the error during deployment fail  https://review.openstack.org/56870721:58
*** rcernin has joined #tripleo22:00
*** oneswig has quit IRC22:04
*** dhill_ has quit IRC22:10
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177143522:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)22:10
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Disable repo centos-qemu-ev  https://review.openstack.org/56870122:10
*** cdearborn has quit IRC22:16
*** pchavva has joined #tripleo22:20
*** wolverineav has quit IRC22:20
*** wolverineav has joined #tripleo22:21
mwhahahawhy do we have to disable the qemu repo in like 12 places22:22
* mwhahaha sighs22:22
*** slaweq has quit IRC22:23
*** slaweq has joined #tripleo22:23
*** wolverineav has quit IRC22:25
stevebakermwhahaha: ugh, my workaround doesn't work because the task that fails is the one which installs that file22:27
mwhahahaha22:27
stevebakermwhahaha: lets just implement the proper contentdir logic https://review.openstack.org/#/c/568239/2/docker/base/Dockerfile.j222:28
*** rpioso is now known as rpioso|afk22:28
* mwhahaha would like to wash his hands of yum repos22:29
mwhahahaand containers, and yaml and a lot of things really22:29
mwhahahastevebaker: aren't we getting that via infra? isn't there some DIB thing we need to update22:30
*** pchavva has quit IRC22:30
sai_dsneddon: hey i retrried and see this https://gist.githubusercontent.com/smalleni/98047cd80bc2373be244120f46e3c2a7/raw/765c134e9ac3c50ba44aa7f3fd3a004d68b31cf5/gistfile1.txt22:32
sai_same error right?22:32
sai_i can login to node and ping..hmm22:33
stevebakermwhahaha: hmm, I thought these jobs were starting with a vanilla centos-7 image. The image is whatever is labelled 'latest' in rdocloud22:33
mwhahahastevebaker: which jobs? multinode come from upstream infra and we've always inherited some repo cruft22:34
*** pchavva has joined #tripleo22:34
stevebakermwhahaha: gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master22:34
mwhahahastevebaker: ah so yes that's rdo cloud22:34
mwhahahabut i think the images are the same22:34
stevebakermwhahaha: specifically, me running a reproducer-quickstart.sh from ^^22:35
mwhahahayes so that's likely not to be the same22:35
dsneddonsai_, OK, great, now you can run "sudo os-net-config --debug -c /etc/os-net-config/config.json" and then see if you can ping 192.168.0.122:35
dsneddonsai_, That way we can narrow it down to whether the underlay network is not working, or whether the NICs just took a while to come up, or something else.22:35
sai_dsneddon: i logged in thru the control plaane ip and ran it so lost access :-)22:36
mwhahahastevebaker: but any of those centos mirrors should be disabled via https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/templates/repo_setup.sh.j2#L9822:36
mwhahahastevebaker: we overlay our own urls from the job config22:36
stevebakermwhahaha: its too late by then. The task which installs the broken repo file is the task which fails22:36
dsneddonsai_, I see two issues, one is that I see routes to 192.168.0.1, but I don't see any interfaces configured with 192.168.0.X addresses.22:37
*** bfournie has quit IRC22:37
mwhahahastevebaker: it's only the reproducer right?22:37
dsneddonsai_, The other problem I see is that I think I see two different default routes with 192.168.0.1 as the next hop, on different interfaces.22:37
stevebakermwhahaha: maybe its only in the reproducer, or RDO CI is failing earlier for other reasons so hasn't hit this yet22:39
*** pmannidi has joined #tripleo22:40
dsneddonsai_, Actually, there is only one default route, the network_config is just repeated twice.22:41
sai_dsneddon: yeh my control plane dhcp is 192.168.0.0/1622:41
sai_and UC ip is 192.168.0.122:41
dsneddonsai_, But I still don't see how 192.168.10.15 is supposed to get to 192.168.0.1. Did you have an incorrect entry for ControlPlaneDefaultRoute? Is that supposed to be 192.168.10.1?22:42
dsneddonsai_, Same problem with EC2MetadataIp22:42
sai_dsneddon: /16 right, im using 192.168.0.0/16 for control plane range22:43
* sai_ is worried if he missed something obvious22:43
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: Handle Docker rpm updates  https://review.openstack.org/56871422:44
stevebakerEmilienM: has that role been RPM packaged? ^^22:45
openstackgerritEmilien Macchi proposed openstack/ansible-role-container-registry master: Handle Docker rpm updates  https://review.openstack.org/56871422:45
dsneddonsai_, Nope, you need to set ControlPlaneSubnetCidr: '16' for that to work. Your control plane IP is getting configured as a /2422:45
EmilienMstevebaker: yep22:46
sai_dsneddon: crap!!!! i changed the dhcp range in undercloud.conf and expected that to take of stuff22:46
EmilienMstevebaker: you can deploy it with "yum install ansible-role-container-registry"22:46
stevebakerEmilienM: sweet. It installs to /etc/ansible/roles?22:47
sai_dsneddon: thanks a ton! maybe that was it22:47
EmilienMstevebaker: /usr/share/ansible/roles22:47
stevebakerok22:47
EmilienMstevebaker: https://github.com/openstack/ansible-role-container-registry/blob/master/setup.cfg#L2222:47
EmilienMstevebaker: I had to create a BZ to import in RDO etc22:48
EmilienMstevebaker: they have a process that works pretty well22:48
EmilienMbut before you need the repo in openstack, one sec22:48
*** tiswanso_ has joined #tripleo22:49
EmilienMstevebaker: https://review.openstack.org/#/q/ansible-role-container-registry and https://review.rdoproject.org/r/#/q/ansible-role-container-registry should help you22:49
stevebakerEmilienM: thanks22:49
EmilienMcool np22:49
EmilienMstevebaker: now I have a question for you :D22:50
EmilienMstevebaker: see https://review.openstack.org/#/c/561377/78/puppet/services/docker.yaml22:50
EmilienMI want to update update_tasks to use the exact same tasks from deploy_steps_tasks22:50
EmilienMI wanted to use get_attr, does it make sense?22:50
sai_dsneddon: aha, makes since why ping works after failed deploy on logging in manually22:51
*** tiswanso has quit IRC22:51
stevebakerEmilienM: in the same file?22:51
sai_dsneddon: because of dhcp range on undercloud22:51
EmilienMstevebaker: yes22:51
stevebakerEmilienM: that sounds like you want to use that yaml reference/anchor thing22:52
EmilienMuh what is that22:52
EmilienMotherwise I could have had a docker-base22:53
EmilienMbut it's really overkill22:53
EmilienMstevebaker: any example?22:53
stevebakerEmilienM: Look for & and * in docker/services/glance-api.yaml22:55
EmilienMohhh that22:55
EmilienMnow I remember, ok thanks22:55
EmilienMis it documented somewhere?22:55
EmilienMbut yeah, & is to set and * is to get22:56
EmilienMiiuc22:56
*** pchavva has quit IRC22:56
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: docker: cleanup update tasks  https://review.openstack.org/56871522:58
*** colonwq has quit IRC23:01
*** saneax-_-|AFK is now known as saneax23:01
EmilienMbnemec: where is designate actually tested? http://logs.openstack.org/07/555007/7/gate/tripleo-ci-centos-7-scenario003-multinode-oooq-container/e04283a/logs/tempest.html.gz23:01
EmilienMbnemec: you'll need to patch the featureset and add at least one designate test23:02
*** SamYaple has quit IRC23:02
*** wolverineav has joined #tripleo23:06
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/177143523:10
*** ooolpbot has quit IRC23:10
openstackLaunchpad bug 1771435 in tripleo "scenario001/002 failing on autoscaling with urllib3.exceptions.SSLError: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:579)" [Critical,In progress] - Assigned to Alex Schultz (alex-schultz)23:10
*** mcornea has quit IRC23:10
*** colonwq has joined #tripleo23:13
*** dxiri_ has joined #tripleo23:17
*** dxiri has quit IRC23:21
sai_dsneddon: setting the controlplanecidr to 16 fixed it, thanks!23:22
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir  https://review.openstack.org/56870123:23
openstackgerritJames Slagle proposed openstack/python-tripleoclient master: overcloud plan deployment failures  https://review.openstack.org/56867323:23
*** wolverineav has quit IRC23:25
*** wolverineav has joined #tripleo23:25
*** tosky has quit IRC23:26
EmilienMstevebaker: can you please review https://review.openstack.org/#/c/567384/ ?23:28
*** ssbarnea_ has joined #tripleo23:28
stevebakerEmilienM: I can!23:29
openstackgerritMerged openstack/tripleo-common master: Implement image customization during upload  https://review.openstack.org/56620723:29
openstackgerritMerged openstack/python-tripleoclient master: Cleanup dead code, build_service_filter mocking  https://review.openstack.org/56741323:29
openstackgerritMerged openstack/tripleo-common master: Persist package update ansible logs  https://review.openstack.org/56601823:29
*** wolverineav has quit IRC23:30
*** dxiri_ has quit IRC23:31
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add recover_deployment workflow  https://review.openstack.org/56669923:31
*** dxiri has joined #tripleo23:32
openstackgerritHonza Pokorny proposed openstack/tripleo-common master: Add recover_deployment workflow  https://review.openstack.org/56669923:33
*** rh-jelabarre has quit IRC23:33
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir  https://review.openstack.org/56870123:36
openstackgerritMerged openstack/python-tripleoclient master: Prepare call, add --modify-role and --modify-vars  https://review.openstack.org/56620923:37
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Call L3 checks before/after Role upgrade.  https://review.openstack.org/56860623:37
openstackgerritMerged openstack/puppet-tripleo stable/newton: [Newton Only] Fix getting live value of nova/neutron during update.  https://review.openstack.org/56855223:37
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir  https://review.openstack.org/56870123:38
*** liverpooler has quit IRC23:39
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: undercloud upgrade: include UndercloudUpgrade service  https://review.openstack.org/56871623:40
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir  https://review.openstack.org/56870123:43
openstackgerritRonelle Landy proposed openstack-infra/tripleo-ci master: DNM - Testing integration of releases script in toci  https://review.openstack.org/56871723:44
openstackgerritMerged openstack/instack-undercloud master: Remove ironic_host_manager usage  https://review.openstack.org/56582423:46
openstackgerritSteve Baker proposed openstack/tripleo-quickstart-extras master: Populate /etc/yum/vars/contentdir  https://review.openstack.org/56870123:50
*** elgxl has joined #tripleo23:52
*** elgxl has quit IRC23:57
*** bfournie has joined #tripleo23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!