Thursday, 2017-09-07

*** achadha has joined #tripleo00:02
*** achadha__ has quit IRC00:05
*** abishop has quit IRC00:08
*** ooolpbot has joined #tripleo00:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION00:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436100:10
*** ooolpbot has quit IRC00:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)00:10
*** ecerquei has joined #tripleo00:10
*** rhallisey has quit IRC00:16
*** itlinux has joined #tripleo00:18
*** catintheroof has joined #tripleo00:18
*** catintheroof has quit IRC00:31
openstackgerritMerged openstack/puppet-tripleo stable/newton: firewall: generally accept "jump" param and use tripleo:firewall for log rule  https://review.openstack.org/50101400:37
*** jcoufal has quit IRC00:39
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Add Neutron SR-IOV agent container  https://review.openstack.org/46906600:48
*** psahoo has joined #tripleo00:49
*** limao has joined #tripleo00:49
*** lblanchard has joined #tripleo00:55
*** dixiaoli has joined #tripleo00:57
*** dsneddon has quit IRC01:01
*** ecerquei has quit IRC01:02
*** achadha has quit IRC01:03
*** achadha has joined #tripleo01:03
*** achadha has quit IRC01:04
*** tzumainn has quit IRC01:05
*** achadha has joined #tripleo01:05
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add OS_REGION_NAME to clouds.yaml  https://review.openstack.org/49574501:07
openstackgerritMerged openstack/tripleo-heat-templates master: Change all references of nsx_v3 to nsx.  https://review.openstack.org/49814301:07
*** ooolpbot has joined #tripleo01:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION01:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436101:10
*** ooolpbot has quit IRC01:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)01:10
*** gbarros has joined #tripleo01:12
*** thrash is now known as thrash|g0ne01:27
*** gbarros has quit IRC01:31
*** dmacpher has joined #tripleo01:36
openstackgerritMerged openstack/tripleo-heat-templates stable/ocata: manila: set "neutron_admin_auth_url" correctly  https://review.openstack.org/50122501:40
openstackgerritMerged openstack/tripleo-common master: Add "tripleo-common-managed" to all workflows in tripleo_common  https://review.openstack.org/50131901:40
*** mgarciam has joined #tripleo01:40
openstackgerritMerged openstack/tripleo-common stable/pike: Use CephAnsibleDisksConfig when deriving HCI parameters  https://review.openstack.org/50078401:40
openstackgerritMerged openstack/tripleo-heat-templates master: Use containerized mongodb in scenario002-multinode-containers  https://review.openstack.org/50125501:40
openstackgerritTom Barron proposed openstack/tripleo-heat-templates stable/newton: manila: set "neutron_admin_auth_url" correctly  https://review.openstack.org/50151901:44
*** fzdarsky__ has joined #tripleo01:49
*** fzdarsky_ has quit IRC01:53
*** ooolpbot has joined #tripleo02:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION02:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436102:10
*** ooolpbot has quit IRC02:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)02:10
*** bkopilov has quit IRC02:10
*** yamahata has quit IRC02:15
*** rlandy|bbl is now known as rlandy02:29
*** rlandy has quit IRC02:33
*** japestinho has joined #tripleo02:37
*** itlinux has quit IRC02:37
*** itlinux has joined #tripleo02:40
*** itlinux has quit IRC02:41
*** mbeierl has quit IRC02:45
*** achadha has quit IRC02:50
*** mbeierl has joined #tripleo02:51
*** achadha has joined #tripleo02:54
*** dtrainor has quit IRC02:57
*** achadha has quit IRC02:59
*** ramishra has joined #tripleo03:00
*** brault has quit IRC03:09
*** ooolpbot has joined #tripleo03:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION03:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436103:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)03:10
*** ooolpbot has quit IRC03:10
*** lblanchard has quit IRC03:10
*** achadha has joined #tripleo03:12
*** dpawar has joined #tripleo03:17
*** itlinux has joined #tripleo03:19
*** jlabarre has quit IRC03:27
*** bkopilov has joined #tripleo03:28
*** ykarel has joined #tripleo03:42
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Use containerized mongodb in scenario002-multinode-containers  https://review.openstack.org/50155303:47
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/pike: Add "tripleo-common-managed" to all workflows in tripleo_common  https://review.openstack.org/50155403:47
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: fluentd: log configuration was not generated correctly  https://review.openstack.org/50155503:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Maintain ceph-osd package only on nodes hosting CephOSD service  https://review.openstack.org/50155703:48
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/pike: Use DeployedSSLCertificatePath for public TLS via certmonger  https://review.openstack.org/50155803:48
*** gkadam has joined #tripleo03:49
*** udesale has joined #tripleo03:50
*** dpawar has quit IRC03:51
*** dbecker has quit IRC03:54
*** cshastri has joined #tripleo03:54
*** dpawar has joined #tripleo03:55
EmilienMtrozet: looks like tempest failed on https://review.openstack.org/#/c/486905/04:01
EmilienMmichapma: ^04:01
EmilienMpabelanger: ci looks really green :D04:04
EmilienMthe only thing we miss now is a promotion https://dashboards.rdoproject.org/rdo-dev04:04
EmilienMand of course upgrade jobs working on scenarios04:05
*** dbecker has joined #tripleo04:08
*** ooolpbot has joined #tripleo04:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION04:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436104:10
*** ooolpbot has quit IRC04:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)04:10
*** garyk1 has joined #tripleo04:14
*** shreshtha has joined #tripleo04:14
*** yolanda has quit IRC04:15
*** jistr|off has quit IRC04:20
*** cinerama has quit IRC04:21
*** cinerama has joined #tripleo04:21
*** garyk has quit IRC04:21
*** garyk has joined #tripleo04:22
*** bandini has quit IRC04:24
*** jistr has joined #tripleo04:24
*** dpawar has quit IRC04:25
*** bandini has joined #tripleo04:26
*** dpawar has joined #tripleo04:46
*** yprokule has joined #tripleo04:46
*** jtomasek has joined #tripleo04:51
*** psachin has joined #tripleo04:51
*** janki has joined #tripleo04:55
*** pgadiya has joined #tripleo05:01
*** skramaja has joined #tripleo05:03
*** dsariel has joined #tripleo05:06
*** jprovazn has joined #tripleo05:07
*** noslzzp has quit IRC05:10
openstackgerritAparna proposed openstack/diskimage-builder master: Change to install a package in 'proliant-tools'  https://review.openstack.org/50156805:13
*** pcaruana has joined #tripleo05:15
*** ratailor has joined #tripleo05:18
*** pdeore has joined #tripleo05:18
*** marios has joined #tripleo05:23
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Change all references of nsx_v3 to nsx.  https://review.openstack.org/50094605:34
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Containerized mongodb, disable by default, fix upgrade  https://review.openstack.org/50112005:34
openstackgerritMerged openstack/tripleo-quickstart master: Install yum priorities after repo set up  https://review.openstack.org/50060105:34
*** dtrainor has joined #tripleo05:37
*** aditya_r has joined #tripleo05:38
*** jaosorior has joined #tripleo05:39
*** udesale__ has joined #tripleo05:40
*** udesale has quit IRC05:42
*** udesale has joined #tripleo05:42
*** ooolpbot has joined #tripleo05:44
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION05:44
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436105:44
*** ooolpbot has quit IRC05:44
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)05:44
*** udesale__ has quit IRC05:45
*** achadha has quit IRC05:47
*** marios has quit IRC05:53
*** iranzo has joined #tripleo05:53
*** iranzo has joined #tripleo05:53
*** marios has joined #tripleo05:55
openstackgerritAparna proposed openstack/diskimage-builder master: Change to install a package in 'proliant-tools'  https://review.openstack.org/50156805:56
*** achadha has joined #tripleo05:57
*** oanson has quit IRC05:58
openstackgerritJuan Badia Payno proposed openstack/tripleo-heat-templates master: docker: add logging(source & groups)  https://review.openstack.org/49952905:58
*** oanson has joined #tripleo05:59
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260706:00
*** marios has quit IRC06:00
*** marios has joined #tripleo06:02
*** agurenko has joined #tripleo06:04
*** aditya_r has quit IRC06:04
openstackgerritMerged openstack/tripleo-quickstart-extras master: Fix upgrade repo script  https://review.openstack.org/50117906:04
*** Vijayendra has joined #tripleo06:04
*** achadha has quit IRC06:09
*** paramite has joined #tripleo06:09
*** achadha has joined #tripleo06:09
*** ooolpbot has joined #tripleo06:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION06:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436106:10
*** ooolpbot has quit IRC06:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)06:10
*** achadha has quit IRC06:14
*** dparkes has joined #tripleo06:17
*** ccamacho has joined #tripleo06:24
*** aditya_r has joined #tripleo06:28
openstackgerritJan Provaznik proposed openstack/tripleo-docs master: Add note about NeutronNetworkVLANRanges for manila provider net  https://review.openstack.org/47876106:31
*** jaosorior has quit IRC06:33
*** marios has quit IRC06:37
*** jfrancoa has joined #tripleo06:39
*** zshi has quit IRC06:39
*** anshul has joined #tripleo06:44
Tenguhello there!06:45
*** brault has joined #tripleo06:46
*** nyechiel has joined #tripleo06:47
*** zshi has joined #tripleo06:49
*** pdeore_ has joined #tripleo06:50
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Define ceph image in overcloud_containers.yaml.j2  https://review.openstack.org/49982206:52
*** rcernin has joined #tripleo06:53
*** pdeore has quit IRC06:53
*** cylopez has joined #tripleo06:54
*** jlinkes has joined #tripleo06:54
*** mcornea has joined #tripleo06:56
openstackgerritJan Provaznik proposed openstack/tripleo-docs master: Add netwrok isolation notes about manila provider network  https://review.openstack.org/47876107:00
*** yprokule_ has joined #tripleo07:00
*** jaganathan has joined #tripleo07:01
*** gkadam is now known as gkadam-afk07:03
*** yprokule has quit IRC07:03
*** yprokule_ is now known as yprokule07:03
*** jpich has joined #tripleo07:03
*** agurenko has quit IRC07:04
*** ebarrera has joined #tripleo07:05
*** agurenko has joined #tripleo07:06
*** ooolpbot has joined #tripleo07:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION07:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436107:10
*** ooolpbot has quit IRC07:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)07:10
*** limao has quit IRC07:11
*** tesseract has joined #tripleo07:13
*** anshul has quit IRC07:14
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Tag workflows created by the templates  https://review.openstack.org/50159407:15
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Tag workflows created by the templates  https://review.openstack.org/50159407:16
openstackgerritMerged openstack/python-tripleoclient stable/pike: Adds when in upgrade_tasks playbook written by config download  https://review.openstack.org/50075107:22
*** dmacpher has quit IRC07:22
*** shardy has joined #tripleo07:22
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Check the role data flags and failed is missing  https://review.openstack.org/50160007:26
*** anshul has joined #tripleo07:27
openstackgerritSteven Hardy proposed openstack/tripleo-validations stable/pike: Lazy load the entire stack instead of single outputs  https://review.openstack.org/50160307:28
openstackgerritSteven Hardy proposed openstack/tripleo-validations stable/pike: Lazy load the entire stack instead of single outputs  https://review.openstack.org/50160307:29
openstackgerritMartin André proposed openstack/tripleo-quickstart master: Set -q option to ssh in ProxyCommand  https://review.openstack.org/45225807:29
shardymcornea: ^^ I pushed a patch yesterday but missed bnemec had already done something similar07:30
shardybackport proposed to pike of bnemec's patch, which I think should solve the inventory performance issues, or at least make it much better07:30
shardyflorianf: ^^ FYI there's the backport07:31
florianfshardy: Just saw that. +2 :-)07:31
florianfshardy: thanks07:31
mcorneashardy: thanks, I'll test it on my environment07:32
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Rename service_workflow_tasks into mistral_tasks  https://review.openstack.org/50160507:33
*** limao has joined #tripleo07:36
*** limao has quit IRC07:37
*** milan has joined #tripleo07:37
*** jpena|off is now known as jpena07:38
*** limao has joined #tripleo07:38
*** egonzalez has joined #tripleo07:41
shardyflorianf: I'm a bit confused why my quickstart environment installed yesterday didn't have the patch from bnemec, so will see if I can figure that out07:49
*** marios has joined #tripleo07:49
openstackgerritDougal Matthews proposed openstack/tripleo-common stable/pike: Add "tripleo-common-managed" to all workflows in tripleo_common  https://review.openstack.org/50155407:53
*** ioggstream has joined #tripleo07:54
*** masco has joined #tripleo07:55
mcorneashardy: looks better, it took 0m31.064s for a 1 ctrl + 1 compute env07:56
*** dbecker has quit IRC07:57
*** aufi has joined #tripleo07:58
*** dbecker has joined #tripleo07:59
*** liverpooler has joined #tripleo08:02
shardymcornea: Ok, my local testing with the patch I posted was faster than that, but it's probably different environments vs the two patches as the approach is similar08:02
shardyI'll confirm later to be sure08:03
shardymcornea: thanks for confirming, 75% improvement is a good start I guess :)08:03
shardymaybe we should write the stack outputs somewhere when the stack goes create complete08:03
shardythen we would just have to read a file08:03
mcorneashardy: yep, the upgrade non controller output doesn't appear to be stuck anymore08:04
mariosmcornea: matbu yprokule shardy: o/ fyi filed this as we discussed yesterday fyi https://bugs.launchpad.net/tripleo/+bug/171555708:04
openstackLaunchpad bug 1715557 in tripleo "Ansible based composable minor update workflow in Pike " [Critical,In progress] - Assigned to Marios Andreou (marios-b)08:04
mariosshardy: mcornea cool is that the delay in the inventory fixed, or the roleconfig output?08:04
shardymarios: ack thanks - we'll have to discuss with EmilienM and mwhahaha as I think we've run out of time to consider it a release blocker08:04
shardymarios: it was a fix to the inventory08:05
yprokulemarios: thanks08:05
shardymarios: I wrote a patch but florianf pointed out bnemec already did more or less the same thing08:05
mariosshardy: yeah, i think it will be the same as 'usual' i mean, upgrades/updates stuff will trail the release into the stable branch :/ not perfect but not sure what we can do about it, indeed i woulnd't want EmilienM on my case with that as a release blocker :)08:05
shardymarios, mcornea: we can probably do better but this is a decent improvement to start with08:05
shardymarios: Ok cool, yeah we can release and backport but just need to get it agreed etc08:06
shardythanks for raising the bug :)08:06
*** shardy is now known as shardy_afk08:06
mariosshardy: nice one on the /win 708:07
mariosshardy_afk: haha woops on the inventory08:07
marios:)08:07
*** anshul has quit IRC08:08
*** ooolpbot has joined #tripleo08:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION08:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436108:10
*** ooolpbot has quit IRC08:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)08:10
*** mcornea has quit IRC08:11
*** mcornea has joined #tripleo08:12
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Add support for deploying RGW with ceph-ansible  https://review.openstack.org/50162008:13
*** anshul has joined #tripleo08:13
openstackgerritMerged openstack/tripleo-validations stable/pike: Lazy load the entire stack instead of single outputs  https://review.openstack.org/50160308:16
*** jaosorior has joined #tripleo08:17
*** shreshtha has quit IRC08:19
*** aditya_r has quit IRC08:19
*** aditya_r has joined #tripleo08:20
*** liverpooler has quit IRC08:25
*** liverpooler has joined #tripleo08:25
* Tengu is proud to announce his script allowing to manage Let's Encrypt certificate across multiple controllers with the support of custodia on the undercloud is WORKING08:25
Tengu:)08:25
TenguI think I might submit it on a launchpad issue once I get the proper heat receipt.08:25
Tengujaosorior: heya! just finished my script :). I think it's pretty solid and shouldn't break the whole thing hopefully. I need to test it "for real" on a real cluster, but my current tests seem to say "all green" :).08:27
*** cschwede_ has joined #tripleo08:27
*** dpawar has quit IRC08:27
openstackgerritDougal Matthews proposed openstack/instack-undercloud master: Only delete workflows with the tripleo-common-managed tag  https://review.openstack.org/50132608:28
d0ugalgfidente: ^08:30
*** lucas-afk is now known as lucasagomes08:31
*** yprokule_ has joined #tripleo08:32
jaosoriorTengu: nice!!08:33
Tengu:)08:34
Tengunoe I have to do the heat thing.08:34
Tengu*now08:34
*** yprokule has quit IRC08:34
*** yprokule_ is now known as yprokule08:34
*** masco_ has joined #tripleo08:36
*** hewbrocca_afk is now known as hewbrocca08:37
*** masco has quit IRC08:38
*** tosky has joined #tripleo08:41
Tengujaosorior: I even have a nice name : "certodia" :)08:41
*** athomas has joined #tripleo08:43
jaosoriorTengu: lol08:43
jaosoriorTengu: looking forward for that writeup :P08:43
*** derekh has joined #tripleo08:45
*** dpawar has joined #tripleo08:46
Tengusmall question: with OS::Heat::SoftwareConfig and "get_file", where is pushed the file? I'd need to get the content in a path we can actually know…08:46
*** garyk1 has quit IRC08:47
Tenguhmm, or I may use a "group: ansible" and go through ansible.08:48
jaosoriorshardy_afk: ^^08:48
jaosoriorTengu: I'm honestly not sure.08:48
TenguI might be able to use ansible instead. not that hard :).08:48
*** snecklifter has joined #tripleo08:49
Tenguduh… nope, not ansible, as it's executed locally.08:50
* Tengu digs08:50
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Wrap IPv6 addresses in square brackets  https://review.openstack.org/49444208:50
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Parse DSN strings with regex  https://review.openstack.org/49444108:50
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Provide LOCAL_IP_WRAPPED as a instack env variable  https://review.openstack.org/49444008:50
*** jaosorior has quit IRC08:50
Tenguok, I can serve my script through the undercloud's httpd, pushing it in /var/www/html/ - this is for the default vhost. probably will answer when we hit it by the IP instead of a name08:52
Tengucorrect.08:52
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Check the role data flags and failed is missing  https://review.openstack.org/50160008:53
gfidenteTengu you can actually run ansible from the undercloud08:54
gfidenteif you make a mistral workflow which heat can run08:54
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Support for Ocata-Pike live-migration over ssh  https://review.openstack.org/50121308:54
gfidentethe worklow runs on the undercloud and can trigger ansible to configure the overcloud nodes08:54
Tengugfidente: well, my knowledge about all that stuff isn't sufficiant for that, I'm afraid :08:55
Tengugfidente: but that shure would be smarter…08:56
Tengu*sure08:56
gfidentesmarter then what?08:56
Tenguthan curl-ing the file through http08:56
Tengugfidente: is it hard to add a new mistral workflow to the "openstack overcloud deploy" stuff ?08:57
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Check the role data flags and failed is missing  https://review.openstack.org/50160008:57
*** leseb has quit IRC08:58
gfidenteTengu it's a section you can use to describe how to deploy a service08:59
gfidentehttps://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/ceph-ansible/ceph-base.yaml#L169-L18008:59
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: Add defaults for ceilometer-agent-compute upgrade tasks  https://review.openstack.org/50163708:59
d0ugalTengu: What do you want to add?08:59
Tengugfidente: hmm. ok.08:59
gfidenteTengu I think another example is for kubernetes where the playbook itself is described in the template https://review.openstack.org/#/c/471759/66/extraconfig/services/kubernetes-master.yaml09:00
Tengud0ugal: a "simple" script must be deployed on the controllers, and a cron.daily file must also be created.09:00
gfidenteTengu but if you just have to download a file09:00
*** garyk1 has joined #tripleo09:00
gfidenteTengu I think it's not smarter :D09:00
Tengugfidente: download and add a file in /etc/cron.daily - that can be done easily (already done in a previous version)09:00
d0ugalTengu: This is for Queens, right?09:01
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: Add defaults for ceilometer-agent-compute upgrade tasks  https://review.openstack.org/50163709:01
Tengugfidente: well, I don't really like the idea of unsecure download, even on the provisioning network ;)09:01
Tengud0ugal: nope, on Pike09:01
d0ugalTengu: oh, it is really late in the cycle for that09:02
d0ugalDo you have a FFE?09:02
Tengud0ugal: ah, na, not for upstream (not now at least) ;)09:02
d0ugalah09:02
*** shreshtha has joined #tripleo09:02
TenguI'm not (yet?) a contributor ;)09:02
TenguI'm just trying to get my let's encrypt certificate on our three controllers. might interest other ppl for later release, but it's still under dev/tests.09:03
Tengugfidente: si you'd say "go with a "script" in OS::Heat::SoftwareConfig and curl your script" ?09:04
*** leseb has joined #tripleo09:04
gfidenteTengu you can also pass the certificate with a param to heat and provision it on the nodes09:05
gfidenteto avoid the 'download' effect09:05
Tenguoh ?09:05
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: Add defaults for ceilometer-agent-compute upgrade tasks  https://review.openstack.org/50163709:05
*** ooolpbot has joined #tripleo09:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION09:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436109:10
*** ooolpbot has quit IRC09:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)09:10
gfidenteTengu you can pass the cert content as a heat parameter, write a shell script which decodes the cert and in heat append the cert contents to the shell script to deploy with SoftwareConfig09:12
Tengugfidente: nope, I don't want to pass any certificate.09:12
Tenguanyway, I'll go with the curl for now.09:13
Tenguand passing a 200+ line script as a param isn't a solution ;).09:13
*** masco_ is now known as masco09:13
*** suuuper has joined #tripleo09:13
*** achadha has joined #tripleo09:15
*** stendulker has joined #tripleo09:16
*** mrch has joined #tripleo09:21
openstackgerritAdriano Petrich proposed openstack/instack-undercloud master: Add an hourly cron trigger for tripleo-ui logging  https://review.openstack.org/46960809:21
*** yamahata has joined #tripleo09:22
*** achadha has quit IRC09:24
*** psahoo has quit IRC09:26
*** marios has quit IRC09:27
*** marios has joined #tripleo09:28
*** jfrancoa has quit IRC09:30
*** dpawar has quit IRC09:33
*** achadha has joined #tripleo09:33
*** gkadam_ has joined #tripleo09:34
*** gkadam-afk has quit IRC09:36
*** cshastri has quit IRC09:37
*** achadha has quit IRC09:37
*** limao has quit IRC09:37
*** psachin has quit IRC09:43
*** achadha has joined #tripleo09:47
*** jaosorior has joined #tripleo09:47
*** dpawar has joined #tripleo09:47
*** jfrancoa has joined #tripleo09:48
*** achadha has quit IRC09:53
*** dpawar has quit IRC09:56
*** cshastri has joined #tripleo09:57
*** jfrancoa has quit IRC10:00
*** achadha has joined #tripleo10:01
*** akrivoka has joined #tripleo10:01
*** dtantsur|afk is now known as dtantsur10:05
*** shardy_afk is now known as shardy10:05
dtantsurhamzy: hi! etingof (not in this channel) will work on agent_ipmitool (or rather its new-style equivalent) support this cycle.10:06
*** achadha has quit IRC10:07
*** ooolpbot has joined #tripleo10:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION10:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436110:10
*** ooolpbot has quit IRC10:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)10:10
*** oanson has quit IRC10:16
*** jfrancoa has joined #tripleo10:16
*** oanson has joined #tripleo10:18
*** achadha has joined #tripleo10:20
*** achadha has quit IRC10:25
owalshmarios: does my comment on https://review.openstack.org/#/c/501213/3 make sense :-)10:31
openstackgerritSteven Hardy proposed openstack/python-tripleoclient stable/pike: Consume new RoleConfig data in config download  https://review.openstack.org/50166610:33
*** dpawar has joined #tripleo10:34
*** achadha has joined #tripleo10:35
openstackgerritSteven Hardy proposed openstack/python-tripleoclient stable/pike: Consume new RoleConfig data in config download  https://review.openstack.org/50166610:36
mariosowalsh: checking thanks10:40
*** jkilpatr has quit IRC10:40
mariosowalsh: yeah thanks for explaining, so the migrationssh*d*port vs migrationsshport was not incidental (no d) i.e. one is for the sshd and the other for the ssh client10:42
jaosoriorlarsks: It seems this is the model that Common Logging is expecting to receive https://github.com/ViaQ/fluent-plugin-viaq_data_model10:43
*** achadha has quit IRC10:45
openstackgerritRaoul Scarazzini proposed openstack/tripleo-quickstart-extras master: Remove validate-ha from available roles  https://review.openstack.org/50080610:46
*** bkopilov has quit IRC10:48
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart-extras master: WIP: Increase the value of tempest config 'validation.ping_count' to 3  https://review.openstack.org/50081510:49
openstackgerritFlorian Fuchs proposed openstack/tripleo-ui master: Exclude outdated validation results from list  https://review.openstack.org/50121410:50
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: DO NOT REVIEW : TESTING ONLY  https://review.openstack.org/50060910:50
*** aditya_r has quit IRC10:50
*** jpena is now known as jpena|lunch10:57
*** achadha has joined #tripleo10:58
*** snecklifter has quit IRC11:03
*** achadha has quit IRC11:03
*** snecklifter has joined #tripleo11:03
*** udesale has quit IRC11:04
*** gkadam__ has joined #tripleo11:05
*** ccamacho has quit IRC11:06
*** cshastri has quit IRC11:07
*** gkadam_ has quit IRC11:07
*** ooolpbot has joined #tripleo11:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION11:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436111:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)11:10
*** ooolpbot has quit IRC11:10
owalshmarios: yea, initially just has migrationsshport but for docker we had to run sshd on a different port to leave the baremetal sshd on 2211:14
*** achadha has joined #tripleo11:14
*** kristaps_ is now known as lvdombrkr11:14
*** ebarrera has quit IRC11:14
*** ebarrera has joined #tripleo11:15
openstackgerritMerged openstack/tripleo-heat-templates master: Add Neutron SR-IOV agent container  https://review.openstack.org/46906611:15
*** jkilpatr has joined #tripleo11:15
lvdombrkrfolks, who can assist enable ssl on overcloud? i added certeficates to enable-tls.yaml and inject-trust-anchor.yaml add both to deploy command but after deployment i have only http11:16
*** psachin has joined #tripleo11:16
*** ioggstream has quit IRC11:17
openstackgerritOliver Walsh proposed openstack/puppet-tripleo master: Support for Ocata-Pike live-migration over ssh  https://review.openstack.org/50120411:20
*** jjung has joined #tripleo11:20
jaosoriorlvdombrkr: I could help with that. First of though, here's the docs http://tripleo.org/install/advanced_deployment/ssl.html#overcloud-ssl (might be useful for future reference)11:21
jaosoriorlvdombrkr: second: I'm pretty sure this is what you missed http://tripleo.org/install/advanced_deployment/ssl.html#deploying-an-ssl-environment11:22
owalshmarios: BTW do we have rolling upgrades of computes yet? I'm testing live-migration between a 1 baremetal and 1 docker compute for now, which is why I missed that11:22
*** achadha has quit IRC11:22
*** cshastri has joined #tripleo11:22
owalshmarios: as a Pike baremetal compute will have sshd listening on both 22 and 202211:22
openstackgerritOliver Walsh proposed openstack/tripleo-heat-templates master: Support for Ocata-Pike live-migration over ssh  https://review.openstack.org/50121311:23
openstackgerritMerged openstack/tripleo-common master: Added a kolla config file for building contaner images with qemu uid  https://review.openstack.org/49905311:24
lvdombrkrjaosorior: if i have  PublicVirtualFixedIPs: in my network-env.yaml already i dont need to add any tls-endpoints-public-ip.yaml ?11:25
*** stendulker_ has joined #tripleo11:26
jaosoriorlvdombrkr: ??11:26
jaosoriorlvdombrkr: sure, the PublicvirtualFixedIPs bit is fine. But you do need to tell tripleo somehow what endpoints should be using TLS (and if it should be using an IP for those endpoints or a DNS name), which is what tls-endpoints-public-ip.yaml is for.11:27
mariosowalsh: no, it will still be operator driven upgrades for the computes (the existing upgrade-non-controller.sh) just now it will run playbooks (upgrade_tasks then deployment_steps) rather than the static script we had before11:27
jaosoriorlvdombrkr: was there something in the documentation that wasn't very clear? I can fix it up if needed. Would really appreciate the feedback.11:27
owalshmarios: ack, might shake out some other issues with the live migration setup but I *think* we should be good now11:27
owalshmarios: unless selinux bite us11:28
*** achadha has joined #tripleo11:28
mariosack thanks owalsh will revisit the review (and didn't check puppet side yet)11:29
*** stendulker has quit IRC11:29
owalshmarios: don't worry.. it just as evil/genius11:29
marios:D11:30
*** stendulker_ has quit IRC11:31
openstackgerritMerged openstack/tripleo-heat-templates master: Add support for deploying RGW with ceph-ansible  https://review.openstack.org/48080411:32
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Use DeployedSSLCertificatePath for public TLS via certmonger  https://review.openstack.org/50155811:32
*** jaganathan has quit IRC11:32
*** lucasagomes is now known as lucas-hungry11:32
lvdombrkrjaosorior: thanks, tls-endpoints-public-ip.yaml was what i miseed11:36
*** achadha has quit IRC11:36
*** rhallisey has joined #tripleo11:37
jaosoriorlvdombrkr: great; if there's anything that you think should be included in the SSL docs, let me know.11:37
skramajashardy: stevebaker could you take a look at https://review.openstack.org/#/c/500475/?11:38
*** thrash|g0ne is now known as thrash11:40
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add CephConfigOverrides to allow arbitrary configs in ceph.conf  https://review.openstack.org/50113311:40
*** mrch has quit IRC11:41
*** garyk1 has quit IRC11:41
*** garyk has quit IRC11:41
*** achadha has joined #tripleo11:42
*** garyk has joined #tripleo11:42
*** garyk1 has joined #tripleo11:42
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Add CephConfigOverrides to allow arbitrary configs in ceph.conf  https://review.openstack.org/50113311:43
shardyskramaja: ack, done11:43
skramajathanks11:43
*** liverpooler has quit IRC11:44
*** dixiaoli has quit IRC11:45
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates stable/pike: Add CephExternal role for ceph-ansible  https://review.openstack.org/50058111:46
openstackgerritSaravanan KR proposed openstack/tripleo-common stable/pike: Added a kolla config file for building contaner images with qemu uid  https://review.openstack.org/50169611:47
*** shreshtha has quit IRC11:47
lvdombrkrjaosorior: when i will enable my ssl ( now its deploys) i will give you feedback )11:47
jaosoriorlvdombrkr++11:48
*** achadha has quit IRC11:52
*** jlabarre has joined #tripleo11:53
*** raildo has joined #tripleo11:55
openstackgerritBrent Eagles proposed openstack/tripleo-common stable/pike: Add SRIOV container image parameter generation  https://review.openstack.org/50169911:56
*** achadha has joined #tripleo11:57
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates stable/pike: Add Neutron SR-IOV agent container  https://review.openstack.org/50170011:57
*** rbowen has joined #tripleo12:01
*** pkovar has joined #tripleo12:01
shardyflorianf: Hey so I confirmed tripleo-validations is missing from the current-tripleo whitelist we define in tripleo-quickstart, wanted to confirm that is wrong, as I'm about to push a patch which will switch to testing master instead for tripleo-ci/master ?12:02
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/pike: Define ceph image in overcloud_containers.yaml.j2  https://review.openstack.org/50170212:03
shardyI'm not sure we even test validations in the promotion pipeline, but I'm thinking we want openstack-tripleo* in the whitelist so everything tripleo related is installed from trunk in ci12:04
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/pike: Define ceph image in overcloud_containers.yaml.j2  https://review.openstack.org/50170212:04
*** ansmith has quit IRC12:04
*** jpena|lunch is now known as jpena12:05
*** abishop has joined #tripleo12:05
*** achadha has quit IRC12:05
*** pgadiya has quit IRC12:06
*** bkopilov has joined #tripleo12:06
*** jaganathan has joined #tripleo12:07
openstackgerritMerged openstack/tripleo-common master: Define ceph image in overcloud_containers.yaml.j2  https://review.openstack.org/49982212:08
florianfshardy: I'm not really familiar with the purpose of the whitelist, but testing master in ci sounds about right.12:08
*** jlabarre has quit IRC12:08
shardyflorianf: Ok, I'll push the patch - basically it defines what we test from trunk vs periodic promotions in CI (and what developers see when they install tripleo-ci/master via quickstart)12:09
shardyflorianf: this is why I didn't see bnemec's patch yesterday, I thought quickstart gave me trunk tripleo-validations12:09
* shardy should admittedly have pulled the git tree and checked ;)12:10
*** ooolpbot has joined #tripleo12:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION12:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436112:10
*** ooolpbot has quit IRC12:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)12:10
*** lucas-hungry is now known as lucasagomes12:10
*** catintheroof has joined #tripleo12:11
*** achadha has joined #tripleo12:11
rcerninshardy: quick question need to double check, if you are scaling out with new node, you already have 5 nodes and want to add 6th, but one of those 5 nodes is in maintenance, do you still use 6 for the scale?12:12
*** mrch has joined #tripleo12:12
florianfshardy: oh, right, thanks for the explanation. it now makes sense to me :-)12:12
*** jlabarre has joined #tripleo12:13
rcerninshardy: so during scale out you actually have only 5nodes available but in nova you would have 6 nodes in total wouldnt that cause problem?12:13
shardyrcernin: is the node in maintenance already deployed?12:13
rcerninshardy: its already deployed12:13
shardydtantsur: ^^ can you confirm, if nova deployed an ironic node, then it's set to maintenance, it'll still be ACTIVE in nova, right?12:14
dtantsurshardy: yep12:14
shardyrcernin: I think it should be ignored, as heat doesn't check the status on update, but even if you did it sounds like it wouldn't be a problem12:14
dtantsurit won't be picked for further deploys, but the existing instances are left as they are12:14
shardydtantsur: ack thanks for confirming! :)12:14
dtantsurnp12:14
shardyrcernin: so it sounds like it should be fine provided there's another 6th node in ironic available12:15
rcerninshardy: so even ironic has 5 nodes available, use 6 because of nova.12:15
*** jaosorior has quit IRC12:15
rcernini was wondering if compute-scale is taking in account ironic+nova or just ironic or just nova because the number is not matching because the node in ironic already deployed in nova is in maintenance12:16
shardyrcernin: yes heat/nova will still treat it as active12:16
shardyrcernin: it could be that we have a validation which sees a mismatched count, are you seeing an error?12:17
rcerninshardy: there is mismatched count reported :(12:19
*** achadha has quit IRC12:19
*** noslzzp has joined #tripleo12:19
rcerninshardy: says only 5 of 6 requested ironic nodes available12:19
shardyrcernin: Ok so that sounds like a validation bug, we should count nodes in maintenance mode if they have an instance id associated12:19
shardyrcernin: can you raise a bug and perhaps try --validation-errors-nonfatal as a temporary workaround?12:21
*** pkovar has quit IRC12:21
rcerninshardy: will try. and will raise a bz12:22
*** tzumainn has joined #tripleo12:24
shardyrcernin: sounds good, thanks!12:24
*** maeca has joined #tripleo12:24
*** achadha has joined #tripleo12:24
openstackgerritMerged openstack/tripleo-heat-templates master: Add tags to baremetal cron removal tasks  https://review.openstack.org/49793612:26
openstackgerritMerged openstack/tripleo-heat-templates master: Add tags in upgrade_tasks for mongodb services.  https://review.openstack.org/50118912:28
openstackgerritMerged openstack/tripleo-heat-templates master: Add yaml validation for upgrade_tasks section.  https://review.openstack.org/49794012:28
*** pkovar has joined #tripleo12:29
*** aditya_r has joined #tripleo12:30
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates stable/pike: Add tags in upgrade_tasks for mongodb services.  https://review.openstack.org/50171512:32
*** lblanchard has joined #tripleo12:32
*** catintheroof has quit IRC12:33
*** rlandy has joined #tripleo12:33
openstackgerritSteven Hardy proposed openstack/tripleo-quickstart master: Use wildcard in delorean-current whitelist  https://review.openstack.org/50171612:33
shardyflorianf: ^^12:33
florianfshardy: thanks! lgtm12:34
*** garyk has quit IRC12:34
*** trown|outtypewww is now known as trown12:34
*** ratailor has quit IRC12:34
*** achadha has quit IRC12:35
*** catintheroof has joined #tripleo12:38
*** ccamacho has joined #tripleo12:39
ccamachoHey EmilienM, quick question, there is no bug associated to this patch https://review.openstack.org/#/c/501715/ but is a bug-fix that jfrancoa pushed, can we backport it?12:40
*** achadha has joined #tripleo12:40
*** gkadam__ has quit IRC12:40
shardyccamacho: No, a bug reference should really be added for every backport, so we can track what's in each release after branching12:42
shardyit's not a huge issue, but personally I'd raise a bug, amend the comment message, then merge it12:42
*** leitan has joined #tripleo12:43
ccamachosure shardy, thanks I'll raise the bug12:43
shardyccamacho: thanks!12:43
*** Vijayendra has quit IRC12:43
shardyccamacho: if it's not a release blocker, please target to queens-1 and tag pike-backport-potential12:44
*** jaosorior has joined #tripleo12:44
*** aditya_r has quit IRC12:48
*** jtomasek has quit IRC12:48
*** jtomasek has joined #tripleo12:49
*** achadha has quit IRC12:49
*** garyk1 has quit IRC12:50
*** nyechiel has quit IRC12:50
lvdombrkrjaosorior: Overcloud Endpoint: https://10.74.0.233:13000/v2.0 but actually i cant reach it... i nothing change in tls-endpoints-public-ip.yaml leave by default its ok?12:51
*** Goneri has joined #tripleo12:51
jaosoriorlvdombrkr: what's the error you get?12:52
*** dprince has joined #tripleo12:54
openstackgerritCarlos Camacho proposed openstack/tripleo-heat-templates stable/pike: Add tags in upgrade_tasks for mongodb services.  https://review.openstack.org/50171512:54
*** achadha has joined #tripleo12:54
*** jmelvin has joined #tripleo12:54
*** liverpooler has joined #tripleo12:54
weshaymatbu, we have an escalation on board for upgrades.  Please get it assigned to someone asap https://trello.com/c/M7VAs2cd12:56
*** pdeore_ has quit IRC12:56
lvdombrkrjaosorior: its a loading for a while (10 seconds, and after that The connection has timed out, The server at 10.74.0.233 is taking too long to respond.)12:56
*** cshastri has quit IRC12:57
jaosoriorlvdombrkr: log into the controller; what do you see as the haproxy configuration?12:57
jaosoriorlvdombrkr: also, check if haproxy is listening on that IP on that port12:57
matbuweshay: yep thank you12:58
chandankumarmwhahaha: please have a look https://review.openstack.org/#/c/501668/13:00
*** raildo has quit IRC13:02
*** nyechiel has joined #tripleo13:03
*** dpawar has quit IRC13:03
*** raildo has joined #tripleo13:03
*** achadha has quit IRC13:04
lvdombrkrjaosorior: i loged into controller it not listne 13000 port at all13:04
*** ansmith has joined #tripleo13:04
jaosoriorlvdombrkr: what about the configuration /etc/haproxy/haproxy.cfg ; does it state that it should be listening on 13000 ?13:05
*** udesale has joined #tripleo13:07
lvdombrkrjaosorior: you can look into http://paste.openstack.org/raw/620623/13:09
*** pchavva has joined #tripleo13:10
*** ooolpbot has joined #tripleo13:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION13:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436113:10
*** ooolpbot has quit IRC13:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)13:10
jaosoriorlvdombrkr: so it didn't enable TLS. Can you tell me how you deployed? Is it containerized or not? what release is it?13:10
skramajadprince: could you take a look at https://review.openstack.org/#/c/499086/ and https://review.openstack.org/#/c/500475/? these will close the dpdk issues.13:11
*** achadha has joined #tripleo13:12
*** jlinkes has quit IRC13:13
*** skramaja has quit IRC13:13
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Add support for deploying RGW with ceph-ansible  https://review.openstack.org/50162013:14
*** jlinkes has joined #tripleo13:14
*** jlinkes_ has joined #tripleo13:14
*** toure_biab is now known as toure13:15
*** shardy has quit IRC13:15
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: Check the role data flags and failed is missing  https://review.openstack.org/50160013:16
*** achadha has quit IRC13:16
lvdombrkrjaosorior: ocata, not containerized, deploy command penstack overcloud deploy --templates -e one.yaml -e netnew.yaml -e network-isolation.yaml -e inject-trust-anchor.yaml -e enable-tls.yaml -e tls-endpoints-public-ip.yaml  --compute-scale 0  (tls-endpoints-public-ip.yaml leave by default)13:17
*** jlinkes has quit IRC13:18
openstackgerritHonza Pokorny proposed openstack/tripleo-ui master: Document how to test a production build  https://review.openstack.org/47653713:18
*** shardy has joined #tripleo13:19
*** itlinux has quit IRC13:19
*** jjung has quit IRC13:20
*** raildo has quit IRC13:20
*** jjung has joined #tripleo13:21
beaglesis there a known issue with the rdo-kolla-build-integration job for pike on tripleo-common?13:22
*** achadha has joined #tripleo13:23
beaglespabelanger: ^ ?13:24
*** jjung has quit IRC13:25
*** jlabarre has quit IRC13:27
*** catintheroof has quit IRC13:27
*** jlabarre has joined #tripleo13:27
*** catintheroof has joined #tripleo13:27
*** sshnaidm|off is now known as sshnaidm13:28
openstackgerritMarios Andreou proposed openstack/python-tripleoclient master: WIP: invoke minor update playbooks  https://review.openstack.org/50172613:29
shardymarios, matbu: Hey when you get a moment please can you check https://review.openstack.org/#/c/501666/ - pike backport of the RoleConfig download patch, passed CI13:29
dprinceshardy: I had some concerns on this one https://review.openstack.org/#/c/500475/13:30
*** dpawar has joined #tripleo13:30
mariosshardy: ack joining call now but will do13:30
*** achadha has quit IRC13:31
shardydprince: ack, np, admittedly I didn't locally test that one13:31
*** raildo has joined #tripleo13:31
*** dpawar has quit IRC13:32
*** gbarros has joined #tripleo13:32
dprinceshardy: I could be missing something, but I don't think this lines up to me13:33
lvdombrkrjaosorior: maybe i can provide more logs or any helpfull information?13:34
*** raildo has quit IRC13:35
*** garyk has joined #tripleo13:35
*** achadha has joined #tripleo13:36
*** raildo has joined #tripleo13:36
*** catintheroof has quit IRC13:37
*** catintheroof has joined #tripleo13:37
*** dpawar has joined #tripleo13:39
adarazstrown, sshnaidm, weshay, gchamoul|afk, rlandy, arxcruz, mwhahaha: Hi folks, CI Squad meeting in 50 minutes and 30 seconds: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting -- add agenda items if necessary.13:39
*** catintheroof has quit IRC13:39
*** catintheroof has joined #tripleo13:40
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: WIP: Delete and disable pacemaker resource only once during upgrade  https://review.openstack.org/50173413:40
jaosoriorlvdombrkr: can you go to a controller and do    sudo hiera -c /etc/puppet/hiera.yaml  tripleo::haproxy::service_certificate13:41
*** udesale has quit IRC13:41
*** f13o has joined #tripleo13:42
*** f13o has quit IRC13:42
lvdombrkrjaosorior: i get output: nil13:44
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814813:45
jaosoriorlvdombrkr: what's the contents of enable-tls.yaml ?13:45
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates master: WIP scenario001-multinode-oooq-container host doesn't need ceph package  https://review.openstack.org/50174313:48
lvdombrkrjaosorior: http://paste.openstack.org/raw/620626/13:48
bnemecshardy: Just a note on the inventory performance, with convergence enabled it only took me 7 seconds to build the inventory.13:48
bnemecWhich seems like a more acceptable amount of time.13:48
bnemecSo once we flip the switch on convergence, hopefully this cycle, we should be in better shape.13:48
shardybnemec: yeah there were some changes around storing outputs which IIRC didn't get applied to the legacy path13:49
shardybnemec: yeah, sounds like it's time13:49
shardySo update re https://bugs.launchpad.net/tripleo/+bug/1714361 for anyone following13:49
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)13:49
shardyit does indeed seem we're installing pike versions of a ton of different openstack pieces13:50
jaosoriorlvdombrkr: check the value of /usr/share/openstack-tripleo-heat-templates/environments/enable-tls.yaml   and add to your enable-tls.yaml what's missing, which is the resource_registry override13:50
shardyhttps://paste.fedoraproject.org/paste/D02YwdsmUX4zCKaV9lgF6g13:50
*** achadha has quit IRC13:50
trozetdtantsur: hi seeing an issue with introspection where the baremetal node pxe boots OK and gets DHCP, eventually boots into the ironic python agent kernel, but then when the kernel starts it fails to dhcp.  Have you seen this before?13:51
dtantsurno, to be honest13:51
shardyI'm currently thinking the quickest solution is to figure out the subset we should ignore from delorean-pike-testing (e.g anything that's in delorean-current) and add an exclude to the yum repo config13:51
shardyjust excluding openstack* would be a good start I guess13:52
shardyapetrich: ^^ FYI13:52
trozetdtantsur: the one thing i see when i tcpdump is there is another server on that subnet which is constantly requesting a new dhcp address from the introspection dnsmasq service13:53
lvdombrkrjaosorior: in inject-trust-anchor.yaml also need something add?13:53
*** shreshtha has joined #tripleo13:53
trozetdtantsur: i was wondering why there is no mac filtering for hte introspection?  I see firewall enabled in the introspection conf.  This is ocata13:53
lvdombrkr jaosorior: add in both13:54
lvdombrkr jaosorior: now i can re-deploy?13:54
jaosoriorlvdombrkr: right, inject-trust-anchor.yaml needed one as well13:55
jaosoriorlvdombrkr: yes, you can redeploy13:55
*** pradk has joined #tripleo13:57
*** ansmith has quit IRC13:57
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: WIP create default settings for environment types  https://review.openstack.org/49540713:58
*** achadha has joined #tripleo14:00
openstackgerritAttila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK for quickstart-extras  https://review.openstack.org/47260714:00
*** apevec has joined #tripleo14:01
dtantsurtrozet: there is no mac filtering, as we don't always know the macs14:02
rcerninshardy: if we are scaling out is there any way to discover which compute-%index% is the next one for heat? I tried look it up in the DB but failed to find it.14:02
openstackgerritMerged openstack/tripleo-heat-templates master: Add CephExternal role for ceph-ansible  https://review.openstack.org/49962714:02
dtantsurtrozet: otherwise it's a bad sign. there may also be another DHCP server.. why isn't this network isolated?14:02
openstackgerritMerged openstack/tripleo-ui master: Imported Translations from Zanata  https://review.openstack.org/50075814:02
openstackgerritMerged openstack/python-tripleoclient master: Write breakpoint cleanup env to swift  https://review.openstack.org/45070914:02
apevecmwhahaha, EmilienM - https://review.openstack.org/500916 was pointed out to me, since it included some features which is not stable policy kosher...14:02
openstackgerritMarius Cornea proposed openstack/tripleo-heat-templates master: WIP: Delete and disable pacemaker resource only once during upgrade  https://review.openstack.org/50173414:03
apevecso questions: do we really need tripleo-common with tags: stable:follows-policy ?14:03
trozetdtantsur: yeah, this is an opnfv user's setup.  I asked these questions.  But going back to the mac filtering.  The deployment dhcp agent in neutron will mac filter because we provide the mac with the instackenv.json...shouldnt ironic introspection do the same?14:03
shardyrcernin: yes, basically it's the N+1 count, unless node-delete has deleted the N+1 node (which you can tell by doing openstack stack environment show overcloud, then looking at ComputeRemovalPolicies, that is the blacklist written by node delete to exlude a node index)14:03
apevecmwhahaha, EmilienM and why is tripleo-common in u-c at all since it is never pip installed (afaik) but always used from rdo RPM ?14:04
*** achadha has quit IRC14:04
dtantsurtrozet: no, because we don't know 1. if your MAC list is present, 2. if it's correct, 3. if it's complete14:04
mwhahahaapevec: i think that's our tripleo policy the problem being that we're trailing as well so there would be why we end up in this situation14:04
dtantsurthat's the differnent with deployment, where we can assume all 314:04
mwhahahaapevec: we include it in requirements so it needs to be u-c14:04
*** trown is now known as trown|brb14:04
trozetdtantsur: but couldnt you check each node and if all have mac then enable filtering?14:04
shardyrcernin: to see the current indexes, you can do openstack stack resource show overcloud Compute14:04
shardyrcernin: then openstack stack resource list <physical resource id of the Compute ResourceGroup above>14:05
dtantsurtrozet: nobody guarantees that the MAC is correct (for several definitions of "correct")14:05
shardythe index is the resource name in the "Compute" ResourceGroup14:05
dtantsurand a bogus DHCP server will break you in any case14:05
shardyrcernin: I did discuss this with owalsh recently, and it might be nice to add a workflow that just figures out the next index and displays it14:06
shardybut for now you have to figure it out by hand14:06
trozetdtantsur: well then that is user error.  THe deployment will then fail at introspection instead of deployment..14:06
marioswin 614:06
apevecmwhahaha, which project has tripleo-common in its reqs ? Is it really pip installed?14:07
dtantsurtrozet: people tend to dislike introspection hanging for an unclear reasons, especially DHCP problems..14:07
mwhahahaapevec: instack-undercloud i think, tht as well14:07
rcerninshardy++ meaning the node delete doesnt actually blacklist the ids?14:08
owalshrcernin: it does14:08
rcerninshardy: because i can see in nova compute-23 but in resources its 20, is the next one 21 or 24 or something else?14:08
trozetdtantsur: ok these are dell r270 machines...i'm guessing these should work just fine14:08
shardyrcernin: No, it does permanently blacklist the ID, but you can see that via the overcloud environment show | grep ComputeRemovalPolicies14:08
shardyrcernin: so say you deployed 1.2.3 and node deleted 3, then scale out will use 414:09
mwhahahaapevec: python-tripleoclient and THT have tripleo-common in their requirements14:09
trozetdtantsur: dell r720*14:09
openstackgerritJohn Fulton proposed openstack/tripleo-common master: WIP Update ceph-ansible workbook to default to different playbook  https://review.openstack.org/50174814:09
apevecmwhahaha, but is it ever pip installed?14:09
*** trown|brb is now known as trown14:09
rcerninshardy: many deployments happened, but resource type Compute shows resource id 20, i m kind of confused because the compute nodes contains also 23 index14:10
shardyrcernin: is this using HostnameMap to override the default Hostname pattern?14:10
rcerninshardy: yes14:10
*** ooolpbot has joined #tripleo14:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION14:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436114:10
*** ooolpbot has quit IRC14:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)14:10
*** ansmith has joined #tripleo14:10
shardyrcernin: Ok, then the resource index matches the keys in HostnameMap, the nova hostname will match the valies14:10
shardyvalues14:10
openstackgerritJohn Fulton proposed openstack/tripleo-common master: WIP Update ceph-ansible workbook to default to different playbook  https://review.openstack.org/50174814:10
shardyrcernin: we just map the hostname heat would have generated to the one the operator asks for14:11
rcerninshardy: there is ComputeHostnameFormat and NovaComputeSchedulerHints capabilities:node: 'compute-%index%14:11
*** ccamacho has quit IRC14:11
shardyrcernin: yup but there is also HostnameMap?14:11
*** ykarel has quit IRC14:11
rcerninshardy: nope.14:12
owalshrcernin: then does it matter? If we are mapping the hostnames using HostnameMap then we need to know14:13
shardyrcernin: Ok, can you please paste the resource list output for the Compute ResourceGroup, and the values in ComputeRemovalPolicies from stack environment show?14:13
shardyrcernin: and the nova list | grep compute14:13
rcerninowalsh: if you specify the capabilities:node and the name wont match the nova created one?14:13
owalshrcernin: ah, gotcha14:14
*** agurenko has quit IRC14:14
*** achadha has joined #tripleo14:14
sshnaidmweshay, all problems with gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv is timeouts, we just don't have enough time to run upgrades, I don't see any other issues right now14:15
weshaysshnaidm, crud14:16
sshnaidmweshay, 66% passed, 33% failed because timeout14:16
hewbroccasshnaidm: shardy was looking at ways to speed things up14:17
hewbroccadon't know how far he god14:17
weshaysshnaidm, so as UA you and I should start thinking about alternatives for upgrades.. e.g. running upgrades as third party in rdo software factory only, and other options14:17
owalshrcernin, shardy; might need 'openstack stack show overcloud | grep RemovalPolicies' to check the blacklisted ids. IIRC environment show didn't output it but I could be mis-remembering14:17
sshnaidmweshay, yeah..14:17
sshnaidmbut before I'd like to know why upgrades are running as they are..14:17
shardyhewbrocca, sshnaidm: I posted https://review.openstack.org/#/c/500942/ which shows we can remove about 15mins from the OVB HA job which has also been a common cause of timeouts lately14:18
mwhahahaapevec: for testing, tripleo-common is mostly a library.14:18
shardynot yet looked at the -containers-upgrades one tho14:18
sshnaidmshardy, we run upgrades on multinode14:18
weshaysshnaidm, shardy has anyone thought about deploying with a limited number of services via a composable deployment?14:18
rcerninshardy: PM14:18
shardysshnaidm: Yeah, but it's the same problem - if we reduce the number of services, the deploy time falls14:18
sshnaidmshardy, weshay maybe you know - why do we run 2 upgrades? http://logs.openstack.org/06/501006/3/check/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/b158876/logs/undercloud/home/jenkins/overcloud-upgrade.sh14:19
mwhahahaapevec: in order to satisfy the requirements job it has to be in u-c and since we do pip install it for testing....14:19
shardysshnaidm: so perhaps we can reduce the number of services, and get coverage via scenarios instead of one job that deploys nearly everything?14:19
weshayshardy, always ahead of everyone :)14:19
sshnaidmshardy, need to check what this job deploys, because we have scenarios jobs too, and they fail too14:20
shardysshnaidm: The first one does the upgrade, the second one is the "converge" which completes the upgrade and unpins nova RPC14:20
*** achadha has quit IRC14:20
shardysshnaidm: yeah, we'll have to figure out the matrix and reduce the amount of overlap14:20
numansI want to debug a CI failure in tripleo job for OVN. Is it possible to login to the undercloud node or the gate machine ? Can some one point me if it is possible ?14:21
*** ebarrera has quit IRC14:21
rcerninshardy: owalsh: if the resource 20 is the max and the compute removal policies contains 21, the next one is 22 right?14:21
shardyweshay: yeah that's pretty much what we do already for scenarios, but some of the older jobs are still "kitchen sink" ones which try to deploy nearly everything14:21
shardyweshay: we have the capability to have either roles or environments to override that tho14:22
shardybut we'll have to be careful to ensure the overall coverage is still OK14:22
sshnaidmshardy, it deploys: https://github.com/openstack/tripleo-heat-templates/blob/5b805cb37eec3097552314c6ce43c02c2a604d81/ci/environments/multinode-containers.yaml14:22
numansEmilienM, shardy hi, you have any idea on my above query ?14:22
rcerninwhat confuses me is that index 23 is already used.14:22
*** ebarrera has joined #tripleo14:22
shardysshnaidm: ack - do we know if ceph deployed there gets upgraded in CI?14:24
shardygfidente: ^^14:24
sshnaidmshardy, weshay oh, sorry, I'm so slow today.. EmilienM meant problem with repos, that we don't use mirrors there (because upgrades role use weird ways to set up repos)14:24
sshnaidmshardy, weshay so if we move everything to AFS mirrors, we can earn some time for us I suppose14:24
sshnaidmweshay, will open a bug about it ^^14:25
*** achadha has joined #tripleo14:25
shardysshnaidm: ack, yeah if there's any mirror fixes we can do that will help14:25
sshnaidmgreat14:25
*** mrch has quit IRC14:25
shardymaybe start with that, then we can chat again about the matrix and maybe reducing the services?14:25
shardyother than ceph and perhaps heat/cinder I'm not sure what we can remove from the multinode-containers env14:26
sshnaidmshardy, yeah, makes sense14:26
shardyI'll take a look at the scenarios and push another wip test to compare times14:26
owalshrcernin: yea, that's odd. shardy, any ideas?14:28
gfidenteshardy sshnaidm sorry wasn't following14:28
gfidenteI think multinode-containers is still using puppet-ceph14:28
gfidentebut I'd be fine switching it to ceph-ansible as well14:29
gfidenteif that helps/makes sense14:29
*** cylopez has quit IRC14:29
lvdombrkrjaosorior:thanks, it works perfectly14:29
sshnaidmbnemec, can you please join tripleo-ci squad mtg today?14:30
shardyrcernin, owalsh: yeah it's strange, am I missing something or is the ResourceGroup missing index 6?14:30
shardye.g not just 2114:30
sshnaidmbnemec, it start right now on https://bluejeans.com/u/whayutin/14:30
shardyThere's also no cld-compute-6 which is kind of confusing14:31
owalshshardy: removal policy gets replaced each time a node is removed?14:31
bnemecsshnaidm: For a little while.  I have another meeting in half an hour.14:31
shardyowalsh: yeah let me check the code, I think we store the blacklist in the DB, but it seems we may replace the property every node delete14:32
sshnaidmbnemec, we'll discuss it right now14:32
adarazsweshay, rlandy: ci squad meeting14:32
sshnaidmbnemec, you're prioritized! :)14:32
*** achadha has quit IRC14:33
jaosoriorlvdombrkr: great!14:33
shardyrcernin: do you have any shell history or logs to prove/disprove that node delete was run previously for nodes other than 21?14:35
*** janki has quit IRC14:36
*** achadha has joined #tripleo14:38
shardyrcernin, owalsh: so yeah this looks like a bug, in heat we append to the blacklist here:14:40
shardyhttps://github.com/openstack/heat/blob/master/heat/engine/resources/openstack/heat/resource_group.py#L329..L33314:40
shardybut in tripleo-common we must be overwriting the property, so it's not visible what the current blacklist is14:40
shardyhttps://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/scale.py#L10814:41
owalshsshnaidm: just noticed that an ovb-ha-oooq timeout because it's building images: http://logs.openstack.org/13/501213/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/f56acb4/console.html#_2017-09-07_12_18_52_27241014:41
owalshsshnaidm: not sure why it's build images though (looking), nothing I've changed should trigger this AFAIK14:43
dhill_shardy,  ?14:45
dhill_shardy, have you ever seen this : {"deploy_stdout": "", "deploy_stderr": "exception: connect failed\n\u001b[1;31mError: Resource type oslo::cache doesn't exist on node ?14:45
dhill_shardy, and howdy, how are you? :)14:45
shardydhill_: yes, it means there is a missing puppet module14:46
dhill_shardy, it's there ?14:46
dhill_shardy, I can see it14:46
shardyhrm14:46
*** achadha has quit IRC14:46
dhill_shardy, but I can't see it being included in the deployment14:47
dhill_shardy, /var/lib/heat-config/heat-config-puppet/d9bab5f8-c2c0-403d-8cf3-f3598d03421d.pp14:47
dhill_shardy,  should it be included in there?14:47
shardydhill_: yeah but it's probably included by something we do include14:47
shardyit's a chain of dependencies between manifests/modules14:47
dhill_shardy, would it be included in one of these?14:48
dhill_include tripleo::profile::base::nova::conductor14:48
dhill_include tripleo::profile::base::nova::api14:48
dhill_include tripleo::profile::base::nova::scheduler14:48
dhill_include tripleo::profile::base::nova::consoleauth14:48
dhill_include tripleo::profile::base::nova::vncproxy14:48
dhill_sorry for copy/paste :)14:48
shardydhill_: hard to say without grepping or running that .pp with --debug14:49
dhill_ok14:49
shardyit's probably included by a few things14:49
shardydhill_: if the module is there, are permissions/selinux enabling it to be read OK?14:50
dhill_shardy, selinux is in permissive14:50
lvdombrkrjaosorior: quick question about overcloud deploy, if i want before deployment change some overcloud controller settings ( for example set cpu_mode=host-passthrough) where i can it specify in undercloud? i hope my question is clear )14:51
*** iranzo has quit IRC14:51
*** iranzo has joined #tripleo14:51
dhill_shardy, I don't get much more information by adding --debug14:51
dhill_shardy,  /var/lib/heat-config/hooks/puppet --debug < /var/lib/heat-config/deployed/d9bab5f8-c2c0-403d-8cf3-f3598d03421d.json ?14:52
dhill_shardy, I do get something like "[2017-09-07 14:51:36,044] (heat-config) [INFO] exception: connect failed" though14:52
jaosoriorlvdombrkr: I'm honestly not sure.14:53
*** achadha has joined #tripleo14:53
shardydhill_: no you'd need to run puppet apply --debug /var/lib/heat-config/heat-config-puppet/d9bab5f8-c2c0-403d-8cf3-f3598d03421d.pp14:54
dhill_yeah I just did ;)14:54
dhill_shardy, sorry it took me some times14:54
shardydhill_: ack, and you added the current step to a file under /etc/puppet/hieradata?14:54
*** limao has joined #tripleo14:54
shardythat should give some more clues14:55
dhill_shardy, I ran the whole command line with --debug after puppet apply14:55
dhill_shardy, ESC[0;36mDebug: importing '/etc/puppet/modules/keystone/manifests/deps.pp' in environment productionESC[0m14:55
dhill_ESC[0;36mDebug: Automatically imported keystone::deps from keystone/deps into productionESC[0m14:55
dhill_ESC[1;31mError: Resource type oslo::cache doesn't exist on node tls-overcloud-controller-0.localdomainESC[0m14:55
dhill_ESC[1;31mError: Resource type oslo::cache doesn't exist on node tls-overcloud-controller-0.localdomainESC[0m14:55
dhill_~14:55
*** gbarros has quit IRC14:55
lvdombrkrjaosorior: okey, thanks anyway14:55
*** gbarros has joined #tripleo14:56
dhill_shardy, I get "exception: connect failed" somewhere though...14:57
bnemeclvdombrkr: Assuming it's exposed as a puppet parameter, you can use NovaComputeExtraConfig to set it.  For example: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/rh1-env.yaml#n3314:57
owalshsshnaidm: I'm guessing the fact that the change Depends-On a puppet-tripleo change is the trigger, sound right?14:58
*** limao_ has joined #tripleo14:58
*** limao has quit IRC14:59
dhill_shardy, seems like /etc/puppet doesn't contain that class14:59
sshnaidmowalsh, we build in these situations: https://github.com/openstack-infra/tripleo-ci/blob/1e0099dc0beaee4bf6884fcd27820aab92492c1e/scripts/to_build15:00
*** dougbtv has quit IRC15:01
sshnaidmowalsh, you have tripleo-common changes: http://logs.openstack.org/13/501213/4/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq/f56acb4/console.html#_2017-09-07_11_39_08_29945515:01
owalshlvdombrkr: you mean deploying to VMs and want to change the cpu_mode on that VM before deploying to it?15:02
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Update the masquerade script to support IPv6  https://review.openstack.org/49701515:03
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Assert that IPv6 ctlplane networks should be /64  https://review.openstack.org/50176315:03
owalshsshnaidm: so *any* tripleo-common changes trigger it... hrmm, I might just remove that depends on to get around it...15:03
*** ansmith has quit IRC15:04
lvdombrkrowalsh: no i mean, when i deploy overcloud controller, now i manually ssh controller and change in nova.conf  cpu_mode=host-passthrough but i want to do it before deployment, not manually15:05
owalshlvdombrkr: you mean during deployment, not before?15:06
*** mcornea has quit IRC15:06
*** achadha has quit IRC15:07
owalshlvdombrkr: we do that in CI e.g https://github.com/openstack/tripleo-heat-templates/blob/master/ci/environments/multinode.yaml#L6515:08
numansmwhahaha, hi15:08
*** jlabarre has quit IRC15:08
lvdombrkrowalsh: yea, thats was my question and i got answer, thanks!15:09
lvdombrkrbnemec: thanks, now its clear for me15:10
lvdombrkr!15:10
shardydhill_: Ok so if it's missing from /etc/puppet/modules I'd check there isn't a mismatch between the tripleo-heat-templates version and either the image used (deploy/scale) or repos configured (upgrade/update)15:10
*** ooolpbot has joined #tripleo15:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION15:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436115:10
*** ooolpbot has quit IRC15:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)15:10
dhill_shardy, it looks like everything's up to date15:10
*** jlabarre has joined #tripleo15:10
dhill_shardy, I'll double check that15:11
dhill_shardy, thank you sir15:11
shardydhill_: np, good luck :)15:12
*** Goneri has quit IRC15:13
*** anshul has quit IRC15:13
openstackgerritMerged openstack/tripleo-ui stable/pike: Imported Translations from Zanata  https://review.openstack.org/50119515:15
*** dougbtv has joined #tripleo15:15
*** jmelvin has quit IRC15:18
*** yprokule has quit IRC15:19
*** limao has joined #tripleo15:20
*** achadha has joined #tripleo15:20
*** limao_ has quit IRC15:21
lvdombrkrguys, why there is pre-installed docker in overcloud and undercloud if there no containers used?15:23
owalshlvdombrkr: it's the same image that's deployed15:25
*** achadha has quit IRC15:25
lvdombrkrowalsh: sorry?15:26
owalshlvdombrkr: overcloud-full is deployed in both cases15:26
owalshlvdombrkr: it contains *everything*15:27
*** itlinux has joined #tripleo15:27
owalshlvdombrkr: then is configured to be a controller, compute, etc...  with or without containers15:27
openstackgerritMerged openstack/tripleo-heat-templates master: Mount vhost_sockets directory for vhost-user socket creation  https://review.openstack.org/49908615:27
*** dprince has quit IRC15:28
lvdombrkrowalsh: thanks, its clear!15:28
mwhahahanumans: what's up?15:28
numansmwhahaha, hi, i am trying to debug a CI job for OVN15:28
numansmwhahaha, is there a way to login to the gate machine ?15:29
mwhahahanumans: no15:29
numansmwhahaha, oh ok. this is the review - https://review.openstack.org/#/c/500609/15:29
numansmwhahaha, thanks. i was wondering if there is.15:29
*** nyechiel has quit IRC15:30
*** gbarros has quit IRC15:30
*** achadha has joined #tripleo15:30
mwhahahanumans: ok I'll take a look in a bit as I'm currently on mobile15:30
numansmwhahaha, yeah sure.15:30
*** jlabarre has quit IRC15:30
*** jlinkes__ has joined #tripleo15:32
*** jlabarre has joined #tripleo15:32
*** nyechiel has joined #tripleo15:33
*** jlinkes_ has quit IRC15:35
owalshnumans: http://logs.openstack.org/09/500609/4/check/gate-tripleo-ci-centos-7-scenario007-multinode-oooq/b195a40/console.html#_2017-09-07_13_31_56_78382315:37
*** dsneddon has joined #tripleo15:37
owalshsshnaidm, numans: exiting with 143 usually means timeout IIRC15:38
numansowalsh, hi,15:38
dhill_ping mwhahaha15:39
mwhahahadhill_: what's up15:39
numansowalsh, ok. yes i could see that it is timing out when the tempest test  cleanup runs in "GET v2/security-groups/.." API15:39
dhill_mwhahaha, I get this weird error where keystone::deps tries to call Oslo::Cache and it fails15:39
*** Goneri has joined #tripleo15:39
dhill_mwhahaha, Debug: importing '/etc/puppet/modules/keystone/manifests/deps.pp' in environment production15:39
dhill_Debug: Automatically imported keystone::deps from keystone/deps into production15:39
dhill_Error: Resource type oslo::cache doesn't exist on node tls-overcloud-controller-0.localdomain15:39
dhill_Error: Resource type oslo::cache doesn't exist on node tls-overcloud-controller-0.localdomain15:39
*** achadha has quit IRC15:40
mwhahahaSounds like old versions15:40
numansowalsh, it happens only with OVN and not with ML2ovs. not sure why it is timing out. looking into the neutron logs also isn' t helping.15:40
dhill_mwhahaha, yeah it is15:41
*** rlandy is now known as rlandy|PTO15:41
dhill_mwhahaha,  puppet apply --debug -e "Oslo::Cache<||> -> Anchor['keystone::service::begin']"15:42
dhill_returns the same15:42
*** jmelvin has joined #tripleo15:42
pradkcan i get some reviews on https://review.openstack.org/#/c/501339/15:42
itlinuxhi pradk:15:44
pradkhello15:45
sshnaidmowalsh, yes, tempest was stuck:http://logs.openstack.org/09/500609/4/check/gate-tripleo-ci-centos-7-scenario007-multinode-oooq/b195a40/logs/undercloud/home/jenkins/tempest_output.log.txt.gz15:46
itlinuxcan I ask a quick question on what I need to get gnocchi from a client running the openstack clients.. I put export the PORT which is on 13041 https.. but it fails to respond.. I get an error..15:46
itlinuxsaying auth..15:47
itlinuxso I tried to use OS_TOKEN but still not luck!15:47
itlinuxI got the rc from Horzion when I log in..15:47
pradkitlinux, so you want to do use 'openstack metric ...' ?15:48
itlinuxyes or gnocchi show metric etc..15:48
owalshsshnaidm: yea, just spotted that15:48
pradkitlinux, it should be the usual stackrc or overcloudrc . with auth url, user, password/token15:48
itlinuxit works from the UC.. but the Dev team will not have access to the UC..15:48
owalshnumans: guess finding out which test gets stuck might provide some more info15:49
itlinuxyes it does so you are saying that if I use openstack metrics it will work if I use gnocchi it will not ..15:49
*** marios has quit IRC15:49
itlinuxok I will test it out..15:49
shardymwhahaha: Hey, when referencing a definition via an anchor like here:15:49
shardyhttps://github.com/openstack/puppet-keystone/blob/master/manifests/deps.pp#L2915:49
*** achadha has joined #tripleo15:50
shardywhat does puppet need to load the definition from oslo/cache.pp?15:50
*** jlinkes__ has quit IRC15:50
shardymwhahaha: I see Debug: Automatically imported oslo::cache from oslo/cache into production but dhill_ has an environment where a puppet apply fails doing this:15:50
owalshnumans: this one maybe https://github.com/openstack/tempest/blob/master/tempest/scenario/test_network_basic_ops.py#L41615:50
pradkitlinux, both should work.. gnocchi client uses the same credentials if they are in env, but you can use osc as thats the preferred way15:50
shardypuppet apply --debug -e "Oslo::Cache<||> -> Anchor['keystone::service::begin']"15:50
dhill_shardy, I have the same issue with Oslo::Db if I coment out Oslo::Cache15:50
*** iranzo has quit IRC15:50
shardydhill_: thanks, I'm assuming the cause is the same15:51
owalshnumans: wrong MTU might explain it15:51
itlinuxpradk: this is what I have http://paste.openstack.org/show/620646/ ..15:51
itlinuxcropped the last part..15:51
shardydhill_: can you paste cat /etc/puppet/modules/oslo/manifests/cache.pp somewhere please?15:51
*** dparkes has quit IRC15:51
dhill_shardy, it's in "nova" here ?15:52
shardydhill_: sure, but a bunch of things reference the definition, none of them work, right?15:52
dhill_shardy, https://pastebin.com/4gbPcnh715:52
dhill_shardy, probably15:53
shardydhill_: No I mean run exactly "cat /etc/puppet/modules/oslo/manifests/cache.pp"15:53
dhill_shardy, it doesn't exist15:53
shardysigh15:53
dhill_shardy, it's in /etc/puppet/modules/nova/manifests/cache.pp15:53
shardydhill_: that's not the same file15:53
dhill_shardy, grrr15:53
pradkitlinux, make sure all these match whats in gnocchi.conf15:54
*** gbarros has joined #tripleo15:54
shardyI asked before if /etc/puppet/modules/oslo/manifests/cache.pp existed15:54
shardyI thought you said yes, sorry if I misunderstood :(15:54
dhill_shardy, so we missed a symlink?15:54
shardydhill_: that's your problem, either puppet-oslo isn't installed, or you're missing a symlink, or the version doesn't have that file15:54
itlinuxok I will check.. the gnocchi.conf in the controllers /etc/gnocchi/15:55
itlinuxand /etc/ceilometer..15:55
dhill_shardy, I created the symlink15:55
*** itlinux has quit IRC15:55
dhill_shardy, I think it worked15:55
dhill_shardy, yep it worked15:55
shardydhill_: Ok sounds good15:55
dhill_shardy, why is that symlink missing though?15:55
shardydhill_: no idea, either there's a packaging bug or someone deleted it?15:56
shardyI'd check the other nodes15:56
*** owalsh is now known as owalsh_afk15:56
*** shardy is now known as shardy_afk15:57
dhill_shardy_afk, I fixed the other nodes too15:58
*** achadha has quit IRC15:58
*** itlinux has joined #tripleo15:58
*** achadha has joined #tripleo15:59
openstackgerritmathieu bultel proposed openstack/tripleo-common master: WIP -- Execute minor update via ansible on mistral  https://review.openstack.org/48749616:00
*** suuuper has quit IRC16:00
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- simplify minor workflow  https://review.openstack.org/48748816:00
*** aufi has quit IRC16:01
*** egonzalez has quit IRC16:03
*** rbrady_ has joined #tripleo16:03
*** rbrady_ has quit IRC16:04
*** itlinux has quit IRC16:06
*** paramite has quit IRC16:06
*** dpawar has quit IRC16:08
*** raildo has quit IRC16:08
*** jfrancoa has quit IRC16:08
*** ansmith has joined #tripleo16:08
*** ooolpbot has joined #tripleo16:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION16:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436116:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)16:10
*** ooolpbot has quit IRC16:10
*** leseb has quit IRC16:10
*** leseb has joined #tripleo16:11
*** raildo has joined #tripleo16:12
*** limao has quit IRC16:12
*** achadha has quit IRC16:12
*** limao has joined #tripleo16:12
Tengujaosorior: I think I'm more or less ready with my hacky script :). Just made an error in my heat template, but overall it seems to do what I want :).16:12
*** raildo has quit IRC16:13
*** raildo has joined #tripleo16:13
pradkmwhahaha, Hi16:13
*** ebarrera has quit IRC16:14
jaosoriorTengu: great! so, where do you originally privision the cert/key ? on the undercloud?16:15
*** iranzo has joined #tripleo16:15
pradkmwhahaha, quick question .. in ocata we removed this option from undercloud.conf https://review.openstack.org/#/c/422184/ .. we now have a bug to mark this deprecated. The code in the service doesnt exist, so its really a noop.16:15
pradkmwhahaha, should i revert this in stable/ocata or just restore the option in conf file and set a note as deprecated?16:16
*** limao has quit IRC16:17
Tengujaosorior: nope, in fact the script is called on all the controllers, and if the VIP is present, it will request the certificate to let's encrypt, and upload it in custodia.16:19
jaosoriorTengu: what's the custodia backend you're using?16:20
Tengujaosorior: if the VIP isn't present, and if there are no certificate in custodia, it will wait 5s, and re-start the script (it's in the heat templates)16:20
Tengujaosorior: encrypted sqlite for now16:20
Tengubetter than clear, and stable, and independant16:20
jaosoriorTengu: so, you have one custodia server running in the undercloud? or do you have several custodia instances (one on each node)16:20
TenguI have one running on the undercloud16:20
Tenguit listens on the provisioning interface, and the controllers access it via the provisioning network as well16:21
jaosoriorTengu: how do the controller authenticate to custodia?16:21
Tengujaosorior: for now, it's not authenticated. and it's still in clear (http, not https)16:21
TenguI'll check with freeIPA certificates I think16:22
jaosoriorTengu: cool cool16:22
Tenguas custodia actually CAN authenticate with certificates16:22
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Create a IPv6 ctlplane subnet if using IPv6  https://review.openstack.org/49444316:22
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Add router for IPv6 ctlplane subnet  https://review.openstack.org/49701416:22
openstackgerritDerek Higgins proposed openstack/instack-undercloud master: Configure dnsmasq for provisioning over IPv6  https://review.openstack.org/50179616:22
Tengubut as the current setup isn't linked to freeIPA, I can't get certificate, thus…16:22
Tengubut I hope I'll be able to redeploy the whole stuff tomorrow and iterate on the SSL communication16:23
Tenguonce that's done, I'll be really happy.16:23
*** iranzo has quit IRC16:23
Tengubasically, the script is working just fine. I suppose I'll need to modify it a bit in order to be able to talk to an SSL custodia, but it's not that hard.16:23
Tenguthe hardest part was to ensure the script will never break haproxy with bad PEM file. I think I've done a good job on that part.16:24
Tengujaosorior: http://paste.openstack.org/show/620649/ the certodia.py script.16:27
TenguI'll probably do some refactoring.16:27
jaosoriorTengu: should probably put it in a gist or in a repo in github :P16:27
Tengujaosorior: well, it's not 100% finished. you can have a look, at least ;)16:28
jaosoriorhaha thanks16:28
TenguI'll also add some more comments/docs16:28
jaosorioralright, I'm off16:29
jaosoriorhave a good day everyone!16:29
Tengusee you :)16:29
EmilienMpabelanger: not sure we can release pike today tbh16:29
*** jaosorior has quit IRC16:30
sshnaidmweshay, https://bugs.launchpad.net/tripleo/+bug/171569916:30
openstackLaunchpad bug 1715699 in tripleo "CI: upgrade role sets up repositories without AFS mirrors" [Critical,Triaged]16:30
pabelangerEmilienM: okay, anything I can help with?16:30
EmilienMpabelanger: not really16:30
EmilienMpabelanger: trying to get some help on testing upgrades16:30
EmilienMbut not successful16:30
pabelangerEmilienM: okay, would you release at PTG?16:31
*** achadha has joined #tripleo16:31
EmilienMpabelanger: I hope16:31
pabelangerk, release jobs should be working, I tested them 2 weeks ago16:32
*** raildo has quit IRC16:33
EmilienMpabelanger: ok good16:33
EmilienMpabelanger: tbh there is no rush on our side to release final pike16:33
EmilienMwe still have ongoing backports that we really need16:33
*** raildo has joined #tripleo16:33
openstackgerritNuman Siddique proposed openstack-infra/tripleo-ci master: FOR TESTING ONLY...TESTING ONLY  https://review.openstack.org/50180216:34
pabelangerEmilienM: okay, the issue I am concerned about, is after zuulv3 goes live, you'll having to start fixing CI failures, distracting from actually release pike16:34
EmilienMpabelanger: I know16:34
pabelangerand not sure how fast we'll be able to resolve them16:34
pabelangerokay16:35
EmilienMpabelanger: we'll release ASAP16:35
openstackgerritNuman Siddique proposed openstack/tripleo-quickstart master: DO NOT REVIEW : TESTING ONLY  https://review.openstack.org/50060916:35
*** achadha has quit IRC16:36
*** itlinux has joined #tripleo16:36
numansEmilienM, Hi, can you please add this to your review queue - https://review.openstack.org/#/c/499574/   this is the backport to pike branch16:36
*** jpich has quit IRC16:38
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: fluentd: log configuration was not generated correctly  https://review.openstack.org/50155516:39
*** milan has quit IRC16:40
*** achadha has joined #tripleo16:42
*** tosky has quit IRC16:43
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- simplify minor workflow  https://review.openstack.org/48748816:44
EmilienMmatbu: could you help us on the scenario upgrade testing?16:45
*** rcernin has quit IRC16:45
*** snecklifter has quit IRC16:47
*** shreshtha has quit IRC16:47
*** itlinux has quit IRC16:48
*** achadha has quit IRC16:50
*** bryan_att has joined #tripleo16:50
*** itlinux has joined #tripleo16:51
*** lucasagomes is now known as lucas-afk16:51
*** dtantsur is now known as dtantsur|afk16:52
bryan_attdtantsur: hi - trozet on #opnfv-apex recommended that I reach out to you on an issue I am having with the ironic inspection kernel in Ocata. It is not successfully dhcp'ing an interface by itself, but when I login via console and bounce the interface, it does, and inspection completes. I need to know how to debug why it can't complete dhcp the first time. I can send you the /var/log/messaages file I pulled off the16:53
bryan_attserver.16:53
*** hewbrocca is now known as hewbrocca_afk16:53
*** masco has quit IRC16:54
*** aditya_r has joined #tripleo16:54
*** tzumainn_ has joined #tripleo16:58
*** achadha has joined #tripleo17:00
*** tzumainn has quit IRC17:00
openstackgerritJohn Fulton proposed openstack/tripleo-quickstart master: DO-NOT-MERGE Enable the centos testing repo for testing  https://review.openstack.org/50181017:01
rwsutrown: do you know if tripleo-quickstart can successfully deploy a containerized over or undercloud at this point? I'm not having success using devmode with featureset01017:01
*** tzumainn_ is now known as tzumainn17:02
*** itlinux has quit IRC17:02
*** achadha has quit IRC17:03
*** dsariel has quit IRC17:03
*** dprince has joined #tripleo17:04
*** thrash is now known as thrash|biab17:07
*** masco has joined #tripleo17:07
mwhahahapradk: it sounds like we need to deprecate it17:08
mwhahahapradk: or update the docs that it's not a thing anymore17:08
*** gbarros has quit IRC17:09
mwhahahadhill_, shardy: sorry got pulled into something, did you figure out the oslo cache thing?17:09
*** ooolpbot has joined #tripleo17:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION17:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436117:10
*** ooolpbot has quit IRC17:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)17:10
*** limao has joined #tripleo17:13
*** itlinux has joined #tripleo17:15
*** dprince has quit IRC17:16
*** trown is now known as trown|lunch17:16
*** jpena is now known as jpena|off17:17
*** limao has quit IRC17:18
*** ramishra has quit IRC17:18
matbuEmilienM: hey man, carlos has taken the card for this one17:19
EmilienMmatbu: I don't see progress now, is there any patch in progress?17:20
*** itlinux has quit IRC17:21
matbuEmilienM: idk , he jump on this this afternoon17:21
matbuidk exactly his status17:21
EmilienMmatbu: can you guys sync on that tomorrow and keep sshnaidm / me / weshay  in the loop please? we really need to make progress on this one17:22
*** rbowen has quit IRC17:22
matbuEmilienM: ack17:22
*** rbowen has joined #tripleo17:22
*** tesseract has quit IRC17:23
*** cschwede_ has quit IRC17:23
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: WIP: use repo-setup role when upgrading undercloud repo  https://review.openstack.org/50181717:23
*** chlong has joined #tripleo17:24
sshnaidmmatbu, weshay ^^ just a test, not sure it will work, please feel free to push over it17:24
*** dsneddon has quit IRC17:24
*** dsneddon has joined #tripleo17:24
*** tongl has joined #tripleo17:26
*** achadha has joined #tripleo17:28
*** sshnaidm is now known as sshnaidm|afk17:30
*** achadha_ has joined #tripleo17:31
*** psachin has quit IRC17:31
*** mcornea has joined #tripleo17:32
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Use containerized mongodb in scenario002-multinode-containers  https://review.openstack.org/50155317:32
*** achadha_ has quit IRC17:32
openstackgerritMerged openstack/python-tripleoclient stable/pike: Consume new RoleConfig data in config download  https://review.openstack.org/50166617:32
openstackgerritMerged openstack/instack-undercloud master: Protect against plan migration failing  https://review.openstack.org/49783417:32
*** achadha_ has joined #tripleo17:33
*** raildo has quit IRC17:33
*** achadha has quit IRC17:33
*** achadha_ has quit IRC17:33
*** achadha has joined #tripleo17:33
*** vpickard has quit IRC17:34
*** achadha has quit IRC17:35
*** achadha has joined #tripleo17:36
*** achadha has quit IRC17:36
weshaymatbu, sshnaidm|afk ping17:36
*** achadha has joined #tripleo17:36
*** vpickard has joined #tripleo17:36
weshayre: https://bugs.launchpad.net/tripleo/+bug/171490517:37
openstackLaunchpad bug 1714905 in tripleo "Composable scenarios BM -> Containers Upgrade jobs never deploy on BM" [Critical,In progress] - Assigned to Martin André (mandre)17:37
*** mcornea has quit IRC17:40
*** achadha has quit IRC17:42
*** achadha has joined #tripleo17:42
*** dsneddon has quit IRC17:45
*** dtrainor has quit IRC17:47
*** aditya_ra has joined #tripleo17:49
honzaAny clues about what this ironic failure means?  http://paste.openstack.org/show/620655/  The wrapping mistral workflow simply times out.  This error is in /var/log/ironic/app.log17:51
*** aditya_r has quit IRC17:52
*** gbarros has joined #tripleo17:55
*** jaganathan has quit IRC17:56
*** thrash|biab is now known as thrash17:57
mwhahahahamzy: the googles point to https://bugs.launchpad.net/ironic/+bug/143192917:57
openstackLaunchpad bug 1431929 in Ironic "Ironic failing to gracefully handle: ipmi error "insufficient resources for session"" [Medium,Fix released] - Assigned to Julia Kreger (juliaashleykreger)17:57
mwhahahahamzy: but the ironic folks we be better able to answer your question on that one17:58
hamzymwhahaha, thanks... currently trying to rebuild the overcloud IPA image to include scsi-target-utils for pxe_agent path18:01
mwhahahahamzy: yea i wouldn't think that's related but but i don't know enough about that process to rule that out. the error seemed to point to ipmi on the nodes18:03
*** jprovazn has quit IRC18:04
*** masco has quit IRC18:05
*** derekh has quit IRC18:05
*** liverpooler has quit IRC18:07
*** ooolpbot has joined #tripleo18:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION18:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436118:10
*** ooolpbot has quit IRC18:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)18:10
*** ebarrera_ has joined #tripleo18:10
*** achadha_ has joined #tripleo18:12
*** achadha_ has quit IRC18:13
*** trown|lunch is now known as trown18:13
*** achadha_ has joined #tripleo18:14
*** achadha has quit IRC18:15
openstackgerritLars Kellogg-Stedman proposed openstack/tripleo-heat-templates master: teach yaml-validate.py how to be --quiet  https://review.openstack.org/50145418:18
openstackgerritMerged openstack/tripleo-common stable/pike: Add "tripleo-common-managed" to all workflows in tripleo_common  https://review.openstack.org/50155418:22
rwsuweshay: do you know how I can reproduce this job locally? http://status.openstack.org/openstack-health/#/job/gate-tripleo-ci-centos-7-containers-multinode18:29
rwsuweshay: is it "bash devmode.sh --no-gate -d -c featureset010"?18:29
*** kbyrne has joined #tripleo18:30
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Support HA for OVN DBs containers using pacemaker bundle  https://review.openstack.org/49957418:32
*** cylopez has joined #tripleo18:32
openstackgerritJohn Trowbridge proposed openstack/tripleo-heat-templates stable/pike: Upgrade CI test on stable/pike - never merge  https://review.openstack.org/50062518:36
openstackgerritOpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements  https://review.openstack.org/50109518:36
*** aditya_r has joined #tripleo18:37
*** florianf has quit IRC18:37
*** aditya_ra has quit IRC18:37
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814818:38
honzaAny clues about what this ironic failure means?  http://paste.openstack.org/show/620655/  The wrapping mistral workflow simply times out.  This error is in /var/log/ironic/app.log18:39
*** pkovar has quit IRC18:39
weshaymandre, ping can you please remove your -1 on https://review.openstack.org/#/c/500546/18:40
*** yamahata has quit IRC18:42
honzaFolks in #openstack-ironic suggested I look in the ironic-bmc-logs dir but that's not present on the undercloud.18:43
honzaI'm thinking it's in the bmc node in my rdo cloud stack?  Except I can't seem to be able to connect to it18:43
*** chlong_ has joined #tripleo18:51
*** chlong has quit IRC18:51
bnemechonza: If you can't get to the bmc node then  that's likely the problem.18:52
bnemechonza: If you run nova console-log on the bmc instance does it provide any useful output?18:52
honzabnemec: i'm not sure i'm doing it right; i did 'nova list' locally and got the ip address (e.g. 10.0.1.10) and tried to ssh to it from the undercloud18:53
bnemechonza: That may or may not work depending on how your ssh keys are configured.18:53
honzabnemec: the undercloud can see it but the ssh connection is denied18:53
*** dprince has joined #tripleo18:53
bnemecThe bmc has the same public key injected as the undercloud, but if your undercloud generated a new private key then it won't be able to connect to the bmc.18:54
bnemecBut usually running "nova console-log bmc" will provide the relevant logs without ever getting on the bmc instance.18:54
bnemec(or whatever your bmc instance is named, of course)18:54
*** cylopez has quit IRC18:55
weshayrwsu, I'd like to try that myself before telling you how to do it. I'm running it now, anything I can help with in the meantime18:55
weshayrecreating multinode nodepool deployments needs a few patches to work, however I'd giving it a go18:57
honzabnemec: cool, that works, (and yes, much simpler)18:57
rwsuweshay: thanks, I am just trying to figure how folks are deploying a containerized under or overcloud for dev work18:57
rwsuor whether the code is stable enough at this point18:58
*** apevec has quit IRC18:58
weshayrwsu, here's what I run.. export WD=/var/tmp/containers; ./quickstart.sh -c $WD/config/general_config/featureset022.yml --tags all -R master-tripleo-ci -w $WD --no-clone whayutin-testbox218:59
rwsuweshay: I haven't tried that feature set and release combination before, let me give it a shot, thanks19:03
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- simplify minor workflow  https://review.openstack.org/48748819:04
*** chlong_ has quit IRC19:07
*** chlong_ has joined #tripleo19:08
*** ooolpbot has joined #tripleo19:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION19:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436119:10
*** ooolpbot has quit IRC19:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)19:10
*** chlong__ has joined #tripleo19:12
openstackgerritGiulio Fidente proposed openstack/instack-undercloud stable/pike: Only delete workflows with the tripleo-common-managed tag  https://review.openstack.org/50184419:12
*** chlong_ has quit IRC19:14
*** limao has joined #tripleo19:14
*** jkilpatr has quit IRC19:17
*** limao has quit IRC19:19
*** cylopez has joined #tripleo19:20
*** cylopez has quit IRC19:20
*** dougbtv has quit IRC19:20
*** derekh has joined #tripleo19:22
*** Goneri has quit IRC19:24
*** dougbtv has joined #tripleo19:24
*** dougbtv has quit IRC19:25
*** dougbtv has joined #tripleo19:25
*** chlong__ has quit IRC19:26
*** chlong_ has joined #tripleo19:26
*** yamahata has joined #tripleo19:30
*** pcaruana has quit IRC19:31
openstackgerritmathieu bultel proposed openstack/tripleo-common master: WIP -- Execute minor update via ansible on mistral  https://review.openstack.org/48749619:31
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Add CephExternal role for ceph-ansible  https://review.openstack.org/50058119:31
openstackgerritMerged openstack/tripleo-heat-templates stable/pike: Add tags in upgrade_tasks for mongodb services.  https://review.openstack.org/50171519:31
*** chlong_ has quit IRC19:32
*** chlong_ has joined #tripleo19:32
openstackgerritHarry Rybacki proposed openstack/tripleo-quickstart master: Update README to make add_repos use clearer  https://review.openstack.org/50185119:34
*** aditya_ra has joined #tripleo19:34
*** bfournie has quit IRC19:37
*** bfournie has joined #tripleo19:37
*** bfournie has quit IRC19:37
*** jkilpatr has joined #tripleo19:38
*** aditya_r has quit IRC19:38
*** aramteke has joined #tripleo19:38
*** Goneri has joined #tripleo19:40
*** aditya_ra has quit IRC19:40
*** chlong__ has joined #tripleo19:41
openstackgerritwes hayutin proposed openstack/tripleo-quickstart-extras master: do not use a custom scripts dir in dlrn builds  https://review.openstack.org/49886619:42
*** chlong_ has quit IRC19:43
*** aramteke has quit IRC19:43
*** stevebaker has quit IRC19:44
*** derekh has quit IRC19:45
*** jlabarre has quit IRC19:46
*** jlabarre has joined #tripleo19:47
*** derekh has joined #tripleo19:48
*** mbeierl has quit IRC19:49
openstackgerritwes hayutin proposed openstack/tripleo-quickstart master: fix lp bug url and comments in contributing doc  https://review.openstack.org/50185419:49
*** itlinux has joined #tripleo19:50
*** itlinux has quit IRC19:53
*** itlinux has joined #tripleo19:54
*** lblanchard has quit IRC20:00
openstackgerritTom Barron proposed openstack/tripleo-heat-templates stable/ocata: DO NOT MERGE  https://review.openstack.org/50186020:05
*** ooolpbot has joined #tripleo20:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION20:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436120:10
*** ooolpbot has quit IRC20:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)20:10
*** pchavva has quit IRC20:11
*** owalsh_afk is now known as owalsh20:12
trownsshnaidm|afk: hmm cant get on mirror server all the sudden :(20:14
*** itlinux has quit IRC20:15
openstackgerritmathieu bultel proposed openstack/tripleo-common master: WIP -- Execute minor update via ansible on mistral  https://review.openstack.org/48749620:20
*** jlabarre has quit IRC20:22
*** jlabarre has joined #tripleo20:25
mandreweshay: about the -W on https://review.openstack.org/#/c/500546/, I think it needs a bit more work to make it backward compatible, otherwise it won't pass the gate20:26
weshaymandre, for newton -> ocata?20:26
mandreweshay: maybe try with "set_fact deploy_composable_scenario = composable_scenario" when the composable_scenario variable is set, but I'm not sure it's going to work if the deploy_composable_variable is also set20:27
pabelangertrown: which mirror?20:27
*** ecerquei has joined #tripleo20:27
mandreweshay: nah, I have two changes in oooq and oooq-extra that are inter-dependent20:27
trownpabelanger: something in rdocloud, was using it as a jump host to another instance... sshnaidm|afk is probably the only one who knows20:28
mandrewe need to break the dependency of the oooq-extra change on the oooq one20:28
mandreweshay: https://review.openstack.org/#/c/500546/ needs to be updated to pass CI on its own20:29
*** gfidente has quit IRC20:29
weshaymandre,  ya.. trown and I were reviewing them. If we keep the disipline with scenario$-multinode and scenario-multinode-containers we don't have to set both variables in the settings20:30
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Update custom-domain.yaml environment  https://review.openstack.org/50186520:31
openstackgerritBen Nemec proposed openstack/tripleo-heat-templates master: Add pep8 check that generated environments are up to date  https://review.openstack.org/50186620:31
weshayif the upgrade is set to use containers, then we can assume the -containers portion of the file name20:31
weshayif containers is not set.. we just leave it as is20:31
weshaymandre, not sure if that is that backwards compat issue you are referring to20:32
mandreweshay: sorry, backward compatible == making https://review.openstack.org/#/c/500546/ pass CI on its own20:34
*** mbeierl has joined #tripleo20:35
mandrewithout the need to update the variables in https://review.openstack.org/#/c/500552/20:35
weshayk /me looks20:35
mandreweshay: btw, after we've fixed the composable scenario for deploy vs upgrade, we're not done yet... at least according to https://review.openstack.org/#/c/461000/20:36
mandreweshay: because the scenarios scenarioXXX-multinode-containers.yaml files are too different from scenarioXXX-multinode.yaml I think20:38
*** ansmith has quit IRC20:38
weshayhrm.. we were doing the same thing here https://review.openstack.org/#/c/500625/20:38
mandreI have a pending patch to bring the two closer20:38
trownweshay: ya 500625 is just the pike check20:38
mandreweshay: yeah, you're testing the same change _for pike_20:38
trownweshay: same patch just pike instead of master20:38
mandreweshay: there is something I don't understand with these scenario jobs... how can the initial deployment be non containerized when the resource point to the docker version?20:40
*** trown is now known as trown|outtypewww20:41
mandreweshay: for example, take PS50 of https://review.openstack.org/#/c/461000/20:42
*** dtrainor has joined #tripleo20:42
*** chlong__ has quit IRC20:42
weshayya.. needed an example20:42
mandreweshay: there is a green gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container-upgrades-nv job, http://logs.openstack.org/00/461000/50/check/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-container-upgrades-nv/1833356/20:42
weshaymandre, like ps50 scenario003?20:42
mandreweshay: yeah exactly20:43
weshaymandre, ok.. let me poke around20:43
*** toure is now known as toure_biab20:44
mandreweshay: so if you look at the deploy command, you see it uses the environement file scenario003-multinode-containers.yaml, pointing to the containerized sahara20:45
weshaymandre, looking at overcloud-deploy.sh in /home/stack that is clearly wrong due to -e /home/jenkins/tripleo-heat-templates/ci/environments/scenario003-multinode-containers.yaml20:45
mandreweshay: but if you look at the controller, it has logs for sahara in /var/log/sahara, meaning the service was not containerized during the initial deployment20:46
mandreand that I can't explain20:46
weshaymandre, maybe it just got lucky their based on the services20:47
weshayhttps://github.com/openstack/tripleo-heat-templates/blob/master/README.rst#service-testing-matrix20:47
openstackgerritmathieu bultel proposed openstack/tripleo-common master: WIP -- Execute minor update via ansible on mistral  https://review.openstack.org/48749620:47
*** Goneri has quit IRC20:47
openstackgerritmathieu bultel proposed openstack/python-tripleoclient master: WIP -- simplify minor workflow  https://review.openstack.org/48748820:47
*** hamzy has quit IRC20:48
*** jlabarre has quit IRC20:48
*** catintheroof has quit IRC20:49
openstackgerritDan Prince proposed openstack/tripleo-heat-templates master: Add a docker pull retry to docker-puppet.py  https://review.openstack.org/50187120:49
*** catintheroof has joined #tripleo20:49
mandreweshay: anyway... let me post my WIP patch for bringing the container version of the multinode scenario more in line with their BM pendant20:50
mandreweshay: I think we'll need it20:50
*** catintheroof has quit IRC20:50
openstackgerritMartin André proposed openstack/tripleo-heat-templates master: [WIP] Add all services to multinode-containers-scenarios  https://review.openstack.org/50187220:53
mandreweshay: ^^ probably this is breaking a lot of stuff :D20:53
*** iranzo has joined #tripleo20:55
*** abishop has quit IRC20:56
*** iranzo has quit IRC20:58
*** itlinux has joined #tripleo20:58
*** iranzo has joined #tripleo20:58
*** iranzo has quit IRC20:58
*** iranzo has joined #tripleo20:58
*** iranzo has quit IRC20:59
openstackgerritLee Yarwood proposed openstack/tripleo-specs master: WIP - Introduce skip level upgrades  https://review.openstack.org/49725721:01
*** itlinux has quit IRC21:01
openstackgerritMerged openstack/tripleo-heat-templates master: Enable Ceilometer agent logging for containers  https://review.openstack.org/50133921:04
*** itlinux has joined #tripleo21:05
*** itlinux has quit IRC21:05
openstackgerritMerged openstack/tripleo-heat-templates stable/newton: manila: set "neutron_admin_auth_url" correctly  https://review.openstack.org/50151921:06
*** itlinux has joined #tripleo21:10
*** ooolpbot has joined #tripleo21:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION21:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436121:10
*** ooolpbot has quit IRC21:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)21:10
*** ecerquei has quit IRC21:10
*** rhallisey has quit IRC21:12
*** nyechiel has quit IRC21:12
*** tosky has joined #tripleo21:18
*** rbrady is now known as rbrady-afk21:19
*** dprince has quit IRC21:21
*** achadha has joined #tripleo21:26
*** achadha_ has quit IRC21:29
*** ansmith has joined #tripleo21:30
*** achadha has quit IRC21:31
openstackgerritPradeep Kilambi proposed openstack/tripleo-heat-templates stable/pike: Enable Ceilometer agent logging for containers  https://review.openstack.org/50187921:32
*** leitan has quit IRC21:32
*** leitan has joined #tripleo21:33
*** leitan has quit IRC21:33
*** leitan has joined #tripleo21:33
*** leitan has quit IRC21:34
*** leitan has joined #tripleo21:34
*** cylopez has joined #tripleo21:38
*** leitan has quit IRC21:38
*** achadha has joined #tripleo21:43
itlinuxI have created a guide for Ocata, will test it on Pike but I am sure it still works.. I could not find a working version... https://github.com/itlinux/OpenStack_theme21:46
*** pradk has quit IRC21:46
itlinuxthis is to create a custom theme21:46
*** cylopez has quit IRC21:47
*** achadha has quit IRC21:48
*** achadha has joined #tripleo21:48
*** itlinux has quit IRC21:51
*** derekh has quit IRC21:57
openstackgerritEmilien Macchi proposed openstack/instack-undercloud master: Revert "Revert "Adds execution of post-upgrade validations on undercloud upgrade""  https://review.openstack.org/49911622:00
*** achadha_ has joined #tripleo22:01
openstackgerritBen Nemec proposed openstack/tripleo-docs master: Clarify predictable ip behavior for deleted nodes  https://review.openstack.org/50188822:03
*** achadha has quit IRC22:05
*** achadha_ has quit IRC22:06
*** ooolpbot has joined #tripleo22:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION22:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436122:10
*** ooolpbot has quit IRC22:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)22:10
*** dsneddon has joined #tripleo22:10
*** derekh has joined #tripleo22:17
*** japestinho has quit IRC22:18
*** jmelvin has quit IRC22:21
*** achadha has joined #tripleo22:23
*** ebarrera_ has quit IRC22:30
openstackgerritOpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements  https://review.openstack.org/48814822:34
*** tosky has quit IRC22:34
openstackgerritMerged openstack/instack-undercloud master: Provide LOCAL_IP_WRAPPED as a instack env variable  https://review.openstack.org/49444022:37
openstackgerritMerged openstack/instack-undercloud master: Only delete workflows with the tripleo-common-managed tag  https://review.openstack.org/50132622:37
*** chlong has joined #tripleo22:44
openstackgerritMerged openstack/puppet-tripleo master: Move manila backend configuration from pacemaker to base  https://review.openstack.org/49994522:44
openstackgerritMerged openstack/puppet-tripleo master: Increase minimum puppetlabs-stdlib version requirement  https://review.openstack.org/49697122:44
*** chlong has quit IRC22:51
*** chlong has joined #tripleo22:51
*** achadha has quit IRC22:53
*** achadha has joined #tripleo22:53
*** achadha_ has joined #tripleo22:56
*** achadha has quit IRC22:57
openstackgerritMerged openstack/puppet-tripleo master: Allow using redis as a Zaqar messaging backend.  https://review.openstack.org/49954222:58
openstackgerritAssaf Muller proposed openstack/tripleo-heat-templates master: Remove VXLAN type driver from OVN environment files  https://review.openstack.org/50189322:59
*** achadha_ has quit IRC23:00
*** achadha has joined #tripleo23:01
*** achadha has quit IRC23:02
*** achadha has joined #tripleo23:03
*** itlinux has joined #tripleo23:04
*** itlinux has quit IRC23:04
*** chlong_ has joined #tripleo23:04
*** chlong has quit IRC23:04
*** chlong_ has quit IRC23:09
*** chlong_ has joined #tripleo23:09
*** ooolpbot has joined #tripleo23:10
ooolpbotURGENT TRIPLEO TASKS NEED ATTENTION23:10
ooolpbothttps://bugs.launchpad.net/tripleo/+bug/171436123:10
openstackLaunchpad bug 1714361 in tripleo "mistral on gates seems old and does not have the required patchs" [Critical,Triaged] - Assigned to Adriano Petrich (apetrich)23:10
*** ooolpbot has quit IRC23:10
*** chlong__ has joined #tripleo23:13
*** chlong_ has quit IRC23:14
openstackgerritTom Barron proposed openstack/puppet-tripleo stable/pike: Move manila backend configuration from pacemaker to base  https://review.openstack.org/50189623:14
*** limao has joined #tripleo23:16
*** gbarros has quit IRC23:18
*** limao has quit IRC23:20
*** dsneddon has quit IRC23:22
*** tongl has quit IRC23:25
*** achadha_ has joined #tripleo23:31
*** achadha has quit IRC23:34
*** dougbtv_ has joined #tripleo23:35
*** achadha_ has quit IRC23:36
*** chlong_ has joined #tripleo23:41
*** chlong__ has quit IRC23:42
*** ecerquei has joined #tripleo23:51
*** chlong__ has joined #tripleo23:52
*** chlong_ has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!