Thursday, 2017-08-10

*** thorst has joined #openstack-ansible00:04
*** thorst has quit IRC00:31
*** markvoelker has joined #openstack-ansible00:45
*** kristian__ has joined #openstack-ansible00:49
*** kristian__ has quit IRC00:54
*** hw_wutianwei has joined #openstack-ansible01:07
*** thorst has joined #openstack-ansible01:08
*** thorst has quit IRC01:08
*** thorst has joined #openstack-ansible01:09
*** thorst has quit IRC01:13
*** thorst has joined #openstack-ansible01:25
*** thorst has quit IRC01:27
cloudnullevenings01:47
cloudnulltasker: still around01:47
cloudnullthe issue is that haproxy will only load the one hap config01:47
cloudnullyou have to concatenate the files into the single config01:48
cloudnullif you run the hap role from osa on the now upgraded host it will do the needful01:48
cloudnullthe code path between trusty and xenial are similar however there are differences specific to systemd01:49
cloudnullmw_: hum.01:49
cloudnullare you enabling l3-ha?01:50
cloudnullmaybe something getting out of sync ?01:50
*** chyka has joined #openstack-ansible02:19
*** chyka has quit IRC02:23
*** thorst has joined #openstack-ansible02:28
*** thorst has quit IRC02:29
mhaydenspotz: here now02:29
*** chhavi has quit IRC02:33
*** esberglu has quit IRC02:40
mw_cloudnull: no l3-ha02:52
mw_cloudnull: DVR and I'm deploying with a Heat template02:52
cloudnullso DVR on the test env?02:58
mw_Yeah02:59
cloudnullis your heat stack deploying DVR w/ linux bridge?02:59
mw_Nope02:59
cloudnull\02:59
cloudnullopps02:59
mw_Is that even possible?03:00
cloudnullno its not, to the best of my knowledge03:00
mw_to deploy a LB solution when the underlying network is OVS-DVR?03:00
mw_haha ok03:00
*** markvoelker has quit IRC03:02
SamYaplelinuxbridge with dvr won't happen03:03
*** markvoelker has joined #openstack-ansible03:03
SamYaplespent alot of time looking into that one03:03
SamYaplebasically at that point you would be reimplementing lots of OVS and you have t oask yourself... why03:03
mw_SamYaple: That's what I thought.03:03
mw_I'm trying to repro this with a small heat template03:03
mw_SamYaple cloudnull Are either of you familiar with heat at all?03:04
mw_I'm wondering if it's a dependency issue that I'm unaware of..03:05
mw_The snat interfaces in the snat namespace aren't being created all the time. It's hit and miss :S03:07
cloudnullim not aware of anything that would cause that03:19
cloudnullhowever im also no dvr-ovs expert03:19
mw_cloudnull: I'm also occasionally getting several (up to 3) snat IPs for the same subnet. Something weird is happening here...03:20
mw_One of them is active and the rest aren't03:20
SamYaplemw_: there is a bug in the retry filters where if nova schedules to a compute host, that compute host fails and it reschedules you can end up with multiple ips attached to a port03:24
SamYaplecheck your logs ot see if it is retring (or just remove the retry filter and watch if it fails)03:24
mw_SamYaple: Nova scheduler log?03:26
SamYaplemw_: that and the compute logs03:27
mw_SamYaple: "The instance sync for host 'compute1' did not match. Re-created its InstanceList."03:27
SamYapleif its hitting the retry filter there should be evidence in the scheduler logs,03:27
mw_SamYaple: That's hte only thing in the scheduler log that isn't "successfully synced instances from host..."03:27
*** udesale has joined #openstack-ansible03:40
mw_SamYaple: Any idea what I'm looking for in the compute logs?03:41
*** gkadam has joined #openstack-ansible03:41
mw_SamYaple: Heat isn't able to delete the stack because additional snat ports have been created (that it doesn't know about it seems).03:45
SamYapleim not sure. im just commenting on one of the reasons you can get multiple ips on a boot03:55
SamYapleport*03:55
*** luzC has quit IRC03:57
mw_SamYaple: Ok, cool. Thanks :)03:58
*** germs has left #openstack-ansible03:59
*** poopcat has quit IRC04:01
*** markvoelker has quit IRC04:01
*** markvoelker has joined #openstack-ansible04:01
*** thorst has joined #openstack-ansible04:04
*** thorst has quit IRC04:09
*** chhavi has joined #openstack-ansible04:13
*** rodolof has joined #openstack-ansible04:18
*** thorst has joined #openstack-ansible04:26
*** thorst has quit IRC04:30
*** gouthamr has joined #openstack-ansible04:31
openstackgerritPraveen N proposed openstack/openstack-ansible-os_tempest master: typo fix  https://review.openstack.org/49237504:40
*** hybridpollo has quit IRC04:55
*** rromans has quit IRC05:08
*** rromans has joined #openstack-ansible05:08
*** gouthamr has quit IRC05:16
*** luzC has joined #openstack-ansible05:31
*** jamesdenton has quit IRC05:36
*** luzC has quit IRC05:37
*** kristian__ has joined #openstack-ansible05:52
*** luzC has joined #openstack-ansible05:54
*** kristian__ has quit IRC05:56
*** luzC has quit IRC05:57
*** jamesdenton has joined #openstack-ansible05:57
*** lvdombrkr has quit IRC06:06
*** lvdombrkr has joined #openstack-ansible06:10
randy^^morning06:10
lvdombrkrmorning06:11
*** rodolof has quit IRC06:11
*** Oku_OS-away is now known as Oku_OS06:12
*** jamesdenton has quit IRC06:16
lvdombrkrhow can i rebuild only  infra1-neutron-agents-container-22e6641c from begining?06:22
*** thorst has joined #openstack-ansible06:26
*** thorst has quit IRC06:31
randy^^lvdombrkr: with -l?06:34
randy^^lvdombrkr: https://cunninghamshane.com/tips-for-managing-openstack-with-openstack-ansible/ - "Rebuilding specific LXC container"06:34
*** jamesdenton has joined #openstack-ansible06:34
*** kristian__ has joined #openstack-ansible06:34
randy^^https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks/containers.html06:35
randy^^"Destroy and recreate containers"06:35
randy^^wow. os-nova-install.yml finished after 8 hours (6 VMs).06:36
*** jamesdenton has quit IRC06:39
*** drifterza has joined #openstack-ansible06:39
lvdombrkri add dhcp agent from neutron-agents-container-22e6641c but cant ping it from external network06:41
lvdombrkrwhere can be problem?06:42
lvdombrkrrandy^^: thank you06:42
*** jamesdenton has joined #openstack-ansible06:48
randy^^lvdombrkr: missing ip in the container, wrong bridge bound, arp issue etc..06:49
randy^^lxc-attach to it and have a look with "ip a s"06:49
lvdombrkrrandy: ip is on container06:52
lvdombrkrrandy^^: you mean ip or interface?06:53
randy^^"ip address show". and check the interface with brctl show if it is bound to the correct bridge on the containerhost06:54
randy^^i had some similar issues, i had to increade ssh_dely to 60sec, since sometimes arp resolutions is not fast enought.06:55
randy^^if i ping the containers, some packets are missing, afterwards it is running correctly.06:55
randy^^but i think it is due to the VM setup and the "overcrowded" esxi servers in the company lab ;)06:55
*** jvidal has joined #openstack-ansible06:57
*** tobberydberg has joined #openstack-ansible07:00
lvdombrkrrandy^^: maybe you can look into my neutron_agent_container bridge log and give some feedback?? http://paste.openstack.org/raw/618016/07:04
*** shardy has joined #openstack-ansible07:09
*** luzC has joined #openstack-ansible07:10
*** luzC has quit IRC07:14
*** luzC has joined #openstack-ansible07:14
randy^^i only see that there is no networkconnection from the container towards outside, but not why :)07:16
randy^^ AMQP server on 172.16.84.133:5671 is unreachable:  - for me it looks like a basic connectivity issue07:17
randy^^so check the containers management interface if the ip address is correct, and the bridge setup is ok.07:18
*** luzC has quit IRC07:18
randy^^on the containerhost. has nothing to do with neutron itself, i think07:18
lvdombrkrrandy^^: i just try telnet 172.16.84.133:5671 from agent_container and there is no problems07:21
lvdombrkrinteresting07:21
*** prometheanfire has quit IRC07:23
*** markus_z has joined #openstack-ansible07:23
lvdombrkrrandy^^: what i just Notice that agent_container network status is down07:32
randy^^maybe the binding to "{'physnet1': 'ens2f3', 'vlan': 'ens2f1'}07:36
randy^^istn correct?07:36
*** luzC has joined #openstack-ansible07:38
*** prometheanfire has joined #openstack-ansible07:42
*** yifei has quit IRC07:42
*** yifei has joined #openstack-ansible07:49
lvdombrkrrandy^^: its correct07:49
lvdombrkrrandy^^: physnet1': 'ens2f3 its a new network which i added recently to openstack_user_config and rerun lxc-container-create and os-neutron-install07:51
*** jafeha has quit IRC07:52
*** sxc731 has joined #openstack-ansible07:53
*** pbandark has joined #openstack-ansible08:01
*** markus_z has quit IRC08:03
*** markus_z has joined #openstack-ansible08:04
*** electrofelix has joined #openstack-ansible08:19
*** jafeha has joined #openstack-ansible08:21
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara master: Implement uWSGI for sahara-api  https://review.openstack.org/49142108:27
*** thorst has joined #openstack-ansible08:27
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara master: Implement uWSGI for sahara-api  https://review.openstack.org/49142108:29
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_sahara master: Implement uWSGI for sahara-api  https://review.openstack.org/49142108:29
*** thorst has quit IRC08:32
*** armaan has quit IRC08:33
*** armaan has joined #openstack-ansible08:33
*** woodard has quit IRC08:53
*** woodard has joined #openstack-ansible08:53
*** mbuil has joined #openstack-ansible09:13
odyssey4memorning all - time to get a patch in to use the reverse proxy for images.linuxcontainers.org09:16
flaviosrIf I want to add a centos job to the sahara role, is it enough to just add it to the list in https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L13672 ?09:17
odyssey4meunfortunately infra is heavily backed up, so it may take all day to merge09:17
odyssey4meflaviosr yes, it should be enough09:17
flaviosrmorning odyssey4me !09:17
flaviosrthanks :)09:17
odyssey4meansible-role-functional-jobs-centos7-nv to start with if you want non voting for now09:18
flaviosryes, that is exactly what I was thinking09:19
*** luzC has quit IRC09:22
*** luzC has joined #openstack-ansible09:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value  https://review.openstack.org/49245209:31
*** luzC has quit IRC09:39
*** yifei has quit IRC09:42
*** markvoelker has quit IRC09:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value  https://review.openstack.org/49245209:46
*** luzC has joined #openstack-ansible09:47
odyssey4meevrardjp andymccr ^ a quick review for that would be good09:47
odyssey4meif that passes gate then we're good and I'll add the override hack to the tests repo for all other role tests09:47
andymccrodyssey4me: sweet taking a look - you coding from inside your occulus rift? :D09:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value  https://review.openstack.org/49245209:54
odyssey4methanksfully there are opensuse images ready to go very quickly, so we get a quick result to validate whether it's working09:55
odyssey4meand no - not inside the oculus yet09:55
odyssey4meI got to play a little last night, but had to download a raft-load of stuff which took some time, cutting my play time short09:56
odyssey4meI'll try again later today09:56
odyssey4methat said, there is an app that allows you to use your desktop through the rift which I thought might be interesting09:56
odyssey4meI did play a couple of shooters which was very, very intense09:56
odyssey4mewell, this patch set appears to be working, and was quick09:59
odyssey4meinteresting, centos on internap is beating suse on rax-dfw10:00
odyssey4methis is not normal :)10:01
odyssey4meevrardjp to explain what's going on in that patch10:02
andymccrahh btw the suse images are changing - infra is only going to keep 423 onboard and not 422, although i think we have some issues with our 423 stuff since that is failing when 422 passes - but i figure we can fix that up reasonably easily once hwoarang is back10:02
odyssey4methe value was changes from a dns entry to a URL in the machinectl patch - so your assumption that we're using the URL everywhere is wrong10:02
evrardjpI just see the code.10:03
evrardjpit may have changed before, but I guess it was with a reno10:04
evrardjpI'm just focusing on this patch.10:04
odyssey4meI'll check the reno, but this patch returns it to the same value as the stable patch - as is explained in the commit message.10:05
odyssey4meoh, and the machinectl patch appears to have had no reno10:06
odyssey4meno reno: https://github.com/openstack/openstack-ansible-lxc_hosts/commit/42545f1c3c7b41ee4db8b55024cfa39a50eb06ab10:07
*** armaan has quit IRC10:07
*** shardy has quit IRC10:08
odyssey4methe test has passed for suse and centos, so it definitely works :)10:08
*** armaan has joined #openstack-ansible10:08
*** armaan has quit IRC10:10
*** armaan has joined #openstack-ansible10:10
*** shardy has joined #openstack-ansible10:11
*** fen[sha] is now known as fengor10:15
*** armaan has quit IRC10:26
*** thorst has joined #openstack-ansible10:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery  https://review.openstack.org/49246510:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery  https://review.openstack.org/49246510:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery  https://review.openstack.org/49246510:32
*** thorst has quit IRC10:33
odyssey4meevrardjp replied to your comments10:35
evrardjpseeing the other patches, I don't have have to open the review to guess what you said ;)10:35
*** armaan has joined #openstack-ansible10:35
evrardjplet me check :)10:36
*** udesale has quit IRC10:36
*** kristian__ has quit IRC10:37
*** kristian__ has joined #openstack-ansible10:38
*** armaan has quit IRC10:39
*** sxc731 has quit IRC10:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use LXC reverse proxy in OpenStack-CI  https://review.openstack.org/49247511:02
odyssey4meright, so I think those three patches will resolve that issue11:07
spotzmhayden still here?11:09
spotzmhayden: andymccr is looking but thoughts on https://bugs.launchpad.net/openstack-ansible/+bug/1703621. comments are all there. Leaving to ride the horses but let me know11:10
openstackLaunchpad bug 1703621 in openstack-ansible "Appendix A conflict with /etc/openstack_deploy/openstack_user_config.yml.example" [Medium,Confirmed] - Assigned to Amy Marrich (amy-marrich)11:10
andymccrenjoy spotz!11:11
andymccri will have an update for you in there by the time youre back hopefully :)11:11
spotzandymccr: gonna try to get them both done this morning so off a little earlier:)11:11
*** armaan has joined #openstack-ansible11:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use LXC reverse proxy in OpenStack-CI  https://review.openstack.org/49247511:12
odyssey4meandymccr mhayden so with regards to the RDO/EPEL and other CentOS repositories, it appears that for some reason the base image has a bunch of upstream mirrors configured and we're not using any of the nodepool ones beyond the base centos stuff... so we can definitely improve there11:14
odyssey4mewe aren't using the mariadb repositories in infra either, except for the integrated gate11:14
andymccri think we disabled a bunch of the base ones - if im not mistaken mhayden put a patch in for that - but that sounds really promising.11:15
odyssey4meyup, we now disable all then enable what we want - which is a start11:16
*** armaan has quit IRC11:16
odyssey4mebut we need to re-examine what we're using and perhaps patch the infra image to ensure it has the right config11:16
odyssey4mealternatively, overwrite with our own like we do for ubuntu11:16
andymccrim hoping that mixed with the dnf stuff will improve centos significantly11:17
andymccr(and the present vs latest)11:17
odyssey4meyup11:17
odyssey4meI think we can use this as a topic for a bit of a hackfest at the PTG11:17
andymccr+211:17
odyssey4meperhaps dovetail with using devstack-gate to reduce all the stuff we have to detect and override11:17
andymccrim game for that.11:18
odyssey4mealright, it seems that https://review.openstack.org/492475, https://review.openstack.org/492452 and https://review.openstack.org/492465 are all passing for suse/centos so once they get an ubuntu host hopefully they'll pass there too and we are good to go11:22
*** pbandark1 has joined #openstack-ansible11:27
*** pbandark has quit IRC11:27
*** pbandark1 is now known as pbandark11:27
lvdombrkrhello guys i trying add vpnaas ( use this guide https://docs.openstack.org/developer/openstack-ansible-os_neutron/ocata/configure-network-services.html) but after run os_neutron_install get error fatal: [infra1_neutron_server_container-ee121208]: FAILED! => {"failed": true, "msg": "'neutron_vpnaas_service_provider' is undefined"}11:34
lvdombrkrany thoughts on this?11:34
lvdombrkr?11:45
*** smatzek has joined #openstack-ansible11:49
*** gkadam has quit IRC11:52
evrardjplvdombrkr: probably there is a variable that needs definition that's not documented.11:57
evrardjpyou have to check into the neutron role11:58
*** esberglu has joined #openstack-ansible11:59
lvdombrkrevrardjp: thank you i already tried to find it but without success12:00
evrardjplvdombrkr: what os are you running? What version of the code are you running?12:01
evrardjpApparently it's defined for ubuntu16, and you should probably not set it.12:01
lvdombrkrevrardjp: centos 712:02
lvdombrkr15.1.812:02
evrardjpok12:02
evrardjplet me fix that for you12:02
evrardjpyou caught a bug, congrats!12:02
mhaydenmorning12:02
*** thorst has joined #openstack-ansible12:02
mhaydenodyssey4me: weird, i thought they were using the mirrors -- perhaps it's time to disable fastestmirror again and check the baseurls12:03
mhaydenalso, i couldn't find a nodepool mirror for RDO last time i tried12:03
*** esberglu has quit IRC12:04
mhaydencrap, it appears my linter tests broke stuff as well :/12:05
mhaydenthe directory is different in the role tests12:05
lvdombrkrevrardjp: i will be grateful )))12:05
evrardjpmhayden: ?12:05
evrardjpthat's sad.12:06
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily  https://review.openstack.org/49249412:08
mhaydenevrardjp: ^^12:08
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Fix VPNaaS variable definition for non-ubuntu  https://review.openstack.org/49249512:08
evrardjpmhayden: why not reverting?12:09
evrardjpI'm ok.12:09
mhaydenthe linter itself is okay12:09
mhaydenbut the unit test discovery needs work12:09
evrardjpI was planning to add extra rules, so I am glad you caught this up12:09
odyssey4meone should not merge linter changes when changes elsewhere aren't merging due to a gate wedge ;)12:10
evrardjplvdombrkr: here is your patch: https://review.openstack.org/#/c/492495/12:10
odyssey4memhayden see https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh12:10
evrardjpyou can apply that to your neutron if you want a temporary fix and are in urgent need for a fix.12:10
odyssey4mewe can source /etc/ci/mirror_info.sh and it provides a bunch of env vars with the mirror URL's12:11
odyssey4mebut that also shows the repo configs that are implemented12:11
odyssey4mewe could patch it so that the RDO stuff is changed to use the reverse proxy by default?12:11
mhaydenoh nice... i might see if i can work a patch for centos12:11
odyssey4mealso, I see the output of what's configured here: http://logs.openstack.org/99/490899/5/check/gate-openstack-ansible-tests-ansible-func-centos-7/31a0876/console.html#_2017-08-07_16_21_26_44674112:12
odyssey4mewe shouldperhaps either replace https://github.com/openstack/openstack-ansible-tests/blob/master/common-tasks/test-set-nodepool-vars.yml#L37-L47 or add things below it to configure the right repositories12:13
mhaydenodyssey4me: well, i disable all of those repos via project-config, but the project-config clone seems to be flaky12:15
odyssey4meyeah, that needs resolving12:15
mhaydenmordred was looking into it but i couldn't get anything from him yesterday12:15
mhaydeni imagine he got caught up in something else12:15
mhaydenbut that --disable * helps a bunch since there are a bunch of repos enabled that we don't always need12:16
mhaydenand some we never need12:16
mhaydenthe centos image isn't terribly clean... looks purpose built for RDO12:16
odyssey4meyep, it likely is12:18
odyssey4meperhaps a discussion should be had to make it more generic as RDO aren't the only ones using it any more12:18
odyssey4megood to see the reverse proxy working right http://logs.openstack.org/65/492465/3/check/gate-openstack-ansible-tests-ansible-func-opensuse-422-nv/8b75e6c/logs/ara/result/74c19534-3ed7-4f8e-a0a0-3db3918323d5/12:19
mhaydeni'm good with 7.6M/s12:20
odyssey4meandymccr I think while it'd be useful to have ARA logs if a job times out, I think maybe it's best we refrain from making any further major changes until we get out of the current wedge12:20
*** schwicht has joined #openstack-ansible12:21
mhaydenodyssey4me: do you have any jobs/output that shows the output of that mirror script?12:21
odyssey4memhayden no, not at this time - what info are you looking for?12:22
mhaydenjust looking for how i can whip those baseurl adjustments into a script12:22
mhaydenthe linter test disable patch already died due to an old version of project-config on the node12:23
mhaydensigh12:23
odyssey4mein theory, that's already done for some: https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh#L352-L35712:23
*** shardy has quit IRC12:23
mhaydenperhaps i should adjust project-config to remove the actual repo files from centos that aren't included in that mirror script12:24
odyssey4meperhaps, then also add the appropriate RDO options too - but leave them disabled by default12:24
odyssey4meie the ones which get added when you install the RDO package12:24
mhaydenright12:24
*** shardy has joined #openstack-ansible12:25
mhaydenthe question is where to put that RDO fix12:25
mhaydensince it normally comes through via pip_install12:25
odyssey4meput it in there too12:25
*** sxc731 has joined #openstack-ansible12:25
odyssey4meeh what?12:25
odyssey4mewhat fix are you referring to?12:25
lvdombrkrevrardjp: thank you, i quite new in openstack, how can i run this pach?12:26
odyssey4meI see that we could also be smarter about how we change the ubuntu repositories for nodepool12:27
odyssey4meif these files exist, use them: https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh#L302-L30712:27
odyssey4mewe should perhaps also add mariadb mirrors for centos12:27
*** jamesdenton has quit IRC12:35
*** jamesdenton has joined #openstack-ansible12:36
evrardjplvdombrkr: you either have to wait (recommended), or you do about the same change into your /etc/ansible/roles/os_neutron (faster).12:39
lvdombrkrevrardjp: can i make this changes myself?12:40
evrardjpyes you'll have to :p12:41
evrardjpI can't change your environment12:41
lvdombrkrevrardjp: sorry but i dont understood what excatly I need to change?12:43
*** woodard has quit IRC12:45
*** woodard has joined #openstack-ansible12:46
*** goldenfr_ has quit IRC12:52
*** schwicht has quit IRC12:53
*** goldenfri has joined #openstack-ansible12:53
evrardjpthe patch is doing a change on the neutron role. If you want to test it fast, you need to apply it your on deploy. So do the same changes into your /etc/ansible/roles/os_neutron12:58
evrardjplvdombrkr: ^12:58
*** esberglu has joined #openstack-ansible13:00
mhaydeni'm going to bump my linter fix patch because it already failed centos due to project-config issues13:01
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily  https://review.openstack.org/49249413:01
*** SerenaFe_ has joined #openstack-ansible13:07
*** rodolof has joined #openstack-ansible13:08
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/ocata: Support installing plugins from packages  https://review.openstack.org/49184213:08
*** aludwar has quit IRC13:09
*** lucasxu has joined #openstack-ansible13:09
*** aludwar has joined #openstack-ansible13:10
*** schwicht has joined #openstack-ansible13:11
lvdombrkrevrardjp: i will test right now13:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos  https://review.openstack.org/49252813:14
mhaydenodyssey4me: ^^ i'll save the output so we don't have to ask this question again :P13:15
*** kylek3h has joined #openstack-ansible13:15
lvdombrkrevrardjp: now i have failed in other task: http://paste.openstack.org/raw/618046/13:19
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos  https://review.openstack.org/49252813:19
evrardjp[m]lvdombrkr: there is a bug opened for that. if you want to step up and contribute, now would be the time.13:21
*** sauloaislan has joined #openstack-ansible13:23
sauloaislanMorning!13:24
lvdombrkrevrardjp: okey i understood, thank you13:26
mhaydenodyssey4me: okay, so by default, centos appears to be using the nodepool repos for everything except RDO13:28
mhaydenhttps://gist.github.com/major/108dfc95b35bc8c25b0070fef5c1f08a13:28
sauloaislanCan someone help me?  fatal: [aio1]: FAILED! => {"failed": true, "msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"}13:28
evrardjplvdombrkr: it's really simple to contribute:13:28
evrardjphttps://docs.openstack.org/openstack-ansible/latest/contributor/contribute.html13:29
evrardjplvdombrkr: first step would be to confirm the bug here: https://bugs.launchpad.net/openstack-ansible/+bug/170542013:30
openstackLaunchpad bug 1705420 in openstack-ansible "os-neutron-install.yml fails during LBaaS v2 deployment" [Undecided,New]13:30
evrardjpJust dropping a message13:30
evrardjpsauloaislan: we'd need to know the playbook run, and the role.13:30
evrardjpand maybe some variables :)13:30
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos  https://review.openstack.org/49252813:31
mhaydendesire to move to a van down by the river grows13:32
evrardjpooooh13:33
andymccrmhayden: how is the wifi down by the river?13:33
evrardjpI'm ok for fishing.13:33
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos  https://review.openstack.org/49252813:33
evrardjpI'm pretty sure mhayden is more ready in case of phishing though.13:33
mhaydenoh yeah13:34
*** sxc731 has quit IRC13:34
andymccrhttps://pbs.twimg.com/media/BhhMT6RCUAALJYc.png:large evrardjp like that?!13:35
evrardjpOMG OMG I didn't know this one.13:35
mhayden:|13:35
andymccrhttps://pbs.twimg.com/media/BIPjeMJCAAA1WTS.jpg:large actually - new favourite13:36
sauloaislanevrardjp: See http://paste.openstack.org/show/RVvwZBZTJD6bWbCrLz32/13:38
evrardjpandymccr: the last one is saved forever.13:38
odyssey4medammit major, your lint test is breaking everything13:41
odyssey4mewe have a proper wedge now13:41
mhaydentrying to get the fix merged :|13:41
evrardjpyeah he already proposed a patch.13:41
mhaydenol' evrardjp reaaaaally wanted unit tests13:41
mhayden:P13:42
evrardjpyeah it's my fault.13:42
evrardjpI take the blame!13:42
odyssey4meso basically we have to get two successful runs of the lint patch before we can merge the lxc patch13:42
* mhayden is sending the gate good feelings13:42
odyssey4meand to get that, we have to not hit infracloud twice in a row13:42
andymccroh what we merged the lint test?13:42
evrardjpmhayden: good vibes?13:42
odyssey4meI knew I shoulda -2'd that one :/13:43
mhaydendoes anyone know where the centos image might be defined? as in what gets passed to dib to build it13:43
* andymccr is an oracle and suggested not merging it because we are at rc1 and that can seriously wait until things have settled down :P13:43
andymccri recommend reverting the lint thing13:43
andymccruntil like a month or so13:44
evrardjpok13:44
mhaydenandymccr: could propose that too and see which merges first13:44
andymccrwhen everything is smoothly working but right now we have image issues, centos timeout issues, lint issues, other general infra issues13:44
odyssey4mewell, I guess we recheck until it passes13:44
*** marst_ has joined #openstack-ansible13:54
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Revert "Add linter for passing pkgs as list"  https://review.openstack.org/49253913:54
mhaydeni went ahead and proposed a revert13:54
mhaydenhopefully one of them passes13:54
mhaydenand we can toss the other one13:54
sauloaislanevrardjp: Did you see my playbook ?13:55
andymccrmhayden: yeah, FTR, the linters are great, i am massively in favour of them going in - just not right now13:55
mhaydenandymccr: i wish i could put a short circuit on the revert to be like "if review == 492539; then exit 0; done"14:00
mhayden:P14:00
andymccrmhayden:  ahhahaha yes14:00
*** gouthamr has joined #openstack-ansible14:00
andymccrmhayden: alas :(14:00
mhaydeni could, but i would feel horribly unethical14:00
andymccrBGB merges - ahh how i miss them14:00
mhaydenwell, on that topic, can someone administratively merge that revert for us? since we're so close to release time?14:01
andymccrwe can just hope for the best i guess ;D14:02
*** mrch has joined #openstack-ansible14:04
*** SerenaFe_ has quit IRC14:04
*** vnogin has joined #openstack-ansible14:12
mhaydenodyssey4me: 491803 (common pip cache) passed xenial in the gate!14:15
mhaydentempest is running on the centos gate14:15
mhaydencentos timed out :/14:20
mhaydenon the unit test disable part14:20
mhaydeni'll bump the patch to get it running again since we'd have to wait forever for a recheck14:21
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily  https://review.openstack.org/49249414:21
odyssey4memhayden two patches going now - whichever one wins :)14:22
randy^^mhm, is there any "caching" of ansible facts within OSA? neutron install wants to connect to a "wrong" ip address..14:22
randy^^(beside of /etc/openstack_deploy/ansible_facts/)14:23
lvdombrkrguys, is there worh to think deploy openstack ansible on Centos in production env.?14:25
lvdombrkror only on Ubuntu?14:25
randy^^lvdombrkr: i'm just trying with cents 7 :)14:25
lvdombrkrrandy^^: im also build my test env on Centos alredy, but now thinks about production env14:27
*** lbragstad has quit IRC14:28
lvdombrkrrandy^^: there was some direct Centos issue during deployment thats why im asking14:31
openstackgerritMerged openstack/openstack-ansible-tests master: Use common pip cache for host & containers  https://review.openstack.org/49180314:31
lvdombrkr*issues14:31
*** sxc731 has joined #openstack-ansible14:32
*** tobberyd_ has joined #openstack-ansible14:32
eoseqlvdombrkr: what issues?14:33
eoseqI see at least one, that installing packages with yum fail sometimes14:34
*** drifterza has quit IRC14:34
eoseqbut yum update fix the problem and next run pass14:34
*** tobberydberg has quit IRC14:36
eoseqlvdombrkr: I ask, because we are in the process of deploying production on CentOS 714:36
*** tobberyd_ has quit IRC14:37
lvdombrkreoseq: there was a problem with file cashing (but its already resolved in 15.1.8,)14:38
*** yifei has joined #openstack-ansible14:38
lvdombrkreoseq:  which version do you deploy?14:38
evrardjpsauloaislan: Hey. I didn't. If you are just looking for ironic + ansible, have you ever heard of bifrost?14:40
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs  https://review.openstack.org/49255114:41
evrardjpsauloaislan: this way you don't need a full openstack cloud.14:41
evrardjpbut I could watch that later with you.14:41
eoseqlvdombrkr: I don't know, where should I check? git clone -b stable/ocata14:42
*** yifei has quit IRC14:43
mhaydenodyssey4me: yay, the common pip wheel directory merged14:43
mhaydenthat should help a little14:43
evrardjpmhayden: I was just about to say that14:44
evrardjpyou are fast sir!14:44
* mhayden is watching zuul status like a hawk14:44
openstackgerritAndy McCrae proposed openstack/openstack-ansible-ceph_client master: Move to use filtered packages/services/clients  https://review.openstack.org/49255614:44
openstackgerritAndy McCrae proposed openstack/openstack-ansible-ceph_client master: Move to use filtered packages/services/clients  https://review.openstack.org/49255614:45
sauloaislanevrardjp: I need Neutron14:47
openstackgerritAndy McCrae proposed openstack/openstack-ansible-ceph_client master: Move to use filtered packages/services/clients  https://review.openstack.org/49255614:55
odyssey4meeoseq git checkout -b stable/ocata will create a new local branch with that name... you wouldn't be using stable/ocata unless your current head is already there14:57
*** lbragstad has joined #openstack-ansible14:59
matttmhayden: what'd you break15:03
openstackgerritAndy McCrae proposed openstack/openstack-ansible-galera_server master: Add upgrade check for dnf  https://review.openstack.org/49256415:03
andymccrmattt:  mhayden was auditing our review processes - we failed :(15:03
matttandymccr: that guy :(15:04
*** vnogin has quit IRC15:04
*** SerenaFe_ has joined #openstack-ansible15:05
*** lvdombrkr has quit IRC15:06
eoseqodyssey4me: I did git clone, bootstrapped and that's all as for now15:06
*** vnogin has joined #openstack-ansible15:07
*** lvdombrkr has joined #openstack-ansible15:07
andymccrmhayden: btw we will need https://review.openstack.org/#/c/492564/ before dnf will work15:09
andymccrfor galera server at least15:10
mhaydenandymccr: already deuced it15:10
andymccryou are too fast for me15:10
mhaydenso i did some digging on the RDO repo15:10
mhaydenthe rpm that we install for RDO just configures repos that already exist in the centos-extras repo15:10
mhaydenso we could avoid downloading that random RPM in pip-install and just use the packages in extras15:11
mhaydenthe end result is the same -- points to the same repo15:11
odyssey4mesounds good to me15:11
mhaydenbut we could use the nodepool mirrors easier15:11
mhaydento implement15:11
odyssey4mealthough I remember we went through a bunch of these, so perhaps mgariepy should weigh in15:12
*** vnogin has quit IRC15:12
xgerman_I have trouble with the linter on https://review.openstack.org/#/c/484440/ but I am not sure if it’s jenkins or me - anybody seen something similar15:14
xgerman_?15:14
andymccrxgerman_: its not you most likely :)15:14
mhaydenxgerman_: yeah, waiting on a patch to merge15:14
mhaydenxgerman_: https://review.openstack.org/49249415:14
openstackgerritAndy McCrae proposed openstack/openstack-ansible-haproxy_server master: Pass list of packages instead of "with_items"  https://review.openstack.org/49256915:15
xgerman_ah, ok15:15
*** Oku_OS is now known as Oku_OS-away15:15
mhaydenwell but installing those repo packages via yum causes dependencies to be added that we don't want15:16
* mhayden will hack arond a little15:16
*** sdake_ is now known as sdake15:27
spotzGreetings my fellow OSAers! •cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccoll15:33
spotzum, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen15:33
spotz Friendly reminder we will be meeting in 27 minutes in #openstack-meeting-4 Agenda is available at https://wiki.openstack.org/wiki/Meetings/openstack-ansible#Agenda_for_next_meeting15:33
openstackgerritAndy McCrae proposed openstack/openstack-ansible-os_aodh master: Standardize services list and package installation  https://review.openstack.org/49258015:33
andymccroh yeah lemme update hahaha15:35
andymccrim terribad15:35
odyssey4meandymccr mhayden FYI cloudnull has made arrangements, so once this merges things should speed up a bit: https://review.openstack.org/#/c/492566/15:37
odyssey4mecloudnull for prez15:37
mhaydenindeedy!15:37
andymccrcloudnull: for prez!15:37
* cloudnull hides15:37
andymccrdid you threaten infra team with fire and fury cloudnull?!15:37
mhaydeni passed the person who approved that change in the hall and attempted to hug him15:37
cloudnulldid he accept your hugs ?15:38
matttwho wouldn't accept a hug from mhayden15:40
matttliekrly15:40
odyssey4memhayden is a hug-er-ator15:42
*** chyka has joined #openstack-ansible15:46
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl  https://review.openstack.org/49260115:53
mhaydenodyssey4me: ^^ so infra mirrors the entire centos repo, which contains virt/cloud directories already15:54
mhaydenno need to use the RDO proxy -- can use the existing CentOS mirror ;)15:54
odyssey4meoh neat15:54
odyssey4mebut for our normal, production builds, what should happen?15:55
mhaydenugh, both fixes to openstack-ansible-tests failed on centos15:55
mhayden:|15:55
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Revert "Add linter for passing pkgs as list"  https://review.openstack.org/49253915:55
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily  https://review.openstack.org/49249415:55
odyssey4memhayden perhaps we should avoid any major repo changes until we have a more stable gate15:56
odyssey4mealthough perhaps that may help to stabilise15:57
mhaydenshould speed up os_nova's package install15:57
odyssey4meI can't really evaluate whether what you're doing there is right. Is mgariepy around?15:57
mgariepyyep i'm here.15:58
mhaydeni did workflow-1 so we could avoid tinkering until we get these tests patches merged15:59
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery  https://review.openstack.org/49246516:00
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs  https://review.openstack.org/49255116:00
mhaydenhah, i failed at jinja on the pip-install one16:01
spotzevrardjp: and I are lonely people!!!16:02
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl  https://review.openstack.org/49260116:02
evrardjpspotz: only if that was true :)16:02
spotzheheh16:03
spotzI think I needed a comma in there somewhere:)16:03
*** BjoernT has joined #openstack-ansible16:08
spotzcloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle16:08
spotz, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen - we be in meeting room 4!!!!16:08
BjoernT.off16:12
*** kristian__ has quit IRC16:18
*** SerenaFe_ has quit IRC16:21
*** tobberydberg has joined #openstack-ansible16:22
*** pcaruana has quit IRC16:25
*** tobberydberg has quit IRC16:26
*** lucasxu has quit IRC16:27
mhaydencloudnull: quota increase merged16:29
odyssey4memhayden cloudnull yep, now nodes need to be built and prepped before adding into nodepool16:31
odyssey4meI'd expect the backlog to catch up by our morning.16:32
odyssey4mehopefully tomorrow it'll be able to keep pace16:32
odyssey4meI fully expect mhayden to be rechecking the linter revert all night until it merges.16:35
odyssey4me:p16:36
*** mbuil has quit IRC16:36
* mhayden sads16:37
mhaydenso both patches to openstack-ansible-tests reached tempest at the 30 min mark, which is promising!16:38
*** jvidal has quit IRC16:40
*** sxc731 has quit IRC16:42
mhaydenokay, both of the openstack-ansible-tests passed centos16:49
andymccrmhayden: you are an inspiration.16:49
andymccralthough i guess they could time out infinitely on the image retrieval :P16:49
mhaydenhaha, well it's gotta pass ubuntu and get into the gate :|16:49
andymccrwell there isnt much we can do rn, im gonna head home - i'll continue my war against package lists and filtered services tomorrow - thanks for following up mhayden. i'll check online later to see how its going.16:53
*** marst_ has quit IRC16:54
*** marst_ has joined #openstack-ansible16:54
mhaydenwow, triple-o has a buncha nodes17:01
mhaydenin nodepool17:01
*** germs has joined #openstack-ansible17:01
odyssey4meyep, they have a special case set of things17:01
odyssey4meapparently they've been trying to unwind a bunch of complexity that was there from very early on and it's been rather hellish17:02
mhaydeni was gandering at http://grafana.openstack.org/dashboard/db/nodepool?panelId=13&fullscreen17:03
mhaydenlooks like the new capacity from rax is kicking in17:04
palendae\o/17:04
mhaydenstill 324 jobs in check, 160 in post :/17:04
mhayden33 in the gate17:04
mhaydeneverything we've proposed for openstack-ansible-tests has passed centos (or is about to pass), waiting on xenial :/17:05
*** tobberydberg has joined #openstack-ansible17:05
*** electrofelix has quit IRC17:08
*** tobberydberg has quit IRC17:10
*** marst_ has quit IRC17:13
*** drifterza has joined #openstack-ansible17:16
*** markus_z has quit IRC17:30
openstackgerritSanthosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db  https://review.openstack.org/49263117:36
*** craigs__ has joined #openstack-ansible17:38
*** shardy has quit IRC17:38
openstackgerritSanthosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db  https://review.openstack.org/49263117:39
openstackgerritSanthosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db  https://review.openstack.org/49263117:44
sauloaislanCan someone help me? fatal: [aio1]: FAILED! => {"failed": true, "msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"}17:46
*** sanfern has joined #openstack-ansible17:46
evrardjpsauloaislan: didn't I just helped you on that?17:49
evrardjpsauloaislan: on what playbook/role do you have that appearing?17:50
*** gouthamr_ has joined #openstack-ansible17:51
*** gouthamr has quit IRC17:51
sauloaislanevrardjp: this is my .sh http://paste.openstack.org/show/a2KSP6RHuqD5XWuNzTDt/17:53
evrardjpwhere is your run log?17:54
sauloaislanevrardjp:   erro apper in setup-hosts.yml17:54
evrardjpmore precisely?17:54
sauloaislanevrardjp: TASK [resolvconf : Gather variables for each operating system]17:54
sauloaislanevrardjp: /etc/ansible/roles/resolvconf/tasks/main.yml:1617:55
evrardjpThere is a patch pending for that I think.17:55
evrardjpour gates are jammed right now, so we'll unlock this situation, but we cannot unlock now. Can you run on a tag instead?17:55
sauloaislanthis https://review.openstack.org/#/c/491508/1 ?17:55
evrardjpsauloaislan: https://review.openstack.org/#/c/491508/17:56
evrardjpyes17:56
evrardjpsauloaislan: can you afford to run on stable branch?17:57
*** tobberydberg has joined #openstack-ansible18:01
sauloaislanevrardjp: the case is that we use this master in order to setup dev environments with master code for OS components18:01
evrardjpoh ok.18:02
sauloaislanevrardjp:  Is it possible to launch the containers with stable ocata ansible and master code for Os components?18:02
evrardjpthe openstack-infra is under heavy contention right now.18:02
evrardjpare you in a rush?18:03
sauloaislanping me back when you have some time18:04
evrardjpit's the end of the day for me18:06
evrardjpbut this patch will be in our recheck list I guess, when our lint bug is fixed.18:06
sauloaislanOk thks!!!18:07
*** chhavi has quit IRC18:08
*** rodrigofm has joined #openstack-ansible18:09
mhaydenAnsible 2.4 due out mid September18:11
*** tobberydberg has quit IRC18:12
openstackgerritSanthosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db  https://review.openstack.org/49263118:13
eoseqhi, does anyone keeps hidden in the pocket (and want to share) a recipe how to change MTU for interfaces in containers? I've run "lxc-containers-create.yml" and waiting, waiting, waiting, drinking coffee, staring at the screen, seeing "ok: [container_name]", grepping "mtu /var/lib/lxc/*/*.ini | grep -v 1500" ...18:14
openstackgerritSanthosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db  https://review.openstack.org/49263118:15
*** sanfern has quit IRC18:27
*** germs has left #openstack-ansible18:28
*** smatzek has quit IRC18:32
mw_eoseq: You want to change the MTU for the lxcbr0 network?18:33
*** smatzek has joined #openstack-ansible18:36
*** germs1 has joined #openstack-ansible18:37
*** BjoernT has quit IRC18:37
*** BjoernT has joined #openstack-ansible18:38
*** nollide has joined #openstack-ansible18:40
*** rodrigofm has left #openstack-ansible18:43
mw_eoseq: Ping :)18:48
taskercloudnull: hey, thanks! I thought might have to happen. Good to know that OSA helps out with that.18:55
*** pbandark has quit IRC18:57
*** BjoernT has quit IRC19:01
*** portdirect is now known as eteppete19:02
*** jamesdenton has quit IRC19:03
*** openstackgerrit has quit IRC19:03
*** jamesdenton has joined #openstack-ansible19:03
*** eteppete is now known as portdirect19:03
*** BjoernT has joined #openstack-ansible19:06
*** perniciouscaffei has joined #openstack-ansible19:13
taskersome clarification, if you mention "run the hap(roxy) role", is there a specific syntax to that? I'm not sure how to "run a role". I parse the suggestion to mean "run the haproxy playbook". is that the right way to read that?19:14
cloudnull++19:14
cloudnullopenstack-ansible haproxy-install.yml19:14
cloudnullshould be all you need19:14
*** portdirect has quit IRC19:17
mgariepyhttp://paste.openstack.org/show/618095/19:17
mgariepyanyone seen this ?19:17
cloudnullmgariepy: no facts?19:17
*** portdirect has joined #openstack-ansible19:17
cloudnullor bad facts?19:17
mgariepyit's in /etc/openstack_deploy/ansible_facts/controller03_galera_container-e57742ca19:17
cloudnullmaybe delete the facts and then run again ?19:18
cloudnullwhenever i see things like that I typically nuke the facts dir19:18
taskercloudnull: thanks. that's what I was thinking.19:18
*** vnogin has joined #openstack-ansible19:19
mgariepycloudnull, removed /etc/openstack_deploy/ansible_facts/controller03_galera_container-e57742ca and got the same result.19:22
*** vnogin has quit IRC19:24
mgariepyhmm gather_fact + -l doesnt' seems to work well..19:24
*** kristian__ has joined #openstack-ansible19:28
*** kristian__ has quit IRC19:33
*** nollide has quit IRC19:35
*** nollide has joined #openstack-ansible19:37
*** kristian__ has joined #openstack-ansible19:38
*** tobberydberg has joined #openstack-ansible19:38
*** tobberydberg has quit IRC19:42
*** tobberydberg has joined #openstack-ansible19:47
*** openstackgerrit has joined #openstack-ansible19:50
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/newton: Support installing plugins from packages  https://review.openstack.org/49102619:50
*** kristian__ has quit IRC19:50
*** tobberydberg has quit IRC19:52
mhaydenoh my, 492539 moved into the gate19:56
* mhayden holds his breath19:56
evrardjpmhayden: woot. Quite an important milestone.19:56
evrardjpI was talking about ansible 2.4, but this applies too.19:57
*** tobberydberg has joined #openstack-ansible19:57
*** kristian__ has joined #openstack-ansible20:00
mhaydenodyssey4me: i added the depends-on to the pip_install review, not https://review.openstack.org/49255120:00
mhaydendo i have it backwards?20:00
mhaydenoh nvm i think i see where you're going20:01
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs  https://review.openstack.org/49255120:03
mhaydenxenial passed, but centos is crawling20:03
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl  https://review.openstack.org/49260120:04
*** jwitko has joined #openstack-ansible20:04
*** smatzek has quit IRC20:07
*** tobberydberg has quit IRC20:09
mhaydenwow, the check jobs are down from 326 to 9820:10
* mhayden high fives cloudnull20:10
*** aludwar has quit IRC20:11
spotzwoot mhayden cloudnull!!!!20:12
mhaydentempest tests started 41 minutes into the job. this is gonna be close20:13
*** aludwar has joined #openstack-ansible20:13
prometheanfire:D20:16
evrardjpyeah.20:16
evrardjpmore thrilling than watching a horse race.20:16
spotzheheh20:17
*** tobberydberg has joined #openstack-ansible20:18
taskerrunning the haproxy-install playbook again did not result in a single config file. I'm using OSA 13.3.7; do I need to change versions? or maybe an old fact is getting in my way (though, it gathered facts right before running)? moving the old configs out of the way also did not help.20:20
*** hamzy has quit IRC20:24
*** pbandark has joined #openstack-ansible20:29
*** pbandark has quit IRC20:29
openstackgerritMerged openstack/openstack-ansible-tests master: Revert "Add linter for passing pkgs as list"  https://review.openstack.org/49253920:32
*** sdake is now known as k2so20:37
*** kristian__ has quit IRC20:38
mhaydenYAY!20:38
*** yusef has joined #openstack-ansible20:38
mhayden#success mhayden cleaned up his own mess and unblocked the gate (but it did take about 8 hours)20:38
openstackstatusmhayden: Added success to Success page20:39
mhaydenhaha20:39
*** jamesdenton has quit IRC20:39
*** aludwar has quit IRC20:41
*** asura has joined #openstack-ansible20:42
*** aludwar has joined #openstack-ansible20:42
SamYaple:+1:20:42
asuraAnyone seen the following error on this task:20:42
asurafatal: [infra1_horizon_container-9ef7698e]: FAILED! => {"failed": true, "msg": "Timeout (7s) waiting for privilege escalation prompt: mesg: ttyname failed: Success\r\n"}20:42
asuratask [os_horizon : Collect and compress static files] **************************20:42
*** jamesdenton has joined #openstack-ansible20:42
asuraAppears when I try to sudo -i inside the infra1_horizon_container-9ef7698e container20:43
taskersudo usually requires access to the TTY so that it can ask for a password. look at the ansible keyword "become" when you need to get elevated permissions.20:44
asuraYeah, the container appears to not be able to acquire the TTY20:44
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl  https://review.openstack.org/49260120:45
asuraroot@infra1-horizon-container-9ef7698e:~# sudo -i mesg: ttyname failed: Success root@infra1-horizon-container-9ef7698e:~#20:45
taskeroh .. interesting. can you reboot the container? or log out / log back in?20:46
*** esberglu has quit IRC20:47
*** gouthamr_ has quit IRC20:50
openstackgerritMajor Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl  https://review.openstack.org/49260120:51
taskerlooks like I need at least OSA 14.0.0 in order to concatenate my haproxy config. 14.0.0 references the (at the time) new "openstack-ansible-haproxy_server" repo and uses the ansible module "assemble" to concatenate the /etc/haproxy/conf.d files into a single haproxy.cfg20:51
*** nollide has left #openstack-ansible20:52
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs  https://review.openstack.org/49255120:54
asuraI rebooted it and the error is still there.  I'm going to try and destroy it and rerun the setup-hosts.yml20:54
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery  https://review.openstack.org/49246520:54
openstackgerritMajor Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs  https://review.openstack.org/49255120:54
*** perniciouscaffei has quit IRC20:59
*** esberglu has joined #openstack-ansible21:01
*** tobberydberg has quit IRC21:02
*** esberglu_ has joined #openstack-ansible21:02
*** esberglu has quit IRC21:02
*** tobberydberg has joined #openstack-ansible21:02
*** tobberydberg has quit IRC21:07
openstackgerritMerged openstack/openstack-ansible-galera_client master: Install MariaDB-shared  https://review.openstack.org/49193021:07
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Run resolvconf role on hosts only after unbound is deployed  https://review.openstack.org/49150821:08
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_octavia master: Enable V2 Octavia API (Experimental)  https://review.openstack.org/48444021:08
spotzthings are going through!!!!!21:10
asuraAfter destroying the horizon container, would the following be a good approach:  openstack-ansible setup-hosts.yml --limit infra1_horizon_container-9ef7698e; openstack-ansible setup-infrastructure.yml --limit infra1_horizon_container-9ef7698e; openstack-ansible setup-openstack.yml --limit infra1_horizon_container-9ef7698e ?21:11
*** jwitko has quit IRC21:11
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Update fastest-infra-wheel-mirror  https://review.openstack.org/49119521:12
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Improve proxy vars in user_variables.yml  https://review.openstack.org/49179121:13
openstackgerritMajor Hayden proposed openstack/openstack-ansible master: Revert "Reduce container counts for cinder, ironic and trove"  https://review.openstack.org/47182221:13
* mhayden rechecked/rebased a bunch21:16
* mhayden heads out21:16
cloudnulltasker: are you running newton ?21:18
cloudnullasura: if you're just looking to kick the new container21:18
cloudnullopenstack-ansible lxc-container-create.yml --limit horizon_all21:18
cloudnullopenstack-ansible os-horizon-install.yml21:18
cloudnulland you should be good21:18
asuraI'm trying with 14.2.7; got stuck on the final step openstack-ansible setup-openstack.yml21:19
cloudnullmgariepy: sorry was driving home21:19
cloudnulldid you get it to go ?21:19
asurawell i destroyed that container and I'm trying again openstack-ansible setup-openstack.yml21:19
asurabut that container still has that error message when I sudo -i inside it21:20
cloudnullif you destroyed it, you'll need to recreate it using lxc-container-create.yml21:20
asuraso, it'll probably error again21:20
cloudnullif you've not run that already21:20
taskercloudnull: mitaka -- I'm working out an upgrade path to get to Newton.21:20
cloudnulltasker: ah!21:20
cloudnullso mitaka didn't actually support 16.0421:20
taskerright.21:21
cloudnullso you'll need to checkout the newton playbook, resolve the roles21:21
cloudnulland then run again21:21
cloudnullthis is why the playbook is not fixing things for you.21:21
cloudnullbut you can just concatenate the files yourself ?21:21
cloudnullif you just need it fixed here and now21:22
cloudnulland then you can map out the upgrade.21:22
taskerI could -- I'm just a lazy programmer. <g>21:22
cloudnullnewton supports both 14.04 and 16.04 at the same time21:22
cloudnullso you should be safe to checkout the newton branch of osa,21:22
cloudnullrun ./scripts/bootstrap-ansible.sh21:23
cloudnulland then run the haproxy-oinstall.yml playbook21:23
*** gouthamr has joined #openstack-ansible21:24
*** thorst has quit IRC21:24
taskeri figured changing the OS first, then using OSA to update the OpSt. it almost sounds like your hinting that doing OpSt first and then the operating system.21:24
cloudnull++21:24
cloudnullwe built the newton branch to do just that21:25
cloudnullyou can get to newton, then do the os upgrades without having to deal with the openstack upgrades too21:25
taskerI must've missed that during my research sprint.21:25
cloudnulland newton can run in a mixed 1404 and 1604 environment21:25
taskerthat's fantastic.21:26
cloudnullso folks can upgrade with time21:26
cloudnullthe only requirement is you have at least 1 infra node (for the repo servers) in whatever os you wish to support21:26
taskeras opposed to a repo_container?21:26
*** thorst has joined #openstack-ansible21:27
cloudnullwhich means you could have cent7, trusty, suse, and xenial as your control plane and you'd be able to run computes or containers in all the os's21:27
cloudnullthe containers are built using the base os21:27
cloudnullof the host21:28
cloudnullso you need 1 repo container running the os of the type you wish to support21:28
taskerI think I get what you're saying .. the host from which I run OSA?21:28
cloudnullyes.21:29
cloudnullso infra1 = trusty, infra2 = trusty, infra3 = xenial and you'd be good to go21:29
cloudnullthen you can role through the rest of your environment rekicking or upgrading in place to get everything to xenial21:30
taskergreat! thanks for your insight.21:30
*** thorst has quit IRC21:31
spotzmhayden no beuno on neutron dbf21:35
spotzdnf even21:35
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value  https://review.openstack.org/49245221:40
evrardjpthanks mhayden for following this21:44
*** thorst has joined #openstack-ansible21:49
*** thorst has quit IRC21:54
*** aludwar has quit IRC21:57
openstackgerritMerged openstack/openstack-ansible-galera_client master: Allow MariaDB gpg overrides without extra-vars  https://review.openstack.org/49207421:58
*** aludwar has joined #openstack-ansible21:58
spotzcloudnull evrardjp mhayden - https://review.openstack.org/#/c/491089/9 passed!!!!!22:00
cloudnullwoot!22:00
*** schwicht has quit IRC22:01
spotzcloudnull: give it a hand across the finish line!22:01
cloudnulldone22:01
spotz:)22:01
*** kylek3h has quit IRC22:07
evrardjpwell let's see that it passes the merge22:08
evrardjp:D22:08
evrardjpodyssey4me: you'll like to know that this passed: https://review.openstack.org/#/c/492074/  too :p22:12
*** vnogin has joined #openstack-ansible22:13
*** openstackgerrit has quit IRC22:18
*** vnogin has quit IRC22:18
*** exodusftw has quit IRC22:19
*** exodusftw has joined #openstack-ansible22:23
*** schwicht has joined #openstack-ansible22:24
cloudnullso what all needs to be babysat to make master happy once again ?22:32
evrardjpI had the impression that we had another series of patches, but I rechecked what you didn't recheck yet cloudnull22:40
evrardjpat least what I know Jesse cared :p22:40
evrardjpand the bare minimum to be honest, so I'd probably missed some22:40
evrardjpI am tired, I'm going to bed ... See you tomorrow!22:40
cloudnullchao evrardjp22:42
cloudnullsee you tomorrow22:42
spotznight evrardjp22:44
spotzcloudnull: if you have a link of things to watch I should be about after we run out to the store22:45
cloudnullim just keeping an eye on zuul22:45
*** openstackgerrit has joined #openstack-ansible22:45
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Update UCA to Pike  https://review.openstack.org/49188022:45
*** BjoernT has quit IRC22:47
*** esberglu_ has quit IRC22:47
*** yusef has quit IRC22:48
*** schwicht has quit IRC22:51
*** craigs__ has quit IRC23:01
openstackgerritMerged openstack/openstack-ansible-os_swift master: Optimize swift gate  https://review.openstack.org/49108923:02
*** rodolof has quit IRC23:11
*** rodolof has joined #openstack-ansible23:11
*** gouthamr has quit IRC23:12
openstackgerritMerged openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery  https://review.openstack.org/49246523:14
*** chyka has quit IRC23:15
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests  https://review.openstack.org/49054823:16
*** rodolof has quit IRC23:25
*** thorst has joined #openstack-ansible23:38
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Download LXC image with async via aria2  https://review.openstack.org/49179823:55
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Download LXC image with async via aria2  https://review.openstack.org/49179823:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!