Wednesday, 2016-02-10

greghaynesYea, we need some indirectoin00:00
jeblairgreghaynes: i'm guessing when this passes it's probably another thread happening to notice the disconnect first00:00
*** eil397 has quit IRC00:00
clarkbwhat if we don't subit the job and just change the db state00:00
clarkbthen rely on the periodic cleanup to fix it?00:00
*** Sukhdev has joined #openstack-infra00:01
jeblairseems safe and simple?00:01
greghaynesjeblair: clarkb Something else I have been thinking is if the builders could notice the disconnect case and handle it by deleting the image00:01
greghayneswhich would work great combined with just deleting the db statae00:01
jeblairgreghaynes: they could probably do so by sending periodic work_status packets00:02
clarkbdoes the server not send an ERROR when the client goes away?00:02
jeblairgreghaynes: if a sendWorkStatus fails, they'll notice00:02
clarkbthat is sort of how I would expect the server to pass that info a long00:02
greghaynesjeblair: awesome00:03
*** Jeffrey4l has quit IRC00:03
jeblairclarkb: iirc, the protocol document does not specify notification to the worker on a client disconnect00:03
*** yamamoto_ has quit IRC00:03
jeblairclarkb: it might be worth checking gearmand to see what it does00:03
*** rm_work has quit IRC00:04
*** Sukhdev has quit IRC00:04
jeblairit's weirdly asymmetrical like that00:04
*** Sukhdev has joined #openstack-infra00:04
jeblair(the protocol, that is)00:04
*** c-jm has quit IRC00:05
*** Sukhdev has quit IRC00:08
*** dimtruck is now known as zz_dimtruck00:09
*** kzaitsev_mb has joined #openstack-infra00:09
*** rm_work has joined #openstack-infra00:09
*** rbrndt has quit IRC00:17
*** armax has quit IRC00:17
*** e0ne has quit IRC00:18
*** shashank_hegde has joined #openstack-infra00:19
*** Sukhdev has joined #openstack-infra00:19
openstackgerritMerged openstack-infra/release-tools: use the name we derive from the project instead of the path  https://review.openstack.org/27814300:23
*** olaph has quit IRC00:26
*** esker has quit IRC00:28
*** flwang has quit IRC00:29
*** annegentle_ has joined #openstack-infra00:29
*** vilobhmm11 has joined #openstack-infra00:30
vilobhmm11clarkb : jenkins not reporting anything for review seems like its stuck http://status.openstack.org/zuul/00:30
vilobhmm11fungii, jeblair : ^^00:31
clarkbvilobhmm11: which change ?00:31
vilobhmm11https://review.openstack.org/24536200:31
vilobhmm11clarkb : ^^00:31
clarkbif you click on the change yo ucan see that one job is still running00:31
vilobhmm11clarkb : any idea whats going wrong here or logs i can check to know what might be wrong here00:32
clarkbthat job has been running for 6 hours00:32
clarkbhttps://jenkins04.openstack.org/job/gate-tempest-dsvm-neutron-src-tooz/98/console00:32
clarkblooks like the job timeout failed to end the job00:32
clarkbI can manually kill it00:32
vilobhmm11is that a bug ?00:32
vilobhmm11clarkb : sure thanks!00:32
clarkbyes probably some jenkins issue with when/how the timeout occurs00:32
*** kgiusti has left #openstack-infra00:33
*** kzaitsev_mb has quit IRC00:39
*** annegentle_ has quit IRC00:41
*** Apsu has quit IRC00:42
*** Apsu has joined #openstack-infra00:42
*** akshai has quit IRC00:43
*** flwang has joined #openstack-infra00:43
*** zz_dimtruck is now known as dimtruck00:44
daemontoolanyone around to review https://review.openstack.org/#/c/278070/  ? it was already +[2A]ed00:44
*** eil397 has joined #openstack-infra00:45
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/release-tools: Use yes/no for pypi flag  https://review.openstack.org/27816700:46
*** achanda has joined #openstack-infra00:46
zaroclarkb: hey, wondering we use gerritlib when there's pygerrit?  pygerrit seems better (or futher along at least).00:49
zaro*why we use00:49
clarkbzaro: because nothing else existed when we wrote gerritlib?00:50
zaroclarkb: well now there is and it's better, what do you think we should do in this case?00:50
clarkbnothing?00:50
daemontoollol00:50
clarkbI don't really think there is much value in porting everything00:50
clarkbif we need some hard to implement feature smaybe00:51
zaroclarkb: would it make sense to deprecate gerritlib and tell everyone to use pygerrit?00:51
clarkbI don't think so00:51
*** thorst has joined #openstack-infra00:52
clarkbzaro: it would've been nice if sony had collaborated on making gerritlib better00:52
clarkbbut looks like it was an internal project for them for a long time before it got pypi'd00:52
clarkbzaro: the problem with doing things like that is it just generates work when gerritlib is working fine00:53
anteayaso just to give folks an opportunity to give me feedback on my actions prior to me taking them, I'm of a mind to post to the third-party-announce list asking intel-openstack-ci why there are posting sucess on a patch: https://review.openstack.org/#/c/278151/1 when the logs report the test actually failed:00:53
clarkband gerritlib existed first00:53
anteayahttp://intel-openstack-ci-logs.ovh/networking-odl-vhostuser-ci/refs/changes/51/278151/1/2016-02-09_23:56:52/console.html00:53
clarkbso it is likely to have users00:53
anteayaI'll make a cup of tea and take feedback00:53
anteayaany opposition to my intended action?00:53
*** kzaitsev_mb has joined #openstack-infra00:54
daemontoolI object on the cup of the, lol00:54
zaroclarkb: imo it seems like more work to maintain 2 projects that do the same thing.00:54
*** thorst has quit IRC00:54
clarkbwe only maintain one...00:54
clarkband it works00:55
clarkband it existed first00:55
*** thorst has joined #openstack-infra00:55
clarkbspending time to retrofit can only add bugs and waste time00:55
fungizaro: i suppose gerritlib could be turned into a compatibility shim/wrapper around pygerrit if someone wanted to write that?00:55
clarkbif there is an additional benefit to switching then it may be worthwhile00:55
clarkbI just don't want to switch because sony pushed their code after ours00:56
zaroclarkb: so lets step back.  i'm not advocating to retrofit.00:56
daemontoolclarkb,  fungi  at your convenience, can you please take a look at https://review.openstack.org/#/c/278070/ it was already approved, just an error in the regex00:56
*** SumitNaiksatam has quit IRC00:56
* anteaya notes daemontool's opjection00:57
clarkbzaro: is there a feature we need that is missing from gerritlib that exists in pygerrit?00:57
clarkbzaro: is there are bug that could be corrected?00:57
clarkbI think we shouldn't switch unless we can make improvements lik etat00:57
*** tzn has quit IRC00:58
*** jokke_ has quit IRC00:58
*** jokke_ has joined #openstack-infra00:58
zaroclarkb: people may want to use python thru gerrit REST api.  pygerrit already has that.00:59
clarkbthat doesn't require switching existing code to it00:59
*** achanda has quit IRC00:59
zaroclarkb: yeah agree.  again i'm not advocating switching code.  i don't want to do that either.01:00
*** thorst has quit IRC01:00
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests  https://review.openstack.org/17700201:00
zaroi'm just wondering if there's a way to get people to join forces on 1 project instead of 201:00
clarkbzaro: my suggestion 2 years ago would've been to focus on gerritlib :) but I guess that ship hsa long sailed01:00
*** markvoelker has joined #openstack-infra01:01
zaroclarkb: yeah, the only reason i think we should point ppl to pygerrit is that it's just better at this point.01:02
clarkbprobably the bes tthing would be to just advertise what features pygerrit does have and as people need those things they can naturally shift their efforts there01:02
*** armax has joined #openstack-infra01:02
zaroclarkb: exactly what i was thinking01:02
zaroclarkb: has this been done before on openstack project? i'm sure it has01:03
clarkbfwiw their ssh interface does not look better01:03
clarkbit doesn't seem to do any output processing and you provide raw command and get raw results01:03
zaroclarkb: it's more bare bones, but very simple01:03
clarkb(at least the docs don't say if it handles paging and the weird metadata line of jason)01:04
fungiso is popen('ssh mygerrit' % command)01:04
fungier, mailercode ;)01:04
*** sflanigan has quit IRC01:05
anteayatea is made composing my email01:05
openstackgerritfumihiko kakuma proposed openstack-infra/project-config: Use constraints based job to the gate of ofagent  https://review.openstack.org/26198201:05
*** gokrokve has joined #openstack-infra01:05
clarkbfungi: well it has native types for the json, you just have to compiose it all yourself and possibly cleanout the metadata and deal with paging01:05
clarkbalso for the events01:05
clarkbso there are handy bits01:05
*** gildub has joined #openstack-infra01:06
*** eil397 has quit IRC01:06
clarkbI am just grumping that our thing which existed first was ignored and now I am expected to switch01:06
*** annegentle_ has joined #openstack-infra01:06
*** angdraug has quit IRC01:07
*** sflanigan has joined #openstack-infra01:07
*** sflanigan has joined #openstack-infra01:07
zaroclarkb: really, it's still being ignored.01:07
zaroclarkb: except for my recent reviews :)01:08
clarkbzaro: my point is that at any time sony et al could've worked upstream on the existing tool01:08
clarkbthey didn't now we have two things01:08
clarkbthats fine, but we shouldn't be expecte dto replace gerritlib simply because pygerrit exists01:08
*** ybathia has quit IRC01:09
clarkbwhich is why my suggestion is to point out what pygerrit can do, and let tooling naturally transition if/when it needs those features01:09
zaroclarkb: ok.  i think add blurb to README about that then?01:10
*** weshay_xchat has quit IRC01:10
anteayamtreinish: http://lists.openstack.org/pipermail/third-party-announce/2016-February/000282.html01:11
clarkbor post to the mailing list01:11
anteayamtreinish: and thank you01:11
clarkbzaro: I know gertty uses the rest api a bunch but I think it just uses requests01:12
mtreinishanteaya: thanks for raising it in the proper place01:12
anteayaI do try01:12
*** amitgandhinz has joined #openstack-infra01:13
*** EricGonc_ has joined #openstack-infra01:13
*** amitgandhinz has quit IRC01:13
fungithere's really not much you need on top of requests to handle the gerrit rest api anyway. paginating the changes method results is about the only complication i01:13
fungi've run into so far01:13
clarkbzaro: and zuul was supposed to switch to gerritlib (gerritlib actually came out of zuul) but that never happend so there is historical "we failed to do this"01:13
mtreinishanteaya: is that ci different from: https://wiki.openstack.org/wiki/ThirdPartySystems/Intel-Networking-CI01:13
mtreinishit's got intel and networking in the name :)01:14
anteayamtreinish: yeah I think it is, the one that commented has odl in the title, that is a new account for me01:14
anteayaalso I know wznoinsk01:14
anteayaI don't think something like this would get past him01:15
anteayahe has been involved with his ci system for over a year01:15
anteayamy sense is this is a separate account01:15
anteayabut I could be wrong01:15
*** Swami has quit IRC01:16
*** weshay_xchat has joined #openstack-infra01:16
mtreinishok, I wasn't sure01:16
zaroclarkb: hmm, well don't let that happen to python-jenkins :)01:16
anteayamtreinish: no it is a good queston01:17
*** gokrokve has quit IRC01:17
*** EricGonczer_ has quit IRC01:17
*** annegentle_ has quit IRC01:17
anteayaI only know because wznoinsk has shown up to many meetings and has been active in channel01:17
anteayahe actually took out our gerrit about 6 months ago with an ssh connection keep alive script he wrote01:17
anteayaso he has been fairly vigilent ever since01:17
anteayahence my belief he would have spotted this himself if this was his system01:18
anteayahe didn't mean to take out our gerrit, and he helped us debug the issue01:19
anteayaso he was helpful01:19
*** ccrouch has quit IRC01:20
openstackgerritMerged openstack-infra/project-config: Set conditions for gate-{name}-docs on freezer*  https://review.openstack.org/27807001:21
clarkbI don't know that I am core on python-jenkins01:21
zaroclarkb: no, it's a nodepool change: https://review.openstack.org/#/c/259157/01:22
zarofungi: do you think we can get some gerrit fixes in for this friday's maintenance?01:22
zarolike this https://review.openstack.org/#/c/261110/01:23
zaroand this https://review.openstack.org/#/c/262611/01:23
zarojhesketh: ^ answered your question on this one01:24
clarkbzaro: has 259157 been tested?01:25
*** esker has joined #openstack-infra01:26
dougwigAJaeger: is it the inner or outer timeout that's no longer needed now?01:26
clarkbit passes the tests we have but none of them talk to a real jenkins :/01:27
*** dimtruck is now known as zz_dimtruck01:29
*** mtanino has quit IRC01:29
*** kzaitsev_mb has quit IRC01:30
zaroClarkb: you mean by using nodepool?01:31
clarkbya point it at a jenkins01:32
*** thorst has joined #openstack-infra01:33
*** thorst has quit IRC01:33
zaroClarkb: then no I have not. I've only tested from using python Jenkins. I've never used nodepool so I'll have to figure that out first01:34
*** thorst has joined #openstack-infra01:34
jheskethzaro: cool, replied :-)01:36
*** thorst has quit IRC01:39
*** esker has quit IRC01:40
*** esker has joined #openstack-infra01:41
openstackgerritMerged openstack/requirements: Make osprofiler requirements >1.0.0  https://review.openstack.org/27758301:45
*** esker has quit IRC01:45
*** darrenc is now known as darrenc_afk01:47
anteayadougwig: DEVSTACK_GATE_TIMEOUT is removed: http://git.openstack.org/cgit/openstack-infra/project-config/commit/?id=065a80d9c27b30dea253ed3554e09b1c8cb37e1801:49
*** bswartz has quit IRC01:49
anteayadougwig: I consider that the inner timeout01:49
*** tiswanso has joined #openstack-infra01:50
*** tiswanso has quit IRC01:50
*** piet has joined #openstack-infra01:50
*** bswartz has joined #openstack-infra01:51
*** tiswanso has joined #openstack-infra01:51
*** gyee has quit IRC01:53
*** shashank_hegde has quit IRC01:54
*** vilobhmm11 has quit IRC01:56
*** Sukhdev has quit IRC01:56
*** vilobhmm11 has joined #openstack-infra01:56
openstackgerritMerged openstack/requirements: Add neutron-lib to projects.txt  https://review.openstack.org/27391301:57
openstackgerritMerged openstack/requirements: Add pylxd library  https://review.openstack.org/27778901:57
openstackgerritMerged openstack/requirements: Add netmiko to requirements  https://review.openstack.org/27620001:57
openstackgerritMerged openstack/requirements: Add overtest to global-req  https://review.openstack.org/27434801:57
*** weshay_xchat has quit IRC01:58
*** darrenc_afk is now known as darrenc01:59
*** achanda has joined #openstack-infra02:00
*** vilobhmm11 has quit IRC02:00
*** Sukhdev has joined #openstack-infra02:00
*** Sukhdev has quit IRC02:01
*** vilobhmm11 has joined #openstack-infra02:01
*** nelsnels_ has quit IRC02:02
*** rossella_s has quit IRC02:03
*** sridhar_ram1 has quit IRC02:03
*** rossella_s has joined #openstack-infra02:03
*** zz_dimtruck is now known as dimtruck02:04
*** piet has quit IRC02:05
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Remove openstack-neutron-release from acceptable channels list  https://review.openstack.org/27818002:05
*** SumitNaiksatam has joined #openstack-infra02:09
pleia2oh! this might be of interest here, since everyone always asks me if I know about other open source infras, I made a list, which now has a handy URL http://opensourceinfra.org/ :)02:10
pleia2(yes, I understand the irony of the source for the site being hosted on github)02:10
*** bpokorny has quit IRC02:10
dougwiganteaya: as do i.  thank you.02:12
mordredpleia2: nice!02:12
*** yamamoto has joined #openstack-infra02:12
openstackgerritEmilien Macchi proposed openstack-infra/project-config: tempest/experimental: run puppet scenarios on centos7  https://review.openstack.org/27808002:14
openstackgerritMerged openstack-infra/release-tools: rename script for making stable branches  https://review.openstack.org/27749902:17
*** annegentle_ has joined #openstack-infra02:17
*** armax has quit IRC02:18
*** hdd has quit IRC02:19
*** yamahata has quit IRC02:19
*** nelsnelson has joined #openstack-infra02:21
*** vilobhmm11 has quit IRC02:22
*** annegentle_ has quit IRC02:25
*** kzaitsev_mb has joined #openstack-infra02:27
*** alex_xu has quit IRC02:28
*** alex_xu has joined #openstack-infra02:30
*** yamamoto has quit IRC02:31
openstackgerritMerged openstack-dev/cookiecutter: Add gitignore files  https://review.openstack.org/27767902:32
tonybAre theer any guidelines on erpo names?  I'm createing a devstack plugin currently called devstack-plugin-bleeding-edge02:33
tonybWould that be accepted or shoudl I look at renaming it?02:33
ianwtonyb: bleeding-edge of what?02:42
ianwi'm presuming libvirt02:42
tonybianw: Well it only supports libvirt+wemu right now but it can be used for any packaged tool02:42
tonybianw: Also on Ubuntu but once F23 is in the gate I'll use that and add virt-preview02:43
tonybs/wemu/qemu/02:43
ianwtonyb: i dunno, i'd call it something more descriptive; "bleeding-edge" pretty much describes everything to do with openstack ci02:44
ianwmostly the bleeding bit02:44
*** dims_ has quit IRC02:45
tonybianw: Thanks.  I'll try to think of a better name.02:47
*** alex_xu has quit IRC02:49
tonybianw: on an unrelated note the devstack-plugin-cookiecutter repo has somewhat bit rotted02:50
*** alex_xu has joined #openstack-infra02:52
ianwhmm, yeah not sure if anyone keeps on top of that02:53
*** mingyu has quit IRC02:54
*** mingyu has joined #openstack-infra02:54
*** darrenc is now known as darrenc_afk02:58
*** kzaitsev_mb has quit IRC02:58
*** bryan_att has quit IRC03:00
*** links has joined #openstack-infra03:00
openstackgerritIan Wienand proposed openstack/diskimage-builder: Fix startup race with growroot/systemd  https://review.openstack.org/27818703:04
openstackgerritIan Wienand proposed openstack/diskimage-builder: Refactor growroot for debuggabilty  https://review.openstack.org/27818803:04
*** hdd has joined #openstack-infra03:05
ianwgreghaynes / SpamapS : ^ on f23 disk-size issue ... 1st one is the fix i believe03:05
*** EricGonc_ has quit IRC03:07
*** logan-- has joined #openstack-infra03:10
*** darrenc_afk is now known as darrenc03:11
prometheanfireianw: any response to https://review.openstack.org/#/c/276581/ ?03:12
*** vilobhmm11 has joined #openstack-infra03:14
*** logan-- has quit IRC03:14
*** vilobhmm111 has joined #openstack-infra03:17
*** nadya has joined #openstack-infra03:18
*** vilobhmm11 has quit IRC03:18
*** nadya is now known as Guest295903:18
*** ccrouch has joined #openstack-infra03:19
*** Guest2959 has quit IRC03:22
*** logan- has joined #openstack-infra03:23
tonybianw: I'll do a thing once I actually have my plugin accepted.03:23
*** ccrouch1 has joined #openstack-infra03:23
*** ccrouch has quit IRC03:26
*** dims has joined #openstack-infra03:27
*** yamamoto has joined #openstack-infra03:29
*** sc68cal has quit IRC03:30
*** ccrouch1 has quit IRC03:30
*** ccrouch has joined #openstack-infra03:31
*** annegentle_ has joined #openstack-infra03:31
*** woodster_ has joined #openstack-infra03:32
*** tphummel has quit IRC03:32
*** sridhar_ram has joined #openstack-infra03:33
*** sridhar_ram has quit IRC03:34
*** xyang1 has joined #openstack-infra03:34
*** annegentle_ has quit IRC03:36
*** dims has quit IRC03:37
*** gokrokve has joined #openstack-infra03:37
prometheanfireianw: so where would you say I doc it?03:39
*** apoorvad has quit IRC03:40
ianwprometheanfire: package-installs readme probably wouldn't be a bad start03:42
prometheanfireok, I'll update that and move the other postinstall.d to 9503:43
*** gokrokve_ has joined #openstack-infra03:43
*** gokrokve has quit IRC03:45
*** vilobhmm111 has quit IRC03:45
*** rguillebert has quit IRC03:47
*** gokrokve has joined #openstack-infra03:48
*** gokrokve_ has quit IRC03:48
*** edmondsw has quit IRC03:49
*** xyang1 has quit IRC03:50
*** gokrokve has quit IRC03:53
*** gokrokve has joined #openstack-infra03:53
*** kzaitsev_mb has joined #openstack-infra03:55
*** kzaitsev_mb has quit IRC04:00
prometheanfireianw: updated04:01
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Remove eclean-dist as it's not available by default  https://review.openstack.org/27658104:01
*** fawadkhaliq has joined #openstack-infra04:02
*** jogo has quit IRC04:10
*** jogo has joined #openstack-infra04:11
*** jogo has joined #openstack-infra04:11
*** markvoelker has quit IRC04:15
*** markvoelker has joined #openstack-infra04:16
*** vilobhmm11 has joined #openstack-infra04:17
*** amotoki has joined #openstack-infra04:17
*** amotoki has quit IRC04:17
*** Daisy has joined #openstack-infra04:18
*** tiswanso has quit IRC04:20
*** Daisy has quit IRC04:23
*** Daisy has joined #openstack-infra04:23
*** shashank_hegde has joined #openstack-infra04:27
*** dimtruck is now known as zz_dimtruck04:27
*** Daisy has quit IRC04:28
*** nelsnelson has quit IRC04:32
*** dahoo has quit IRC04:33
*** salv-orlando has joined #openstack-infra04:41
*** chaitu has joined #openstack-infra04:41
chaituHi, even after image build is complete dib-image-list says that image is in building state,can someone please help me out with it.04:43
*** salv-orl_ has quit IRC04:43
openstackgerritgreghaynes proposed openstack/diskimage-builder: Install docker for tests  https://review.openstack.org/27802104:45
*** shashank_hegde has quit IRC04:47
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests  https://review.openstack.org/17700204:47
*** maishsk has quit IRC04:49
*** Thelo has quit IRC04:55
*** kzaitsev_mb has joined #openstack-infra04:57
*** Thelo has joined #openstack-infra04:58
*** moravec has quit IRC05:01
*** kzaitsev_mb has quit IRC05:02
*** gokrokve_ has joined #openstack-infra05:05
*** gokrokve has quit IRC05:06
*** rlandy has quit IRC05:07
*** piet has joined #openstack-infra05:13
*** maishsk has joined #openstack-infra05:16
*** maishsk has quit IRC05:23
prometheanfireianw: you really like slowing me down :(05:26
*** fawadkhaliq has quit IRC05:27
*** vilobhmm11 has quit IRC05:30
*** armax has joined #openstack-infra05:31
openstackgerritSachi King proposed openstack-dev/pbr: Don't attempt to test with 0.6c11 with Py3  https://review.openstack.org/27335805:33
openstackgerritSachi King proposed openstack-dev/pbr: Ensure we succeed at env_markers or bail gracefully  https://review.openstack.org/27821005:33
*** woodster_ has quit IRC05:36
*** shashank_hegde has joined #openstack-infra05:37
*** sflanigan has quit IRC05:40
chaituHi, even after image build is complete dib-image-list says that image is in building state,can someone please help me out with it. After starting nodepool service image got deleted05:41
*** gokrokve_ has quit IRC05:42
*** mingyu has quit IRC05:42
*** mingyu has joined #openstack-infra05:43
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Reorder the package-uninstall action  https://review.openstack.org/27821105:43
clarkbchaitu: did the dib image build fail?05:43
clarkbthere have been several bugs in error handling that were recently fixed that could result in out of sync state between nodepool amd its image builder05:44
chaituno it didnt fail05:44
openstackgerritMatthew Thode proposed openstack/diskimage-builder: Remove eclean-dist as it's not available by default  https://review.openstack.org/27658105:44
prometheanfireianw: ok, separated it out, either can merge first, ordering doesn't matter05:45
chaituclarkb: It was in building state05:45
*** shashank_hegde has quit IRC05:45
clarkbchaitu: yes but did the actual dib process fail? you can check the logs05:45
*** gokrokve has joined #openstack-infra05:45
*** sam_wan has joined #openstack-infra05:45
chaituclarkb: i dont see any error in image.log or nodepool-builder.log05:46
clarkbchaitu: and you do see the build completed according to the log?05:48
*** gokrokve has quit IRC05:48
*** gokrokve_ has joined #openstack-infra05:48
clarkbif that is the case it is possibly a gearman client disconnect (which has also been patched in a couple ways)05:48
chaituyes, http://paste.openstack.org/show/486510/05:49
chaituplease look into builder-log05:49
zxiiroI'm having some issues with nodepool failing with NoneType on private ip. My Rackspace network doesn't have a private IP as far as I can tell, does it really require one to work? http://pastebin.com/PFsGW4Ms05:49
*** sam_wan has quit IRC05:49
clarkbchaitu: can you check ps and see if that process is still running?05:50
clarkbzxiiro: it is not required and at least one of our clouds dossnt have private IPs05:51
*** sam_wan has joined #openstack-infra05:51
clarkbzxiiro: in that case it should treat the public as privatr05:51
clarkbbut IP stuff is the most complicated unstandard impossible to infer thing about virtual machines right now05:51
chaituclarkb: Now it is building an new image.http://paste.openstack.org/show/486511/05:52
zxiiroclarkb: any ideas  why it would blow up with the trace from my pastebin then?  I'm trying the latest nodepool from pypi and in the paste I had to add this workaround for our network. https://github.com/zxiiro/nodepool/commit/7bc6b47df5464cf7b97e4b75a8eb6591ced71ce405:52
clarkbzxiiro: it should log what it thinks the IPs are05:52
clarkboh from pypi05:52
clarkbyou might try newer (becausr again networking hard)05:53
zxiirook let me try ....05:53
*** nadya has joined #openstack-infra05:53
*** Sukhdev has joined #openstack-infra05:54
*** nadya is now known as Guest9112105:54
clarkbchaitu: image 5 is the one in progress according to both logs05:54
*** piet has quit IRC05:55
clarkbchaitu: something explicitly deleted image 405:55
ianwpromethanfire: did you read what i wrote about the documentation i'm looking for?  it's not to explain the ordering, which we can take as understood.  it's to explain why we have made the choice to have it at *95* and not 96, or 86, or 9905:56
openstackgerritOmer Anson proposed openstack/requirements: Add scapy and python-pytun  https://review.openstack.org/27789305:57
clarkbzxiiro: the underlying problem is there is no way for openstack to signal to the user which IP address shpuld be routable and whoch IP addresses are tenant private05:57
chaituclarkb: How could i cross check thae status of gearman plugin now???05:57
clarkbzxiiro: anf there is also no indicatiom of when a floating IP is needed. so nodepool tries its best05:57
clarkbchaitu: ps says the image build is runnig05:58
*** daemontool_ has joined #openstack-infra05:58
*** kzaitsev_mb has joined #openstack-infra05:58
clarkbyou can tail your image logs, you can check that process, you can also connect to the gearman server via telnet and run the status command against it05:58
*** nelsnelson has joined #openstack-infra05:59
chaituclarkb: Yeah but after build completes the image get deleted.05:59
clarkbchaitu: many hours later according to the log05:59
*** daemontool has quit IRC06:02
*** kzaitsev_mb has quit IRC06:03
*** rossella_s has quit IRC06:03
chaituyeah, This is fresh installation i didnt start my nodepool service for the first build and waited many hours to completed, After a while i started my nodepool service and the image got deleted.06:03
*** rossella_s has joined #openstack-infra06:03
*** fawadkhaliq has joined #openstack-infra06:04
chaituclarkb: Now it again started to build new image06:04
*** gokrokve_ has quit IRC06:06
clarkbchaitu anything in the nodepool debug log?06:06
clarkbit shpuld tell you ehy it is deleting the image06:06
*** esker has joined #openstack-infra06:08
zxiiroclarkb: just tried with the latest code from master, still same failure: http://pastebin.com/BBwRNgpS06:13
chaituclarkb: it deleted in the process of periodic cleanup http://paste.openstack.org/show/486512/ please check the log06:15
*** gildub has quit IRC06:16
zxiirothe code's expecting a string to be returned but it's returning None because we don't have an IP address i guess06:17
clarkbzxiiro: yes, do the logs indicate any IP is detected?06:17
clarkbchaitu: that is normal if you have a newer image06:17
clarkbit should keep the last 2 images06:18
*** hamzy has quit IRC06:18
zxiiroI think so because just before that log it successfully ssh's into the machine06:19
zxiiroand runs scripts06:19
zxiiroRESP BODY: {"servers": [{"status": "ACTIVE", "updated": "2016-02-10T06:08:02Z", "hostId": "", "addresses": {"opendaylight": [{"version": 4, "addr": "10.30.32.56"}]},06:19
zxiirothat's the json request i see just before that contains an ip too06:19
clarkbthats what nova says but then nodepool has to figure out if that address is public or private06:19
clarkbit should log explicitly the mapping it decides on iirc06:20
zxiiro2016-02-10 06:12:31,694 DEBUG nodepool.NodeLauncher: Node id: 14 is running, ipv4: 10.30.32.242, ipv6: None06:20
zxiiro2016-02-10 06:12:31,694 DEBUG nodepool.NodeLauncher: Node id: 14 testing ssh at ip: 10.30.32.24206:20
zxiirohmm i don't see a mapping in the logs06:20
zxiiroyeah that's the only log i see that has ips in it other than the flood of ssh debug logs that appear06:21
*** esker has quit IRC06:21
clarkbhttps://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n6806:22
clarkbdo I guess we must rely on that fixed spec on ovh06:23
*** sam_wan has quit IRC06:24
zxiirowhat should it do if we don't have a private ip? just reuse the public ip?06:25
clarkbI think if no private ip exists then we should either explicitly treat thr public as private or not try to use private at all06:25
zxiirowe have to change our get_public_ip to use server.addresses.get('opendaylight', []) because we have a custom network name06:26
zxiirothat change worked for us on older nodepool version06:26
clarkbif your addresses had https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n78 it would work06:26
clarkbwhich appears to be how it works for us today06:26
zxiiroi guess something must have changed related to how nodepool handles missing private ip06:26
clarkbyou can specify the name in config now06:27
clarkbno need to patch the service06:27
zxiirooh? how do i do that?06:27
zxiiroi'll give that a try just in case06:27
clarkbhttps://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/provider_manager.py#n61 id the code, only affects publoc, not private06:27
clarkbhttp://docs.openstack.org/infra/nodepool/configuration.html#provider has docs on that06:28
*** annegentle_ has joined #openstack-infra06:29
* clarkb really wishes that neutron would be explocit and consistent about this info06:29
zxiiroi'm guessing it's that networks: field.06:29
*** Guest91121 has quit IRC06:29
* zxiiro goes to give it a try06:29
clarkbdenote if IP is routable outside of the cloud or not06:30
*** ccrouch has quit IRC06:30
zxiiroclarkb: we're using the rackspace public cloud though, i'm worried that line that says provider.use_neutron means we need access to neutron which we don't have in the public cloud i don't think...06:31
* zxiiro we really need to move into the private cloud more quickly....06:31
*** hamzy has joined #openstack-infra06:31
clarkbwhat you describe isnt rackspace public cloud that I know06:31
clarkbwe use thus just fien with rax and there is no opendaylight and I want to say the if name == private is for rax06:32
*** esker has joined #openstack-infra06:32
*** annegentle_ has quit IRC06:34
*** ashleighfarnham has joined #openstack-infra06:34
clarkbbut yes if we cant determine a private IP we should either A) ignore that properly or B) just use public06:35
zxiirook when i add the networks setting i get NeutronClientException: 404 Not Found06:36
*** abregman has joined #openstack-infra06:36
zxiirobut i pip installed rackspace-neutronclient06:36
zxiiroand just running "neutron" in the terminal works...06:36
clarkbwe use python-neutronclient06:37
clarkbis rackspace-neutronclient really a thing?06:38
clarkb:/06:38
zxiiroapparently... i assumed that was the one i wanted maybe not06:38
* zxiiro tries the other one06:38
zxiironope that didn't make a difference....06:40
clarkbI am not sure then, the setup you describe is very odd especialpy for what I expect from rackspace06:41
zxiirohttp://pastebin.com/Vuyqk1m306:41
zxiirothat's the traceback06:41
zxiiroi'm guessing i have the wrong "name" for my network06:41
zxiiroi tried both the "id" as well as the "name" column that appears in rackspace, neither seem to work06:42
clarkbwell the 404 is on the list networks call06:42
clarkbso it isnt able to list networks at all06:42
zxiirohmm06:43
zxiirooh well it's late06:43
zxiiroi'm gonna go sleep06:43
zxiiroclarkb: thanks for the help06:43
*** yumapath has joined #openstack-infra06:44
yumapathhi folks06:44
yumapatham facing issues connecting to gerrit event stream through zuul06:45
yumapath2016-02-10 12:12:47,410 ERROR gerrit.GerritWatcher: Exception on ssh event stream: Traceback (most recent call last):   File "/usr/local/lib/python2.7/dist-packages/zuul/connection/gerrit.py", line 173, in _run     key_filename=self.keyfile)   File "/usr/local/lib/python2.7/dist-packages/paramiko/client.py", line 292, in connect     retry_on_signal(lambda: sock.connect(addr))   File "/usr/local/lib/python2.7/dist-packages/06:45
yumapathcan anyone please help me with this06:45
clarkbyumapath: can you usr a paste service and paste the entire traceback?06:46
yumapaththis command works though when run manually06:46
yumapathssh -vv -p 29418 yumapath@review.openstack.org06:46
yumapathas zuul user06:46
yumapathclarkb: am new to openstack , can you please tell me what is a paste service06:47
clarkbit id a web service that you paste data into which then returns a url for that paste06:48
*** armax has quit IRC06:48
yumapathok06:48
clarkbthid way you dont have to do it line by line on irc06:48
yumapathok06:48
yumapathlet me just try something online06:48
yumapathone sec06:48
clarkbhttp://paste.openstack.org is the one we host but there are many options06:48
yumapathok06:48
yumapaththanks06:48
yumapathhttp://paste.openstack.org/show/486514/06:49
yumapathPlease try this06:49
clarkbnetwork is unreachable06:50
*** gildub has joined #openstack-infra06:50
clarkbpossibly a firewall probl06:50
clarkb*problem06:50
yumapathi tried this command06:50
yumapathssh -vv -p 29418 yumapath@review.openstack.org06:50
yumapathmanually with my gerrit username06:51
yumapathit seems to work fine06:51
yumapathas a zuul user06:51
clarkbon the same machine running zuul?06:51
yumapathyes06:51
yumapathi have that allinone installation06:51
yumapathusing puppet modules06:51
yumapathmy server is behind a proxy06:51
yumapaththat is true06:51
yumapathbut since this command ssh -vv -p 29418 yumapath@review.openstack.org works06:51
yumapatham lost as to what could be the issue06:52
clarkbI would double check your zuul config then06:52
clarkbit could be trying to connect yo the wrong location06:52
yumapathoh i see06:52
yumapathi have not changed anything in the zuul file06:52
yumapatham just trying to check the noop connection06:52
yumapathtest06:52
yumapathlet me paste the contents06:52
clarkbwell check that it looks correct...06:52
clarkbthere should be a gerrit section with connection details I think06:53
yumapathhttp://paste.openstack.org/show/486515/06:54
clarkbdoes telnet review.openstack.org 29418 establish a tcp connection?06:56
clarkbI wonder if ssh is configured to proxy06:56
clarkband since zuul uses paramiko that wont just work06:56
yumapathssh is working06:56
yumapaththrough proxy06:56
yumapathssh -vv -p 29418 yumapath@review.openstack.org06:56
yumapaththis command works06:57
clarkbyes I know06:57
clarkbbut zuul does not use the ssh command, it uses the paramiko library06:57
clarkbdoes a "raw" tcp connection work?06:57
clarkbusing nc or telnet?06:57
yumapathi have not checked06:57
yumapathone sec06:57
clarkbif not then likely paramiko doesnt have the necessary proxy bits06:57
yumapathok06:57
*** ashleighfarnham has quit IRC06:59
yumapathzuul@cinder-jenkins:/etc/zuul$ telnet review.openstack.org Trying 104.130.159.134... Trying 2001:4800:7818:102:be76:4eff:fe05:9b12... telnet: Unable to connect to remote host: Network is unreachable zuul@cinder-jenkins:/etc/zuul$06:59
*** kzaitsev_mb has joined #openstack-infra06:59
yumapath<clarkb>: raw telnet connection seems to fail06:59
clarkbthat us probably the issue then07:00
yumapaththen basically i should make telnet work behind a proxy07:00
yumapathlike i made ssh work behind a proxy07:00
clarkbwell you need paramiko to work yes07:01
yumapathok07:01
yumapathlet me try that out07:01
yumapaththanks for your help07:01
yumapathi was all along thinking it was using ssh for connecting07:01
yumapathi was not aware that it was using telnet07:01
clarkbit isnt using telnet07:01
nibalizerno its using ssh07:01
clarkbit uses paramiko07:01
nibalizertelnet is just a basic tester for network connectivity07:02
nibalizerparamiko is an ssh library for python07:02
yumapathok07:02
clarkbbut ssh is botha protocol and a command. in this case paramiko implemts the protocol but is separate from the command07:02
yumapathok07:02
nibalizeryumapath: what is in your .ssh/config ?07:02
nibalizerit looks like paramiko has proxycommand support http://docs.paramiko.org/en/1.16/api/proxy.html07:03
nibalizerI doubt that is piped through to zuul though07:03
yumapathok07:03
ianwhttp://nodepool.openstack.org/ <- so few images!07:03
*** kzaitsev_mb has quit IRC07:04
yumapath<nibalizer> & <clarkb>07:04
yumapathi have the following in ssh config07:04
yumapathhttp://paste.openstack.org/show/486516/07:05
*** gokrokve has joined #openstack-infra07:06
yumapath<nibalizer> <clarkb> can you please check to see if the config for proxy07:06
yumapathis enough07:06
yumapathas you say am able to do ssh to review.openstack.org07:07
yumapathso you mean to say that is not enough07:07
yumapatha raw tcp connection should go through07:07
*** hdd has quit IRC07:08
yumapathmy understand is, pramiko has its own implementation of the ssh protocol07:08
yumapathand the proxy information which i have given is for the ssh command07:08
yumapathand not for the protocol itself07:08
yumapatham i right07:08
yumapath?07:08
clarkbyes07:09
yumapathok got it07:09
yumapathnow i will have to figure out how to make tcp work behind a proxy07:09
yumapaththanks so much clarkb and nibalizer07:09
yumapathfor pointing it out07:09
yumapathlet me try to fig out07:09
*** shashank_hegde has joined #openstack-infra07:10
*** gokrokve has quit IRC07:14
*** cgross- has joined #openstack-infra07:14
*** rcernin has joined #openstack-infra07:14
*** infra-red has joined #openstack-infra07:15
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/27770207:15
*** infra-re_ has joined #openstack-infra07:16
*** infra-red has quit IRC07:19
*** cgross- is now known as lmiccini07:20
yolandamorning07:29
nibalizergood morning07:29
*** ianw has quit IRC07:30
*** ianw has joined #openstack-infra07:30
*** Sukhdev has quit IRC07:31
*** otherwiseguy has quit IRC07:34
openstackgerritMerged openstack-infra/project-config: Notify #openstack-dev of governance changes  https://review.openstack.org/27794307:35
*** nmagnezi has joined #openstack-infra07:36
openstackgerritMerged openstack-infra/project-config: Add python3-job and check-requirements for networking-fujitsu  https://review.openstack.org/27546207:37
openstackgerritMerged openstack-infra/project-config: Rename periodic networking jobs  https://review.openstack.org/27636707:37
openstackgerritMerged openstack-infra/project-config: gate-networking-midonet-v2-dsvm-rally-nv: Don't forget to enable rally  https://review.openstack.org/27655007:39
openstackgerritMerged openstack-infra/project-config: networking-nec: Enable python3 and check-requirement jobs  https://review.openstack.org/27661307:43
*** openstackgerrit has quit IRC07:47
*** openstackgerrit has joined #openstack-infra07:47
*** scheuran has joined #openstack-infra07:47
openstackgerritMerged openstack-infra/project-config: puppet/integ/multinode: copy logs for localhost machine  https://review.openstack.org/27800807:48
openstackgerritMerged openstack-infra/project-config: Move bindep fallback job-template to infra file  https://review.openstack.org/27798007:50
*** jtomasek_ has joined #openstack-infra07:51
openstackgerritMerged openstack-infra/glean: Stop confusing vim's tiny brain  https://review.openstack.org/27598407:51
*** rcernin has quit IRC07:52
*** isaacb has joined #openstack-infra07:55
*** andymaier has joined #openstack-infra07:55
*** esker has quit IRC07:56
*** e0ne has joined #openstack-infra07:58
*** AJaeger has quit IRC07:59
*** esker has joined #openstack-infra07:59
openstackgerritMerged openstack-infra/project-config: Enables Congress to launch with dist_arch flag as True  https://review.openstack.org/27778707:59
*** tzn has joined #openstack-infra08:00
*** kzaitsev_mb has joined #openstack-infra08:00
openstackgerritMerged openstack-infra/project-config: Make TripleO puppet check jobs voting  https://review.openstack.org/27016508:00
*** abregman has quit IRC08:01
*** kzaitsev_mb has quit IRC08:04
*** abregman has joined #openstack-infra08:05
*** sam_wan has joined #openstack-infra08:11
*** achanda has quit IRC08:13
*** rcernin has joined #openstack-infra08:15
*** d0ugal has joined #openstack-infra08:17
*** SumitNaiksatam has quit IRC08:19
*** jistr|doc has joined #openstack-infra08:22
*** vincentfrancoise has joined #openstack-infra08:23
openstackgerritAlexander Charykov proposed openstack-infra/gerritlib: Add limit for bulk_query request  https://review.openstack.org/27777308:23
*** samuelBartel has joined #openstack-infra08:24
*** nt has quit IRC08:28
*** tzn has quit IRC08:29
*** flepied has quit IRC08:30
openstackgerritMerged openstack/diskimage-builder: Only match #!/bin/bash in scripts  https://review.openstack.org/27387908:35
*** matrohon has joined #openstack-infra08:35
*** nadya has joined #openstack-infra08:35
*** nadya is now known as Guest1589008:36
*** yaume has joined #openstack-infra08:37
*** achanda has joined #openstack-infra08:37
*** jlanoux has joined #openstack-infra08:38
*** mikelk has joined #openstack-infra08:39
*** e0ne has quit IRC08:39
*** dingyichen has quit IRC08:40
*** gokrokve has joined #openstack-infra08:40
*** abregman has quit IRC08:40
*** abregman has joined #openstack-infra08:41
*** maishsk has joined #openstack-infra08:41
*** ihrachys has joined #openstack-infra08:42
*** abregman has quit IRC08:42
*** abregman has joined #openstack-infra08:43
*** salv-orlando has quit IRC08:44
*** gokrokve has quit IRC08:44
*** shashank_hegde has quit IRC08:46
*** jaosorior has joined #openstack-infra08:48
*** Hal has joined #openstack-infra08:51
*** Hal is now known as Guest6822008:52
openstackgerritMoshe Levi proposed openstack/diskimage-builder: Adding InfiniBand Support  https://review.openstack.org/27478108:54
*** jlanoux has quit IRC08:54
*** jlanoux has joined #openstack-infra08:55
*** jpr has joined #openstack-infra08:57
*** kzaitsev_mb has joined #openstack-infra09:01
*** abregman has quit IRC09:01
*** abregman has joined #openstack-infra09:02
*** ifarkas has joined #openstack-infra09:02
*** jcoufal has joined #openstack-infra09:03
*** dtardivel has joined #openstack-infra09:04
*** kzaitsev_mb has quit IRC09:05
*** zeih_ has joined #openstack-infra09:09
*** flepied has joined #openstack-infra09:10
*** shardy has joined #openstack-infra09:11
*** BobBall_AWOL has quit IRC09:18
*** BobBall_AWOL has joined #openstack-infra09:18
*** fawadkhaliq has quit IRC09:19
*** lucas-dinner is now known as lucasagomes09:19
*** fawadkhaliq has joined #openstack-infra09:19
*** kzaitsev_mb has joined #openstack-infra09:20
*** isaacb has quit IRC09:23
*** dtantsur|afk is now known as dtantsur09:28
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Remove magnum bandit gate  https://review.openstack.org/27827109:34
openstackgerritDmitry Tantsur proposed openstack/requirements: Bump futurist to 0.11.0  https://review.openstack.org/27827209:34
*** flepied1 has joined #openstack-infra09:37
*** yumapath has quit IRC09:40
*** BobBall_AWOL is now known as BobBall09:40
*** flepied has quit IRC09:40
*** BobBall is now known as Guest883509:41
*** gokrokve has joined #openstack-infra09:41
*** Guest8835 is now known as Bobba09:41
*** Bobba is now known as BobBall109:42
*** electrofelix has joined #openstack-infra09:42
*** annegentle_ has joined #openstack-infra09:45
*** tzn has joined #openstack-infra09:45
*** kzaitsev_mb has quit IRC09:46
*** jistr|doc has quit IRC09:46
*** ihrachys has quit IRC09:47
*** zz_dimtruck is now known as dimtruck09:47
*** gokrokve has quit IRC09:48
*** [HeOS] is now known as HeOS09:48
*** derekh has joined #openstack-infra09:50
*** placko_ has joined #openstack-infra09:50
*** annegentle_ has quit IRC09:50
*** dtantsur is now known as dtantsur|brb09:51
*** wznoinsk has quit IRC09:54
*** mrmartin has joined #openstack-infra10:00
*** achanda has quit IRC10:06
*** maishsk has quit IRC10:07
*** e0ne has joined #openstack-infra10:07
*** maishsk has joined #openstack-infra10:07
*** achanda has joined #openstack-infra10:08
*** sam_wan has quit IRC10:10
*** jaosorior has quit IRC10:21
maishskGood afternoon all10:21
maishskHow do I rebase a change?10:22
*** shardy has quit IRC10:25
*** shardy has joined #openstack-infra10:25
*** ihrachys has joined #openstack-infra10:29
*** fawadkhaliq has quit IRC10:32
*** fhubik has joined #openstack-infra10:35
*** rguillebert has joined #openstack-infra10:37
*** ihrachys has quit IRC10:41
*** salv-orlando has joined #openstack-infra10:41
*** dtantsur|brb is now known as dtantsur10:42
nibalizermaishsk: in many cases you can press the 'rebase change' button10:42
openstackgerritMerged openstack-infra/tripleo-ci: Add support for periodic jobs  https://review.openstack.org/27137010:42
maishsknibalizer: I have tried that - but I am getting an error10:42
openstackgerritMerged openstack-infra/tripleo-ci: Add support for command line job names  https://review.openstack.org/23542110:42
maishskDo I need to change parent revision? or fill in anything else?10:43
*** achanda has quit IRC10:45
*** ldnunes has joined #openstack-infra10:46
*** dims has joined #openstack-infra10:48
nibalizeryou may need to use the command line10:48
nibalizerhttps://help.github.com/articles/about-git-rebase/10:48
openstackgerritAdelina Tuvenie proposed openstack/requirements: Change global requirements forcing cliff!=1.16.0  https://review.openstack.org/27829910:48
nibalizerthat is github docs but mauch of it applies10:48
*** kzaitsev_mb has joined #openstack-infra10:49
*** fawadkhaliq has joined #openstack-infra10:51
*** aysyd has joined #openstack-infra10:52
*** tpsilva has joined #openstack-infra10:53
*** fawadkhaliq has quit IRC10:54
*** fawadkhaliq has joined #openstack-infra10:55
maishsknibalizer: thanks - but I still dont know how to rebase a specific change10:56
*** aysyd has quit IRC10:58
*** aysyd has joined #openstack-infra10:59
vincentfrancoiseHi everyone. In https://review.openstack.org/#/c/275167/, I created a new "watcher-dashboard" project along with its "watcher-dashboard-core" group. The thing is that no one is currently in, so could a Gerrit admin to put me in?11:00
yolandahi vincentfrancoise, sure11:02
vincentfrancoiseyolanda: thanks a lot11:02
yolandadone11:03
vincentfrancoisethank you11:04
*** rfolco has joined #openstack-infra11:09
*** samuelBartel has quit IRC11:15
openstackgerritSean Dague proposed openstack-infra/project-config: Revert "Set gate-grenade-dsvm-multinode to non-voting"  https://review.openstack.org/27783311:16
*** mrmartin has quit IRC11:20
*** fawadkhaliq has quit IRC11:22
*** fawadkhaliq has joined #openstack-infra11:23
*** akscram has quit IRC11:25
*** changbl has quit IRC11:25
*** akscram has joined #openstack-infra11:25
*** jaypipes has joined #openstack-infra11:27
*** fhubik is now known as fhubik_brb11:34
*** |-paul-| has joined #openstack-infra11:35
*** ociuhandu has quit IRC11:35
*** Daisy has joined #openstack-infra11:36
*** sfinucan has joined #openstack-infra11:37
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added *-npm-publish-draft job  https://review.openstack.org/27799611:37
*** ildikov has quit IRC11:38
*** sam_wan has joined #openstack-infra11:39
*** AJaeger has joined #openstack-infra11:42
openstackgerritDavid TARDIVEL proposed openstack/requirements: Add watcher and python-watcherclient to projects.txt  https://review.openstack.org/27832111:43
*** ihrachys has joined #openstack-infra11:43
*** erlon has joined #openstack-infra11:43
AJaegerinfra-root, the pip installation on the proposal slaves is broken. We get: "Download error on http://pypi.dfw.openstack.org/simple/pbr/: [Errno 113] No route to host -- Some packages may not be found!"11:43
AJaegerexamples: https://jenkins.openstack.org/job/propose-requirements-constraints-master/227/console and https://jenkins.openstack.org/job/designate-dashboard-propose-translation-update/142/console11:44
yolandahi AJaeger11:44
yolandai haven't been involved on that but i can try debug11:44
AJaegerThis worked a few days ago, failed already yesterday11:44
AJaegeryolanda: IMHO not time critical but should be done today11:44
yolandagoing to check the server for obvious errors11:45
AJaegermight be some side effect of mirror setup, mordred mentioned yesterday that the mirror looks like an old mirror.11:45
AJaegerthanks, yolanda !11:45
*** achanda has joined #openstack-infra11:45
*** kzaitsev_mb has quit IRC11:47
yolandaweird, i cannot contact that externally from a browser, but responds to ping, ip resolves11:47
*** esikachev has joined #openstack-infra11:47
yolandaand wget internal from that machine works11:47
yolandadoh, ipv6 problems again11:48
*** kmartin__ has quit IRC11:48
AJaegerargh ;(11:48
yolandaResolviendo pypi.dfw.openstack.org (pypi.dfw.openstack.org)... 23.253.237.8, 2001:4800:7817:104:d256:7a33:5187:7e1b11:48
yolandaConectando con pypi.dfw.openstack.org (pypi.dfw.openstack.org)[23.253.237.8]:80... falló: No existe ninguna ruta hasta el «host».11:48
yolandaConectando con pypi.dfw.openstack.org (pypi.dfw.openstack.org)[2001:4800:7817:104:d256:7a33:5187:7e1b]:80... falló: La red es inaccesible.11:48
yolandasorry for the spanish11:49
yolandaso for ipv4, no route to host, for ipv6, not reachable network11:49
yolandagoing to check dns entries11:49
*** arthus has joined #openstack-infra11:50
openstackgerritFausto Marzi proposed openstack-infra/project-config: Set conditions for gate-freezer-devstack-dsvm on freezer  https://review.openstack.org/27832311:50
AJaegerdid we decommission that host as part of the new mirror setup?11:50
*** achanda has quit IRC11:50
AJaegeryolanda: https://review.openstack.org/#/c/273518/11:51
AJaegercould it be that we did not update the pip mirror configuration for the proposal slave?11:52
yolandaah didn't know that it landed yet11:52
yolandaserver is still up11:52
yolandaso yes, jobs will need to use new slaves then. But it was dropped without the update of the jobs using that?11:53
*** xek has quit IRC11:53
yolandaAJaeger, i see iptables closed11:53
yolandaso can you check if there are jobs still pending to update? if that's the case they need to be updated, or this change has to be reverted11:54
AJaegerMight be something for mordred, jeblair, krotscheck_dcm, and fungi to look at later.11:55
AJaegerI don't see an open review but might have missed something...11:56
*** links has quit IRC11:56
yolandaAJaeger, looking at project-config, i cannot find anything pointing to pypi.dfw11:56
yolandamm, in system-config, there is pydistutils configured to point to that!11:57
yolanda[easy_install]11:57
yolandaindex_url = http://pypi.dfw.openstack.org/simple11:57
yolandaallow_hosts = *.openstack.org11:57
yolandathat looks as guilty!11:57
yolandaAJaeger, what is the equivalent url now? you know?11:58
*** Daisy has quit IRC11:58
*** claudiub has joined #openstack-infra11:58
*** fhubik_brb is now known as fhubik11:58
* AJaeger checks...11:58
*** notnownikki has quit IRC11:59
Zarajeblair: btw, how are things going with https://review.openstack.org/#/c/270331/ ?11:59
*** fawadkhaliq has quit IRC11:59
AJaegeryolanda: http://mirror.dfw.rax.openstack.org/11:59
yolandaok let's change it11:59
AJaegerI think http://mirror.dfw.rax.openstack.org/pypi/11:59
yolandaok that one works12:00
AJaegerBetter http://mirror.dfw.rax.openstack.org/pypi/simple/12:00
*** daemontool_ has quit IRC12:00
yolandawell yes, that one12:01
AJaegernote that file modules/openstack_project/templates/wheel_mirror/known_hosts.erb needs probably updating as well - it has all the old mirrors in it...12:01
openstackgerritSean Dague proposed openstack-infra/project-config: move our API 2.0 compat jobs to experimental  https://review.openstack.org/27832512:01
yolandai'll double check it12:01
AJaegerthanks, yolanda12:02
yolandathat's already included in trusted hsots12:02
yolandahosts12:02
openstackgerritDavid TARDIVEL proposed openstack-infra/project-config: Add requirements check for watcher  https://review.openstack.org/27832612:02
AJaegerOr we should remove the file completely?12:03
* AJaeger knows too little about the puppet setup, just knows the content is wrong...12:03
yolandano, we better point that to a valid mirror12:04
sdagueAJaeger / yolanda  https://review.openstack.org/27832512:04
*** arxcruz has quit IRC12:04
*** tzn has quit IRC12:04
yolandaAJaeger, sorry, a bit slow because i'm having rebase problems, i had some cruft in that repo12:04
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566812:04
*** |-paul-| has quit IRC12:04
AJaegersdague: I trade you a trivial review in exchange: https://review.openstack.org/278094 ;)12:05
*** ociuhandu has joined #openstack-infra12:05
*** tzn has joined #openstack-infra12:05
AJaegeryolanda: no worries - I'm suggesting to let that change be properly reviewed and not ninja-approve it.12:06
*** olaph has joined #openstack-infra12:06
*** annegentle_ has joined #openstack-infra12:06
AJaegersdague: but this one is one I really would love some feedback on from you when you have time, please: https://review.openstack.org/#/c/278034/12:07
sdagueAJaeger: that I need more brainpower for12:07
openstackgerrityolanda.robla proposed openstack-infra/system-config: Update mirror to use in easy_install  https://review.openstack.org/27832812:08
yolandaok sent12:08
sdagueAJaeger: https://review.openstack.org/#/c/277833/ is rebased so zuul will vote on it12:08
sdagueif you could kick that in12:08
yolandasdague, approved12:08
AJaegersdague: done12:08
AJaegersdague: sure, take your time...12:09
yolandainfra-root, can you review https://review.openstack.org/278328 ? we need to fix that, to point to valid mirrors, causing tests to fail12:09
AJaegerthanks, yolanda12:09
yolandaAJaeger, i remember having similar issues downstrema with that12:09
AJaegersdague: do you plan to continue with the constraints? AFAIR your latest change for project-config was reverted but I think that patch for just the gates - not the post - should be fine and move us forward.12:10
*** annegentle_ has quit IRC12:11
*** notnownikki has joined #openstack-infra12:12
*** kzaitsev_mb has joined #openstack-infra12:12
AJaegersdague: btw. I did some more housekeeping of devstack-jobs, see https://review.openstack.org/#/q/status:open+topic:cleanup-devstack12:12
*** daemontool_ has joined #openstack-infra12:16
openstackgerritMerged openstack-infra/project-config: Revert "Set gate-grenade-dsvm-multinode to non-voting"  https://review.openstack.org/27783312:16
*** ildikov has joined #openstack-infra12:16
*** tzn has quit IRC12:18
AJaegermordred, jeblair could you review system-config file ./modules/openstack_project/templates/wheel_mirror/known_hosts.erb, please? That looks very outdated12:19
*** yamamoto has quit IRC12:20
openstackgerritMerged openstack-infra/project-config: move our API 2.0 compat jobs to experimental  https://review.openstack.org/27832512:20
*** gildub has quit IRC12:23
*** arxcruz has joined #openstack-infra12:27
sdagueAJaeger: I can respin that, it was my original patch, but I got -1ed for it12:27
openstackgerritMerged openstack/requirements: Remove version exclusions for selenium  https://review.openstack.org/27628812:28
*** edmondsw has joined #openstack-infra12:29
AJaegersdague: my understanding of the -1 was that this was fixed with the PTI update. Best to talk with jeblair and others.12:30
* AJaeger likes to see a way forward with constraint testing, it's stale right now...12:30
*** EricGonczer_ has joined #openstack-infra12:31
yolandagoing to have lunch12:32
*** tzn has joined #openstack-infra12:32
AJaegerenjoy, yolanda !12:32
yolandaAJaeger, i'll need to step out in the afternoon. Can you ping some infra-root to review that change?12:33
sdagueAJaeger: no, https://review.openstack.org/#/c/267133/12:34
sdaguebut I can redo it as ps112:34
*** mingyu has quit IRC12:35
*** EricGonczer_ has quit IRC12:36
*** links has joined #openstack-infra12:36
*** tzn has quit IRC12:36
*** tzn has joined #openstack-infra12:36
*** mingyu has joined #openstack-infra12:36
openstackgerritSean Dague proposed openstack-infra/project-config: always make upper-constraints available to python jobs  https://review.openstack.org/27833512:36
sdagueAJaeger: re proposed12:37
*** sam_wan has quit IRC12:37
*** sam_wan has joined #openstack-infra12:37
*** ildikov has quit IRC12:38
openstackgerritFausto Marzi proposed openstack-infra/project-config: Set conditions for gate-freezer-devstack-dsvm on freezer  https://review.openstack.org/27832312:38
AJaegeryolanda: I'll try...12:38
*** krotscheck_dcm is now known as krotscheck12:38
*** sam_wan has quit IRC12:38
AJaegersdague: you cannot use zuul-cloner currenlty in the post pipeline - the coverage jobs runs in post, doesn't it?12:39
openstackgerritSean Dague proposed openstack-infra/project-config: always make upper-constraints available to python jobs  https://review.openstack.org/27833512:40
sdagueAJaeger: probably, fixed12:40
*** thorst has joined #openstack-infra12:40
AJaegersdague: please ping jeblair and fungi to review your change 27833512:41
*** ildikov has joined #openstack-infra12:44
*** Mmike has quit IRC12:44
*** vgridnev has joined #openstack-infra12:45
*** thorst has quit IRC12:45
*** Mmike has joined #openstack-infra12:47
*** Mmike has joined #openstack-infra12:47
pigmejyolanda: could you please look into https://review.openstack.org/#/c/267453/ it's nearly 2w since AJaeger Code Review +2... and about a month since patch was created12:47
*** annegentle_ has joined #openstack-infra12:48
*** achanda has joined #openstack-infra12:48
*** thorst_ has joined #openstack-infra12:49
*** thorst_ has quit IRC12:49
*** thorst_ has joined #openstack-infra12:50
*** weshay_xchat has joined #openstack-infra12:52
*** sam_wan has joined #openstack-infra12:52
*** annegentle_ has quit IRC12:53
*** achanda has quit IRC12:54
*** mrmartin has joined #openstack-infra12:54
*** sam_wan has quit IRC12:56
*** lucasagomes is now known as lucas-hungry12:56
*** sam_wan has joined #openstack-infra12:57
*** tzn has quit IRC12:58
*** dizquierdo has joined #openstack-infra12:58
*** maishsk has quit IRC12:59
*** sam_wan has quit IRC13:00
*** vincentfrancoise has left #openstack-infra13:01
*** sam_wan has joined #openstack-infra13:01
*** rlandy has joined #openstack-infra13:02
*** dimtruck is now known as zz_dimtruck13:03
*** sdake has joined #openstack-infra13:04
*** sam_wan has quit IRC13:04
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Revert "Revert "Enable voting for Puppet OpenStack Integration jobs""  https://review.openstack.org/27835213:04
*** sam_wan has joined #openstack-infra13:06
AJaegerEmilienM: glad to see puppet gate back in business...13:06
EmilienMAJaeger: until when? :)13:06
AJaegerEmilienM: for ever I hope ;)13:06
EmilienMAJaeger: the root cause was some issues in nova & gnocchi, that worked on devstack but not in package. Some sort of chicken & egg problem13:06
AJaeger;(13:06
*** tzn has joined #openstack-infra13:07
*** tzn has quit IRC13:07
*** jcoufal has quit IRC13:07
*** tzn has joined #openstack-infra13:07
tristanCmordred: do you have a moment to talk about heat stack support in shade ? I've been using the proposed patch to demonstrate an os_stack ansible2 module...13:08
*** dprince has joined #openstack-infra13:09
*** e0ne has quit IRC13:09
*** vgridnev has quit IRC13:09
*** annegentle_ has joined #openstack-infra13:09
*** e0ne has joined #openstack-infra13:09
tristanCmordred: it's working fine and all, and before looking at heat stack-snapshot and resources listing, I'd like to check with you how/if you want to support heat with shade13:10
*** kgiusti has joined #openstack-infra13:11
*** edmondsw has quit IRC13:11
openstackgerritDmitry Tantsur proposed openstack/requirements: Bump futurist to 0.11.0  https://review.openstack.org/27827213:12
dtantsurdims, ^^13:12
dimsdtantsur : +213:12
*** olaph is now known as loaf13:13
*** jed56 has quit IRC13:13
*** annegentle_ has quit IRC13:13
*** olaph has joined #openstack-infra13:14
*** sam_wan has quit IRC13:15
dimsAJaeger : i still don't see emails from the periodic jobs (-with-oslo-master)13:18
*** gordc has joined #openstack-infra13:19
*** vgridnev has joined #openstack-infra13:19
*** vgridnev has quit IRC13:21
*** mase_x200 has joined #openstack-infra13:22
AJaegerdims: why emails?13:23
*** moravec has joined #openstack-infra13:24
AJaegerdims: we're not sending emails for periodic jobs anymore...13:24
*** e0ne has quit IRC13:24
dimsAJaeger : ah. so those are just for stable-main jobs ("[Openstack-stable-maint] Stable check of openstack/tempest failed")13:24
AJaegerdims, you have to check http://logs.openstack.org/periodic/ - or look at healthcheck13:24
AJaegerdims: yes, only periodic-stable still sends emails13:25
*** EricGonczer_ has joined #openstack-infra13:25
*** e0ne has joined #openstack-infra13:25
*** sdake_ has joined #openstack-infra13:25
AJaegerdims: seems your jobs show not up here: http://status.openstack.org/openstack-health/#/g/build_queue/periodic?groupKey=build_queue&resolutionKey=hour&searchJob= - best talk with mtreinish on how to get them there....13:27
*** baoli has joined #openstack-infra13:27
*** vgridnev has joined #openstack-infra13:28
dimsAJaeger : will do thanks13:28
*** baoli_ has joined #openstack-infra13:28
*** yamamoto has joined #openstack-infra13:29
mordredtristanC: definitely want to support heat ... oh, I'm way behind in reviewing13:29
*** sdake has quit IRC13:29
mordredtristanC: let me go review some13:29
*** EricGonczer_ has quit IRC13:29
openstackgerritJulien Danjou proposed openstack-dev/pbr: Add --sysconfdir option to install command  https://review.openstack.org/27407713:29
openstackgerritJulien Danjou proposed openstack-dev/pbr: tests: fix data_files testing  https://review.openstack.org/27836013:29
AJaegermordred: morning! Could you review 278328, please  - that's the broken proposal slaves we briefly discussed yesterday. See scrollback for details13:30
ShrewstristanC: your reviews are likely failing jenkins tests b/c they need a fix for the gate that was recently merged13:31
*** baoli has quit IRC13:32
ShrewstristanC: for shade, that is13:32
tristanCmordred: for what it worth, here is the ansible implementation https://gist.github.com/TristanCacqueray/ef93d63a98addf4dae9413:33
*** hdd has joined #openstack-infra13:33
*** annegentle_ has joined #openstack-infra13:33
*** amitgandhinz has joined #openstack-infra13:33
tristanCShrews: yup I noticed those unrelated test failure, but I'm still in the blind if the code is the right approach in the first place13:34
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file  https://review.openstack.org/27566713:36
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566813:37
ShrewstristanC: mordred: i have concerns about shade supporting heat since we don't have any way to functionally test it.13:37
* gtmanfred would like the grant and revoke role stuff for keystone merged :)13:37
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add class to deal with cacert on infra cloud  https://review.openstack.org/27836213:37
*** thorst_ has quit IRC13:38
Shrewsgtmanfred: if mordred or SpamapS don't get around to adding a second +2 soon-ish, i may invoke super-ninja-merging powers13:38
Shrewsbut we'll give them a bit longer  :)13:38
tristanCShrews: that would be good to know, otherwise I could probably rewrite os_stack ansible module using native heatclient13:38
gtmanfredawesome :)13:38
gtmanfredkk13:38
*** xek has joined #openstack-infra13:38
mordredShrews, tristanC looking at code right now13:39
*** thorst has joined #openstack-infra13:39
mordredShrews: we should be able to enable heat in our devstacks, no?13:39
tristanCmordred: that's appreciated, thank!13:39
*** Jeffrey4l has joined #openstack-infra13:39
mordredtristanC, Shrews: what's the deal with treating generators special in the first patch? is there something I'm missing?13:40
Shrewsmordred: i assume so. not knowing enough about heat, is functionally testing that in devstack viable?13:40
openstackgerrityolanda.robla proposed openstack-infra/system-config: Enable cacert signing on infra cloud  https://review.openstack.org/27836813:40
Shrewsmordred: b/c some client api calls return a generator13:40
*** thorst has quit IRC13:40
*** ihrachys_ has joined #openstack-infra13:40
tristanCmordred: otherwise stack list fail because the get() method is different for Stack object13:40
*** thorst has joined #openstack-infra13:40
Shrewsmordred: you then have to have a way to iterate through the generator to munchify things13:41
*** jsavak has joined #openstack-infra13:41
mordredI mean - why do we need obj_gen_to_dict - obj_list_to_dict is the same code13:41
*** zz_dimtruck is now known as dimtruck13:41
Shrewsoh, i haven't actually reviewed the new code... i should do that now i suppose13:41
*** sc68cal has joined #openstack-infra13:42
mordredShrews: yes - I tihnk heat in devstack works well13:42
*** fawadkhaliq has joined #openstack-infra13:42
*** ildikov has quit IRC13:43
tristanCShrews: well you actually asked for obj_gen_to_dict... note that first patchset of https://review.openstack.org/#/c/276045/1 did this just for the stack_list method13:43
Shrewsthen that is a thing we should do13:43
*** ihrachys has quit IRC13:43
ShrewstristanC: i probably did. been weeks since i looked at it13:43
* Shrews makes more coffee first13:44
*** fhubik is now known as fhubik_brb13:45
*** fhubik_brb is now known as fhubik13:46
*** jed56 has joined #openstack-infra13:46
*** amitgandhinz has quit IRC13:47
*** amitgandhinz has joined #openstack-infra13:47
*** sdake_ has quit IRC13:48
*** gokrokve has joined #openstack-infra13:49
*** mase_x200 has quit IRC13:49
*** thorst has quit IRC13:52
*** eharney has joined #openstack-infra13:52
*** gokrokve has quit IRC13:53
*** piet has joined #openstack-infra13:53
*** lucas-hungry is now known as lucasagomes13:53
*** rvasilets_ has joined #openstack-infra13:54
*** mase_x200 has joined #openstack-infra13:56
mordredtristanC: stack looks generally good- other than my disagreement with Shrews over obj_list vs. obj_gen :)13:58
*** akshai has joined #openstack-infra13:59
*** hamzy has quit IRC13:59
*** hamzy has joined #openstack-infra14:00
tristanCmordred: sweet, then I can look into adding stack snapshot too!14:00
*** rhallisey has joined #openstack-infra14:00
mordredtristanC: why don't you go ahead and send a PR to ansible/ansible-modules-extra with your ansible module - and then note that it's going to need a new shade release14:01
*** dizquierdo has quit IRC14:01
tristanCmordred: well there's already 2 PR for an os_stack module in ansible, my version is just to validate shade interface14:03
tristanCI could submit it if matbu doesn't update his PR14:04
mordredah - ok14:04
mordredI suck then  - I'll go dig those up14:04
*** mingyu has quit IRC14:05
*** dimtruck is now known as zz_dimtruck14:06
matbuHi Shrews mordred tristanC14:07
*** mingyu has joined #openstack-infra14:07
*** weshay_xchat is now known as weshay14:07
matbumordred: tristanC what parameter is missing to the os_heat_module ?14:08
matbumordred: tristanC I will update the PR regarding the needs14:08
*** nt has joined #openstack-infra14:08
openstackgerritMichael Krotscheck proposed openstack-infra/project-config: Added *-npm-publish-draft job  https://review.openstack.org/27799614:08
krotscheckAJaeger: Answered your question on ^^14:08
*** piet has quit IRC14:09
matbuShrews: mordred for the review here : https://review.openstack.org/#/c/254337/ gen_to_dict was required, because the heat client return a generator of heat stack object14:09
*** piet has joined #openstack-infra14:09
*** Daisy has joined #openstack-infra14:10
matbuShrews: mordred check my comment on patch set 1114:10
*** isaacb has joined #openstack-infra14:10
mordredmatbu: yes - but obj_list_to_dict is the same logic as obj_gen_to_dict because a generator in a for loop is the same as a list14:12
*** mtanino has joined #openstack-infra14:12
mordredso I tihnk the original error in 11 was not running obj_*_to_dict before doing the normalize14:12
mordrednow that the sequencing is correct, we do not need a second copy of the obj_list_to_dict function - we just need it to be called in the right place, which is now is14:13
mordredor?14:13
matbuyep14:14
*** dizquierdo has joined #openstack-infra14:14
Shrewsmordred: matbu: yes, we don't need obj_gen_to_dict since it is identical to obj_list_to_dict, but we DO need to make sure that a generator is not passed to obj_to_dict() since that will make things go boom14:14
mordred++14:14
*** Daisy has quit IRC14:14
matbuand keep the change for handle the generator case14:15
matbuin wait()14:15
Shrewswhich i *think* was my original point way back when, but i may not have expressed myself clearly14:15
*** julim has joined #openstack-infra14:15
*** hashar has joined #openstack-infra14:15
Shrewsyeah, the change in wait() needs to stay (except use obj_list_to_dict)14:15
openstackgerritCraig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests  https://review.openstack.org/27809514:16
*** zz_dimtruck is now known as dimtruck14:16
phschwartzWhen nodepool is building an image with dib what is injecting /home/jenkins/.pydistutils.conf ?14:18
*** esikachev has quit IRC14:19
*** sabeen has joined #openstack-infra14:19
*** eharney has quit IRC14:21
*** esikachev has joined #openstack-infra14:21
*** mriedem has joined #openstack-infra14:22
*** sabeen3 has joined #openstack-infra14:22
*** jordanP has joined #openstack-infra14:22
mordredphschwartz: puppet14:23
phschwartzmordred: I had that feeling, recent change? last 2 months? It use to be handled by the configure_mirror.sh script for nodepool14:23
*** sabeen has quit IRC14:24
*** tiswanso has joined #openstack-infra14:24
mordredphschwartz: http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/slave_common.pp#n4614:24
mordredphschwartz: when it is building an image, it's this ^^14:24
mordredphschwartz: configure_mirror is run on node creation time14:25
*** eharney has joined #openstack-infra14:25
mordredtwo different things14:25
Shrewsjeblair: fyi, getting this exception everytime i attempt to see the diff of a change in gertty (HEAD at fbb9969): http://paste.openstack.org/show/486564/14:25
*** krtaylor has quit IRC14:25
mordredphschwartz: image build needs to have a mirror associated with the location the image is being built in (for us, always rackspace dfw)14:25
mordredphschwartz: but when you spin up nodes, it needs to know the mirror for the location the node is running in14:26
mordredphschwartz: it can likely be refactored/reorganized once we don't do snapshot images anymore14:26
*** _amrith_ is now known as amrith14:27
mordredbut for now, some of the things happen in more than one place because history and because it's not worth refactoring until the snapshots go away14:27
*** annegentle_ has quit IRC14:27
*** links has quit IRC14:27
phschwartzmordred: I have to figure a way around that as for our images that are being built we don't want to use a pypi mirror (and the pypi.dfw.o.o is not accessiable to us so it causes a pip break)14:28
*** hdd has quit IRC14:29
mordredphschwartz: well - pypi.dfw.o.o isn't accessible to anybody - https://review.openstack.org/#/c/278328/ is needed14:29
*** changbl has joined #openstack-infra14:29
*** mase_x200 has quit IRC14:31
mordredphschwartz: but also, you shouldn't be using the puppet manifests in system-config anyway - that's the config for this instance of infra14:31
mordredasselin: ^^ what's the story for this?14:31
phschwartzmordred: I didn't use them, or at least tell it to. I am trying to track down what pulled it in14:32
*** ildikov has joined #openstack-infra14:32
*** jcoufal has joined #openstack-infra14:33
*** akshai has quit IRC14:34
*** chaitu has quit IRC14:34
*** slogan621 has quit IRC14:34
mordrednod14:36
*** xyang1 has joined #openstack-infra14:37
anteayapleia2: nice list, isn't wikimedia part of that group as well?14:38
*** sdake has joined #openstack-infra14:38
*** dimtruck is now known as zz_dimtruck14:38
anteayatonyb: yeah anything with bleeding edge in the name is soon outdated, as what ever you are doing is bleeding edge for a limited period of time14:38
*** bryan_att has joined #openstack-infra14:39
*** akshai has joined #openstack-infra14:39
*** mrmartin has quit IRC14:39
pabelangermorning14:40
*** w_ has joined #openstack-infra14:40
pabelangermordred: so, about to dive into the does for an official RPM mirror in centos / fedora. Any reason not to start with that software for our AFS mirrors?14:41
*** Swami has joined #openstack-infra14:41
*** loaf has quit IRC14:43
fungihttps://git-man-page-generator.lokaltog.net/14:43
anteayamaishsk: this may help if you are in channel again: http://anteaya.info/blog/2013/03/25/please-rebase-your-change-and-upload-a-new-patchset/14:45
mordredpabelanger: we should absolutely start with that on our AFS mirrors14:47
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for tempest verify-config cliff bug 1543841  https://review.openstack.org/27840914:48
openstackbug 1543841 in devstack "Invocation error: tempest verify-config: error: unrecognized arguments: -uro ../../../../tmp/tmp.FR5OHabb3Y" [Undecided,In progress] https://launchpad.net/bugs/1543841 - Assigned to Matthew Treinish (treinish)14:48
mordredpabelanger: I think you should be able to cargo-cult the ubuntu mirror code - just replace the reprepro calls with a call to rsync14:48
*** maishsk has joined #openstack-infra14:48
mordredpabelanger: and then once you've rsync'd, I'm not sure if there is a 'good' way to check a yum repo for consistency - but if there is, that would be a good thing to run where we're running reprepro check14:49
pabelangermordred: Ya, that's seems to be the tooling of choice for yum (rsync)14:49
mordredpabelanger: finally - do yum repos purge old packages?14:49
*** daemontool_ has quit IRC14:49
*** gokrokve has joined #openstack-infra14:50
*** daemontool_ has joined #openstack-infra14:50
*** abregman has quit IRC14:50
pabelangermordred: Ya, I think repomanage has some logic built in for that14:50
*** jpeeler has joined #openstack-infra14:50
mordredpabelanger: k. so - one of the things we did with ubuntu is that we record the files to be purged when we do a mirror run14:50
mordredpabelanger: but then we do not purge them until the following run14:50
openstackgerritMerged openstack-infra/system-config: Update mirror to use in easy_install  https://review.openstack.org/27832814:50
mordredpabelanger: that way if someone has fetched an index, then we do a mirror release, then they try to fetch the file pointed to in the index - they do not get an error14:51
pabelangermordred: sure. I'll look into the review and see what is happening14:51
mordred(unless they wait 2 hours between fetching an index and fetching the file)14:51
mordredpabelanger: woot!14:51
mordredpabelanger: I'm totally happy to help as much as you need - super excited to get centos/fedora mirrors going14:51
*** daemontool__ has joined #openstack-infra14:51
openstackgerritMerged openstack-infra/release-tools: Use yes/no for pypi flag  https://review.openstack.org/27816714:52
pabelangermordred: Ya, I expect I'll be pinging you for reviews and questions14:52
pabelangeror any other infra-root14:52
*** achanda has joined #openstack-infra14:52
*** daemontool__ is now known as daemontool14:52
openstackgerritMerged openstack-infra/system-config: Show toggle CI button for Gerrit URLs with patch set ranges  https://review.openstack.org/26111014:52
*** esker has quit IRC14:52
*** Daisy has joined #openstack-infra14:53
dolphmare all gerrit usernames directly derived from launchpad IDs?14:53
dolphmgerrit usernames / gerrit IDs14:53
*** alivigni has joined #openstack-infra14:53
fungidolphm: they used to be, but lp stopped providing usernames via openid about a year ago so since then they're chosen at account creation time in gerrit14:54
*** [1]Thelo has joined #openstack-infra14:54
fungidolphm: at this point the only linkage we have there is between gerrit accounts and login.launchpad.net openid urls14:55
dolphmfungi: ah, that explains it14:55
*** daemontool_ has quit IRC14:55
*** w_ has quit IRC14:55
fungiat least the only linkage we can reasonably trust14:55
anteayadolphm: on first sign in, the gerrit username is blank and has to be created14:55
*** annegentle_ has joined #openstack-infra14:55
*** pradk has joined #openstack-infra14:55
fungialso, once chosen, gerrit does not allow you to change the username either14:56
dolphmi assume the stackalytics data is the most reliable public data linking inconsistently named accounts? https://github.com/openstack/stackalytics/blob/master/etc/default_data.json14:56
*** hexhaxtron_ has joined #openstack-infra14:56
*** gokrokve has quit IRC14:56
*** Thelo has quit IRC14:56
*** [1]Thelo is now known as Thelo14:56
anteayadolphm: I wouldn't assume that14:56
fungidolphm: depends on what you mean by "data"14:56
*** w_ has joined #openstack-infra14:57
anteayadolphm: you can query gerrit14:57
dolphmlol14:57
fungito reach code contributors, i directly query gerrit's rest api14:57
*** achanda has quit IRC14:57
fungithough at the moment you can only see the preferred e-mail address of users in gerrit without being a gerrit admin (there's a patch upstream to fix that)14:57
dolphmi'm looking to identify launchpad accounts (which i thought i could assume was 1:1) based on gerrit accounts (which i have)14:57
*** otherwiseguy has joined #openstack-infra14:58
*** gokrokve has joined #openstack-infra14:58
fungiahh, yes to actually identify lp accounts you'd need access to the openid urls tracked in gerrit's database, and i don't think it exposes those via the rest api14:58
dolphmso, stackalytics for me then :P14:58
fungithough if you had them, lp's api does provide an openid to lp account lookup method14:59
*** akshai has quit IRC14:59
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: [WIP] Switch to new Neutron devstack  https://review.openstack.org/27841514:59
*** maishsk has quit IRC14:59
fungiadded at our request as well, because we use it in our bug update hooks to figure out how to reassign bugs in progress14:59
*** aovchinnikov has quit IRC14:59
fungiin theory this will become a much easier problem once we switch gerrit to identify users via openstackid.org15:00
*** akshai has joined #openstack-infra15:01
openstackgerritOmer Anson proposed openstack/requirements: Add scapy and python-pytun  https://review.openstack.org/27789315:01
*** hexhaxtron_ has left #openstack-infra15:02
*** fhubik is now known as fhubik_brb15:03
*** annegentle_ has quit IRC15:03
*** BobBall1 is now known as BobBall15:03
mordreddolphm: I agree - although the stackalytics data is not perfect, it's likely the best thing you have available to you15:03
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Remove query for bug 1524418  https://review.openstack.org/27841815:04
openstackbug 1524418 in oslo.messaging "gate-grenade-dsvm-multinode fails with "AttributeError: 'LocalManager' object has no attribute 'l3driver'"" [Undecided,Fix released] https://launchpad.net/bugs/1524418 - Assigned to Mehdi Abaakouk (sileht)15:04
fungiunless someone wanted to write a periodic etl process which created a gerrit->lp mapping we could publish15:05
dolphmfungi: what about a way to go from OpenID to gerrit username?15:06
AJaegeranteaya: https://review.openstack.org/#/c/277996/3/zuul/layout.yaml adds a voting job only to check queue. The reasons given satisfy me but I would ask krotscheck to update the commit message to add it there. Could you look at it as well, please?15:06
*** Daisy has quit IRC15:07
*** deva_ has joined #openstack-infra15:08
*** annegentle_ has joined #openstack-infra15:08
*** esp has joined #openstack-infra15:09
* anteaya looks15:09
*** vgridnev has quit IRC15:09
*** NobodyCa1 has joined #openstack-infra15:09
*** ccrouch has joined #openstack-infra15:09
*** mtanino has quit IRC15:09
AJaegerdougwig: could you review https://review.openstack.org/#/c/278051/ , please?15:09
*** otherwiseguy has quit IRC15:10
*** vgridnev has joined #openstack-infra15:11
asselinmordred, phschwartz hi, what's up?15:11
*** nmagnezi has quit IRC15:11
mordredasselin: I thought phschwartz might need help in stopping to use system-config in his CI15:11
mordredasselin: but he may have it now15:11
phschwartzasselin: yeah, I am looking through it right now. I pulled in system-config somewhere for setting up the nodepool nodes15:12
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: [WIP] Switch to new Neutron devstack  https://review.openstack.org/27841515:12
anteayaAJaeger: I agree, having a draft available makes sense pre merge, thank you, the commit message is nice and clear15:12
*** esp has quit IRC15:13
asselinmordred, phschwartz ok I see...right now creating the images in in project-config which pulls in system-config15:13
AJaegeranteaya: you approved without a second +2?15:13
jeblairShrews: yikes! what gertty version/git-sha, what change, and python2 or python3?15:13
Shrewsjeblair: sha in the comment15:13
phschwartzasselin: that about wraps it up15:13
AJaegeranteaya: let me quickly add my +2 ;)15:13
anteayaAJaeger: I did so, sorry I thought your +2 was there15:14
Shrewsjeblair: 2.7.1015:14
asselinmordred, phschwartz we don't have a way yet to make images for devstack in common-ci w/o reusing infra's setup15:14
anteayaAJaeger: my apologies15:14
*** zz_dimtruck is now known as dimtruck15:14
phschwartzasselin: which is why I think I did it that way.15:14
phschwartzasselin: I might just add to my nodepool scripts an rm of the .pydistutils.cfg15:14
*** NobodyCa1 has quit IRC15:14
Shrewsjeblair: apologies... using a venv... 3.4.315:14
*** deva_ has quit IRC15:14
phschwartzthat will most likely solve it all15:14
AJaegeranteaya: no worries, was just surprised...15:14
AJaegeranteaya: now it's there15:14
anteayaAJaeger: yes, good call, I don't do that15:14
anteayaAJaeger: thanks for speaking up15:15
anteayathank you, sorry about that15:15
asselinmordred, phschwartz so you end up needing patches like this too: https://review.openstack.org/#/c/217914/15:15
Shrewsjeblair: so far, every gerrit change i've tried to get the diff causes it15:15
*** burgerk has joined #openstack-infra15:15
openstackgerritBryan Jones proposed openstack/requirements: Bump python-openstackclient version to 2.1.0  https://review.openstack.org/27842815:16
phschwartzasselin: yes, that seems to be what is needed.15:16
jeblairShrews: what's the gitpython version?15:16
Shrewsjeblair: 1.0.115:17
Shrewsjeblair: pip freeze output: http://paste.openstack.org/show/486574/15:17
*** vgridnev has quit IRC15:17
*** rbrndt_ has joined #openstack-infra15:18
asselinphschwartz, mordred so while we've separated the actual setup of the ci system by using common-ci, we still do some copy and paste-modify e.g. http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/README.md#n315:18
*** gokrokve has quit IRC15:19
*** sigmavirus24_awa is now known as sigmavirus2415:19
*** dkranz has joined #openstack-infra15:20
*** maishsk has joined #openstack-infra15:20
asselinand here: http://git.openstack.org/cgit/openstack-infra/project-config-example/tree/README.md#n4115:20
*** thorst_ has joined #openstack-infra15:21
openstackgerritRyan Rossiter proposed openstack-infra/release-tools: Add more emotion words  https://review.openstack.org/27843515:22
openstackgerritKyle Mestery proposed openstack-infra/project-config: networking-ovn: Add an install job for networking-ovn + kuryr  https://review.openstack.org/27810115:22
fungidolphm: well, if we had some service publishing the mapping, it would be a two-way mapping. but ideally the gerrit rest api should be extended to expose methods for that15:22
*** woodster_ has joined #openstack-infra15:23
*** thorst__ has joined #openstack-infra15:23
*** jaosorior has joined #openstack-infra15:24
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Remove test workaround for extra_dhcp_opts  https://review.openstack.org/27843815:24
jeblairShrews: huh, so i kind of thought virtualenv-3.4 would make a python3.4 virtualenv15:25
jeblairapparently i was mistaken about that15:25
phschwartzasselin: mordred: maybe we should work to get that review merged. There are a bunch of +1's and +2's whats holding it from getting a +1 to workflow?15:25
jeblairShrews: so it's quite possible my 3.4 testing is not nearly as effective as i thought it was15:25
*** thorst_ has quit IRC15:25
asselinphschwartz, I can rebase it...it was waiting for some baby-sitting b/c it affects image builds.15:26
Shrewsjeblair: yes, it is 3.4.3. i was mistaken about the python version initially15:26
openstackgerritBrant Knudson proposed openstack-infra/project-config: Support stable requirements  https://review.openstack.org/27805615:26
*** w__ has joined #openstack-infra15:26
openstackgerritMerged openstack-infra/project-config: Added *-npm-publish-draft job  https://review.openstack.org/27799615:26
*** thorst_ has joined #openstack-infra15:26
jeblairShrews: do you know how i should make a 3.4 virtualenv?15:26
fungijeblair: i just do virtualenv -p python3.415:26
phschwartzasselin: if you don't have time to do the rebase and baby sit, I can as I need this to fix our downstream15:26
jeblairfungi: ah, ok i'll try that15:27
*** jsavak has quit IRC15:27
fungi-p PYTHON_EXE, --python=PYTHON_EXE15:27
*** thorst__ has quit IRC15:27
jeblairokay that works.  wth is virtualenv-3.4 ?  <mutter>15:27
*** w_ has quit IRC15:28
fungino clue. haven't used that15:28
Shrewsjeblair: i think all i did was 'tox -evenv' and alias gertty to the one in that env15:28
jeblairit's "fool's virtualenv"15:28
asselinphschwartz, I worked around it by adding an element to fix the pip configuratino after puppet finishes15:28
fungihah15:28
fungiShrews: oh, good idea. using aliases probably makes more sense than my linkfarm in ~/bin15:29
Shrewsjeblair: perhaps i should rebuild that env? /me tries15:30
phschwartzasselin: hmm, that is a good point. I can probably do it that way for now15:30
jeblairShrews: yep, i get that error in 3.4.  so the short answer is, it should work in 2.7.  and i'll go fix my 3.4 fixes better now that i'm actually running 3.4.15:30
Shrewsjeblair: nope. same thing15:30
*** regXboi has joined #openstack-infra15:30
*** EricGonczer_ has joined #openstack-infra15:30
Shrewsjeblair: ++15:30
fungiShrews: what platform are you on that the default python is 3.4?15:31
*** thorst_ has quit IRC15:31
*** jsavak has joined #openstack-infra15:31
Shrewsfungi: wily, but the system default is still 2.7. not sure why tox uses 3.415:31
fungiShrews: that's weird15:32
*** EricGonc_ has joined #openstack-infra15:32
fungiShrews: then again, my tox is actually ~/pyenvs/tox/bin/tox so its default python is the one i used to create its virtualenv15:32
*** rcernin has quit IRC15:33
AJaegerdims, dhellmann : Could you review https://review.openstack.org/#/c/278056 , please? It's another stable requirements fix15:33
fungiin fact, my virtualenv is ~/pyenvs/virtualenv/bin/virtualenv15:33
*** vgridnev has joined #openstack-infra15:33
fungii should start learning about pip --user or whatever it is15:34
*** thorst_ has joined #openstack-infra15:34
*** e0ne has quit IRC15:34
*** EricGonczer_ has quit IRC15:35
*** e0ne has joined #openstack-infra15:35
*** yamamoto has quit IRC15:35
mordredfungi: just run as root15:36
*** jaosorior has quit IRC15:36
*** thorst_ has quit IRC15:38
pabelangernibalizer: so, what our the changes of adding a testing hiera.yaml config file into system-config/tools?15:38
fungii have a root allergy15:38
*** krtaylor has joined #openstack-infra15:38
pabelangerfor people how don't have access to the production one15:38
sdaguefungi: they make a cream for that15:38
*** mrmartin has joined #openstack-infra15:39
fungii've been trying to treat it with more booze15:39
pabelangerjust removes an manual setup from a tester who want to spin up a node to write puppet code15:39
*** thorst_ has joined #openstack-infra15:39
pabelangernibalizer: eg: udo puppet apply --modulepath=/etc/puppet/modules:modules manifests/site.pp --certname mirror.test.openstack.org --hiera_config tools/hiera.yaml15:39
pabelangernibalizer: otherwise you get: Error: Could not find data item elasticsearch_nodes in any Hiera data file and no default supplied at /home/ubuntu/system-config/manifests/site.pp:8 on node mirror.test.openstack.org15:39
*** mrmartin has quit IRC15:40
*** infra-re_ has quit IRC15:42
*** jaosorior has joined #openstack-infra15:42
*** gokrokve has joined #openstack-infra15:43
AJaegermordred, jeblair could you review system-config file ./modules/openstack_project/templates/wheel_mirror/known_hosts.erb, please? That looks very outdated. Can we just remove with new mirrors now?15:43
*** thorst_ has quit IRC15:44
AJaegerlifeless : Could you also review https://review.openstack.org/#/c/278056 , please? It's another stable requirements fix15:44
*** vgridnev has quit IRC15:45
*** vgridnev has joined #openstack-infra15:45
*** esikachev has quit IRC15:46
*** piet has quit IRC15:46
*** gokrokve has quit IRC15:47
openstackgerritMark Vanderwiel proposed openstack-infra/project-config: Adding integration test support for lbaas v2 dashboard  https://review.openstack.org/27539415:47
*** otherwiseguy has joined #openstack-infra15:48
*** dizquierdo has quit IRC15:49
openstackgerritMark Vanderwiel proposed openstack-infra/project-config: Adding integration test support for app catalog horizon plugin  https://review.openstack.org/27644015:49
*** ihrachys_ is now known as ihrachys15:49
*** Daisy has joined #openstack-infra15:50
*** max_lobur has joined #openstack-infra15:52
*** maishsk has quit IRC15:53
*** yamamoto has joined #openstack-infra15:54
*** Daisy has quit IRC15:55
*** mtanino has joined #openstack-infra15:56
*** piet has joined #openstack-infra15:56
openstackgerritJames E. Blair proposed openstack/gertty: Add support for conflicts-with  https://review.openstack.org/27699815:56
openstackgerritJames E. Blair proposed openstack/gertty: Improve handling of abandoned related changes  https://review.openstack.org/27699715:56
openstackgerritJames E. Blair proposed openstack/gertty: Make sorting commands use two two keys  https://review.openstack.org/27747615:56
openstackgerritJames E. Blair proposed openstack/gertty: Fix return values in handleCommands in project_list  https://review.openstack.org/27747715:56
openstackgerritJames E. Blair proposed openstack/gertty: Add support for last_seen  https://review.openstack.org/27747415:56
openstackgerritJames E. Blair proposed openstack/gertty: Add support for customized dashboard sorting  https://review.openstack.org/27747515:56
openstackgerritJames E. Blair proposed openstack/gertty: Add debug-sync option  https://review.openstack.org/27747315:56
openstackgerritJames E. Blair proposed openstack/gertty: Fix unicode regression regressions  https://review.openstack.org/27847215:56
jeblairShrews: ^ 278472 should fix it15:57
*** Sukhdev has joined #openstack-infra15:57
jeblairShrews: despite appearances, that's actually the bottom of that stack15:57
jeblairShrews: if you _also_ want to test out the new stuff i've been hacking on, feel free to go further up15:57
jeblairShrews: but it rebased them all on it so you don't have to15:57
yolandaback... so AJaeger, modred, is the problem with easy_install fixed now? or we will need to rebuild images for it?15:58
mordredyolanda: I am not sure if it landed before this morning's image builds or not15:58
AJaegeryolanda: patch merged. I'm not sure whether we need to dosomething for the proposal slaves15:58
mordredoh - proposal slaves15:58
mordredno - those don't need images15:58
mordredthose are normal servers15:59
jeblairShrews: i have two test changes i use to test unicode issues -- they are https://review.openstack.org/275862 and https://review.openstack.org/119302 .  278472 appears to work with both on 2.7 and 3.4, as well as a random non-unicodeish change.15:59
yolandamordred, is that only configuration for proposal slaves?15:59
*** thorst_ has joined #openstack-infra15:59
*** jpr has quit IRC15:59
mordredyolanda: we update pydistutils.cfg in configure-mirror.sh when we boot nodes, so nodes themselves should be fine15:59
yolandanice16:00
Shrewsjeblair: cool. will test it out16:00
openstackgerritJames E. Blair proposed openstack-infra/system-config: Remove wheel_mirror known hosts  https://review.openstack.org/27847316:00
jeblairAJaeger: ^ indeed, thanks.  krotscheck, fungi, mordred: ^16:00
*** rcernin has joined #openstack-infra16:01
*** fhubik_brb is now known as fhubik16:01
*** jsavak has quit IRC16:01
*** jswarren_ has joined #openstack-infra16:01
*** salv-orlando has quit IRC16:01
Shrewsjeblair: those unicode test reviews you posted don't seem to be, um, relevant?16:01
jeblairShrews: they have utf8 encoded chars in them16:02
Shrewsoh16:02
jeblairShrews: though... possibly not in the diffs...  maybe only in the author fields?16:02
jeblairwe may need to keep an eye out for actual diffs.16:03
*** tcammann has joined #openstack-infra16:04
*** esp has joined #openstack-infra16:04
*** samueldmq1 has joined #openstack-infra16:04
*** gokrokve has joined #openstack-infra16:04
*** NobodyCa1 has joined #openstack-infra16:05
Shrewsjeblair: yay, it worky! thx16:05
*** kmartin has joined #openstack-infra16:05
jeblairShrews: cool -- also, i found a change with a utf8 char in the diff itself, and it works in 27 and 34  ( https://review.openstack.org/133550 )16:05
*** Jeffrey4l has quit IRC16:05
*** deva_ has joined #openstack-infra16:06
openstackgerritJames E. Blair proposed openstack/gertty: Add another utf8 test change comment  https://review.openstack.org/27848016:06
*** lmiccini is now known as lmiccini|gone16:07
Shrewsjeblair: the 133550 diff opens fine for me. no crash16:07
*** fhubik has quit IRC16:08
*** jaosorior_ has joined #openstack-infra16:09
*** hdd has joined #openstack-infra16:09
*** tcammann has quit IRC16:09
openstackgerritCarl Baldwin proposed openstack-infra/irc-meetings: A meeting for discussing and coordinating routed networks  https://review.openstack.org/27811416:09
*** esp has quit IRC16:11
*** deva_ has quit IRC16:11
*** NobodyCa1 has quit IRC16:11
*** samueldmq1 has quit IRC16:11
*** rajinir has joined #openstack-infra16:11
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Setup rabbit user/pass for keystone  https://review.openstack.org/27848216:11
*** esker has joined #openstack-infra16:12
*** jsavak has joined #openstack-infra16:13
openstackgerrityolanda.robla proposed openstack-infra/system-config: Send keystone_rabbit_password parameter  https://review.openstack.org/27848516:15
daemontoolanyone available for +A https://review.openstack.org/#/c/278323/ ? thanks16:15
*** esker has quit IRC16:16
*** arthus has quit IRC16:17
*** esp has joined #openstack-infra16:17
*** esker has joined #openstack-infra16:17
*** tcammann has joined #openstack-infra16:18
*** slogan621 has joined #openstack-infra16:18
*** NobodyCa1 has joined #openstack-infra16:19
anteayafungi clarkb jeblair is the only issue we have had in our tooling with 4-byte unicode etherpad?16:20
*** [HeOS] has joined #openstack-infra16:21
anteayaI ask because cinder is discussing supporting 4-byte unicode for naming their things16:21
openstackgerritMerged openstack-infra/elastic-recheck: Add query for tempest verify-config cliff bug 1543841  https://review.openstack.org/27840916:21
openstackbug 1543841 in devstack "Invocation error: tempest verify-config: error: unrecognized arguments: -uro ../../../../tmp/tmp.FR5OHabb3Y" [Undecided,In progress] https://launchpad.net/bugs/1543841 - Assigned to Matthew Treinish (treinish)16:21
*** weshay has quit IRC16:21
clarkbanteaya: that issue shoudlve been corrected not long after the vancouver summit16:21
*** weshay_xchat has joined #openstack-infra16:21
*** cbader has quit IRC16:22
anteayaclarkb: right with etherpad16:22
anteayaI'm wondering if that has been an issue with any of our other tools16:22
slogan621Andreas: thanks again for the +216:22
anteayathey are discussing at their meeting underway in -meeting16:22
*** Swami_ has joined #openstack-infra16:22
*** annegentle_ has quit IRC16:22
slogan621anteaya: can I get a review from you on https://review.openstack.org/#/c/275873/ please?16:23
*** weshay_xchat has quit IRC16:23
anteayaslogan621: I'm in a meeting, perhaps afterwards16:23
*** weshay has joined #openstack-infra16:23
clarkbanteaya: not that I have seen I think other tools generally check and are more cautious wheeeas etherpad blindly wrote to the db16:23
slogan621anteaya: thanks16:23
*** NobodyCa1 has quit IRC16:23
*** otherwiseguy has quit IRC16:24
anteayaclarkb: thank you16:24
*** HeOS has quit IRC16:24
*** tcammann has quit IRC16:24
clarkbdaemontool: that change doesnt say why it is being made, only what it does (which is discoverable in the diff)16:24
*** rcernin has quit IRC16:24
*** esp has quit IRC16:24
openstackgerritDoug Hellmann proposed openstack-infra/project-config: import release-test repository  https://review.openstack.org/27849516:24
openstackgerritCarl Baldwin proposed openstack-infra/irc-meetings: A meeting for discussing and coordinating routed networks  https://review.openstack.org/27811416:25
daemontoolclarkb,  ok, I'm adding more info in the commit message, ty16:25
*** placko_ has quit IRC16:26
daemontoolyou already make the point yestarday about this16:26
daemontools/make/made/16:26
*** otherwiseguy has joined #openstack-infra16:26
pabelangermordred: so, just to confirm, we should only need os and updates repos for centos / fedora right?16:26
pabelangerI don't think we need to mirror epel716:26
*** placko_ has joined #openstack-infra16:27
clarkbwe use epel16:27
pabelangeroh16:27
pabelangerokay then16:27
*** Swami has quit IRC16:27
clarkband the rdo repo16:27
*** harlowja_at_home has joined #openstack-infra16:27
*** annegentle_ has joined #openstack-infra16:28
fungiyeah, the main repo for centos is pretty useless on its own16:29
fungiepel is a necessity16:29
fungiso many of the packages we need are in epel16:29
pabelangerokay, will start with epel7 then16:30
clarkband rdp has half the packages to use oprmstack16:30
clarkbovs and friends16:30
openstackgerritFausto Marzi proposed openstack-infra/project-config: Set conditions for gate-freezer-devstack-dsvm on freezer  https://review.openstack.org/27832316:30
mordredpabelanger: what clarkb and fungi said16:30
mnaseris there a way of providing the nodepool config with the os-client-config vendor profile?16:31
*** tiswanso has quit IRC16:31
zeih_hey, someone around of requirements-core? I have a question regarding requirements handling in stable branches. Is it recommended/usefull to backport PS to stable/liberty and stable/kilo of global-requirements repo if I have this stable branches in the projekt repo as well?16:31
mordredpabelanger: I think we likely only want 2 afs volumes - mirror.centos and mirror.fedora - and then mirror all of the repos for each we want as part of a run/release cycle for each16:31
*** placko_ has quit IRC16:31
mnaseri have a customer that's setting up nodepool for CI and they're getting "service catalog is empty" related errors, i suspect it's the incorrect region-name/service-type/service-name16:31
*** abregman has joined #openstack-infra16:31
mnaserbut ideally i'd like them to be using the os-client-config profile to make sure stuff always works16:31
pabelangermordred: right16:31
*** placko_ has joined #openstack-infra16:31
anteayathank you16:31
clarkbmnaser: yes have a clouds.yaml and set the cloud name in your nodepool provider config16:32
mnaserclarkb: so the cloud name under providers is actually the name of the profile in os-client-config ?16:32
clarkbmnaser: yes16:32
*** placko_ has quit IRC16:32
mnaserwell that might be a documentation bug then i guess :-P16:32
clarkbbecaude it used to be called "cloud" in os client config16:32
*** boris-42 has quit IRC16:33
clarkbmnaser: I just confirmed it isnt documented16:34
clarkbmordred ^16:34
mnaseri wonder if this can explain them getting: "The Service Catalog is empty"16:34
*** tiswanso has joined #openstack-infra16:34
*** tiswanso has quit IRC16:35
*** rvasilets_ has quit IRC16:35
*** slogan621 has quit IRC16:35
*** tiswanso has joined #openstack-infra16:35
mordredthey should not need to set service-type/service-name unless something is really weird16:36
*** vgridnev has quit IRC16:36
*** Guest15890 has quit IRC16:36
*** jsavak has quit IRC16:36
mordredbut if they have a clouds.yaml file it should be pretty easy to test that it's correct using python-openstackclient16:36
*** jgriffith_away is now known as jgriffith16:37
mnaseri have their clouds yaml file here infront of me, they don't have it specified so its a bit confusing16:37
mnaseroh.16:37
mnaserauth-url with /v2.0/16:37
mnaserthat could be it16:37
*** mingyu has quit IRC16:38
*** infra-red has joined #openstack-infra16:39
jeblairthey shouldn't need auth-url, right?16:39
jeblairif the profile is specified16:40
mnaserif they use os-client-config I guess they don't16:40
mnaserbut in this caes, they have their own name for the provider and the rest of the stuff is defined16:40
mnaserholy crap16:40
mnaser!!16:40
openstackmnaser: Error: "!" is not a valid command.16:40
*** doug-fish has quit IRC16:40
mnaseri just noticed looking at their config... "tennant-id: "16:40
*** doug-fish has joined #openstack-infra16:41
*** bpokorny has joined #openstack-infra16:41
*** harlowja_at_home has quit IRC16:41
mordred:)16:41
*** mingyu has joined #openstack-infra16:41
mordredmnaser: can you pastebin their clouds.yaml removing the password from it and send it to me and I can doublecheck anything else for you16:42
*** mingyu has left #openstack-infra16:42
*** jsavak has joined #openstack-infra16:42
mordredbut also - I'm a bit unhappy about that error message16:42
mordredif they have tennant-id in there there SHOULD have been an error about missing required parameters16:42
*** harlowja_at_home has joined #openstack-infra16:42
*** jtomasek_ has quit IRC16:42
mnasermordred: sent via pm with extra stuff removed16:44
*** jpr has joined #openstack-infra16:44
*** maishsk has joined #openstack-infra16:45
*** doug-fish has quit IRC16:45
*** MarkAtwood has joined #openstack-infra16:46
fungizeih_: i'm pretty sure the general stable branch policy for requirements is to make no additions and no increases of minimum or maximum versions, but adding or lowering maximum versions may be acceptable if it fixes an issue with a new release of some dependency16:48
*** jpr has quit IRC16:49
zeih_fungi: yes, thats right.16:50
*** salv-orlando has joined #openstack-infra16:50
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add a calendar directive  https://review.openstack.org/27850816:50
*** apoorvad has joined #openstack-infra16:51
*** jswarren_ has quit IRC16:51
*** doug-fish has joined #openstack-infra16:51
*** jlanoux has quit IRC16:51
*** asselin has quit IRC16:52
*** marcusvrn_ has joined #openstack-infra16:53
*** mikelk has quit IRC16:53
openstackgerrityolanda.robla proposed openstack-infra/puppet-infracloud: Add element to bring up bridge on infra cloud  https://review.openstack.org/27629216:53
*** achanda has joined #openstack-infra16:55
*** gyee has joined #openstack-infra16:55
*** sigmavirus24 is now known as sigmavirus24_awa16:55
*** sigmavirus24_awa is now known as sigmavirus2416:56
*** asselin has joined #openstack-infra16:57
*** doug-fish has quit IRC16:57
*** jaosorior_ has quit IRC16:58
jeblairthe travel support committee uses google docs.  :(  i've asked if there's some other way i can contribute.16:58
*** annegentle_ has quit IRC16:59
*** asselin__ has joined #openstack-infra16:59
*** achanda has quit IRC16:59
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add a calendar directive  https://review.openstack.org/27850817:00
*** jaosorior_ has joined #openstack-infra17:00
*** flepied1 has quit IRC17:00
*** thorst_ has quit IRC17:01
*** asselin has quit IRC17:01
EmilienMmordred: do you have an example in infra where http://docs.ansible.com/ansible/os_auth_module.html is used?17:02
*** esikachev has joined #openstack-infra17:02
*** jsavak has quit IRC17:02
*** jsavak has joined #openstack-infra17:02
anteayajeblair: :(17:05
*** jpr has joined #openstack-infra17:05
mordredEmilienM: nope- I mostly made that module to help debug things17:05
EmilienMmordred: trying to use it, but I don't get how to use auth (and if I should use it)17:06
mordredEmilienM: you should just always have a clouds.yaml and use that17:06
EmilienMok17:06
EmilienMI missed that part17:07
*** sdake has quit IRC17:08
*** e0ne has quit IRC17:08
mordredEmilienM: http://paste.openstack.org/show/48658717:08
tristanCspeaking of, nodepool is still failing if image-api-use-tasks isn't defined in nodepool.yaml: https://review.openstack.org/#/c/272097/17:08
mordredEmilienM: there is a playbook that shows it17:09
mordredtristanC: using or not using clouds.yaml ?17:09
EmilienMmordred: thanks17:09
tristanCmordred: well without clouds.yaml17:09
*** esikachev has quit IRC17:09
*** armax has joined #openstack-infra17:09
tristanCmordred: is there a documentation about using clouds.yaml for nodepool ?17:10
*** shashank_hegde has joined #openstack-infra17:10
*** thorst__ has joined #openstack-infra17:10
clarkbtristanC: no thsts what I was pointing out to mordred earlier17:10
clarkbwe never added docs for it17:10
mordredgah17:10
mordredI think I have it in one of the nodepool-shade patches17:11
yolandanibalizer, aroun?17:11
mordredI should pull that out and resubmit it17:11
yolandaaround?17:11
yolandai need to talk with you about certs17:11
*** maishsk has quit IRC17:11
mordredhttps://review.openstack.org/#/c/226758/4/doc/source/configuration.rst17:12
tristanCclarkb: thank! that's a bit confusing for now, and well, master version of nodepool won't work with shade-1.4.0 without that image-api-use-tasks setting17:12
mordredtristanC, clarkb: ^^17:12
tristanCmordred: ha nice, makes more sense now :)17:12
*** daemontool has quit IRC17:13
mordredlet me extract that and just send a patch with that17:13
*** jcoufal has quit IRC17:13
tristanCshould I abandon https://review.openstack.org/#/c/272097/ then ?17:14
*** maishsk has joined #openstack-infra17:14
clarkbdepends, is that a setting nodepool can read natively already?17:15
clarkbif so then we should accept it17:15
*** vgridnev has joined #openstack-infra17:16
*** amotoki has joined #openstack-infra17:16
flaper87Is there a way (sorry for the dumb question) to group several patches from the same project (glance) so that they are run under 1 CI job (without merging them in a single patch and giving up authorship)? I'm interested in doing so for a group of patches that just fix typos and docstrings17:16
*** amotoki has quit IRC17:16
AJaegerflaper87: no, each will be tested separately17:16
*** [HeOS] has quit IRC17:16
clarkbyou can stack them though17:17
flaper87AJaeger: that's the current behavior and I take, from your answer, there's no way to have them run under the same job. too bad :(17:17
*** annegentle_ has joined #openstack-infra17:17
clarkbchildren are tested with their parent17:17
flaper87clarkb: I'm all ears17:17
flaper87or eyes?17:17
jeblairflaper87: if you did want to squash them, you could add "Co-Authored-By" headers17:17
*** scheuran has quit IRC17:17
flaper87clarkb: NICE!17:17
zaromorning17:18
anteayamorning zaro17:18
*** arthus has joined #openstack-infra17:18
flaper87jeblair: tbh, I believe these are just folks trying to get a free ticket to the summit. If I add Co-Author I'll have to request extra ATC and I don't want to spend time on that :P17:18
EmilienMmordred: works perfectly :) thanks17:18
AJaegerclarkb: but if you stack them, each is tested still separately, isn't it?17:18
jeblairflaper87: summit stuff should respect co-authored-by17:18
flaper87but stacking them sounds like simple enough17:18
cody-somerville617:18
cody-somervilleoops.17:18
flaper87jeblair: Ok, *that* I didn't know17:19
clarkbyes separate tests but the child test is for all of them together17:19
*** mrmartin has joined #openstack-infra17:19
fungijeblair: what summit stuff respects co-authored-by? we talked about it but no support was ever implemented anywhere17:20
*** zeih_ has quit IRC17:20
jeblairflaper87: we should check with fungi that's the case, but it's certainly the intention17:20
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Document clouds.yaml as the preferred configuration  https://review.openstack.org/27852917:20
*** jlanoux has joined #openstack-infra17:20
*** jcoufal has joined #openstack-infra17:20
mordredtristanC, clarkb, jeblair: ^^17:20
flaper87fungi: jeblair oh :(17:20
mordredmnaser: you too - since we also discussed this this moring ^^17:20
fungiright now neither the old nor new script scrapes commit messages, it just looks at gerrit's "owner" field17:20
openstackgerritFausto Marzi proposed openstack-infra/project-config: Set conditions for devstack-dsvm and python34 on freezer  https://review.openstack.org/27832317:20
flaper87mordred: what's clouds.yaml? /me ducks #trollmode17:20
jeblairfungi: what's the old and new script?17:20
* mordred picks up flaper87 and tosses him into the pool17:21
*** annegentle_ has quit IRC17:21
mnasermordred: how annoyed do you get by typos in docs :-P17:21
fungijeblair: old: http://git.openstack.org/cgit/openstack-infra/system-config/tree/tools/atc/email_stats.py new: https://review.openstack.org/26397117:21
fungiall based on gerrit change "owner" (so it's not even necessarily the author or committer of the commit which eventually merged, just the committer of the first patchset)17:22
mordredmnaser: well, I should probably fix them :)17:22
jeblairfungi: did you write the new script that way by choice?17:23
flaper87jeblair: fungi: can this be added in the new script? :D :D :D17:23
fungijeblair: what "way?"17:23
mnasermordred: done, thanks17:23
*** jcoufal has quit IRC17:23
jeblairfungi: tied so strongly to owner17:23
jeblairfungi: i mean, you called it 'owners.py'17:24
flaper87were there objections ?17:24
jeblairfungi: have you made a choice that only owners should be considered?17:24
fungijeblair: i wrote it for feature parity with the old script17:24
fungii'm perfectly happy for us to calculate electorate in new and different ways than we have in the past as long as there's sufficient official buy-in17:25
jeblairfungi: i believe we have always said that co-authored-by should be treated as equivalent as the author field17:25
jeblairfungi: it's what our documentation says, and the fact that our invite script omitted that was an oversight17:26
mordredbtw: https://review.openstack.org/278533 os-client-config patch removing HP and RunAbove for anyone who cares17:26
jeblairthough i really do remember fixing that _somewhere_17:26
*** burgerk_ has joined #openstack-infra17:26
fungijeblair: the reason we still rely on owner is that (in theory) the user must have had a valid foundation individual membership to be able to agree to the icla, while co-authored-by has no such guarantee17:26
anteayaah actually I never considered co-authored by equavalent to owner for elections17:26
jeblairfungi: we do not require that people sign the cla to be contributors17:27
anteayaI know it was discussed in the tc but then the solution was to include names in extra-atcs17:27
*** ifarkas has quit IRC17:27
anteayawhich was the reason for a very large patch to the extra-atcs file when it existed17:27
jeblairfungi: even before the changes... it is permissible to submit something on someone's behalf under certain circumstances17:27
fungijeblair: yeah, that was i guess one of those "best effort" things to attempt to meet the bylaws requirement for electorate to be foundation members in good standing17:27
*** dtantsur is now known as dtantsur|afk17:28
fungijeblair: there is, if i remember correctly, a script in the governance repo which scrapes co-authored-by for purposes of coming up with potential candidates for addition to the extra-atcs list (pending manual research of the foundation membership for each of them)17:28
*** jaosorior_ has quit IRC17:28
mordredthat is my understanding as well17:29
anteayathat was it17:29
jeblairfungi: right, though membership isn't required for summit passes17:29
*** doug-fish has joined #openstack-infra17:29
anteayayes and it resulted in a very large initial patch17:29
jeblairbut sommit passes have 'arbitrary' criteria17:29
*** burgerk has quit IRC17:29
zarofungi: willing to include this change for friday's gerrit maintenance? https://review.openstack.org/#/c/165228/17:29
anteayamembership is required for addition in extra-atcs17:29
mordredhttps://governance.openstack.org/reference/charter.html#voters-for-tc-seats-atc17:29
mordredActive Technical Contributors (“ATC”), which are a subset of the Foundation Individual Members.17:30
jeblairanteaya, mordred,  right17:30
jeblairwe're talking about a couple different things at once :)17:30
fungijeblair: true. summit registration discount codes for contributors follow requirements decided arbitrarily by the conference organizers, but traditionally they've been baed on people able to vote in the tc election (in recent cycles limited to a more recent period of activity though)17:30
*** burgerk_ has quit IRC17:30
mordredmy undersatnding is that the only folks who get automatic non-judgement-based passes are people who are ATCs, which implies foundation membership. additional people who do not meet that automatic criteria can also get passes, but those require extra-atcs judgement17:31
jeblairso here's what i'm getting at -- we either need to recognize co-authored-by as == author (and base our stuff on author); or change our docs to say "do not use co-authored-by" rather than "use co-authored-by"17:31
mordredwhich is why co-authored-by has been handled by the other script and a submission for extra-atcs17:31
*** matrohon has quit IRC17:31
maishskGood evening17:31
jeblairdetermining membership of co-authored-by is automatable17:32
mordredjeblair: I believe that if we can automate determining membership of co-authored-by, then I agree with your assessment17:32
maishskCan someone please have a look as to why https://review.openstack.org/#/c/278164/4 is not being checked ?17:32
jeblairmordred: i do not believe _i_ can automate it, but i believe the foundation can.  :(17:32
fungiyep, in theory we could get a lookup api in the foundation member system. i want to request it, but have a feeling it would need to be implemented in the openstackid-resources system which needs a server provisioned which needs openstackid running on a newer ubuntu release... yak shave. so i've avoided asking for that until i can free up time to do that other prerequisite work17:33
*** sdake has joined #openstack-infra17:33
maishskI would appreciate the help and explanation - so that I can hopefully deal with this myself next time17:33
mtreinishdims: which jobs are you looking for?17:33
fungiwhich i keep promising i'll work on and then not finding the time to do17:33
jeblairmordred: i could do, at most, a first pass that checks co-authored-by against change owners so that you would catch the ones that happen to have also submitted changes17:33
maishskI assume that I did something wrong there17:33
mordredjeblair: yes. I think that would work well on our side17:33
*** krtaylor has quit IRC17:34
jeblairfungi: indeed17:34
fungithat's a good point. compare to the list of all change owners (lookup from table by e-mail address)17:34
zarofungi: also i wasn't sure whether you were requesting me to do anything more than review the patches for project name change for this friday.  was there something else?17:34
*** EricGonc_ has quit IRC17:34
jeblairfungi: will the summit invite use the extra-atc script?17:34
mordredjeblair: however, I'm not sure what that would gain for this, since that person would already have the atc credit from being the owner of the different change17:34
fungijeblair: it uses the extra-atcs _file_ (or the extra-atcs data from the projects.yaml since it's moving/moved there)17:35
jeblairmordred: it may not be a current change17:35
*** davideagnello has quit IRC17:35
fungialso querying by owner takes us back to probably needing to dump an entire list of contributors if we want to catch people who were active as authors or co-authored-by but not owners of a change which merged within the qualifying period17:36
*** davideagnello has joined #openstack-infra17:36
*** piet has quit IRC17:36
jeblairfungi: so does that mean this round of summit invites will have co-authored-by via the extra-atc script?17:36
*** claudiub has quit IRC17:36
fungiwhich the rewritten script was explicitly avoiding in an attempt to make something which people can run without being a gerrit admin/root admin17:36
*** tiswanso has quit IRC17:36
fungijeblair: again, not sure what you mean by "via the extra-atc script"17:37
fungiit will have co-authored-by entries from the governance repo merged into the query results17:37
*** nadya has joined #openstack-infra17:37
*** nadya is now known as Guest1072017:37
*** hashar has quit IRC17:38
jeblair17:28 < fungi> jeblair: there is, if i remember correctly, a script in the governance repo which scrapes co-authored-by for purposes of coming up with potential candidates for addition to the extra-atcs list  (pending manual research of the foundation membership for each of them)17:38
jeblairfungi: that ^17:38
fungiit doesn't run the script from the governance repo to get them. ptls run that script and propose results they think are worthy of consideration as an extra atc based on co-authored-by credits in commits17:38
fungiand then the tc votes on their inclusion17:38
jeblairfungi: right, so does that happen in time for the summit invites?17:38
fungiif proposed and approved in time for them, sure17:39
anteayafungi: that data has now moved to projects.yaml, yes17:39
*** boris-42 has joined #openstack-infra17:39
fungithat's been the process so far anyway (for several cycles now)17:39
*** Swami_ has quit IRC17:39
jeblairso i can say to flaper87 that as long as he runs that script in a timely manner, co-authored-by people in his repos will end up as atcs17:40
jeblair?17:40
fungiyes17:40
jeblairit's not perfect but it's something :)17:40
anteayahe runs the script and creates a patch to governance yes17:40
fungiget it proposed to the governance repo and approved prior to feature freeze week17:40
jeblairwhew.  this was easy.17:40
fungiwe'll be sending a last batch of codes just after feature freeze17:40
*** fedexo has joined #openstack-infra17:40
*** fedexo_ has joined #openstack-infra17:41
*** claudiub has joined #openstack-infra17:41
anteayawhile we are on the topic if you want to get in on the fun early jeblair and mordred here is an addition of a cinder extra atc: https://review.openstack.org/#/c/278464/17:42
openstackgerritBob Ball proposed openstack-infra/project-config-example: Email notifications should only be for silent checks.  https://review.openstack.org/27854117:42
*** jed56 has quit IRC17:43
*** esikachev has joined #openstack-infra17:43
*** infra-re_ has joined #openstack-infra17:44
*** mrmartin has quit IRC17:44
*** kzaitsev_mb has quit IRC17:45
*** claudiub has quit IRC17:45
*** krtaylor has joined #openstack-infra17:45
*** rvasilets__ has joined #openstack-infra17:46
*** claudiub has joined #openstack-infra17:46
*** eharney has quit IRC17:47
*** infra-red has quit IRC17:47
*** tphummel has joined #openstack-infra17:48
*** jtomasek has joined #openstack-infra17:48
anteayaI have to go uptown and get better mousetraps17:49
anteayaI have learned what style just torture the mice, so I have that as a data point17:49
anteayaback later17:49
openstackgerritBob Ball proposed openstack-infra/project-config-example: Email notifications should only be for silent checks.  https://review.openstack.org/27854117:50
sdaguehey, infra folks, what's up with - https://jenkins07.openstack.org/job/gate-tempest-dsvm-full-ceph/7156/console  ?17:50
sdagueit's oddly hung17:50
sdaguethe whole gate is stalled behind it17:51
openstackgerritBob Ball proposed openstack-infra/project-config-example: Update recheck syntax to avoid the global namespace  https://review.openstack.org/27853717:51
clarkbsdague: the job timed out but jenkins hasn't been able to kill it17:52
*** rcernin has joined #openstack-infra17:52
clarkbI have seen a small number ~2 other cases of this in the lsat week but haven't been able to figure out why jenkins is not able to stop the job17:52
BobBallasselin_: Regarding the project list in layout.yaml; do you know if the zuul 'behaviour' where we had to list all projects has been changed?  I believe it was because depends-on changes expect the target project to be listed in zuul's config even if there are no jobs17:53
clarkbwe can likely work around it by having the internal timeout be more aggressive so the job ends itself17:53
AJaegerclarkb: jeblair and myself changed the internal timeout handling the last few days, do you want to double check the changes?17:55
asselin__BobBall, yes I remember there were some patches merged to zuul to fix that17:55
BobBallasselin__: Awesome - I won't propose an update to layout.yaml for that then :)17:55
sdagueclarkb: the job did end itself17:56
sdagueor tried17:56
sdague2016-02-10 14:25:32.840 | /home/jenkins/workspace/gate-tempest-dsvm-full-ceph/devstack-gate/functions.sh: line 1088: 19472 Killed                  timeout -s 9 ${REMAINING_TIME}m bash -c "source $WORKSPACE/devstack-gate/functions.sh && $cmd"17:56
clarkbsdague: it was still world dumping when the jenkins timeout kicked in17:56
clarkb15 minutes later17:56
clarkbish17:56
sdagueok, that command takes 2 seconds17:56
*** achanda has joined #openstack-infra17:57
sdaguewhich means something is horribly wrong17:57
sdagueis there any way to get on the node to get syslog or a kernel console?17:57
clarkbwe can try17:58
fungiUnable to download data from https://rubygem17:58
fungis.org/ - bad response Not Found 404 (https://rubygems.global.ssl.fastly.net/late17:58
fungist_specs.4.8.gz)17:58
fungigrr, stray newlines17:58
pabelangerAJaeger: no new info about the github replication issue?17:58
*** Swami has joined #openstack-infra17:58
fungiwe should consider caching that or making the bundler jobs non-voting17:58
sdaguebecause I feel like ceph vs. kernel is going on here17:58
sdagueand it would be good to figure out17:58
AJaegerpabelanger: I can't help with that at all since I don't have the needed access, please ask infra-root for help.17:59
*** dolphm has quit IRC17:59
rvasilets__fungi: Hi, I really didn’t want to make such an offensive proposal. I choose wrong words to bring my thoughts. We didn’t want to say anything bad about infra and infra efforts. I am going to fix proposal soon, sorry!17:59
*** tiswanso has joined #openstack-infra18:00
clarkbsdague: ssh is failing me, I can try a nova console-log18:00
clarkbit did manage to open a tcp connection but I am not getting a login18:01
sdagueclarkb: yeh, any bread crumbs we can get would be good18:01
*** armax has quit IRC18:01
*** derekh has quit IRC18:01
sdagueI really wonder if there was an oom killer event18:01
*** achanda has quit IRC18:01
*** w__ has quit IRC18:02
clarkbsdague: [ 2160.896598] INFO: task kworker/u16:1:98 blocked for more than 120 seconds.18:02
clarkbthere are a few of those18:02
*** shashank_hegde has quit IRC18:02
AJaegerpabelanger: did you merge any changes already to the repos?18:02
*** rossella_s has quit IRC18:03
pabelangerAJaeger: I did, but nothing that can't be reimported18:03
*** mrmartin has joined #openstack-infra18:03
*** dahoo has joined #openstack-infra18:03
clarkbsdague: magnum ran into similar on a different region (but same image)18:03
fungirvasilets__: i appreciate the apology. a lot of the benefits you pointed out in your description of rally-ci are in the process of being added to zuul v3, and we could certainly use some additional developers helping. see http://specs.openstack.org/openstack-infra/infra-specs/specs/zuulv3.html for a basic outline of what's changing18:03
AJaegerpabelanger: So, that means additional syncs failed as well...18:03
clarkbI wonder if that kernel is buggy18:03
*** rossella_s has joined #openstack-infra18:03
sdaguesame cloud ?18:03
*** ihrachys has quit IRC18:04
clarkbno18:04
pabelangerAJaeger: right. I was hoping a new commit would force a replication, but didn't work18:04
clarkbwas ovh18:04
clarkbthis is bluebox18:04
AJaegerfungi, clarkb: Can you help pabelanger, please? problem is: https://github.com/openstack/ansible-role-jenkins empty18:04
sdagueand we've forced off nested kvm, right?18:04
clarkbsdague: yes in devstack gate we force qemu18:04
*** sridhar_ram has joined #openstack-infra18:04
sdaguehmmm, ok18:04
*** esker has quit IRC18:04
*** zeih_ has joined #openstack-infra18:05
*** tiswanso has quit IRC18:05
sdagueclarkb: well, can you dump everything off nova-console to a file somewhere to look at it later?18:05
rvasilets__fungi: Thank you for the link I will look at the link and zuul v3 more carefully18:05
*** tiswanso has joined #openstack-infra18:05
sdagueand I guess can you hard kill the node and zuul will reset things?18:06
*** annegentle_ has joined #openstack-infra18:06
sdaguebecause all work is currently stopped on this18:06
clarkbsdague: it may reset things :) not sure I would count on it18:06
*** mrmartin has quit IRC18:06
sdaguewell, we should figure out what the recovery path is supposed to be here18:06
sdaguebecause our 2 different timeouts haven't managed to do it18:06
*** BobBall is now known as BobBall_AWOL18:07
fungiAJaeger: fixed. it was the usual github api call fail when trying to add permissions for gerrit to push. i just had to add gerrit to that repo manually in github and replication completed18:07
fungipabelanger: ^18:07
clarkbright because the machine is completely hosed. I bet jenkins is trying to tell its slave agent that the job should die so it can cleanup slave side18:07
clarkbhence the fail to stop the job18:07
sdagueright18:07
sdaguebut it's now something that's been seen more than once18:07
AJaegerfungi, there's a second repo: https://github.com/openstack/ansible-role-jenkins-plugins18:07
AJaegerfungi, thanks!18:07
AJaegerpabelanger, fungi: first repo looks fine now!18:08
*** krtaylor has quit IRC18:08
*** Sukhdev has quit IRC18:08
*** ociuhandu_ has joined #openstack-infra18:08
fungiadded there too18:09
pabelangergreat18:09
fungiwill take a moment for gerrit to realize and retry the push18:09
clarkbsdague: http://paste.openstack.org/show/486599/18:09
*** jaosorior has quit IRC18:09
clarkband delete is in progress, we shall see if it gets rescheduled or not18:09
AJaegerand has content now -thanks, fungi!18:09
funginp18:10
*** dkranz has quit IRC18:10
*** ociuhandu has quit IRC18:11
*** ociuhandu_ is now known as ociuhandu18:11
clarkbdelete is slow...18:12
*** achanda has joined #openstack-infra18:12
sdaguewhat is the swap setup here18:13
fungion ovh?18:14
*** w__ has joined #openstack-infra18:14
clarkbon ovh and bluebox I beliee it is the swap file18:14
clarkbwhich is sparse18:14
clarkbwe could try a preallocated file18:15
*** achanda has quit IRC18:15
*** yaume has quit IRC18:16
clarkbsdague: slave deleted18:16
*** thorst__ has quit IRC18:16
*** max_lobur has quit IRC18:17
clarkblooks like job stayed queued and didn't flip to aborted or failed so job will be rerun18:17
sdagueclarkb: yeh, sparse swap file could definitely be an issue, because if it goes after a block it can't get because there isn't space left18:17
*** jlanoux has quit IRC18:17
sdaguethat would explain something like this18:17
*** mrmartin has joined #openstack-infra18:18
craigeo/18:19
fungibasically memory exhaustion coupled with disk space exhaustion18:19
sdaguefungi: yeh18:19
*** yamamoto has quit IRC18:19
sdaguebecause this kind of hard stop is indicative of blocking io18:20
pabelangermordred: is there a way I can mock k5start with my local afs setup? using the same openstack.org directories?18:20
fungithe downside to preallocated means we're eating space on an already tight filesystem18:20
clarkbreally the ideal thing would be to not swap at all :/18:20
*** krtaylor has joined #openstack-infra18:20
sdaguefungi: right, but if you need the swap, you need it18:20
clarkb(and not have a swap device)18:20
clarkbmost of our jobs get away with it just fine18:20
*** e0ne has joined #openstack-infra18:20
fungii think we may have some jobs (grenade?) which can't function on 8gb less than the current size of the rootfs on ovh18:20
*** shashank_hegde has joined #openstack-infra18:20
sdaguelying to the server and telling it it has swap it does not actually have means it makes decisions based on it18:21
mordredpabelanger: uhm18:21
sdagueso we get there, then we wedge18:21
fungisdague: well, that's only a lie if the rootfs is almost full18:21
mordredjeblair: did we make krotscheck a principal for him to hack on mirrors?18:21
clarkbthere is a small minority like magnum and I guess ceph that dig into swap18:21
pabelangermordred: aside from me standing up my own kerbose server and enrolling afs into it18:21
sdaguefungi: sure, but, we see it's sometimes a lie18:21
mordredjeblair: I'm wondering if making pabelanger a principal that can write to a volume in our AFS is a good way to let him hack on the yum mirror18:21
*** rhallisey has quit IRC18:21
*** electrofelix has quit IRC18:22
sdagueand having it wedge the whole system until I come and tell you about it, doesn't feel very "continuous" :)18:22
fungiright, and as clarkb points out we have jobs which oom because 8gb ram is insufficient. maybe those jobs should create a swapfile and we should just drop swap across all workers instead18:22
sdagueespecially as it also prevents us from real post mortem18:22
*** cbader has joined #openstack-infra18:23
fungiunfortunately, the oom condition in at least some cases has a similar effect (machine becomes completely unreachable, drops from jenkins, zuul restarts job on new worker, loop ad infinitum)18:23
sdaguefungi: maybe they could, not sparsely allocating the swap seems like a thing which could be fixed today so we don't have non post mortemable jobs18:23
*** tzn has quit IRC18:23
openstackgerritClark Boylan proposed openstack-infra/nodepool: Show innodb status before dropping db  https://review.openstack.org/27814618:23
clarkbok that is actually locally tested against mysql and working18:24
clarkbgreghaynes: jeblair ^ I am probably goint to recheck that a few times and see if I can catch the error on the test slaves18:24
*** jbernard has joined #openstack-infra18:24
greghaynesclarkb: ++18:24
*** zeih_ has quit IRC18:25
*** dkranz has joined #openstack-infra18:25
clarkbsdague: I can make that change to d-g18:25
clarkbsince I basically already wrote it once18:25
sdagueclarkb: cool, thanks18:25
*** lucasagomes is now known as lucas-afk18:25
*** tzn has joined #openstack-infra18:26
sdagueclarkb: oh, interesting, zuul was smart enough to restart that test job18:26
fungiyeah, node deletion has that effect18:26
*** infra-red has joined #openstack-infra18:26
sdaguecool, that means if it passes, we get to land the 20 patches backed up behind it instead of restarting them all18:26
*** tzn has quit IRC18:26
*** tzn has joined #openstack-infra18:27
fungiunfortunately, also any job which consistently tanks in such a way as to cause the worker to die in flames has a similar effect18:27
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/27770218:27
*** slogan621 has joined #openstack-infra18:27
*** infra-re_ has quit IRC18:28
*** mriedem has quit IRC18:28
*** _tzn has joined #openstack-infra18:29
*** jordanP has quit IRC18:29
*** max_lobur has joined #openstack-infra18:29
*** tzn has quit IRC18:29
*** thorst_ has joined #openstack-infra18:30
lifelessAJaeger: sure18:31
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Preallocate swapfile  https://review.openstack.org/27855718:31
clarkbsdague: fungi ^18:31
clarkbnote we can also make the swapfile smaller if that helps, but 8G is what it was before and at least for magnum I think we need ~2G18:32
*** kdas_ has joined #openstack-infra18:32
fungiwe probably want to recheck that a bunch to make sure we get grenade runs in ovh/bluebox18:32
clarkbyup18:32
*** dkranz has quit IRC18:32
clarkband internap18:32
fungialso note there's a thread on the -dev ml about reducing the memory footprint of magnum's jobs18:32
fungiso maybe they don't actually need swap soon?18:32
clarkbthey did reduce their VMs to 1GB flavor18:33
clarkbwhich helps18:33
*** eharney has joined #openstack-infra18:33
*** ccrouch has quit IRC18:33
*** thorst_ has quit IRC18:34
clarkbtristanC: https://review.openstack.org/#/c/272097/3/nodepool/cmd/config_validator.py isn't a key that nodepool already knows about18:34
clarkbtristanC: so that is a noop change?18:35
*** kushal has quit IRC18:35
*** ashleighfarnham has joined #openstack-infra18:35
jeblairmordred, pabelanger: yeah, i'm down with creating a principal; we should either grant pabelanger perms in user/pabelanger, or, if we want to use the real paths, we should make sure to revoke those before production18:36
*** mriedem has joined #openstack-infra18:36
jeblairmostly just on principle18:36
jeblairi did it with group membership elsewhere, so it's easy18:36
jeblairmordred, pabelanger: oh -- note k5start is different with a user vs service principal18:37
clarkbtristanC: ya I can't find any way for that parameter to make it from the nodepool config to shade18:37
jeblairwe have keytabs for service principals; if you use k5start without a keytab, you'll get prompted for a password18:37
jeblairwe could probably set up pabelanger's principal with a keytab18:38
jeblairif that's important18:38
pabelangerjeblair: mordred: Okay, I'm not sure the best approach. OpenAFS still pretty new to me.18:38
jeblairif the password prompts are okay though, that would be easiest/best18:39
krotscheckmordred: Sortof. I have principal rights on /mirror/npm, but I forgot the credentials18:39
AJaegerteam, I have a policy question for you regarding the PTI: We discussed a few weeks ago to add a linters job so that projects can use that instead of pep8 - and first projects already use that like keystone and bandit. But PTI mentions pep8, so should I update the PTI somehow?18:39
*** vilobhmm11 has joined #openstack-infra18:40
pabelangerjeblair: Ya, password work for now. until I puppetize everything18:40
jeblairAJaeger: yes.  keystone and bandit are out of policy.  those changes should not have been approved.18:40
*** MarkAtwood has quit IRC18:40
jeblairAJaeger: i would go so far as to say they should be reverted18:40
*** sridhar_ram is now known as sridhar_ram_afk18:40
*** vilobhmm11 has left #openstack-infra18:40
jeblairAJaeger: what problem was trying to be solved?18:41
AJaegerjeblair: then I totally misunderstood the discussion we had a few weeks ago here ;(18:41
*** annegentle_ has quit IRC18:41
clarkbmordred: commnted on https://review.openstack.org/#/c/278529/118:42
* AJaeger tries to find logs from that discusion..18:42
jeblairAJaeger: it's *very* important that projects follow that interface.  the pep8 job does more than just run pep8.18:42
fungii think the two main goals from that were to combine multiple static analysis jobs for a slight additional efficiency, and also to get rid of the potential confusion around having a "pep8" tox environment that runs all sorts of things and not just pep8/flake818:43
*** mrmartin has quit IRC18:43
jeblairyeah, but by doing that without adjusting the pti means we're not testing tarball builds of keystone anymore18:43
AJaegerjeblair: discussion starting here http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2015-12-21.log.html#t2015-12-21T19:10:2918:43
fungibut yeah, before moving to projects adhering to the pti the pti should have been amended/updated with that18:43
*** ashleighfarnham has quit IRC18:43
*** jsavak has quit IRC18:44
*** armax has joined #openstack-infra18:44
AJaegerjeblair: why not anymore tarball builds?18:44
jeblairAJaeger: because that's done by run-pep818:44
*** sridhar_ram_afk has quit IRC18:44
*** samueldmq has joined #openstack-infra18:45
samueldmqhi18:45
samueldmqis there any kno issue with stackalytics.o.o ?18:45
samueldmqlast time it was updated was 28 Jan18:45
samueldmqknown*18:45
slogan621https://review.openstack.org/#/c/275873 - any approvers willing to take a look? Thanks!18:46
pabelangersamueldmq: looks like it, I can see what is going on18:46
*** cbader_ has joined #openstack-infra18:46
pabelangersamueldmq: it currently isn't production, so might not be getting the love it needs18:46
jeblairAJaeger: projects must adhere to the pti so that we can make changes like this globally.  it's our *interface* to running tests for the projects.  we can make the changes you're talking about, but we need to do it with care.  for openstack projects we don't just run whatever people tell us to.  we make some guarantees about what is run and how.18:46
samueldmqpabelanger: :(18:47
jeblairAJaeger: can you take care of reverting those?18:48
AJaegerjeblair: ARgh, wished I had that advise before Christmas when we discussed it.18:48
samueldmqpabelanger: I got it, there are other priorities18:48
pabelangersamueldmq: looks like stackalytics-processor is hung18:48
AJaegerjeblair: I can take care of cleaning up.18:48
AJaegerjeblair: but before reverting, I'd like to discuss whether there's a clear path forward - or whether I should revert and bury it.18:48
pabelangersamueldmq: well, we still need to get a migration plan in place to retire stackalytics.com. There are still some dependency on it18:49
jeblairAJaeger: thanks.  sorry i did not see that discussion then.  i have a vague recollection of it happening, but my perception was that you wanted to test it out in project-config.18:49
*** dkranz has joined #openstack-infra18:49
clarkbso thats interesting, I just got google results for gerrit changes18:50
pabelangersamueldmq: once we can schedule the migration, it shouldn't take too long18:50
clarkbI wonder if indexing is part of our memory and 500ing woes18:50
samueldmqpabelanger: is stackalytics.com maintained by openstack-infra ,18:50
samueldmq?18:50
*** cbader has quit IRC18:50
pabelangersamueldmq: no, mirantis.18:50
tristanCclarkb: well it get evaluated here http://git.openstack.org/cgit/openstack-infra/shade/tree/shade/openstackcloud.py#n12718:50
*** yamamoto has joined #openstack-infra18:50
*** eharney has quit IRC18:50
pabelangersamueldmq: that's one of the reason for stackalytics.o.o18:50
pabelangersamueldmq: we just haven't made the switch yet18:50
*** baoli_ has quit IRC18:51
pabelangersamueldmq: http://lists.openstack.org/pipermail/openstack-infra/2016-January/003627.html18:51
AJaegerfungi, jeblair: Do you see a way forward - or should I revert?18:51
tristanCclarkb: and iirc, trying to use master of nodepool with shade-1.4.0 is not possible because shade throws KeyError when the setting is not there, and nodepool will not validate the configuration is the setting is there18:51
samueldmqpabelanger: okay so the plan is to make stackaylytics.o.o more stable and ask miratis to remove their own?18:51
clarkbtristanC: via cloud config, not via nodepool config18:51
* samueldmq 's looking18:51
tristanCclarkb: that is without any clouds.yaml18:51
jeblairAJaeger: i think there is a path forward -- adjust the pti,  propose the new environment to all of the projects, then adjust project-config.  but the things we are doing for pep8 must still be done in the new linters job too18:51
clarkbtristanC: so you can add that to the nodepool config but it won't be used18:52
jeblairAJaeger: it will be a big, long, slow process.18:52
tristanCclarkb: there may be something else, all I know is that this patch make nodepool work again for me (+ the new param in my nodepool.yaml)18:52
clarkbtristanC: I just don't see how it can, all that is saying is if you validate the config allow this key18:53
fungiAJaeger: right, i agree with what jeblair said. for official projects this needs to be a coordinated transition for which the next step is updating the defined standard18:53
clarkbbut nothing from what I can see ever passes that key from nodepool config to shade18:53
samueldmqpabelanger: okay, thanks for the updates18:53
fungis/official/projects attempting conformance wit the pti/18:53
pabelangersamueldmq: yes, we have an infra-spec to do that. stackalytics.o.o is fully managed by puppet now, and under the control of -infra.  However, some minor things like maintenance and upgrades that need to be resolved. My understanding is stackalytics.com does that manually18:53
jeblairAJaeger: (you don't need to revert the change to have project-config use linters -- it's not subject to the pti)18:53
AJaegerI see ;( So, possible - but so much work that it's not worth it, correct?18:53
samueldmqpabelanger: nice, unfortunately I can't commit part of my time to help on that :(18:53
pleia2anteaya: just saw your earlier question re: wikimedia, they're an organization, not an open source project, maybe mediawiki (which IS the open source project) has an open infra, but I don't know and I don't know where I'd find it18:54
AJaegerjeblair: reverting for project-config is the most trivial one - but thanks ;)18:54
tristanCclarkb: I could look into that, but it seems like I should better switch to this new cloud.yaml configuration18:54
clarkbtristanC: thats the way I would expect it to work :)18:54
jeblairAJaeger: i don't know whether it's worth it or not.18:54
*** thorst_ has joined #openstack-infra18:54
clarkbtristanC: it is possible we dump the entire key space for provider config into shade as kwargs18:55
clarkblet me check that18:55
fungiAJaeger: it's not been worth it to anyone so far, to the point where effort has been invested to get it done, but that's not to say it's not worthwhile to someone18:55
fungier, double-negative18:55
fungiit's possible it may be worthwhile enough to someone that they're willing to invest the effort to go through the (long and arduous) process to make it happen18:56
clarkb_cloudKwargsFromProvider(provider) seems to filter out the list18:56
AJaegerSo, a slow migration is not really possible? Meaning offering it as an alternative? ;(18:56
fungiAJaeger: i think the best argument for doing it is so that developers can know that by running `tox -e linters` they're guaranteed to get all the important static analysis checks performed rather than having to run a bunch of different commands and know which ones are important to a particular project and which aren't18:57
jeblairAJaeger: i think it could be phased, but i think we would want to make the transition as quickly as possible for our own sanity.18:58
*** bpokorny_ has joined #openstack-infra18:59
*** pvaneck has joined #openstack-infra18:59
AJaegerfungi: I'm currently frightened that continuing I will have a lot of work and therefore ask whether it can be done in a reasonable way - without becoming insane ;/18:59
*** thorst_ has quit IRC18:59
*** Guest10720 has quit IRC18:59
*** bpokorny_ has quit IRC18:59
fungiAJaeger: a perfectly reasonable concern. certainly don't volunteer for things you don't think you'll have time to do18:59
AJaeger;)18:59
*** bpokorny_ has joined #openstack-infra19:00
fungion the scale of important problems we need solved within openstack, that one is probably pretty far down the list19:00
*** achanda has joined #openstack-infra19:00
tristanCclarkb: http://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/config.py#n141  wouldn't that copy the whole object ?19:00
*** annegentle_ has joined #openstack-infra19:00
*** mrmartin has joined #openstack-infra19:01
*** annegentle_ has quit IRC19:01
*** w_ has joined #openstack-infra19:01
AJaegerfungi: yeah, it might be easier to explain a few more times that bandit, bashate, and other linters should be in pep8 instead of pushing it through...19:01
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add job tags  https://review.openstack.org/27798119:01
clarkbtristanC: yes but that isn't what we pass to OpenStackCloud19:01
*** annegentle_ has joined #openstack-infra19:01
clarkbtristanC: we pas a cloud_kwargs thing that comes from _cloudKwargsFromProvider(provider) which filters out a specific set of args19:02
*** doug-fis_ has joined #openstack-infra19:02
*** EricGonczer_ has joined #openstack-infra19:02
*** bpokorny has quit IRC19:02
fungiAJaeger: well, also there is a good reason to have separate tox envs for those things while they're in the process of being phased in, since a project might want separate job results for bandit, or to be able to make bandit's results visible but non-voting while they're working on getting compliant without making their other linters non-voting19:03
*** eharney has joined #openstack-infra19:03
tristanCclarkb: oh ok, well nevermind. I'll try again without that patch to track how the config is processed. Thank for the review though!19:03
clarkbI have to say, figuring out why swift uploads to rax still don't work really makes me dislike the number of layers between client and get a token19:03
*** w__ has quit IRC19:03
openstackgerritPaul Belanger proposed openstack-infra/puppet-stackalytics: Setup logging for stackalytics-processor  https://review.openstack.org/27856719:04
clarkbnodepool -> shade -> openstack client config -> keystone auth with some swift client mixed in19:04
fungiAJaeger: though i still think that adding the new linter and at the same time adding skips/overrides fro everything it's failing on is a better approach, then you can peel back individual skips/overrides incrementally in later patches19:04
*** daemontool has joined #openstack-infra19:04
*** zeih_ has joined #openstack-infra19:04
*** doug-fi__ has joined #openstack-infra19:04
pabelangersamueldmq: that should help debug the failure with stackalytics.o.o ^19:05
*** doug-fish has quit IRC19:05
AJaegerfungi: sure, non-voting bandit is valid...19:06
tristanCclarkb: on that subject, note I'm able to run zuul without swift connection, providing a known temp_url_key and storage_url... the code is actually missing a condition as proposed here: https://review.openstack.org/#/c/270338/19:06
*** doug-fis_ has quit IRC19:06
jeblairclarkb: wasn't notmorgan working on the keystoneauth/swift thing?19:06
*** EricGonc_ has joined #openstack-infra19:07
samueldmqpabelanger: what does Signed-off-by mean?19:07
samueldmqpabelanger: firt time I see that19:07
*** sridhar_ram has joined #openstack-infra19:07
pabelangersamueldmq: nothing, just a habit of doing git -s19:08
clarkbjeblair: he was going to add sessions to swiftclient19:08
fungisamueldmq: http://docs.openstack.org/infra/manual/developers.html#using-signed-off-by19:08
mordredpabelanger: there is a fellow in #ansible who has the sads because he wants to use the os_ modules in ansible 2.0 but that requires shade and he's on rhel7 and there are no rpms for shade and pip installing shade breaks other things he has installed via rpms19:08
clarkbjeblair: I am trying to fix it given the current state of software19:08
pabelangersamueldmq: one day well support gpg keys :)19:08
mordredpabelanger: I told him I knew a person who did packging that I would ping about it19:08
*** thorst_ has joined #openstack-infra19:08
*** jsavak has joined #openstack-infra19:08
fungipabelanger: what do you mean by "one day"?19:08
clarkbit looks like keystoneauth gives its plugins discretion on whether or not a new token should be issued19:08
*** zeih_ has quit IRC19:08
clarkbso we don't really have control to say "give me a new token really I mean it" despite remaking our client object19:08
fungipabelanger: you can already do git commit -S and push the result up for review, no problem19:08
*** doug-fi__ has quit IRC19:09
pabelangermordred: indeed. I'm trying to get the required os-client-config for rawhide now.19:09
jeblairclarkb: okay, is it worth checking in with notmorgan to find out if that is imminent?19:09
pabelangermordred: what that is done, I'll be backporting into epel719:09
clarkbjeblair: it is worth checking in but I seriously doubt that swiftclient changes + oscc changes + shade changes will get in any time soon19:09
pabelangerfungi: Wait, our workflow support signed commits?19:09
pabelangerI didn't know that19:09
clarkbmostly because swift will probably not like the change in deps19:09
pabelangermaybe I am confusing it with tags19:09
*** xyang1 has quit IRC19:09
fungipabelanger: anyway, the signed-off-by header has a completely different implication (acknowledgement of the dco) than signed git commits19:09
fungipabelanger: see the url i linked about it for samueldmq19:10
mordredpabelanger: awesome! thanks19:10
notmynameclarkb: those cranky swift devs. always getting in the way ;-)19:10
*** EricGonczer_ has quit IRC19:10
clarkbnotmyname: I just set my expectations based on previous attempts at changing similar things in swiftclient19:10
notmynameclarkb: in seriousness, though, we (swift devs) do want the keystone session support in swiftclient19:10
pabelangerfungi: ya, reading now19:10
*** _tzn has quit IRC19:11
AJaegerjeblair, fungi: See we have 383 repos using pep8 right now ;(19:11
clarkbnotmyname: ok thats good to hear. Last time I pushed a change to swiftclient to do keystone things I got much fire and brimstone19:11
clarkbbecause swiftclient very much prefers its basic auth or something19:11
samueldmqpabelanger: fungi: thanks, good to know19:11
clarkbthats what it was, I wanted it to install keystoneclient by default since you know openstack19:11
fungipabelanger: but `git commit -S` (capital S) does commit signing with an openpgp key and gerrit will accept the resulting signed commit just fine19:11
*** thorst_ has quit IRC19:12
pabelangerfungi: Nice. TIL. Going to give it a try19:12
fungithough i don't think it supports any sort of validation of the signature, nor even displays it. you'd still need to retrieve the commit to check the signature if you were so inclined19:12
*** thorst_ has joined #openstack-infra19:12
clarkbbut I guess if keystoneauth goes in like client where it isn't actually installed automagically maybe that won't be a problem19:12
*** dpaterson has joined #openstack-infra19:12
*** w_ has quit IRC19:14
*** w_ has joined #openstack-infra19:14
*** w_ has quit IRC19:15
clarkbnotmyname: jeblair the other concern is that we may not actually correct things with direct session support, since I basically hacked the whole get me a new token process into shade for iamge uplodas except it isn't working19:15
clarkboh wait I see why19:15
daemontoolanyone available to review https://review.openstack.org/#/c/278323/19:16
clarkbbecause there are actually many api calls that happen over time (potentially) from that one python function call19:16
clarkbso hacky thing may still timeout, sessions should fix that particular thing19:16
AJaegerwould ansible also violate the PTI? They're using linters now but are they a python project under PTI?19:16
mordredAJaeger: I'm not sure they are a python project, tbh19:17
*** rpioso has joined #openstack-infra19:17
*** fedexo_ has quit IRC19:17
*** fedexo has quit IRC19:17
*** bpokorny_ has quit IRC19:17
mordredI think the language they write in is "ansible" - and ansible happens to be written in python - there are many things about their setup that don't make sense in the PTI19:17
*** bpokorny has joined #openstack-infra19:18
mordredbut I do think that's getting into a grey-ish area19:18
*** jdurgin has joined #openstack-infra19:18
mordredclarkb: oh - it looks like I missed a fun dicsussion about seesions19:18
clarkbmordred: well just wrapping my brain around why the hack in shade isn't reliable and I think I sorted it out19:19
mordrednotmyname: I added it to a few other client libs - I'd be happy to work you up a patch if it's a thing you're interested in receiving19:19
clarkbit is because we only reup the token before doing all of the operations, those operations don't all happen at once and happen over time19:19
clarkbsessions should reup for each one if done properly19:19
dpatersonmordred, rpioso: I've been assist my associate rpioso with some difficulty he is having with pbr and packaging.19:19
mordredclarkb: yah19:19
mordreddpaterson: uhoh19:20
* mordred hides19:20
dpaterson:)19:20
rpiosomordred: Nice to meet you.19:20
clarkbmordred: so my shade hack helps but isn't complete19:20
dpatersonrpioso: please describe the issue19:20
notmynamemordred: thanks. the people to work with on the swift side are timburke and joeljwright19:20
mordrednotmyname: cool! I shall put it on my list and then poke them19:21
notmynamemordred: both have expressed interest and willingness to see that done in swiftclient, but they don't know much about how to. that's the barrier right now, I think19:21
AJaegerfungi, jeblair: So boils down to these two options:19:21
AJaeger1) Updating PTI, 2) fixing linters job to do the same as pep8, 3) adding linters to python-jobs with lots of skips/non-voting, 4) updating official repos to have linters target that does pep8 job on master (not on stable), 5) removing pep8 and skips/non-voting19:21
AJaegerPlan B: 1) Revert changes for bandit, keystone 2) Remove linters job from python-jobs in jenkins . Leave ansible, system-config, project-config as is (using linters)19:22
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Modify test workaround for extra_dhcp_opts  https://review.openstack.org/27843819:22
AJaegerCorrect?19:22
* nibalizer shakes the collection tin on https://review.openstack.org/#/c/234535/1119:22
mordrednotmyname: cool - I know a bunch about it - but am not in a position to have an interest in it being done in swiftclient19:22
mordrednotmyname: so it sounds like a good match :)19:22
clarkbthere should be lots of prior art too19:23
daemontoolclarkb,  thanks, anyone can +A please https://review.openstack.org/#/c/278323/19:23
rpiosodpaterson, mordred: In the package I'm building, I would like to include a script (Py module with name equal to __main__ ) that is not inside of a Py package. I haven't been able to find doc on how to do that with pbr.  Is it possible?19:24
SpamapSmtreinish: hah, mysql 5.6 allows you to have bigger indexes now btw https://dev.mysql.com/doc/refman/5.6/en/innodb-parameters.html#sysvar_innodb_large_prefix19:24
mordredrpioso: hrm. I believe so - one sec19:25
SpamapSmtreinish: glad we got rid of all those big indexes before that arrived ;)19:25
lifelessrpioso: should be the same as getting setuptools to do it19:25
lifelessrpioso: I don't think we specifically break that in any way19:25
mtreinishSpamapS: heh, nice :)19:25
AJaegerjeblair, fungi : Can you confirm? Then I would choose plan B.19:26
lifelessjd__: whats a project that uses etc files? nova doesn't have any19:26
openstackgerritMikhail S Medvedev proposed openstack-infra/system-config: Add #openstack-third-party-ci to channel logging  https://review.openstack.org/27857419:26
mtreinishSpamapS: heh, subunit2sql is running on 5.6.1719:26
lifelessah, neutron19:26
mordredlifeless: good - you're here - I haven't tried that in forever19:27
clarkbjeblair: https://review.openstack.org/#/c/277941/ would be a good one to get into nodepool soon19:27
*** jpr has quit IRC19:27
clarkbmordred: also I commented on your nodepool docs change, if we can address those items I will happily fast approve19:28
*** abregman is now known as abregman|afk19:28
lifelessdstufft: oh wow19:28
lifelessdstufft: pip wheel now outputs  to . by default?19:28
fungiAJaeger: yeah, i think those are basically our two options. if we do option "b" now, someone interested in option "a" later can always pick up the torch and work on implementation19:28
AJaegeroh, kolla, kolla-mesos, ekko, steht, also use linters19:28
*** jsavak has quit IRC19:28
mordredclarkb: cloud in nodepool does not refer to a profile. it refers to a cloud19:29
dstufftlifeless: hm does it? I remember talking aobut it but I don't remember what happened19:29
mordredclarkb: a "profile" is a named vendor19:29
clarkbmordred: I thought we explicitly renamed all that stuff because that was confusing19:29
mordredclarkb: we did- just the opposite way of how you're thinking19:29
clarkbah19:29
lifelessdstufft: can you remember the status of /etc handling in wheels ?19:29
clarkbmordred: ok, then just pointing at oscc docs for "this is what the thing is and where it can live" and addressing the ipv6 thing19:30
mordredclarkb: "rackspace" is a profile that the cloud "rax" has in our config19:30
mordredclarkb: yes19:30
lifelessdstufft: I'm just looking at https://review.openstack.org/#/c/274077/5 closely, and my recollection is that wheel doesn't support /etc as a thing19:30
*** electrofelix has joined #openstack-infra19:30
clarkbmordred: nodepool will actually internally set a nodes ip attribute in the db and elsewhere to the ipv6 addr with that flag set19:30
dstufftlifeless: /etc no, it supports data_files which are installed relative to sys.prefix (which sadly, is different then how they are treated in setuptools....)19:30
mordredclarkb: so - ipv6-preferred is also shade thing19:30
mordredclarkb: but you are right, we are not using that yet19:30
clarkbmordred: its also a nodepool thing19:30
mordredclarkb: so I'll fix it19:31
dstufftbut the same to how it is treated in distutils19:31
mordredclarkb: once we do shade-nodepool it will be an occ thing19:31
*** mrmartin has quit IRC19:31
*** infra-re_ has joined #openstack-infra19:31
mordredbecause it controls what gets set into the interface_ip field of the server metadata which is where nodepool will pull the value to store in the db19:31
clarkbmordred: nodepool will lilkely need to special case that but it can read the value from cloud config19:31
mordredhowever, your review is correct as nodepool exists today19:31
mordredclarkb: I see no reason why nodepool would need to special case tht19:32
clarkbmordred: oh gotcha that is even ebtter on the shade - nodepool interaction19:32
mordredphew19:32
mordredI thought I'd missed something major :)19:32
clarkbmordred: I was expecting shade to still return ipv4 and nodepool would have to sort between all the adrds19:32
clarkbwhich is basically what it does today19:32
*** jsavak has joined #openstack-infra19:33
*** rockyg has joined #openstack-infra19:33
notmorgan jeblair yes. Just slow going. If someone else picks it up, all good.19:33
lifelesssdague: remind me; did nova go to a model of having no files needed in /etc by default ?19:34
sdaguelifeless: no19:34
*** hashar has joined #openstack-infra19:34
mordredclarkb: yah - turns out sorting through the addrs is hard19:34
clarkbmordred: fwiw after talking to zxiiro last night I really really think the next item to solve in neutron API is the whole "public" vs "private" distinguishing19:34
jeblairclarkb: +2 with comments19:35
mordredclarkb: ++19:35
mordredclarkb: very much so19:35
*** infra-red has quit IRC19:35
openstackgerritMonty Taylor proposed openstack-infra/nodepool: Document clouds.yaml as the preferred configuration  https://review.openstack.org/27852919:35
mordredclarkb: ^^ updated19:35
clarkbjeblair: thanks19:36
*** achanda has quit IRC19:36
lifelesssdague: hmm, I didn't see any etc files in nova's setup.cfg19:36
rpiosolifeless: For a Py script named foo, I tried http://pastebin.com/Rx6aZNyw, but it didn't work.19:37
sdaguelifeless: you are assuming pip install nova is all you need for a running nona19:37
sdaguewhich is not true19:37
lifelesssdague: I'm not assuming anything actually - I'm looking into what we're doing in projects in response to a pbr patch19:38
*** daemontool has quit IRC19:38
lifelesssdague: and thus asking you stuff :)19:38
sdaguelifeless: ok19:38
lifelesssdague: the pbr patch adds a sysconf-dir option, which wheel doesn't support19:38
lifelesssdague: and I'd like, if I end up saying 'no, we really can't do this', to be able to say 'this is what nova does, copy them' (if thats sensible)19:38
lifelesssdague: so, what does nova do ?19:39
sdaguesome number of months ago I was waved off the idea of making the servers installable19:39
sdaguerequire another installer: i.e. devstack, puppet, ansible, etc....19:39
*** hdd has quit IRC19:39
sdaguelike all our server projects19:39
AJaegerjeblair, fungi : I drafted an email before sending out patches: https://etherpad.openstack.org/p/C2CWVcO7dz - will that one work?19:39
clarkbmordred: I was going to fast approve but two other reviewers were faster than me19:40
jd__lifeless: gnocchi at least19:40
jd__lifeless: and I get beaten by packages for not having a way to put them in the right directory19:40
jd__s/packages/packagers/19:40
mordredlifeless: I agree with sdague, btw19:41
AJaegerjeblair, fungi, feel free to edit19:41
sdaguemordred: agree with what? Because I think it actually sucks that we can't do a real install from python19:41
mordredsdague: well, it may suck, but it's the case as it is due to how wheels work19:41
mordredsdague: oh - nevermind - I agree with your characterization19:42
sdaguemordred: right sure, it's the way things are.19:42
mordredsdague: I misread a connecting word in your sentence19:42
sdagueit makes me sad19:42
sdaguebecause I'd really like to live in a universe where we could make pip install nova a thing19:42
*** doug-fish has joined #openstack-infra19:43
clarkbfungi: sdague https://jenkins07.openstack.org/job/gate-grenade-dsvm-multinode/2740/ is an ovh grenade run with preallocated swapfile19:44
mordredso ...19:44
mordredsdague: I have a suggestion for that - but it might be weird19:44
mordredsdague: put your example /etc files into the nova package as pacakge data19:44
*** achanda has joined #openstack-infra19:45
*** rajinir has quit IRC19:45
mordredsdague: then include a command that is "nova-init-config" that will write those files into /etc/nova19:45
clarkbthere are currently 50GB of disk avaiable on /19:45
mordredsdague: the main problem is that pip doesn't have a way to track files specifically19:45
mordredsdague: so if pip always installed the files, you'd get file clobbers on upgrade19:45
jeblairmordred: i like that idea (the command should of course be careful not to overwrite them)19:45
sdaguemordred: right, it just all seems kind of wonky19:45
mordredif you had config management lay down the files in the first place19:45
mordredsdague: pip is and never will be an actual package manager - you need apt or yum for that19:46
lifelessmordred: pep 491 will help19:46
sdaguethere is also the issue of building packages from this19:46
lifelessmordred: pip tracks the files19:46
mordredsdague: but - a one-command "please write out things that a package manager would normally write out" - is _less_ wonky than ont being able to do it at all19:46
sdaguewhich means you need the ability to reroot it all19:46
lifelessmordred: it toally does19:46
jeblairmordred: we could do that for gertty too...19:46
nibalizermordred: haha so use an install wizard?19:46
sdaguesound like a good pbr extension, no?19:46
lifelesssdague: possibly yes19:47
mordredlifeless: sure - but it doesn't so much have apt/yum like facilities to say "hey, you changed this file I want to write, do you want me to overwrite?"19:47
sdagueI honestly don't want to invent a custom hack locally in nova19:47
openstackgerritCraig Vyvial proposed openstack-infra/project-config: run trove experimental run scenario tests  https://review.openstack.org/27809519:47
mordredsdague: I also don't want you to do that19:47
mordredsdague: I agree with lifeless - possibly yes19:47
*** krotscheck is now known as krotscheck_dcm19:47
sdaguebut if something showed up in pbr that allowed for such a thing, adding the pbr config to do it would be nice19:47
*** abregman|afk is now known as abregman19:47
sdagueand I'd love to live in a world where that was a real thing you could do19:48
mordredjeblair: I thnk the command should by default not overwrite them - but also have a --force flag19:48
*** Sukhdev_ has joined #openstack-infra19:48
mordredsdague: you and me both19:48
jeblairmordred, lifeless: gertty has several alternate example config files; selection of which might be nice; but if that's too much, would probably just install the full reference one with all the options...19:48
slogan621what are these notifications from openstackgerrit bot triggered by, like the one above at 11:4719:48
slogan621?19:48
* slogan621 is a newbie19:48
mordredslogan621: openstackgerrit watches the gerrit event stream19:48
jeblairslogan621: the one at 19:47 UTC was triggered by the gerrit event stream19:49
mordredslogan621: https://review.openstack.org/Documentation/cmd-stream-events.html19:49
AJaegerjeblair, fungi : should I send that email as is?19:49
slogan621thanks19:49
jeblairAJaeger: wfm19:49
* slogan621 reads19:49
fungiAJaeger: sorry, looking now. i'm having about 10 different conversations at once19:50
*** electrofelix has quit IRC19:50
AJaegersorry, fungi. Thanks, jeblair.19:50
fungiAJaeger: corrected one minor typo: conversation->conversion19:51
*** matrohon has joined #openstack-infra19:51
fungiotherwise lgtm19:51
fungisend at your leisure19:51
dmsimardDoes openstack-infra still have a puppetboard instance ?19:51
dmsimardThe link I found was puppetdb.openstack.org but that doesn't seem to work.19:52
fungidmsimard: surprisingly, at http://puppetboard.openstack.org/19:52
AJaegerthanks, fungi19:52
dmsimardfungi: doesn't load for me :(19:52
fungidmsimard: ...for some definitions of "have" i guess. it was working yesterday19:52
*** notnownikki has quit IRC19:52
mordredit also does not work for me19:53
funginow it's taking a while and eventually throwing an internal server error19:53
mordredfungi: maybe we need to restart java?19:53
dmsimardfungi: yeah I actually *just* got the internal server error19:53
*** ociuhandu has quit IRC19:53
fungilast time i saw this, there was a corrupt report file which was causing it to fail to load19:53
rpiosolifeless: Resending, ...  For a Py script named foo, I tried http://pastebin.com/Rx6aZNyw, but it didn't work.19:54
*** ccrouch has joined #openstack-infra19:54
*** mrmartin has joined #openstack-infra19:54
rpiosolifeless: Am I specifying it correctly?19:55
*** esikachev has quit IRC19:55
*** doug-fish has quit IRC19:55
fungidmsimard: mordred: cpu usage is spiking up pretty high briefly, but system load average is not bad, memory consumption and disk utilization look under control, et cetera19:56
fungiaccording to cacti19:56
fungino indication of a recent oom in dmesg output, puppetdb log isn't filled with errors19:56
*** esikachev has joined #openstack-infra19:56
dmsimardwsgi/apache error logs ?&19:56
fungithat's where i'm looking next19:56
fungiworking my way up the stack there19:57
*** jgriffith is now known as jgriffith_away19:57
fungi[Wed Feb 10 19:57:19 2016] [error] ERROR:pypuppetdb.api:Could not reach PuppetDB on localhost:8080 over HTTP.19:57
fungiyeah, that's no good19:57
openstackgerritMerged openstack-infra/system-config: Add infracloud playbook  https://review.openstack.org/23453519:58
funginothing listening on 8080/tcp locally19:58
*** eliqiao_ has quit IRC19:59
openstackgerritBrant Knudson proposed openstack-infra/project-config: Revert "Support stable requirements"  https://review.openstack.org/27858819:59
*** nadya has joined #openstack-infra20:00
*** nadya is now known as Guest613720:00
*** rfolco has quit IRC20:01
fungithough that goes back periodically as far as we have logs20:01
fungiwhich i think means puppetdb is "down" from time to time?20:01
*** arthus has quit IRC20:02
*** doug-fish has joined #openstack-infra20:02
*** eliqiao_ has joined #openstack-infra20:02
crinklefungi: I don't think puppetdb was ever running on 8080 http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/puppetdb.pp#n2420:02
fungiweird, then i wonder why puppetboard is trying to reach that?20:03
crinklenibalizer: ^ ?20:03
fungioho! now i see it listed again20:04
fungiand puppetboard is working again20:04
fungivery strange20:04
*** Guest6137 has quit IRC20:04
fungialso odd is its socket implementation20:04
fungitcp6       0      0 127.0.0.1:8080          :::*                    LISTEN20:04
fungithat seems... contradictory?\20:04
fungishouldn't that be tcp 127.0.0.1:8080 and tcp6 ::1:8080?20:05
*** Sukhdev_ has quit IRC20:06
clarkbhttp://paste.openstack.org/show/486620/ caught a hung nodepool test on db delete20:06
clarkbrealize I should record the name of the schema we are dropping so will add that to my change20:06
clarkbmordred: ^ that may be less indecipherable to you, but looks like posibly we are creating an index on a table and that has it hung up?20:07
lifelessrpioso: that seems incomplete20:08
nibalizerpuppetboard listens locally on 808020:08
nibalizerunauthenticated20:08
mordredclarkb: that does seem like an index create20:08
lifelessrpioso: basically though, you'll need to figure it out, because its really not a use case today20:08
nibalizerer /spuppetboard/puppetdb/20:08
mordredSpamapS: ^^ that read to you?20:08
*** daemontool has joined #openstack-infra20:08
nibalizerso puppetboard contacts it on 8080 local20:08
lifelessrpioso: doing it the same as everything else is trivial, and you can have tests that way, in the stock layout openstack uses20:08
nibalizerunfortunately our puppetdb is sick20:08
lifelessmordred: wheel RECORD files have hashes of everything installed20:09
nibalizerrelated https://review.openstack.org/#/c/272850/20:09
lifelessmordred: pip can totally detect modified vs unmodified. Is there a UX around that today? no.20:09
daemontoolfungi, jeblair at your convenience please https://review.openstack.org/#/c/278323/20:09
Sam-I-Amdhellmann: ping20:09
*** jtomasek has quit IRC20:10
lifelessmordred: *should* there be? Even more fascinating question20:10
mordredlifeless: right - sorry, I was mostly meaning that there is currently no UI that would make it seem to a user like pip did anything with that information20:10
mordredand yes20:10
Sam-I-Amdhellmann: having a docs publishing problem, maybe you can help?20:10
clarkbmordred: I will be adding explicit recording of the schema being dropped whcih should allow us to more easily map onto the transaction log20:10
funginibalizer: got it, so it's a process inside the jvm running out of memory, not system-level process under init20:10
rpiosolifeless: I only provided what I consider to be the relevant section of setup.cfg.20:10
nibalizeryes20:10
clarkbtesting it locally first20:10
nibalizerI'm not sure what that word is20:10
nibalizermaybe just javaOutOfMemoryException20:10
*** esikachev has quit IRC20:11
jeblairclarkb, mordred: why does it show up in 2 transactions?20:12
rpiosolifeless: What do you mean by "its really not a use case today"?20:12
*** xyang1 has joined #openstack-infra20:12
*** tmcpeak has joined #openstack-infra20:13
lifelessrpioso: installing a single .py file is something that so far no openstack project has needed to do20:13
tmcpeakAJaeger: you around?20:13
*** andymaier has quit IRC20:13
jeblairclarkb, mordred: two transactions, referencing the same thread, one committing, one not started20:13
openstackgerritClark Boylan proposed openstack-infra/nodepool: Show innodb status before dropping db  https://review.openstack.org/27814620:13
lifelessrpioso: perhaps I'm misunderstanding what you're attempting20:13
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 for keystone projects  https://review.openstack.org/27859320:13
AJaegertmcpeak: yes20:13
tmcpeakAJaeger: Are we back to the drawing board for "bandit" gates then?20:14
clarkbjeblair: that is an excellent question20:14
tmcpeakI guess we should do a separate template, etc20:14
clarkbjeblair: two different sessions performing the same action?20:15
AJaegertmcpeak: no, we rename linters to pep8, and bandit stays in pep820:15
jeblairclarkb: the same thread id makes me think no, but i know very little about this :)20:15
tmcpeakAJaeger: ahh ok, got it20:15
jeblairclarkb: what does that look like when it doesn't hang?20:15
clarkbone sec will pull that out of my local testing20:15
rpiosolifeless: No worries. I'm trying to install Py packages, along with a closely related script that uses them.20:15
*** ldnunes has quit IRC20:16
*** achanda has quit IRC20:16
*** sfinucan has quit IRC20:16
jeblairclarkb: (but yeah, if it were two sessions performing the same action, that might go a long way to explaining things)20:16
tmcpeakAJaeger: did you make the change to call bandit in the non-linters target or should I?20:16
*** hdd has joined #openstack-infra20:16
clarkbjeblair: http://paste.openstack.org/show/486623/20:16
AJaegertmcpeak: I just send a change for bandit itself20:16
clarkbjeblair: that is the transaction portion from my local run20:16
lifelessrpioso: define script20:17
clarkband it did not hang locally20:17
lifelessrpioso: it may be that we're miscommunicating20:17
nibalizerinfra-root: the IC-west stuff landed20:17
lifelessrpioso: or better yet, supply the whole setup.cfg20:17
AJaegertmcpeak: https://review.openstack.org/#/q/topic:pti-pep8-linters20:17
nibalizeri'm monitoring20:17
tmcpeakok, if we're actually removing the target that calls linters from infra I assume Bandit would fail unless it gets changed over too?20:17
jeblairclarkb: so only one thing there20:17
AJaegertmcpeak: so, first changing bandit project, then changing infra. I'll take care of that20:17
rpiosolifeless: I would like the script to be readily available to users.20:17
tmcpeakAJaeger: got it, thank you20:18
rpiosolifeless: By script I mean a Py module with name equal to __main__.20:18
*** doug-fish has quit IRC20:18
clarkbone unlikely theory would be that our random db generation isn't really random enough20:18
clarkbwe add the pid though and since we only run a test at a time that should be fine if it is the case20:19
lifelessrpioso: can you supply the whole setup.cfg? It would be a lot easier to reason about if I could actually see it20:19
clarkbone at a time per pid20:19
rpiosolifeless: That can be executed at the shell via "python script.py".20:19
anteayapleia2: would hashar know if mediawiki has an open infra20:19
hasharanteaya: pleia2: hello!  I might be able to answer :-)20:20
*** doug-fish has joined #openstack-infra20:20
clarkbjeblair: the query id and thread are the same for both but the transaction id differs20:20
anteayahashar: awesome20:20
pleia2hashar: I run a list of open source projects that run an open source infra, is mediawiki the project one of them?20:20
jeblairclarkb: yep, doesn't make a lot of sense to me yet20:21
anteayahttp://opensourceinfra.org/20:21
anteayahashar: ^^20:21
tmcpeakAJaeger: if projects run this way, then how can they run pep8 standalone?20:21
tmcpeakwill Bandit always be included with pep8?20:21
tmcpeakseparate runs seems useful in cases20:21
pleia2hashar: I know you *use* open source tooling, just wasn't sure if your configs and stuff are open source and people can contribute to them20:21
*** jgriffith_away is now known as jgriffith20:22
tmcpeakAJaeger: I'm not sure that gets us where we want to be20:22
AJaegertmcpeak: they can create separate environments for these.20:22
hasharpleia2: anteaya: the whole Wikimedia infrastructure is based on open source software and almost its entire configuration is public and editable (as one can propose a change in Gerrit).  That includes all DNS entries, puppet, server side conf for php etc20:22
clarkbjeblair: the latest patchset will at least allow us to confirm if the db being deleted is the one being operated on20:22
tmcpeakAJaeger: separate pep8 environment that isn't called pep8?20:22
clarkbjeblair: hopeflly we can get it to trip over this issue quickly20:22
tmcpeakAJaeger: approaching a different direction, why couldn't "linters" be the standard target20:23
*** achanda has joined #openstack-infra20:23
AJaegerpep8 already has in many projects other lint like jobs, so adding bandit there is no problem20:23
rpiosolifeless: Thank you.  The entire setup.cfg is at http://pastebin.com/58qsiY5n20:23
tmcpeakAJaeger: do you know of an example off the top of your head I can check out?20:23
*** ociuhandu has joined #openstack-infra20:23
lifelessrpioso: so, on disk you have foo/__main__.py ?20:23
AJaegertmcpeak: read the scrollback here, e.g. on eavesdrop. To make it the standard, we would need to adopt all official projects - and that's far more than I can sign up for.20:23
tmcpeakAJaeger: ok, I'll read it20:24
pleia2hashar: asking specifically about mediawiki the project, is there a link to where people can learn about it in order to contribute?20:24
*** harlowja_at_home has quit IRC20:25
*** mrmartin has quit IRC20:25
hasharpleia2: for the CI system ?  The landing page would be http://www.mediawiki.org/wiki/CI20:25
rpiosolifeless: I have a project directory named foo.  It contains README.rst, foo.py, requirements.txt, setup.cfg, and setup.py.20:25
lifelessthen your script is not named __main__20:26
*** piet has joined #openstack-infra20:26
lifelessso your entry point should say foo.foo:main20:26
lifelessassuming your entry function is called main20:26
rpiosolifeless: foo.py contains main()... and if __name__ == "__main__": main()20:26
lifelessrpioso: the __name__ stuff is entirely irrelevant for entry points20:27
*** kozhukalov_ has joined #openstack-infra20:27
rpiosolifeless: K.  Just trying to be clear :-)20:27
lifelessI appreciate that20:28
lifelessone of the complexities here is that 'name' can refer to __name__, a variable set by python's import system, or the name on disk20:29
*** Swami has quit IRC20:29
lifelessand both of those have the special __main__ value20:29
rpiosolifeless: I've tried foo.foo:main. That only seems to work if foo.py is in a Py package named foo.20:29
lifelesswith very different meanings20:29
*** matrohon has quit IRC20:29
tmcpeakAJaeger: I think I'd rather just create a Bandit template20:29
*** EricGonc_ has quit IRC20:29
lifelessrpioso: you said you had a package called foo20:29
lifelessrpioso: packages = foo20:29
lifelessrpioso: in your setup.cfg20:29
tmcpeakI liked your idea of the linters target, but bundling Bandit into pep8 really doesn't feel clean to me, they're really totally different except they can both be described as a linter20:29
*** kozhukalov has quit IRC20:30
*** infra-re_ has quit IRC20:30
rpiosolifeless: I do have a package named foo.  However, I don't want foo.py to live in that package.20:30
fungitmcpeak: the name of the pep8 environment is already misleading because it doesn't directly invoke pep8 and only pep820:30
lifelessrpioso: why not?20:30
tmcpeakfungi: agreed20:31
fungitmcpeak: however, the _name_ pep8 is an arbitrary string encoded in our project testing interface standard in governance20:31
AJaegertmcpeak: linters and pep8 had the same purpose, the indented change was a pure rename.20:31
rpiosolifeless: Cuz then relative imports don't work.20:31
AJaegertmcpeak: pep8 already calls for many projects bashate or doc820:31
lifelessrpioso: so don't call it foo.py ?20:31
fungi(or flake8 which also has pyflakes and hacking and potentially other plugins)_20:31
AJaegertmcpeak: starting a new VM just for bandit is a lot of waste20:32
*** jsavak has quit IRC20:32
*** e0ne has quit IRC20:32
AJaegerfungi, jeblair: Do you want to +2 https://review.openstack.org/278593 to get keystone "pep8ed" again?20:32
rpiosolifeless: The name of the script doesn't affect the availability of relative imports.20:32
tmcpeakAJaeger: I see your point, although really since the job is called pep8 and then lumping all of the pass fail for potentially serious security issues into the style checking part of the gate feels off20:32
rpiosolifeless: I tried a different name.20:33
tmcpeakfungi: ^20:33
lifelessrpioso: sure it does; its failing because a module foo inside a package foo shadows the name foo20:33
fungitmcpeak: well, if they fail the job will fail, right? and if they pass and everything else is also passing, the job will pass20:33
AJaegertmcpeak: I prefer linters as well but getting this through in the proper way is more than I can commit to. If anybody wants to take it on, I can assist20:33
*** jsavak has joined #openstack-infra20:33
openstackgerritSean Dague proposed openstack-infra/project-config: create openstack/service-registry  https://review.openstack.org/27861220:33
*** dims has quit IRC20:34
*** fawadkhaliq has quit IRC20:34
tmcpeakfungi: ok so what's the realistic path for a project that wants to add the Bandit gate and still be able to get a separate style check?20:34
fungitmcpeak: basically it's a very large amount of work to change a cosmetic issue (renaming an arbitrary string from "pep8" to "linters") so while i agree it seems like something i wouldn't object to, someone would need to have time to invest in a proper phased implementation through governance and down to all repos following the pti20:35
tmcpeakthey add Bandit in pep8, now the thing that used to be called pep8 and actually runs pep8 is called some arbitrary other thing?20:35
rpiosolifeless: Unfortunately, it didn't for me.20:35
*** dims has joined #openstack-infra20:35
fungitmcpeak: the thing which runs pep8 runs all sorts of arbitrary other things already20:35
tmcpeakfungi: well it's not entirely cosmetic, a project loses their ability to just run style checks by adding bandit unless they do something else special20:35
lifelessrpioso: ok, well here's the situation - all the openstack projects put their CLI entry points inside the project package itself20:35
*** aysyd has quit IRC20:36
lifelessrpioso: and it works fine. I can probably diagnose whats not working for you, but I can't with the information asymmetry going on right now20:36
fungitmcpeak: i argued to call it "static-analyzers" rather than "pep8" or "linters" fwiw20:36
lifelessrpioso: if you want to push up a tree to github or something where I can actually test it and figure out whats up with your relative imports, I'd be happy ro do that20:36
tmcpeakfungi, AJaeger: ok cool, I see your points20:36
dimsclarkb : fungi : which version of tox do we use?20:37
tmcpeakit is a ton of work for something mostly cosmetic20:37
lifelessrpioso: short of that though - this stuff works :)20:37
*** yamahata has joined #openstack-infra20:37
fungitmcpeak: but i'm also not especially invested in whether bandit jobs should be bundled into jobs that run all the other static analyzers or kept separate20:37
tmcpeakso I should advise projects that add Bandit to add it in their pep8 section, and then maybe make a separate target that does Bandit and PEP8 separately if they want?20:37
rpiosolifeless: Do the projects use relative imports? Silly question, perhaps.20:37
*** dtardivel has quit IRC20:38
*** matrohon has joined #openstack-infra20:38
lifelessrpioso: depends on what you mean, since that term has had at least two definitions in python20:38
*** dkranz has quit IRC20:38
fungitmcpeak: what are the reasons why a project which successfully complies with bandit (or has sufficient skips/overrides in place to work around the existing noncompliance) would want to not run bandit checks when they run other static analyzers? does it take a lot longer than the others, or have tons of extra requirements, or something?20:38
clarkbdims: looks like latest (but with the image build lag time)20:39
dimsclarkb : ack thanks20:39
*** ccrouch has quit IRC20:39
*** burgerk has joined #openstack-infra20:39
*** angdraug has joined #openstack-infra20:39
tmcpeakfungi: no, neither of those hold true.  I suppose having the idea of "linters" now called "pep8" really doesn't make a difference (except cosmetic)20:39
*** gokrokve has quit IRC20:40
clarkbdims: devstack may update it when it runs but for everything else they will use the system installed version included in the image20:40
openstackgerritColleen Murphy proposed openstack/diskimage-builder: Fix dpkg element for Ubuntu Xenial  https://review.openstack.org/27861720:40
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196420:40
fungitmcpeak: from a standpoint of pragmatism, it makes one less thing developers have to remember to run locally, and one less job they need to remember to add in the ci20:40
AJaegertmcpeak: and I guess you want to encourage develoeprs to run bandit when they run pep8 as well...20:40
*** |-paul-| has joined #openstack-infra20:40
dimsclarkb : so what ever "apt-get install python-tox" fetches?20:41
clarkbdims: no it is pip install tox20:41
AJaegerbetter to catch errors early ;)20:41
dimsclarkb : ah even better. thanks20:41
tmcpeakfungi, AJaeger: yeah, I guess my only concern is it makes it feel like a slightly bigger step to adopt Bandit20:41
nibalizerseems to have not lolsploded20:41
*** rockyg has quit IRC20:41
fungitmcpeak: and hopefully people who _strongly_ object to the naming inaccuracy have time to correct it properly through a cross-project effort rather than taking the easy and less efficient way out20:41
rpiosolifeless: By relative import, I mean what's described as "explicit relative imports" in section 6.4.2 of https://docs.python.org/2/tutorial/modules.html.20:42
tmcpeakfungi: cool, yeah fair enough20:42
*** kzaitsev_mb has joined #openstack-infra20:42
tmcpeakAJaeger, fungi: I appreciate your effort on this20:42
fungitmcpeak: i appreciate the discussion!20:42
*** kozhukalov has joined #openstack-infra20:42
*** HeOS has joined #openstack-infra20:43
clarkbkeep in mind pep8 is self testing20:43
*** sdake has quit IRC20:43
clarkbso any project adding bandit to the pep8 target will be self tested and any issues can be corrected20:43
*** EricGonczer_ has joined #openstack-infra20:43
clarkbit actually makes adoption simpler in many cases than adding a new separate job then iterating on why it fials20:43
rpiosolifeless: Thank you for your offer to look at some code.  Much appreciated.20:44
fungitmcpeak: but basically "pep8" was no longer accurately named when most projects started calling flake8 from it years ago20:44
lifelessrpioso: that should work fine20:44
tmcpeakfungi: yeah, it's a fair point20:44
*** maishsk has quit IRC20:44
*** jpeeler has quit IRC20:44
tmcpeakfungi: feels like just semantics so it should be fine20:44
*** alexpilotti_ has joined #openstack-infra20:44
tmcpeakfungi: we can revisit later if there are problems I'm not seeing now20:45
AJaegersure, thanks for understanding, tmcpeak20:45
*** kozhukalov_ has quit IRC20:45
*** jgriffith is now known as jgriffith_away20:45
tmcpeakthanks for all the effort on it20:46
rpiosolifeless: I'll try to put together a simple sample that illustrates what I've been seeing and publish it on github.20:46
*** tzn has joined #openstack-infra20:46
*** maishsk has joined #openstack-infra20:46
*** gildub has joined #openstack-infra20:46
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for kolla*  https://review.openstack.org/27862220:46
*** hdd has quit IRC20:47
lifelessrpioso: I'm happy looking at your current code for this, it doesn't need to be made super simple20:47
*** eil397 has joined #openstack-infra20:47
openstackgerritsebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API  https://review.openstack.org/22196420:47
*** EricGonczer_ has quit IRC20:48
rpiosolifeless: Simpler may simplify it for me, if you know what I mean :)  I'll circle back with you when it's available.20:49
rpiosolifeless: Thanks for being accommodating, tho.20:49
lifelessnp20:49
lifelessgl20:49
*** tzn has quit IRC20:51
*** tmcpeak has left #openstack-infra20:51
*** tzn has joined #openstack-infra20:51
*** zeih_ has joined #openstack-infra20:53
*** e0ne has joined #openstack-infra20:53
*** kozhukalov_ has joined #openstack-infra20:55
*** rvasilets__ has quit IRC20:56
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for bandit  https://review.openstack.org/27862720:56
*** ccrouch has joined #openstack-infra20:56
*** abregman is now known as abregman|afk20:56
*** apoorvad has quit IRC20:59
*** HeOS has quit IRC20:59
daemontoolAJaeger,  if that's allright, could you +A this review please https://review.openstack.org/#/c/278323/21:00
*** kozhukal` has joined #openstack-infra21:01
AJaegerdaemontool: done21:01
*** kozhukal` has quit IRC21:02
*** abregman|afk is now known as abregman21:02
openstackgerritMerged openstack/requirements: Change global requirements forcing cliff!=1.16.0  https://review.openstack.org/27829921:02
openstackgerritDoug Hellmann proposed openstack-infra/project-config: import release-test repository  https://review.openstack.org/27849521:03
*** zeih_ has quit IRC21:03
*** jlk has quit IRC21:05
*** jlk has joined #openstack-infra21:05
*** jlk has quit IRC21:05
*** yamahata has quit IRC21:06
*** jlk has joined #openstack-infra21:06
*** daemontool has quit IRC21:07
*** ybathia has joined #openstack-infra21:07
jamielennoxclarkb: yes, keystoneauth plugins get tokens as required - however there is an invalidate() method that can be used to drop auth21:07
*** mrmartin has joined #openstack-infra21:07
*** mrmartin has quit IRC21:07
jamielennoxclarkb: so not so much force it to get a new token, but you can invalidate() then get_token() and you'll practically always get a new one21:07
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 for doc projects  https://review.openstack.org/27863321:08
jamielennoxclarkb: but i'd be interested in why you really need a new one if you're using the same credentials21:08
*** dkranz has joined #openstack-infra21:09
clarkbjamielennox: ya the issue is swift uplaods for large files end up being many api calls over time, so even if I invalidate at the beginning one could fail later21:09
clarkbjamielennox: because of ^21:09
*** e0ne has quit IRC21:09
AJaegerjeblair, fungi, project-config cores: Could you review 278633 and 278593, please? The first keystone changes have been approved already but 278593 is a pre-requisite21:09
clarkbsessions should handle that gor each sub request but my reup then call macto swift level call wont21:09
*** jlk has joined #openstack-infra21:10
openstackgerritMerged openstack-infra/project-config: Set conditions for devstack-dsvm and python34 on freezer  https://review.openstack.org/27832321:10
*** jlk has quit IRC21:10
*** jlk has joined #openstack-infra21:10
*** baoli has joined #openstack-infra21:11
*** sdake has joined #openstack-infra21:12
jamielennoxclarkb: so is this issue that swiftclient doesn't support sessions?21:12
clarkbthat and shade/os client config dont pass the auth details to swiftclient so it can't renew the token itself21:13
stevemarAJaeger: if i wanted to create a dsvm job that uses cliff from source should i use something like "gate-tempest-dsvm-largeops-src-cliff" ?21:14
*** jsavak has quit IRC21:15
dhellmannstevemar : yeah, I think that would do it21:15
AJaegerNot sure about the largeops name, otherwise sounds fine21:15
clarkbbut I think that only worls with password auth which is why shade/oscc do it the eay yhey do21:15
slogan621jeblair, fungi: Could you please review and possible approve https://review.openstack.org/#/c/275873/21:15
*** HeOS has joined #openstack-infra21:15
dhellmannstevemar : though largeops may be going away soon, so I hope whoever does that provides a replacement21:15
clarkbsupport more auth methods21:15
slogan621s/possible/if possible/21:15
*** daemontool has joined #openstack-infra21:15
* slogan621 thanks you21:15
fungidhellmann: seemed that largeops going away was pretty inevitable from the ml thread21:16
daemontoolAJaeger, thanks a M21:16
fungidhellmann: and that coming up with an alternative would be up to someone with time to implement one21:16
fungiSpamapS seemed to think he might be interested in bringing in something useful for that space in the future21:16
dhellmannfungi : we're using that job in a lot of places as a way to test libs from source, so just deleting those instead of replacing them with another job is going to drop our test coverage drastically21:16
dhellmannfungi : well, not a lot. a few.21:17
fungioh, i see. so you just mean picking another existing job to run as the backward compat verification21:17
*** sdake has quit IRC21:17
dhellmannright21:17
dhellmannoslo.db, oslo.log, oslo.messaging, and oslo.rootwrap use that right now21:18
fungithat seems fairly trivial assuming the largeops job was chosen mostly arbitrarily21:18
*** kozhukalov has quit IRC21:18
dhellmannyeah, just something to keep an eye out for when someone actually goes to delete the job21:18
*** jsavak has joined #openstack-infra21:18
dhellmanngate-tempest-dsvm-neutron-src-{name} may be a reasonable substitute21:18
*** kozhukalov has joined #openstack-infra21:18
AJaegerlet's tell sdague about the above ^, I guess he will do the cleanup21:18
openstackgerritSteve Martinelli proposed openstack-infra/project-config: add a dsvm job for cliff  https://review.openstack.org/27863821:19
hasharpleia2: thank you for the add on http://opensourceinfra.org/ .  Not sure what the site will be about that looks nice :}21:19
stevemardhellmann: AJaeger ^21:19
*** alexpilotti_ has quit IRC21:19
clarkblargeops is likely a good one for messaging and db21:19
clarkbbecause it puts some strain on those components21:19
*** baoli has quit IRC21:19
stevemarclarkb: oh is that the only diff between largeps and non-largeops?21:20
dhellmannstevemar you may want to just use gate-tempest-dsvm-neutron-src-{name} from the start21:20
stevemaryeah21:20
*** baoli has joined #openstack-infra21:20
clarkbstevemar: largeops uses the nova fake virt driver amd boots a hundred or so VMs21:20
stevemareek21:20
clarkbthe other jobs use qemu and dont boot so many VMs21:20
clarkbbut exercise a broader scope of things21:21
openstackgerritSteve Martinelli proposed openstack-infra/project-config: add a dsvm job for cliff  https://review.openstack.org/27863821:21
stevemarclarkb: thanks for the explanation, i didn't know the diff between the two21:21
*** HeOS has quit IRC21:21
openstackgerritMerged openstack-infra/system-config: Puppetdb keeps ooming, give it more ram  https://review.openstack.org/27285021:22
funginibalizer: ^21:22
*** rockyg has joined #openstack-infra21:23
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for ekko  https://review.openstack.org/27864121:24
*** tiswanso has quit IRC21:24
*** apoorvad has joined #openstack-infra21:24
clarkbI wonder if largeops makes sense with a longer timeout running in the periodic pipeline and monitored by the health dashboard21:24
openstackgerritPaul Belanger proposed openstack-infra/project-config: Create ansible-role-shade project  https://review.openstack.org/27864321:24
clarkbthat way its less about perfoance and more about can we boot a large number of VMs all at once21:25
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for steth  https://review.openstack.org/27864421:26
anteayahashar: yay!21:27
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Use pep8 instead of linters for terracotta  https://review.openstack.org/27864521:28
*** gildub has quit IRC21:28
*** alivigni has quit IRC21:28
*** maishsk has quit IRC21:28
*** gildub has joined #openstack-infra21:28
AJaegerteam, what happened on https://review.openstack.org/#/c/278645/21:29
*** maishsk has joined #openstack-infra21:29
*** jgriffith_away is now known as jgriffith21:29
AJaegersuhani gupta send a merge failed message ^21:29
AJaegerah, no -1 - strange....21:30
clarkbusing personal account for CI?21:31
AJaegerand then on project-config???21:31
AJaegerand also on terrakotta: https://review.openstack.org/#/c/27863721:32
rbrndt_saw it on moans as well https://review.openstack.org/#/c/278104/21:32
rbrndt_monasca21:33
samueldmqhi, what/who is "suhani gupta" ?21:33
samueldmqit just posted a comment in a keystone change as it was a CI bot21:33
samueldmqso I am here to confirm21:33
anteayait is a ci https://review.openstack.org/#/q/reviewer:%22suhani+gupta+%253Csuhani%2540hedviginc.com%253E%2221:33
AJaegersamueldmq: that's what we're wondering as well...21:33
*** ZZelle_ has joined #openstack-infra21:33
*** ZZelle_ has quit IRC21:33
anteayaI'll get the id and we will shut it down21:33
bknudson_why is suhani gupta telling me the merge failed? https://review.openstack.org/#/c/277494/21:33
AJaegeranteaya: thanks!21:33
*** ZZelle_ has joined #openstack-infra21:33
samueldmqanteaya: so a bot doing bad things :/21:34
AJaegerbknudson_: anteaya is shutting that CI down...21:34
bknudson_oh, thanks!21:34
AJaegerIt's not giving any -1s AFAIU but very confusing ;(21:34
pabelangersamueldmq: looks more like 3rd party CI21:34
samueldmqand it's posting merge failed in lots of changes :(21:35
AJaegerjeblair, fungi : I think I cleaned up all projects regarding linters. Thanks a lot for discussing this through with me!21:35
pabelangersamueldmq: Ya, if zuul-merger is not setup properly, it will do just that21:35
pabelangerlikely local permission issue21:35
openstackgerritMerged openstack-infra/system-config: Update common.js to include OpenStack-Health  https://review.openstack.org/24037921:35
Shrewsmordred: jeblair: SpamapS: if one or more of you can +2 this, we can unbreak shade gate... again: https://review.openstack.org/27843821:35
anteayainfra-root could someone disable and close connection on gerrit id 20395 please? http://paste.openstack.org/show/486629/21:35
* AJaeger waves good night..21:36
pleia2anteaya: having a look now21:36
anteayathis is a ci operating under a personal account: https://review.openstack.org/#/q/reviewer:%22suhani+gupta+%253Csuhani%2540hedviginc.com%253E%2221:36
anteayapleia2: thank you21:36
anteayaAJaeger: thank you, good night21:36
samueldmqanteaya: pleia2: thanks for taking care of it21:37
pabelangerI remember some talks in Vancouver about adding some soft of middleware to gerrit to throttle / better control ACLs for 3rd party.21:37
samueldmqpabelanger: ^21:37
anteayasamueldmq: thanks for saying something21:37
samueldmqgood night all21:37
pleia2anteaya: disabled, but I don't know how to do the "close connection" bit21:37
*** adis has joined #openstack-infra21:37
samueldmqanteaya: glad to give feedback and keep things working :)21:37
adisdali ima neko ovdje iz Bosne21:38
adisza opusten razgovor21:38
adisbilo ko, neka se javi21:38
adis???21:38
anteayaadis: Govorimo engleski u ovom kanalu. Ja ne znam niti suradnika koji govore hrvatski.21:38
*** pradk_ has joined #openstack-infra21:38
*** rocky_g has joined #openstack-infra21:38
adisaham. ok21:39
anteayapleia2: https://review.openstack.org/Documentation/cmd-close-connection.html21:39
adisenglish21:39
*** ybathia_ has joined #openstack-infra21:39
anteayaadis: english21:39
*** devananda has quit IRC21:39
stevemaranteaya: google translate for the win21:39
*** salv-orl_ has joined #openstack-infra21:39
anteayastevemar: exactly21:39
* stevemar is mildly impressed21:39
pabelangersame21:39
adisznaci, samo na engleskom jeziku21:39
pabelangerthat was fast21:40
anteayaadis had already visted -dev so I had it all in copy/paste21:40
*** achanda_ has joined #openstack-infra21:40
anteayaadis: sorry I only speak english21:40
anteayaadis: I used google translate to understand that you speak Croatian and were looking for others who do21:40
*** bknudson has joined #openstack-infra21:40
*** dprince has quit IRC21:40
*** cbader_2 has joined #openstack-infra21:40
anteayaadis: I don't know of any contributors who speak Croatian21:41
adisthe first time i use Mirc and I am not sure how this all works21:41
*** erlon_ has joined #openstack-infra21:41
*** jordanP has joined #openstack-infra21:41
*** kzaitsev_mb has quit IRC21:41
anteayaadis: okay great, well welcome21:41
adisI'm sorry..21:41
anteayaadis: you are in a channel that helps developers create openstack21:41
*** charz_ has joined #openstack-infra21:41
pleia2anteaya: hm, do you know the session_id?21:41
*** crinkle_ has joined #openstack-infra21:41
anteayaadis: don't be sorry, welcome to irc21:41
anteayapleia2: I don't, sorry21:42
*** christiana has quit IRC21:42
anteayapleia2: and I don't know how to find out21:42
pleia2me neither21:42
adishvala, ups, thanks21:42
anteayaadis: welcome, were you looking for openstack?21:42
anteayaadis: or just any irc channel?21:42
*** nadya has joined #openstack-infra21:43
*** bodepd_ has joined #openstack-infra21:43
*** nadya is now known as Guest1840721:43
adisHowever, asking the channel in the language of the Balkan peoples, Croatian, Bosnian, Serbian and so on.21:43
*** devananda has joined #openstack-infra21:43
*** gibi_ has joined #openstack-infra21:43
*** smcginni1 has joined #openstack-infra21:44
*** Swami has joined #openstack-infra21:44
*** wolsen has joined #openstack-infra21:44
anteayahere is a serbian user group: https://groups.openstack.org/groups/serbia21:45
*** markvan_ has joined #openstack-infra21:45
*** devananda has quit IRC21:45
*** andymaier has joined #openstack-infra21:45
*** baoli has quit IRC21:45
anteayaI don't see one for Croatia or Bosnia21:45
*** _ody_ has joined #openstack-infra21:45
anteayathe slovian group looks active: https://groups.openstack.org/groups/slovenia21:46
anteayawould slovania count?21:46
adisno no Slovenian, I do not understand Slovenian language21:47
adis;)21:47
*** crinkle has quit IRC21:47
*** HenryG_ has joined #openstack-infra21:47
*** kzaitsev_mb has joined #openstack-infra21:47
anteayaoh okay21:47
*** crinkle_ is now known as crinkle21:47
anteayaI don't know it either21:47
anteayaare you looking to contribute to openstack?21:47
*** HeOS has joined #openstack-infra21:47
*** Guest18407 has quit IRC21:47
adisNevertheless, thank you very much, very kind of you21:47
anteayawelcome21:47
openstackgerritMerged openstack-infra/puppet-statusbot: Allow statusbot to take an array of auth nicks  https://review.openstack.org/27425221:47
anteayahappy to help21:47
*** bknudson has quit IRC21:48
*** cbader_2 has quit IRC21:48
*** cbader has joined #openstack-infra21:48
*** rockyg has quit IRC21:48
*** ybathia has quit IRC21:48
*** achanda has quit IRC21:48
*** cbader_ has quit IRC21:48
*** salv-orlando has quit IRC21:48
*** pradk has quit IRC21:48
*** nt has quit IRC21:48
*** erlon has quit IRC21:48
*** Apsu has quit IRC21:48
*** gibi has quit IRC21:48
*** jgriffith has quit IRC21:48
*** fbo_ has quit IRC21:48
*** pkoniszewski has quit IRC21:48
*** ctlaugh has quit IRC21:48
*** wolsen_ has quit IRC21:48
*** smcginnis has quit IRC21:48
*** wfoster has quit IRC21:48
*** tlbr has quit IRC21:48
*** Ryan_Lane_ has quit IRC21:48
*** zxiiro has quit IRC21:48
*** charz has quit IRC21:48
*** bknudson_ has quit IRC21:48
*** sbadia has quit IRC21:48
*** zhenguo_ has quit IRC21:48
*** mkwiek has quit IRC21:48
*** betherly has quit IRC21:48
*** iremizov has quit IRC21:48
*** skath_ has quit IRC21:48
*** igorbelikov has quit IRC21:48
*** HenryG has quit IRC21:48
*** dhellmann has quit IRC21:48
*** ramishra has quit IRC21:48
*** _ody has quit IRC21:48
*** gmann has quit IRC21:48
*** beisner has quit IRC21:48
*** hockeynut has quit IRC21:48
*** jesusaur has quit IRC21:48
*** zz_zz_ja has quit IRC21:48
*** acabot has quit IRC21:48
*** bodepd has quit IRC21:48
*** markvan has quit IRC21:48
*** zeus has quit IRC21:48
*** HenryG_ is now known as HenryG21:48
*** ybathia_ is now known as ybathia21:48
*** bknudson has joined #openstack-infra21:49
pleia2anteaya: aha, there's a show-connections command, let's see where I get with that21:49
*** zeus has joined #openstack-infra21:49
anteayaah go go show connections21:49
*** hockeynut has joined #openstack-infra21:49
*** tlbr has joined #openstack-infra21:49
anteayaI think I knew about that and forgot to say it21:49
*** dhellmann has joined #openstack-infra21:49
anteayasorry about that21:49
*** zz_ja has joined #openstack-infra21:49
*** zeus is now known as Guest5749721:49
*** wfoster has joined #openstack-infra21:49
jheskethMorning21:49
*** erlon_ is now known as erlon21:49
*** |-paul-| has quit IRC21:49
pleia2hm, this seems to be very slow, or something (not returning results yet)21:50
anteayamorning jhesketh21:50
anteayapleia2: hmmmm21:50
anteayawould zaro know?21:50
*** fbo has joined #openstack-infra21:50
anteayazaro how would pleia2 find the connection to close via close connections21:50
*** beisner has joined #openstack-infra21:50
*** Apsu has joined #openstack-infra21:50
anteayathe account is still posting21:50
*** pkoniszewski has joined #openstack-infra21:50
openstackgerritMerged openstack/diskimage-builder: Fix growroot for Gentoo's openrc  https://review.openstack.org/27657821:50
pleia2aha, there it goes21:50
*** nt has joined #openstack-infra21:50
pleia2just slow :)21:50
*** sbadia has joined #openstack-infra21:51
anteayaI think21:51
anteayaah patience21:51
fungipleia2: if you only want numeric ip addresses and usernames then add -n21:51
openstackgerritOpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/27865421:51
openstackgerritOpenStack Proposal Bot proposed openstack-dev/pbr: Updated from global requirements  https://review.openstack.org/27865521:51
*** jgriffith has joined #openstack-infra21:51
fungigoes a lot faster since it doesn't need to do a bunch of reverse dns lookups21:51
pleia2anteaya: no connection from the user we disabled, so I think we're ok21:51
anteayaawesome21:51
pleia2fungi: ah, I saw the -n but didn't use it, good to know re: speedy21:51
fungis/usernames/ids/21:52
*** tiswanso has joined #openstack-infra21:52
*** baoli has joined #openstack-infra21:52
fungi-n switches from ptr records to ip addresses and usernames to numeric user ids21:52
*** HenryG has quit IRC21:52
pleia2yeah, and all I needed here was the numeric user id anyway21:52
fungiiirc21:52
*** smcginni1 is now known as smcginnis21:52
anteayamost recent post is at <hour>:3121:52
pleia2" If the -n option is used, this column shows the Account Id instead."21:52
pleia2so yeah21:52
pleia2next time, -n :)21:52
anteayapleia2: thanks for taking care of it21:53
stevemaranteaya: we're getting a lot of comments from a "suhani gupta" account, it almost looks like a third party CI account21:53
anteayastevemar: we just disabled it21:53
stevemaranteaya: oh nice, thanks21:53
*** kzaitsev_mb has quit IRC21:53
anteayastevemar: and yes it is a third party ci using a personal account21:53
anteayastevemar: you shouldn't see any further posts, do speak up if you see something recent21:53
stevemaranteaya: not sure why they need to comment on keystone jobs, we don't have any third party plugins21:53
*** Sukhdev has joined #openstack-infra21:53
anteayathey were all over the place: https://review.openstack.org/#/q/reviewer:%22suhani+gupta+%253Csuhani%2540hedviginc.com%253E%2221:54
*** adis has left #openstack-infra21:54
anteayakeystone just got scooped up too21:54
*** acabot has joined #openstack-infra21:54
*** ctlaugh has joined #openstack-infra21:55
*** HenryG has joined #openstack-infra21:56
*** jesusaur has joined #openstack-infra21:56
*** ramishra has joined #openstack-infra21:56
*** mkwiek has joined #openstack-infra21:56
*** gmann has joined #openstack-infra21:56
*** bpokorny has quit IRC21:56
*** zxiiro has joined #openstack-infra21:57
*** skath_ has joined #openstack-infra21:57
*** igorbelikov has joined #openstack-infra21:57
*** devananda has joined #openstack-infra21:57
*** betherly has joined #openstack-infra21:57
stevemarahh21:58
*** Ryan_Lane_ has joined #openstack-infra21:58
*** vgridnev has quit IRC21:58
anteayayeah, they have no idea what they are doing21:59
anteayathey should be set up for ci-sandbox only at this point21:59
anteayaand using a real CI account, not a personal account21:59
anteayabut they aren't21:59
*** zhenguo_ has joined #openstack-infra22:00
*** iremizov has joined #openstack-infra22:01
*** rossella_s has quit IRC22:03
*** rossella_s has joined #openstack-infra22:03
*** kgiusti has left #openstack-infra22:04
*** rcernin has quit IRC22:07
*** amrith is now known as _amrith_22:08
*** abregman is now known as abregman|afk22:09
*** thorst_ has quit IRC22:10
*** thorst_ has joined #openstack-infra22:10
*** daemontool has quit IRC22:13
*** ccrouch has quit IRC22:14
*** thorst_ has quit IRC22:14
*** shardy has quit IRC22:14
*** regXboi has quit IRC22:15
*** ccrouch has joined #openstack-infra22:16
*** julim has quit IRC22:16
*** hashar_ has joined #openstack-infra22:17
*** zxiiro_ has joined #openstack-infra22:17
*** igorbelikov_ has joined #openstack-infra22:17
*** boris-42_ has joined #openstack-infra22:17
*** julim has joined #openstack-infra22:17
*** julim has quit IRC22:17
*** annegent_ has joined #openstack-infra22:18
stevemaranteaya: could you take a quick look at https://review.openstack.org/#/c/278638/ ?22:18
anteayajust a quick one :)22:18
stevemarit'll really help in diagnosing https://bugs.launchpad.net/python-cliff/+bug/1543841 - but we need it anyway :)22:18
openstackLaunchpad bug 1543841 in devstack "Invocation error: tempest verify-config: error: unrecognized arguments: -uro ../../../../tmp/tmp.FR5OHabb3Y" [Undecided,In progress] - Assigned to Matthew Treinish (treinish)22:18
*** mase_x200 has joined #openstack-infra22:18
*** armax has quit IRC22:19
*** YorikSar_ has joined #openstack-infra22:19
*** bknudson_ has joined #openstack-infra22:19
anteayastevemar: done22:19
anteayamay it be all you hope it will be22:19
*** Ryan_Lane_ is now known as Ryan_Lane22:19
*** bknudson_ has quit IRC22:19
stevemaranteaya: yee haw22:20
*** Ryan_Lane is now known as Guest7658122:20
*** bknudson_ has joined #openstack-infra22:20
anteaya:)22:20
*** sbadia_ has joined #openstack-infra22:20
*** Guest76581 has quit IRC22:20
*** Guest76581 has joined #openstack-infra22:20
*** Guest76581 is now known as Ryan_Lane22:20
openstackgerritMerged openstack-infra/shade: Modify test workaround for extra_dhcp_opts  https://review.openstack.org/27843822:21
*** woodster__ has joined #openstack-infra22:22
tonybDid something change with the way we upload/store job logs in thast 24hours (or so).  I'm no longer getting console.log from gate-irc-meetings-tox-ical jobs.  Compare http://logs.openstack.org/14/278114/1/check/gate-irc-meetings-tox-ical/a74b71b/ to http://logs.openstack.org/14/278114/3/check/gate-irc-meetings-tox-ical/6e25e19/22:22
*** ianw_ has joined #openstack-infra22:22
*** chlong_ has joined #openstack-infra22:22
*** aspiers_ has joined #openstack-infra22:22
anteayajhesketh: ^^ any logging changes I know about?22:22
*** igorbelikov has quit IRC22:22
*** zxiiro has quit IRC22:22
*** boris-42 has quit IRC22:22
*** acabot has quit IRC22:22
*** dhellmann has quit IRC22:22
*** sbadia has quit IRC22:22
*** bknudson has quit IRC22:22
*** ianw has quit IRC22:22
*** YorikSar has quit IRC22:22
*** chlong has quit IRC22:22
*** hashar has quit IRC22:22
*** claudiub has quit IRC22:22
*** woodster_ has quit IRC22:22
*** AJaeger has quit IRC22:22
*** annegentle_ has quit IRC22:22
*** aspiers has quit IRC22:22
*** ianw_ is now known as ianw22:22
*** tzn has quit IRC22:22
*** igorbelikov_ is now known as igorbelikov22:22
*** sbadia_ is now known as sbadia22:22
anteayatonyb: I don't know of any mind you I was away in the middle of the day for a few hours22:23
*** dhellmann has joined #openstack-infra22:23
anteayasomething may have happened during that time22:23
*** zxiiro_ is now known as zxiiro22:23
*** AJaeger has joined #openstack-infra22:23
ianwdoes anyone know if it's possible to change the default view when you click on a project (e.g. https://review.openstack.org/#/projects/openstack-dev/devstack,dashboards/default) to *not* show merged changes?22:23
*** woodster__ is now known as woodster_22:23
*** boris-42_ is now known as boris-4222:24
jheskethanteaya, tonyb: not that I've done or know of sorry22:24
*** acabot has joined #openstack-infra22:24
anteayajhesketh: thanks anyway22:25
tonybjhesketh: Okay I'll find the job on jenkins*.o.o and see if I can get more details.22:25
anteayatonyb: I can offer you sad face22:25
anteaya:(22:25
anteayaif that helps22:25
tonybanteaya: it does :)22:25
jheskethtonyb: yep good idea22:25
onovyanyone for final +A pls? https://review.openstack.org/#/c/256668/ https://review.openstack.org/#/c/256755/22:25
*** tiswanso has quit IRC22:25
tonybjhesketh: I'm learning :)22:26
tonybjhesketh: dosn't stop be from being lazy but ...22:26
clarkbtonyb it looks like you are copyong an index.html to the root22:26
tonybclarkb: we used to BUT there is explict stuff in the publisher to stop that and AFICT that's still there22:26
*** armax has joined #openstack-infra22:27
clarkbtonyb console log is there22:27
tonybclarkb: seek jenkins/jobs/infra.yaml22:27
clarkbjust masked by rogue index.html22:27
clarkbyou cam address it directly to see it22:27
tonybclarkb: yeah it helps if I use console.html NOT console.log :)22:28
openstackgerritMerged openstack-infra/project-config: Use pep8 for keystone projects  https://review.openstack.org/27859322:28
mordredjamielennox: notmyname and I spoke earlier and he said that  timburke and joeljwright were the folks on the swiftclient side we should work with on adding session support22:30
openstackgerritSpencer Krum proposed openstack-infra/system-config: Disable nonfunctional infracloud hosts  https://review.openstack.org/27876922:30
*** matrohon has quit IRC22:30
nibalizermordred: im interested to know your thoughts on that ^^ as well22:31
nibalizershould we be commenting or moving to a disabled group22:31
jamielennoxmordred: is there support there for the idea? i have looked at swiftclient in the past and whilst it is an invasive change for all clients it will not be an easy conversion for swiftclient22:32
mordredjamielennox: yes - there are people interested and supportive22:32
openstackgerritBrant Knudson proposed openstack/requirements: Add checks for setup.cfg existence in project dictionary  https://review.openstack.org/27877222:32
openstackgerritBrant Knudson proposed openstack/requirements: Add location to requirement.Requirement  https://review.openstack.org/27877322:32
openstackgerritBrant Knudson proposed openstack/requirements: Fix editing constraints files with urls in them.  https://review.openstack.org/27877422:32
openstackgerritBrant Knudson proposed openstack/requirements: Deal with underscores in names in edit-constraints  https://review.openstack.org/27877522:32
openstackgerritBrant Knudson proposed openstack/requirements: Expose extras information in requirements  https://review.openstack.org/27877622:32
*** jordanP has quit IRC22:33
jamielennoxmordred: ok, i'll need to have another look at swiftclient and speak to them, hopefully it'll be easier with some of the team on board22:33
*** thorst_ has joined #openstack-infra22:34
*** eharney has quit IRC22:35
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec  https://review.openstack.org/27877722:35
openstackgerritMark Vanderwiel proposed openstack-infra/project-config: Adding integration test support for app catalog horizon plugin  https://review.openstack.org/27644022:35
*** kozhukal` has joined #openstack-infra22:35
*** dimtruck is now known as zz_dimtruck22:36
jeblairclarkb, greghaynes, mordred: when you have some time, i'd love some feedback on https://review.openstack.org/278777 which i've been thinking about for a while, but especially after some of the hairy things we've run into with nodepool dib builders22:36
*** kozhukal` has quit IRC22:36
*** kozhukalov_ has quit IRC22:37
mordredjeblair: I'm reading it right now22:37
*** kozhukalov has quit IRC22:37
prometheanfireianw: that review is only cleaning up the cleanup function, it's not to fix the ordering of package-installs22:37
prometheanfireand doesn't depend on it either, though it would be nice to have22:38
prometheanfireit's a ncie to have22:38
*** thorst_ has quit IRC22:39
nibalizerjeblair: neat!22:39
jeblairi see some typos in self-review i'm already fixing :)22:40
*** mattt has joined #openstack-infra22:40
*** miqui has quit IRC22:41
*** salv-orlando has joined #openstack-infra22:42
mattthi infra team, has there just been a new release of the ubuntu-trusty-rax-iad and devstack-trusty-rax-iad image by chance?22:42
*** mase_x200 has quit IRC22:42
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Add Nodepool Zookeeper spec  https://review.openstack.org/27877722:42
jeblairmattt: i'll check22:43
*** dpaterson has quit IRC22:44
jeblairmattt: it does not look like it -- http://paste.openstack.org/show/486635/22:44
*** salv-orl_ has quit IRC22:44
mnaserwould be cool if the openstack-infra projects hosted the docs of the latest release + master .. all docs refer to this patch already updated - https://github.com/openstack-infra/nodepool/commit/0ceb3d53b27bcd81ef577eb00d849c5dfe7dae6d -- but zero docs online show the 0.2.0 previous behaviour, as all docs are for master22:45
mnaserjust throwing a suggestion out there, unless I couldn't find them22:45
jeblairmattt: (first field in "Age" is days)22:45
mnaserfor context, 0.2.0 is the latest release (on pypi) of nodepool22:45
*** zz_dimtruck is now known as dimtruck22:45
*** jgriffith is now known as jgriffith_away22:46
matttjeblair: ok cool, let me make sure the issue isn't on this end!22:47
dimshmm. check queue is ~350 and gate is ~50...wondering if this is stuff backed up from yesterday or some other rush22:48
anteayajeblair: according to the paste, doesn't it say this id 355223 (devstack-trusty) is 7 hours old?22:48
openstackgerritMerged openstack/diskimage-builder: Mark ironic-discoverd-ramdisk as deprecated in favor of ironic-agent  https://review.openstack.org/27026722:48
jeblairanteaya: it does.22:49
jeblairanteaya: so is 355221.22:49
jeblairbut that wasn't asked about22:49
*** FallenPegasus has joined #openstack-infra22:49
anteayayes22:49
anteayaoh?22:49
*** achanda_ has quit IRC22:49
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Templatize experimental bindep jobs  https://review.openstack.org/27878422:49
jeblairanteaya: i don't consider 7 hours old to be 'just'.22:50
mordredmnaser: that is not a terrible idea22:50
anteayajeblair: oh okay22:50
*** baoli has quit IRC22:50
tonybclarkb: okay I'm seeing "[PostBuildScript] Build is not success : do not execute script" which (I think) explains the clobbering of the index.22:50
jeblairi guess that's a matter for the long now foundation though.22:50
matttanteaya jeblair : the reason i ask -- our openstack-ansible-security role started to fail due to a misconfiguration in /etc/apt/apt.d, we're only seeing it in iad i /think/22:50
*** baoli has joined #openstack-infra22:51
tonybclarkb: so that means I now need to ask how can a I make sure that my publisher job always runs?22:51
openstackgerritMerged openstack-infra/tripleo-ci: scp/ssh do not check for know host keys  https://review.openstack.org/26966022:51
anteayamattt: when did it start to fail?22:51
*** arthus has joined #openstack-infra22:51
*** burgerk has quit IRC22:51
jeblairmattt: and do you have a link to a failure?22:51
mordredoh! woot - btw - apt mirror is live22:51
clarkbtonyb: there are some flags you can set, look at how the swift console log stuff does it22:51
anteayamordred: yay22:51
mordredhttp://logs.openstack.org/03/254703/36/check/gate-tempest-dsvm-neutron-full/b6c9bf0/logs/devstacklog.txt.gz#_2016-02-10_20_40_12_32422:52
fungimordred: i worry that you and mattt are talking about the same thing :/22:52
jeblairindeed22:52
mordredfungi: well - that was from a successful run22:52
*** alex_xu has quit IRC22:52
mordredso at least _some_ nodes are running against apt mirror and succeeding22:52
matttjeblair: http://logs.openstack.org/91/278491/2/check/gate-openstack-ansible-dsvm-commit/707ae72/logs/ansible-logging/ansible.log, search for AllowUnauthenticated22:52
*** mriedem has quit IRC22:52
matttjeblair: the role fails if AllowUnauthenticated is set to true in /etc/apt/apt.d22:53
mordred(hahahaha)22:53
mordredyup22:53
mordredthat would be this22:53
*** sigmavirus24 is now known as sigmavirus24_awa22:53
*** dingyichen has joined #openstack-infra22:53
fungiindeed, seems like the role needs some adjusting for testing purposes22:53
mordredyah - we do not sign the packages in the mirror - so we drop a file in there that disables signature checks22:53
anteayabtw firefox prompts me to open mattt's link using gedit22:53
fungisince you may want to test against a package mirror with unsigned indices22:53
jeblairit's a security hardening role22:54
anteayarather than openin in the browser so I opened it in chrome22:54
fungi(as we do)22:54
matttwe can disable this rule, that's no problem22:54
mordredis openstack-ansible using our mirror yet?22:54
mattti just wanted to make sure we knew why it needed to be done22:54
jeblairmordred: i don't understand the question22:54
fungimattt: alternatively, you could unset that after packages are installed?22:54
matttmordred: i know odyssey4me has been doing a bunch of work using your pip mirrors etc, but didn't realise it had gone live22:55
mordredI thought I rembmered openstack-ansible having local code to use per-cloud-region apt mirrors22:55
jeblairmordred: ah now i understand22:55
mordredif that is still the case22:55
*** alex_xu has joined #openstack-infra22:55
fungilie wrap that role's test in code which forces the setting to true and then restores it to its prior value after the test22:55
tonybclarkb: Okay thanks. although I now think that isn;t the real probelm as bit patchsets failed but ps1 "did the right thing" and ps3 didn't22:55
fungis/lie/like22:56
mordredthen I recommend for the moment simply adding an rm of the file in /etc/apt/apt.conf.d/22:56
anteayafirefox 44.022:56
matttmordred: yeah that's what i'll do22:56
fungior mock out the apt configuration for testing purposes22:56
mordreduntil such a time as openstack-ansible consumes our mirrors22:56
*** piet has quit IRC22:56
*** dpaterson has joined #openstack-infra22:56
matttthanks a lot guys!22:56
mattt(and girls!)22:57
mordredmattt: sure thing!22:57
fungimattt: because presumably what you want to know is that the control properly detects when that setting has been set incorrectly for production purposes, but you don't _actually_ need to test the security of our test servers to do that22:57
mordredinfra-root: everybody good with me sending out the mirror announce?22:58
mordredthey seem to be live and working :)22:58
nibalizerwfm22:58
jheskethyep :-)22:58
fungimordred: it's working in multiple regions?22:58
*** eil397 has quit IRC22:58
mordreduh22:58
fungisounds like good timing to me then22:58
mordredI know it's working in iad22:59
mordredI can go troll for more build logs real quick22:59
*** doug-fish has quit IRC22:59
anteayayou need to exercise that troll22:59
fungilogstash.o.o presumably makes that fast22:59
clarkbjeblair I thi k greghaynes has been toying with the idea of running builders completely separate from nodepool then just use glance to find the current image22:59
mordredfungi: yes. I confirm multiple regions23:00
clarkbwhich should remove the need for any db beyond the api23:00
*** doug-fish has joined #openstack-infra23:00
jeblairclarkb: that would work for severing the daemon-worker relationship, but not for worker mutexing of builds.23:00
mordredhttp://logs.openstack.org/03/254703/36/check/gate-tempest-dsvm-full/94f9198/logs/devstacklog.txt.gz#_2016-02-10_20_39_28_44923:00
mordredfungi: that's internap nyj0123:01
fungiright on23:01
greghaynesclarkb: jeblair Yea, I think they are unrelated but funny timing23:01
anteayamordred: happy posting to the ml23:01
*** eil397 has joined #openstack-infra23:01
mordredalso - I'm sure everyone in both new york and new jersey loves the 'nyj' acronym23:01
clarkbjeblair correct you eould have to shard builds instead23:01
greghaynesclarkb: jeblair I think both is ideal, actually23:01
openstackgerritPaul Belanger proposed openstack-infra/puppet-stackalytics: Setup logging for stackalytics-processor  https://review.openstack.org/27856723:01
fungimordred: they're the same place, right? ;)23:02
*** jgriffith_away is now known as jgriffith23:02
* mordred waits for Clint to come diving through the air at fungi23:02
anteayamordred: only because everyone on new york and new jersey agree on everything23:02
anteayas/on/in23:02
*** armax has quit IRC23:02
jeblairclarkb, greghaynes: yeah, if we don't want to support more than one thing being able to build ubuntu-trusty, then no db needed.23:02
fungimordred: i thought "new jersey" was just what you called teh part of new york where you dump your trash23:02
mordredfungi: yup. but we choose to not refer to it as new york - it has all that trash23:03
fungivery good point23:03
jeblairclarkb, greghaynes: if we do want to support that, we need a db (zookeeper/mysql/...).  but you're right, we don't need the launcher to have access to that if it uses metadata and glance23:03
greghaynesjeblair: clarkb Even if we have a db because we want to scale out more easily then I like the separation of concerns from breaking builders out entirely23:03
clarkbyup23:03
greghaynesjeblair: yep23:03
clarkbI actually like the idea of mkxing them together23:04
greghaynesjeblair: also, I was just trying to brainstorm with someone over lunch today on how we could use zookeeper for this23:04
jeblairclarkb, greghaynes: however, that would be a polling operation, so we'd have to do an image list periodically.  sharing the zookeeper db could be more responsive.  but it's not a huge gain/hit.23:04
jeblairgreghaynes: now you can brainstorm with me too. :)23:04
anteayajeblair: I'm going to advocate for zuul being restarted: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=392&rra_id=all23:04
clarkbjeblair I want to say shade already does the poll23:05
anteayain response to dims post in backscroll23:05
greghaynesjeblair: clarkb Yes, it would have to poll, but the polling can be very infrequent - if it takes 15min after an image upload for the image to begin being in use then its not a big deal23:05
clarkbbut I would have to reread its image boot path23:05
jeblairclarkb: hopefully it's in the cache :)23:05
*** doug-fish has quit IRC23:05
jeblairclarkb: i think we'd launch by image id anyway23:05
greghaynesAlso, if we *really* dont want to poll, I wouldn't be opposed to having one rpc call between the two which is builders poking nodepoold to say "this image-id should be uploaded now to this provider"23:07
jeblairgreghaynes, clarkb: regardless of whether the nodepool daemon does a glance poll or checks zk -- we would still have achieved the goal of having independent dib building daemons that do not depend on the central daemon23:07
mmedvedehi infra, it looks like no new nodes are being launched, correct? sorry if it is somewhere in backscroll, ctrl-f fails me23:07
greghaynesjeblair: yep23:07
jeblairgreghaynes: well, the builder can do the upload itself23:07
greghaynesjeblair: Yes, I mean after it completes an upload, just as a way to wake up nodepool to poll a specific image-id23:08
greghaynesits an optimization and not really important23:08
*** doug-fis_ has joined #openstack-infra23:08
jeblairgreghaynes: ah, so more "this image *was* uploaded to this provider"23:08
greghaynesyep23:08
anteayammedvede: jenkins01 and 06 are off on their own but it looks like other jenkins are online: http://grafana.openstack.org/dashboard/db/nodepool23:09
anteayammedvede: what are you seeing?23:09
mmedvedeanteaya: just a bunch of scheduled builds are very old on http://status.openstack.org/zuul/. Was making sure that gate is fine before doing a recheck23:09
anteayaa bunch of scheduled builds are very old, what does that mean?23:10
*** doug-fis_ has quit IRC23:10
anteayadoes that mean the jobs are stuck?23:10
anteayaor that the patches are waiting a long time for nodes?23:10
*** doug-fis_ has joined #openstack-infra23:11
clarkbjeblair: greghaynes my only comments would be dont require zk for a single builder to be useful for small installs and as a dib to glance utility and dont bother with etcd or consul23:11
mordredclarkb: bluebox is unhappy with node launching again - didn't you do something last time?23:11
clarkbmordred: cleaned up leaked fips23:11
mordredyay23:11
mmedvedeanteaya: from zuul's perspective, it can not find a node to finish a check23:11
mordredmy favorite23:11
jeblairclarkb: i agree re etcd and consul;23:11
anteayammedvede: right the job is queued23:11
fungimmedvede: perhaps it would help if you provided a specific example23:11
jeblairclarkb: i'm less excited about supporting nothing though23:11
mordredzk seems super easy to install for small things23:12
clarkbjeblair I am just thinking about the use case of on my laptop amd build + ulpaod23:12
mordredI mean, it's no _harder_ to install than mysql on ubuntu23:12
jeblairclarkb: zk still acts as a persistent data store, so we'd have to fill that with something23:12
*** denisra has quit IRC23:13
clarkbya maybe its simpler to just build a separate utility on a shard run dib and use shade thing23:13
greghaynesYou could use no persistent store with the caveat that you can only have one builder responsible for a given image23:13
mordredI mean23:13
mordredseriously23:13
mordredinstalling zk is super easy23:13
jeblairclarkb: yeah, i feel like laptop build+upload is a different use case than general dib+upload daemon.23:13
mordredI'm not sure why we'd work around it23:13
JayFmordred++23:13
mordredit's a single apt-get command23:13
anteayaI will agree that zuul is almost at max memory and could do with a restart, and 2 of 7 jenkins aren't playing well with others, but I think as far as I can see everything else is behaving as expected23:13
JayFmordred: I want more ZK in  my OpenStack ;)23:13
nibalizergreghaynes: yes23:13
anteayawe do have fewer test nodes than we used to, that plays a role23:14
greghaynesYep, I agree with the 'just use zk' thinking23:14
clarkbmordred mostly becausr I dont want it on my laptop but I dont want dib actaully on my laptop either23:14
greghaynesI need to actually read the spec in detail too, though23:14
mmedvedefungi: anteaya: I think I am misinterpreting zuul's status, not used to see checks that are sitting for long (e.g. zuul.o.o has a few older than 8 hours)23:14
clarkbthe missing thing here is uploading to rax is litrrally impossible23:14
clarkbbut nodepool almost can do it23:14
clarkbso I want that23:14
mmedvedefungi: anteaya: would proceed with my recheck then, thanks23:14
mordredclarkb: you can't shade uploads locally without nodepool?23:14
*** annegent_ has quit IRC23:14
clarkband using glance in general is an exercisr in frustration23:14
clarkbmordred it isnt fun to no23:15
anteayammedvede: what do you expect a recheck to do23:15
mordredclarkb: I usually just use os_image from ansible or make a 2 line python script23:15
*** yamahata has joined #openstack-infra23:15
greghaynesjeblair: mordred clarkb One of my motivations for breaking out builders entirely too is that I think that tool would be generall useful (lots of clouds need to keep a set of images up to date regularlyish)23:15
anteayammedvede: all that does it take it out of where it is in the queue and put it farther back in the line23:15
jeblairmordred: is one of them a #! line?23:15
*** daemontool has joined #openstack-infra23:15
mordredclarkb: perhaps I should write up a quick thin on using os_image?23:15
fungimmedvede: yes, we're running jobs at basically max capacity and there is a substantial backlog. also because the gate pipeline is prioritized, the check pipeline only gets what quota is not being used by gate pipeline jobs23:15
mmedvedeanteaya: my patch is not on the queue23:15
jeblairgreghaynes: yeah, and we can use it for our infra system images.23:15
clarkbmordred ya maybe thats what I need to see23:15
mordredjeblair: well, only if I write the python like it's perl :)23:15
mordredclarkb: I'll make you one of those23:15
mmedvedeanteaya: one of checks failed with timeout though23:15
anteayammedvede: ah okay23:15
greghaynesjeblair: yep23:15
anteayammedvede: which job failed?23:16
anteayammedvede: can you share the log?23:16
clarkbmordred yhr real problem with dhade for me currently is instantiating a cloud23:16
clarkbgetting auth is noy really easier today, you just dont havr to know cloud secrrts23:16
clarkbbut uts still ridiculously complicated23:16
*** erlon has quit IRC23:16
mordredclarkb: really?23:16
mmedvedeanteaya: sure, the log: http://logs.openstack.org/74/278574/1/check/gate-infra-puppet-apply-bare-precise/08bd048/console.html. But I think it just hit something random23:17
mordredclarkb: import shade ; cloud = shade.openstack_cloud()23:17
clarkbya I just spent all morning debugging it23:17
clarkband ended up in 6 repos23:17
clarkbfor just get me a token23:17
mmedvedefungi: good explanation, thank you23:17
mordredclarkb: I would like to hear more about that - I usually find opening a python interpreter and importing shade to be the easiest way to interact with an openstack cloud23:18
clarkbmordred the rax swift token fail thing23:18
mordredoh. that's swift23:18
mordrednothing else needs pre-created tokens - the way swiftclient works is very different23:19
anteayammedvede: zuul cloner spent 30 minutes trying to update origin remote in puppet-logstash23:19
clarkbnodepool -> shade -> oscc -> keystoneauth and swiftclient23:19
clarkbmordred ya but its required for rax uploads :)23:19
clarkbI can upload to everyone else just fine23:19
mordredwell, sure.23:19
*** dkranz has quit IRC23:19
mordredbut the shade to do an image upload is still hella easy23:20
mordreddebugging it DOES involve needing to grok those 5 things23:20
mordredbecause the rackspace image upload process is hella complex23:20
mordredclarkb: did you find any new workarounds to make it betterer?23:20
mordredclarkb: or was the result "suck"23:21
mmedvedeanteaya: ok, I thought the VM might have gone away or lost connectivity23:21
mordredclarkb: also - I wonder if we lower the chunk size we're using23:21
mordredclarkb: if that would be helpful23:21
clarkbmordred no I think the two solutions would be only support passeord auth fot swift in shade and hand over the creds or get sessions in swiftclient23:21
clarkbbut shade/oscc do ejat they do to support other auth aiui23:21
clarkbso thatd a tradeoff23:22
mordredclarkb: oh- well - we could support password auth in swift23:22
mordredclarkb: I'd support a change that passes in username/password if the password auth plugin is in use23:22
mordredclarkb: and fallback to passing in a preauthtoken to swiftclient if non-password auth is the auth plugin23:22
clarkbthat may be worth trying23:22
clarkbonce home I can pull oscc back up and look at it23:23
*** christiana has joined #openstack-infra23:23
clarkbsince it actually makes the clients23:23
*** jaypipes has quit IRC23:23
mordredclarkb: I'll look in a jiff - I'm pretty sure I konw where that goes and how it should work23:23
anteayammedvede: no zuul cloner looks like it couldn't finish updating the repo within 30 minutes for some reason23:23
mmedvedeanteaya: right, if VM went away, postscript would not have ran23:24
clarkbmordred I also need to figure out how to use osic and push oscc patch for it23:24
clarkbcurrently just have a horizon ip address23:24
mordredclarkb: that would be welcomed23:24
clarkbshould be fun23:24
mordredclarkb: you should be able to get an openrc file from horizon23:24
clarkboh cool23:24
openstackgerritTony Breeds proposed openstack-infra/project-config: Force the gate-irc-meetings-tox-ical postbuildscript to always run  https://review.openstack.org/27879023:24
anteayammedvede: logstash hasn't seen a lot of that message: Build timed out (after 30 minutes). Marking the build as failed.23:25
tonybThat that should fix my irc-meetings thing.23:25
clarkbmordred and qcow2 vs raw is trial and error?23:25
mordredclarkb: what I usually do is do a glance image-list23:26
mordredclarkb: and look to see what format the images in the cloud are in23:26
*** baoli has quit IRC23:26
mordredclarkb: then record that into the vendor profile in oscc23:26
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Source undercloud environment variable from a file  https://review.openstack.org/27566723:26
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Split the deploy script into its own file  https://review.openstack.org/27566823:26
*** baoli has joined #openstack-infra23:27
mordredclarkb: openrc file should be in compute -> access & security -> api access23:27
anteayatonyb: this builder only runs on irc-meetings, which is good because unless I already understood what the issue was I couldn't get it from your commit message and comment, sorry :(23:27
mordredclarkb: and there should be a link or button at the tpo of that to download the rc file23:27
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Add experimental bindep for the python-jobs group  https://review.openstack.org/27879323:27
anteayatonyb: I know you know what you are talking about23:27
clarkbmordred so many hax23:27
anteayatonyb: let me see if I have a suggestion23:27
clarkbclearly you have done thus before23:27
mordredclarkb: :)23:27
mordredclarkb: many. many. many times23:28
*** sc68cal has quit IRC23:28
tonybanteaya: Okay Thanks.  I thought the subject called that out but Happy for corrections.23:29
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Add experimental bindep for the python-jobs group  https://review.openstack.org/27879323:29
*** ZZelle_ has quit IRC23:29
*** baoli has quit IRC23:29
*** baoli has joined #openstack-infra23:30
mordredjamielennox: need some advice23:30
mordredjamielennox: say I have a keystone session and an auth plugin23:30
mordredjamielennox: ... wait- I overthought something. nevermind23:30
anteayatonyb: the obvious is often lost on me23:31
anteayatonyb: I'm the slow kid in the class23:31
*** achanda has joined #openstack-infra23:31
anteayaleft some suggestions23:32
tonybanteaya: pish.23:32
anteaya:)23:32
mmedvedeanteaya: thanks for the help. I looked through zuul cloner, but nothing obvious there. I do not think it is something reproducible, would see on recheck23:32
*** doug-fis_ has quit IRC23:33
openstackgerritMerged openstack-infra/project-config: Revert "Revert "Enable voting for Puppet OpenStack Integration jobs""  https://review.openstack.org/27835223:33
*** pahuang has quit IRC23:33
anteayammedvede: okey dokey, thanks for taking a look23:33
anteayammedvede: let me know if you see the same error though with zuul cloner23:33
anteayasorry not error, timeout23:33
mmedvedeanteaya: would do23:34
anteayathank you23:34
anteayammedvede: I'm going offline soon so leave your thoughts in channel if you have any to share23:34
openstackgerritMerged openstack-infra/project-config: add a dsvm job for cliff  https://review.openstack.org/27863823:34
*** edmondsw has joined #openstack-infra23:34
openstackgerritMerged openstack/diskimage-builder: py26 is no longer supported by Infra's CI  https://review.openstack.org/26165623:36
*** andymaier has quit IRC23:38
*** thorst_ has joined #openstack-infra23:38
mordredclarkb: https://review.openstack.org/27879723:39
openstackgerritJeremy Stanley proposed openstack-infra/project-config: Extend experimental-bindep-jobs to 14 projects  https://review.openstack.org/27879823:39
*** thorst_ has quit IRC23:39
mordredclarkb: there's rough draft of passing in user/pass to swiftclient23:39
*** thorst_ has joined #openstack-infra23:40
mordredclarkb: completely untested - I mostly just wanted to get thoughts into a patch for you23:40
*** sc68cal has joined #openstack-infra23:40
*** gordc has quit IRC23:41
clarkbmordred: ya that seems right23:41
*** ccrouch has quit IRC23:41
clarkbassuming the auth name is a key in auth_args23:41
mnaserhrm, does nodepool have a hard requirement on adding floating IPs to servers?23:42
mordredmnaser: nope23:42
mordredmnaser: not if the cloud does not need floating ips23:42
mnaserit .. seems like it does?  at least based on the 0.2.0 release23:42
mordredmnaser: it has never had a hard require on floating ips23:42
mordredmnaser: only one of our four clouds has floating ips23:42
clarkbif it can't determine the public ip it iwll try to fip though23:42
mordredyes23:43
mnasermordred: interesting, so it seems that it's attempting to create floating ips here23:43
mnaserwell, the idea is that the customer doesn't want internet accessiblity to these machines (NAT is okay, but no public access)23:43
mordredAH23:43
mnaserperhaps i misformulated my question23:43
jeblairnodpool's fip logic is tuned for our clouds; shade will make that better.23:43
mordredmnaser: yah - I have config controls to support the thing you're doing in shade23:44
jeblairnodpool. heh. clearly i meant to type nodepoor.23:44
*** baoli has quit IRC23:44
mnasernodepoor? :-P23:44
mnaserso the customer has their own internal /23 network that they want to deploy VMs inside, and maintain all communication inside that private neutron /23 network23:44
mordredmnaser: I'm not 100% sure that we can express that in current nodepool- but I'm working on a patch that should help23:44
jeblairdvorak typos are even better than qwerty ones23:44
mordredmnaser: yah - the trick there will basically be to tell nodepool and shade that the internal network is the one it should consider "public"23:45
clarkbmordred: mnaser you can, you just have to set the network name iwth the public attribute for that /2323:45
clarkbif you do that it will happily use unroutable IPs as the public IPs23:45
mnaserclarkb: that's the workaround i thought about, except 0.2.0 (latest pypi release doesn't have that)23:45
mordredclarkb: oh right - we have that directly in nodepool.yaml23:45
mnaserit'd be cool if we got a new release hint hint hint23:45
clarkbmnaser: oh ya don't use 0.2.023:45
mordred:)23:45
clarkbmnaser: as soon as we have reliablish image builds a new release should happen23:46
clarkbit is very close23:46
*** chlong_ has quit IRC23:46
mnaserso takeaways, dont use 0.2.0 (master?) and - label: public\n  public: true23:46
anteayanodepour, nodestream, nodewaterfall23:46
*** pahuang has joined #openstack-infra23:46
clarkbmnaser: yes, we deploy master23:47
*** devananda has quit IRC23:47
clarkbreleases are somewhat arbitrary but there is at least one outstanding known bug that I owuldn't want to release with23:47
mnaseri figured that was the reason23:47
mnaseri think going for master is the best solution in this case23:48
clarkbmordred: question about oscc vendor data, when do you choose to add the authurl and when do you not add the authurl23:48
*** thorst_ has quit IRC23:49
*** weshay has quit IRC23:49
*** dimtruck is now known as zz_dimtruck23:49
*** thorst_ has joined #openstack-infra23:49
mnaserclarkb: say someone was to ask "very close", more in a timeframe (i don't expect a commitment)23:51
mnaserfew weeks -> few months -> few years? :p23:51
mordredclarkb: when there is an auth url to add, I add it23:51
jamielennoxAJaeger: hey, if you're around, for https://review.openstack.org/#/c/271128/ i literally just need to add to  gate-tempest-dsvm-neutron-identity-v3-only-full-nv to the devstack-gate list?23:51
mordredclarkb: so, like, osic is a single cloud that's has an auth url23:51
mordredclarkb: so it would do it23:51
clarkbmnaser: for a release? the two outstnading things have changes proposed23:51
mordredclarkb: but adding a vendor profile for bluebox wouldn't make sense23:51
clarkbmordred: gotcha23:52
mordredclarkb: since there are more than one bluebox cloud23:52
jamielennoxAJaeger: it's passing tox on my machine, and i don't see a corresponding one for identity-v3-only that has been otherwise declared23:52
mnaserclarkb: sounds good, thank you :)23:52
* mnaser is excited to see this customer spin up nodepool for their CI23:52
clarkbmordred: and the floating ip source as None is only required if there are no floating IPs or should I put the external network name there if I have it?23:52
mordredclarkb: only required if there are no floating ips23:53
mnaseronce they got up to ~50 concurrent builds/machines, jenkins didnt start feeling oh-so-hot, so they're moving to nodepool23:53
mordredclarkb: and external network name only needed if it's a cloud where shade can't figure it out23:53
*** jlk has quit IRC23:54
mordredmnaser: WOOT23:54
clarkbmordred: what are the criteria for that?23:54
clarkbI guess I can just try making a fip and see whta happens23:54
*** bpokorny has joined #openstack-infra23:55
mordredclarkb: yah - or - do cloud.create_server(*args, auto_ip=True, wait=True) and see if you wind up with a server with a floating ip23:55
mordredclarkb: there are almost no clouds where shade can't figure it out23:56
mgagneis there a way to create dependent jobs in Zuul? Job A needs to complete before job B starts for example (in same pipeline)23:56
*** jlk has joined #openstack-infra23:57
*** jlk has quit IRC23:57
*** jlk has joined #openstack-infra23:57
*** thorst_ has quit IRC23:57
clarkbvenv/bin/glance --insecure image-list --sort disk_format does not actually show you the disk format :)23:58
clarkbmgagne: yes you make the parent a dict key and the children a list of jobs23:58
anteayamnaser: we try to keep the jobs per jenkins to about 10023:58
anteayabut yay for nodepool23:59
mgagneclarkb: really? where can I find an example? (docs, existing layout.yaml, etc.)23:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: create_service() should normalize return value  https://review.openstack.org/27409123:59
clarkbimage-show works23:59
clarkbmgagne: in our layout.yaml look at the tarball and pypi release jobs23:59
anteayayay23:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add docs tox target  https://review.openstack.org/27687023:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Clarify Munch object usage in documentation  https://review.openstack.org/27687823:59
clarkbmgagne: the relationship there is tarball must complete before the upload job runs23:59
mgagnewill check, thanks!23:59
mnaseranteaya: i think they're looking to bring all their CI to one centralized nodepool, similar to what the foundation does :)23:59
clarkbmordred: qcow2 which is default so that is easy23:59
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Add enabled flag to keystone service data  https://review.openstack.org/27411623:59
mnaseranyways, i'm off to go home.. to finish up more work :-P23:59
mgagneclarkb: you know what I want =)23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!