Tuesday, 2016-07-12

*** lvdongbing has quit IRC00:00
jeblairpabelanger, clarkb: oh i know what it is00:00
jeblairpabelanger, clarkb: those are used nodes that nodepool never saw as being used because nodepool does not listed to zmq from zlstatic0100:01
*** shashank_hegde has joined #openstack-infra00:01
pabelangersounds right00:01
jeblairpabelanger: so i think you'll need to 'nodepool delete' all of the zlstatic01 nodes after it stops00:01
pabelangerya, I was planning on doing that just to be safe00:01
clarkbgotcha, zlstatic is like jenkins.o.o was and has no dynamic hosts00:01
pabelangerif zuul didn't do it00:02
jeblairyep.  normally, except for that bug.00:02
*** garyk has quit IRC00:02
clarkbcompletely unrelated but we should totally have a grep -i error consolelog && exit 1 build step00:03
jeblairclarkb: we *could* mix static/dynamic, but it didn't seem worth changing how we do things.00:03
jeblair(release.slave.o.o can still only be attached to one launcher, so it may as well be a special launcher)00:04
pabelangerSo, feature request, not sure how to design it. Some how list which zuul-launcher a job is running on from status.o.o/zuul page.  Before we could hover over URLs to see the jenkins hostname in the console URL.  Maybe a enable a tooltip?00:04
clarkbsphinx builds in aprticular complain about a lot of stuff but seem to build anyways and tox returns 000:04
*** garyk has joined #openstack-infra00:04
jeblairpabelanger: i hesitate for that -- i'm not sure which zuul-launcher is particularly useful feature to most users00:04
jeblairclarkb: ugh, i thought we managed to convince sphinx to exit on warnings00:05
jeblairerror on warnings00:05
clarkbjeblair: doesn't look like it00:05
pabelangerjeblair: right, was looking for a easy way to see how many jobs were running when we do maintenance00:05
clarkbjeblair: but these are even errors not just warnings00:05
pabelangerdoesn't have to be status.o.o00:05
jeblairpabelanger: i run 'ps' on the launcher in question00:05
jeblairpabelanger: you can see the 'ansible-playbook' processes00:06
pabelangerya, I do that too00:06
jeblairpabelanger: i think there are 3 processes for each job00:06
jeblairclarkb: wow :(00:06
clarkbI am going to look in some zuul side logs to see if they persist there00:07
*** garyk has quit IRC00:07
*** heyongli has quit IRC00:07
clarkb/home/jenkins/openstack/ceilometer/doc/source/webapi/v2.rst:234: ERROR: Unexpected indentation.00:07
clarkbis one example00:07
*** heyongli has joined #openstack-infra00:07
clarkbhttp://logs.openstack.org/75/338975/2/check/gate-ceilometer-docs/b00c023/console.html.gz#_2016-07-07_14_57_47_839664 ya00:08
jeblairclarkb: grepping in the console log is a neat idea, but i worry that makes us un-future-zuulv3 proof00:08
jeblairclarkb: it would probably be better to fix this in the tox docs script00:08
*** thiagop has quit IRC00:09
clarkbdoes zuulv3 not have console logs?00:09
clarkbbut yes fixing it more directly is always better00:09
clarkbcan give better error messages to devs that way00:09
*** esberglu has joined #openstack-infra00:09
jeblairclarkb: i have no idea if zuulv3 will have console logs :)00:09
jeblairi hope it has something like them00:10
jeblairbut how we end up doing some of this with ansible is still a bit of a wildcard00:10
*** garyk has joined #openstack-infra00:10
clarkbI see00:10
openstackgerritMerged openstack-infra/git-review: Update gerrit version for testing  https://review.openstack.org/28201800:10
clarkb(and to be extra doubly clear that ERROR above did not cause the job to error)00:10
pabelangersphinx and pbr, always in for a fun time00:11
pabelangerwarnonerrors was broken for a while00:11
pabelangerand only recently got fixed again00:11
clarkbpabelanger: pretty sure its not working now00:11
clarkbbased on ^00:11
pabelangerclarkb: yup, seems to look that way00:12
clarkbor maybe ceilometer has it diasbled?00:12
pabelangerthat time I looked, there was very basic to no testing with sphinx in pbr00:12
pabelangerthat was 18months ago00:12
fungidisabling that was one of the workarounds mentioned in the pbr breaking change thread on the ml, so entirely possible00:12
jeblairthe run-docs script is pretty simple -- the exit code (0 in this case) is the exit code of  tox -e$venv -- python setup.py build_sphinx00:13
jeblairceilometer has warnerrors = true00:14
clarkbjeblair: ya my mega loop is just tox -evenv python setup.py build_sphinx and check $? and record some data on failure00:15
clarkbthen I can run find logs/ -name '*fail*' and find all the failed tox targets00:16
clarkb(I am reasonably happy with how well this simple test all the things setup is working)00:16
clarkbcisco-ironic-contrib is failibng because nova changed some internal interfaces00:16
clarkbI am discovering most of the work here is going to be sifting the legit xenial issues from the $random things is broken00:17
*** heyongli has quit IRC00:17
*** heyongli has joined #openstack-infra00:17
*** PollyZ has joined #openstack-infra00:18
*** caowei has quit IRC00:18
*** zz_dimtruck is now known as dimtruck00:19
*** ddieterly has joined #openstack-infra00:19
*** _oanson has quit IRC00:20
*** karthikp_ has joined #openstack-infra00:21
*** bapalm has quit IRC00:22
*** PollyZ has quit IRC00:22
*** Julien-zte has joined #openstack-infra00:23
*** bapalm has joined #openstack-infra00:25
*** xarses has quit IRC00:26
*** heyongli has quit IRC00:27
*** heyongli has joined #openstack-infra00:28
*** rlandy has quit IRC00:28
pabelangerclarkb: nice work00:30
pabelangerjeblair: do we feel ansible is stable enough for zuul to start introducing 331499? SSH pipelining00:32
*** sflanigan is now known as sflanigan_meetin00:33
*** cody-somerville has quit IRC00:33
*** adrian_otto has quit IRC00:33
*** pvaneck has quit IRC00:33
jeblairpabelanger: what was the answer wrt async?  if async doesn't use this, what's the point?00:34
*** karthikp_ has quit IRC00:35
clarkbcoupler has no code in it00:35
pabelangerjeblair: ya, it doesn't look like async support it.  That was my impression looking at the code.  However, I still think it would be useful relating to all other things, rsync included00:35
clarkbbut runs python-jobs00:35
*** karthikp_ has joined #openstack-infra00:35
*** cody-somerville has joined #openstack-infra00:36
clarkbmaybe we should send email to the coupler fokls and ask them if they are still intending to do stuff wit htaht repo and retire it fi not00:36
clarkbhttps://review.openstack.org/#/c/302791/ is the change00:37
jeblairpabelanger: i have to run, let's pick this up later00:37
pabelangerjeblair: no rush00:37
clarkbRockyg: ^ submitter has a huawei addr maybe you know what is going on?00:37
*** heyongli has quit IRC00:38
openstackgerritMerged openstack-infra/project-config: Update build-image.sh to reflect nodepool config  https://review.openstack.org/34053900:38
*** heyongli has joined #openstack-infra00:38
*** gyee has quit IRC00:38
Rockyggimme a sec, clarkb checking it out....00:39
*** gfreeman has quit IRC00:39
openstackgerritMerged openstack-infra/project-config: Fix name of layer build target  https://review.openstack.org/34036600:39
Rockygclarkb, I know th guy.  english name of Howard.  I'll sent hime an mail.  He should b reading and on line, even if not on IRC00:41
clarkbRockyg: thank you00:43
*** sdake has quit IRC00:45
*** shashank_hegde has quit IRC00:45
dmsimardProbably not the best place to ask, but -- in general, is there some sort of schedule for dot releases of supported releases ? (i.e, Mitaka)00:47
dmsimardI looked at http://releases.openstack.org/mitaka/index.html and http://releases.openstack.org/00:47
*** sputnik13 has joined #openstack-infra00:48
*** heyongli has quit IRC00:48
*** rdx_matt has joined #openstack-infra00:48
*** shashank_hegde has joined #openstack-infra00:48
*** heyongli has joined #openstack-infra00:48
Rockygclarkb, sent an email, cc'ed you.  He's generally very responsive.00:50
openstackgerritMerged openstack-infra/project-config: Add keystone v3 only nv job to designate  https://review.openstack.org/34038800:51
*** tphummel has quit IRC00:53
*** rdx_matt has quit IRC00:53
*** vasanthi has quit IRC00:53
*** kzaitsev_mb has joined #openstack-infra00:54
*** PollyZ has joined #openstack-infra00:54
*** tphummel has joined #openstack-infra00:55
clarkbRockyg: perfect, thanks again00:55
clarkbdmsimard: dot releases? also you may have better luck in the releases or stable channel00:56
clarkbdmsimard: oh dot releases I don't know why I kept reading that ad DoT eg department of transportation00:56
clarkbdmsimard: they happen on a schedule set by the stable maint team iirc.00:57
dmsimardclarkb: ok, I'll try and ask if their schedule is available somewhere. Thanks.00:57
clarkbclearly I should call it a day00:57
*** heyongli has quit IRC00:58
*** heyongli has joined #openstack-infra00:58
*** Swami has quit IRC00:59
*** PollyZ has quit IRC01:00
*** sputnik13_ has joined #openstack-infra01:01
*** garyk has quit IRC01:01
*** cody-somerville has quit IRC01:02
*** ddieterly has quit IRC01:02
*** cody-somerville has joined #openstack-infra01:04
*** cody-somerville has joined #openstack-infra01:04
*** sputnik13 has quit IRC01:04
pabelangerclarkb: how longs are the checks for wait_for now?01:06
clarkbevoque fails pep8 and py27 and not just on xenial01:06
pabelangerthis is for the restart_zuul_launcher.yaml playbook01:06
pabelanger2016-07-12 01:01:15,411 DEBUG zuul.LaunchServer: Stopped01:06
clarkbpabelanger: the length is the asme as before we just use a single ssh connection intead of reconnecting on a poll interval01:06
pabelangerbut ansible wait_for is still waiting01:06
pabelangerHmm01:07
clarkbpabelanger: it checks if the pid file goes away, double check that happened?01:07
pabelangerclarkb: ya, pid is gone01:07
clarkbpabelanger: are you running from puppetmaster?01:07
pabelangerno, locally this time01:08
clarkb(thinking maybe its an ansible version difference?)01:08
pabelangerya, let me double check that01:08
pabelangeransible-playbook 2.0.1.001:08
*** shashank_hegde has quit IRC01:08
pabelangerso, could be that01:08
pabelangerokay, good enough for me01:08
*** heyongli has quit IRC01:08
pabelangerI'll stop my playbook and manually start it01:08
clarkbhttp://docs.ansible.com/ansible/wait_for_module.html01:09
clarkbthe docs don't actually say what the checking interval is01:09
pabelangerya, I noticed that too01:09
clarkbbut it did work on all of the instances I ran it against when using ansible on the puppetmaster01:09
pabelangerack01:09
pabelangerI'll look into it more tomorrow01:10
clarkbok let me know what you fnid. I am about to call it a day for real and go spend time with family01:10
pabelangeryup, same01:10
clarkbI just keep getting nerd sniped by all these failures01:10
clarkbI keep worrying I have stumbled upon some major xenial issue but no its always projects that just don't work01:10
pabelanger#status log zlstatic01.o.o back online01:11
openstackstatuspabelanger: finished logging01:11
*** heyongli has joined #openstack-infra01:11
*** sputnik13_ has quit IRC01:12
*** zhurong has joined #openstack-infra01:12
*** Apoorva_ has joined #openstack-infra01:13
*** akshai has quit IRC01:13
pabelangerjhesketh: ianw: mind helping land https://review.openstack.org/#/c/340543/01:13
*** kzaitsev_mb has quit IRC01:14
ianwpabelanger: ok, not keeping up ... mounted space not enough?01:14
pabelangerianw: incorrect path for job, permission denied01:15
clarkb/opt should have more space fwiw. I too am curious what the motivation behind that is01:15
clarkb+201:15
pabelangerwe also delete contents each build01:16
*** Apoorva has quit IRC01:16
*** Apoorva_ has quit IRC01:17
ianwpabelanger: ahh, no sudo at this point?01:17
*** heyongli has quit IRC01:19
*** heyongli has joined #openstack-infra01:19
openstackgerritJoshua Hesketh proposed openstack-infra/release-tools: Automate retiring old branches  https://review.openstack.org/33387501:20
jheskethpabelanger: looking01:20
*** mtanin___ has joined #openstack-infra01:21
*** thorst has joined #openstack-infra01:21
pabelangerianw: Ya01:21
*** mtanino has quit IRC01:22
*** dimtruck is now known as zz_dimtruck01:24
*** Qiming has joined #openstack-infra01:25
*** heyongli has quit IRC01:29
*** heyongli has joined #openstack-infra01:29
*** xarses has joined #openstack-infra01:29
openstackgerritIan Wienand proposed openstack-infra/system-config: Make sure non-root can write to volume storage  https://review.openstack.org/34063801:30
ianwpabelanger / clarkb : ^ might help.  same thing broke diskimage-builder when i switched it to use /opt as temp space01:30
openstackgerritMerged openstack-infra/project-config: Update PACKAGE_DIR for reprepro-import builder  https://review.openstack.org/34054301:31
*** Daisy has joined #openstack-infra01:32
*** Daisy has quit IRC01:33
*** Daisy has joined #openstack-infra01:33
*** karthikp_ has quit IRC01:35
*** weshay has quit IRC01:37
*** sputnik13 has joined #openstack-infra01:38
*** sflanigan_meetin is now known as sflanigan01:38
*** heyongli has quit IRC01:39
*** heyongli has joined #openstack-infra01:40
*** jaosorior has joined #openstack-infra01:40
*** sputnik13_ has joined #openstack-infra01:40
*** kzaitsev_mb has joined #openstack-infra01:41
*** ajmiller has quit IRC01:42
*** ajmiller has joined #openstack-infra01:42
*** sputnik13 has quit IRC01:43
*** karthikp_ has joined #openstack-infra01:45
*** sputnik13 has joined #openstack-infra01:46
*** sputnik13_ has quit IRC01:46
*** thorst has quit IRC01:47
*** Daisy has quit IRC01:47
*** thorst has joined #openstack-infra01:47
openstackgerritCraige McWhirter proposed openstack-infra/infra-specs: Initial commit of the Pholio spec  https://review.openstack.org/34064101:48
*** rdx_matt has joined #openstack-infra01:49
*** heyongli has quit IRC01:49
*** zul has quit IRC01:50
*** heyongli has joined #openstack-infra01:50
*** jianghuaw has joined #openstack-infra01:51
*** thorst has quit IRC01:51
*** piet has quit IRC01:52
*** rdx_matt has quit IRC01:53
openstackgerritMerged openstack-infra/project-config: Add openstack/fuel-plugin-murano-tests project  https://review.openstack.org/33215101:55
*** thorst has joined #openstack-infra01:55
*** zz_dimtruck is now known as dimtruck01:56
*** thorst has quit IRC01:56
*** thorst has joined #openstack-infra01:56
jianghuawhi, how are the tempest tests divided to workers? I run devstack-gate in my test environment, but I noticed that the longest worker ran much longer than the shortest worker. e.g. 1hr40min v.s. 0hr52min.01:57
jianghuawIs there anyway to make it to be better balanced?01:59
jianghuawthanks.01:59
*** PollyZ has joined #openstack-infra01:59
*** tphummel has quit IRC01:59
*** heyongli has quit IRC02:00
*** ajmiller has quit IRC02:00
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Start fleshing out ansible-launcher tests  https://review.openstack.org/31748202:00
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Clean up results returned from ansible-launcher  https://review.openstack.org/31748102:00
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Add jjb and zmq to requirements  https://review.openstack.org/31675202:00
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Prepare files for testing zuulv25  https://review.openstack.org/31675302:00
*** ajmiller has joined #openstack-infra02:00
*** heyongli has joined #openstack-infra02:00
clarkbjianghuaw: using preseeded subunit files02:00
*** heyongli has quit IRC02:00
clarkbjianghuaw: you could possibly pressed with that data too but I dont have all the details handy02:00
*** zul_ has joined #openstack-infra02:01
*** thorst has quit IRC02:02
*** zul has joined #openstack-infra02:02
jianghuawclarkb: Could you point me where is "preseeded subunit files"?02:02
*** Daisy has joined #openstack-infra02:03
*** PollyZ has quit IRC02:03
openstackgerritJoshua Hesketh proposed openstack-infra/zuul: Move the command processing into the launcher cmd  https://review.openstack.org/33112302:04
clarkbjianghuaw: it happens in project-config/nodepool/elememts somehwere for us02:04
ianwjianguaw: have a look around -> http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n70102:06
ianwjianghuaw: ^02:06
*** csomerville has joined #openstack-infra02:06
jianghuawAh, yes. It is.02:07
jianghuawclarkb and ianw: Thanks very much. Very helpful.02:07
*** sdake has joined #openstack-infra02:09
*** cody-somerville has quit IRC02:10
*** zul_ has quit IRC02:10
*** kzaitsev_mb has quit IRC02:13
*** Sukhdev_ has quit IRC02:15
*** Daisy_ has joined #openstack-infra02:16
*** Daisy has quit IRC02:17
*** karthikp_ has quit IRC02:18
*** karthikp_ has joined #openstack-infra02:19
openstackgerritPaul Belanger proposed openstack-infra/system-config: Give jenkins permission to read packaging_keytab  https://review.openstack.org/34064602:21
*** EricGonczer_ has joined #openstack-infra02:21
*** rockstar_ has joined #openstack-infra02:24
*** rkukura has quit IRC02:26
*** sputnik13 has quit IRC02:27
*** rockstar has quit IRC02:28
*** yanyanhu has joined #openstack-infra02:32
*** yanyanhu_ has joined #openstack-infra02:32
*** yanyanhu_ has quit IRC02:32
*** gongysh has joined #openstack-infra02:34
*** amotoki has joined #openstack-infra02:36
*** rfolco has quit IRC02:39
ianw^ pabelanger : doesn't that mean you could "cat" it, and ...02:40
*** yamahata has quit IRC02:40
*** rossella_s has quit IRC02:40
*** rossella_s has joined #openstack-infra02:40
*** kzaitsev_mb has joined #openstack-infra02:40
*** piet has joined #openstack-infra02:43
*** mtanino has joined #openstack-infra02:45
*** mtanin___ has quit IRC02:47
*** EricGonczer_ has quit IRC02:47
*** rkukura has joined #openstack-infra02:49
*** rdx_matt has joined #openstack-infra02:50
*** mtanino has quit IRC02:50
*** krtaylor has joined #openstack-infra02:50
openstackgerritSachi King proposed openstack-infra/zuul: Support post jobs by supporting rev checkout  https://review.openstack.org/29319402:52
*** piet has quit IRC02:54
*** rdx_matt has quit IRC02:54
*** piet has joined #openstack-infra02:54
*** EricGonczer_ has joined #openstack-infra02:55
*** Daisy_ has quit IRC02:57
*** Daisy has joined #openstack-infra02:57
*** sarob has joined #openstack-infra02:57
*** amotoki has quit IRC02:59
openstackgerritWeiwei Gu proposed openstack-dev/pbr: Fix argument order for assertEqual to (expected, observed)  https://review.openstack.org/34065403:00
*** ddieterly has joined #openstack-infra03:01
*** Daisy has quit IRC03:02
*** caowei has joined #openstack-infra03:02
*** kzaitsev_mb has quit IRC03:10
*** zhurong has quit IRC03:11
*** Daisy has joined #openstack-infra03:12
*** zhurong has joined #openstack-infra03:12
*** sflanigan is now known as sflanigan_meetin03:12
*** sflanigan_meetin is now known as sflanigan_afk03:12
pabelangerianw: it does, but that's how we do it for afsadmin.keytab too03:13
pabelangerianw: but it runs on our static workers, so we have somewhat control on what can touch it03:13
pabelangerhttp://logs.openstack.org/20/340520/4/experimental/reprepro-import-debian-openstack-jessie/109caed/console.html03:14
pabelangerwith it working properly03:14
pabelangerianw: jhesketh if you can help land 340646 I would appreciate it03:14
*** ddieterly has quit IRC03:15
openstackgerritEric Brown proposed openstack-infra/project-config: Enable py35 voting on oslo.config  https://review.openstack.org/34065703:15
*** ajmiller has quit IRC03:16
*** ajmiller has joined #openstack-infra03:16
*** piet has quit IRC03:16
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: ZooKeeper API  https://review.openstack.org/34065803:17
*** treaki_ has joined #openstack-infra03:18
*** amotoki has joined #openstack-infra03:21
*** treaki__ has quit IRC03:22
openstackgerritEric Brown proposed openstack-infra/project-config: Enable py35 voting on oslo.utils  https://review.openstack.org/34066203:23
*** ramishra has quit IRC03:24
*** EricGonczer_ has quit IRC03:25
*** amotoki has quit IRC03:26
*** ramishra has joined #openstack-infra03:26
*** ajmiller has quit IRC03:26
*** ajmiller has joined #openstack-infra03:27
*** yamamoto has quit IRC03:27
*** yamamoto has joined #openstack-infra03:27
*** amotoki has joined #openstack-infra03:27
*** shashank_hegde has joined #openstack-infra03:27
*** yamahata has joined #openstack-infra03:28
*** armax has quit IRC03:29
*** markvoelker has joined #openstack-infra03:32
*** Daisy has quit IRC03:32
*** Daisy has joined #openstack-infra03:33
*** garyk has joined #openstack-infra03:34
*** markvoelker_ has joined #openstack-infra03:35
*** Daisy has quit IRC03:37
*** shashank_hegde has quit IRC03:37
*** shashank_hegde has joined #openstack-infra03:37
*** kushal has joined #openstack-infra03:37
*** markvoelker has quit IRC03:38
*** sflanigan_afk is now known as sflanigan03:40
*** karthikp_ has quit IRC03:43
*** gouthamr has joined #openstack-infra03:44
*** PollyZ has joined #openstack-infra03:45
*** markvoelker has joined #openstack-infra03:46
*** gouthamr has quit IRC03:49
*** amotoki has quit IRC03:49
*** markvoelker_ has quit IRC03:49
*** shashank_hegde has quit IRC03:50
*** rdx_matt has joined #openstack-infra03:50
*** mtanino has joined #openstack-infra03:51
*** _sarob has joined #openstack-infra03:52
*** sarob has quit IRC03:53
*** rdx_matt has quit IRC03:55
*** gouthamr_ has joined #openstack-infra03:56
*** julim has quit IRC03:58
*** amotoki has joined #openstack-infra03:59
*** tqtran has quit IRC04:00
*** shashank_hegde has joined #openstack-infra04:00
*** links has joined #openstack-infra04:02
*** ramishra has quit IRC04:04
*** ajmiller has quit IRC04:05
*** ajmiller has joined #openstack-infra04:05
openstackgerritIan Wienand proposed openstack-infra/project-config: Add Fedora 24 nodes  https://review.openstack.org/34067104:06
openstackgerritIan Wienand proposed openstack-infra/project-config: Add experimental Fedora 24 job  https://review.openstack.org/34067204:06
*** ramishra has joined #openstack-infra04:07
*** sree has joined #openstack-infra04:07
*** flepied1 has joined #openstack-infra04:10
*** flepied has quit IRC04:11
*** Ravikiran_K has quit IRC04:13
*** Sukhdev has joined #openstack-infra04:14
*** shashank_hegde has quit IRC04:16
*** ramishra has quit IRC04:19
*** gongysh has quit IRC04:21
*** ramishra has joined #openstack-infra04:21
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Refactor to accept java_home from parent modules  https://review.openstack.org/33152304:21
openstackgerritJin Jing Lin proposed openstack-infra/project-config: Enable Neutron VPNaaS API CI tests  https://review.openstack.org/33701104:23
*** davidlenwell has quit IRC04:28
*** dimtruck is now known as zz_dimtruck04:29
*** ramishra has quit IRC04:31
*** ramishra has joined #openstack-infra04:31
*** coolsvap has joined #openstack-infra04:37
*** davidlenwell has joined #openstack-infra04:38
clarkbjacket is another project with no code04:41
*** ramishra has quit IRC04:41
*** gouthamr_ has quit IRC04:42
*** ramishra has joined #openstack-infra04:43
*** _sarob has quit IRC04:46
*** sarob has joined #openstack-infra04:46
*** pahuang_ has quit IRC04:51
*** rdx_matt has joined #openstack-infra04:51
*** pahuang has joined #openstack-infra04:53
*** rdx_matt has quit IRC04:56
*** psachin has joined #openstack-infra04:56
*** caowei has quit IRC04:56
*** xyang1 has quit IRC04:58
*** tqtran has joined #openstack-infra04:59
*** shashank_hegde has joined #openstack-infra04:59
*** ramishra has quit IRC05:00
*** d0ugal has quit IRC05:01
*** fawadkhaliq has joined #openstack-infra05:01
*** ramishra has joined #openstack-infra05:01
*** flepied1 has quit IRC05:02
*** tqtran has quit IRC05:03
*** shashank_hegde has quit IRC05:04
*** caowei has joined #openstack-infra05:05
*** Daisy has joined #openstack-infra05:05
*** flepied has joined #openstack-infra05:07
*** kzaitsev_mb has joined #openstack-infra05:07
*** Daisy has quit IRC05:07
*** flepied has quit IRC05:08
*** hurgleburgler has joined #openstack-infra05:09
*** sree has quit IRC05:10
*** Daisy has joined #openstack-infra05:10
*** shashank_hegde has joined #openstack-infra05:12
*** kzaitsev_mb has quit IRC05:12
*** caowei has quit IRC05:13
*** sree has joined #openstack-infra05:14
*** markvoelker_ has joined #openstack-infra05:16
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs  https://review.openstack.org/34034605:16
zaroi made my change (https://review.openstack.org/#/c/331523/) depend on your change (https://review.openstack.org/#/c/340529/) which you thought might fix the lint puppet-lint job on my change but it doesn't seem to fix.  would this be considered a satisfactory test that your change doesn't fix what you thought it might?05:18
*** zeih has quit IRC05:18
*** david-lyle has joined #openstack-infra05:18
*** markvoelker has quit IRC05:19
zaroclarkb: would be nice to cleanup gerrit once in a while.05:19
*** ajmiller has quit IRC05:21
*** ajmiller has joined #openstack-infra05:22
*** sandanar_ has joined #openstack-infra05:24
*** sandanar has joined #openstack-infra05:24
*** sdake_ has joined #openstack-infra05:25
*** Daisy has quit IRC05:29
*** Daisy has joined #openstack-infra05:29
*** Daisy_ has joined #openstack-infra05:31
*** Daisy has quit IRC05:31
*** yanyanhu has quit IRC05:32
*** Daisy_ has quit IRC05:33
*** Daisy has joined #openstack-infra05:34
jesusaurzaro: no, the tests always use master for openstack_infra_spec_helper, so depending on the change doesn't have any effect :(05:34
*** hurgleburgler has quit IRC05:34
*** ramishra has quit IRC05:35
jesusaurI tried looking into how to use a zuul ref for the spec helper, but it looks like bundler doesn't support that kind of thing05:35
sdake_AJaeger ping05:35
sdake_AJaeger i think i messed up your recheck of the ceph gate05:35
*** isaacb has joined #openstack-infra05:35
*** savihou has joined #openstack-infra05:36
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Refactor to accept java_home from parent modules  https://review.openstack.org/33152305:38
*** itisha has quit IRC05:40
*** esberglu has quit IRC05:41
*** savihou has quit IRC05:41
*** savihou has joined #openstack-infra05:42
*** arif-ali has quit IRC05:45
*** markvoelker_ has quit IRC05:45
*** PollyZ has quit IRC05:46
*** coolsvap has quit IRC05:46
clarkbzaro: ya I am going to script up a check for empty repos tomorrow I think and ping thwir owners05:48
*** hashar has joined #openstack-infra05:52
*** rdx_matt has joined #openstack-infra05:52
*** Sukhdev has quit IRC05:53
sdake_AJaeger i can tell you rax.ord does not have the sources.available.d dir05:53
*** binbincong has quit IRC05:53
sdake_pabelanger looked in one on of the images earlier and it had it on a different cloud provider05:53
*** Ravikiran_K has joined #openstack-infra05:54
*** javeriak has joined #openstack-infra05:55
*** sarob has quit IRC05:55
sdake_clarkb any idea on the sources.d thing - been nt workign for 3+ days05:55
sdake_not in a uper rush05:56
sdake_but just want to make sure its working before i add more mirrors05:56
sdake_nt/not05:56
*** rdx_matt has quit IRC05:57
*** fawadkhaliq has quit IRC05:58
*** rcernin has joined #openstack-infra05:58
*** Rockyg has quit IRC05:59
*** rkukura has quit IRC06:00
*** gongysh has joined #openstack-infra06:03
*** amotoki has quit IRC06:03
*** d0ugal has joined #openstack-infra06:04
*** binbincong has joined #openstack-infra06:08
*** rkukura has joined #openstack-infra06:10
*** pgadiya has joined #openstack-infra06:10
*** lennyb has quit IRC06:12
*** rajinir has quit IRC06:15
*** isaacb has quit IRC06:17
*** amotoki has joined #openstack-infra06:17
*** shardy has joined #openstack-infra06:17
openstackgerritMerged openstack-infra/project-config: Add an experimental grenade multinode job for Neutron Linuxbridge  https://review.openstack.org/33679306:17
*** ramishra has joined #openstack-infra06:19
*** lennyb has joined #openstack-infra06:20
*** sdake has quit IRC06:22
*** Daisy_ has joined #openstack-infra06:23
*** mtanino has quit IRC06:24
*** Daisy has quit IRC06:26
lennybgmann: Could you, pls, review #link https://review.openstack.org/#/c/33544706:28
*** pahuang has quit IRC06:30
*** ramishra has quit IRC06:30
*** ramishra has joined #openstack-infra06:31
*** sree has quit IRC06:34
*** sree has joined #openstack-infra06:35
openstackgerritEric Brown proposed openstack-infra/project-config: Enable py35 voting on vmware-nsx  https://review.openstack.org/34070806:35
*** nadya has joined #openstack-infra06:40
*** pahuang has joined #openstack-infra06:42
*** d0ugal has quit IRC06:43
*** mahatic has quit IRC06:45
*** nadya has quit IRC06:45
*** csomerville has quit IRC06:46
*** zeih has joined #openstack-infra06:46
*** slaweq has joined #openstack-infra06:48
*** caowei has joined #openstack-infra06:48
*** sdake_ has quit IRC06:49
*** yolanda has quit IRC06:50
*** mahatic has joined #openstack-infra06:50
*** isaacb has joined #openstack-infra06:50
*** yolanda has joined #openstack-infra06:50
*** nmagnezi has joined #openstack-infra06:50
*** andreas_s has joined #openstack-infra06:50
*** jswarren_ has quit IRC06:52
*** amotoki has quit IRC06:52
*** rdx_matt has joined #openstack-infra06:53
openstackgerritSteven Hardy proposed openstack-infra/tripleo-ci: Temporarily pin puppet-ceph to stable/hammer  https://review.openstack.org/34071706:53
*** yolanda has quit IRC06:55
*** fawadkhaliq has joined #openstack-infra06:56
*** yanyanhu has joined #openstack-infra06:57
*** rdx_matt has quit IRC06:58
*** fawadkhaliq has quit IRC06:59
*** fawadkhaliq has joined #openstack-infra06:59
jamespagekzaitsev_ws, yes - coreycb or I are good for ubuntu package queries06:59
*** andymaier has joined #openstack-infra06:59
*** tesseract- has joined #openstack-infra07:00
*** pcaruana has joined #openstack-infra07:00
*** shardy has quit IRC07:01
*** tqtran has joined #openstack-infra07:01
*** yolanda has joined #openstack-infra07:03
yolandagood morning07:03
*** liusheng has joined #openstack-infra07:04
*** ociuhandu has quit IRC07:06
*** tqtran has quit IRC07:06
*** ljjjustin has joined #openstack-infra07:08
*** jianghuaw has quit IRC07:10
*** yanyanhu_ has joined #openstack-infra07:12
*** ramishra has quit IRC07:13
*** yanyanhu has quit IRC07:14
*** amotoki has joined #openstack-infra07:14
*** ramishra has joined #openstack-infra07:15
*** karthikp_ has joined #openstack-infra07:16
*** dtardivel has joined #openstack-infra07:16
*** Nikolay_St has joined #openstack-infra07:18
*** garyk has quit IRC07:19
*** amotoki has quit IRC07:19
*** karthikp_ has quit IRC07:20
*** garyk has joined #openstack-infra07:21
*** david-lyle has quit IRC07:22
*** ifarkas has joined #openstack-infra07:23
*** Daisy has joined #openstack-infra07:30
*** Daisy_ has quit IRC07:33
openstackgerritMerged openstack-infra/system-config: Give jenkins permission to read packaging_keytab  https://review.openstack.org/34064607:35
*** vincentll has joined #openstack-infra07:36
*** Daisy has quit IRC07:36
*** Daisy has joined #openstack-infra07:36
openstackgerritMerged openstack-infra/project-config: Use template for python35 everywhere  https://review.openstack.org/33976907:40
*** jlanoux has joined #openstack-infra07:43
*** zhurong has quit IRC07:46
*** eezhova has joined #openstack-infra07:46
openstackgerritMerged openstack-infra/project-config: Cleanup after ansible EOLing  https://review.openstack.org/34038407:46
*** zhurong has joined #openstack-infra07:47
openstackgerritMerged openstack-infra/project-config: Remove neutron full job from neutron-vpnaas queues  https://review.openstack.org/34057107:48
*** flepied has joined #openstack-infra07:49
openstackgerritMerged openstack-infra/project-config: make gate-vmware-nsx-python34 voting  https://review.openstack.org/33972407:49
openstackgerritMerged openstack-infra/project-config: Don't run gate-cinder-tox-db-functional on stable/liberty  https://review.openstack.org/34060407:51
*** dfflanders has quit IRC07:52
*** daemontool has joined #openstack-infra07:53
*** rdx_matt has joined #openstack-infra07:53
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs  https://review.openstack.org/34034607:54
*** mikelk has joined #openstack-infra07:54
*** flepied has quit IRC07:54
*** dizquierdo has joined #openstack-infra07:56
*** pt_15 has quit IRC07:56
*** zeih has quit IRC07:56
*** mrmartin has joined #openstack-infra07:58
*** ramishra has quit IRC07:58
*** rdx_matt has quit IRC07:58
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs  https://review.openstack.org/34034607:58
*** coolsvap has joined #openstack-infra07:59
*** ramishra has joined #openstack-infra07:59
*** fawadkhaliq has quit IRC07:59
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-infra08:00
*** arxcruz has joined #openstack-infra08:00
*** zeih has joined #openstack-infra08:01
*** fawadkhaliq has joined #openstack-infra08:01
therveWe're having very poor connectivity to tarballs.openstack.org recently08:03
therveI don't know where the problem comes from, but it got worse in the past week or so08:03
*** asettle has joined #openstack-infra08:04
*** fawadkhaliq has quit IRC08:05
*** sorantis has joined #openstack-infra08:06
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs  https://review.openstack.org/34034608:07
*** amotoki has joined #openstack-infra08:09
*** kzaitsev_mb has joined #openstack-infra08:09
*** john-davidge has joined #openstack-infra08:09
*** john-dav_ has joined #openstack-infra08:11
*** john-dav_ is now known as john-davidge_08:11
rakhmerovhi, I'm trying to get this done: https://review.openstack.org/#/c/34034608:11
rakhmerovand seems like I need some help from your team08:11
rakhmerovis anybody available?08:12
*** jlanoux has quit IRC08:13
*** jlanoux has joined #openstack-infra08:13
*** amotoki has quit IRC08:13
*** jtomasek_ has joined #openstack-infra08:13
*** john-davidge has quit IRC08:14
yolandahi rakhmerov , project-config cores and infra cores go through review queue daily. Your change will be reviewed soon08:14
*** kzaitsev_mb has quit IRC08:15
*** ramishra has quit IRC08:15
*** lucas|afk is now known as lucasagomes08:15
rakhmerovyeah, I know you review quickly, but I wanted to save time and ask some basic questions to reduce overall merge time )08:15
yolandawhat do you need?08:15
*** jpich has joined #openstack-infra08:15
rakhmerovyolanda: we have "mistral-extra" repo which is configured to run standard jobs (py27, py34, pep8), I want to disable all these jobs08:16
rakhmerovand I don't understand what changes I need to do in jenkins/jobs/projects.yaml08:17
*** ramishra has joined #openstack-infra08:17
rakhmerovcan I still leave something like python-jobs in "jobs" section or should I replace it with something else08:17
yolandayou need to remove any specific job that affects only to mistra-extra if you have any, and in zuul/layout.yaml remove that jobs, and add just merge-check and noop-jobs08:17
*** gongysh has quit IRC08:17
rakhmerovvalid changes in zuul/layout.yaml are well explained in the doc08:17
*** AJaeger has quit IRC08:18
rakhmerovzuul/layout.yaml is fine, I did it08:18
yolandarakhmerov, if you don't need any job in mistral-extra, just remove the entry from jenkins/jobs/projects.yaml08:18
rakhmerovooh, ok08:18
rakhmerovthat's what I need to do08:18
*** Na3iL has joined #openstack-infra08:19
rakhmerovyolanda: thanks a bunch!08:19
yolandarakhmerov, glad to help08:19
*** coolsvap_ has joined #openstack-infra08:19
*** derekh has joined #openstack-infra08:20
*** rdx_matt has joined #openstack-infra08:22
*** jistr has joined #openstack-infra08:22
*** coolsvap has quit IRC08:22
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs  https://review.openstack.org/34034608:22
*** zeih has quit IRC08:24
*** zeih has joined #openstack-infra08:26
*** shashank_hegde has quit IRC08:27
openstackgerritMerged openstack-infra/tripleo-ci: Bump up the number of OVB env workers available  https://review.openstack.org/34035908:28
*** EricGonczer_ has joined #openstack-infra08:28
*** snarwade has quit IRC08:34
*** snarwade has joined #openstack-infra08:34
*** watersoul has quit IRC08:35
*** nadya has joined #openstack-infra08:36
*** watersoul has joined #openstack-infra08:36
*** ajmiller has quit IRC08:37
*** sshnaidm|afk is now known as sshnaidm08:38
*** ajmiller has joined #openstack-infra08:38
*** pgadiya has quit IRC08:38
*** pgadiya has joined #openstack-infra08:41
*** Daisy_ has joined #openstack-infra08:43
*** chem has joined #openstack-infra08:43
*** Na3iL has quit IRC08:45
*** coolsvap_ has quit IRC08:46
*** alexey_weyl has joined #openstack-infra08:48
*** Daisy has quit IRC08:48
alexey_weylHi,08:49
alexey_weylWe are having a problem in Vitrage project in the tempests, and we think that there might have happened some changes in openstack that maybe causing that08:50
alexey_weylWhen we run the tempests we can see in the vitrage logs that:08:50
alexey_weyl"08:50
alexey_weyl"DiscoveryFailure: Could not determine a suitable URL for the plugin" happens08:50
*** e0ne has joined #openstack-infra08:50
alexey_weylYou can see that here:08:51
alexey_weyl#link http://logs.openstack.org/75/340275/3/check/gate-vitrage-dsvm-api/17314e5/logs/screen-vitrage-graph.txt.gz08:51
alexey_weylat 2016-07-11 14:27:49.75908:51
*** sree has quit IRC08:51
alexey_weylMaybe you are familiar with that problem?08:52
*** sorantis has quit IRC08:52
*** sflanigan has quit IRC08:52
*** javeriak has quit IRC08:54
*** electrofelix has joined #openstack-infra08:56
*** sorantis has joined #openstack-infra08:56
*** pgadiya has quit IRC08:57
*** idan_hefetz has joined #openstack-infra08:58
*** pgadiya has joined #openstack-infra08:59
*** dizquierdo has quit IRC09:00
*** yamahata has quit IRC09:02
*** fawadkhaliq has joined #openstack-infra09:02
*** tqtran has joined #openstack-infra09:03
*** amotoki has joined #openstack-infra09:03
*** arxcruz has quit IRC09:03
mordredalexey_weyl: looks like an issue with your clinet connections and your auth parameters ... jamielennox ^^ ? yeah?09:05
*** tosky has joined #openstack-infra09:06
*** fawadkhaliq has quit IRC09:06
*** xarses_ has joined #openstack-infra09:07
*** claudiub has joined #openstack-infra09:07
*** tqtran has quit IRC09:07
*** xarses has quit IRC09:07
*** xarses_ has quit IRC09:07
*** gongysh has joined #openstack-infra09:07
*** xarses_ has joined #openstack-infra09:08
*** dtantsur|afk is now known as dtantsur09:08
*** sputnik13 has joined #openstack-infra09:08
alexey_weylI agree, but I checked and saw that in Vitrage nothing has changed in that area, and thus I don't see why this is happening09:08
alexey_weylbecause until now it worked09:08
*** raildo-afk has quit IRC09:09
*** amotoki has quit IRC09:09
mordredalexey_weyl: I haven't been following changes in this area recently... hopefully jamielennox has some thoughts or knows who to go poke09:10
*** Daisy_ has quit IRC09:10
*** Daisy has joined #openstack-infra09:11
*** EricGonczer_ has quit IRC09:12
*** caowei has quit IRC09:13
*** ramishra has quit IRC09:14
*** ramishra has joined #openstack-infra09:15
*** Daisy has quit IRC09:15
*** arxcruz has joined #openstack-infra09:17
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Temporarily pin puppet-ceph to stable/hammer  https://review.openstack.org/34071709:19
openstackgerritOleksii Zamiatin proposed openstack-infra/project-config: Turn zmq gates to voting  https://review.openstack.org/34043909:20
*** yamahata has joined #openstack-infra09:22
*** caowei has joined #openstack-infra09:23
*** fawadkhaliq has joined #openstack-infra09:24
*** ramishra has quit IRC09:25
*** binbincong has quit IRC09:26
*** ramishra has joined #openstack-infra09:26
*** _degorenko|afk is now known as degorenko09:27
*** binbincong has joined #openstack-infra09:28
*** ccamacho has joined #openstack-infra09:28
openstackgerritChangBo Guo(gcb) proposed openstack-dev/pbr: Add Python 3.5 classifier and venv  https://review.openstack.org/34081309:28
openstackgerritVladimir Kozhukalov proposed openstack-infra/project-config: Disable fuel-mirror pep8 jobs for master.  https://review.openstack.org/34081409:28
openstackgerritOleksii Zamiatin proposed openstack-infra/project-config: [zmq] Use proper driver name to configure devstack  https://review.openstack.org/33905009:29
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571309:30
openstackgerritVladimir Kozhukalov proposed openstack-infra/project-config: Disable all gate jobs for fuel-mirror master  https://review.openstack.org/34081409:30
*** caowei has quit IRC09:32
*** kzaitsev_mb has joined #openstack-infra09:35
openstackgerritMerged openstack-infra/project-config: Add a bandit non-voting for Kolla  https://review.openstack.org/29007009:35
*** zeih has quit IRC09:36
*** shardy has joined #openstack-infra09:40
*** ramishra has quit IRC09:43
*** ramishra has joined #openstack-infra09:46
*** Guest2250 has quit IRC09:47
*** jaosorior has quit IRC09:49
*** jaosorior has joined #openstack-infra09:49
*** gongysh has quit IRC09:53
openstackgerritDerek Higgins proposed openstack-infra/tripleo-ci: Only run kill if there is a httpserver to kill  https://review.openstack.org/34082909:56
*** amotoki has joined #openstack-infra09:57
*** ajmiller has quit IRC09:59
*** ajmiller has joined #openstack-infra09:59
*** javeriak has joined #openstack-infra10:00
*** dizquierdo has joined #openstack-infra10:00
*** d0ugal has joined #openstack-infra10:02
*** amotoki has quit IRC10:02
*** yamahata has quit IRC10:03
jamielennoxalexey_weyl: there's a few things that could cause it, i would take the auth params and try them in osc with the --debug flag and see what its hitting10:07
jamielennoxalexey_weyl: the first thing i see as a problem is admin_endpoint in http://logs.openstack.org/75/340275/3/check/gate-vitrage-dsvm-api/17314e5/logs/etc/keystone/keystone.conf.txt.gz10:07
jamielennoxbut i don't know if/why vitrage would be changing that from the standard devstack config10:08
*** eezhova has quit IRC10:09
jamielennoxbut i can't think of recent changes that would have messed with this from an auth end10:09
*** kzaitsev_mb has quit IRC10:10
*** eezhova has joined #openstack-infra10:12
*** zhurong has quit IRC10:13
*** Julien-zte has quit IRC10:13
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571310:15
openstackgerritMarton Kiss proposed openstack-infra/groups: Add https support for mapbox urls  https://review.openstack.org/34083610:16
*** eezhova has quit IRC10:21
*** yanyanhu_ has quit IRC10:24
*** Julien-zte has joined #openstack-infra10:24
*** sorantis has quit IRC10:24
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Add new "mistral-lib" project  https://review.openstack.org/34084410:25
openstackgerritMerged openstack-infra/tripleo-ci: Remove tripleo-jobs.py  https://review.openstack.org/33765710:26
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Change mistral-extra jobs  https://review.openstack.org/34034610:29
*** jlanoux_ has joined #openstack-infra10:29
*** zeih has joined #openstack-infra10:30
*** jlanoux has quit IRC10:30
*** berendt has quit IRC10:33
*** rossella_s has quit IRC10:40
*** rossella_s has joined #openstack-infra10:40
openstackgerritRenat Akhmerov proposed openstack-infra/project-config: Add new "mistral-lib" project  https://review.openstack.org/34084410:42
*** jlanoux_ has quit IRC10:44
*** jlanoux has joined #openstack-infra10:44
dulekHi everyone! We can notice some strange python jobs failures in Cinder gate: http://logs.openstack.org/80/337580/9/check/gate-cinder-python34-db/086b9af/console.html10:45
*** rodrigods has quit IRC10:48
*** rodrigods has joined #openstack-infra10:48
*** arif-ali has joined #openstack-infra10:50
*** eezhova has joined #openstack-infra10:56
*** apuimedo is now known as apuimedo|lunch10:57
rcarrillocruzmordred: https://review.openstack.org/#/c/315713/ fixes the func tests10:58
rcarrillocruzi need to sort out why now the unit tests are failing (some mock related errors) and we should be good10:58
rcarrillocruzShrews: ^10:58
rcarrillocruzregardless, i really think we should get to the bottom of the admin vs non-admin performance issue11:02
rcarrillocruzasselin__: ^11:04
asselin__rcarrillocruz, will try it out11:05
*** julim has joined #openstack-infra11:05
*** gyx has joined #openstack-infra11:06
*** kzaitsev_mb has joined #openstack-infra11:06
asselin__rcarrillocruz, were you able to reproduce the issue with clouds.yaml verify=false?11:07
*** sdake has joined #openstack-infra11:07
rcarrillocruzi haven't reached to that yet, being drowned by shade gate issues11:08
asselin__ok11:08
gyxIs this temptest?11:08
*** sdake_ has joined #openstack-infra11:08
asselin__rcarrillocruz, so how is the "ansible master" deployed?11:09
rcarrillocruzit can be any machine with the ansible-role-puppet installed and some hiera11:09
rcarrillocruzthing is, this was reused from puppetmaster11:10
openstackgerritMerged openstack-infra/tripleo-ci: Remove Fedora support from CI scripts  https://review.openstack.org/33821011:10
rcarrillocruzso it expects the same hiera datastructure11:10
openstackgerritMerged openstack-infra/tripleo-ci: Remove pointless case clause  https://review.openstack.org/33872511:10
kzaitsev_mbjamespage: zul: coreyob: is anyone of you guys the correct person to ask about ubuntu packages?11:11
*** zeih has quit IRC11:11
jamespagekzaitsev_mb, yes - ask away11:11
rcarrillocruzone of the things i hope to do in infra-ansible11:11
rcarrillocruzis to put puppetdb ( i have some wip around  for puppet-openstackci )11:11
rcarrillocruzproblem is, puppetdb requires ssl11:11
rcarrillocruzand you have two options:11:11
rcarrillocruz1. install a puppetmaster to reuse its CA11:11
rcarrillocruz2. put puppetdb behind a ssl reverse proxy11:12
rcarrillocruzin infra they just used 1, since they just reused puppetmaster11:12
rcarrillocruzbut for puppetopsntak ci it would be overkill11:12
*** berendt has joined #openstack-infra11:12
rcarrillocruzneed to find some time to implement 211:12
asselin__agree11:12
*** sdake has quit IRC11:13
*** Nikolay_St has quit IRC11:13
*** rdxnoam has quit IRC11:14
gyxIs this the channel for temptest?11:15
*** mrmartin has quit IRC11:15
*** Nikolay_St has joined #openstack-infra11:16
rcarrillocruzgyx: try better #openstack-qa11:16
*** winggundamth has quit IRC11:16
openstackgerritMerged openstack-infra/groups: Add https support for mapbox urls  https://review.openstack.org/34083611:16
*** psilvad has quit IRC11:17
*** gyx has left #openstack-infra11:17
*** idan_hefetz has left #openstack-infra11:17
openstackgerritSam Betts proposed openstack-infra/project-config: Refactor Ironic job macro  https://review.openstack.org/34056711:18
*** tpsilva has joined #openstack-infra11:20
*** zubchick has joined #openstack-infra11:22
*** julim has quit IRC11:23
*** amotoki has joined #openstack-infra11:25
*** ddieterly has joined #openstack-infra11:26
openstackgerritGraham Hayes proposed openstack-infra/project-config: Fix designate-identity-v3-only tempest job  https://review.openstack.org/34087811:29
*** ddieterly has quit IRC11:31
*** watersoul has quit IRC11:31
*** watersoul_ has joined #openstack-infra11:32
*** dizquierdo has quit IRC11:33
openstackgerritXiang Chen proposed openstack/diskimage-builder: Fix a bug when using yum-minimal  https://review.openstack.org/34088411:35
zubchickHi folks. Is some environment variable exists that I can use in my tox.ini to determine branch name when commit/gate tests run on Jenkins?11:38
*** ldnunes has joined #openstack-infra11:39
*** chem is now known as chem|away11:40
*** thorst has joined #openstack-infra11:41
*** weshay has joined #openstack-infra11:42
*** sorantis has joined #openstack-infra11:43
rcarrillocruzZUUL_BRANCH ?11:43
*** asettle has quit IRC11:44
*** sambetts|afk is now known as sambetts11:44
rcarrillocruzbut that's available on the test itself11:45
rcarrillocruznot on tox.ini11:45
rcarrillocruznot sure what you are after11:45
*** fawadkhaliq has quit IRC11:50
*** rfolco has joined #openstack-infra11:51
*** chem|away has quit IRC11:55
*** jokke_ has quit IRC11:59
*** asettle has joined #openstack-infra11:59
*** mrmartin has joined #openstack-infra11:59
*** jokke_ has joined #openstack-infra11:59
*** markusry has joined #openstack-infra11:59
*** Julien-zte has quit IRC12:03
*** asettle has quit IRC12:04
*** lucasagomes is now known as lucas-hungry12:04
*** pradk has joined #openstack-infra12:04
Zarahm, trusty doesn't like https://review.openstack.org/#/c/330925/11 or https://review.openstack.org/#/c/340605/1 . seems to be the same sort of thing for both (only skimmed logs so far)12:05
*** tqtran has joined #openstack-infra12:05
javeriakhello, can someone please point me to the steps for tagging an openstack repo?12:05
*** ddieterly has joined #openstack-infra12:06
*** Julien-zte has joined #openstack-infra12:06
dtardivelhi folks, could you help me about this changset https://review.openstack.org/#/c/327095/ which should be merged by Gerrit, and unfortunately I feel it's stuck somewhere in the gate :/12:06
*** abregman has joined #openstack-infra12:07
*** zeih has joined #openstack-infra12:08
*** tqtran has quit IRC12:10
*** abregman has quit IRC12:10
*** abregman has joined #openstack-infra12:11
*** amotoki_ has joined #openstack-infra12:13
*** amotoki has quit IRC12:13
*** TaylorHuang has joined #openstack-infra12:14
*** ccamacho is now known as ccamacho|lunch12:15
*** ajmiller has quit IRC12:16
*** sdake_ has quit IRC12:16
*** ajmiller has joined #openstack-infra12:16
*** fawadkhaliq has joined #openstack-infra12:17
*** TaylorH has quit IRC12:17
*** dizquierdo has joined #openstack-infra12:17
*** cbader has joined #openstack-infra12:19
*** asettle has joined #openstack-infra12:20
*** fawadkhaliq has quit IRC12:20
*** akshai has joined #openstack-infra12:20
*** piet has joined #openstack-infra12:22
*** psachin has quit IRC12:24
*** gouthamr has joined #openstack-infra12:24
*** asettle has quit IRC12:25
*** zeih has quit IRC12:25
*** zhurong has joined #openstack-infra12:26
*** trown|outtypewww is now known as trown12:26
*** dprince has joined #openstack-infra12:27
*** zeih has joined #openstack-infra12:27
Zaraattempted to help debug gerrit-storyboard plugin config. I think https://review.openstack.org/#/c/330925/ is failing to find a certificate file or something, which seems familiar. I have no idea what's up with https://review.openstack.org/#/c/340605/ ; the error message cites a file which isn't changed as part of the patch. any ideas appreciated. :)12:28
*** Nikolay_St has quit IRC12:28
*** mdrabe has joined #openstack-infra12:31
*** ddieterly is now known as ddieterly[away]12:31
*** ddieterly[away] is now known as ddieterly12:31
*** ddieterly has quit IRC12:32
*** kgiusti has joined #openstack-infra12:32
*** sree has joined #openstack-infra12:32
*** apuimedo|lunch is now known as apuimedo12:32
*** akshai has quit IRC12:33
* Zara finds https://review.openstack.org/#/c/331523/ 12:33
*** Julien-zte has quit IRC12:33
*** markvoelker has joined #openstack-infra12:34
ZaraI'm gonna hazard a guess that that's what the second patch was talking about...12:34
*** psachin has joined #openstack-infra12:34
*** ddieterly has joined #openstack-infra12:35
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571312:36
*** psilvad has joined #openstack-infra12:37
*** ihrachys has joined #openstack-infra12:37
*** baoli has joined #openstack-infra12:39
*** piet has quit IRC12:40
*** piet has joined #openstack-infra12:40
*** weshay is now known as weshay_mtg12:40
*** amotoki_ has quit IRC12:41
*** ddieterly has quit IRC12:42
*** dizquierdo has quit IRC12:45
*** Goneri has joined #openstack-infra12:46
*** saggi1 has joined #openstack-infra12:46
*** ccamacho|lunch is now known as ccamacho12:46
*** john-davidge_ is now known as john-davidge12:47
*** thiagop has joined #openstack-infra12:47
*** rlandy has joined #openstack-infra12:47
*** baoli_ has joined #openstack-infra12:47
*** jed56 has joined #openstack-infra12:47
*** burgerk has joined #openstack-infra12:47
*** baoli has quit IRC12:49
*** amotoki has joined #openstack-infra12:50
*** saggi1 has quit IRC12:51
*** mdrabe has quit IRC12:51
*** eezhova has quit IRC12:51
*** yaume has joined #openstack-infra12:52
*** yanyanhu has joined #openstack-infra12:52
*** ajmiller has quit IRC12:53
*** ajmiller has joined #openstack-infra12:53
*** yanyanhu has quit IRC12:53
*** hashar_ has joined #openstack-infra12:53
*** hashar__ has joined #openstack-infra12:53
*** hashar_ has quit IRC12:54
*** ramishra has quit IRC12:55
*** lucas-hungry is now known as lucasagomes12:56
*** yanyanhu has joined #openstack-infra12:56
*** yanyanhu_ has joined #openstack-infra12:56
*** eezhova has joined #openstack-infra12:56
*** ramishra has joined #openstack-infra12:57
*** M-docaedo_vector has quit IRC12:57
*** edmondsw has joined #openstack-infra12:58
*** javeriak has quit IRC12:58
*** javeriak has joined #openstack-infra13:00
*** xyang1 has joined #openstack-infra13:00
*** makowals has joined #openstack-infra13:00
odyssey4memgagne pabelanger ping?13:01
*** mdrabe has joined #openstack-infra13:01
*** yanyanhu_ has left #openstack-infra13:01
odyssey4mejaveriak http://docs.openstack.org/infra/manual/drivers.html#tagging-a-release13:02
*** amotoki has quit IRC13:03
*** Na3iL has joined #openstack-infra13:03
*** rdx_matt has quit IRC13:04
*** woodster_ has joined #openstack-infra13:04
*** rdx_matt has joined #openstack-infra13:04
*** akshai has joined #openstack-infra13:04
pabelangermorning13:05
*** snarwade has quit IRC13:05
pabelangerodyssey4me: ^13:05
lucasagomesmordred, when trying to vote on the P release name I'm getting a "Your voter key is invalid." from the link in the email13:05
odyssey4memorning pabelanger :)13:06
electrofelixwaynr: going to push up the rebased set of JJB 2.0 api patches later this afternoon as I'm away over the next few days so figure it would be good to allow others to re-review13:06
*** Hal has joined #openstack-infra13:07
electrofelixwaynr: did you get a chance to look over the modifications I made to your patch queue and are reasonably happy with them?13:07
*** Hal is now known as Guest9410613:07
odyssey4mepabelanger with reference to https://review.openstack.org/339770 I'd like to introduce an optional extension to the ansible role functional tests to allow the optional implementation of some sort of change in the test... and I realise now that it'll need a different name for the job13:07
*** Goneri has quit IRC13:07
*** snarwade has joined #openstack-infra13:07
*** alexey_weyl has quit IRC13:08
*** rdx_matt has quit IRC13:08
odyssey4mepabelanger I was wondering whether we could change the job template to be '{pipeline}-{name}-ansible-{tox-environment}-{ostype}{job-suffix}' and have all the jobs set to use 'functional' as the tox-environment, unless the repo specifies an alternative13:09
odyssey4mepabelanger as I recall we cut the name from functional to func due to job name length limitations - not sure if those are still in effect?13:09
*** Na3iL has quit IRC13:10
*** Trozz has quit IRC13:11
pabelangerodyssey4me: I thought we had a {scenario} flag passed to the job name, so we could control the tox environment13:11
pabelangerguess I was wrong13:11
odyssey4mepabelanger yeah, that's kinda what I'd like to implement13:12
odyssey4mewith the default 'scenario' being 'functional'13:12
*** dizquierdo has joined #openstack-infra13:12
pabelangerodyssey4me: right, I am fine with that. Lets use scenario, like the puppet jobs and you are right, I think we are going to have some name length limitations13:13
pabelangerodyssey4me: By brain is lacking coffee atm to help could up with a fix for that13:13
*** Na3iL has joined #openstack-infra13:13
*** asettle has joined #openstack-infra13:13
pabelangerlet me loop back to it13:13
odyssey4mepabelanger alright, let me have a go at it while you come up with coffee13:14
*** ddieterly has joined #openstack-infra13:15
*** Goneri has joined #openstack-infra13:16
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Make gate-grenade-dsvm-neutron-dvr-multinode voting  https://review.openstack.org/33611613:16
javeriakthanks odyssey4me :)13:16
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Make gate-grenade-dsvm-neutron-dvr-multinode voting  https://review.openstack.org/33611613:16
*** mriedem_away is now known as mriedem13:17
openstackgerritPaul Belanger proposed openstack-infra/project-config: Fix URL variable with reprepro-import builder  https://review.openstack.org/34093713:18
*** esberglu has joined #openstack-infra13:19
*** pgadiya has quit IRC13:20
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571313:20
*** pgadiya has joined #openstack-infra13:20
*** pgadiya has quit IRC13:20
*** M-docaedo_vector has joined #openstack-infra13:20
*** ddieterly is now known as ddieterly[away]13:20
*** julim has joined #openstack-infra13:21
*** zeih has quit IRC13:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977013:22
*** cardeois has joined #openstack-infra13:22
*** julim has quit IRC13:23
*** amotoki has joined #openstack-infra13:23
odyssey4mepabelanger ^ not sure if that will work - I'm trying to allow the job name to remain short, but provide the option of the scenario setting13:23
*** yanyanhu has quit IRC13:24
*** yanyanhu has joined #openstack-infra13:25
*** zhurong has quit IRC13:25
*** ddieterly[away] is now known as ddieterly13:26
pabelangerodyssey4me: https://review.openstack.org/#/c/287850/ is the issue with char limits13:27
*** tonytan4ever has joined #openstack-infra13:27
*** jcoufal has joined #openstack-infra13:28
openstackgerritSteven Hardy proposed openstack/diskimage-builder: DNM testing tripleo-ci fix  https://review.openstack.org/34094113:28
*** amotoki has quit IRC13:28
pabelangerodyssey4me: we should really dig in to tox and find out why 128 is the char limit13:29
john-davidgeanteaya: Hello, HP Networking CI has started posting a comment at the beginning of its test run. See https://review.openstack.org/#/c/337851 for an example13:29
*** jpich_ has joined #openstack-infra13:29
odyssey4mepabelanger as I recall it wasn't tox, it was jenkins13:29
odyssey4meso maybe the issue is no more13:29
*** jtomasek__ has joined #openstack-infra13:29
odyssey4memaybe fungi can remember?13:29
pabelangerodyssey4me: the issue is the python interpreter rewritten for python files in tox, explodes on long paths13:30
*** d0ugal_ has joined #openstack-infra13:30
pabelangerwhich result in python apps not being able to rung13:30
odyssey4meoh, that's a whole different ball game13:31
*** pt_15 has joined #openstack-infra13:31
Shrewsrcarrillocruz: really? interesting. notmorgan could not reproduce the issue on a new devstack setup yesterday. i'm thoroughly confused13:31
*** itisha has joined #openstack-infra13:31
rcarrillocruzwell13:31
rcarrillocruzthe fix i referred13:31
odyssey4mepabelanger hmm, does it have something to do with the home folder's name - or some other file name on the FS?13:31
rcarrillocruzis not related to the performance issues between admin/non-admin13:31
*** sdake has joined #openstack-infra13:31
rcarrillocruzthat change is about putting on the server dict the fips manually13:32
odyssey4mepabelanger I'm not sure I understand where it is that tox uses the job name?13:32
fungipabelanger: odyssey4me: fun. i wonder if we should just switch to a hash of job names for our workspaces13:32
pabelangerfungi: ya, that would solve it13:32
rcarrillocruzsince different clousd may populate neutron -> nova fips info slower thatn others13:32
*** jpich has quit IRC13:32
rcarrillocruzi've noticed the timeouts on devstack instances, whre it didn't before13:32
fungiodyssey4me: i think it's that we end up with /home/jenkins/workspace/some-really-really-long-job-name/.tox/some-fairly-long-env-name/bin/python and so on13:32
rcarrillocruzand that same issue was also hit by asselin__ , but he uses a HOS cloud13:32
*** d0ugal has quit IRC13:33
odyssey4mefungi ah, so the workspace is based on the job name - not the repo or something else13:33
*** jtomasek_ has quit IRC13:33
rcarrillocruzlong story short: the fix would give us fast create_server with auto_ip, which would fix the test issues, but regardless we should investigate at some point why the calls are so slow for non-admin users13:33
pabelangerrcarrillocruz: mind reviewing 34093713:33
*** _ari_ has joined #openstack-infra13:33
rcarrillocruzsure13:33
*** ajmiller has quit IRC13:33
*** ajmiller has joined #openstack-infra13:33
pabelangerfungi: ^ if you are also online too13:33
*** sfinucan has quit IRC13:34
*** baoli_ has quit IRC13:34
fungiodyssey4me: right. honestly that's just there to accommodate workers which persist and run multiple different jobs. for our single-use workers we could just use a generic workspace because they'll never get reused13:34
rcarrillocruzlgtm13:34
fungiodyssey4me: however that's not configurable at the moment13:34
openstackgerritAlex Kavanagh proposed openstack-infra/project-config: Add charm-barbican, and related  https://review.openstack.org/34094513:34
fungiodyssey4me: we're just mirroring jenkins' old behavior13:35
odyssey4mefungi hmm, so using a hash of the job name or a mktemp folder could work13:35
*** d0ugal_ is now known as d0ugal13:35
*** mtanino has joined #openstack-infra13:36
fungiodyssey4me: right13:36
odyssey4menow that jenkins is no more, things can change13:36
*** d0ugal is now known as Guest6571513:36
*** sfinucan has joined #openstack-infra13:36
*** Guest65715 has quit IRC13:36
*** d0ugal_ has joined #openstack-infra13:36
fungiwell, probably not mktemp on our long-lived nodes because we may want to reuse the same workspace for multiple runs of the same job, but a deterministic hash would be fine13:37
*** baoli has joined #openstack-infra13:37
fungias long as the collision rate is reasonably infinitesimal13:37
*** baoli_ has joined #openstack-infra13:39
odyssey4mefungi or perhaps just let the workspace name be optionally set to something static or something random13:39
*** ddieterly is now known as ddieterly[away]13:39
*** Nikolay_St has joined #openstack-infra13:39
fungiyep13:39
*** jaosorior has quit IRC13:40
*** Na3iL has quit IRC13:40
odyssey4mewhere does the workspace get defined?13:40
pabelangerzuul-launcher13:40
odyssey4melet me see if I can figure something out13:41
fungianyway, problem now is that we really don't want to extend zuul-launcher. we considered feature parity with the parts of jenkins we used sufficient to make it feature-complete and work has since shifted back to zuul v3 which is pretty drastically different13:41
*** sdake_ has joined #openstack-infra13:41
*** caowei has joined #openstack-infra13:41
*** ramishra has quit IRC13:41
fungiso we need a pretty strong case for altering the "old" zuul-launcher codebase at this point13:41
*** eharney has joined #openstack-infra13:42
*** baoli has quit IRC13:42
*** mtanino has quit IRC13:43
*** ramishra has joined #openstack-infra13:43
fungias zuul-launcher was merely intended as a stop-gap to get us off jenkins while zuul v3 is still under development, and it isn't really expected to have a future once v3 is production ready (though some ideas from it may be reused in v3)13:43
*** jamesmcarthur has joined #openstack-infra13:43
*** notnownikki has joined #openstack-infra13:43
*** d0ugal_ has quit IRC13:44
odyssey4mefungi hmm, then perhaps you can help me work out a way to achieve the goal I have without extending zuul-launcher13:44
*** d0ugal has joined #openstack-infra13:44
odyssey4mefungi with reference to https://review.openstack.org/33977013:45
*** amotoki has joined #openstack-infra13:45
*** mdrabe has quit IRC13:46
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Add {name}-python27-mitaka jobs to murano projects  https://review.openstack.org/34095413:47
*** matthewbodkin has joined #openstack-infra13:47
fungiZara: odyssey4me the general way to do that is to use separate job parameters for the name substring and whatever you actually want set in the job, so that  you can still make the jobs have unique names but are able to pass longer strings into the job payload13:48
*** ddieterly[away] is now known as ddieterly13:48
fungier, sorry Zara. tab completion failure13:48
fungiodyssey4me: ^13:48
Zarahaha13:48
*** ramishra_ has joined #openstack-infra13:48
ZaraI was worried for a second xD13:48
*** e0ne has quit IRC13:49
*** Goneri has quit IRC13:49
*** ramishra has quit IRC13:49
openstackgerritMerged openstack-infra/project-config: Fix URL variable with reprepro-import builder  https://review.openstack.org/34093713:50
*** PollyZ has joined #openstack-infra13:50
odyssey4mefungi in this case the only thing I need to protect is the translation of 'func' to the tox env 'functional' - this is to prevent having to patch many, many repositories with a tox config change...13:51
*** amrith has quit IRC13:51
*** amrith has joined #openstack-infra13:52
odyssey4mefungi but I would like to allow the optional use of an alternative tox env, without building a new and almost identical job template13:52
*** e0ne has joined #openstack-infra13:53
*** ramishra_ has quit IRC13:53
*** rbrndt has joined #openstack-infra13:53
*** garyk has quit IRC13:53
*** r-mibu has quit IRC13:54
*** r-mibu has joined #openstack-infra13:54
*** ramishra has joined #openstack-infra13:55
*** ajmiller has quit IRC13:55
*** ajmiller has joined #openstack-infra13:55
*** gongysh has joined #openstack-infra13:56
*** caowei has quit IRC13:57
openstackgerritMerged openstack-infra/tripleo-ci: Use venv for all tempest commands  https://review.openstack.org/33911813:57
*** Goneri has joined #openstack-infra13:57
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Add quick non-permanent filter buttons for timeline events  https://review.openstack.org/33174813:59
*** xarses_ has quit IRC13:59
*** yamamoto has quit IRC13:59
waynrelectrofelix: i haven't had a chance to review them yet13:59
fungiyou could adjust the template so that the env you pass to the tox builder is a separate parameter from the name substring you insert, and then pass both when instantiating the template in a project13:59
fungiodyssey4me: ^13:59
*** Julien-zte has joined #openstack-infra13:59
*** sarob has joined #openstack-infra13:59
*** isaacb has quit IRC14:00
*** sarob has quit IRC14:00
*** sarob has joined #openstack-infra14:00
fungiodyssey4me: pabelanger: for reference, i believe this is the issue we're attempting to work around https://github.com/pypa/virtualenv/issues/59614:01
fungior https://github.com/pypa/pip/issues/177314:02
fungithough as those issue discussions point out, it's more of a general shortcoming of shebang lines on linux, so anything we do is going to simply be working around that14:03
*** burgerk has quit IRC14:03
odyssey4meyeah, so it seems14:03
*** rdx_matt has joined #openstack-infra14:04
*** piet has quit IRC14:04
odyssey4meI suppose in the jobs it could be easy enough to create a mktemp folder name, symlink that name to the workspace directory, then execute tox from inside the symlinked folder14:05
odyssey4mebut that's a horrible hack14:05
*** javeriak has quit IRC14:05
fungiyeah, i still definitely think this is something we should fix by not using job names in workspaces with zuul, it's just a question of whether that's going to happen in zuul v2.5's zuul-launcher, or in zuul v3, or both14:06
odyssey4mesure, unfortunately with that option there will needs to be some discussion and it'll take more time than I can afford... so while I'm happy to work on that as a mid to long term option, I need something for the short term that will work around the limitation14:08
fungithe end result of the present design is that the job name and the tox env name added together can't exceed something like 86 characters14:08
pabelangerfungi: good find14:09
odyssey4meyeah, and we have a particularly long repo name which resulted in the folder name of /home/jenkins/workspace/gate-openstack-ansible-lxc_container_create-ansible-functional-ubuntu-xenial-nv/.tox/functional/bin/python14:09
odyssey4methat's 131 chars14:09
*** berendt has quit IRC14:09
odyssey4methus we changed 'functional' to 'func' in the job name14:10
fungiso anyway, separating the job name uniqueness parameter from the tox env parameter is one way to work around it14:10
openstackgerritIhar Hrachyshka proposed openstack-infra/project-config: Clone grenade for multinode linuxbridge job  https://review.openstack.org/34096214:10
*** markvoelker has quit IRC14:11
fungithat way you can set strings per instantiation of the template to make the resulting job names unique without tying them to the length of the tox env names14:11
odyssey4meis there a way that I can do that without having to specify the list of valid options in the job or job group?14:12
fungiodyssey4me: not sure what you mean by "the list of valid options"14:12
*** hurgleburgler has joined #openstack-infra14:13
fungiodyssey4me: you would just pass multiple parameters to each instantiation of the job-template (whether that's in a job-group or in a project)14:13
*** gordc has joined #openstack-infra14:13
tlbrpabelanger, packages for packaging-deb project are under https://tarballs.openstack.org/packaging-deb/*/uploads/*/ path. It was discussed with mordred and fungi on #openstack-pkg channel14:13
*** zz_dimtruck is now known as dimtruck14:13
*** wznoinsk_ has joined #openstack-infra14:14
*** timburke_ has joined #openstack-infra14:15
pabelangertlbr: that is an easy fix, however I'd like want to drop the packaging-deb portion of the URL, so we can make our JJB build generic for other project to consume, if they wanted too14:15
*** alvladeru has joined #openstack-infra14:15
*** timburke has quit IRC14:15
*** wznoinsk has quit IRC14:15
*** Nakato has quit IRC14:15
*** aderyugin has quit IRC14:15
*** jlk has quit IRC14:15
*** karthikp_ has joined #openstack-infra14:15
*** timrc has quit IRC14:15
*** sigmavirus has quit IRC14:15
*** alvladeru is now known as aderyugin14:15
odyssey4mefungi hmm, I think the two wires have connected and I have seen the error of my ways... let me revise that patch14:15
*** jlk` has joined #openstack-infra14:15
*** links has quit IRC14:15
*** timrc has joined #openstack-infra14:16
*** Nakato has joined #openstack-infra14:16
fungipabelanger: the problem there is that they want the parent directory of, for example, the nova packages to just be called "nova" but want to avoid them ending up in the same place as the nova project's tarballs14:17
*** yanyanhu has quit IRC14:17
fungipabelanger: which is why they prefixed them with that packaging-deb directory14:17
*** tonytan_brb has joined #openstack-infra14:17
zigopabelanger: I'd prefer not to. I'll do the packaging under packaging-deb for these stuff we want to package for Debian / Ubuntu as well.14:17
fungii missed that 340937 was removing that14:17
*** timburke_ is now known as timburke14:18
pabelangerfungi: okay, that's fine. Like I said, an easy fix14:18
pabelangeronce we move it into post pipeline we can add the prefix14:18
*** sputnik13 has quit IRC14:18
openstackgerritSpyros Trigazis proposed openstack-infra/project-config: [magnum] Add ironic projects to PROJECTS env  https://review.openstack.org/34096514:18
*** Julien-zte has quit IRC14:18
*** Julien-zte has joined #openstack-infra14:19
zigopabelanger: Thanks for this work, btw, I was getting depressed seeing no progress.14:19
fungibut to pabelanger's point, people should also be free to reuse these same mechanisms to create deb packages of repos outside the control of the packaging-deb team, so will end up either creating a separate and nearly-identical job with a different upload namespace or will need the existing template to be slightly more generic14:19
electrofelixregarding https://review.openstack.org/320994 a change for elastic-recheck, although it was abandoned as superseded, a question remained unanswered, that is why is '-U' being used for dependency installation?14:19
*** dingyichen has quit IRC14:20
*** tonytan4ever has quit IRC14:20
*** sigmavirus has joined #openstack-infra14:20
*** ramishra has quit IRC14:20
pabelangerinfra-root: any objections on helping landing 334652? I'd like to enable SSH pipelining for ansible on puppetmaster.o.o, that should result in a performance increase and help reduce our wheel under 15mins again14:20
*** mdrabe has joined #openstack-infra14:20
electrofelixit does appear to prevent upper constraints from being adhered to when dealing with test-requirements14:20
zigofungi: In such case, we can call the destination folder something else than "packaging-deb"...14:20
zigoThe only point is to use a generic name for the dest folder for the pickup job to read from.14:21
fungizigo: right, the question is whether the existing job-template can be made more generic to accommodate that, or whether we have a separate job-template for each14:21
openstackgerritMerged openstack-infra/storyboard-webclient: Add quick non-permanent filter buttons for timeline events  https://review.openstack.org/33174814:21
zigoI don't intend to slow down anyone by doing more bikeshedding ! :)14:21
pabelangerfungi: zigo: Ya, the naming to me is moot honestly, its a place to store tmp files. We should consider something along that lines which gets purged every x days14:21
zigoAs you like, as long as we get it done.14:21
fungibut i also think that until such time as there are people who want to do that (build debs and upload them somewhere other than packaging-deb) we can live with that hard-coded14:22
pabelangerzigo: yes, lets get something working first, then iterate on that14:22
*** karthikp_ has quit IRC14:22
fungipabelanger: is that pipelining change what you were discussing with jeblair, Shrews, et al last night?14:23
*** acoles_ is now known as acoles14:23
*** ramishra has joined #openstack-infra14:24
*** EricGonczer_ has joined #openstack-infra14:27
*** chem|away has joined #openstack-infra14:27
*** mriedem1 has joined #openstack-infra14:28
electrofelixmtreinish: would you mind responding to the follow up question on https://review.openstack.org/320994 ?14:28
electrofelixmtreinish: It seems to me that the way tox works by performing using '{install_command} -e .' at the end when usedevelop = True, if you put '-U' into the install_command anything installed via test-requirements can be upgraded past it's upper pins14:28
*** chem|away is now known as chem14:28
electrofelixmtreinish: this seems to only occur with test-requirements.txt since pbr reflects requirements.txt into setuptools so upper pins will be adhered to (assuming correct ordering) by a the install_command.14:28
*** piet has joined #openstack-infra14:28
electrofelixmtreinish: so I'm wondering whether '-U' is inherently problematic for test-requirements.txt and upper constraints14:29
*** _oanson has joined #openstack-infra14:29
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Improve logger output for expanding templates  https://review.openstack.org/33609114:29
openstackgerritDarragh Bailey proposed openstack-infra/jenkins-job-builder: Refactor base test classes inheritance for reuse  https://review.openstack.org/33609014:29
*** mriedem has quit IRC14:29
clarkbpabelanger: is the sudo requiretty thing a non issue? we ssh as root for puppet things but zuul launcher will ssh as jenkins/zuul14:30
clarkbalso I wish the docs explained what this did14:30
*** markvoelker has joined #openstack-infra14:30
*** isaacb has joined #openstack-infra14:31
*** julim has joined #openstack-infra14:31
openstackgerritDarragh Bailey proposed openstack-infra/elastic-recheck: SearchEngine search only supports ints for days  https://review.openstack.org/32098814:31
*** mriedem1 is now known as mriedem14:31
pabelangerfungi: no, this is for our ansible / puppet wheel. That was related to zuul-launcher14:31
clarkbelectrofelix: pip will respect the upper bounds in the test requirements file too14:31
clarkbI mean as much as it respects them at all14:32
*** eharney has quit IRC14:32
*** mtanino has joined #openstack-infra14:32
electrofelixclarkb: it doesn't appear to when usedevelop=True14:32
pabelangerclarkb: I don't believe so, however I have not tested it. When I looked for zuul-launcher, we were not affected.  However, until we test with puppetmaster and puppet, I am not 100% sure14:32
*** amitgandhinz has quit IRC14:33
electrofelixclarkb: or rather when usedevelop=True and -U is in the install command14:33
*** gongysh has quit IRC14:33
pabelangerclarkb: I _think_ the issue is if you call becomes: directly from your ansible-playbook14:33
electrofelixso I left an open question on a review as to whether it was a good idea to have -U enabled14:33
clarkbelectrofelix: the reason it is there is so you dont have to tox -r14:33
*** ajmiller has quit IRC14:33
*** amitgandhinz has joined #openstack-infra14:33
pabelangerthat will requiretty settings14:34
clarkband -U is very intentional amd shpuld not do ehat you describe14:34
*** ajmiller has joined #openstack-infra14:34
clarkb-U means upgradw within the bpunds provoded not install newest everything unconditionally14:34
*** abregman is now known as abregman|mtg14:34
electrofelixI believe the problem is that test-requirements.txt is not included in the final 'pip install -e .' when usedevelop=True14:34
clarkbpabelanger: ya which we do for the zuul laumcher restart playbook but nowhere else that I know of14:34
electrofelixrequirements.txt is reflected into it via setuptools14:35
pabelangerclarkb: Right, that's the only place I can think of it too14:35
electrofelixwhich means -U + usedevelop=True does not respect upper constraints in test-requirements.txt, but would for requirements.txt14:35
electrofelixarguably that's a bug in tox14:35
clarkbelectrofelix: yes but at that point both requirements and testrequiremts have been preinstall and the install of . should just do .14:36
*** ajmiller has quit IRC14:36
*** ajmiller has joined #openstack-infra14:36
*** tonytan4ever has joined #openstack-infra14:36
openstackgerritMerged openstack-infra/tripleo-ci: Switch away from the default IP range used by tripleo  https://review.openstack.org/33888614:36
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571314:36
*** garyk has joined #openstack-infra14:37
*** mctaylor has joined #openstack-infra14:38
*** karthikp_ has joined #openstack-infra14:38
*** mctaylor has quit IRC14:38
*** rdx_matt has quit IRC14:38
electrofelixclarkb: I don't think test-requirements is being passed to the final "pip install -U -e ." so the upper bound is not defined14:38
*** tonytan_brb has quit IRC14:39
*** rossella_s has quit IRC14:40
clarkbelectrofelix: is the issue where they overlap but you arent apecific enough in requirements?14:40
clarkbelectrofelix: pip shpuldnt look at everything installed amd upgrade it, it doesnt work like apt that way14:40
*** Guest94106 has quit IRC14:40
clarkbit will only touch things in the input14:40
*** Hal has joined #openstack-infra14:40
*** rossella_s has joined #openstack-infra14:40
clarkbso test libs like fixtures are left as is because they are not in the requirements.txt set14:41
*** Hal is now known as Guest1994614:41
*** sree has quit IRC14:41
electrofelixI'm concerned that it's behaviour doesn't match what was stated as to how it should be behaving14:41
*** sorantis has quit IRC14:42
*** clenimar has joined #openstack-infra14:43
*** clenimar_ has joined #openstack-infra14:43
*** clenimar_ has quit IRC14:43
*** clenimar has quit IRC14:43
openstackgerritAdam Coldrick proposed openstack-infra/storyboard-webclient: Allow comments to be edited by their owner  https://review.openstack.org/33341814:43
*** clenimar has joined #openstack-infra14:44
*** deadnull has joined #openstack-infra14:44
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977014:44
fungielectrofelix: it may be easier to provide a short reproducer for the observed (mis)behavior14:45
fungito make it easier to rule out other more likely causes14:45
*** david-lyle has joined #openstack-infra14:46
electrofelixfungi clarkb: so http://paste.openstack.org/show/530896/ shows the exact behaviour using pip commands, I debugged tox before to show me what was being executed. testtools has a lower pin on fixtures, but pip seems to ignore this in favour of the newer version14:48
electrofelixsorry, meant pip ignores the fact that the installed version is sufficient and still upgrades it to a newer version14:48
openstackgerritMerged openstack-infra/tripleo-ci: Only run kill if there is a httpserver to kill  https://review.openstack.org/34082914:48
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Add {name}-python27-mitaka jobs to murano projects  https://review.openstack.org/34095414:49
clarkbelectrofelix: roght so the bug there is not having fixtures in requirements.txt14:49
electrofelixfixtures however is in test-requirements.txt with an upper constraint14:49
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571314:49
*** eezhova has quit IRC14:49
fungielectrofelix: just to be clear, when you say "upper constraint" you mean in a constraint list specified with the -c option to pip?14:49
fungielectrofelix: or just "an upper bound in a version specifier"?14:50
electrofelixtest-requirements.txt contains a line with 'fixtures>=0.3.14,<3.0'14:50
fungielectrofelix: aha, communication breakdown. that's not a "constraint"14:50
clarkbelectrofelix: yes you need to either update that bound to be valid or move fixtures into requirements.txt14:50
openstackgerritSteve Martinelli proposed openstack-infra/project-config: publish osc-lib docs  https://review.openstack.org/34098114:50
electrofelixsorry reusing a word with different meaning?14:50
electrofelixclarkb: how is that not valid?14:51
*** mariusv has joined #openstack-infra14:51
clarkbelectrofelix: pip has "constraints" which are install this version despite any other bounds listings14:51
fungielectrofelix: pip does not have a holistic dep solver, it evaluates each version specifier as it encounters it. this is a very long-standing implementation shortcoming in pip which constraints (-c) is a workaround for14:51
clarkbelectrofelix: because of how pip works its required... pip is not apt and will not remember you had a previous bound14:51
*** zeih has joined #openstack-infra14:51
clarkbya what fungi said basically14:51
electrofelixso basically you're agreeing there is a hole between test-requirements.txt use of -U and upper bounds14:52
clarkbno14:52
*** xarses has joined #openstack-infra14:52
fungielectrofelix: it's pip working as designed14:52
fungielectrofelix: the design is simply not so great if you expect behavior like a distro package manager14:52
*** xarses has quit IRC14:52
clarkbright pip is doing what you told it. You can achieve the behavior you want by telling pip something else14:52
electrofelixto be clear, testtools is not specified in requirements either14:53
*** xarses has joined #openstack-infra14:53
electrofelixit only appears in test-requirements.txt14:53
*** gongysh has joined #openstack-infra14:53
electrofelixso basically any upper bound in test-requirements.txt is going to get ignored14:53
electrofelixonce usedevelop=True and -U is set on the pip install command14:53
openstackgerritMerged openstack-infra/tripleo-ci: Remove the rewrite of TOCI_JOBTYPE  https://review.openstack.org/33856614:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977014:53
*** nmagnezi has quit IRC14:54
*** hurgleburgler has quit IRC14:54
*** burgerk has joined #openstack-infra14:54
fungielectrofelix: one very fiddly workaround is to reorder your requirements and test requirements to make sure the most specific version specifiers of deps (including transitive deps in a depth-first walk if memory serves) are encountered first14:54
electrofelixAFAICT the only reason upper bound works in requirements.txt is because pbr will reflect those into setuptools and result in pip seeing them even if tox does not pass '-r requirements.txt'14:54
*** jed56 has quit IRC14:55
electrofelixfungi: this doesn't work no matter when I list the fixtures and upper bound in test-requirements.txt14:55
clarkbelectrofelix: no in fact if it reflected nothing you would get the behavior you eant14:55
clarkbb3cause pip unlike apt only works on its current inputs14:55
fungielectrofelix: we relied very, very heavily on "lucky ordering" of dependencies in our requirements lists for a long time before constraints was implemented. now we use constraints lists to set specific solved sets of dependencies alongside the requirements lists14:56
*** rockstar_ is now known as rockstar14:57
openstackgerritSagi Shnaidman proposed openstack-infra/gear: Support TCP keepalives in geard  https://review.openstack.org/33445214:57
fungielectrofelix: there's a lot of explanation in http://git.openstack.org/cgit/openstack/requirements/tree/README.rst if you're ready to be extremely disappointed by the state of pip's solver14:57
openstackgerritRicardo Carrillo Cruz proposed openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571314:57
electrofelixclarkb: so if pip was only getting it's current inputs, how is it getting the dependency on testtools to process?14:58
fungielectrofelix: i haven't looked at your paste closely yet, but odds are it's a transitive dependency of one of the specified deps14:58
electrofelixfungi: so it's not really a test only dep?14:59
fungiCollecting fixtures>=1.3.0 (from testtools>=0.9.34->python-subunit>=0.0.18->subunit2sql>=0.9.0->elastic-recheck==0.0.1.dev1770)14:59
*** cody-somerville has joined #openstack-infra14:59
*** yamamoto has joined #openstack-infra14:59
electrofelixyeap just spotted that as well15:00
electrofelixso it's not really a test dependency at all15:00
fungielectrofelix: so elastic-recheck wants a version of subunit2sql which wants a version of python-subunit which wants a version of testtools which wants fixtures>=1.3.0 (no upper bound on the specifier)15:00
electrofelixso should be moved to requirements.txt to prevent surprises in the future?15:00
fungielectrofelix: that's one workaround, yes15:01
fungithe other is to make a constraints file containing an == to a specific version of fixtures you know meets all the needs of everything else in your dep chain and pass that with -c every time pip is called15:01
fungiwhich is how it's being handled in most openstack projects now15:01
*** jamesmca_ has joined #openstack-infra15:02
*** jamesmcarthur has quit IRC15:02
*** yaume_ has joined #openstack-infra15:02
electrofelixsounds a bit like how pip-compile was pitched15:03
*** bin_ has joined #openstack-infra15:03
*** weshay_mtg is now known as weshay15:05
*** matbu is now known as matbu|mtg15:05
*** yaume has quit IRC15:05
fungielectrofelix: yes, we do a process similar to pip-compile to generate our upper-constraints.txt from the state of global-requirements.txt\15:05
electrofelixfungi clarkb: thanks with being so patient with me, this stuff was driving me around the bend15:06
fungiand then we run some canary tests with the proposed upper-constraints.txt before merging, and then other projects pull upper-constraints.txt and apply it in their tox invocations15:06
*** ihrachys has quit IRC15:06
*** yamamoto has quit IRC15:07
*** samueldmq has joined #openstack-infra15:07
*** nadya has quit IRC15:07
*** cardeois_ has joined #openstack-infra15:07
*** hashar is now known as hasharAway15:07
samueldmqhi folks15:07
electrofelixfungi: looks like this could do to be added to the elastic-recheck, I'll no15:07
samueldmqI have a question about bindep/other-requirements15:07
electrofelixI'll have a look in a few days at submitting it15:07
clarkbsamueldmq: ask away15:08
*** hurgleburgler has joined #openstack-infra15:08
openstackgerritPaul Belanger proposed openstack-infra/project-config: Enable reprepro-release-deb-openstack  https://review.openstack.org/34099315:08
*** Ravikiran_K has quit IRC15:08
openstackgerritMerged openstack-infra/tripleo-ci: Upload images to cache at end of ovb job  https://review.openstack.org/33876215:08
samueldmqclarkb: other-requirements is expected to list deps for a dev environment ?15:09
pabelangerfungi: clarkb: ^ mind a review? reprepro import is working so I've enabled reprepro-release to test our AFS release process15:09
samueldmqclarkb: or for a production/deployment environment?15:09
pabelangeradds some new mutexes15:09
*** hurgleburgler1 has joined #openstack-infra15:10
*** ramishra_ has joined #openstack-infra15:10
clarkbsamueldmq: it depends on who you ask ... I have asserted it should be for dev work because that is the most likely target installing from source. But I think we have decided to have a [test] env and a default env for production like deps15:10
*** cardeois has quit IRC15:10
*** yamahata has joined #openstack-infra15:10
clarkbno andreas here but fungi ^ is that how we are doing it?15:11
*** isaacb has quit IRC15:11
samueldmqzigo: ^15:12
fungisamueldmq: it's flexible. any packages you list without a user profile or with a "test" user profile will be identified if the platform profiles match your target environment15:12
fungisamueldmq: so you _can_ use [test] to indicate it's a test-only dependency, and not put [test] on runtime deps15:12
fungisamueldmq: or you can just ignore it and only bother listing your test deps15:13
*** hurgleburgler has quit IRC15:13
*** ramishra has quit IRC15:13
fungiour jobs will support either method15:13
zigofungi: From my perspective (ie: packaging), how should I read it?15:13
pabelangeralso note, we have no way to check test-only or runtime deps currently in bindep jobs15:13
*** dronshaw has joined #openstack-infra15:13
zigofungi: No [test] means it's also runtime ?15:13
fungizigo: i don't know that it necessarily feeds packager decisions15:14
*** ams__ has quit IRC15:14
samueldmqfungi: clarkb: for now we only have a list in keystone's file: https://github.com/openstack/keystone/blob/master/other-requirements.txt15:14
*** notnownikki has quit IRC15:14
zigofungi: For the case of keystoneclient, I see real mistakes though.15:14
fungizigo: no [test] _might_ mean it's a runtime dep, or might mean that the project is only using that list to specify their test deps15:14
zigo:/15:15
samueldmqdoes that mean they're all runtime deps ?15:15
clarkbmy xenial test loop is at project 268 of 30515:15
clarkbof course all the db projects are still to run and will likely be slower :(15:16
pabelangerclarkb: nice, anything explode yet?15:16
fungizigo: the main use case we've targeted is, as a developer i clone python-keystoneclient and want to test some changes i've made by running `tox`, but then a bunch of the python dependencies which it tries to pip install won't compile because i'm missing c headers. with a sane other-requirements.txt file in that repo, running `bindep` (or maybe `tox -e bindep`) will tell me what distro packages i need15:16
fungito install first15:16
clarkbsamueldmq: fungi is saying that if a project does not have explicit test deps in that list annotated with [test] then they may or not be test/dev deps15:16
clarkbpabelanger: pbr is probably the biggest worry I have right now since its pretty central15:16
clarkbpabelanger: its wsgi tests were unhappy for some reason, I will ahve to do more digging after this initial pass through15:17
clarkbpabelanger: otherwise from what I have seen its either tests are failign on trusty too or they have no tests or code yet15:17
zigofungi: How come we get stuff like python3-dev in [platform:dpkg] ?15:17
zigofungi: There's no need for Python.h in ksc ...15:17
openstackgerritSpyros Trigazis proposed openstack-infra/project-config: [magnum] Add ironic projects to PROJECTS env  https://review.openstack.org/34096515:18
*** adrian_otto has joined #openstack-infra15:18
clarkbzigo: because ksc likely builds some dep on source installs that links against python15:18
*** ihrachys has joined #openstack-infra15:18
samueldmqclarkb: nice. so for keystone I understand it as setting up a _dev_ env, as it reflects http://docs.openstack.org/developer/keystone/setup.html#installing-dependencies15:18
clarkblxml probably15:18
fungizigo: are you able to pip install all of ksc's requirements.txt and test-requirements.txt without that installed first?15:18
samueldmqclarkb: I am going to update those docs do advise using bindep15:18
*** sarob has quit IRC15:19
zigofungi: Just by a quick look, I'd say yes.15:19
*** acoles is now known as acoles_15:19
fungianyway, we made our jobs look for the test user profile (in addition to the implicit default profile) at the request of some projects who wanted to get more specific about what packages are runtime non-python deps vs which ones are test-time non-python deps, but it's not expected to be consistent between projects15:19
fungizigo: including in a python 3 virtualenv?15:19
zigoNo idea about venv, but if that's the case we need it for venv, then it will appear everywhere, which isn't probably what we want, is it?15:20
fungizigo: easiest way to test that theory is to remove that line from the other-requirements.txt file and propose that change to the python-keystoneclient repo and see what jobs fail (if any)15:20
samueldmqfungi: zigo: and that will also depends on the distribution, some may meet all the requirements, others may meet none of them15:20
fungizigo: it will only appear for projects which need to compile non-python extensions. that's certainly not _everywhere_15:20
samueldmqhaving a list of deps and using bindep will ensure consistency15:20
clarkbpabelanger: http://paste.openstack.org/show/530926/ thats the current list of results15:20
clarkbpabelanger: note that in most cases releasenotes failing is due to no releasenotes tox target which is fine15:21
apuimedomordred: the condorcet voting system tells me my voter key is invalid15:21
clarkbdhellmann: ^ you might also be curious for the current data15:21
zigofungi: I also saw stuff like "python3.4 [platform:ubuntu-trusty]", that's completely wrong, it should *always* be replaced by python3-all (which means: all available python in the system)15:21
clarkbapuimedo: there is a mailing list thread about it. mordred is trying to sort out what happened15:21
apuimedoah, ok15:21
apuimedosorry I didn't see it15:21
fungiapuimedo: see his followup to the -dev ml. there was something wrong with the ballots. he's going to try again, not sure when15:21
apuimedothanks :-)15:21
apuimedoyou guys are always on top of things :-)15:22
*** tidwellr has joined #openstack-infra15:22
clarkbpabelanger: looks like osc failed py27 I should check on that15:23
*** andymaier has quit IRC15:23
dhellmannclarkb : lots of release notes and doc build failures. I wonder how many of those are related to the issue fixed in https://review.openstack.org/#/c/334201/15:23
*** cardeois_ has quit IRC15:23
fungizigo: sounds reasonable. i compiled the fallback list by looking at what packages we were installing from puppet on our old workers where we used to preinstall a lot of this stuff, and then entries from that have been getting copied to other-requirements.txt files in individual projects. i likely missed some cases where we'd have been better to install a virtual package rather than whatever it refers15:24
fungito15:24
*** cardeois_ has joined #openstack-infra15:24
clarkbdhellmann: at least for releasenotes I think most of them are my script trying to run that tox target when it doesn't exist15:24
zigofungi: I'll try and fix what I can manually.15:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977015:24
dhellmannclarkb : ah15:24
clarkbdhellmann: I will run thatthrough a filter to remove the fails caused by that when I get closer to producing final results15:24
*** david-lyle has quit IRC15:24
dhellmannsounds good15:24
clarkbAttributeError: 'module' object has no attribute 'select_auth_plugin' is the osc issue15:25
fungizigo: all of this can be fixed by just proposing corrections to the relevant files. also http://codesearch.openstack.org/ may be useful in looking for which files in which projects have those known bad entries15:25
zigofungi: Though it'd be nice to have some consistency checks. For example, if there's python3-all-dev, no need for python-all, and such ...15:25
samueldmqfungi: ++15:25
*** hurgleburgler1 has quit IRC15:25
*** xarses has quit IRC15:25
zigofungi: It's looking like I'll be voting for absolutely all DefCore projects in this cycle! :P15:26
*** xarses has joined #openstack-infra15:26
fungizigo: "voting in all elections" is an exclusive club that most of the infra team also belongs to15:26
*** e0ne has quit IRC15:26
*** ericksonsantos has joined #openstack-infra15:26
zigofungi: :)15:27
samueldmqzigo: cool, let me know when you have fixes for keystone repos15:27
odyssey4mefungi hmm, can a var not be set for use for the tox environment? http://logs.openstack.org/70/339770/4/check/gate-project-config-jenkins-project/8e8d772/console.html#_2016-07-12_15_05_00_79108515:27
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe  https://review.openstack.org/34033915:27
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477715:27
samueldmqfungi: clarkb: thanks15:27
clarkbdhellmann: I am also going to try filtering out all ht projects that have no code15:27
clarkbdhellmann: because apparently that is a non zero set15:27
*** harlowja_at_home has joined #openstack-infra15:27
dhellmannsigh15:27
fungithere are a disappointingly nonzero number of projects that see repo creation in gerrit as a placeholder for work they may never actually get around to starting15:29
asselin__rcarrillocruz, any idea what i'm doing wrong? http://paste.openstack.org/show/530932/15:30
*** akshai has quit IRC15:31
*** deadnull has quit IRC15:31
*** ajmiller has quit IRC15:31
rcarrillocruzi believe you are not passing security_groups var on cli15:31
rcarrillocruzthus the parsing fails15:32
*** armax has joined #openstack-infra15:32
*** ajmiller has joined #openstack-infra15:32
pabelangerclarkb: feel free to ping me if you need to offload something in the process15:33
dhellmannfungi, clarkb : I suppose asking teams to create something useful in a repo somewhere else would lead to importing lots of untested and/or unreviewed code, so that's not a good solution. How hard is it to remove empty repositories? If we did that annually would that make a difference?15:33
clarkbpabelanger: can do, its actually a lot of "make script, run it and keep an eye on it to make sure it doesn't explode" then move on to the next thing15:34
fungidhellmann: it's a small enough percentage to not be worth the effort to try to clean up on their behalf15:34
clarkbpabelanger: hwoever I have only been focusing on tox -e py27 -e docs -e releasenotes and -v venv python setup.py build_sphinx so far15:35
fungiodyssey4me: i don't know exactly why it's erroring there, though i do see you're unnecessarily re-setting those parameters inside your job templates too15:35
*** matbu|mtg is now known as matbu15:35
clarkbpabelanger: maybe you want to poke at neutron functional tests and similar tests to that?15:35
*** arxcruz has quit IRC15:35
*** rajinir has joined #openstack-infra15:35
*** rdx_matt has joined #openstack-infra15:36
*** sdake_ has quit IRC15:36
clarkbpabelanger: I think there is only a small handful of those but parsing zuul layout.yaml should tell you for sure15:36
*** sdake_ has joined #openstack-infra15:36
clarkbdhellmann: fungi ya its mostly only an annoyance when you try to do these large scale high level "does X work" then you have to filter through and sort out why a great big collection fail15:36
odyssey4mefungi so if I understand how it all works correctly, I can remove the 'scenario' and 'toxenv' settings from the job group because the job group inherits them?15:36
fungiodyssey4me: oh, that's actually exactly the problem. i'll leave inline comments15:36
odyssey4mefungi great, thanks15:37
clarkbhttp://git.openstack.org/cgit/openstack/networking-icc/tree/ is another15:37
clarkbactually I think there are a few networking-*s in this bucket15:37
clarkbdhellmann: fungi what we can do is put a list together then send them a gentle nudge about using repos if they are still intending to and letting us know if not15:37
*** dtantsur is now known as dtantsur|afk15:37
*** makowals has quit IRC15:38
* clarkb uses pep8 fails as a canary15:38
*** bauzas is now known as bauzas_notabot15:40
asselin__rcarrillocruz, I added security groups, but still same error. Seems only name and image are required.15:40
rcarrillocruzshow me the playbook15:40
pabelangerclarkb: sure, I can poke around15:40
pabelangerclarkb: can you pastebin your script again?15:41
*** vincentll has quit IRC15:41
jeblairpabelanger: perhaps we should test the pipelining change on a single zl?15:41
*** cardeois_ has quit IRC15:41
pabelangerwouldn't mind a review or 2 on 340993 to help close out my reprepro testing15:41
*** mctaylor has joined #openstack-infra15:41
pabelangerjeblair: I think that is a good plan15:42
clarkbpabelanger: http://paste.openstack.org/show/530939/ note the comment at the top with minor setup requirements15:42
*** cardeois_ has joined #openstack-infra15:42
*** mctaylor has quit IRC15:42
clarkbpabelanger: but otherwise running that on one of our images should just work15:42
anteayajohn-davidge: do you want to try to contact them: https://wiki.openstack.org/wiki/ThirdPartySystems/HP_Networking_CI and point out that they have to follow the requirments: http://docs.openstack.org/infra/system-config/third_party.html#requirements to ensure their gerrit account remains enabled?15:42
pabelangerclarkb: will do15:42
*** jamesmca_ has quit IRC15:42
anteayajohn-davidge: if you give that a try and they don't reply or continue to post build started then I can take further action15:43
jeblairpabelanger: if you want to graceful stop one of them and manually install that for testing, i'd be ok with that15:43
clarkbpabelanger: then I have done for project in cat project run that script15:43
pabelangerjeblair: okay, let me set aside some time later today.15:43
pabelangerclarkb: ack15:43
john-davidgeanteaya: Sure, will do :)15:43
anteayajohn-davidge: thank you, I appreciate your help here :)15:44
rcarrillocruzo-k15:44
rcarrillocruzfinally!15:44
*** mahatic has quit IRC15:44
jeblairShrews, notmorgan: i've been deep in crazy for the past couple days; i might have missed requests made of me -- do you need anything?15:44
rcarrillocruzShrews , mordred : i need eyes on https://review.openstack.org/#/c/315713/15:44
rcarrillocruzthat  should unblock the shade gate15:45
*** ericksonsantos has left #openstack-infra15:46
*** akshai has joined #openstack-infra15:46
john-davidgeanteaya: Message sent, will let you know if the big enforcement guns are needed15:47
*** mikelk has quit IRC15:48
*** ericksonsantos has joined #openstack-infra15:48
anteayajohn-davidge: very good, hopefully it was a case of education doing what is needed here15:48
anteayathank you15:48
*** andreas_s has quit IRC15:49
*** mestery has quit IRC15:49
clarkbzaro: looks like python-jenkins fails testing on xenial because it can't compile against kerberos15:49
*** mriedem1 has joined #openstack-infra15:49
clarkbfungi: ^ any idea how that passes on trusty?15:49
fungijeblair: not sure if you saw earlier discussion with odyssey4me and pabelanger, but short version is that it would at least be nice in zuul v3 if workspaces (assuming there still is such a concept) don't embed the job name or repo name in their path. tox uses the full path to bin/python in a virtualenv and if that exceeds BINPRM_BUF_SIZE in /usr/include/linux/binfmts.h (generally 128) then it's15:50
fungitruncated15:50
*** mestery has joined #openstack-infra15:50
clarkbhuh krb5-multidev ends up in the trusty jobs somehow15:51
jeblairfungi: ah yeah, i bet we can avoid that in v3.15:51
clarkbhttp://logs.openstack.org/08/337208/1/check/gate-python-jenkins-python27/668878c/console.html.gz#_2016-07-04_12_42_32_14922615:51
*** mriedem has quit IRC15:51
openstackgerritMerged openstack-infra/zuul: Support post jobs by supporting rev checkout  https://review.openstack.org/29319415:51
fungiclarkb: likely a transitive dep of some package getting installed on trusty but not on xenial?15:51
clarkblooks like it may be a dep15:51
clarkbfungi: ya15:51
clarkbI guess I need to add a patch to include that in fallback requirements15:52
*** mriedem has joined #openstack-infra15:52
fungiclarkb: yeah, i'm okay extending the fallback list to add analogous xenial support (rather than forcing many projects to add an other-requirements.txt file before we can move to xenial) but for that one repo it might be easier to just switch it to using other-requirements?15:53
fungikeep in mind that the fallback list is baked into our images, so will be somewhat delayed taking effect15:53
*** mahatic has joined #openstack-infra15:54
*** mriedem1 has quit IRC15:54
*** ddieterly is now known as ddieterly[away]15:54
clarkbthats true, and this run of tests should tell me if there are any other projects that rely on the same dev package15:54
odyssey4mefungi with regards to your comment in https://review.openstack.org/#/c/339770/5/jenkins/jobs/projects.yaml - the jobs added are *additional* - in order words the 'functional' tox env must run and the 'functional-ovs' tox env must run15:54
clarkbzaro: ^ maybe you can work on other-requirementsing python-jenkins?15:55
*** gyee has joined #openstack-infra15:55
clarkbfungi: I will likely wait for the entire set to run then compile a "master" list of missing system deps15:55
openstackgerritDoug Hellmann proposed openstack-infra/project-config: add job to apply tags when based on changes in openstack/releases  https://review.openstack.org/34105815:55
*** psachin has quit IRC15:55
odyssey4mefungi also that job group has other jobs that must also run15:55
odyssey4me(docs, linters, announce-release)15:56
fungiodyssey4me: oh, yep, i missed the ovs on those. so my last inline comment about redundancy isn't valid15:56
dhellmannfungi , clarkb : I would appreciate some help making sure I have ^^ setting up the local workspace properly (and of course anything else needed, but that's the part I know I'm uncomfortable with having done right)15:56
odyssey4mefungi ok cool thanks - just making sure I understand things correctly15:56
zaroclarkb15:56
*** arxcruz has joined #openstack-infra15:57
zaroclarkb: will look into that. need to setup xenial first15:57
*** ddieterly[away] is now known as ddieterly15:57
*** ajmiller has quit IRC15:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977015:57
clarkbzaro: thanks15:57
*** ifarkas has quit IRC15:58
*** ajmiller has joined #openstack-infra15:58
rajinirI need the slave node for debugging failures. Will OFFLINE_NODE_WHEN_COMPLETE='0' work?15:59
clarkbrajinir: if you are using nodepool you can `nodepool hold` the instance. If you don't offline the node then more jobs can run on it which is likely not desireable15:59
jeblairrajinir: are you using nodepool?15:59
*** _oanson has quit IRC16:00
sshnaidmclarkb, jeblair hi, can we please merge this today? https://review.openstack.org/#/c/334452/  thanks16:00
*** pcaruana has quit IRC16:00
rajinirclarkb,thanks will try. Is that using the nodepool cli?16:01
rajinirjeblair: yes16:01
clarkbrajinir: it is16:01
rajinirclarb: awesome , thanks16:02
rajinirclarkb: Thank you16:02
pabelangerodyssey4me: I've left a comment, and what we need to do to fix the scenario / toxenv settings16:02
pabelangerodyssey4me: we need to allow tox -efunc in tox.ini16:02
Shrewsjeblair: nothing lately from me16:03
Shrewsrcarrillocruz: looking16:03
clarkbsshnaidm: +216:03
odyssey4mepabelanger that would certainly simplify things - I was trying to avoid the mass tox.ini change16:03
*** rcernin has quit IRC16:03
sshnaidmclarkb, thanks!16:03
pabelangerodyssey4me: Ya, that's the most work, but the right change IMO16:03
odyssey4mepabelanger so basically I disconnected the scenario name from the tox env name16:03
*** jlanoux has quit IRC16:04
jeblairsshnaidm: SpamapS had some good suggestions there -- the first, mirring the names between the method and command line.  i noticed you updated your patch to implement that, though i note that while they are closer, they aren't exactly the same.  SpamapS, is that what you meant to suggest?16:04
jeblairsshnaidm: the other suggestion was adding a basic test -- i'm guessing something that instantiates geard with tcp keepalives just to make sure the code executes (we probably don't need to try to verify that they actually *work*)16:05
odyssey4mepabelanger you do realise that it'll be a change to add func as a target to tox, then the job change, then a change to remove functional from tox :/16:05
jeblairsshnaidm: what do you think about adding a test like that?16:05
sshnaidmjeblair, mm.. I need to look at current tests and to see if it's possible16:06
*** daemontool has quit IRC16:06
*** dprince has quit IRC16:06
*** harlowja_at_home has quit IRC16:06
rcarrillocruzi'm going afk for a bit, enough shade battling16:06
rcarrillocruzwill be around for infra meeting16:06
rcarrillocruzlaterz16:07
*** tonytan_brb has joined #openstack-infra16:07
sshnaidmjeblair, I thought it was related to variable names, not cli args, but no problem to change them too16:07
pabelangerodyssey4me: Yup. Going to be alot of churn.  I don't think JJB will work on your current patch, lets see what the gate says.  otherwise, maybe we just hold off until zuulv3 is done16:07
jeblairsshnaidm: i like the cli args as is16:07
*** ihrachys has quit IRC16:07
sshnaidmjeblair, ok, then won't change :)16:07
openstackgerritAnita Kuno proposed openstack-infra/storyboard: Add example commands for the Tags api  https://review.openstack.org/33853216:07
jeblairsshnaidm: my question is, should the class parameters exactly match the cli args, or just be mostly like them (as it is now)16:07
*** rdx_matt has quit IRC16:08
*** tqtran has joined #openstack-infra16:08
*** Julien-zte has quit IRC16:08
Shrewsrcarrillocruz: +A'd. thx!16:09
*** sdake_ has quit IRC16:09
sshnaidmjeblair, I think cli args are for people, and class arguments are for library users, so I don't think it *must* be the same16:09
*** tesseract- has quit IRC16:09
*** tonytan4ever has quit IRC16:09
*** sdake_ has joined #openstack-infra16:10
*** karthikp_ has quit IRC16:10
*** simondodsley has joined #openstack-infra16:10
jeblairsshnaidm: *nod*.  i'm hoping SpamapS will let us know what his intent was there.16:11
*** tqtran has quit IRC16:12
dmsimardOh wow, it never occured to me that http://status.openstack.org/zuul/ and http://zuul.openstack.org/ were different16:12
* SpamapS stirs16:12
dmsimardhttp://status.openstack.org/zuul/ is so much more lightweight on my browser16:12
*** ggillies has quit IRC16:13
*** david-lyle has joined #openstack-infra16:13
*** hurgleburgler has joined #openstack-infra16:14
pabelangerodyssey4me: left a new suggestion16:14
*** ggillies has joined #openstack-infra16:14
*** javeriak has joined #openstack-infra16:14
*** bauzas_notabot is now known as bauzas16:15
odyssey4mepabelanger hmm, that's doable - although the tox builder executes the run-tox script, it doesn't just execute tox -e {env}16:16
*** jamesmcarthur has joined #openstack-infra16:16
*** dizquierdo has quit IRC16:18
*** daemontool has joined #openstack-infra16:19
*** ajmiller has quit IRC16:19
*** ajmiller has joined #openstack-infra16:19
SpamapSsshnaidm: I agree with your assertion that CLI args are different than library args16:21
*** david-lyle has quit IRC16:21
sshnaidmSpamapS, ok, cool16:21
*** tidwellr has left #openstack-infra16:22
*** armax_ has joined #openstack-infra16:22
*** Swami has joined #openstack-infra16:22
*** shashank_hegde has joined #openstack-infra16:22
SpamapSsshnaidm: +1'd16:23
SpamapSjeblair: ^16:23
*** karthikp_ has joined #openstack-infra16:23
*** hurgleburgler has quit IRC16:23
*** sandanar_ has quit IRC16:23
*** notnownikki has joined #openstack-infra16:23
jeblairSpamapS: okay, so you were going for "approximate" rather than "be identical"?16:23
*** gongysh has quit IRC16:23
pabelangerodyssey4me: right, we'd call /usr/local/jenkins/slave_scripts/run-tox.sh {scenario} directly now16:24
pabelangeror16:24
*** sdake_ has quit IRC16:24
*** armax has quit IRC16:24
*** armax_ is now known as armax16:24
pabelanger/usr/local/jenkins/slave_scripts/run-tox.sh functional16:24
*** sandanar has quit IRC16:24
*** d0ugal has quit IRC16:24
*** jpich_ has quit IRC16:24
SpamapSjeblair: correct. The way they were written before, they seemed oddly skewed. But now they're at least the same letters (or at least, my brain thinks they are)16:25
odyssey4mepabelanger ok, adjustment incoming16:26
*** jtomasek__ has quit IRC16:26
*** jlk` is now known as jlk16:26
*** jlk has quit IRC16:27
*** jlk has joined #openstack-infra16:27
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Make gate-tempest-dsvm-postgres-full voting again  https://review.openstack.org/34107316:27
mriedemanteaya: clarkb: ^16:27
*** hurgleburgler has joined #openstack-infra16:27
sshnaidmSpamapS, jeblair so we have an agreement?16:29
pabelangerrcarrillocruz: have a minute for a review? 34099316:29
*** makowals has joined #openstack-infra16:30
jeblairsshnaidm: yep.  do you want to add a test?16:31
vponomaryovfungi, tristanC: Hello, I need help in procedure of security bug fix proposal. "manila-ui" project does not have vulnerability managed governance tag, but has currently "private" security issue reported with existing fix for it. So, what our, "manila-ui" maintainers, proper actions to do?16:31
sshnaidmjeblair, as I looked now on tests, this server is not tested anywhere, it's itself: "A simple gearman server implementation for testing (not for production use)"16:32
clarkbfungi: ttx tristanC ^ I think vponomaryov's question is somethign you may know the answer to16:32
sshnaidmjeblair, so testing it will require a pretty big overhead in test code, but no real value, because it's a test itself..16:32
sshnaidmwe're bad risky guys that use it :)16:33
*** trown is now known as trown|lunch16:33
jeblairsshnaidm: works for me :)16:33
*** savihou has quit IRC16:34
*** Rockyg has joined #openstack-infra16:34
fungivponomaryov: the official process we have documented at https://security.openstack.org/vmt-process.html also serves as a guideline for handling of vulnerabilities outside of openstack vmt oversight. there are a few caveats though16:34
sshnaidmjeblair, SpamapS, clarkb thank for your input guys!16:34
anteayamriedem: +2, thank you16:35
jeblairsshnaidm: thanks for the patch :)  we should probably start using it....16:35
fungivponomaryov: also, we're (vmt members) happy to consult on vulnerability reports throughout the community and guide you through some of the more touchy parts of that process16:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977016:36
*** david-lyle has joined #openstack-infra16:36
*** e0ne has joined #openstack-infra16:36
sshnaidmjeblair, yeah, if zuul erases vms not gracefully, you have a risk to have a lot of stuck connection and breaking fd limits16:36
fungivponomaryov: the main caveats are that the published vulnerability won't have an "ossa" number assigned, and you'll need vmt assistance to send advance notification to downstream stakeholders if you need to do so under an embargo (depending on your comfort level and the severity of the vulnerability)16:37
*** asettle has quit IRC16:37
fungivponomaryov: otherwise pretty much all of that process should be reusable by your project's bug team16:38
*** rkukura has quit IRC16:38
*** mrmartin has quit IRC16:38
openstackgerritMerged openstack-infra/gear: Support TCP keepalives in geard  https://review.openstack.org/33445216:38
odyssey4mepabelanger you like ? https://review.openstack.org/339770 :)16:39
pabelangerodyssey4me: looking16:39
*** tqtran has joined #openstack-infra16:39
fungivponomaryov: oh, also you won't propose a yaml version of the advisory to the openstack/ossa repo, but instead will need to plug your information into a copy of the restructured text we use to send our advisories to various mailing lists16:39
*** sdake_ has joined #openstack-infra16:40
*** shashank_hegde has quit IRC16:40
vponomaryovfungi: I am not sure whether OSSA is needed, but "vmt assistance to send advance notification to downstream stakeholders" is right thing to do, IMHO16:40
*** asettle has joined #openstack-infra16:41
fungivponomaryov: you can see an example by looking at a recent official advisory like https://security.openstack.org/vmt-process.html and clicking on the "show source" link in the left hand column16:41
*** AJaeger has joined #openstack-infra16:41
fungithat's basically what we send in the public announcements16:41
anteayaanyone else willing to review mriedem's patch to make the progress-full job voting again? https://review.openstack.org/#/c/341073/116:41
openstackgerritJon-Paul Sullivan (j3p0uk) proposed openstack-infra/zuul: Make the cloner strategy clearer  https://review.openstack.org/17720116:42
pabelangerodyssey4me: minor nit16:42
fungivponomaryov: er, i meant a recent advisory like https://security.openstack.org/ossa/OSSA-2016-008.html16:42
*** eharney has joined #openstack-infra16:42
*** thorst is now known as thorst_afk16:42
*** lucasagomes is now known as lucas|afk16:42
sshnaidmjeblair, do you know maybe - how is it going the versioning/releasing geard? when can I get the new version from PyPi?16:43
AJaegerjeblair: thanks for merging Sachi's change for zuul (https://review.openstack.org/#/c/293194/)- what does this mean for contraints? Can we use them now in post jobs - and how exactly?16:43
pabelangerAJaeger: did you submit your lightning talk for bindep?16:43
fungivponomaryov: anyway, feel free to contact those of us listed at https://security.openstack.org/index.html#how-to-report-security-issues-to-openstack or subscribe https://launchpad.net/~openstack-vuln-mgmt to the bug16:43
AJaegerpabelanger: yes, I did - since nobody answered my email, I sent something yesterday16:43
AJaegerpabelanger: thanks for asking!16:44
pabelangerAJaeger: great, I just did one for nodepool and dibs16:44
jeblairsshnaidm: it might be nice to land https://review.openstack.org/184265 before releasing it16:44
jeblairclarkb: ^ if you feel like another gear review16:44
jeblair(also parent patch)16:44
AJaegerpabelanger: great!16:45
openstackgerritKhai Do proposed openstack-infra/system-config: Configure its-storyboard plugin  https://review.openstack.org/33092516:45
openstackgerritMerged openstack-infra/shade: Add floating IPs to server dict ourselves  https://review.openstack.org/31571316:46
jeblairAJaeger: i don't know exactly what that will look like16:46
*** asettle has quit IRC16:46
*** karthikp_ has quit IRC16:46
*** david-lyle_ has joined #openstack-infra16:46
*** garyk has quit IRC16:46
greghaynespabelanger: nice!16:46
clarkbjeblair: yes I need a break from trolling failed test logs16:46
*** asettle has joined #openstack-infra16:46
*** karthikp_ has joined #openstack-infra16:47
dmsimardIs there a way for a job to tell if it's running a parent or a child job in Zuul ? i.e with the config in http://paste.openstack.org/show/530955/ .. I'd basically like to re-use the child job in different contexts and just add an "<if running as child>do this</if running as child>".16:47
jeblairAJaeger: but once new images are built with the new zuul-cloner, it can be used in post jobs.  we install from master, so no zuul release needed.16:47
AJaegersamueldmq, clarkb : you had a question on other-requirements? Ideally, the normal environment is run-time environment, and the test adds the packages needed for testing.16:47
pabelangerAJaeger: if you mind adding 340993 to your review list16:47
AJaegerpabelanger: will do16:47
AJaegerdmsimard, clarkb: Is there a review you want comments on?16:48
* AJaeger glances over eavesdrop backscroll16:48
AJaegerpabelanger: will do16:48
dmsimardAJaeger: this is in another zuul instance, not openstack-infra's16:48
samueldmqAJaeger: so runtime env is always a superset of dev env16:48
*** david-lyle has quit IRC16:48
jeblairdmsimard: not directly, however, most child jobs are children because of some dependency on the product of a parent job, so rather than assuming that dependency, you could check for it.16:49
AJaegersamueldmq: as clarkb said it. I see runtime as subset of test environment - for testing, you need additional packages installed.16:49
samueldmqAJaeger: and we differentiate the test specific reqs with [test] section in other-requirements, right?16:49
dmsimardjeblair: the way we thought of doing it was to query the Zuul status.json and find if there is a relationship for the same patch16:49
openstackgerritJeremy Stanley proposed openstack-infra/infra-specs: Add spec for unified message bus  https://review.openstack.org/32911516:49
dmsimardwas hoping there'd be a better way16:49
dmsimardbut yes, in this particular case, we're interested in an artifact of the parent job16:50
jeblairdmsimard: all jobs in a build set share a zuul ref16:50
samueldmqAJaeger: that's correct, I've put it in the opposite order in my explanation, gotcha16:50
AJaegerjeblair: ok, do we need to change existing post jobs to make use of the change zuul-cloner?16:50
clarkbjeblair: done, that was a simple change16:50
AJaegersamueldmq: yes, [test] - as documented. Have a look at storyboard repo for an example16:50
jeblairdmsimard: the zuul ref can be used to uniquely identify artifacts from the same build set16:51
jeblairdmsimard: please don't fetch status.json :)16:51
openstackgerritJeremy Stanley proposed openstack-infra/infra-specs: Firehose, a unified message bus for Infra services  https://review.openstack.org/32911516:52
samueldmqAJaeger: https://github.com/openstack-infra/storyboard/blob/master/other-requirements.txt ?16:52
AJaegerzigo, dmsimard : Initially using [test] was broken, so first repos did not use [test] at all. Feel free to update those repos to make proper use of [test]16:52
*** Daisy_ has joined #openstack-infra16:52
samueldmqAJaeger: I can't see the use of [test] there16:52
dmsimardjeblair: hm, the problem I'm facing is that I have to find the zuul_uuid of the parent job -- because that uuid is used in the artifact location and the child job does not know it16:52
clarkbdhellmann: is the CalledProcessError for releasenotes the one you are aware of?16:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Implement optional scenario setting for Ansible jobs  https://review.openstack.org/33977016:52
dmsimardjeblair: since the zuul_uuid is unique per job16:52
AJaegerdmsimard: my change hasn't merged - use https://review.openstack.org/#/c/335826/1/other-requirements.txt16:52
*** notnownikki has quit IRC16:53
AJaegerdmsimard: I forgot that it's still under review ;(16:53
dmsimardAJaeger: have you been meaning to ping someone else ? I'm not sure what you're on about16:53
samueldmqAJaeger: dmsimard: cool, I looked at that patch ^ thanks16:53
jeblairdmsimard: i'd suggest using the zuul ref rather than the uuid then16:54
*** javeriak_ has joined #openstack-infra16:54
*** javeriak has quit IRC16:54
AJaegerdmsimard: I meant samueldmq - not sure how I screwed up. Sory.16:54
odyssey4mepabelanger done16:54
dmsimardjeblair: so upload artifacts at a location based on the ref rather than the uuid ?16:54
samueldmqAJaeger: np at all16:54
samueldmqAJaeger: thanks for the additional clarifications16:55
*** Apoorva has joined #openstack-infra16:55
dmsimardjeblair: that ref is unique within a single job set, right ? if I do, for example, a recheck, a new ref will be generated ?16:55
*** Apoorva has quit IRC16:55
*** zhurong has joined #openstack-infra16:56
*** Daisy_ has quit IRC16:56
*** derekh has quit IRC16:56
*** dprince has joined #openstack-infra16:57
*** rkukura has joined #openstack-infra16:57
openstackgerritKaiyan Sheng proposed openstack-infra/project-config: [Monasca-agent] Remove check-requirements check job for monasca-agent  https://review.openstack.org/34109116:58
jeblairdmsimard: the ref is unique for a build set, which is a set of running jobs for a change in a given configuration in a pipeline.  all the jobs running for a change at the same time share the buildset; you get a new buildset if zuul reorders the queue, and you get a new buildset each time a change is enqueued.16:59
jeblairdmsimard: (long winded way of saying 'yes' to your question, i think :)16:59
*** ajmiller has quit IRC16:59
dmsimardjeblair: ack, thanks16:59
*** ajmiller has joined #openstack-infra17:00
*** Apoorva has joined #openstack-infra17:00
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Bindep: Use python3-all  https://review.openstack.org/34109317:00
*** xenogear has joined #openstack-infra17:00
AJaegerzigo, fungi, what do you think of this cleanup for python3-all ? ^17:00
*** sarob has joined #openstack-infra17:01
*** jamesmcarthur has quit IRC17:02
*** zhurong has quit IRC17:02
*** zhurong has joined #openstack-infra17:03
zaroclarkb, fungi : I've got gerrit delete-project plugin ready to go if you need to cleanup repos, https://review.openstack.org/#/c/319400/17:03
AJaegerinfra-root, has anybody helped sdake to upload current images to rax-ord? See  https://review.openstack.org/339776 - it showed that we still have old rax-ord images without the updated repository location there. Help would be welcome17:03
*** mrmartin has joined #openstack-infra17:04
*** armax_ has joined #openstack-infra17:04
pabelangerAJaeger: ya, I missed that one last night17:04
pabelangerI'll be confirming again tonight17:04
*** matthewbodkin has quit IRC17:04
AJaegerpabelanger: thanks!17:05
clarkbzaro: I think first step is to just let them know that the resources are still available to them and give them a chacne to say they don't want them17:05
zaroclarkb: yeah ++17:05
dmsimardjeblair: hm, I guess we're bound to the uuid location as we're currently using swift uploader and there's https://github.com/openstack-infra/project-config/blob/master/jenkins/scripts/zuul_swift_upload.py#L46717:05
pabelangerAJaeger: actually, it is updated already17:05
*** rdx_matt has joined #openstack-infra17:06
clarkbnodepool tsets seem to be completely broken on xenial17:06
dmsimardjeblair: but we can override that location17:06
clarkbdue to mysql things17:06
pabelangerAJaeger: so each region should be good for ubuntu-trusty now17:06
AJaegersdake: let's recheck again  ^17:06
*** akshai has quit IRC17:06
AJaegerthanks, pabelanger17:06
pabelangerAJaeger: which review are you testing?17:06
zarofungi: RE:https://review.openstack.org/#/c/334714/  gerrit module is not part of puppet-openstackci so are third parties actually using it?17:07
*** akshai has joined #openstack-infra17:07
*** armax has quit IRC17:07
*** armax_ is now known as armax17:07
AJaegerpabelanger: 33977617:08
zaroif so can we identify and add appropriate reviewers to get feedback.  otherwise i can just make it configurable if it makes this go in faster17:08
pabelangerdmsimard: you should be able to update your copy of http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/openstack_functions.py#n18 for the LOG_PATH you need17:08
*** karthikp_ has quit IRC17:09
dmsimardpabelanger: oh, that's much cleaner than what I was going to do, thanks for that17:09
fungizaro: i don't think it has as many downstream consumers as modules openstackci depends on, but it definitely has some17:09
zarofungi: would making it configurable satisfy your concern?17:09
anteayazaro: I have no idea how many downstream folks are consuming the gerrit module, the only way I would know is if you post to -infra, asking for them to show themselves and review the patch if they care17:09
fungizaro: i understood hpe/gozer was using it, for example17:09
*** sarob has quit IRC17:09
*** karthikp_ has joined #openstack-infra17:09
fungizaro: and yes, making it configurable would solve that17:09
zarook, then i'll just puppet it up configurable.17:10
fungizaro: that way we can enable git gc from our system-config repo but others who are using that module continue to use git repack instead17:10
dmsimardpabelanger: when does that openstack_functions script run ?17:11
pabelangerdmsimard: from zuul/layout.yaml17:11
*** ihrachys has joined #openstack-infra17:11
pabelangerdmsimard: it gets loaded when zuul starts IIRC17:12
dmsimardpabelanger: I mean, I essentially want to remap LOG_PATH to "${BASE_LOG_PATH}/${ZUUL_PIPELINE}/${JOB_NAME}/${ZUUL_REF}"17:12
dmsimarddo I access to those variables ?17:12
dmsimardwith os.getenv or whatever17:12
pabelangerand then we use some regex to call the set_node_options function17:12
pabelangerUmm17:12
dmsimardRight now LOG_PATH is ${BASE_LOG_PATH}/${ZUUL_PIPELINE}/${JOB_NAME}/${ZUUL_UUID}17:13
pabelangerdmsimard: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/layout.yaml#n1057 is how it is setup17:13
*** PollyZ has quit IRC17:13
pabelangerdo, I am not sure which jobs you want to override it for17:13
pabelangerthere is a few ways to handle it17:13
pabelangeryou can do it in JJB17:13
pabelangeror from zuul directly17:13
dmsimardpabelanger: yeah I was going to jenkins way17:14
dmsimardor, err, well, JJB17:14
openstackgerritMerged openstack-infra/project-config: Enable reprepro-release-deb-openstack  https://review.openstack.org/34099317:14
*** pfallenop has quit IRC17:15
*** jtomasek__ has joined #openstack-infra17:17
*** pfallenop has joined #openstack-infra17:17
*** degorenko is now known as _degorenko|afk17:17
*** sdake_ has quit IRC17:17
dkehnfungi, is there a openstack-infra repo that is used to build the the final release packages for things like neutron, etc.?17:17
*** gfreeman has joined #openstack-infra17:18
anteayadkehn: there are release manager tools, could that be what you are looking for?17:18
anteayadkehn: http://git.openstack.org/cgit/openstack-infra/release-tools/17:19
jesusaurclarkb: how busy is your week looking? could we possibly find some time to switch to the log_processor project (I'm realizing that I dropped the ball on that a while ago)17:20
dkehnanteaya, so when the project for release are build is there a set of tools , in the openstack-info repo tree, for example that are used to package up the rpms, etc for real release?17:20
dkehnanteaya, ok, let me looky17:21
anteayaI don't think we package rpms17:21
jesusaurbut the good news is that https://review.openstack.org/254312 is the only outstanding commit17:21
dkehnanteaya, thxs tons17:21
clarkbjesusaur: this week is a milestone and I am trying to finish up prep for the xenial switch so we can switchover soon after milestone17:21
anteayadkehn: I think the artifact form we create are tarballs, then folks that want other package forms use the tarballs17:21
clarkbjesusaur: I may have time late in the week depending onhow prep goes17:21
anteayadkehn: and you are welcome tons17:22
*** zhurong has quit IRC17:22
clarkbjesusaur: so far it is going pretty well. Nothing too crazy has been run into so I may have time17:22
*** jtomasek__ has quit IRC17:22
AJaegerdkehn, there's a separate project for RPMs with their own channel...17:22
AJaegerdkehn: the release team only takes care of python packages and that's basically invoking the usual sdist commands and uploading17:22
fungidkehn: yeah, what anteaya says. we publish python sdist tarballs and wheels from every tag. various linux distro package maintainers have their own tools and workflows for making the packages of those for their distros--we don't have a hand in it currently17:24
dkehnAJaeger, thx17:24
jesusaurclarkb: alright, ping me if you want to make the switch17:25
*** locust has joined #openstack-infra17:25
locusthello, can anybody please give me link on how to deploy my local "Cloud" that supposed to be opperated by nodepool?17:26
*** dizquierdo has joined #openstack-infra17:26
locustand it is all in a context of OpenStack CI17:26
locustthank you17:26
*** samueldmq has quit IRC17:27
*** garyk has joined #openstack-infra17:28
*** mrmartin has quit IRC17:28
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477717:28
fungilocust: we (for the upstream openstack ci) don't actually run a cloud nodepool interacts with (yet). we just use accounts at various public cloud providers. so it's at least not necessary in all cases that you run a copy of openstack to use nodepool17:29
*** dizquierdo is now known as dizquierdo_afk17:30
*** deadnull has joined #openstack-infra17:31
*** hurgleburgler has quit IRC17:31
*** hurgleburgler has joined #openstack-infra17:31
fungilocust: if you want to run your own openstack cloud and use that with nodepool, you would i suppose deploy openstack via whatever means you're most comfortable with (there are projects which deploy it with ansible, puppet, chef, salt, in containers, bootstrapping it with itself and orchestrating with heat, pick your poison)17:31
*** karthikp_ has quit IRC17:31
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477717:32
jeblairdmsimard: i thought we were not using the swift uploader for anything right now17:32
anteayathank you AJaeger17:33
*** ddieterly is now known as ddieterly[away]17:33
*** ddieterly[away] is now known as ddieterly17:34
jeblairdmsimard: what zuul are you talking about?  openstack's zuul or a third-party?17:34
openstackgerritChris Denneen proposed openstack-infra/jenkins-job-builder: gitlab trigger: Support new "trigger-open-merge-request-push" options  https://review.openstack.org/31212117:34
jeblairdmsimard: because pabelanger said "your copy of openstack_functions" which only makes sense as a response for a question about a third-party ci17:34
*** makowals has quit IRC17:34
*** makowals has joined #openstack-infra17:34
*** makowals has quit IRC17:35
*** PollyZ has joined #openstack-infra17:35
pabelangerjeblair: since dmsimard was asking, it is likely Software Factory and review.rdoproject.org17:35
*** makowals has joined #openstack-infra17:36
openstackgerritChris Denneen proposed openstack-infra/jenkins-job-builder: I've rebased my change... see if that helps  https://review.openstack.org/34111017:36
*** garyk has quit IRC17:37
*** garyk has joined #openstack-infra17:37
locustfungi: you mean I can use devstack or rdo too?17:37
dhellmannclarkb : hmm, no, I think we were seeing encoding errors. have a link?17:37
clarkbdhellmann: its from my local tests on xenial will give you a copy of an example17:38
dhellmannk17:38
fungilocust: well, i'd advise against devstack since it's not designed to run long-term or preserve configuration changes17:38
*** shashank_hegde has joined #openstack-infra17:38
clarkbdhellmann: http://paste.openstack.org/show/531005/17:38
fungilocust: though you could certainly test nodepool out against a devstack-deployed openstack (and in fact, that is precisely what our integration testing for nodepool does)17:39
dhellmannclarkb : is that a result of running the releasenotes job under python 3.5?17:39
dmsimardjeblair: this is in the review.rdoproject.org environment, yes17:39
fungilocust: but yes, you could use nodepool with rdo or mos or whatever distro of openstack you like too17:40
*** rdx_matt has quit IRC17:40
locustfungi: yep, you are 100% right17:40
*** PollyZ has quit IRC17:41
jeblairdmsimard, pabelanger: gotcha, thanks17:41
*** dprince has quit IRC17:41
openstackgerritEric Brown proposed openstack-infra/project-config: Enable py35 voting on vmware-nsx  https://review.openstack.org/34070817:41
*** asettle has quit IRC17:41
clarkbdhellmann: no the traceback has python2.7 in it17:41
locustfungi: after I deploy for instance RDO openstack, I have to pass credentianl to it to ansible along side with nodepool17:41
openstackgerritMerged openstack-infra/project-config: Make gate-tempest-dsvm-postgres-full voting again  https://review.openstack.org/34107317:42
dhellmannoh, weird17:42
*** akshai has quit IRC17:42
*** trown|lunch is now known as trown17:42
clarkbdhellmann: tox should default to python2.7 unless you tell it to us a different version17:42
dhellmannwell, it defaults to the version of python where it's installed, but yeah17:43
*** dprince has joined #openstack-infra17:43
fungilocust: you would configure clouds.yaml for nodepool to have the credentials for a tenant/project you created for it in your openstack deployment, yes17:43
dhellmannclarkb: ok, this is a new error I haven't seen before. I'll have to see about setting up a test system. this is 16.04?17:44
fungilocust: in fact, you could run your nodepool server on a virtual machine in one tenant in your cloud, and have it manage nodes in a separate tenant if you wanted, as long as your api endpoints are reachable from the instance you're using for nodepool17:44
clarkbdhellmann: yup 16.04 xenial17:44
dhellmannok, I'll put that on my todo list to test out17:45
*** akshai has joined #openstack-infra17:45
clarkbdhellmann: 2.3.1 imported from /usr/local/lib/python2.7/dist-packages/tox/__init__.pyc is the tox --version output on my test box17:45
AJaegerclarkb: can you run the git command directly? "git log --simplify-by-decoration --pretty="%d" origin/stable/liberty" ?17:45
clarkbwhich is how we install it on the infra images ( I am using an infra image)17:45
clarkbAJaeger: ya I can swing around once I am done classifying the current set of errors17:45
*** jlk has left #openstack-infra17:45
*** thorst_afk is now known as thorst17:45
dhellmannclarkb : ack. it might be tomorrow before I can get something similar set up, but I'll look at this one if you want to start looking at the others17:46
*** mrmartin has joined #openstack-infra17:46
*** psilvad has quit IRC17:46
*** puiterwijk is now known as puiterwijk|otg17:47
*** puiterwijk|otg is now known as puiterwijk|outag17:47
*** puiterwijk|outag is now known as puiterwijk17:49
*** asettle has joined #openstack-infra17:49
*** asettle has quit IRC17:49
*** PollyZ has joined #openstack-infra17:49
clarkbdhellmann: sounds good thanks17:49
*** asettle has joined #openstack-infra17:49
clarkbdhellmann: I will also provide a full list of errors and the sanitized list with things scrubbed out that I believe are non issues17:50
*** john-davidge has quit IRC17:50
*** garyk has quit IRC17:51
*** andymaier has joined #openstack-infra17:51
*** psilvad has joined #openstack-infra17:52
*** tidwellr has joined #openstack-infra17:52
tidwellrHi, is there someone here who can take a look at (and hopefully approve) https://review.openstack.org/#/c/340222 ?17:53
*** pvaneck has joined #openstack-infra17:53
*** psilvad has quit IRC17:54
*** psilvad has joined #openstack-infra17:54
*** PollyZ has quit IRC17:54
*** tonytan_brb has quit IRC17:54
*** ddieterly is now known as ddieterly[away]17:55
*** psilvad has quit IRC17:55
AJaegertidwellr: it needs neutron infra liason +1 first. Ask armax, dougwig or mestery for a +1 - and then somebody will approve. But not before.17:56
anteayatidwellr: can you get armax or dougwig to at least say they know the patch exists?17:56
anteayaoh yeah or mestery17:56
clarkbdtroyer: openstackclient fails tox -epy27 on xenial with AttributeError: 'module' object has no attribute 'select_auth_plugin'17:56
anteayathanks AJaeger17:56
dougwigAJaeger: looking17:56
* armax looks17:56
*** tosky has quit IRC17:56
anteayathe whole gang is here17:56
AJaegerthanks, anteaya ;)17:56
anteaya:)17:56
* AJaeger shouldn't have awakened all of them ;)17:56
armaxAJaeger: what did you do?17:56
armaxAJaeger: :)17:56
*** electrofelix has quit IRC17:57
anteayait is nice to see them :)17:57
dougwigAJaeger: the project with the change in question needs a PROJECTS entry???17:57
AJaegerarmax: just helping tidwellr :)17:57
*** psilvad has joined #openstack-infra17:57
*** fawadkhaliq has joined #openstack-infra17:57
dougwigi thought that was implicit.17:57
armaxAJaeger: too much help at once may have the opposite effect!17:57
AJaegerarmax: I have no interest in the change - besides that it's in our queue ;)17:58
*** e0ne has quit IRC17:58
*** andymaier has quit IRC17:58
armaxAJaeger: it’s all god17:58
armaxgood17:58
armaxAJaeger: thanks17:58
*** andymaier has joined #openstack-infra17:58
AJaeger;)17:58
*** Apoorva_ has joined #openstack-infra17:59
tidwellrAJaegar: I'm fumbling around just trying to get some jobs to run in the gate for that project, maybe a PROJECTS entry isn't necessary, I have no idea what I'm doing but it seems like getting this merged may help my cause?17:59
openstackgerritPaul Belanger proposed openstack-infra/system-config: Use strategy free for git servers  https://review.openstack.org/34112117:59
*** ajmiller has quit IRC18:00
pabelangersome ansible performance tuning on puppetmaster.o.o, would be interested in some feedback^.  I've limited it to our git servers for the moment18:00
*** ajmiller has joined #openstack-infra18:00
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477718:01
AJaegertidwellr: it's at least consistent with other projects ;)18:01
clarkbdhellmann: just thinking about that fail is it possible I need to do more setup than git clone and git checkout master and tox -ereleasenotes?18:03
*** Apoorva has quit IRC18:03
clarkbdhellmann: since it seems to be complaining about older branches, clone won't setup tracking branches by default. However it is refering to origin18:03
*** rbrndt has quit IRC18:03
clarkbI wonder if using the on host git cache is breaking this somehow18:03
AJaegerclarkb: it should be fine since it refers to origin18:04
pabelangerzigo: mordred: okay, here is our first iteration on reprepro: http://mirror.dfw.rax.openstack.org/debian-openstack/18:04
clarkbAJaeger: dhellmann I actually think that could be the issue, I will test that in a bit18:04
pabelangerzigo: mordred: I believe we need to have a discussion on the components section. Right now, it contains jessie main (mitaka)18:05
pabelangerzigo: mordred: that should likely be jessie/mitaka18:05
*** ramishra_ has quit IRC18:05
pabelangerbut will wait for your feedback18:05
*** hurgleburgler has quit IRC18:06
clarkbya my local clone doesn't have those branches18:06
*** PollyZ has joined #openstack-infra18:07
AJaegerclarkb: it worked for me locally but perhaps my clone is done differently18:07
*** ramishra has joined #openstack-infra18:07
*** amotoki has quit IRC18:07
armaxAJaeger: if I can trouble with https://review.openstack.org/#/c/340612/, that should fix the failure on one of the jobs for the neutron periodic queue18:08
*** eharney has quit IRC18:08
clarkbAJaeger: its because I am cloning from /opt/git/ on our images18:08
armaxsince you summoned me, in the channel :)18:08
clarkbAJaeger: I need to clone from there, then change the remote then update18:08
armaxmordred, notmorgan: anything you ended up discovering about the shade/neutron issue?18:08
AJaegerarmax: will check;)18:08
armaxAJaeger: in your own time18:09
armaxit’s already late your end18:09
AJaegerclarkb: So, you didn't do all steps we do in the gate? Ok, that explains it...18:09
*** dizquierdo_afk is now known as dizquierdo18:09
AJaegerarmax: why is that change not needed for oslo? Are they not using constraints?18:10
armaxAJaeger: not in that case since it’s testing the master version of the library18:11
*** sdake_ has joined #openstack-infra18:11
armaxAJaeger: that’s the very purpose of the job18:11
*** akshai has quit IRC18:11
*** jamesmcarthur has joined #openstack-infra18:11
AJaegerah...18:11
AJaegerarmax: +2 - now find somebody else ;)18:12
openstackgerritJames E. Blair proposed openstack-infra/infra-specs: Update Xenial work items formatting  https://review.openstack.org/34112618:12
jeblairclarkb: ^18:12
armaxAJaeger: thank you sire18:12
* AJaeger calls it a day and waves good-bye18:12
*** andymaier has quit IRC18:12
*** hurgleburgler has joined #openstack-infra18:12
anteayabye AJaeger18:12
*** ajmiller has quit IRC18:13
anteayathank you18:13
*** ajmiller has joined #openstack-infra18:13
*** akshai has joined #openstack-infra18:13
*** gouthamr has quit IRC18:14
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477718:14
*** PollyZ has quit IRC18:17
openstackgerritMerged openstack-infra/project-config: Add neutron-dynamic-routing to PROJECT list  https://review.openstack.org/34022218:18
*** javeriak_ has quit IRC18:19
*** tonytan4ever has joined #openstack-infra18:20
*** tphummel has joined #openstack-infra18:20
*** kushal has quit IRC18:22
*** karthikp_ has joined #openstack-infra18:23
*** PollyZ has joined #openstack-infra18:23
openstackgerritJoshua Harlow proposed openstack-infra/irc-meetings: Fix chair for oslo team meetings  https://review.openstack.org/34113118:24
openstackgerritPaul Belanger proposed openstack-infra/project-config: Prefix packaging-deb for reprepro-import URL  https://review.openstack.org/34113218:25
openstackgerritPaul Belanger proposed openstack-infra/project-config: Add reprepro import / release into post pipeline  https://review.openstack.org/34113318:25
pabelangerreprepro bits for post queue18:25
locustfungi: thank you!18:26
fungilocust: you're welcome18:26
*** mriedem1 has joined #openstack-infra18:27
*** Apoorva_ has quit IRC18:28
*** Apoorva has joined #openstack-infra18:28
*** PollyZ has quit IRC18:29
*** mriedem2 has joined #openstack-infra18:29
*** mriedem has quit IRC18:29
*** eharney has joined #openstack-infra18:29
*** locust has quit IRC18:31
rcarrillocruzyolanda: your betamax change just passed neutron func tests18:31
rcarrillocruz\o/18:31
*** mriedem1 has quit IRC18:32
yolandayay!18:32
*** rbrndt has joined #openstack-infra18:32
*** sdake_ has quit IRC18:32
fungias a child i had a betta (fish) named "max"18:33
*** Sukhdev has joined #openstack-infra18:33
*** sdake_ has joined #openstack-infra18:33
pleia2fungi: haha, that's wonderful18:33
fungihis successors were "supermax" and "ed" (for the superbetamax and extended definition formats)18:34
*** mriedem2 is now known as mriedem18:35
pabelangerpleia2: neat stuff with https://github.com/apache/ and the mirror18:35
pabelangerurl*18:35
pleia2pabelanger: yeah, I'm thinking our project sync script could just add a prefix in the project description18:35
*** rdx_matt has joined #openstack-infra18:36
pleia2and we can update the project description, like drupal and kde have done18:36
pleia2project == openstack (not individual repos)18:36
pabelangerpleia2: wonder how we get mirrored from in https://github.com/apache/incubator-pirk18:36
pabelangerif that is configurable or not18:36
pleia2pabelanger: ah, I assumed that was the description, but it's not18:37
* pleia2 pokes around UI18:37
*** gouthamr has joined #openstack-infra18:38
*** asettle has quit IRC18:38
*** shardy is now known as shardy_afk18:38
pabelangerpleia2: I think we'd need to ask github staff: http://stackoverflow.com/questions/11370239/creating-an-official-github-mirror18:40
clarkbanyone know who works on blazar?18:40
pleia2it's a mystery18:40
pleia2pabelanger: ah, hm18:40
clarkbit has hit AttributeError: 'module' object has no attribute 'PROTOCOL_SSLv3' which I think is a xenial thing due to debuntu removing ssl3 support from python because it is insecure18:41
clarkbthey should probably not use an insecure protocol18:41
*** kzaitsev_mb has quit IRC18:41
pleia2https://help.github.com/articles/about-github-mirrors/18:41
*** dizquierdo has quit IRC18:42
*** psilvad has quit IRC18:42
*** david-lyle has joined #openstack-infra18:43
clarkbpabelanger: I looked into it as an alternative to our push model and iirc you have to aks them and its not autoamtable18:43
clarkbwhich is why we didn't consider changes18:43
clarkbs/changes/changing/18:43
pabelangerclarkb: ya18:44
pleia2we can chat more at the meeting, but my main concern is that every day someone submits a change, and we don't give clear indication that it's read-only, or that they should be doing something differently18:44
clarkbpleia2: the pull requset closer bot attempts to clarify things18:45
pleia2been thinking about trying to pull some email matching stats to see if any of these people actually follow up after a bot closes their change18:45
pleia2clarkb: people hate that closer bot, they've already put in work18:45
pleia2now they're told to do it differently, it gives them bad feels (and I sympathize)18:45
fungipleia2: also we have used github's recommended convention of providing a CONTRIBUTING.rst file which says these things too18:45
pleia2it's not enough18:46
clarkbI don't think we will every be able to do enough as long as we mirror to github18:46
*** Goneri has quit IRC18:46
fungii'm afraid nothing will ever be enough to deal with people who don't read and get huffy the first moment they're asked to do something differently18:46
anteayaI'm in favour of not mirroring to github18:47
fungisame here18:47
anteayaI can't please all the people, I accept that about myself18:47
clarkbpleia2: fwiw I also checked those apache repos when I was checking out that feature and many of them had pull requests too18:47
pleia2some of the projects I linked in the agenda made it much more obvious than ours, like appending it to the project description that it was read only, etc18:47
jeblairpleia2: we could also do what other projects do, and put in a static pull request with contributing info18:48
fungithe only real argument i've seen for continuing to mirror to github is that people will search for openstack projects on github because they don't know any better, and if we don't mirror to it then they'll end up finding some joe random outdated fork and assuming that's ours18:48
pleia2then by loading up the project page itself, they can see that they should follow another process without digging into a contributing file18:48
*** piet has quit IRC18:48
pleia2jeblair: the pull request template?18:48
pleia2(that's one of my suggestions in the agenda)18:48
*** PollyZ has joined #openstack-infra18:48
clarkbfungi: many people also use github to collaborate on before pushing to gerrit (whther ot not you want to support that workflow is another question)18:49
jeblairpleia2: oh didn't know about that.  i meant a pull request that stays open so that people see it when they go to the PR page for a project18:49
anteayaI can't even make the people happy who _do_ go to the work of asking themselves what our workflow is18:49
anteayaI don't think I can take on the additional numbers of people who can't be bothered to do that18:49
*** dizquierdo has joined #openstack-infra18:49
pleia2jeblair: it's new :) https://help.github.com/articles/creating-a-pull-request-template-for-your-repository/18:49
*** david-lyle has quit IRC18:49
*** adrian_otto has quit IRC18:49
*** dizquierdo has quit IRC18:49
clarkbansible has a template and its annoying because almost never is the stuff in the template useful18:49
jeblairpleia2: maybe an 'all of the above' approach, assuming we want to keep mirroring18:49
*** dizquierdo has joined #openstack-infra18:50
pleia2jeblair: yeah18:50
pleia2fwiw, I don't like the github mirror more than any of you do, so I'm trying to make the best of it18:50
anteayapleia2: would you be opposed to dropping the github mirror?18:50
pleia2anteaya: no, but people have already mentioned reasons we are keeping it18:51
fungii'm pretty sure we'd have community outrage on our hands if we did18:51
anteayasure we would18:51
jeblairthing is, there has always been a github mirror of openstack (even before it used git), and there always will be.  the question is -- do we run it.  :)18:51
openstackgerritKhai Do proposed openstack/python-jenkins: Add kerberose packages  https://review.openstack.org/34114318:51
pleia2I think a lot of internal corp things we don't see point at github18:51
fungiand people would quickly set up hacky pull mirrors into github18:51
zaroclarkb: ^ i think that's what you wanted?18:51
clarkbzaro: close, you are going to need to list all of the test deps in other-requirements not just the kerberos ones18:51
clarkbzaro: python-dev-all etc18:52
pleia2jeblair: I think project integrity requires us to continue in this nasty chore18:52
* fungi scrambles to do last-minute meeting prep18:52
anteayajeblair: ah okay, fair18:52
pleia2woo, last agenda item almost finished before the meeting \o/18:52
fungipleia2: fwiw i'm cool with taking every possible (automated) measure to try and redirect people from github to the correct resources18:53
*** asettle has joined #openstack-infra18:53
*** asettle has quit IRC18:53
zarodoes 'tox -e bindep' produce that list?  that commands fails for me on my xenail container.18:54
*** asettle has joined #openstack-infra18:54
zaroclarkb: ^18:54
fungias long as we accept that whatever we do will never be enough, and that there will always be at least some github zealots who will be incredulous at our insistence to use something else18:54
pleia2fungi: that's helpful, I didn't want to spend time+effort in the weeds if we weren't on the same page, but it seems like we are18:54
clarkbzaro: no bindep uses the other-requirements to generate it so you have to proivide it18:55
*** ddieterly[away] has quit IRC18:56
rcarrillocruzShrews: we should make a release of shade18:56
rcarrillocruzi have stuff broken till we get the fix on pypi : http://logs.openstack.org/23/322823/9/check/gate-ansible-role-cloud-launcher-dsvm-ansible-func-ubuntu-trusty/b7944c7/console.html18:56
rcarrillocruz:/18:56
*** piet has joined #openstack-infra18:57
*** arxcruz has quit IRC18:57
*** hurgleburgler has quit IRC18:57
jheskethMorning18:58
anteayamorning jhesketh18:58
fungiit's that (weekly infra team meeting) time again! find us in #openstack-meeting for the next hour19:00
*** ociuhandu has joined #openstack-infra19:00
*** daemontool has quit IRC19:04
*** bin_ has quit IRC19:04
*** ddieterly has joined #openstack-infra19:04
*** hurgleburgler has joined #openstack-infra19:05
clarkbzaro: I think you meant to use this channel for bindep?19:06
clarkbzaro: look at the other-requirements files for other projects like swift and gear I think19:07
*** sdake_ has quit IRC19:08
Rockygclarkb, quickie.... I think Howard is at OpenStack China (Beijing) so may be a deelay in answering19:09
*** rdx_matt has quit IRC19:09
clarkbRockyg: thats fine, its not a huge rush. Just want to check in and make sure that there aren't problems pushing upstream etc19:09
clarkbRockyg: I have actually found 10 or so projects liek that and will try to ping all of their owners to see if we can do anything else to help19:10
Rockygkk  Thanks.19:10
clarkbalsoa few that have jobs setup in zuul that have never been able to pass19:10
*** nadya has joined #openstack-infra19:10
clarkbno tox.ini, etc19:10
openstackgerritEmilien Macchi proposed openstack-infra/project-config: zuul/tripleo: run gate-tripleo-ci-centos-7-ovb-nonha in tripleo-ci  https://review.openstack.org/34114419:11
*** nadya has quit IRC19:14
*** tidwellr has quit IRC19:15
*** PollyZ has quit IRC19:17
*** gyee has quit IRC19:18
rodshello, any chance I can get another review from a core for this pr? https://review.openstack.org/#/c/339065/319:20
dhellmannclarkb : so if I'm reading the scrollback right the releasenotes build issue is with the way the git clone was done?19:20
clarkbdhellmann: yes I think so. I haven't gone through and rerun it against all the projects that failed to confirm but I am fairly confident this was it19:21
clarkbdhellmann: I think we can ignore that issue for now19:21
*** hurgleburgler has quit IRC19:22
*** flepied has joined #openstack-infra19:22
dhellmannclarkb : cool19:23
clarkbdhellmann: still waiting on the last 10 or so projects to go through my test loop (nova and neutron included so may be a while) then I will rerun my script just on releasenotes with that configured properly19:23
dhellmannsounds good19:23
openstackgerritMerged openstack-infra/shade: Use keystoneauth.betamax for shade mocks  https://review.openstack.org/29864719:24
clarkbdhellmann: the only real issues I have seen so far are an ssl3 related one in blazar (sslv3 was removed from python because its insecure), some potential sqlite3 things and nodepool not liking mysql (but everything else seems fine with it so sqlalchemy/oslo.db are fine I think19:24
openstackgerritMerged openstack-infra/shade: Add support for changing metadata of compute instances  https://review.openstack.org/31939519:24
clarkboh and pbr fails wsgi tests19:25
zigopabelanger: Awesome, thanks a lot. Yes, we should have something like "jessie-mitaka" or "jessie/mitaka", I'd prefer the former, so that we have all in a flat repo.19:25
*** ajmiller has quit IRC19:25
zigopabelanger: Also, it needs to come from the built packages, I'm not sure where you got that version 52 from. Is this just from official jessie-backports?19:25
pabelangerzigo: okay, I can get a change up for that. It is trivial now19:26
*** ajmiller has joined #openstack-infra19:26
zigopabelanger: I'd prefer if we worked on Newton directly though, Mitaka is kind of the past ... :P19:26
dhellmannclarkb : weird about the wsgi tests.19:26
*** sdake_ has joined #openstack-infra19:26
*** mikelk has joined #openstack-infra19:26
zigopabelanger: How does your job work, is it a "post" after the merge of deb-openstack-pkg-tools ?19:27
pabelangerzigo: imported from http://tarballs.openstack.org/openstack-pkg-tools/uploads/d2b2b048228e08f77ee0403e5a5f637cc5c6148d/19:27
pabelangerzigo: yes19:27
pabelangerzigo: https://review.openstack.org/#/c/341133/19:27
zigopabelanger: How come it doesn't contain the commit number?19:27
pabelangerzigo: what do you mean?19:28
zigopabelanger: Normally, the version should integrate the number of commits before the last tag.19:28
*** ihrachys has quit IRC19:28
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Revert "Switch away from the default IP range used by tripleo"  https://review.openstack.org/34114919:29
zigopabelanger: That would be something like this: http://tarballs.openstack.org/packaging-deb/openstack-pkg-tools/uploads/d1ab24a12d2126acccc5c6a56f210ea2b2ae97ea/19:29
pabelangerzigo: that's the version numbering you have done. The stuff I have worked on simply downloaded things from tarball.o.o and imported it into reprepro19:29
pabelangerzigo: okay, so I was testing using an old URL19:29
zigo:)19:29
*** sambetts is now known as sambetts|afk19:29
pabelangermoving forward it should be like the URL you listed above19:29
zigopabelanger: We should then agree on what URL scheme to use...19:29
zigopabelanger: Also, I'll need to know what URL to use for the repo. I guess it wont always be rackspace, right?19:30
openstackgerritMerged openstack-infra/tripleo-ci: Revert "Switch away from the default IP range used by tripleo"  https://review.openstack.org/34114919:30
*** julim has quit IRC19:30
pabelangerzigo: is the URL I am downloading from, you should upload to the same: https://review.openstack.org/#/c/341132/1/jenkins/jobs/packaging-mirror.yaml19:30
pabelangerzigo: we can expose that in our nodepool configure_mirror.sh script19:30
pabelangerzigo: for example http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/scripts/configure_mirror.sh19:31
zigoYup, URL seems correct.19:31
*** david-lyle_ has quit IRC19:31
pabelangerzigo: I suggest fixing your jobs on deb-openstack-pkg-tools, they are currently failing19:32
zigopabelanger: Which one?19:32
pabelangerand we can finalize the reprepro layout for the codename settings19:32
pabelangerzigo: http://logs.openstack.org/20/340520/4/check/pkgdeb-build-openstack-pkg-tools/a5189d1/19:32
pabelangerany new patch fails19:32
*** esker has joined #openstack-infra19:33
zigoI thought I fixed that ...19:33
openstackgerritTristan Cacqueray proposed openstack-infra/zuul: Call parameter_function before swift parameter  https://review.openstack.org/34115419:33
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe  https://review.openstack.org/34033919:34
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477719:34
*** ajmiller_ has joined #openstack-infra19:34
zigopabelanger: The problem seems to be the Unix username. Does "jenkins" still exist as a username?19:35
*** david-lyle_ has joined #openstack-infra19:35
pabelangeryes19:35
pabelangerbut it will be changing in the future19:35
pabelangerto zuul19:35
*** ajmiller has quit IRC19:38
*** PollyZ has joined #openstack-infra19:38
zigopabelanger: Ah also, for a reason, patch prosal don't go to the #openstack-pkg channel as they should. I'm not sure what's wrong in what we attempted doing with fungi for that...19:38
pabelangerzigo: project-config/gerritbot is what you need to add your project too19:39
zigoI believe I did that already, but that's probably wrong.19:40
* zigo is checking19:40
zigoYup, it's there...19:41
zigoMaybe the bots need a restart?19:41
pabelangerzigo: missing mitaka branch19:41
zigoOh ...19:41
*** hurgleburgler has joined #openstack-infra19:42
*** ihrachys has joined #openstack-infra19:42
*** PollyZ has quit IRC19:43
openstackgerritThomas Goirand proposed openstack-infra/project-config: Add debian/{mitaka,newton} to deb-ospkgtools IRC robot  https://review.openstack.org/34115719:44
tristanCjeblair: so it seems like the parameter_functions is called after swift hmac computation, thus to set a custom (swift) LOG_PATH in function.py, we need https://review.openstack.org/#/c/34115419:44
*** sarob has joined #openstack-infra19:44
*** adrian_otto has joined #openstack-infra19:44
zaroclarkb: thanks for pointer to other-requirements examples but what i'm suggesting is a doc update because what's in the bindep docs doesn't seem like it's enough to direct users to create that file.19:44
*** _sarob has joined #openstack-infra19:45
clarkbzaro: well its all context dependent on what you need bindep to do19:45
clarkbzaro: all bindep is is a list of packages with distro and version markers that when parsed can emit a lsit for your current host19:45
*** ociuhandu has quit IRC19:46
*** ociuhandu has joined #openstack-infra19:46
dmsimardjeblair, tristanC: fyi context: being able to use zuul_ref as the log destination for the artifacts for what we talked about earlier for parent vs child jobs19:46
zaroclarkb: at least some references to some of how we use it may help19:46
*** annegentle has joined #openstack-infra19:47
zaroparticularly in the infra manual19:47
clarkbya we could add that there19:48
zigopabelanger: This will fix the issue: https://review.openstack.org/#/c/34115519:48
zigoAnd should produce another version of openstack-pkg-tools ! :P19:48
jeblairdmsimard, tristanC: we should ask jhesketh to review that19:49
dmsimardjeblair: ack, I'll add a comment in the review for context.19:49
*** sarob has quit IRC19:49
clarkbmordred: notmorgan: related to your admin vs not admin slowness on my local test rig for xenial postgres tests are much faster than mysql when running tox -epy27 with keystone19:50
clarkb18seconds vs 4-5seconds19:50
*** daemontool has joined #openstack-infra19:50
pabelangerAJaeger: ianw: rcarrillocruz: mind helping land 341133 and 34113219:51
mordredclarkb: that's weird and sad19:51
* jhesketh will add it to the queue 19:51
openstackgerritamrith proposed openstack-infra/irc-meetings: Proposing OpenStack SWG Meeting  https://review.openstack.org/33813419:51
clarkbmordred: its possible that mysql is just less happy on my VM than postgres but likely warrants more investigation19:51
notmorganclarkb: good to know.19:52
*** PollyZ has joined #openstack-infra19:52
notmorganclarkb: mysql also falls out the gate with horrible defaults19:52
notmorganclarkb: if devstack is doing zero tuning on mysql, you basically have a useless config for nothing more than very limited testing19:52
clarkbalso I am running serially on one cpu so shouldn'19:52
clarkbt be related to tests fighting each other19:52
*** maishsk has joined #openstack-infra19:52
notmorganclarkb: if pgsql on the same box is happier, i'd blame mysql's horrible defaults19:53
*** fawadkhaliq has quit IRC19:53
notmorgans/box/setup19:53
clarkbnotmorgan: even 5x the performance cost though?19:53
notmorganyou can probably increase buffers and caching and see massive improvements.19:53
clarkbits not like we are dealing with massive datasets19:53
clarkbits make a user19:53
notmorganyou have no idea how bad mysql's defaults are19:53
clarkbI have a hard time believing they are that bad19:53
notmorgani wont use them on my dev boxes19:53
rcarrillocruzmordred !19:54
clarkbespecailly when you consider nodepool uses the same setup just fine19:54
rcarrillocruzwe need a release of shade19:54
rcarrillocruz:-)19:54
clarkbthis to me screams keystone issue19:54
clarkbbut what do I know19:54
notmorgannodepool doesn't grind in the db as much19:54
* stevemar perks 19:54
notmorganhaving worked with the schemas19:54
clarkbnotmorgan: neither does keystone in "make a user"19:54
clarkbnotmorgan: this isn't tempset19:54
notmorganclarkb: it's not "make a user" it's token validation among other things19:54
clarkbits the unittest for make a user with mysql abckend19:54
rcarrillocruzmordred: https://review.openstack.org/#/c/315713/ merged, solved the gate issues19:54
notmorganwhich is hit a lot19:54
*** cody-somerville has quit IRC19:55
rcarrillocruzbut we need a release, i have plays failing with fip timeouts :/19:55
*** mikelk has quit IRC19:55
clarkbnotmorgan: I think you misunderstand me19:55
clarkbnotmorgan: these are very isolated code paths, its nto a running cloud19:55
mordredrcarrillocruz: yah - I saw - I'm poking jlk right now to see if he can verify that it doesn't break him19:55
rcarrillocruz++19:55
notmorgancreate a user hits a ton of db grinding to validate things.19:55
clarkband ldap is on the order of miliseconds19:55
*** karthikp_ has quit IRC19:55
clarkbnot sure if thats mocked out though19:55
notmorganldap is in our testing.19:56
*** annegentle has quit IRC19:56
clarkbnotmorgan: but enough to result in 5x slower?19:56
notmorganclarkb: i could buy 2-3x slowness19:56
clarkbI wouldn't be surprised if mysql defaults makes it slower, but its 5x slower19:56
notmorgani've seen it before.19:56
*** ddieterly is now known as ddieterly[away]19:56
notmorganit doesn't take a lot to tip over a badly (or completly untuned) mysql.19:57
*** kzaitsev_mb has joined #openstack-infra19:57
*** PollyZ has quit IRC19:57
clarkbI just have a hard time believing a db with no data in it would notice19:57
clarkbits not like its going to disk19:57
clarkbor needing to rely on buffer tuning19:58
clarkbits all in memory because its tiny19:58
*** ihrachys has quit IRC19:58
notmorgani can only speak to my experiences.19:59
*** Apoorva has quit IRC19:59
clarkbyes and I to mine, I am just asking that keystone treat this as a potential issue rather than blame mysql without checking19:59
notmorgani am not a mysql dev/former mysql dev (I defer to mordred, SpamapS, etc)19:59
*** julim has joined #openstack-infra19:59
*** hasharAway is now known as hashar20:00
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Make ovb testenv more user friendly  https://review.openstack.org/33763720:00
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Update to use quintupleo  https://review.openstack.org/33630920:00
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Deploy full net-iso environment  https://review.openstack.org/34116120:00
notmorganactually, let me make this easier, i really shouldn't speak on keystone's behalf here.20:00
clarkbthe gate info is likely not clean enough to use in comparison because we run with 8vcpus all fighting each other20:00
clarkbbut it is easy to reproduce locally with tox -epy27 --concurrency 1 iirc20:00
clarkber -- --concurrency20:00
* notmorgan has to stop jumping into the keystone discussions20:00
*** Apoorva has joined #openstack-infra20:00
*** zeih has quit IRC20:01
openstackgerritDoug Hellmann proposed openstack-infra/project-config: add job to apply tags when based on changes in openstack/releases  https://review.openstack.org/34105820:01
* notmorgan can't keep all of keystone and the new zuul/infra knowledge swapped in at the same time.20:01
*** sdake_ has quit IRC20:01
pabelangerianw: are we still blocking fedora24 builds with diskimage-builder?  Last time I tried I it error'd out on locales20:01
notmorganstevemar: ^ you should look at this20:02
notmorgan(the thing clarkb is talking about)20:02
clarkbEmilienM: re that logo proposal, regardless of any other reules my undersatnding is any dilution of the openstack logo wouldn't be allowed20:02
ianwpabelanger: nope ... should be ready!  https://review.openstack.org/#/c/340671/120:02
pabelangerianw: ah, nice. I missed that20:02
EmilienMclarkb: o20:03
EmilienMok20:03
ianwpabelanger: yeah, if we get some nodes i can start transition off f2320:03
ianwpabelanger: also looking at the centos locales thing ... as i think you determined yesterday, guess what, systemd is involved :)20:03
clarkbstevemar: basically run the opportunistic mysql and postgres tests with a single threaded test runner and compare the timing between them20:04
clarkbstevemar: I am seeing up to 5x slower mysql tests than postgresql20:04
stevemarclarkb: i'm still not super clear on what the issue is, partly because i keep checking in half way through20:04
*** jamesmcarthur has quit IRC20:04
pabelangerianw: ya, I see some talks about it the other day20:04
*** pradk_ has joined #openstack-infra20:04
clarkbstevemar: thought I would point it out because I know mordred was looking into another performance related issue with keystnoe admin vs non admin ops20:05
*** mriedem1 has joined #openstack-infra20:05
notmorganclarkb: fwiw, i was unable to duplicate the admin vs nonadmin thing eysterday20:05
stevemarclarkb: can you file a bug for it? otherwise i'll lose track of it20:05
*** jcoufal has quit IRC20:05
clarkbstevemar: sure20:05
*** PollyZ has joined #openstack-infra20:05
notmorganclarkb: i spent a good deal of time trying to, all examples i could come up with ended up being slow, but about the same slow20:05
pabelangerianw: since you are around: https://review.openstack.org/#/c/341132/ and https://review.openstack.org/#/c/341133 mind a +3?20:05
pabelangerianw: I've tested them already in experimental20:06
clarkbnotmorgan: interesting20:06
notmorganclarkb: and i was using the same(ish) setup Shrews had.20:06
*** jamesmcarthur has joined #openstack-infra20:06
*** rdx_matt has joined #openstack-infra20:06
notmorganclarkb: it bothers me that it "magically" fixed or is more subtle.20:06
notmorganclarkb: i just need more concrete "here is how to repo" to do much more.20:06
zaroclarkb: so i've found the swift other-requirements.txt but still not sure whether that list overrides or inherits the base set of packages.20:07
zarohttps://git.openstack.org/cgit/openstack/swift/tree/other-requirements.txt20:07
notmorganor a snapshot/working VM env that i can spin up and poke at with the issue20:07
zaroclarkb: i thought it inherits so you only have to add whatever else is missing?20:07
notmorgansince i clearly couldn't make an environment that duplicated the issue myself (which just means i didn't have all the data needed to do so, bnot that it isn't an issue)20:08
*** mriedem has quit IRC20:08
*** tonytan4ever has quit IRC20:08
*** cody-somerville has joined #openstack-infra20:08
zaroclarkb: i'm still not sure how to currate my own list from that example.20:09
*** markusry has quit IRC20:09
clarkbstevemar: https://bugs.launchpad.net/keystone/+bug/160240720:09
openstackLaunchpad bug 1602407 in OpenStack Identity (keystone) "MySQL tests significantly slower than PostgreSQL tests" [Undecided,New]20:09
zigopabelanger: Did your job pick-up http://tarballs.openstack.org/packaging-deb/openstack-pkg-tools/uploads/385aacd524eac4c86d93dd58ed1e629637945ff7/ ?20:09
*** csomerville has joined #openstack-infra20:09
clarkbzaro: it does not inherit, which is intentional we want minimal lists to be clear20:09
stevemarclarkb: thank you sir20:10
*** mriedem has joined #openstack-infra20:10
clarkbzaro: you will need python dev deps. Depends on what python-jenkins needs, will liekly require trial and error20:10
clarkbzaro: I would start with what zuul or nodepool use (drop the mysql/postgre stuff) and add in krb5-dev20:10
*** PollyZ has quit IRC20:10
*** karthikp_ has joined #openstack-infra20:12
zaroclarkb: and keep running 'tox -e bindep test' until it passes?20:12
*** mriedem1 has quit IRC20:12
clarkbno tox -ebindep won't tell you if you have all the packages you need20:12
*** cody-somerville has quit IRC20:12
clarkbit will only tell you what is missing from the other-requirements.txt list on the current machine iirc20:13
clarkbzaro: you have to install the deps from bindep, then run tox -epy2720:13
clarkbif that works then your list is liekly good20:13
pabelangerzigo: no, we are still merging to patch20:14
zarook. will give that a go.  again, not sure how other people would figure this out.  i've not found it in the documentation.20:14
pabelangerzigo: changes are landing now20:14
fungizaro: or propose a change you think is most of the way there and check the job results. other-requirements.txt file addition/removal and changes to that file should all be enturely self-testing in our ci20:14
fungier, entirely20:15
*** adrian_otto1 has joined #openstack-infra20:15
openstackgerritKirill Zaitsev proposed openstack-infra/project-config: Add py27-mitaka tox jobs to murano projects  https://review.openstack.org/34095420:15
asselin__rcarrillocruz, what git format is expected for ansible galaxy? http://paste.openstack.org/show/531014/20:15
zaroclarkb, fungi : thanks, will try to update the docs with this process when i've figured it all out.20:16
AJaegerzaro: Quick comment: We have documentation at http://docs.openstack.org/infra/manual/drivers.html#package-requirements and http://docs.openstack.org/infra/bindep/ - if those are confusing, please help updating.20:16
AJaegerzaro, thanks!20:16
fungizaro: the way this usually happens from scratch is that you go to run a project's unit tests, it breaks complaining you're missing a c header package to make it possible to build some particular python dependency, so you install that, then you find that it breaks on yet another, and so on. take the list of packages you ended up having to install and put them in an other-requirements.txt file and push20:16
fungiup a review for that20:16
clarkbasselin__: are you behind a proxy?20:16
ianwpliea2: so it has to be a top-of-tree horizon running?  i'm wondering if something like RDO can take the pressure off having to maintain the "openstack" portion of the whole thing, by using something more stable than devstack20:16
clarkbasselin__: er ya I see it there in the log now20:16
asselin__clarkb, I am20:16
asselin__i had to change away from the git+git protocol20:17
fungiianw: it needs to be master branch tip, right. and then import incomplete translations from zanata on top of that20:17
rcarrillocruzasselin__: http://git.openstack.org/cgit/openstack-infra/system-config/tree/roles.yaml20:17
clarkbasselin__: our non cgit urls are not web hosted20:17
clarkbasselin__: they only do git protocols20:17
clarkbasselin__: so wget is doign what I expect20:17
clarkbasselin__: try git clone that url20:17
AJaegerianw: it needs a really recent horizon so that the translations that we have in zanata match20:17
asselin__yeah, git clone works fine....but not via ansible galaxy20:18
fungiasselin__: the trick is that we have different clone urls and browsing urls. sites/services that assume those will always be identical are broken20:18
asselin__http://paste.openstack.org/show/531015/20:18
*** adrian_otto has quit IRC20:19
AJaegerzaro: if you have a change and want feedback, feel free to add me to it or ping me - or ask question via email. I'll drop off again now...20:19
*** PollyZ has joined #openstack-infra20:19
clarkbasselin__: you can try cloning from the cgit url20:19
tristanCjhesketh: nevermind about 341154, I just realise there is already 262112 and 229582...20:19
clarkbasselin__: maybe that will make galaxy happy20:19
fungiyou actually have to do a lot of very hacky browser detection to rewrite browsing requests for your clone urls to something a browser can grok20:19
*** mrmartin has quit IRC20:19
openstackgerritMerged openstack-infra/project-config: Prefix packaging-deb for reprepro-import URL  https://review.openstack.org/34113220:19
fungiasselin__: clarkb: note that cloning from cgit is extremely terrible from both a performance and reliability standpoint20:20
asselin__sorry, I know i wget it, but that's not really the issue I'm trying to solve....I did that merely to see if there's something that ansible galaxy is also doing20:20
clarkbfungi: yup20:20
asselin__by goal is to use a non git url in roles.yaml and ansible galaxy and be happy with20:21
asselin__non git protocol* url20:21
clarkbasselin__: yes, try the cgit https url20:21
clarkbasselin__: that should at least tell you if galaxy expects a proper web browser for some reason20:21
zaroAJaeger: sure will thanks.20:22
fungiasselin__: what's in your roles.yaml?20:22
asselin__fungi, http://paste.openstack.org/show/531017/20:23
openstackgerritMerged openstack-infra/project-config: Add reprepro import / release into post pipeline  https://review.openstack.org/34113320:24
zarofungi: it seems like it's hard to tell what packages are needed and which are appropriate.  like i always install 'build-essential' but is that appropriate to put in others-requirement since we want min set?20:24
pabelangerzigo: I see an issue with your upload URL, it should be http://tarballs.openstack.org/packaging-deb/deb-openstack-pkg-tools/ not http://tarballs.openstack.org/packaging-deb/openstack-pkg-tools/ because we are using ZUUL_PROJECT20:24
*** tdasilva has quit IRC20:24
asselin__clarkb, with cgit url http://paste.openstack.org/show/531018/20:24
*** PollyZ has quit IRC20:24
asselin__not sure if that's right cgit url or not20:24
*** ddieterly[away] is now known as ddieterly20:24
fungizaro: yes, that's the crux of the problem bindep is there to solve. hopefully projects adding an other-requirements.txt file reduce the number of devs who have to figure that out to a very small number20:25
fungizaro: but someone still needs to figure it out at least once20:25
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe  https://review.openstack.org/34033920:25
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477720:25
ianwpabelanger: i'm not too fussed, we've largely sorted out upload issues but when diagnosing initial devstack runs, it's nice to remove one more variable of bouncing providers20:25
zigopabelanger: will fix20:26
pabelangerianw: Right, I think clarkb mention last time, add all providers out of the box, since things are pretty stable now.  But could be wrong20:27
*** adrian_otto1 has quit IRC20:27
clarkbasselin__: thats the correct url. the error gives you a clue though apparently it wants a tarball20:27
clarkbya I would just add to all providers and cut down on restarting services20:27
*** Sukhdev has quit IRC20:27
*** adrian_otto has joined #openstack-infra20:28
*** lucas|afk has quit IRC20:28
*** ramishra has quit IRC20:29
fungiasselin__: i suppose we could add branch tarball jobs for those repos and then you could specify https://tarballs.openstack.org/ansible-role-puppet/ansible-role-puppet-master.tar.gz instead20:30
asselin__i'm going to see if I can use github first as a workaround20:30
*** PollyZ has joined #openstack-infra20:31
*** ramishra has joined #openstack-infra20:31
openstackgerritKhai Do proposed openstack-infra/system-config: Install the Gerrit its-storyboard plugin  https://review.openstack.org/34060520:31
clarkbor maybe there us a way to tell galaxy the url is a repo20:31
clarkbrather than a tarball20:31
fungiclarkb: oh, i think mordred might have submitted a pull request for this actually20:31
fungior i might be confusing it with go get20:32
*** deadnull has quit IRC20:33
*** kgiusti has left #openstack-infra20:33
rcarrillocruzanteaya: nice, didn't know the beaver was canada's national animal :D20:34
*** lucasagomes has joined #openstack-infra20:35
fungiclarkb: asselin__: yeah, it looks like there are some additional parameters you can specify20:35
fungithings like "path"20:35
mgagneit isn't the moose :D20:35
asselin__btw, this url work: - src: https://github.com/openstack-infra/ansible-role-puppet20:35
*** csomerville has quit IRC20:35
fungialso it looks like convention if you want to have it use git is to specify git+https:// otherwise it thinks you're referring to a file20:35
fungigithub may do fancy rewrites on the backend to make that just work20:36
asselin__i found this option too:  scm: git20:37
jeblairjhesketh, mtreinish, fungi: i don't understand where prometheus is coming from or why it's in 32911520:37
openstackgerritRoland Hochmuth proposed openstack-infra/project-config: Add openstack/monasca-grafana-datasource project  https://review.openstack.org/34117620:38
jeblairjhesketh, mtreinish, fungi: i think the mqtt thing is a great idea.  i don't see that it has anything to do with prometheus, and i'm concerned about +1ing the spec without understanding what is intended there.20:38
fungijeblair: jhesketh seemed to _really_ want someone to mention that a monitoring system could maybe make use of this in the future, enough to -1 the spec20:38
fungii don't personally see that happening, but *shrug*20:39
openstackgerritC.J. Collier proposed openstack-infra/gerritbot: Improve gerritbot error handling  https://review.openstack.org/28705620:39
asselin__clarkb, fungi rcarrillocruz fyi I got it working by adding scm: git: http://paste.openstack.org/show/531019/20:39
rcarrillocruznice!20:39
pabelangerzigo: okay, once you fix the URL, it should publish the package20:39
jeblairfungi, jhesketh: that feels like a forced scope expansion to me.  this is an open ended spec that says "hey people can do whatever with this".  i don't see the point of mentioning prometheus unless the goal is to say "we agreed in a spec to implement prometheus" which, if we want to do, we need to have a conversation about20:39
*** zz_ja is now known as zz_zz_ja20:40
pabelangerzigo: tomorrow we'll address the codename issue20:40
mordredfungi: what did I do?20:40
fungimordred: something else i misremembered20:40
*** ddieterly is now known as ddieterly[away]20:40
mordredasselin__, clarkb: oh - galaxy and roles and infra?20:40
fungimordred: updating go tools to know how to handle our git server urls20:40
mordredyes. that has been merged20:40
jeblairfungi, jhesketh: i would be *far* more comfortable if someone wants to stand up prometheus, that there be a spec for that20:40
*** rdx_matt has quit IRC20:41
mordredasselin__: yeah -for now galaxy only indexes roles from github. I've chatted with the galaxy team about being able to register non-github git locations but it has not hit their todo list yet (understaffed)20:42
fungijeblair: i'm happy to take it back out. as i said in my review comment i don't want to plan for this to be relied on for production purposes until we know it's worth running in the long-term, which will take a while to figure out20:42
*** ccamacho has quit IRC20:42
*** csomerville has joined #openstack-infra20:42
mordredhowever, because we changed names to ansible-role-*foo* form, it's fairly easy to point galaxy at our github proxy orgs and have it index all of the ansible-role-* repos it finds  I've been meaning to write something up about that20:42
asselin__mordred, actually it works fine using the github url. For the openstack url I needed to add the scm: git option.20:43
fungijeblair: i also have a feeling some of jhesketh's concern might have stemmed from overzealous scope wording in the original patchset, which i softened up quite a bit when i did my pass. so maybe it's addressed even without mentioning monitoring systems and failure prediction20:44
*** shardy_afk is now known as shardy20:44
fungii'll pull that sentence back out and see where we end up20:44
jeblairfungi: possibly so -- maybe it's "keeping track of what each service is doing" that's the problem20:44
fungijeblair: ooh, good eye. i'll reword that bit real quickly too20:45
jeblairthat's a pretty ambiguous phrase -- while mqtt certainly lets you see what things are doing (it's an event stream!), it may not actually help "keep track" of things (it's ephemeral!)20:45
*** david-lyle_ has quit IRC20:45
*** mdrabe_ has joined #openstack-infra20:46
*** mdrabe has quit IRC20:46
*** karthikp_ has quit IRC20:46
asselin__fungi: this also works: - src: git+https://git.openstack.org/openstack-infra/ansible-role-puppet20:46
*** chem has quit IRC20:46
fungijeblair: yep, heartily agreed20:46
mordredasselin__: ah - nod. I misunderstood what you were trying to do20:46
*** karthikp_ has joined #openstack-infra20:47
mordredasselin__: I would like for you to just be able to reference openstack-infra.puppet20:47
*** priteau has joined #openstack-infra20:47
mordredbut that's a little bit more work20:47
*** akshai has quit IRC20:48
asselin__mordred, basically working around git protocol blocks :)20:48
*** esker has quit IRC20:48
*** gyee has joined #openstack-infra20:48
*** tdasilva has joined #openstack-infra20:48
mordred:)20:48
*** david-lyle_ has joined #openstack-infra20:49
asselin__but I like the scm option. It's clear what it's trying to do.20:49
*** markvoelker has quit IRC20:49
sridhar_raminfra-team: I'm trying understand diff reason why a patchset wouldn't merge after a +A. Looking at https://review.openstack.org/#/c/332097/ I'm wondering how I would go about finding the reason ? Does "Needs Verified" indicate this patchset needs a newer Jenkins run ?20:49
sridhar_ram*diff reasons20:50
mgagnesridhar_ram: make sure parent change is merged: https://review.openstack.org/#/c/331304/20:50
mgagnesridhar_ram: I think you asked about the same last week: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2016-07-08.log.html#t2016-07-08T16:27:4720:51
openstackgerritJeremy Stanley proposed openstack-infra/infra-specs: Firehose: A unified message bus for Infra services  https://review.openstack.org/32911520:51
sridhar_rammgagne: ouch, same reason again.. how did you find that out ?20:51
fungijeblair: jhesketh: ^20:51
mgagneit's the first thing I check because it's often/always the same reason =)20:51
*** _ari_ has quit IRC20:51
ianwpleia2 / AJaeger : if you moved the zanata pull into a normal job and did a "sleep ((20 * 60))" (assuming we figured out http access) would that be suitable, i.e. enough time to log-in and check your translations?20:51
sridhar_rammgagne: yes, i did   :(20:51
jeblairfungi: lovely!20:52
fungipabelanger: i've (minorly) updated 32911520:52
pleia2ianw: the main problem is that most translations don't end up in jobs at all, if the translations aren't 75% complete we don't sync them into git20:52
pleia2ianw: but we also just need a casual system where folks can log in whenever and check the status, not a time limit on availability20:53
sridhar_rammgagne: i think, now this will be itched in my mind 8) thanks a bunch20:53
mgagne=)20:53
ianwpliea2: i just mean a job you can run ad-hoc when you know you want to check things out20:53
pleia2ianw: well, it's not me :) I only speak English, it's the translations folks who mostly aren't developers and need something simple20:54
fungiianw: also they're not going to be thrilled when they have to wait 30 minutes to see the resulting site20:54
fungi(and that's on a good day when we're not resource-starved)20:55
ianwi just think that at any given time devstack is going to be unstable, i can't see how we can do bleeding edge but not bleed20:55
pleia2yeah, many of the translators are unpaid, they do this in free time here and there20:55
ianwbut we're quite good at spinning up a fresh vm and deploying onto that at any given time20:55
pleia2ianw: instead of a human triggering a job, if we could just do it daily automatically it could work20:56
*** gouthamr has quit IRC20:56
pabelangerfungi: ack20:56
*** piet has quit IRC20:56
fungipleia2: ianw: it's also entirely valid to admit defeat on this. demo'ing current un-merged translation state live over the internet in an automated fashion may simply not be something the inherent instability (due to the pace of openstack developent) lends itself to. it will be disappointing to quite a few people, but reality is what it is sometimes20:57
*** shashank_hegde has quit IRC20:57
*** ccamacho has joined #openstack-infra20:58
*** stewie925 has joined #openstack-infra20:58
fungicontinuous deployment of openstack from master is nothing to sneeze at20:58
wznoinsk_fungi, hi, apologies I missed the infra meeting20:58
*** wznoinsk_ is now known as wznoinsk20:58
mordredfungi: yah. that's what I was thinking earlier20:58
fungilots of companies have whole teams of devs and operators whose job it is to make that possible20:58
mordredfungi: itsounds like a description of a CD-from-master openstack20:59
fungiand even they can't always do it reliably20:59
mordredyup. paste files. rootwrap files. ... stuff changes20:59
pleia2glad it's not just me, this project has been frustrating and depressing20:59
ianwfungi / pleia2 : it just seems like https://git.openstack.org/cgit/openstack-infra/puppet-translation_checksite/tree/templates/zanata-sync.sh.erb could be done quite easily in a job that would be quite reliable.  i know you'd have to wait a bit for output, and we could only hold a node for a little while, but it might be enough?21:00
mordredup until recently I had a team of almost 8 working full-time on that - it's non-trivial21:00
*** rfolco has quit IRC21:00
pleia2I thought it would be made easier by being short-lived and respin every week without preserving data, but even that :(21:00
*** markvoelker has joined #openstack-infra21:00
fungiianw: hacky solution, we could set the job timeout to 24 hours for it. then we just need some sort of mechanism to update dns automatically or manage a redirect maybe21:01
*** shashank_hegde has joined #openstack-infra21:01
mordredpleia2: that was the original remit of trystack 4-5 years ago21:01
* fungi is mostly joking about the 24-hour job timeout21:01
*** zeih has joined #openstack-infra21:01
*** jamesmcarthur has quit IRC21:02
*** jamesmcarthur has joined #openstack-infra21:02
fungia mechanism to refresh the deployment on a new system and then only update the redirect site if that succeeds is probably a clean-ish solution21:02
*** claudiub has quit IRC21:02
jeblairmordred: i think it's worth noting that this system doesn't need to do much; it's an all-in-one, and doesn't need to support any real capacity or deal with real networks, etc...21:02
*** ddieterly[away] is now known as ddieterly21:03
jeblairmordred: so i take your point that deploying openstack is hard -- just that this problem is more constrained than those examples21:03
*** sdake has quit IRC21:03
*** akshai has joined #openstack-infra21:03
pleia2fungi: yeah21:03
fungiif we were at the point with our launch-node automation we've been dreaming about where we can launch new servers independently of ci jobs, this would be a relatively minor addition on top21:03
clarkbstevemar: keystone also has args already parsed errors building docs21:04
fungimanaging a web redirect instead of updating dns also makes it more tractable21:04
jeblairfungi: this is a nice problem for zuulv3, bet we could probably approximate what you just suggested in v221:04
fungisomething we can host in a trivial vhost on static.o.o for example21:04
*** david-lyle has joined #openstack-infra21:04
*** hurgleburgler has quit IRC21:04
jeblairfungi: (a zuul job to deploy with a child job to update the redirect if it succeeds)21:04
pleia2jeblair: that would be nice21:05
*** xenogear has quit IRC21:05
fungijeblair: the trick is, if the job succeeds, we also want to keep the worker around for some long but undefined period, and only reclaim it if the next job run succeeds21:05
stevemarclarkb: yay, file a bug for that one too? should be easier to fix than your other :)21:06
fungijeblair: so still dynamically launched/deleted nodes, but with different deletion conditions than nodepool currently handles21:06
jeblairfungi, pleia2: if whatever deployment system you choose has a way of resetting to zero at the start, then you can do it on static nodes (i could see doing a/b switching between static nodes being pretty easy)21:07
*** piet has joined #openstack-infra21:07
ianwi feel like this might be tending towards devstack running in dib ...21:07
fungiyep, a/b alternating would be an option as long as we continue deploying to b until b succeeds and don't alternate when there's a job failure21:07
*** hurgleburgler has joined #openstack-infra21:07
clarkbstevemar: https://bugs.launchpad.net/keystone/+bug/160242221:09
openstackLaunchpad bug 1602422 in OpenStack Identity (keystone) "Many tracebacks building keystone docs" [Undecided,New]21:09
*** jamesmcarthur has quit IRC21:09
pleia2eep, lunch is here21:09
*** trown is now known as trown|outtypewww21:09
fungii need to help with dinner myself21:09
*** jamesmcarthur has joined #openstack-infra21:09
*** shashank_hegde has quit IRC21:09
stevemarclarkb: building them now myself21:09
stevemaroh yeah, i see them now21:10
*** _sarob has quit IRC21:10
clarkbstevemar: ya I realized there was a whoel bunch in addition to the duplicate arg exception so didn't try to capture all of them and just linked the log instead21:11
clarkb(which will be deletedin 4months but meh)21:11
stevemarclarkb: i think we can fix it up in 4 months21:12
*** jamesmcarthur has quit IRC21:13
* ianw gets breakfast to complete the infra meal cycle21:13
*** jamesmcarthur has joined #openstack-infra21:13
wznoinskfungi we plan, given the approval, to have a joint talk (Intel/Mellanox) about - 3rdparty Openstack CI - testing NFV and SR-IOV21:13
wznoinskabstract - https://etherpad.openstack.org/p/3rdparty_Openstack_CI_-_testing_NFV_and_SR-IOV21:14
jeblairnow i want afternoon tea21:14
clarkbstevemar: also not trying to pick on keystone its just what was goign through my giant loop of run all the tests :)21:14
stevemarclarkb: oh np21:14
stevemari understand21:14
wznoinskfungi, I wanted to get os infra ppl to comment on it, give some hints on what the community is looking for at the moment so we could include it in the presentation21:14
stevemarya find one issue and then another 4 come up21:14
clarkbstevemar: I am filtering through the fails to figure out which are related to running on xenial and which are problems in the projects before we do the switch to testing on xenial21:15
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477721:15
stevemarclarkb: makes sense, i appreciate all the feedback21:15
*** thorst has quit IRC21:16
*** thorst has joined #openstack-infra21:17
openstackgerritJames E. Blair proposed openstack-infra/project-config: Add puppet-ipsilon  https://review.openstack.org/34119221:17
*** thorst_ has joined #openstack-infra21:18
jeblairfungi: https://review.openstack.org/341193 Add puppet-ipsilon to infra21:19
*** thorst__ has joined #openstack-infra21:20
clarkbmordred: when you are actually awake do yopu think you will have time to look at pbr wsgi tests failing on xenial?21:20
clarkblifeless: Nakato ^ that may interest you as well21:20
*** tonytan4ever has joined #openstack-infra21:20
*** rcernin has joined #openstack-infra21:21
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Configure a different port for httpd ipxe  https://review.openstack.org/34033921:21
openstackgerritJames Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci  https://review.openstack.org/32477721:21
mordredclarkb: maybe? I'm about to get on a plane - not sure what the day looks like for hacking21:21
*** maishsk_ has joined #openstack-infra21:21
*** thorst has quit IRC21:21
clarkbok21:22
*** esker has joined #openstack-infra21:22
mordredclarkb: is there a link anywhere? or just need to get a xenial vm and run them?21:22
*** zeih has quit IRC21:22
*** thorst_ has quit IRC21:23
clarkbmordred: ya just need xenial and run them21:23
clarkbmordred: I can paste the traceback I got locally21:23
mordrednah - that won't help debugging21:24
mordredI'll find some xenial when I get a chance21:24
*** thorst__ has quit IRC21:24
*** maishsk has quit IRC21:24
*** maishsk_ is now known as maishsk21:24
clarkbmordred: http://paste.openstack.org/show/531023/21:24
clarkbwell its there anyways21:24
mordredcool. thanks21:24
clarkbits in the subprocess stdout pip reading21:24
clarkbwe expect a string to be written and get empty string21:24
clarkbI haven't had time to go install and run that helper command outside the test suite to see if it does something funny21:25
clarkbnotmorgan: and I think it was you that had mentioned addressing mysql on xenial for nodepool?21:26
clarkbnotmorgan: is that code up yet?21:26
*** tonytan4ever has quit IRC21:26
*** esker has quit IRC21:27
*** PollyZ has quit IRC21:27
*** esker has joined #openstack-infra21:28
*** ldnunes has quit IRC21:31
*** jamesmcarthur has quit IRC21:31
*** csomerville has quit IRC21:31
*** jamesmcarthur has joined #openstack-infra21:31
*** csomerville has joined #openstack-infra21:31
*** david-lyle has quit IRC21:31
*** priteau has quit IRC21:32
*** PollyZ has joined #openstack-infra21:32
*** priteau has joined #openstack-infra21:33
*** asettle has quit IRC21:33
*** esker has quit IRC21:33
*** ramishra has quit IRC21:35
*** hashar has quit IRC21:36
*** dprince has quit IRC21:36
*** ramishra has joined #openstack-infra21:36
*** jamesmcarthur has quit IRC21:36
*** rdx_matt has joined #openstack-infra21:37
*** shardy has quit IRC21:38
*** jamesmcarthur has joined #openstack-infra21:39
*** jamesmcarthur has quit IRC21:39
*** EricGonczer_ has quit IRC21:42
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: ZooKeeper API  https://review.openstack.org/34065821:43
notmorganclarkb: it is21:44
edmondswmordred, the link in the Q release naming email I just got doesn't work, indicates the key is invalid... known issue?21:44
clarkbnotmorgan: cool I will have to dig it up and double check it makes xenial happy that review21:45
notmorganclarkb: https://review.openstack.org/#/c/338619/21:45
notmorganclarkb: considering i wrote and test it on xenial here, i *hope* it works ;)21:45
notmorganand makes things happy for you21:45
clarkbedmondsw: yes see the thraed on the mailing list21:45
edmondswah, I see it now... tx21:46
*** amitgandhinz has quit IRC21:47
clarkbTIL about https://git.openstack.org/cgit/openstack/kuryr-libnetwork/tree/tools/tox_install.sh21:47
*** adrian_otto has quit IRC21:50
*** abregman|mtg has quit IRC21:50
*** yaume_ has quit IRC21:50
clarkbjeblair: I think http://paste.openstack.org/show/531030/ is new git interacting with GitPython in ways it doesn't expect21:50
clarkbjeblair: what is odd is that the other tox targets for that repo which use the tox install helper script don't hit the same issue21:51
*** yaume has joined #openstack-infra21:51
clarkbI wonder if itis a race of some sort21:51
openstackgerritKhai Do proposed openstack/python-jenkins: Setup required packages with bindep  https://review.openstack.org/34114321:53
zaroclarkb: ^21:53
*** clenimar_ has joined #openstack-infra21:54
jeblairclarkb: hrm, the py35 cloner tests on zuul are all failing for some other reason; i don't think they're even getting that far21:54
clarkbjeblair: oh right py35 should exercise that too (this ran on python27 but underlying git should be the same)21:55
*** burgerk has quit IRC21:55
*** tphummel has quit IRC21:55
jeblairclarkb: yeah, was just hoping for some test results to easy narrow in on that, but no such luck21:55
jeblairclarkb: i'll grab a xenial node and poke at it21:55
clarkbjeblair: thanks21:56
openstackgerritMarc Abramowitz proposed openstack-infra/jenkins-job-builder: Refactor delete_jobs  https://review.openstack.org/8864621:56
*** tphummel has joined #openstack-infra21:57
*** dtardivel has quit IRC21:57
*** Sukhdev has joined #openstack-infra21:57
*** markvoelker has quit IRC21:59
*** akshai has quit IRC22:00
*** markvoelker has joined #openstack-infra22:04
Shrewsgrr... testtools getUniqueInteger() does not appear to be giving me a unique integer per test22:05
clarkbShrews: its likely only unique per process22:05
Shrewsthat'd likely be it22:06
* Shrews shakes fist at concurrency demons22:06
*** esberglu has quit IRC22:06
*** clenimar_ has quit IRC22:06
clarkbShrews: if you only need one unique integer per process use the pids22:07
clarkbif you need mulitple unique integers per process use random uuid or something22:07
Shrewsgood idear22:07
clarkbnow to figure out why poppy can't import things on xenial22:07
clarkbI think its a circular import but I just don't see it22:08
*** mriedem has quit IRC22:08
*** priteau has quit IRC22:09
*** priteau has joined #openstack-infra22:10
clarkbor maybe its shadowing something22:10
*** netsin has quit IRC22:10
*** rdx_matt has quit IRC22:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: TEST: Run undercloud idempotency test on all jobs  https://review.openstack.org/33611222:11
openstackgerritBen Nemec proposed openstack-infra/tripleo-ci: Add undercloud idempotency test  https://review.openstack.org/27921822:11
*** priteau has quit IRC22:13
clarkbnova unittests pass on xenial22:13
openstackgerritAnand Desai proposed openstack-infra/glean: Disable live check on configured interfaces. Change-Id: I566b10393c09f73dec9f3ecd1f03f8a626591354 Signed-off-by: Anand Desai <anandd@us.ibm.com>  https://review.openstack.org/34058522:14
*** cbader has quit IRC22:14
jeblair| 2218349 | rax-dfw                | None | centos-7             | zuul   | zl03    | centos-7-rax-dfw-2218349                            | centos-7-rax-dfw-2218349                            | 20058041-ea30-4c65-aeab-2fdc77505165 | 23.253.94.57    | hold     | 07:10:51:13 | None22:15
jeblairinfra-root: ^ is that needed?  (it was held with no reason)22:15
clarkbI do not know what it is held for22:16
clarkbfine by me to remove22:16
jeblair(also, maybe we should make --reason non-optional)22:16
clarkbmordred: I think jd__'s pifpaf thing may possibly have the same problem as pbr's wsgi tests. ERROR: pifpaf: Program did not print: `Available at http://'22:16
clarkbjeblair: that seems like a good idea22:16
clarkbmordred: could be something up with reading pipes on xenial? I have no idea but about to check pifpafs code to see if it does the same thing as pbr's tests22:17
*** karthikp_ has quit IRC22:17
*** zeih has joined #openstack-infra22:19
clarkbmordred: https://github.com/jd/pifpaf/blob/e2f255c93bb58748e1a1bf3665d077d91759414e/pifpaf/drivers/__init__.py#L122-L131 looks pretty similar, if not line would match empty string22:19
jeblairclarkb: http://paste.openstack.org/show/531035/22:19
*** clenimar_ has joined #openstack-infra22:19
clarkbjeblair: ya I think it must be a race somehow22:20
clarkbjeblair: where git emits string GitPython isn't ready for. Its possible that this is an issue on trusty even we just never see it22:20
*** shashank_hegde has joined #openstack-infra22:21
*** david-lyle_ is now known as david-lyle22:22
jeblairclarkb: ah, there are some hits for "Could not parse git-remote prune result" in logstash....22:23
clarkbyay logstash22:23
*** xyang1 has quit IRC22:23
clarkbjeblair: any chance those hits happened on not trusty?22:24
jeblairclarkb: appears on trusty, precise, xenial, centos7, f2322:24
clarkbyay?!22:24
clarkbok at least it isn't a regression on xenial22:24
*** eeiden has joined #openstack-infra22:24
*** zeih has quit IRC22:25
*** thorst has joined #openstack-infra22:25
jeblairya, highly clustered by time -- all the events in logstash are 07-05 21:xx -- 07-06 01:xx22:25
jeblairi think 21 instances of it22:26
jeblairalmost all infra puppet jobs22:27
jeblairs/almost//22:27
*** tpsilva has quit IRC22:28
jheskethfungi, jeblair: sorry I missed the conversation earlier re firehose.. I haven't read the new patch yet, but I think my comment may have been mis-understood. It's not that I want the spec to cover monitoring, but I want the spec to limit itself in scope to not include monitoring (which I worded poorly by saying it should mention monitoring outside of the system and gave prometheus as an example)22:28
jheskethfungi, jeblair: the issue (from memory) was there were parts of the spec that implied the state of infra could be determined from the firehose. My comment was that I didn't think that was the point or the right tool.22:28
*** thorst_ has joined #openstack-infra22:29
*** Sukhdev has quit IRC22:29
*** larainema has quit IRC22:29
*** ddieterly has quit IRC22:29
*** thorst has quit IRC22:30
jeblairjhesketh: cool, i think we're on the same page then -- i think fungi and i figured that was probably the issue.  fungi pushed up a new patchset that hopefully addresses that (no mention of prometheus, but also removes the suggestion that this could be used to "keep track of state")22:30
*** jlk has joined #openstack-infra22:31
clarkbstevemar: still about?22:31
clarkbstevemar: have question about some oddness I am seeing with openstackclient tests22:31
clarkbstevemar: basically hitting AttributeError: 'module' object has no attribute 'select_auth_plugin' and sure enough if I look at https://git.openstack.org/cgit/openstack/osc-lib/tree/osc_lib/api/auth.py select_auth_plugin isn't there but the python27 tests pass in zuul22:32
clarkbstevemar: http://paste.openstack.org/show/531037/ is a full traceback22:32
*** thorst_ has quit IRC22:34
*** rcernin has quit IRC22:35
*** ramishra has quit IRC22:35
*** zul has quit IRC22:36
*** ramishra has joined #openstack-infra22:36
*** zul has joined #openstack-infra22:37
*** tonytan4ever has joined #openstack-infra22:37
*** somerville32 has joined #openstack-infra22:39
*** somerville32 has joined #openstack-infra22:39
*** gordc has quit IRC22:40
*** rossella_s has quit IRC22:40
*** ajmiller_ has quit IRC22:40
clarkbstevemar: actually I think I may see hat is going on, will patch if this is the issue22:40
*** rossella_s has joined #openstack-infra22:41
*** tonytan4ever has quit IRC22:42
openstackgerritMerged openstack-infra/zuul: Use the new launch client in zuul server  https://review.openstack.org/30413222:42
clarkboh looks like its already patched upstream22:42
clarkbalso I think this means anyone installing openstackclient right now without constraints is broken22:42
*** csomerville has quit IRC22:43
clarkbah only from source22:43
*** csomerville has joined #openstack-infra22:43
jheskethjeblair: cool, will look shortly :-)22:44
*** weshay has quit IRC22:45
*** Julien-zte has joined #openstack-infra22:46
jeblairjhesketh: also, i'm reviewing your v3 backlog :)22:47
*** somerville32 has quit IRC22:47
jheskethjeblair: yay, although I'm not even sure what I have in my v3 backlog :-p22:48
openstackgerritMarc Abramowitz proposed openstack-infra/jenkins-job-builder: Refactor delete_jobs  https://review.openstack.org/8864622:48
jheskethjeblair: I do have a bunch of v2 things that should possibly be considered though22:48
clarkboh hey trove still uses proboscis22:51
clarkbthis fail might be my first one that I can legitly tie back to xenial22:51
*** rbrndt has quit IRC22:51
clarkbmysql emits a warning when you passwd on the cli now22:51
*** dimtruck is now known as zz_dimtruck22:52
*** mriedem has joined #openstack-infra22:53
jeblairShrews: can you use the topic "nodepool-zk" for the zookeeper stuff?   http://specs.openstack.org/openstack-infra/infra-specs/specs/nodepool-zookeeper-workers.html#gerrit-topic22:54
*** pradk has quit IRC22:54
anteayarcarrillocruz: https://en.wikipedia.org/wiki/Canada#Symbols glad to share22:56
openstackgerritgreghaynes proposed openstack/diskimage-builder: WIP: Move hook generation in to python  https://review.openstack.org/27113922:56
dtroyerclarkb: I think https://review.openstack.org/#/c/339077/ will fix OSC22:57
clarkbdtroyer: ya I figured it out22:57
dtroyeralso https://review.openstack.org/#/c/329189/22:57
openstackgerritJames E. Blair proposed openstack-infra/zuul: Add dynamic reconfiguration  https://review.openstack.org/34059722:57
anteayarcarrillocruz: I see spain's national animal is the bull, makes sense22:57
*** csomerville has quit IRC23:00
fungijeblair: that held node is not one of mine, at least as far as i know. i've been fairly diligent about using --reason (as well as deleting them as soon as i know i'm done with them)23:00
*** markvoelker has quit IRC23:00
Shrewsjeblair: oh yeah. Thx23:00
clarkbflaper87: if you are around I ran into a fail in the zaqar unittest suite on xenial. TypeError: 'NoneType' object has no attribute '__getitem__' not sure if known issue or not23:00
jeblairShrews: also, i'm digging your wip.  :)23:01
Shrewsjeblair: it's more of an experiment to see how this design pans out. i think it might work23:02
jeblairShrews: it's very comprehensible23:03
Shrewsoh, you changed the topic already. danke23:03
*** shashank_hegde has quit IRC23:03
*** csomerville has joined #openstack-infra23:03
*** Sukhdev has joined #openstack-infra23:03
*** shashank_hegde has joined #openstack-infra23:03
jeblairi made a little gertty dashboard of "status:open (branch:feature/zuulv3 OR topic:nodepool-zk)"23:04
Shrewsparadise by the little gertty dashboard light?23:05
openstackgerritMerged openstack-infra/zuul: Register connections when testing configuration  https://review.openstack.org/30092423:05
Shrewssorry, i might be drinking now23:06
*** netsin has joined #openstack-infra23:06
*** markvoelker has joined #openstack-infra23:06
jeblairShrews: you should start work when i do, and i should start drinking when you do23:07
*** rdx_matt has joined #openstack-infra23:07
Shrewslol23:07
*** yaume has quit IRC23:07
*** PollyZ has quit IRC23:07
jeblairnotmorgan: can you look at 269731?  i'm assuming it's harmless, and if we merge it in master, you'll just update it as needed -- but... i dunno? :)23:08
openstackgerritMerged openstack-infra/zuul: Don't take into account commit message for skip-if filter  https://review.openstack.org/24738323:08
openstackgerritMerged openstack-infra/zuul: Add additional zuul.conf information  https://review.openstack.org/27186823:10
*** rdx_matt has quit IRC23:12
*** Sukhdev has quit IRC23:14
Nakatoclarkb: re PBR WSGI.  That's on my list to look at.23:14
clarkbNakato: yay, also not sure if you caught it but pifpaf (a tool jd__ wrote) does something similar and also fails23:15
clarkbNakato: so I wonder if this is a new exciting ubuntu xenial python2.7 behavior when reading pipes from subprocesses23:15
Nakatoclarkb: Oh, what patch is this that's failing?23:15
clarkbNakato: no patch, this is master23:16
Nakatoclarkb: The one I saw was related to the c extensions23:16
NakatoOh, interesting, hadn't seen that yet.23:16
*** karthikp_ has joined #openstack-infra23:16
clarkbNakato: did you see my paste link of the full fail log? its in scrollback somewhere I Can dig it up if not23:16
openstackgerritMerged openstack-infra/zuul: highlight the error condition when reporting a config issue  https://review.openstack.org/27226223:17
openstackgerritMerged openstack-infra/zuul: Add quick-start guide  https://review.openstack.org/27187223:17
*** adrian_otto has joined #openstack-infra23:19
*** shashank_hegde has quit IRC23:19
openstackgerritMerged openstack-infra/zuul: Add extra test for bad url patterns  https://review.openstack.org/26024323:20
*** zeih has joined #openstack-infra23:20
openstackgerritMerged openstack-infra/zuul: Clarify zuul-cloner message about missing branch  https://review.openstack.org/25919323:21
*** hemna is now known as hemnafk23:22
*** xarses has quit IRC23:23
openstackgerritMerged openstack-infra/zuul: Update documentation on statsd metrics generated.  https://review.openstack.org/23552123:24
*** zeih has quit IRC23:26
openstackgerritMerged openstack-infra/zuul: Zuul references cleaner  https://review.openstack.org/10927623:27
openstackgerritMerged openstack-infra/zuul: Use high precedence when manually submitting jobs  https://review.openstack.org/27640623:27
*** dingyichen has joined #openstack-infra23:28
openstackgerritMerged openstack-infra/zuul: Expose webapp listen_address and port  https://review.openstack.org/26105223:31
pabelanger\o/23:31
pabelangerdid that one a while ago23:31
Nakatoclarkb: I can't seem to find it in scrollback23:32
notmorganjeblair: looking23:32
notmorganjeblair: yeah that is harmless23:32
notmorganjeblair: should make pep8, etc happier for 2.523:33
fungiNakato: 21:24 utc23:33
clarkbNakato: http://paste.openstack.org/show/531023/23:33
NakatoThanks!23:33
jeblairnotmorgan: thx; aprvd23:34
notmorganjeblair: i also left a comment on it re: py3 stuff.23:34
*** ccamacho has quit IRC23:34
notmorganbut it's good as is (i wouldn't change it)23:34
jeblairjhesketh: do we want both https://review.openstack.org/229582 and https://review.openstack.org/262112 ?23:34
jeblairnotmorgan: agree with comment23:35
notmorganjeblair: once i get zuul v3 all py3 happy, are we going to do the same for nodepool, py3 only?23:35
notmorganor is nodepool going to want to sup[port py3/2 compat for a while/longtime/whatever23:35
notmorganno answer needed now23:35
notmorganjust something to think about23:35
jeblairnotmorgan: i don't think it needs to support py2 -- but i'd prioritize that lower since it's not a zuulv3 blocker23:35
*** baoli_ has quit IRC23:35
notmorganabsolutely23:36
notmorganand it can totally just live on py2 for... well ever23:36
notmorgan[aka until we get around to fixing it]23:36
jeblairnotmorgan: having said that -- greghaynes has a desire to use nodepool as an image building engine independent of zuul -- so we should see if py3-only is a hardship for that use case23:37
notmorgani doubt it will be, but yeah, we can play that by ear as we head closer to that23:37
*** Sukhdev has joined #openstack-infra23:38
jeblair(yeah, hopefully not since it's an anticipated future use case...)23:38
clarkbnotmorgan: jeblair one reason I could think of for that is rhel doesn't python3 iirc23:42
clarkbso if you want an engine builder on centos/rhel you need python2?23:42
clarkblooks like it is in epel and is a software collection though23:43
notmorganclarkb: epel should have it23:44
notmorganclarkb: yeah.23:44
*** hurgleburgler has quit IRC23:44
jheskethjeblair: yes, they are subtly different23:44
jheskethjeblair: the latter is used in the swift work but could be useful where we want to give swift hte ability to push outside of the LOG_PATH but want to keep the LOG_PATH param otherwise23:45
*** tqtran has quit IRC23:46
openstackgerritMarc Abramowitz proposed openstack-infra/jenkins-job-builder: Refactor delete_jobs  https://review.openstack.org/8864623:46
jeblairjhesketh: and safe to merge both?23:47
jheskethjeblair: should be... one is behind the other.. but it was a long time since I looked23:47
*** amitgandhinz has joined #openstack-infra23:48
*** Julien-zte has quit IRC23:48
*** zz_dimtruck is now known as dimtruck23:51
openstackgerritPatrick East proposed openstack-infra/devstack-gate: Add support for sub-node specific local.conf's  https://review.openstack.org/34122223:51
*** thorst has joined #openstack-infra23:51
*** amitgandhinz has quit IRC23:53
*** shashank_hegde has joined #openstack-infra23:53
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: WIP: ZooKeeper API  https://review.openstack.org/34065823:54
openstackgerritDavid Shrewsbury proposed openstack-infra/nodepool: Use random numbers for ZK test paths  https://review.openstack.org/34122323:54
*** EricGonczer_ has joined #openstack-infra23:56
*** dizquierdo has quit IRC23:58
*** sflanigan has joined #openstack-infra23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!