Thursday, 2014-07-10

clarkbmordred: previous to that there was a bug in a js lib that node bundles into its binary00:00
clarkbmordred: so what do you hve to do? recompile00:00
sdaguemarun: so I'm actually slightly confused as this point, because clearly openstack services can call rootwrap after this point00:00
mordredclarkb: right. but the distro model does not work for the people who are actually doing web dev and does not provide value00:00
marunsdague: :/00:00
*** msabramo has joined #openstack-infra00:00
marunsdague: here's the console log: http://logs.openstack.org/43/104043/5/check/check-neutron-dsvm-functional/2a39c8a/console.html00:00
mordredclarkb: so I'm not sure why we expect them to bow down at the alter of a system that was designed for and optimized for managing C dependencies00:01
mordredmind you - they're assholes00:01
nibalizermordred: so isn't port 8081 available on puppetdb from ci-puppetmaster?00:01
mordredgiant assholes00:01
nibalizerjust use that00:01
clarkbmordred: except its C :P00:01
mordredbut I don't thin kthe distros are much better00:01
clarkbmordred: this is exactly what the tooling is for00:01
marunsdague: if you search for 'Removing sudo privileges'00:01
mordredin their lack of flexibility and their inability to deal with solving problems00:01
sdaguemarun: yeh, sure00:01
marunsdague: I'm not sure how any services running as the devstack user are going to have permission to do anything.  What am I missing?00:02
sdaguebut we *know* that neutron can make rootwrap calls after this point, because it does it all the time00:02
sdagueotherwise all the tests fail00:02
marunsdague: does it though?  post_test_hook implies that everything that has to run, has run.  or no?00:02
sdaguehmmmm00:02
marunsdague: doesn't sudo use some kind of token that has a lifespan?00:03
marunsdague: i.e. what is removed by 'sudo -k'00:03
sdagueno, we actually do this before we call tempest00:03
mordredclarkb: the problem is - deploy-time compilation and inclusion makes technical sense in the web world00:03
mordredclarkb: but it violates long-held principles of "don't do that" in the distro world00:03
mordredrather than working to figure out how to solve the problem at hand00:03
mordredpeople are just told they're wrong00:04
mordredwhich isn't helpful00:04
clarkbmordred: well arguably compiling js into your C binary is wrong no matter how you look at it00:04
marunsdague: do you have an example of the config that calls tempest?00:04
clarkbmordred: but sure00:04
mordredare people going to have to recompile/redeploy on update of bundled deploytime things? maybe00:04
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/config: Create git repo and jenkins jobs for oslo.utils  https://review.openstack.org/10123000:04
mordredbut why not work on tools that help identify, recompile and help redeploy00:04
sdaguemarun: yeh, the rootwrap sudoers files should still be there00:05
mordredas a run-time and not a packaging time activity00:05
sdagueunless they didn't install for neutron00:05
marunsdague: and that should work for the stack user?00:05
sdagueyep00:05
clarkbmordred: I think partially because its a self inflicted wound00:05
clarkbmordred: there really is no reason to force yourself to do that00:05
mordredclarkb: anywho - we use pip to install things in ways that dstufft tells us not to, and we regularly tell the distros to get over it when they ask us to do things differently00:06
dims_clarkb, thanks for the review. fixed that job to vote00:06
clarkbif openssl has a massive vulnerability you update openssl00:06
sdaguemarun: os1:/etc/sudoers.d> sudo more nova-rootwrap00:06
sdaguesdague ALL=(root) NOPASSWD: /usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf *00:06
mordredclarkb: I don't see why us chosing to use javascript tools shouldn't go the same way00:06
clarkbdims_: what about the name? where are we on that?00:06
sdaguesdague is my stack user on this bo00:06
sdaguebox00:06
clarkbmordred: I am with you on that. I argued for using the js tools :)00:06
clarkbmordred: but I appreciate the issues it poses00:06
mordredclarkb: yah! oh, I apprecaite teh issues00:06
mordredI just think we should force the issue of working on fixing them00:07
mordredrather than pretending that they're python :)00:07
mordredof all of the things they are not, python is certainly at the top00:07
marunsdague: arg.00:07
mordredalso, they are not beef00:07
marunsdague: the error is: 'sudo: no tty present and no askpass program specified'00:07
*** arosen has left #openstack-infra00:07
sdaguemarun: did the !requiretty get added again?00:07
sdaguebecause something that *is* in 50_stack_sh00:08
sdagueDefaults:sdague secure_path=/sbin:/usr/sbin:/usr/bin:/bin:/usr/local/sbin:/usr/local/bin00:08
sdagueDefaults:sdague !requiretty00:08
mordredsdague: do you ever wish we had a bot that read all of the patches and looked for certain strings and then poked some of us in IRC when they show up?00:08
sdaguemaybe00:08
sdagueI more wish I could tell a bot my review comments for a patch00:08
sdagueso when someone pinged me for a review, I could have a conversation with them in IRC and it would record that as my review comments00:09
mordredsdague: +1000000000:09
marunsdague: How to see the contents of /etc/sudoers.d/neutron-rootwrap on a gate node?00:09
mordredsdague: one of the reasons my review numbers aren't as good is that I often chat with people about their patches in IRC00:09
sdaguemarun: ... with sudo?00:09
mordrednot that numbers are iportant00:09
mordredbut just saying - I tend to IRC people ...00:09
sdaguemarun: we could make d-g capture it00:10
clarkbinteractive discussion is useful00:10
clarkboh hey jeblair +2'd my change00:10
clarkbI will approve that shortly00:10
marunsdague: So I should submit a patch to config that outputs the contents of the file?00:11
sdaguemarun: you could capture that a couple of ways00:11
*** penguinRaider has joined #openstack-infra00:11
sdaguehaving devstack-gate upload them would be valid00:11
sdaguebut more importantly, do you believe that you've added the !requiretty anywhere in the sudo config?00:12
sdaguebecause I think that's the crux of the issue00:12
sdagueI actually think the rest of it is going to work now00:13
*** sarob has quit IRC00:13
sdagueso maybe in your pre_hook add Defaults:stack !requiretty to /etc/sudoers.d/00_no_tty00:13
*** sarob has joined #openstack-infra00:14
marunsdague: I haven't changed the sudo config, though.   The goal was to reuse the sudo config that neutron already uses in the gate, and that seems to work fine.00:14
sdagueso, it works fine for things that are daemons00:14
*** homeless has quit IRC00:15
marunsdague: yes00:15
sdaguebut you aren't a daemon00:15
marunsdague: nope.00:15
marunsdague: config in question: https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/neutron-functional.yaml00:15
marunsdague: the tox env sets the right environment variables in this test patch: https://review.openstack.org/#/c/104043/5/tox.ini00:16
sdagueecho "Defaults:stack !requiretty" | sudo tee /etc/sudoers.d/00_no_tty00:17
sdagueat line 3300:17
sdaguesorry before line 3200:17
marunok00:17
sdagueI think that's actually the issue00:17
dstufftmordred: you should use pip only in dstufft approved ways imo00:17
dstufft(just kidding)00:17
*** hogepodge has quit IRC00:18
sdagueclarkb: what do you think? am I off in the woods on this sudo idea?00:18
*** sarob has quit IRC00:18
marunsdague: so that will have to merge before my test patch can work.  is that ok?00:18
sdaguemarun: I think so00:18
mordreddstufft: I keep telling people that ...00:18
mordred :)00:18
clarkbsdague: I am not sure. jeblair is the sudo maestro00:18
sdagueit doesn't fundamentally violate what we are trying to do00:18
clarkbit could be that stuff needs ot move back into test_hook00:18
sdaguedstufft: you need a stamp00:18
sdaguedstuff approved!00:19
marunclarkb: where is test_hook called?00:19
clarkbmarun: in devstack_gate00:19
marunclarkb: i only see gate_hook and pre/post_test_hook00:20
clarkbsorry its called gate_hook00:20
openstackgerritA change was merged to openstack-infra/config: Use local ES balancers on logstash workers  https://review.openstack.org/10530300:20
marunwell, I00:20
*** msabramo has quit IRC00:21
*** Evgeny has quit IRC00:22
*** Evgeny_ has joined #openstack-infra00:22
*** wenlock has quit IRC00:23
openstackgerritMaru Newby proposed a change to openstack-infra/config: Fix neutron func job sudo config.  https://review.openstack.org/10592600:23
dims_clarkb, oslo.utils is good. we are sticking to oslo.* per doug00:23
clarkbdims_: why did we rename projects to remove the . then?00:23
*** gangil_ has quit IRC00:24
*** emagana has joined #openstack-infra00:24
marunclarkb, jeblair, sdague: if that makes sense?00:24
dims_clarkb, sphinx was special from what i understand00:24
marun^^00:24
marunbiab00:25
clarkbdims_: we don't do special...00:25
*** marun has quit IRC00:25
*** alexpilotti has joined #openstack-infra00:25
sdagueclarkb: if you override gate_hook, you don't get devstack00:26
clarkbsdague: riht you have to add devstack in00:26
clarkbbut I think that is what you need00:26
sdagueyeh00:26
sdaguebut I think we can get the exact behavior desired with this post_hook00:27
dims_clarkb, let me see if i can dig up notes from post-sphinx renaming00:27
sdaguebecause the *only* difference is a sudoers file with the tty rule00:27
sdagueand it seems silly to redo all of d-g.sh for that change00:27
clarkbsdague: sure, does this edit need to go in pre test hook?00:27
openstackgerritMorgan Fainberg proposed a change to openstack/requirements: Add new keystone projects to projects.txt  https://review.openstack.org/10337500:27
clarkbor does sudo work in post test hook until stuff happens?00:27
sdaguesudo works in post test hook00:28
sdaguejust not for stack user00:28
clarkbok00:28
*** emagana has quit IRC00:28
dims_clarkb, btw, the steps and the naming scheme is codified here - https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary00:29
*** UtahDave has left #openstack-infra00:30
clarkbdims_: fwiw I am fine with either way. I just don't want special snowflakes and I don't awnt to rename this project later if we can do it right now00:30
sdaguedims_: I thought we had all these namespace issues00:31
*** tusharsg has joined #openstack-infra00:31
*** msabramo has joined #openstack-infra00:32
dims_clarkb, sdague looking for notes from Doug that we worked past the namespace issues00:34
*** tsg has quit IRC00:34
openstackgerritA change was merged to openstack-infra/elastic-recheck: Extend query for pip download timeout bug 1270710  https://review.openstack.org/10588400:35
uvirtbotLaunchpad bug 1270710 in openstack-ci "sporadic pip timeouts during download" [Medium,Incomplete] https://launchpad.net/bugs/127071000:35
*** sballe has quit IRC00:35
sdaguedims_: so I wrote a brutal work around in devstack for it, but I'm not convinced that's a definitive work around :)00:36
sdagueunless something else was done00:36
*** packet has quit IRC00:36
* sdague kind of wishes oslo was 1 library00:36
openstackgerritSteve Kowalik proposed a change to openstack-infra/config: Sprinkle in more USE_IRONIC to TripleO jobs  https://review.openstack.org/10592700:39
*** msabramo has quit IRC00:43
*** hemna is now known as hemna_00:45
*** thedodd has joined #openstack-infra00:51
openstackgerritA change was merged to openstack-infra/git-review: Update tests to use Gerrit 2.8.6.1  https://review.openstack.org/10424900:55
*** bdpayne has quit IRC00:55
*** thedodd has quit IRC00:56
openstackgerritK Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file  https://review.openstack.org/10593000:57
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add tools to hack on infra with Docker  https://review.openstack.org/10591700:57
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Align prepare_node.sh with prepare-node in dib  https://review.openstack.org/10593100:57
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool  https://review.openstack.org/8847901:01
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add pre-requisites needed for diskimage-builder  https://review.openstack.org/10258301:01
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add tools to hack on infra with Docker  https://review.openstack.org/10591701:01
dims_sdague, clarkb - the long discussion in ML was in April (http://markmail.org/message/nr2f2nri43fyvdjp) and Doug updated the wiki with latest discussion in May (https://wiki.openstack.org/w/index.php?title=Oslo/CreatingANewLibrary&diff=53356&oldid=51766). I'll get Doug to post the "why" to the ML so everyone knows tomorrow01:02
dims_s/get/request/01:02
clarkbdhellmann: that thread says to me we should keep using oslo01:04
clarkber dims_ ^01:04
clarkbbut it doesn't seem to differentiate between the . and no .01:04
dims_clarkb, the wiki updates are a month after the email discussion01:05
dims_i bet i need to check one of the weekly chats for more info01:05
sdagueclarkb: is this kosher? - https://review.openstack.org/#/c/98575/601:07
*** shashankhegde has quit IRC01:07
clarkbsdague: I mean it won't hurt anything, but bandersnatch fixed that bug already01:08
clarkbsdague: and its sort of assumed you got tox already from somewhere01:08
sdagueclarkb: ok, can you comment on that then?01:08
clarkb(it is weird to me that devstack would install tox)01:08
sdagueI'd rather not be adding talismans01:08
sdaguewell you need tox to run tempest01:08
clarkbsdague: sure, I guess to me tox was the bootstrap tool like pip01:09
clarkbyou had to have those two before anything else01:09
sdagueyeh, well you don't need anything for devstack01:09
sdagueit installs pip as well01:09
clarkbsdague: commented. I didn't give a numberic value because its fine to add but it won't necessarily change anything01:11
sdagueclarkb: actually, that's all confusing to me. That's added just because someone that's not us is using our mirror?01:11
clarkbsdague: yes01:12
sdagueyeh, f that01:12
clarkbI mean it doens't hurt anything. But it doesn't necessarily help either01:12
*** Daisy has joined #openstack-infra01:13
sdagueright, but if we don't need it we shouldn't do it. If we add talismans all through here, no one will know later that it's vestigial01:14
clarkbsdague: did you see my comment about whitespace on the tip of os-loganalyze stack?01:16
dims_sdague, clarkb - oslo.db vs oslodb came up in ML thread and here's Doug's response - http://markmail.org/message/w4vj5jg454prkbwp01:16
clarkboh you did I masked it by setting my base to ps1 derp01:17
dims_that's all the nuggets i can find :)01:17
clarkbdims_: ok, I disagree with that :) but at least there is concrete evidence for why the . is still a thing01:17
dims_clarkb, ack.01:18
clarkb(if something is broken to where it doesnt work you fix it even if it sucks...)01:18
clarkbsdague: stack is +2 to me01:19
*** emagana has joined #openstack-infra01:25
*** amcrn has quit IRC01:25
dims_clarkb, :)01:28
*** emagana has quit IRC01:29
*** marcoemorais has quit IRC01:33
*** Evgeny_ has quit IRC01:35
*** praneshp has quit IRC01:36
*** Sukhdev has quit IRC01:38
*** praneshp has joined #openstack-infra01:41
*** praneshp has quit IRC01:42
*** praneshp has joined #openstack-infra01:44
*** maxbit has quit IRC01:45
*** moted has quit IRC01:45
fungiit's also worth noting that developers (maybe even operators/deployers) who configured their systems to install from our mirror against our recommendation are in for a rude awakening when we eventually delete the openstack pypi tree we're no longer using there in favor of the simple tree01:45
*** gangil has joined #openstack-infra01:46
*** nosnos has joined #openstack-infra01:48
*** gangil has quit IRC01:50
*** praneshp has quit IRC01:51
*** mfer has joined #openstack-infra01:56
*** mfer has quit IRC01:57
*** nati_uen_ has quit IRC02:02
*** oanufriev has joined #openstack-infra02:02
*** arnaud has quit IRC02:03
oanufrievguys, hi. I'broke jenkins job. What have i do to abort it? https://jenkins04.openstack.org/job/check-rally-dsvm-rally/177/console02:04
clarkboanufriev: there are timeuots on the jobs. it should die on its own02:04
*** mwagner_lap has quit IRC02:04
oanufrievoh, thanks. good news02:04
*** praneshp has joined #openstack-infra02:06
*** mmaglana has quit IRC02:06
*** zhiyan_ is now known as zhiyan02:07
*** alexpilotti has quit IRC02:08
*** asettle has quit IRC02:09
openstackgerritJamie Lennox proposed a change to openstack-infra/config: Add requests-mock to stackforge  https://review.openstack.org/10594102:09
openstackgerritjizhilong proposed a change to openstack-dev/hacking: Add check: unnecessary list comprehension in set()  https://review.openstack.org/10594202:10
*** jyuso has joined #openstack-infra02:12
*** loquacities has quit IRC02:14
*** loquacities has joined #openstack-infra02:14
openstackgerritpatrick-crews proposed a change to openstack-infra/config: Setting environment variables to ensure we execute basic tripleo overcloud upgrade tests.  https://review.openstack.org/10594402:15
*** asettle has joined #openstack-infra02:20
openstackgerritAaron Rosen proposed a change to openstack-infra/config: Add congress-specs as new project to stackforge  https://review.openstack.org/10594702:22
*** Evgeny has joined #openstack-infra02:22
*** praneshp has quit IRC02:22
*** gangil has joined #openstack-infra02:26
*** trinaths has joined #openstack-infra02:27
*** markwash has quit IRC02:28
*** [1]trinaths has joined #openstack-infra02:30
*** trinaths has quit IRC02:32
*** [1]trinaths is now known as trinaths02:32
*** Ryan_Lane has quit IRC02:32
*** pballand has quit IRC02:34
openstackgerritAaron Rosen proposed a change to openstack-infra/config: Add congress-specs as new project to stackforge  https://review.openstack.org/10594702:34
*** trinaths has quit IRC02:36
*** baohua has joined #openstack-infra02:39
*** vhoward has joined #openstack-infra02:47
*** zz_johnthetubagu has quit IRC02:50
*** mancdaz has quit IRC02:50
*** zz_johnthetubagu has joined #openstack-infra02:52
*** zz_johnthetubagu is now known as johnthetubaguy02:52
*** mancdaz has joined #openstack-infra02:52
tusharsgclarkb:  I am back to debugging the centos6 + py26 issue with pyeclib .. at this point I have pyeclib building/installing fine with "tox -e py26" in centos6 - but jenkis on a latest recheck still seems unhappy https://jenkins01.openstack.org/job/gate-swift-python26/4546/console02:53
*** tusharsg is now known as tsg02:54
*** baohua has quit IRC02:55
tsgclarkb:  wondering what would be the best way to further debug this issue02:56
*** baohua has joined #openstack-infra02:56
clarkbtsg: how were you testing?02:57
clarkboh I see tox there02:57
clarkbI missed that somehow. and that particular test runs?02:57
tsgyeah "tox -e py26" runs fine02:57
*** mmaglana has joined #openstack-infra02:57
tsgalso "pip install pyeclib" in a venv works02:58
tsgthis is on a vagrant centos6.5 box + puppet/modules from config.git02:59
clarkbI have just held one of the actual slaves, and will poke around there03:02
tsgclarkb: appreciate that!  :)03:02
*** HenryG has joined #openstack-infra03:03
*** markwash has joined #openstack-infra03:04
*** vhoward has left #openstack-infra03:06
*** dstufft|laptop has joined #openstack-infra03:11
clarkbfungi: btw with this held node I am noticing packet loss from hpcloud to git.o.o03:14
clarkbfungi: mtr blames routers living in us.above.net03:15
clarkbfungi: and http and git protocols both seem happy but https is not03:16
clarkbfungi: there is somethingreally funny going on03:16
*** nati_ueno has joined #openstack-infra03:20
*** dims_ has quit IRC03:22
clarkbtsg: ok I have reproduced03:22
clarkbtsg: there is no pyeclib package installed at all03:22
*** dims_ has joined #openstack-infra03:23
tsgclarkb: good to know you are able to see the same thing .. that matches what "pip freeze" output is telling us03:23
*** nosnos has quit IRC03:23
clarkbnow trying to see if I can figure out wy03:24
tsgclarkb:  are you able to use the slave to try out stuff?  such as "pip install pyeclib" etc?  or even better "tox -e py26" in the leftover swift dir03:24
tsgclarkb:  thanks!03:24
clarkbtsg: so I did pip install pyeclib>=0.9.2 it returns success, pip freeze | grep pyeclib reports no install03:24
clarkbso I think it must be realted to the install of pyeclib03:24
clarkbits sayign it succeeded when it fails03:24
*** elambert has joined #openstack-infra03:25
* tsg nods03:25
tsgclarkb: i assume  it pulled down pyeclib 0.9.4 .. or tried to, anyway03:25
tsgclarkb: could this be an issue with pip version?03:26
clarkbtsg: maybe, I have pip 1.5.603:26
clarkbtsg: more likely it is a bug in tha tcrazy setup.py03:26
clarkbI am currently trying to udnerstand what it is doing03:27
tsgclarkb: one thing I must mention .. the way it is in requirements.txt is "pyeclib" but actually the package name is "PyECLib"03:27
clarkbthat may make a difference03:27
tsgclarkb:  right now it is doing a lot of crazy stuff - we are actively working on cleaning it up .. should be up very soon (next week)03:27
clarkbhow is it registered in pypi?03:28
*** mmaglana has quit IRC03:28
tsgPyECLib03:28
clarkbalways use the same string as it is registered in pypi03:28
* clarkb tries that03:28
tsgclarkb: gotcha :)03:28
*** jerryz has quit IRC03:29
tsgclarkb: I have seen pip "figure out" the name to be PyECLib on py27 .. that may have been added in a later ver of pip03:29
clarkbtsg: yes pip can figure things out and package names are not case sensitive03:29
clarkbtsg: but there are corner cases where if you dont' get it right stuff faisl. so why not use the actual name/03:29
clarkbanyways that didin't change anything03:29
clarkbtsg: we are using the lastest version of pip (1.5.6)03:30
tsgclarkb:  I agree - we'll fix that03:30
tsgclarkb:  ok I didn't realize03:30
tsgclarkb: do you have access to the actual requirements.txt tox was trying to use?03:30
tsgjust to make sure the package appears in there ..03:31
clarkbtsg: yes it is the same as in your cange03:31
clarkbtsg: https://review.openstack.org/#/c/103644/2/requirements.txt that is exactly what is used03:31
tsgclarkb:  ok thanks03:31
elamberttsg:  shouldn't that be greater than 0.9.4 ?03:31
elambertthe change has 9.203:32
tsgelambert:  we have >=0.9.2 .. it picks the latest03:32
elambertfair'nuff …03:33
tsgelambert:  clarkb confirmed that it was picking 0.9.4 - but I will get it updated in the next rev of the patch03:33
* elambert nods03:33
*** emagana has joined #openstack-infra03:34
*** markwash has quit IRC03:35
*** mmaglana has joined #openstack-infra03:35
clarkbright so I think the problem is your *-c_eclib.sh scripts are not set -e03:35
clarkbso things can fail silenty03:35
clarkbthere are explicit checks that can cause failure but nothing eg in the event that make fails03:35
clarkbso it silently reports success without doing anything03:35
*** emagana_ has joined #openstack-infra03:35
clarkbso I guess the next step is to clone pyeclib and see if making some changes clears anything up03:36
clarkbtis build process appears to grab random things from the internet03:37
tsgclarkb:  we are working on changing that  :)03:37
clarkbsure but that means these tests could fail at any time due to factors completely out of our control03:37
tsgclarkb:  we are trying to separate c_eclib into separate project (liberasurecode)03:37
clarkbok git tip of master installs properly03:38
tsgclarkb:  yeah .. it does seem to install fine by hand03:38
*** emagana has quit IRC03:38
tsg(and on py27)03:38
openstackgerritjizhilong proposed a change to openstack-dev/hacking: Add check: unnecessary list comprehension in set()  https://review.openstack.org/10594203:38
tsgclarkb: assume you used https://bitbucket.org/kmgreen2/pyeclib03:38
clarkbyes03:38
clarkbnow to grab the tarball and try isntalling that03:39
tsgoff of pyeclib .. ok .. that should go fine as well :)03:39
tsgsorry s/pyeclib/pypi03:39
*** emagana_ has quit IRC03:40
clarkbyup that works too03:41
clarkbso its a pip + pypi thing?03:41
clarkbwhere pypi may or may not be our mirror03:41
* clarkb grabs package from the mirror03:41
tsgclarkb:  yeah looks like it03:41
clarkbohhh here we go03:41
clarkbhttp://pypi.openstack.org/simple/PyECLib/03:41
clarkbthats only 0.9.203:42
tsgclarkb:  how often is that updated?03:42
clarkbtsg: should be continuous but bandersnatch may have had a sad03:43
clarkbmordred: ^03:43
tsgclarkb:  :)03:43
tsgclarkb:  we did find some issues on centos6 and pushed it few hours ago03:43
tsgmay not have been propagated03:43
clarkbtsg: http://paste.openstack.org/show/85862/ so thats the problem03:44
tsgclarkb:  learning a lot here about openstac infra .. heh .. pypi mirror is another one!03:44
clarkbtsg: I highly recommend making your install scripts set -203:44
clarkber set -e03:44
clarkbtsg: you have `make` running and its error code is not interpretted by anything03:44
clarkbjust as happened above03:45
tsgclarkb: will get that change in asap03:45
elambertso that was the issue we had fixed in 9/403:45
elamberterr 9.403:45
clarkbelambert: its not fixed03:45
clarkbelambert: it may be that make works on centos6 now03:45
clarkbelambert: but if you break it again you won't now03:45
clarkbtsg: the reason we use a mirror is the internet is unreliable. THis is why I point out that your install downloads random things from internet03:46
elambertclarkb:  not disagreeing with -e03:46
clarkbtsg: bceause it bypasses any sort of mirroring that your downstreams may attempt to do03:46
tsgclarkb:  so simply exit(err) from the shell and setup.py doing a sys.exit(err) is not enough .. looks like03:46
tsgclarkb:  agree with that03:46
*** arnaud has joined #openstack-infra03:46
clarkbtsg: no because you are ignoring the return codes on many commands03:46
clarkbtsg: notably make03:46
*** emagana has joined #openstack-infra03:47
tsgclarkb:  not completely ignoring:03:47
tsg  make03:47
tsg  [ $? -ne 0 ] && popd && popd && exit 503:47
clarkbmordred: dstufft RuntimeError: Could not acquire lock on /srv/static/mirror/.lock. Another instance seems to be running. bandersnatch is complaining about that03:47
tsgbut I get the point03:47
elambertclarkb: so the paste you provide above .. was that from 0.9.4?03:48
*** emagana has quit IRC03:48
clarkbtsg: https://bitbucket.org/kmgreen2/pyeclib/src/5fc005a96e5263ed20f125b9dda2da59f07f2deb/c_eclib-0.9/install-c_eclib.sh?at=master#cl-9703:48
tsgelambert:  from 0.9.2 .. http://pypi.openstack.org/simple/PyECLib/03:48
clarkbelambert: no that is from 0.9.2 which is what we are using03:48
*** emagana has joined #openstack-infra03:48
clarkbbecause bandersnatch got itself wedged03:48
* elambert nods03:48
tsgclarkb:  I see that  .. certainly missed that one!03:49
tsgclarkb:  I think it is better we work on separating c_eclib out and eliminate the compile time dependencies on jerasure etc (that we download at compile time)03:50
elamberttsg:  +1 :-)03:50
tsgclarkb:  in that version we move to a complete autotools env .. no build scripts03:51
tsgclarkb:  this is an interim version so Swift development can move forward03:51
tsgclarkb:  if we split into PyECLib + liberasurecode, I assume we need to get liberasurecode into requirements (you told us where yesterday)03:52
tsgfor that to happen do we need to have Debian and RedHat packages already?03:53
clarkbtsg: for what its worth its not the end of the world to do what you do. But eg libzmq falls back on it rather than enforcing it03:53
*** emagana has quit IRC03:53
openstackgerritJoshua Hesketh proposed a change to openstack-infra/os-loganalyze: Log swift errors to stderr  https://review.openstack.org/10471903:53
clarkbtsg: no liberasurecode would be a C dep installed by the operating system right?03:53
*** nosnos has joined #openstack-infra03:53
tsgclarkb: yes03:53
clarkbtsg: we would have to isntall it on the slaves if that is the case using apt and yum03:53
clarkbthe global-requirements list is for python dependencies03:54
*** blamar has quit IRC03:54
tsgclarkb:  gotcha .. so we need to get it into Debian and Redhat before we can request anything03:54
tsgclarkb:  thankfully zigo has already begun the work on debian03:56
clarkbmordred: dstufft: lsof says the process I expect to be bandersnatching has the .lock file open. Could this be an flock put in place by a dead process? I thought flocks only lived as long as a process because process tables03:56
clarkbtsg: ubuntu and centos03:56
tsgclarkb: but with this newfound Centos6 requirement (for my pov :)), we need to rush into centos as well :)03:56
tsgneed to talk to zaitcev about it!03:56
*** dims_ has quit IRC03:57
tsgclarkb:  does it have to be on official ubuntu/debian ppa?03:57
tsgclarkb:  never mind .. :)03:59
tsgmany thanks for all your help!03:59
clarkbtsg: so we don't need debian at all (though debian will want it anyways because they do openstack too and getting it into debian usually makes things trickle into ubuntu)03:59
clarkbwe would need the package in ubuntu trusty's repos03:59
tsgclarkb:  ah that's good to know!  :)03:59
clarkbwe try to avoid ppas because they tend to not come with any formal security updates and the like03:59
tsgclarkb:  that makes sense04:00
tsgso Ubuntu and Centos repos specifically04:00
tsggotcha04:00
tsgelambert:  can you also please make a note of that :)04:00
elamberttsg ..noted04:01
clarkbmordred: dstufft so the way we are running bandersnatch is via cron on a 5 minute interval04:01
tsgelambert:  thanks - we need to rush this stuff for certain04:01
clarkbmordred: dstufft the crons are complaining because there is a day old bandersnatch that is still alive04:01
clarkbmordred: dstufft: is it safe to kill that running bandersnatch? to see if cron will start another happier process?04:02
clarkbmordred: also the run_bandersnatch script doesn't seem to be in use yet04:02
tsgclarkb, elambert:  thanks much .. later04:03
*** tsg is now known as tsg_away04:03
dstufft|laptopclarkb: yes it should be safe04:04
clarkbmordred: dstufft bandersnatch is doing a lot of gettimeofday and select04:04
clarkbdstufft|laptop: thanks, I will go ahead and try that then04:04
clarkbdstufft|laptop: http://paste.openstack.org/show/85863/ is what it says now which doesn't seem great but also implies bandersnatch is trying04:05
clarkbwell its late I am not going to worry about it tonight04:07
*** Daisy has quit IRC04:08
*** tsg_away has quit IRC04:08
*** blamar has joined #openstack-infra04:08
*** ildikov has quit IRC04:09
*** chuckC has quit IRC04:12
*** mtreinish has quit IRC04:19
*** pballand has joined #openstack-infra04:19
*** amitpp has joined #openstack-infra04:19
*** mtreinish has joined #openstack-infra04:20
*** ArxCruz has quit IRC04:23
*** asettle has quit IRC04:27
*** mmaglana has quit IRC04:28
*** emagana has joined #openstack-infra04:33
*** pcrews has quit IRC04:34
*** chandankumar has joined #openstack-infra04:34
*** emagana has quit IRC04:34
*** emagana_ has joined #openstack-infra04:34
*** pcrews has joined #openstack-infra04:36
*** garyk has quit IRC04:38
*** emagana_ has quit IRC04:39
*** YorikSar has quit IRC04:39
*** YorikSar has joined #openstack-infra04:41
*** chandankumar has quit IRC04:44
*** pcrews has quit IRC04:46
*** cody-somerville has quit IRC04:47
*** bdpayne has joined #openstack-infra04:52
*** dims_ has joined #openstack-infra04:53
*** mrmartin has joined #openstack-infra04:58
*** dims_ has quit IRC05:02
*** Daisy has joined #openstack-infra05:05
*** mrmartin has quit IRC05:05
*** bdpayne has quit IRC05:06
*** cody-somerville has joined #openstack-infra05:07
*** pballand has quit IRC05:07
*** tsg has joined #openstack-infra05:08
openstackgerritA change was merged to openstack-infra/git-review: Build universal wheels  https://review.openstack.org/10466705:17
*** cristov_macbook has joined #openstack-infra05:17
*** msabramo has joined #openstack-infra05:18
*** bdpayne has joined #openstack-infra05:19
tsgclarkb:  after pyeclib 0.9.4 synced to pypi mirror, all looks good .. thanks again05:24
clarkboh good bandersnatch woke up05:24
*** chandankumar has joined #openstack-infra05:24
tsgclarkb: assume that's the hostname for the mirror?05:25
clarkbno bandersnatch is the pypi mirror tool05:25
clarkbI had to kick it earlier and it didn't do what I expected but eventually it did05:25
clarkbso thats good05:25
tsgah gotcha05:26
mikalRemind me of where our elastic search is?05:29
clarkbmikal: http://logstash.openstack.org for the kibana web ui05:31
mikalThanks05:31
clarkbmikal: http://logstash.openstack.org/elasticsearch for the raw elasticsearch REST api05:31
*** dstanek_zzz is now known as dstanek05:31
*** garyk has joined #openstack-infra05:32
*** jpeeler has quit IRC05:33
*** sballe has joined #openstack-infra05:33
mikalclarkb: do you have the energy for a conversation about gate failures? Or is it too late in your day?05:33
clarkbmikal: and its all cuaght up right now... hopefully we are getting close to a longer term solution for that05:34
clarkbmikal: its late but really hot so no sleep anytime soon. whats up05:34
* jhesketh grabs popcorn05:34
mikalSo, I have this guy named gus...05:34
mikalHe's been tricked into looking into mysql locking problems in neutron tempest runs05:34
mikalWe think its super common05:34
mikalBasically eventlet and mysqldb interact poorly05:35
*** k4n0 has joined #openstack-infra05:35
mikalIf we wanted to change the connection string used for mysql in tempest runs for neutron to see how many failures we removed, that's going to be hard right?05:35
*** emagana has joined #openstack-infra05:35
openstackgerritjizhilong proposed a change to openstack-dev/hacking: Add check: unnecessary list comprehension in set()  https://review.openstack.org/10594205:35
clarkbmikal: you want to change it for some subset of tempest jenkins runs or some subset of the individual tempest tests?05:36
*** praneshp has joined #openstack-infra05:36
mikalgus: explain things here please05:36
gushow much background do we want?05:36
mikalclarkb: I think we probably want to change it for everything eventually, but it would be wise to prove this improves things first05:36
gusbasically there's a deadlock that happens with eventlet and mysqldb05:37
clarkbgus: gotcha05:37
clarkband I assume you want to change the connection string to use a different driver?05:37
gus.. if the transaction switches to another eventlet, that then reenters mysqldb and then blocks on the same transaction, then we're screwed.05:37
mikalclarkb: to my (possibly incorrect) understanding, this is a searh for failures caused by this problem -- http://logstash.openstack.org/#eyJzZWFyY2giOiJcIkxvY2sgd2FpdCB0aW1lb3V0IGV4Y2VlZGVkOyB0cnkgcmVzdGFydGluZyB0cmFuc2FjdGlvblwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDA0OTcwMzgwMjc0fQ==05:37
clarkbbecause python-mysql or whatever the driver is is blocking and bad05:37
gusI want to change the connection string to mysql+mysqlconnecter, yep.05:37
gusI have a few small changes outstanding to oslo.db to allow their unittests to be able to be run against non-default mysql drivers.05:38
gusbut I don't think there's anything blocking switching tempest at this point.05:39
clarkbI don't think changing the string will be hard. The tricky bit is going to be getting that python driver on the slaves as it doesn't look like it is on pypi05:39
gusit's external ...05:39
mikalclarkb: what is involved in getting somehting onto pypi?05:39
clarkbmikal: usually we try to get the package owners to push there05:40
clarkbmikal: and often it works. libvirt for example05:40
mikalclarkb: I could deploy The Richard if that would help05:40
mikalclarkb: but I'm not clear on if that would actually help05:40
*** emagana has quit IRC05:40
clarkbmikal: no I think pypi upstream doesn't want to slurp stuff up for people05:41
clarkbmikal: for legal raisins or some such05:41
clarkbmordred might know who to yell at in mysql land to publish on pypi05:41
*** trinaths has joined #openstack-infra05:41
mikalSo yeah05:42
gusso we need it on the real pypi (not --allow-external)?  hrm.05:42
mikalI wonder what's the best way to communicate enough background to people to get everyone pulling in the same direction?05:42
clarkbgus: yes, we managed to finally avoid all external pypi links finally05:42
clarkbgus: and we don't want to regress on that (it took a long time)05:42
mikalclarkb: I assume because external is less reliable?05:42
clarkbmikal: exactly05:42
clarkbmikal: it also breaks mirroring05:42
mikalgus: should you write up the problem and the proposed fix in an email to openstack-dev or something?05:43
gusmikal: the pypi people seem to hate it because of security mumble mumble.05:43
mikalclarkb: would that help get people pulling in the right direction you think?05:43
gusmikal: there's already an os-dev thread, and a blueprint.05:43
clarkbmikal: so prior to the very recent switch to banderstanthc we had the most hacking pypi-mirror tool that would find externally hosted stuff and host it on the mirror anyways. We now use bandersnatch beacuse no externally hosted packages05:43
gusas you said, I think at this point we need a sufficient cabal of people pulling in the same direction.05:43
mikalgus: there's the thread from the mirantis guy05:44
mikalgus: does that explain the underlying problem well enough?05:44
mikalAhhh, he does provide an intro now that I re-read it05:45
*** emagana has joined #openstack-infra05:45
mikalAnd by mirantis I mean red hat05:46
gussubject: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client05:46
gusfor those playing along at home05:46
*** emagana_ has joined #openstack-infra05:47
*** emagana has quit IRC05:47
clarkbya so first step I think is get https://pypi.python.org/pypi/mysql-connector-python/1.2.2 to host their package05:47
*** shashankhegde has joined #openstack-infra05:47
clarkbsecond step is adding that to global-requirements05:47
clarkbthen we can hit the jobs with hammers05:49
clarkbsomeone should just make libdrizzle work alrady05:49
clarkbwhere is LinuxJedi05:49
gus... so before we can fix this, we need to convince oracle to ship their software via a different repository?05:50
mikalclarkb: so, do we really think we can get Oracle to change their packaging?05:50
gussnap!05:50
mikalLOL05:50
mikalmordred: FIX THIS THING!05:50
clarkbmikal: I honestly don't know. Other projects have done it05:50
clarkbbut they weren't oracle05:50
gussigh.05:50
mikalYeah, Oracle05:50
mikalI am sure their legal department has thoughts about this05:50
clarkbprobably all wrong05:51
mikalLOL05:51
* gus just wants to add 15 characters to fix the gate :(05:51
mikal15 characters? That's 15 weeks work!05:51
mordredmikal: ++05:51
*** emagana_ has quit IRC05:51
clarkbto attack from a different angle, can we not make mysql-python better?05:51
clarkbI think mordred has experience with this too05:52
*** marcoemorais has joined #openstack-infra05:52
*** marcoemorais1 has joined #openstack-infra05:53
*** andreykurilin_ has joined #openstack-infra05:54
*** cristov_macbook has quit IRC05:54
*** bdpayne has quit IRC05:55
*** marcoemorais has quit IRC05:56
*** marcoemorais1 has quit IRC05:57
clarkbmikal: gus looking at devstack https://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/databases/mysql#n159 the way its currently implemented it is all or nothing05:58
clarkbmikal: gus so all projects would have to use the same mysql driver or devstack would need new smarts05:59
gusclarkb: that's probably the end result we want, but I guess it means having to convince more people before we can start.06:00
gus(that's almost certainly the end result we want)06:00
clarkbgus: maybe? you cna probably also just add a second mysql type in devstack and at least keep the old one working06:00
*** Azher__ has joined #openstack-infra06:01
gusclarkb: thanks for the assistance.06:01
gusI'll start some email threads and we can pick it up again there.06:01
clarkbmikal: actually isn't oracle participating upstream with openstack now?06:02
clarkbmikal: maybe we can get some of those folks to talk to the mysql people06:02
*** Azher__ has quit IRC06:02
clarkband maybe buy them beers?06:02
*** Azher__ has joined #openstack-infra06:02
mikalclarkb: they intend to, it hasn't really meshed yet06:03
mikalclarkb: but we coudl ask our solaris contacts for help06:03
mikalclarkb: different teams etc etc though06:03
mikalclarkb: I told gus to email openstack-infra to talk about this, is that the right place?06:03
*** doude has joined #openstack-infra06:04
clarkbprobably -dev06:04
clarkbthis is less about infra and more about this is how you play nice with python and so forth06:04
mikalSo, there's already a thread on -dev06:05
mikalIt didn't get a lot of love06:05
clarkbout of curiousity, do we know why nova and cinder and glance et al apparenetly are not affected?06:05
clarkbor are they and its just bad everywhere?06:05
*** Alexei_987 has quit IRC06:06
*** nosnos has quit IRC06:08
*** YorikSar has quit IRC06:08
clarkbmikal: gus: I will also be at the ironic/nova meetup so can sit in person too if people will be around06:08
clarkbgranted this is neutron but whatever06:09
*** r1chardj0n3s has joined #openstack-infra06:09
*** r1chardj0n3s has left #openstack-infra06:10
mikalclarkb: gus isn't going to that unfortunately06:10
mikalclarkb: but I am sure we can get him on the phone or something if we need to06:10
gusyep, happy to explain what I know to anyone who asks.06:10
gusclarkb: we think neutron code structure is more likely to hit this.06:11
gusin particular, neutron opens lots of transactions and then does stuff within that transaction that might yield.06:11
gus(sending notifications in particular)06:11
gusI'm mostly repeating what others have said here, since I haven't gone and looked at coding patterns elsewhere.06:12
*** jpeeler has joined #openstack-infra06:13
clarkb(I have no idea what I am talking about) PyMysql was brought up in the past but ruled as too slow. What about CyMysql?06:13
gusyeah I haven't looked exhaustively at alternatives either.06:14
guswe need something that is pure python (and can be monkeypatched), or has some sort of explicit support for eventlet.06:14
gusthere are several python libraries, I just went straight to mysqlconnector since it's the "official" mysql client.06:14
StevenKAnd then got Oracled06:15
clarkbpymsql is pure python, cymsql is a fork that adds cython support06:15
clarkbnot sure how cython and eventlet monkeypatching interact06:15
gusI look forward to seeing zuul tests for all of them.06:15
gusif only we had a unittest that exercised this eventlet and sqlalchemy issue.  Oh wait, I have one of those!06:16
*** msabramo has quit IRC06:17
*** sballe has quit IRC06:17
*** tsg has quit IRC06:18
*** msabramo has joined #openstack-infra06:18
clarkbwhat terms are mysql-connector distributed under? GPL?06:20
clarkbI suppose if we make the source available somewhere we can shove it on pypi ourselves (terrible idea but hey)06:20
gusgpl06:20
gusaccording to the sidebar on http://dev.mysql.com/downloads/connector/python/06:20
*** sweston_irccloud is now known as sweston06:21
clarkbso in theory that is doable06:21
*** sweston has quit IRC06:21
StevenKThat platform selector dropdown makes me go WAT06:21
*** sweston has joined #openstack-infra06:22
StevenKThere's no real 'give me the source, damn it' button06:22
gusoh it took me quite a while to actually find the link to the source.06:22
clarkblogin now or sign up wtf06:22
* clarkb sees if pypi has a backdoor06:22
gusand then I tried to find pre-oracle versions and couldn't without a google search.06:22
clarkbhttp://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-1.2.2.zip#md5=1459adcda19858629585d356ef48118006:23
StevenKI wonder if they could make the "No thanks, just start my download" link any smaller06:23
clarkbyup GPLv206:23
StevenKhttp://dev.mysql.com/get/Downloads/Connector-Python/mysql-connector-python-1.2.2.tar.gz seems to work06:24
clarkbis this pure python too?06:24
clarkbwill it suffer the same issues as PyMysql?06:24
gussuffer?06:25
gusmysql connector does _not_ have the same deadlocks as mysqldb.06:25
gusI'm guessing pymysql does _not_ either, but I haven't tested it.06:25
clarkbgus: right but PyMysql which is also pure python is has been ruled too slow06:25
gusaha that problem.06:26
gusSomeone had  a benchmarks page somewhere ...06:26
*** mkoderer has joined #openstack-infra06:26
gusI can't find the page I was reading earlier today :(06:31
gushttp://blog.fizyk.net.pl/blog/sqlalchemy-speed-tests-on-mysql-connector-python-mysqldb-and-oursql-drivers.html06:31
*** jcoufal has joined #openstack-infra06:32
*** msabramo has quit IRC06:32
gus^^ this one has some frankly rather terrible benchmarks (in quality of testing, not in results for mysqlconnector).06:32
*** liam_ has joined #openstack-infra06:32
*** liam_ is now known as Guest540506:33
gushttps://github.com/Tin/sqlalchemy-gevent-mysql-drivers-comparison/blob/master/README.md06:33
gus^^ aha, that's what I was reading earlier today.06:34
*** andreykurilin_ has quit IRC06:34
gusso mysqlconnector was substantially faster on one test that benefited from actually supporting python threading (or similar)06:34
gus.. and about 2x slower than mysqldb on a general thrash-as-fast-as-you-can test.06:35
clarkband pymsql is slightly worse than mysql-connector06:36
gusI gather mysqlconnector is very new code (only a few years old as a project). So that's a concern too.06:36
clarkbit might be worth taking a stab at pymysql again06:36
gusyep.  that implies we're looking at 2-2.5 times slower than mysqldb for things that are DB-bound.06:37
gusjust to put an order-of-magnitude on C vs python client.06:38
*** sweston_ has joined #openstack-infra06:43
*** harlowja is now known as harlowja_away06:47
*** jlibosva has joined #openstack-infra06:48
*** shashankhegde has quit IRC06:48
*** Evgeny has quit IRC06:51
*** msabramo has joined #openstack-infra06:52
*** nati_ueno has quit IRC06:53
*** mpavone has joined #openstack-infra07:01
*** dstanek is now known as dstanek_zzz07:02
*** camunoz has quit IRC07:03
*** luqas has joined #openstack-infra07:04
*** emagana has joined #openstack-infra07:12
*** emagana has quit IRC07:16
*** amalagon has quit IRC07:18
*** mpavone has quit IRC07:18
*** Longgeek has joined #openstack-infra07:22
*** mrmartin has joined #openstack-infra07:22
*** msabramo has quit IRC07:23
*** Longgeek has quit IRC07:23
*** Longgeek has joined #openstack-infra07:25
*** jgallard has joined #openstack-infra07:29
*** praneshp_ has joined #openstack-infra07:31
*** tkelsey has joined #openstack-infra07:32
*** yfried__ has quit IRC07:33
*** praneshp has quit IRC07:34
*** praneshp_ is now known as praneshp07:34
*** luqas has quit IRC07:34
*** jp_at_hp has joined #openstack-infra07:35
*** luqas has joined #openstack-infra07:36
*** Daisy has quit IRC07:36
*** luqas has quit IRC07:37
*** Daisy has joined #openstack-infra07:39
*** sweston_ has quit IRC07:43
*** xianghui has joined #openstack-infra07:45
*** praneshp has quit IRC07:47
*** dstufft|laptop has quit IRC07:48
*** zehicle has joined #openstack-infra07:49
*** zehicle_at_dell has quit IRC07:50
*** mkerrin has quit IRC07:51
*** jpich has joined #openstack-infra07:52
*** dstanek_zzz is now known as dstanek07:53
*** Mithrandir has quit IRC07:55
mkodererjhesketh: mattoliverau: gents, could you add the email address of Dimitry in https://wiki.openstack.org/wiki/Qa_Infra_Meetup_201407:56
mkodererdavidlenwell: could you add your address as well into the wiki?07:57
*** dizquierdo has joined #openstack-infra07:57
*** mkerrin has joined #openstack-infra07:58
*** Evgeny has joined #openstack-infra07:59
jheskethmkoderer: can do :-)08:00
mkodererjhesketh: thx :)08:00
*** Mithrandir has joined #openstack-infra08:01
jheskethmkoderer: done08:01
*** dstanek is now known as dstanek_zzz08:03
*** nati_ueno has joined #openstack-infra08:04
*** viktors has joined #openstack-infra08:05
*** YorikSar has joined #openstack-infra08:08
*** nati_ueno has quit IRC08:09
*** Guest58876 has joined #openstack-infra08:12
*** emagana has joined #openstack-infra08:13
openstackgerritA change was merged to openstack-infra/storyboard: Update the global require  https://review.openstack.org/10339108:15
*** derekh_ has joined #openstack-infra08:15
*** ihrachyshka has joined #openstack-infra08:17
*** emagana has quit IRC08:18
*** jistr has joined #openstack-infra08:18
viktorshello. Can I ask a question about pypi.openstack.org in this chat? )08:22
*** luqas has joined #openstack-infra08:23
*** maxbit has joined #openstack-infra08:23
*** sweston_ has joined #openstack-infra08:24
*** ihrachyshka has quit IRC08:24
*** ihrachyshka has joined #openstack-infra08:25
*** hashar has joined #openstack-infra08:32
*** e0ne has joined #openstack-infra08:38
*** IvanBerezovskiy has joined #openstack-infra08:45
*** _nadya_ has joined #openstack-infra08:51
*** _nadya_ has quit IRC08:58
*** luqas has quit IRC08:59
*** flaviof_zzz has quit IRC09:03
*** ildikov has joined #openstack-infra09:04
*** zhiyan is now known as zhiyan_09:04
*** ociuhandu has joined #openstack-infra09:04
*** zigo has quit IRC09:05
*** nati_ueno has joined #openstack-infra09:05
*** Guest58876 has quit IRC09:05
*** Guest58876 has joined #openstack-infra09:06
*** yaguang has joined #openstack-infra09:06
*** zigo has joined #openstack-infra09:07
*** cyeoh has quit IRC09:08
*** nati_ueno has quit IRC09:09
*** nibalizer has quit IRC09:10
*** nibalizer has joined #openstack-infra09:10
*** emagana has joined #openstack-infra09:13
*** cyeoh has joined #openstack-infra09:14
*** baohua has quit IRC09:16
*** emagana has quit IRC09:18
*** Daisy has quit IRC09:19
*** johnthetubaguy is now known as zz_johnthetubagu09:19
*** zz_johnthetubagu is now known as johnthetubaguy09:19
*** e0ne has quit IRC09:22
*** e0ne has joined #openstack-infra09:25
*** zhiyan_ is now known as zhiyan09:27
*** rlandy has joined #openstack-infra09:28
*** Evgeny has quit IRC09:29
*** pelix has joined #openstack-infra09:33
*** luqas has joined #openstack-infra09:41
*** dmakogon_ is now known as denis_makogon09:43
joaHello o/09:44
joaSmall question about zuul: There are two services: "zuul" and "zuul-merger"; but zuul cannot be stopped, as it says it cannot find any pid file. Is it something inconsistent within zuul itself or do I have an issue somewhere ?09:44
*** matrohon has joined #openstack-infra09:45
*** saper_ is now known as saper09:50
*** afazekas has joined #openstack-infra09:51
*** dstanek_zzz is now known as dstanek09:52
*** ominakov has joined #openstack-infra09:55
rcarrillocruzjoa: have you checked that zuul is really running at all?09:57
rcarrillocruzthe fact that there's no pid, it may mean it's just not running, thus no need to stop it09:57
*** alexpilotti has joined #openstack-infra10:00
*** jedimike has joined #openstack-infra10:02
*** dstanek is now known as dstanek_zzz10:02
joarcarrillocruz: Well, if by zuul you mean the zuul-server process, yeah it's running10:02
openstackgerritAntoine Musso proposed a change to openstack-infra/nodepool: Drop voluptuous from requirements  https://review.openstack.org/10600310:02
joaI have to kill it manually currently, which is kind of strange10:03
joazuul merger can be started/stopped fine10:03
joabut zuul itself says nothing when starting and doesnt want to be stopped10:03
*** Guest58876 has quit IRC10:05
*** alexpilotti has quit IRC10:06
*** nati_ueno has joined #openstack-infra10:06
*** pblaho has joined #openstack-infra10:07
*** xianghui has quit IRC10:07
*** flaviof_zzz has joined #openstack-infra10:08
hasharjoa: zuul and zuul-merger should be two different init script with two different pid files10:08
*** jd__ has quit IRC10:09
joahashar: yeah I know10:09
joabut one "works" properly10:09
joawhile the other not :D10:09
hasharmaybe your defaults are wrong?10:09
*** gaelL has quit IRC10:10
*** saper has quit IRC10:10
openstackgerritJoão Cravo proposed a change to openstack-infra/jenkins-job-builder: Add support for reverse build trigger  https://review.openstack.org/9573410:11
*** nati_ueno has quit IRC10:11
*** e0ne has quit IRC10:13
*** jd__ has joined #openstack-infra10:13
joahashar: maybe, but since I'm kind of starting with it, now idea what could be wrong. The zuul.log file contains some logs, nothing talking about exception or crash10:13
*** Longgeek has quit IRC10:13
*** gaelL has joined #openstack-infra10:13
*** emagana has joined #openstack-infra10:14
joaAlso, I have the two processes properly running: zuul-server and zuul-merger10:15
joaso.. it's not like it didn't start or crashed before creating the pid file.10:16
jgallardsalut mat !10:16
*** saper has joined #openstack-infra10:17
jgallardoups sorry... :)10:17
*** emagana has quit IRC10:18
*** Guest58876 has joined #openstack-infra10:20
hasharbonjour jgallard :D10:21
*** Longgeek has joined #openstack-infra10:24
*** Evgeny has joined #openstack-infra10:25
*** asselin has quit IRC10:25
*** skolekonov has quit IRC10:27
*** chuckC has joined #openstack-infra10:27
*** jgallard has quit IRC10:28
*** kmartin has quit IRC10:28
*** Guest58876 has quit IRC10:29
dmitrymeHey people, I am playing with the http://logstash.openstack.org/. I am running the following query as a test10:31
dmitrymemessage:"EC2VolumesTest-1485461725" AND filename:"logs/screen-n-api.txt"10:31
*** chuckC has quit IRC10:31
*** chuckC has joined #openstack-infra10:31
dmitrymethe problem is logstash inconsistently reports build_status for entries found10:31
dmitrymewhen I click on ‘build_status’ link, it reports that 7% of found entries failed10:31
sdaguedmitryme: build_status on the front page is wrong in percentages10:32
sdagueit's a known bug10:32
dmitrymesdague: any known workaround for that?10:33
sdaguenot really, but is it important?10:33
sdaguebuild_status is a facet of the hits you've found10:35
sdaguethere is only 1 build_status10:35
sdagueso it's 100% of your hits10:35
dmitrymesdague: I am trying to find a signature for bug I’ve experienced in check job. I’d like to be sure that that the query I’ve made finds failed builds only10:35
dmitrymethat is outlined in https://wiki.openstack.org/wiki/ElasticRecheck10:35
sdaguesure10:36
dmitrymeYou need a 100% failure rate for a good e-r query10:36
sdagueright10:36
sdaguebut you have 100%10:36
sdaguethe facets will show the top 5 facets10:36
sdagueso if there is < 5 listed10:36
sdaguethen just do the quick math in your head between them10:36
sdaguehowever, that's not a good signature10:36
dmitrymesgadue: sure, that was just a test query to check my suspition that it incorrectly shows failure rate10:37
sdaguedmitryme: sure10:40
sdagueso basically ignore the % absolute numbers10:40
sdagueand just do the quick math in your head between the facets shown10:40
dmitrymesdague: could you please clarify, what fo you mean by “facets”?10:41
dmitrymeand what is “top 5 facets”?10:41
dmitrymeI mean, in my perspective logstash just shows log entries corresponding to the query10:42
*** andreaf has joined #openstack-infra10:42
sdagueeverything down the left side10:43
sdaguethose are facets10:43
sdaguepieces of metadata that we store on every result10:43
openstackgerritSergey Reshetnyak proposed a change to openstack/requirements: Add cm_api to global requirements  https://review.openstack.org/10601110:43
*** yfried__ has joined #openstack-infra10:45
openstackgerritNikita Konovalov proposed a change to openstack-infra/storyboard: Update _route method usage  https://review.openstack.org/10576610:51
dmitrymesdague: I think I understood what you mean. So basically for build_status column there could be only 2 facets: “success” and “failure”. Am I right?10:52
openstackgerritRadomir Dopieralski proposed a change to openstack/requirements: Add xstatic-packaged JavaScript libraries for Horizon  https://review.openstack.org/9779310:52
*** x1b2j has joined #openstack-infra10:53
sdaguedmitryme: yep10:53
*** mrmartin has quit IRC10:57
*** Azher__ has quit IRC10:58
dmitrymesdague: thank you for clarification. The problem with the facets is that they are displayed for the current page only (500 entries maximum). So if query returns large number of entries, facets are not really helpful. But seems like I’ve found a way to search for false positives - I am adding ‘AND build_status:”SUCCESS”’ and the query should return 0 entries. Again, thank you for your help.10:59
*** ZZelle_ has quit IRC11:00
*** ZZelle_ has joined #openstack-infra11:00
*** dstanek_zzz is now known as dstanek11:00
*** ihrachyshka has quit IRC11:01
*** hashar has quit IRC11:01
*** nati_ueno has joined #openstack-infra11:07
*** _nadya_ has joined #openstack-infra11:10
*** nati_ueno has quit IRC11:11
*** obondarev has joined #openstack-infra11:11
*** pcm_ has joined #openstack-infra11:12
*** juzuluag has joined #openstack-infra11:12
*** emagana has joined #openstack-infra11:15
*** ihrachyshka has joined #openstack-infra11:15
*** gangil has quit IRC11:17
*** Evgeny_ has joined #openstack-infra11:18
*** Evgeny has quit IRC11:18
*** emagana has quit IRC11:19
*** e0ne has joined #openstack-infra11:20
*** _nadya_ has quit IRC11:20
viktorshi! i have an issue with pypi.openstack.org mirror. Can someone help me?11:22
sdaguejhesketh is you are still up - https://review.openstack.org/#/c/102941 and the series after that11:25
sdaguea bunch of os-loganalyze refactoring and a few new features11:25
jheskethsdague: cool :-)11:25
sdagueclarkb +2ed the stack, I figure you are the most familiar other infra core on it11:26
*** k4n0 has quit IRC11:26
jheskethI just realised my failed the tests, so I'll chuck it behind your stack11:26
jheskethunless you have any objections11:26
sdaguejhesketh: none at all11:26
sdagueyou might want to check out the stack first, because the refactor is extensive enough that you probably have to tweak a bit where things are11:26
jheskethsure, I'll review first anyway11:27
viktorssdague: Hi! Please tell me to what person I should address question about pypi mirror?11:28
*** jyuso has quit IRC11:28
jamielennoxcan someone point me at the graphs for the gate's success rate? i want to figure out if there are a lot of issues at the moment or zuul just hates me11:36
sdaguejamielennox: zuul never just hates anyone11:37
sdaguehttp://jogo.github.io/gate/11:37
jamielennoxsdague: i have 4 reviews that have failed gate for unrelated issues 3 times each - i feel like it's me11:38
*** yamahata has quit IRC11:38
sdaguejamielennox: yeh, I think this has to land - https://review.openstack.org/#/c/105854/11:39
sdagueit bounced of something else failing11:39
*** amitpp has quit IRC11:40
jamielennoxalright - i'll just leave them and try again tomorrow11:41
*** yamahata has joined #openstack-infra11:41
sdagueturns out we run so many daemons in a single node setup, 100 db connections is not enough :)11:43
*** pblaho has quit IRC11:43
*** baohua has joined #openstack-infra11:47
*** openstackgerrit has quit IRC11:47
*** adalbas has joined #openstack-infra11:48
jamielennoxlol, wow that's either impressive or a tad scary11:48
*** mrda is now known as mrda-away11:50
*** mriedem has joined #openstack-infra11:50
*** jamielennox is now known as jamielennox|away11:50
*** penguinRaider has quit IRC11:52
vponomaryovWho knows, how can be added/enabled triggering of requirements update for stackforge project, like this one: https://github.com/openstack/cinder/commit/c72e8670dd0d49da1787c66e835bbe5a7aee9f79 ?11:52
*** jgallard has joined #openstack-infra11:56
*** dkranz has joined #openstack-infra11:56
*** pcm_ has quit IRC11:56
*** dkranz has quit IRC11:57
*** dkranz has joined #openstack-infra11:57
*** ArxCruz has joined #openstack-infra11:58
*** trinaths has quit IRC11:58
jheskethsdague: all looks pretty good to me! :-)11:58
jheskethI was mislead to where it was leading though, so disregard my earlier comments11:58
jheskethI've left it for you to review + babysit11:59
sdaguejhesketh: if you want to +A, I'll watch, and hot fix anything11:59
sdaguejhesketh: yeh, the patch order... was a little discombobulated12:00
jheskethsdague: I don't have root access so I'd prefer to make sure somebody else is here too12:00
jhesketheg clarkb ^12:00
sdaguebecause 1, 2 & 5 really were a thing, and 3 & 4 are related12:00
sdaguejhesketh: ah, well it's CDed, so it's easy to hot fix12:00
sdaguebut that's fine12:00
jheskethheh, it's been a while since I've heard somebody use discombobulated !12:00
fungiviktors: i'm only around for a moment (need to dash off to breakfast shortly) but i might be able to answer your pypi mirror question if you will just ask it12:01
*** _nadya_ has joined #openstack-infra12:01
*** e0ne has quit IRC12:02
fungivponomaryov: right now adding that will also require you to only use dependencies of openstack (we won't add new dependencies to the openstack/requirements project's global-requirements.txt file at the request of a stackforge project). if that's okay, then add your project in the projects.txt file in the openstack/requirements project12:02
viktorsfungi: my issue is - I've released oslo.db 0.3.0 yesterday, but I still see old 0.2.0 version on http://pypi.openstack.org/openstack/oslo.db/ What I'm doing wrong? Thanks!12:03
jheskethsdague: https://review.openstack.org/#/c/104719/ a little extra debugging to help us with swift stuff12:03
fungiviktors: i'll look, but i believe clarkb found last night that the mirror update process was stuck. he un-stuck it according to the channel scrollback, but i haven't had a chance to check back on its status yet12:03
viktorsfungi: ok, thank you12:04
*** afazekas has quit IRC12:04
*** hashar has joined #openstack-infra12:05
fungiviktors: i see it on our mirror... http://pypi.openstack.org/simple/oslo.db/12:05
fungiviktors: maybe you need to refresh your browser?12:05
fungiviktors: oh, you're looking at the old mirror12:05
fungithat one's probably getting deleted soon12:06
viktorsfungi: so what url is correct?12:06
sdaguejeblair: lgtm12:06
fungiviktors: the correct url is already in use for all our gate jobs12:06
sdaguejhesketh: lgtm12:06
fungiviktors: but http://pypi.openstack.org/simple/oslo.db/ if you're double-checking it yourself12:07
vponomaryovfungi: thanks, project already depends on only openstack requirements, it ok.12:07
*** doug-fish has joined #openstack-infra12:07
sdaguejhesketh: though actually there is a wsgiref exception logger12:07
* fungi disappears to breakfast. back in an hour or so12:07
sdaguemaybe use that int he 2nd part12:07
viktorsfungi: ok, sorry for trouble you12:08
jheskethsdague: where now?12:09
*** dstanek is now known as dstanek_zzz12:10
sdaguejhesketh: so https://docs.python.org/2/library/wsgiref.html seems to indicated that using 'warnings' is probably the proper way instead of writing out to sys.stderr directly12:11
*** mbacchi has joined #openstack-infra12:15
*** rfolco has joined #openstack-infra12:15
jheskethoh right12:15
jheskethsdague: this does get us a quick stacktrace though12:15
sdaguejhesketh: log_exception12:17
*** penguinRaider has joined #openstack-infra12:17
sdaguethat's in wsgiref.handlers12:17
jheskethhmm interesting12:18
sdagueso I think warnings for the 1 liners, and that might be the "proper" way to do it12:18
sdagueat least from reading the dosc12:19
sdaguedocs12:19
*** afazekas has joined #openstack-infra12:19
*** sweston__ has joined #openstack-infra12:23
*** pcm_ has joined #openstack-infra12:23
*** dprince has joined #openstack-infra12:23
*** _nadya_ has quit IRC12:24
dhellmannmordred, clarkb : https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary#Choosing_a_Name12:25
*** dims has joined #openstack-infra12:25
*** markmc has joined #openstack-infra12:26
*** rcarrillocruz has quit IRC12:27
*** pdmars has joined #openstack-infra12:28
jheskethsdague: which warnings are you referring to sorry?12:28
dhellmannmordred, clarkb: and I see dims found the ML history on that discussion, too12:30
*** tkelsey has quit IRC12:31
*** xianghui has joined #openstack-infra12:32
*** rcarrillocruz has joined #openstack-infra12:32
sdaguejhesketh: commened :)12:36
dhellmannmordred, clarkb, dims : IIRC, I made the final decision on IRC talking with sdague where we decided that the effort to rename the existing libraries wasn't worth it, and we had solved the technical issues that brought it up in the first place. So let's not stall forward motion on an old decision that isn't causing us any trouble, please?12:36
sdaguedhellmann: so I still don't feel like namespace packages are solved, they are worked around12:37
dhellmannsdague: ok, worked around. I still consider this topic closed.12:38
* dhellmann has to start his commute12:38
*** dhellmann is now known as dhellmann_12:38
sdagueand dstufft repeatedly said "namespace packages are a bad idea" :)12:38
Kialldhellmann / viktors - Q re oslo.db. We had an issue a few days ago with a fairly unusual Percona Cluster quirk, it's likely something that needs to be fixed in oslo.db - but I'm not sure what the best approach is. Have a minute and I'll explain? :)12:38
dhellmann_sdague: *after we had committed to that course with at least 2 libs*12:38
dhellmann_Kiall: I'm about to drop offline for about 90 minutes. viktors may be in #openstack-oslo, though12:39
sdaguedhellmann_: well, if we knew every issue before we hit it, we'd be kings12:39
KiallSure - didn't know the channel existed :) Enjoy the commute (if that's possible!)12:39
viktorsKiall: yes, #openstack-oslo will be the better place12:40
jheskethsdague: thanks.. my brain is clearly not parsing properly so I might return to it in the morning :-)12:40
*** dkliban_afk is now known as dkliban12:41
*** afazekas has quit IRC12:44
*** che-arne has joined #openstack-infra12:45
joaDoes anyone know what's missing in my jenkins configuration, looking at the error message of the jenkins-jobs command ? : jenkins_jobs.errors.JenkinsJobsException: Failed to find suitable template named 'noop-check-communication'12:50
joa(trying to setup basic 3rd-party CI)12:50
sdaguefungi / SergeyLukjanov: promoting 105854,3 would probably be in order12:50
sdaguewe've got like a 50% fail rate on pg jobs, I think because we're running out of db connections12:50
*** Evgeny has joined #openstack-infra12:51
*** Evgeny_ has quit IRC12:51
*** mestery has joined #openstack-infra12:51
*** miqui_ is now known as miqui12:56
*** afazekas has joined #openstack-infra12:57
*** baohua has quit IRC12:58
*** HenryG has quit IRC13:01
*** dstanek_zzz is now known as dstanek13:04
*** rkukura has joined #openstack-infra13:05
*** mwagner_lap has joined #openstack-infra13:05
denis_makogonhey, guys, could you please review/approve patch for Trove https://review.openstack.org/#/c/103172/13:06
*** radez_g0n3 is now known as radez13:06
*** afazekas has quit IRC13:08
*** che-arne has quit IRC13:08
*** julim has joined #openstack-infra13:11
*** sweston__ has quit IRC13:12
*** e0ne has joined #openstack-infra13:12
*** julim has quit IRC13:12
*** habib has joined #openstack-infra13:13
*** emagana has joined #openstack-infra13:16
*** tsg has joined #openstack-infra13:17
*** HenryG has joined #openstack-infra13:19
*** rkukura has quit IRC13:22
*** ominakov has quit IRC13:22
*** emagana has quit IRC13:22
*** mfer has joined #openstack-infra13:22
hasharhi smart pythonist. Any clue why installing a pbr software (zuul in this case) yields:   TypeError: dist must be a Distribution instance13:23
*** ominakov has joined #openstack-infra13:23
hasharseems that does not play well with pbr13:24
*** eharney has joined #openstack-infra13:25
hasharpip works :]13:26
*** __afazekas is now known as afazekas13:27
*** ArxCruz has quit IRC13:27
*** ArxCruz has joined #openstack-infra13:28
*** julim has joined #openstack-infra13:28
*** julim has quit IRC13:29
*** julim has joined #openstack-infra13:30
afazekasclarkb: ping13:31
*** aysyd has joined #openstack-infra13:33
*** dangers_away is now known as dangers13:33
gilliard_I can't set bug 1276530 to "Won't fix" although that seems to be the result of disccusion in https://review.openstack.org/#/c/96757/13:33
uvirtbotLaunchpad bug 1276530 in oslo "memorycache#get scans the whole cache for expired items on every fetch" [Low,Triaged] https://launchpad.net/bugs/127653013:33
gilliard_Is that a permissions thing?13:34
*** homeless has joined #openstack-infra13:35
*** sballe has joined #openstack-infra13:36
*** dustins has joined #openstack-infra13:36
ttxGo Kilo! https://www.surveymonkey.com/s/openstack-k-naming13:36
*** dkranz has quit IRC13:38
joaMhh where does the Kilo come from in this listing ?13:39
gilliard_The reference SI Kilogram is kept near Paris13:40
ttxjoa: see http://lists.openstack.org/pipermail/openstack/2014-July/008342.html and https://wiki.openstack.org/wiki/Release_Naming13:40
joaoh okay13:40
gilliard_Although why it's "kilo" not "kilogram" is a question...13:40
joagilliard_: thanks, didn't think of that13:40
joayup, agreed.13:40
ttxgilliard_: it's openstack K, not openstack Kg :) But yeah, it's not a perfect strike13:42
gilliard_I like it though13:42
ttxnone of those options are, except Kleber which really is a street in paris13:42
ttxbut sounds weird13:42
joawell, I don't know the original submissions list13:43
joabut no name strikes me in those.13:43
ttx"K" is not really used that much in France. Like I in China.13:44
joaMHhh.. we do use it.. but not much as a word starter I guess...13:44
ttxright.13:44
ttxjoa: if you're curious the full list of K cities is in the wiki history13:45
joaoh ok I'll look then :D13:45
ttxjoa: Lots of Alsacian names13:45
ttxand Brittany obviously13:45
ttxand a few good names were striked by legal13:46
joawell, I'd expect it, yeah13:46
joabrittany names and alsacian are a given for the K as a starter :D13:46
joa(if only for the local languages)13:46
*** signed8bit has joined #openstack-infra13:46
*** rakhmerov has quit IRC13:47
*** mattymo has quit IRC13:47
*** sballe has quit IRC13:48
*** akuznetsova has quit IRC13:48
*** katyafervent has quit IRC13:48
*** sballe has joined #openstack-infra13:48
*** jamespage_ has joined #openstack-infra13:50
e0nehi infra team! please, review my request: https://review.openstack.org/#/c/99041/. it contains two +1s and nothing changes from Jun 1713:52
*** dstanek is now known as dstanek_zzz13:52
*** prad has joined #openstack-infra13:53
fungisdague: i tried to promote 105854,3 just now, and everything vanished out of the gate... troubleshooting now13:55
*** zhiyan is now known as zhiyan_13:56
*** tcammann has joined #openstack-infra13:56
*** vhoward has joined #openstack-infra13:56
*** jcoufal has quit IRC13:56
fungiohhhhhh13:56
*** jamespage_ has quit IRC13:56
fungipipeline requirements plus clearing the vote when initially enqueuing breaks the promote function13:57
fungion promote zuul tries to reenqueue everything in the gate in a new order13:57
*** pcrews has joined #openstack-infra13:57
fungibut since none of the changes it wants to reenqueue have a check +1, it doesn't consider them13:57
*** ominakov has quit IRC13:57
*** yfried__ has quit IRC13:58
fungijeblair: ^ possibly another unforseen side effect of pipeline requirements13:58
*** obondarev has quit IRC13:58
fungimriedem: thanks for rechecking that one13:59
*** ominakov has joined #openstack-infra13:59
*** jistr has quit IRC13:59
*** emagana has joined #openstack-infra14:00
*** rkukura has joined #openstack-infra14:00
fungii knew the zuul enqueue subcommand didn't work now with pipeline requirements in place for the gate, but didn't realize it was also affecting zuul promote14:01
*** jgrimm has joined #openstack-infra14:01
*** markmcclain has joined #openstack-infra14:02
*** jamespage_ has joined #openstack-infra14:02
*** zz_gondoi is now known as gondoi14:02
*** julim_ has joined #openstack-infra14:02
mriedemfungi: sure14:02
*** julim has quit IRC14:05
*** sballe has quit IRC14:06
*** ildikov has quit IRC14:06
*** jcoufal has joined #openstack-infra14:06
*** melwitt has joined #openstack-infra14:06
*** sballe has joined #openstack-infra14:07
*** sballe has quit IRC14:07
*** sballe has joined #openstack-infra14:07
*** dstanek_zzz is now known as dstanek14:08
*** duran has joined #openstack-infra14:08
*** jamespage_ has quit IRC14:10
*** crc32 has quit IRC14:14
*** crc32 has joined #openstack-infra14:14
*** wayneeseguin has quit IRC14:15
*** timrc is now known as timrc-afk14:16
*** jswarren has joined #openstack-infra14:16
*** yfried__ has joined #openstack-infra14:18
*** pballand has joined #openstack-infra14:19
*** ZZelle_ has quit IRC14:21
*** ZZelle_ has joined #openstack-infra14:21
*** sballe has quit IRC14:22
*** ildikov has joined #openstack-infra14:23
*** sballe has joined #openstack-infra14:23
*** nelsnelson has joined #openstack-infra14:24
*** Longgeek has quit IRC14:25
joafungi: do you have some time for a few questions about zuul ? (already read docs and all, I think :p)14:25
*** yfried__ has quit IRC14:25
*** elambert has quit IRC14:26
*** jistr has joined #openstack-infra14:28
*** tcammann has quit IRC14:28
anteayattx how did Kepler not make the list?14:28
anteayaI'm so disappointed14:28
*** amalagon has joined #openstack-infra14:28
*** wenlock has joined #openstack-infra14:29
*** sballe has quit IRC14:29
*** tcammann has joined #openstack-infra14:29
*** annegent_ has joined #openstack-infra14:29
*** bknudson has joined #openstack-infra14:29
*** wenlock has quit IRC14:30
*** zz_dimtruck is now known as dimtruck14:30
*** sballe has joined #openstack-infra14:30
*** annegent_ is now known as annegentl_14:30
ttxanteaya: blame NVidia14:31
fungianteaya: it was my favorite too, but not a good choice in the market unfortunately14:32
*** garyk has quit IRC14:33
*** datsun180b has joined #openstack-infra14:33
fungii actually ended up voting for kleber as my #1 pick because it's distinct and not too hard to type14:33
fungikilo is not very distinct14:34
fungichallenging in a search engine14:34
*** dstanek is now known as dstanek_zzz14:34
fungijoa: it sounds like you don't have a template which matches the name you're trying to instantiate14:34
joatoo many kilo thinigs :p14:34
joafungi: Well, I've gone forward about that.14:35
fungijoa: oh, new error message now?14:35
joaNow, I simply wonder if having zuul excepting right out of the bat about not being able to start a gearman server...14:35
fungiahh, you've switched to zuul questions. got it14:35
joaif it's normal or not14:35
*** Longgeek has joined #openstack-infra14:35
joaI'm trying to glue things here, so reading the code; fiddling with the conf and all14:35
joaand I fail to see if some behaviors are expected or erroneous14:36
*** morganfainberg_Z is now known as morganfainberg14:36
fungijoa: zuul can either use its internal gearman server *or* optionally connect to a separate gearman server14:36
fungiwe use the internal gearman server for zuul.openstack.org14:36
joaokay; so I shall put false into the gearman section of zuul's conf's "start"; I guess. (since I already have a gearmand running)14:37
joaor I need to prevent gearmand from starting..14:37
fungiyou have gearmand running on that machine for other reasons, or just installed it because you assumed zuul needed it?14:37
joaInstalled it at one point I think14:38
*** yfried__ has joined #openstack-infra14:38
joathe machine is kind of experiment field for my CI; until I manage to make it work "[14:38
joa:p14:38
*** akuznetsova has joined #openstack-infra14:38
fungiright, so ideally you would just disable or uninstall the gearmand you have now, if that's an option for you, and configure zuul to provide its own14:38
joasure it is, going to do just that14:39
*** rakhmerov has joined #openstack-infra14:39
morganfainbergmornin14:39
fungiwhile there are features for zuul to use a separate standard gearmand, we don't really test that it works as designed that way beyond maybe some basic unit testing14:39
anteayattx I will do so14:40
joaoh; by the way, do you have any idea about my pid file missing ?14:40
* anteaya shakes her finger at NVidia14:40
joa(zuul.pid)14:40
anteayafungi: :(14:40
*** bknudson has left #openstack-infra14:40
fungiand also part of the reason zuul provides its own is that there were some features we needed from gearman that the usual suspects didn't provide14:40
joafungi: okay.14:40
fungijoa: usually the missing pidfile would either mean that the service didn't start, or lacked filesystem permissions to write the pidfile14:41
* joa didnt write anything while he tried setting up things; he'll have to do it again before writing a howto.14:41
anteayaI'm not ready to vote yet, still in mourning over kepler14:41
joafungi: Mhh well, the zuul-server process is running14:41
joaand no pidfile exists. which is also a strange point.14:41
*** arnaud has quit IRC14:41
anteayamorning morganfainberg14:41
fungijoa: so it's possible that it's able to start even if it fails to write the pidfile (e.g. for filesystem access reasons)14:41
morganfainberganteaya, how goes today?14:42
*** wenlock has joined #openstack-infra14:42
anteayamorganfainberg: great breakfast, comfy chair14:42
morganfainberganteaya, woot!14:42
joafungi: sure. But I see no reason for it to fail writing the pid :/14:42
anteayamorganfainberg: disappointment that kepler isn't in the k naming poll: http://lists.openstack.org/pipermail/openstack/2014-July/008342.html14:42
*** marun has joined #openstack-infra14:42
*** sballe has quit IRC14:42
anteayamorganfainberg: so on the plus side anyway14:42
morganfainberganteaya, aww yeah.14:42
anteayamorganfainberg: and you?14:42
fungijoa: we run our zuul daemon as the "zuul" user and have the /var/run/zuul directory owned by that user14:43
mtreinishanteaya: damn trademarks...14:43
*** katyafervent has joined #openstack-infra14:43
anteayamtreinish: damn those trademarks14:43
morganfainberganteaya, at the keystone hackathon. discussing lots of stuff :)14:43
*** sballe has joined #openstack-infra14:43
anteayamorganfainberg: awesome!14:43
joafungi: mhhh.. using service zuul start; so.. that should work.. Unless...14:43
fungizuul drops privs before it tries to open the fd for the pidfile14:44
joawhelp, nope; the group is right there.14:44
*** arnaud has joined #openstack-infra14:44
joazuul:root  on /var/run/zuul -> normal; or mistake ?14:44
*** mriedem has quit IRC14:45
fungijoa: probably should be fine as long as it's writeable. but ours in production looks like http://paste.openstack.org/show/85958/14:45
*** jamespage_ has joined #openstack-infra14:45
joaok14:45
*** otherwiseguy has joined #openstack-infra14:45
joaWell, I can touch zuul.pid in there within a zuul session. I dunnow what's wrong. I'd have to fiddle a bit with the code I guess (or the pidfile context manager as far as I could see)14:46
joaOkay.14:46
*** mriedem has joined #openstack-infra14:48
joawhat the...14:49
joarunning with the service utility; zuul seems to have stopped this time.14:49
joaRunning in foreground, it seems to run properly.14:49
*** mattymo has joined #openstack-infra14:49
joaOr my brain got left somewhere else...14:49
*** sballe has quit IRC14:50
*** obondarev has joined #openstack-infra14:50
*** AJaeger has quit IRC14:51
*** jamespage_ has quit IRC14:51
joaWell, yeah seems to have some issues in the init script14:52
fungiwe're currently continuously deployed from the tip of master on an ubuntu 12.04 lts (precise pangolin) vm14:53
fungiif that helps as a point of comparison14:53
*** trinaths has joined #openstack-infra14:53
joaWell, maybe I do not have master's tip. I think it was installed through jaypipes's scripts14:55
joain /usr/local14:55
*** zehicle has quit IRC14:55
* joa is starting to want to throw tables around for fun14:55
*** Guest58876 has joined #openstack-infra14:56
anteayajoa: now you are getting the hang of it14:56
joaanteaya: of throwing tables around ? :D14:56
joaHonestly, I didn't expect to spend so much time in the CI setup14:56
joaI gravely underestimated this.14:56
jeblairhey the periodic stable jobs ran!  ceilometer, heat, horizon, glance, and tempest failed!14:57
joafun.14:57
joaso much fun14:57
fungijoa: no idea what init script jaypipes uses, but we have a puppet module which installs zuul with this initscript for the main service http://git.openstack.org/cgit/openstack-infra/config/tree/modules/zuul/files/zuul.init14:57
*** thedodd has joined #openstack-infra14:57
joaI think he uses puppet scripts (but well, I never did any puppet so it looks like half-shell to me, and half-gibberish)14:58
fungialso known as ruby ;)14:58
joabut now I'm thinking of doing things manually.14:58
joais it basic ruby ?14:58
fungiwhat puppet? no not really14:58
fungiit's some sort of block-based declarative language they made up with bits of embedded ruby14:59
joaoh, reassuring. I'd be afraid if I did not manage to recognize ruby itself14:59
fungipuppet is fun too, if you like throwing tables around14:59
fungireally, computers in general15:00
joawell, have had some feedbacks from friends trying to use it15:00
joathat brings me to a totallyy unrelated question15:00
joawhy use puppet and not salt, which is in python for openstack ? Any specific reason you might know about ?15:00
fungihistorical at this point15:01
joaokay15:01
jeblairsalt did not exist at the time we started, and interest on technical debt is compounding15:02
fungii mean, we have evaluated salt and it too has its benefits and shortcomings, but the effort involved in rewriting everything we have into a new orchestration engine is i think the biggest hurdle15:02
*** kmartin has joined #openstack-infra15:02
anteayajeblair: yes15:02
fungii'm just thankful that we have it in any orchestration engine at all15:02
anteayasorry tab complete fail15:02
anteayathe yes was to joa15:03
fungis/orchestration engine/configuration management system/15:03
fungisome of both really15:04
*** garyk has joined #openstack-infra15:04
*** garyk has quit IRC15:04
fungiwe've started to use ansible in some places for remote execution though15:04
joajeblair: okay, I don't really know either; but if it started before salt it makes sense :)15:04
*** garyk has joined #openstack-infra15:04
*** pballand has quit IRC15:04
*** luqas has quit IRC15:05
fungijeblair: not sure if you saw in scrollback, but i discovered that zuul promote suffers from the same issue as zuul enqueue with our new pipeline requirements configuration15:05
jeblairfungi: okay.  we should probably fix those soon then :)15:06
fungi'zuul promote' is now a synonym for 'zuul empty-the-gate'15:06
*** shayneburgess has joined #openstack-infra15:06
jeblairneat!15:06
fungiyeah, i certainly thought so15:06
*** dstanek_zzz is now known as dstanek15:08
*** gangil has joined #openstack-infra15:09
*** dstanek is now known as dstanek_zzz15:09
*** viktors has quit IRC15:10
*** david-lyle has joined #openstack-infra15:11
*** moted has joined #openstack-infra15:13
*** moted has quit IRC15:13
*** pballand has joined #openstack-infra15:14
*** _nadya_ has joined #openstack-infra15:15
*** Longgeek has quit IRC15:16
*** morganfainberg is now known as morganfainberg_Z15:19
*** morganfainberg_Z is now known as morganfainberg15:20
*** Sukhdev has joined #openstack-infra15:20
*** luqas has joined #openstack-infra15:20
*** ihrachyshka has quit IRC15:21
*** luqas has quit IRC15:22
*** jistr has quit IRC15:24
*** jistr has joined #openstack-infra15:24
*** armax has joined #openstack-infra15:25
jeblairfungi: i think the obvious thing to do for both promote and enqueue is to just ignore pipeline requirements (we're essentially trusting the judgement of the operator to override the configuration anyway)15:25
armaxhi there…is there a way to create an experimental job in the Openstack CI that uses a local.conf rather that the usual way of passing confg to DevStack via env variables?15:26
fungijeblair: i agree that makes sense15:26
jeblairfungi: the complicating aspect of that is whether we should also ignore them when considering changes ahead or behind15:26
*** zzelle__ has joined #openstack-infra15:26
jeblairfungi: i tend to think "no", because that could cause changes that aren't actually ready to be pulled into the queue15:26
*** crc32 has quit IRC15:26
fungijeblair: you mean strictly when using the enqueue/promote subcommands, or all the time?15:26
jeblairfungi: strictly15:27
fungijeblair: and yeah, it seems dangerous. i don't think we should either15:27
*** carl_baldwin has joined #openstack-infra15:27
jeblairfungi: note that when using promote, all of the changes ahead or behind that should be in the queue should already be in the queue when the promote command is used15:27
jeblairfungi: so they will benefit from the override and still end up back in the queue15:27
fungiyeah, that seems fair15:28
fungijeblair: on a related note, did you see my (probably terrible) first attempt at ironing out the reporting failure bug? https://review.openstack.org/104963 mainly a conversation-starter, though i think it at least exposes the problem rather than hiding it in the log15:28
*** signed8bit has quit IRC15:28
jeblairfungi: i did not15:29
*** pballand has quit IRC15:29
fungii think right now any change which gets ejected from the gate because of a failure on another change it depends on is ending up with no -2 in gerrit and no comment from zuul15:29
mtreinishhmm, no gerrit bot again?15:30
fungimtreinish: it seems to be a casualty of the recent netsplit storms. i'll kick it back in15:30
mtreinishanteaya: anyway I respun https://review.openstack.org/#/c/102392/15:30
*** _nadya_ has quit IRC15:30
anteayamtreinish: thanks15:31
* anteaya looks15:31
mtreinishfungi: cool thanks15:31
mtreinishgerritbot seems to get lost during netsplits a lot...15:31
*** radez is now known as radez_g0n315:31
*** chandankumar has quit IRC15:31
anteayamtreinish: sorry, I wasn't clear I had meant this syntax: node: 'bare-precise || bare-trusty' will specifying just bare-trusty work?15:32
anteayafungi: ^15:32
armaxmtreinish, jeblair: is there a way to create an experimental job in the Openstack CI that uses a local.conf rather that the usual way of passing confg to DevStack via env variables? Or do you have suggestions about where I can go look? Thanks15:32
*** openstackgerrit has joined #openstack-infra15:33
*** _nadya_ has joined #openstack-infra15:33
anteayaSergeyLukjanov: I thought I had stated in teh name format guidelines that we would not be using openstack program names in ci names15:33
fungianteaya: uh, probably... unless we end up needing to switch the job from trusty to precise with a parameter function15:33
*** che-arne has joined #openstack-infra15:33
mtreinishanteaya: ah, I thought you were complaining about the whitespace.15:33
anteayaSergeyLukjanov: I had thought you were operating from that understanding, which is why I hadn't said anything on the purestorage email requesting a ci15:34
*** radez_g0n3 is now known as radez15:34
mtreinishI didn't realize everyone else was using an or there15:34
*** vhoward has left #openstack-infra15:34
anteayamtreinish: the empty line and the node: 'bare-precise || bare-trusty', I had two complaints15:34
SergeyLukjanovanteaya, /me checking15:34
mtreinishanteaya: ok, one more time...15:35
anteayamtreinish: sorry, this is my fault, I need to be clearer15:35
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Add subunit2sql to stackforge  https://review.openstack.org/10239215:35
mtreinishanteaya: ^^^15:35
fungialso, openstackgerrit is back now15:35
mtreinishfungi: yep and all's right with the world15:36
anteayamtreinish: yes, that makes me happy15:36
anteayathank you15:36
*** gondoi is now known as zz_gondoi15:37
*** torandu has joined #openstack-infra15:37
*** beagles has joined #openstack-infra15:37
anteayagiven the exposure of driverlog on stackalytics, I have a growing concern that folks need a ci more for marketing purposes than for actual testing purposes15:37
SergeyLukjanovanteaya, I've checked it based on the existing accounts (there is an "HP Cinder CI" already)15:37
anteayaright15:37
anteayawhich was a mistake15:38
anteayawhich I made15:38
anteayaand have been trying to undo ever since I made it15:38
anteayaas per the conversation on the patch dealing with naming15:38
*** asselin has joined #openstack-infra15:38
*** wenlock has quit IRC15:38
anteayaI had thought you have been following the comments on that patch15:38
anteayawhich I hope to discuss next week15:38
*** doude has quit IRC15:39
*** wenlock has joined #openstack-infra15:39
SergeyLukjanovanteaya, unfortunately I'm a bit ahead of the reviews15:39
SergeyLukjanov:(15:39
anteayaokay, well you have been doing such a good job I didn't want to interfere15:39
*** signed8bit has joined #openstack-infra15:39
anteayaI can be irritating15:39
mordredmtreinish: yay subunit2sql15:40
SergeyLukjanovanteaya, I'm sorry :( /me hope to return back to realtime reviews this week15:41
anteayanp, I understand15:41
*** atiwari has joined #openstack-infra15:41
anteayacan you freeze that account, explain that you need to hear from them about their naming choices, and hopefully rename it15:41
anteayaand point to the patch so they understand15:42
*** sweston_ has quit IRC15:43
*** luqas has joined #openstack-infra15:43
*** jlibosva has quit IRC15:43
mordredSergeyLukjanov: the world is strange when you are not reviewing a billion things a day15:45
*** sweston_ has joined #openstack-infra15:45
*** timrc-afk is now known as timrc15:45
SergeyLukjanovanteaya, I'm not sure that it's a good approach while the patch isn't approved15:45
SergeyLukjanovmordred, I was on Paris summit + 4 PTO days for the last 10 days + finishing house repair :)15:46
*** ArxCruz has quit IRC15:46
*** sweston_ has quit IRC15:46
mordredSergeyLukjanov: sounds like fun!15:46
SergeyLukjanovmordred, that's why I'm not doing a lot of reviews but I hope to return back to billions of them next week ;)15:47
SergeyLukjanovmordred, yeah, it's fun :)15:47
*** jgriffith has quit IRC15:47
mtreinishmordred: yeah, I think it's pretty cool. It'll also be interesting to start doing longer term tracking of individual tests from the gate with it15:47
*** ArxCruz has joined #openstack-infra15:47
*** msabramo has joined #openstack-infra15:50
mtreinishmordred: it was also super easy to write (albeit probably poorly :) )15:52
zaromorning15:52
*** jgriffith has joined #openstack-infra15:53
*** thedodd has quit IRC15:54
*** asettle has joined #openstack-infra15:54
jeblairmtreinish: how are you planning on using it?15:55
*** atiwari has quit IRC15:55
anteayaSergeyLukjanov: well right now the problem just got worse15:55
zaromsabramo: mind taking a look? need to create minor release for python-jenkins https://review.openstack.org/#/c/105897 AND https://review.openstack.org/#/c/10589815:56
anteayaSergeyLukjanov: so what are you comfortable doing to not make the problem worse15:56
*** thedodd has joined #openstack-infra15:56
*** sballe has joined #openstack-infra15:57
mtreinishjeblair: I was thinking we'd just have a DB running (maybe spun up with trove) and at the end of each gate job run we use subunit2sql to upload the results of the test run into it15:58
zaroSergeyLukjanov: any reason for not approving?  https://review.openstack.org/#/c/9467515:58
mtreinishthen on top of the DB we could have some dashboards to show individual run metrics, like job fail rates and run times15:58
mtreinishsorry indidvidual test fail rates and run times15:58
*** ihrachyshka has joined #openstack-infra15:59
*** bknudson1 has joined #openstack-infra15:59
mtreinishwe can use the longer term data to make decisions about how we slice tests for running in the gate15:59
mtreinishif we get close to the run time boundary again15:59
mtreinishwe can do this kind of analysis with logstash now, but 10 days isn't enough data16:00
mtreinishanyway I was planning to bring it up next week16:00
jeblairmtreinish: cool; i think we may need to have a post-processing job like the logstash workers actually run subunit2sql (since if we run it on the slaves, the creds will be public)16:01
SergeyLukjanovanteaya, so, I think that we should rename accounts when patch will be approved, I'm ready to do the renaming part16:01
SergeyLukjanovanteaya, (but will need some consultations about how to do it :)16:01
jeblairmtreinish: can you write up an infra-spec for it so we can hammer out all the details?16:01
SergeyLukjanovzaro, /me looking16:02
jeblairmtreinish: and it sounds like maybe it should be in openstack-infra instead of stackforge16:02
mtreinishjeblair: yeah doing it as a post-processing job is fine16:02
mtreinishsure I'll draft a spec after lunch16:02
mtreinishI made it a stackforge project because the subunit2sql library is more general purpose16:02
SergeyLukjanovzaro, good question :) approved16:02
mtreinishI didn't really see anything openstack specific about it16:02
mtreinishbut if you'd rather have it in openstack-infra we can move it there16:03
davidlenwellmkoderer: will do16:03
anteayaSergeyLukjanov: can you communicate with that account and at least make them aware of the patch16:03
*** dizquierdo has quit IRC16:03
jeblairmtreinish: we have lots of stuff in infra that's not openstack-specific -- i think the question is "when you are working on this tool, are you advancing the state of the openstack project infrastructure"16:04
anteayaSergeyLukjanov: so that they are not caught be surprise when asked to come up with a new name16:04
SergeyLukjanovanteaya, yup, sure, I'll do it16:04
anteayaSergeyLukjanov: thank you16:04
*** IvanBerezovskiy has left #openstack-infra16:04
jeblairmtreinish: and i think if we start running a test performance db for all the tests we run, the answer to that is probably 'yes'16:04
*** luqas has quit IRC16:04
*** dstanek_zzz is now known as dstanek16:04
*** e0ne has quit IRC16:04
anteayaSergeyLukjanov: and henceforth you can keep an eye out for ci proposed names and request an alternate if the proposed name includes an openstack program name?16:05
*** melwitt has quit IRC16:05
SergeyLukjanovanteaya, ack16:05
jeblairmtreinish: also, subunit to graphite might be interesting16:05
SergeyLukjanovanteaya, could you please post a link to your CR about naming?16:05
*** david-lyle has quit IRC16:06
*** emagana has quit IRC16:06
*** bknudson1 has quit IRC16:06
*** emagana has joined #openstack-infra16:06
mtreinishjeblair: ok that's fair, I just didn't see it's usefulness limited to just infra and running the test performance db. For exmaple, there was talks of using it as the db backend for a tempest test server16:07
mtreinishbut that being said I don't really care where it lives16:07
*** david-lyle has joined #openstack-infra16:07
mtreinishI can respin that patch and move it under infra that's no real effort16:07
mtreinishjeblair: heh, yeah but I don't know enough about graphite :)16:08
msabramozaro: sure16:09
*** pdmars has quit IRC16:09
*** hashar has quit IRC16:09
jeblairmtreinish: yeah, this in no way has to limit it -- it's more about recognizing that it's part of our work on openstack.  it fits into the system we're building as a whole, contributors get atc status, companies get bigger numbers next to their names, etc :)16:09
msabramothink I need a better IRC client that tracks mentions better16:09
*** pdmars has joined #openstack-infra16:10
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Document the Zuul triggers  https://review.openstack.org/7783816:10
anteayaSergeyLukjanov: https://review.openstack.org/#/c/101013/16:10
mtreinishjeblair: ok you don't have to twist my arm, I fully support padding my stats :)16:11
SergeyLukjanovanteaya, thx16:11
*** emagana has quit IRC16:11
mtreinishjeblair: I'll respin it under the infra namespace16:11
anteayaSergeyLukjanov: np, sorry I didn't know you weren't aware of the patch16:12
anteayaSergeyLukjanov: I should have ensured you were16:12
clarkbdhellmann_: sdague I +2'd the change given the discussion. Its just surprising to me that we decided we had a problem that should be fixed and stopped halfway16:14
clarkbdhellmann_: sdague and that we wouldn't want to start new projects in a fixed state16:14
jeblairsdague: close to final: https://review-dev.openstack.org/#/c/5269/16:15
*** kgriffs has left #openstack-infra16:15
sdaguejeblair: nice16:15
jeblairsdague: hides comments by default16:15
*** emagana has joined #openstack-infra16:15
*** hogepodge has joined #openstack-infra16:15
msabramozaro: Done! Thanks for taking care of that!16:15
clarkbjeblair: that is shiny16:16
openstackgerritJames E. Blair proposed a change to openstack-infra/config: WIP: add CI results table  https://review.openstack.org/10586016:16
jeblairlast todo is new change screen16:16
sdaguejeblair: you could probably shrink the .addMemberTextBox to 20em to square things up a bunch16:16
jeblairsdague: yeah16:17
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: multijob: added kill-phase-on option  https://review.openstack.org/9990316:18
jeblairrgerganov: when you have a minute, can you add an apache license header and copyright statement to hideci.js?16:18
clarkbafazekas: pong16:18
*** duran_ has joined #openstack-infra16:18
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Add subunit2sql to openstack-infra  https://review.openstack.org/10239216:19
*** duran_ has quit IRC16:19
mtreinishjeblair: ^^^ should have gotten all the stackforge references16:19
*** duran_ has joined #openstack-infra16:20
afazekasclarkb: is this job definition ok: https://review.openstack.org/#/c/105534/16:20
*** bknudson has joined #openstack-infra16:21
sdaguefungi: so can we get a re-re promote of - https://review.openstack.org/#/c/105854/16:21
fungisdague: nope16:21
sdaguebecause until that merges, pg tests seem to be at a 50% fail rate16:21
sdaguehow about a ninja merge then?16:21
fungisdague: the reason it dropped out of the gate before was that i tried to promote it16:22
fungiand promote no longer works with pipeline requirements16:22
sdaguewe lost promote... :(16:22
sdaguethat makes me a sad panda16:22
fungiwhen i tried, it just helpfully emptied the entire gate instead, because none of those changes had check +1 votes on them at that point16:22
jeblairwe'll get it back16:22
*** nati_ueno has joined #openstack-infra16:23
*** anonitus has joined #openstack-infra16:23
*** bknudson has left #openstack-infra16:23
fungiyeah, the current issue is that the zuul enqueue/promote utility cli subcommands take the same code path that changes moving in and out of pipelines normally take, so are subject to the same configuration restrictions we've got in place16:24
*** luqas has joined #openstack-infra16:24
*** anonitus has left #openstack-infra16:24
*** anonitus has joined #openstack-infra16:24
fungithus we need a way to give them a free pass rather than be subjected to the configured pipeline requirements16:24
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Modularized StoryBoard Module  https://review.openstack.org/9800716:25
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Change default Reply-To header to $DEFAULT_REPLYTO.  https://review.openstack.org/7933116:25
*** markmcclain has quit IRC16:25
sdaguefungi / jeblair ok, ninja merge?16:26
sdaguebecause - http://jogo.github.io/gate/16:26
clarkbafazekas: reviewed. mostly small things otherwise yes, I think that is a good place to start16:26
sdaguewithout promote we're kind of unhealable16:26
*** marcoemorais has joined #openstack-infra16:26
anteayamtreinish: jenkins is unhappy16:29
anteayamtreinish: alphabetized failed16:29
*** radez is now known as radez_g0n316:30
fungisdague: the change itself looks fairly trivial (though that obviously doesn't speak to the gravity of its effect). i'd be okay manually submitting it through gerrit if jeblair/clarkb are in agreement, though in general we shouldn't be bypassing the gate just because it isn't fast enough for us16:31
*** radez_g0n3 is now known as radez16:31
sdaguefungi: well, I'm sure we can have plenty of beer discussions about that next week :)16:32
*** arnaud has quit IRC16:32
*** nati_ueno has quit IRC16:32
*** atiwari has joined #openstack-infra16:32
*** nati_ueno has joined #openstack-infra16:32
fungisdague: it looks like 105854,3 is failing on a tempest-postgres job in check right now... is it hitting the same failure it's trying to prevent, or is that a different bug?16:33
*** arnaud has joined #openstack-infra16:33
sdaguefungi: let me look16:33
fungihttp://logs.openstack.org/54/105854/3/check/check-tempest-dsvm-postgres-full/8a11ce1/16:33
*** _nadya_ has quit IRC16:33
sdagueif it's failing this fast, I doubt it's the issue16:33
fungiyeah, hit something in devstack, not tempest16:33
mtreinishanteaya: thanks, let me respin it yet again16:33
*** [1]trinaths has joined #openstack-infra16:34
sdaguefailing on rax mirror - http://logs.openstack.org/54/105854/3/check/check-tempest-dsvm-postgres-full/8a11ce1/logs/devstacklog.txt.gz#_2014-07-10_16_27_45_13516:34
fungirackspace ubuntu mirror fail16:34
sdaguetrying to install libxen of all things16:34
fungiokay, so false alarm16:34
*** elambert has joined #openstack-infra16:34
openstackgerritMatthew Treinish proposed a change to openstack-infra/config: Add subunit2sql to openstack-infra  https://review.openstack.org/10239216:35
mtreinishanteaya: ^^^16:35
*** jgriffith has quit IRC16:35
*** eglynn-regus is now known as eglynn-office16:36
*** jgriffith has joined #openstack-infra16:36
*** yaguang has quit IRC16:36
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Add support for Managed Script Plugin  https://review.openstack.org/9910916:36
openstackgerritRandy Coulman proposed a change to openstack-infra/jenkins-job-builder: Support the Store SCM plugin  https://review.openstack.org/8572916:37
*** trinaths has quit IRC16:37
*** [1]trinaths is now known as trinaths16:37
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Add docs jobs for keystone-specs  https://review.openstack.org/10610016:39
*** xianghui has quit IRC16:39
*** salv-orlando has quit IRC16:42
*** markwash has joined #openstack-infra16:42
openstackgerritMichael Krotscheck proposed a change to openstack-infra/infra-specs: StoryBoard Streaming API specification  https://review.openstack.org/10525216:44
*** thedodd has quit IRC16:44
*** SumitNaiksatam has quit IRC16:44
*** tkelsey has joined #openstack-infra16:44
*** chandankumar has joined #openstack-infra16:45
*** jpich has quit IRC16:46
*** duran_ has quit IRC16:48
*** duran has quit IRC16:48
*** e0ne has joined #openstack-infra16:48
openstackgerritMichael Krotscheck proposed a change to openstack-infra/infra-specs: StoryBoard Streaming API specification  https://review.openstack.org/10525216:50
*** sweston_ has joined #openstack-infra16:50
marunfungi, jeblair: when you have the chance, would you take a look at this fix suggested by sdague to fix sudo support for the neutron functional job?16:50
marunhttps://review.openstack.org/#/c/105926/16:51
*** flaper87 is now known as flaper87|afk16:51
*** liam_ has joined #openstack-infra16:51
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Publish docs jobs for keystone-specs  https://review.openstack.org/10610016:51
*** jistr has quit IRC16:52
*** andreaf has quit IRC16:52
armaxcan anyone help me to understand how to add local.conf support to jobs for the experimental queue? Or am I looking at this all wrong?16:52
wenlockclarkb we're looking for when the pip package will show up for this change https://review.openstack.org/#/c/105876/   how does that work?16:53
*** reed has joined #openstack-infra16:54
*** bdpayne has joined #openstack-infra16:54
*** e0ne has quit IRC16:54
*** stevemar has joined #openstack-infra16:54
clarkbzaro: wenlock's  question makes me wonder if python-jenkins pre pbr even honors requirements.txt?16:55
*** denis_makogon has quit IRC16:55
anteayamtreinish: do you want openstack-merges to be aware of this repo?16:55
anteayaregarding gerritbot16:55
*** nati_ueno has quit IRC16:55
stevemarWas wondering what the status of creating specs.openstack.org was? (referring heavily to http://lists.openstack.org/pipermail/openstack-dev/2014-March/031234.html)16:55
clarkbzaro: https://review.openstack.org/gitweb?p=stackforge/python-jenkins.git;a=blob;f=setup.py;h=53f53d66444ace61038a72a59eb41aee7e5650bc;hb=064c4a2e5a11531700cf4a8828825c550f253fe3 judging by that it won't16:55
*** johnthetubaguy is now known as zz_johnthetubagu16:55
morganfainbergstevemar, ++16:55
clarkbzaro: I think that means we need to add suport for reading requirements.txt in that setup.py16:56
jeblairafaik, no one is working on specs.o.o right now.16:56
stevemarmorganfainberg, yeah, turns out they won't be published on docs.o.org :( just learned that16:56
jeblairclarkb: or just add it to setup.py16:56
clarkbjeblair: or that16:56
*** derekh_ has quit IRC16:56
clarkbzaro: in any case the backport wasn't direct. we will need to make a change to setup.py too16:56
zaroclarkb: shoot! i just created another tag.16:56
anteayamtreinish: +116:56
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335516:57
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Stop using select-mirror in slave scripts  https://review.openstack.org/10610716:57
clarkbzaro: did you push it yet?16:57
clarkbzaro: if you haven't pushed it yet then just delete the tag locally16:57
zarowas pushed 5 mins ago.16:57
*** thedodd has joined #openstack-infra16:58
*** annegentl_ has quit IRC16:59
*** emagana has quit IRC16:59
zaroclarkb: i'm not sure what's needed. can you make that change?17:00
*** emagana has joined #openstack-infra17:00
*** salv-orlando has joined #openstack-infra17:00
*** duran has joined #openstack-infra17:01
clarkbzaro: the setup.py on that branch does not install requirements.txt17:02
clarkbzaro: you either need to add six as a requireemnt in the setup.py or read in requirements.txt in the setup.py17:02
clarkbI can't make the change now have to run errands will be back this afternoon17:02
*** SumitNaiksatam has joined #openstack-infra17:03
zaroclarkb: ok. i will propose something.17:03
wenlockzaro clarkb thanks!17:03
*** Ryan_Lane has joined #openstack-infra17:04
*** emagana has quit IRC17:04
stevemarjeblair, anyway I can help on getting specs.o.org setup?17:05
*** SnowDust has joined #openstack-infra17:05
*** juzuluag has quit IRC17:05
notmynamelifeless: I've got a heat question. around?17:05
notmynameor anyone who knows about heat ^^17:06
*** shashankhegde has joined #openstack-infra17:06
notmynamealso where do I ask such questions?17:06
jeblairstevemar: yep.  develop a plan, figure out how the index page should be handled, decide how the jobs should be published, add the appropriate puppet configuration if needed, and write the jobs.17:06
jeblairstevemar: basically nothing has been done, and no one is working on it.17:07
stevemarjeblair, like a walk in the park! i'll start poking around17:08
*** elambert_ has joined #openstack-infra17:08
*** elambert has quit IRC17:08
*** elambert_ is now known as elambert17:08
*** maxbit has quit IRC17:09
jeblairstevemar: there's only one or two things that need infra root access (the dns, and if you choose to do ftp to cloudsites rather than scp to static.o.o, setting that up); we can do that no problem when we get to that point.17:09
*** luqas has quit IRC17:10
clarkbnotmyname: I think there is a #heat17:10
*** Ajaeger has joined #openstack-infra17:10
jeblairjogo: at least, i assume you aren't working on specs.o.o?17:10
notmynameclarkb: ah, ok. thanks. (I found that #openstack-heat isn't a thing)17:10
jeblairprobably should be17:11
*** SnowDust has quit IRC17:11
*** pelix has quit IRC17:11
*** jgallard has quit IRC17:11
*** harlowja_away is now known as harlowja17:13
mtreinishanteaya: heh, I didn't even think about that. If you think adding it to openstack-merges is important I'll respin it again17:14
*** shashankhegde has quit IRC17:15
Ajaegernotmyname: yeah, it's #heat - confusing IMHO17:17
*** shashankhegde has joined #openstack-infra17:17
jogojeblair: I am not working on creating specs.o.o as I don't even know where to start17:18
*** dstanek is now known as dstanek_zzz17:19
*** Sukhdev has quit IRC17:20
*** ominakov has quit IRC17:21
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Stop using select-mirror in slave scripts  https://review.openstack.org/10610717:23
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Delete select-mirror and all the args  https://review.openstack.org/10335517:23
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Clean up select-mirror backward compatibility  https://review.openstack.org/10611217:23
krotscheckIf I make a modification to install_modules.sh, does that get run during gate-config-puppet-apply-precise?17:24
jeblairkrotscheck: i don't think so; it's possible we made a catch-22 there  (it's new)17:24
jeblairkrotscheck: have a test failure from that you can link to?17:25
krotscheckjeblair: https://review.openstack.org/#/c/98007/17:25
krotscheckjeblair: Specifically http://logs.openstack.org/07/98007/12/check/gate-config-puppet-apply-precise/3a6374a/17:25
fungikrotscheck: the job just runs http://git.openstack.org/cgit/openstack-infra/config/tree/test.sh17:25
fungikrotscheck: and no mention of install_modules.sh in it17:26
jeblairso i'm wondering if we can just "sudo install_modules.sh" in test.sh...17:26
*** praneshp has joined #openstack-infra17:26
mordredjeblair: don't see why not17:26
fungias a first step before all the applies17:26
jeblairwill do17:26
fungiseems like a reasonable addition. should be self-testing too17:26
mordred++17:27
*** msabramo has quit IRC17:27
fungimordred: the select-mirror removal patch breakout has now turned into a three-patch series because i couldn't think of a safe way to do it in two17:27
*** dhellmann_ is now known as dhellmann17:27
dhellmannclarkb: the "fix" of renaming the existing libs was deemed too onerous after we found how to not trigger the problem17:28
dhellmannclarkb: I probably do need to write this up for posterity, when I have time17:28
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Run install_modules.sh in puppet apply test  https://review.openstack.org/10611417:28
jeblairkrotscheck, mordred, fungi: ^17:29
fungialready dying! https://jenkins07.openstack.org/job/gate-config-puppet-apply-centos6/35/console17:30
*** harlowja has quit IRC17:30
fungiError: Could not install module 'puppetlabs-stdlib' (v3.2.0); Module 'puppetlabs-stdlib' (v4.2.2) is already installed; Use `puppet module upgrade` to install a different version; Use `puppet module install --force` to re-install only this module17:30
*** harlowja has joined #openstack-infra17:30
*** habib has quit IRC17:30
jeblairwhat's with the stuff after that?17:31
fungia mystery17:31
*** shivharis has joined #openstack-infra17:31
fungihm, and also, that job succeeded anyway17:31
jeblairoh, there are git commands in install_modules17:31
fungimildly troubling on its own17:31
jeblairfungi: install_modules doesn't errexit17:32
*** adrian_otto has joined #openstack-infra17:32
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Run install_modules.sh in puppet apply test  https://review.openstack.org/10611417:32
jeblairswitching to -x so we can see what's going on17:32
shivharisfungi: hi, whom should i contact for issues wrt gerrit triggers - i.e. some ci's are not being sent triggers17:33
*** jedimike has quit IRC17:33
*** markmcclain has joined #openstack-infra17:33
mordredI believe we expect for some of the dependencies to be violated17:33
mordreds/I believe//17:33
*** msabramo has joined #openstack-infra17:34
mordredwhich is one of the reasons we were working towards doing all git commands and not using puppet module install - because the dependencies go bad17:34
dhellmannmordred: requirements update checks are still failing for oslo alphas because the integration script in pbr is doing some steps I think we can skip. http://logs.openstack.org/36/103536/2/check/check-requirements-integration-dsvm/52291e0/console.html#_2014-07-09_18_57_18_74917:34
*** gyee has joined #openstack-infra17:34
*** emagana has joined #openstack-infra17:34
jeblairthe git commands in that script don't look correct17:35
dhellmannmordred: how much of that "build the mirror" stuff do we need to be doing there, do you think? is it enough to just test install the packages and not compare the requirements lists? do we need a mirror for that?17:35
adrian_ottoGuys, my understanding is that Gerrit offers a very simple event stream API that allows you to make an SSH connection to it, and get a feed of events on that connection. Who can I ask for access to that so we can put some async CI automation on it? I'm happy to elaborate on the use case if that's interesting, but I'm most interested in who to give our SSH public key to (in the form of a pull request?) and what access controls if any might need to17:35
fungishivharis: not really sure what you're asking. you can test the account with 'ssh -p 29418 username@review.example.com gerrit stream-events'17:35
fungiadrian_otto: http://ci.openstack.org/third_party.html17:35
adrian_ottofungi: awesomesauce!17:36
*** crc32 has joined #openstack-infra17:36
fungishivharis: either you get the event stream or you don't. gerrit itself doesn't know anything about "triggers" there, it just sends you events, what your system does with the json stream to trigger actions on events in it is up to you17:36
mordreddhellmann: sorry - I keep meaning to rewrite that script real quick17:37
mordredwe need to do almost noen of that17:37
jeblairkrotscheck: try rebasing your change on https://review.openstack.org/106114 and see if it gets the new module17:37
dhellmannmordred: I'm looking at it, but don't have the history so I'm not sure of the changes I'm making.17:37
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Run install_modules.sh in puppet apply test  https://review.openstack.org/10611417:38
dhellmannmordred: so maybe just keep the loop on line 224, and whatever above that is needed for support?17:38
shivharisfungi: Thanks, I'll debug a bit more and then get back.17:38
*** arnaud has quit IRC17:38
*** rcarrillocruz has quit IRC17:40
anteayamtreinish: it just crossed my mind, I'm fine if openstack-merges channel doesn't know about it17:40
*** dstanek_zzz is now known as dstanek17:40
*** Guest49060 has joined #openstack-infra17:40
Guest49060تحذير17:40
Guest49060warning17:40
Guest49060 you may be  watched17:40
Guest49060do usa&israel use the internet(facebook,youtube,twitter, chat rooms ..ect)to spy??17:40
Guest49060do usa&israel use the internet 2 collect informations,,can we call that spying??17:40
*** Guest49060 has quit IRC17:40
*** Guest49060 has joined #openstack-infra17:40
*** Guest49060 has left #openstack-infra17:41
anteayajeblair: ^^ one for you17:41
*** jedimike has joined #openstack-infra17:42
*** rcarrillocruz has joined #openstack-infra17:42
fungii added them to chanserv's akick list17:44
fungijeblair: yeah, it looks like the git commands there are leaving out an action verb17:44
fungioh, wait, they do rev-list HEAD17:45
fungilooks like it should be --max-count=1 not --max-count 117:46
*** gpilz has joined #openstack-infra17:46
*** shashankhegde has quit IRC17:46
openstackgerritK Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file  https://review.openstack.org/10593017:46
fungithough i do like that our spammer visitor managed to get in a plug for internet 217:47
openstackgerritK Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file  https://review.openstack.org/10593017:47
*** msabramo has quit IRC17:49
*** eharney has quit IRC17:49
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Modularized StoryBoard Module  https://review.openstack.org/9800717:49
zaroclarkb, wenlock : fixed python-jenkins installation of requirements: https://review.openstack.org/#/c/106119 AND https://review.openstack.org/#/c/10612117:49
*** Alexei_987 has joined #openstack-infra17:50
*** _nadya_ has joined #openstack-infra17:51
wenlockzaro, awesome, checking now17:52
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script  https://review.openstack.org/10612517:53
dhellmannmordred: ^^17:53
*** shashankhegde has joined #openstack-infra17:53
clarkbzaro you import os but dont use it?17:54
*** maxbit has joined #openstack-infra17:54
krotscheckAre trusty build nodes a thing? I want to see if I can build storyboard without nodeenv :)17:54
mordredkrotscheck: yup!17:55
krotscheckmordred: Sweeeeeeet17:55
*** dstanek is now known as dstanek_zzz17:55
*** eharney has joined #openstack-infra17:55
mordreddhellmann: we'll need to do something to properly test pbr - but we can come back to that17:56
*** dstanek_zzz is now known as dstanek17:57
*** msabramo has joined #openstack-infra17:58
afazekasclarkb: is the 'devstack-precise-2-node' used by anyone ? can it be replaced with trusty ?17:58
clarkbafazekas: I think it can be replaced17:58
zarowenlock, clarkb :fixed now17:59
mordreddhellmann: two niggles - but otherwise awesome17:59
*** nati_ueno has joined #openstack-infra18:01
wenlockzaro, woot18:01
wenlockty18:02
krotscheckjeblair: Looks like that fix of yours worked!18:03
jeblairneato!18:04
*** annegentl_ has joined #openstack-infra18:04
nibalizerjeblair: so to follow up from tuesday's meeting, i do think the p3 master is ready to be fired up, and I can be around to help with that today18:05
openstackgerritafazekas proposed a change to openstack-infra/config: Add 2 node experimental job to d-g  https://review.openstack.org/10553418:05
*** annegentl_ has quit IRC18:06
jeblairnibalizer: cool, let's try to catch up on that after lunch18:06
fungigiven we use other non-puppetlabs modules, i suppose as long as example42-puppi passes a cursory sanity (license, security) review there should be no serious concerns?18:06
fungikrotscheck: ^18:06
fungiseems to be apache-2 licensed18:07
krotscheckThat’s what my thought was. mordred has an opinion as well.18:07
*** _nadya_ has quit IRC18:08
nibalizerya alessandro(example42) knows what he is doing18:08
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script  https://review.openstack.org/10612518:08
krotscheckReally, the critical feature there is the “Hey go get me a tarball” implementation.18:08
* mordred agrees18:08
fungipuppi make me a sandwich?18:08
mordredI also did a pass one night at looking at using it for our other places that do that18:08
mordredit's not urgent, but when we land this, I think it's not a terrible idea to use it across teh board18:08
fungimordred: groups, openstackid, where else?18:09
dhellmannmordred: ^^ addresses your comments18:09
fungioh, i guess for other things not implemented here too18:09
nibalizeri'm haarstarstwhat does puppi do? i'm having a hard time groking the readme18:09
nibalizersssssss           arst18:09
nibalizergo ssh lag go-go18:10
*** Sukhdev has joined #openstack-infra18:12
krotschecknibalizer: It’s a toolkit. I’m using one of the submodules called “netinstall” that allows you to go get a tarball from elsewhere, in a stateful way.18:12
clarkbafazekas looks good. it just occured to me we need to select the node in zuul layout.yaml while we transition to trusty18:12
nibalizeroh nice18:12
krotschecknibalizer: Example, for a while I had my own jenkins build use puppi:netinstall to downoad jenkins-latest and then bounce tomcat. Worked really well except that sometimes tomcat didn’t clean itself up.18:13
clarkbafazekas: sorry I forgot that but otherwise looks good18:13
nibalizeri think there is some code somewhere in our repo where we do a pretty ugly curl -z on the unless parameter to an exec18:13
krotschecknibalizer: There is, in storyboard.18:13
krotschecknibalizer: I think we use wget for that though18:13
nibalizerwel lyea im all for it, can you link the review i can +1 stuff18:13
nibalizeror is this that monster patch you have in to totally redo storyboard?18:14
krotschecknibalizer: https://review.openstack.org/#/c/98007/18:14
krotschecknibalizer: Urrr… yeah.18:14
krotscheck:D18:14
nibalizer:D18:14
*** zz_gondoi is now known as gondoi18:14
mordreddhellmann: almost perfect - except you spelled openstack opensatck :)18:16
mordreddhellmann: but thank you18:16
dhellmannmordred: ugh18:16
* fungi opens a sack of openstack18:16
*** andreaf has joined #openstack-infra18:17
* krotscheck is learning the hard way that having large patches is a recipe for not getting my code landed.18:17
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script  https://review.openstack.org/10612518:17
dhellmannmordred: ^^ third time's the charm?18:18
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add CI results table to Gerrit  https://review.openstack.org/10586018:18
fungikrotscheck: it's a lesson you only have to learn once18:18
*** gondoi is now known as zz_gondoi18:18
*** ociuhandu has quit IRC18:19
krotscheckfungi: Yeah, well, it’s a thing I sometimes can’t do anything about. Landing a feature in StoryBoard like Project Group admin usually is meningless unless all admin functions are there.18:19
nibalizerkrotscheck: my first time i put up a patch i put up a 12k line change18:19
krotscheckfungi: It doesn’t help that people are allergic to javascript around here ;)18:19
*** tkelsey has quit IRC18:19
krotschecknibalizer: Ok, you win.18:19
nibalizeranteaya: was all 'yea.... no....'18:19
funginibalizer: you serve as a good warning to others ;)18:20
jeblairkrotscheck: is your patch ready?18:20
*** salv-orlando has quit IRC18:20
jeblairsdague: final version of ci table on review dev and in https://review.openstack.org/10586018:20
krotscheckjeblair: Incorporated all your comments from a while ago, plus some rebase bugs that have come up since, yes.18:20
*** mwagner_lap has quit IRC18:21
openstackgerritafazekas proposed a change to openstack-infra/config: Add 2 node experimental job to d-g  https://review.openstack.org/10553418:21
afazekasclarkb: ^18:21
mordreddhellmann: looks good!18:22
dhellmannmordred: cool, thanks for the assist18:22
mordreddhellmann: thank YOU18:22
openstackgerritCedric Brandily proposed a change to openstack-infra/git-review: Disable ssh/scp password authentication during tests  https://review.openstack.org/9702518:22
fungimordred: dhellmann: see my -1 on 106125 but i'm probably just missing something18:23
*** blitz has joined #openstack-infra18:23
*** sabeen has joined #openstack-infra18:24
Ajaegerfungi, jeblair, clarkb: Is there a chance to get my translation jobs in this week, please? My two top ones are: https://review.openstack.org/98238 https://review.openstack.org/105372 - and then there's 82384, 96132 and 10544818:24
*** ihrachyshka has quit IRC18:24
dhellmannfungi: if puppet is configuring those, I'm happy to remove them. Running that script as it is now borked my dev box. :-)18:25
mordredfungi: oh - you're right18:25
blitzdoes anyone know if the gate is fixed? seem to be running into this https://bugs.launchpad.net/bugs/133884118:25
uvirtbotLaunchpad bug 1338841 in devstack "asynchronous connection failed in postgresql jobs" [Undecided,In progress]18:25
*** msabramo has quit IRC18:25
dhellmannfungi: both config files?18:25
dhellmannfungi: and does it set the log file up? I don't know if the rest of the job is expecting that log file name18:25
fungidhellmann: yep as far as both files http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/slave_common.pp#n2818:26
*** che-arne has quit IRC18:26
fungidhellmann: checking on the logging, but it would probably make sense for us to just set pip logging common across all our workers anyway... checking now18:26
*** melwitt has joined #openstack-infra18:26
*** jcoufal-mobile has joined #openstack-infra18:27
fungidhellmann: yeah, so you could either append it the pip.conf or update http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/pip.conf18:27
*** msabramo has joined #openstack-infra18:28
dhellmannfungi: I'll do the latter, thanks for catching that18:28
fungimordred: pip normally just logs to ~/.pip/pip.log right? why were we moving it in that script?18:29
*** shivharis has quit IRC18:29
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script  https://review.openstack.org/10612518:29
fungimordred: maybe the job should just collect it from the normal location?18:29
openstackgerritDoug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script  https://review.openstack.org/10612518:30
*** jcoufal-mobile has quit IRC18:30
*** andreaf has quit IRC18:31
krotscheckHrm, this trusty thing seems to be working....18:31
*** arnaud has joined #openstack-infra18:31
*** jedimike has quit IRC18:31
*** annegent_ has joined #openstack-infra18:32
*** marcoemorais has quit IRC18:32
*** marcoemorais has joined #openstack-infra18:33
*** bknudson has joined #openstack-infra18:33
*** marcoemorais has quit IRC18:33
*** marcoemorais has joined #openstack-infra18:33
*** marcoemorais has quit IRC18:34
fungimordred: dhellmann: i'm wondering if we can't just leave out the change to the log location there entirely. i see no indication that the script does anything with the logfile afterward, nor does the job collect/publish it18:34
*** marcoemorais has joined #openstack-infra18:34
fungiso that line may just be cruft18:34
krotscheckthe place to add a new jenkins node dependency is in jenkins_params, yes?18:35
*** mfink has joined #openstack-infra18:35
*** emagana has quit IRC18:36
fungikrotscheck: well, there and then the slave.pp18:36
dhellmannfungi: my latest patch does that, so we'll see if it breaks18:37
*** jswarren_ has joined #openstack-infra18:37
*** emagana has joined #openstack-infra18:37
*** rlandy has quit IRC18:37
krotscheckfungi: Thanks. Is there a convention for installing things on one OS but not another? RHEL for instance doesn’t have a recent node package.18:37
dhellmannfungi, mordred : I wonder if this job name needs to change now, too, since it's not doing requirements integration testing so much as making sure pbr can install things18:37
fungikrotscheck: the params.pp file is for specifying distribution-specific package names, then the slave.pp actually installs the packages by a variable name based on what's in params.pp for the target platform18:37
*** bknudson has quit IRC18:37
fungikrotscheck: yeah, stick a placeholder comment in the missing location for the other platform, and then in the slave.pp you'll find a conditional block in which to insert the variable for your package18:38
krotscheckfungi: Thanks! Ignore my previous question, I’ll read the manifest and figure it out.18:38
fungidhellmann: perhaps. i believe i renamed it when we started using it for per-branch requirements integration testing, so likely it could be named back to whatever the old pbr-specific name used to be18:39
annegent_IRC question, how do I set the topic in the #openstack-doc channel? Apparently I am not a channel operator18:40
jeblairannegent_: we make you an op :)18:41
*** jswarren has quit IRC18:41
*** jswarren_ is now known as jswarren18:41
*** emagana has quit IRC18:41
*** mwagner_lap has joined #openstack-infra18:41
annegent_jeblair: sweet18:41
annegent_jeblair: oh shoot let me get on a network where I can be me, annegentle, tho18:42
jeblairannegent_: yeah, it requires authentication to nickserv18:42
annegent_jeblair: ok got it18:42
annegent_jeblair: I'll ping you in a bit, is that ok?18:42
jeblairannegent_: yup18:43
*** masayukig has quit IRC18:45
*** blitz has quit IRC18:46
*** jedimike has joined #openstack-infra18:47
anteayacan I see what it looks like if we have more than one ci system comment/verify a patch? https://review-dev.openstack.org/#/c/5269/18:50
anteayaoh and yay!18:50
*** masayukig has joined #openstack-infra18:51
*** marcoemorais has quit IRC18:51
openstackgerritDoug Hellmann proposed a change to openstack-infra/config: Rename requirements-integration job  https://review.openstack.org/10613718:52
dhellmannfungi: ^^18:52
*** mkoderer has quit IRC18:52
*** maxbit has quit IRC18:53
*** maxbit has joined #openstack-infra18:53
*** ihrachyshka has joined #openstack-infra18:55
dhellmannfungi, mordred : hmm, do we have another job that tries to install all of our requirements together into one virtualenv or something to make sure there are not conflicting dependencies from somewhere?18:55
krotscheckfungi: Are all of our jenkins ubuntu nodes now trusty, or should I add a special exception?18:55
*** bknudson has joined #openstack-infra18:56
dhellmannfungi, mordred : duh, nevermind, the normal devstack-gate job would do that18:56
*** maxbit has quit IRC18:57
krotscheckffff.f…. I swear, sometimes the most annoying thing about the javascript world is how fast they update their things.18:57
*** ihrachyshka has quit IRC18:57
*** shayneburgess has quit IRC18:58
*** maxbit has joined #openstack-infra18:58
*** marcoemorais has joined #openstack-infra18:59
asettlelunch!19:00
*** hashar has joined #openstack-infra19:00
*** emagana has joined #openstack-infra19:01
openstackgerritRadoslav Gerganov proposed a change to openstack-infra/config: Add button that shows/hides CI comments in Gerrit  https://review.openstack.org/9574319:03
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to jenkins node  https://review.openstack.org/10613919:03
krotscheckAnd with that, lunch!19:03
*** bdpayne has quit IRC19:04
fungidhellmann: granted, we don't actually try to coinstall everything listed in global-requirements.txt, we just normalize all the project requirements to match lines in that file, so there could in theory be things in that file we don't try to install together in devstack19:04
*** _nadya_ has joined #openstack-infra19:05
*** bdpayne has joined #openstack-infra19:05
fungikrotscheck: i believe the only things we're still running on precise are things which run on long-running workers (instead of nodepool managed single-use workers) and py33/pypy jobs19:05
dhellmannfungi: I don't think the changes I'm making change that situation. It was just building the mirror from the global requirements, then trying to install each package in the project list19:06
fungithough there might be some we haven't gotten to switching yet which fell through the cracks19:06
*** primeministerp has quit IRC19:06
fungidhellmann: yep, probably ~= from our perspective19:06
*** primeministerp has joined #openstack-infra19:07
dhellmannfungi: yeah19:07
*** eharney has quit IRC19:08
*** _nadya_ has quit IRC19:10
openstackgerritChristian Berendt proposed a change to openstack-infra/gerritbot: replace dict.iteritems() with six.iteritems(dict)  https://review.openstack.org/9572719:16
*** andreykurilin_ has joined #openstack-infra19:18
*** otherwiseguy has quit IRC19:19
*** terryw has joined #openstack-infra19:19
*** shashankhegde has quit IRC19:20
*** e0ne has joined #openstack-infra19:21
krotscheckfungi: I’m guessing apply-precise should be updated to apply-trusty then?19:21
jeblairkrotscheck: all of our long-running servers are on precise at the moment; we don't have any servers running trusty19:21
jeblairkrotscheck: once we have one, we'll add an apply-trusty job, and when we have zero on precise, we'll drop apply-precise19:22
krotscheckjeblair: Gotcha. The jenkins slaves are trusty though?19:22
*** dstufft|laptop has joined #openstack-infra19:23
jeblairkrotscheck: both19:23
krotscheckjeblair: Aha! So I _do_ need to special case trusty.19:23
jeblairkrotscheck: it's a project by project (or job by job) move from precise to trusty19:23
jeblairkrotscheck: most of openstack is on trusty now, i'm not certain of overall progress.  we'll be keeping precise around for as long as we're supporting icehouse though19:24
jeblairkrotscheck: so yeah, both need to continue to work for the forseeable future19:24
*** chandankumar has quit IRC19:25
*** e0ne has quit IRC19:25
fungiwhich, if pledges for assistance in the last summit's stable maintenance session are to be believed, will be ~this time next year when icehouse gets eol'd19:26
fungi(15 months from when it was released)19:26
annegentlejeblair: ping as me19:26
fungithough if it begins falling apart sooner and nobody steps up to help fix it, possibly much sooner19:26
jeblairkrotscheck: btw, i'm context-free on this -- what's this in service of?19:27
*** e0ne has joined #openstack-infra19:28
mordredjeblair: he's investigating being able to do the storyboard stuff without nodeenv since the stuff in trusty is potentially new enough I believe19:29
krotscheckjeblair: The JS builds use a package called nodeenv, which downloads nodejs and npm and compiles them from source during the build. Turns out that with trusty that’s not necessary anymore, so I’m adding that to our jenkins nodes.19:29
krotscheckWhat mordred said19:29
mordredwhee! I got it right19:29
*** thedodd has quit IRC19:29
*** annegent_ has quit IRC19:30
sdagueso we're still bouncing on 105854,3 not being merged yet19:30
*** crc32 has quit IRC19:30
*** flaper87|afk is now known as flaper8719:30
sdagueif promote is still dead, can we just merge that?19:30
fungithough it is back in the gate, with only foud changes which need to fail out ahead of it19:30
jeblairannegentle: you should now be able to set the topic on #openstack-doc; best way to do that is probably to '/msg chanserv topic #openstack-doc topic goes here'19:30
fungis/foud/four/19:30
annegentleawesome jeblair! Giving it a try19:30
*** pcm_ has quit IRC19:31
sdaguefungi: right, but each is going to fail and reset19:31
*** yfried__ has quit IRC19:31
*** jpich has joined #openstack-infra19:31
sdagueso it's 4 hrs19:31
jeblairannegentle: you can also '/msg chanserv op ...' to make yourself an op... '/msg chanserv help' for all the gory details19:31
sdaguewe're at a 75% failure rate on pg right now19:31
*** jedimike has quit IRC19:31
fungiit's increased? thought it was 50% earlier today19:31
sdaguehttp://jogo.github.io/gate/19:31
krotscheckmordred jeblair: Speaking of which, I’m seeing a thick_slave and a slave… if I really only care about npm on storyboard build nodes, should I use thick_slave?19:31
sdagueit is *very* bad19:31
krotscheck‘cause I know not everyone will want that.19:31
*** terryw is now known as otherwiseguy19:32
mordredkrotscheck: actually, why not start with adding "sudo apt-get install npm" as the first step in the job19:32
*** thedodd has joined #openstack-infra19:32
krotscheckmordred: Because that would be easy and make sense.19:33
morganfainbergmordred, dhellmann, sdague, anteaya, any advice on the best ML  / place to send out a "hey we released keystonemiddleware, packagers, deployers, expect to need it soon™" ?19:33
*** arnaud has quit IRC19:34
Ajaegermorganfainberg: blog about it and ask reed to add it to his weekly newsletter. If it's a release, why not send to -announce?19:35
morganfainbergAjaeger, that was what i was looking for :)19:36
morganfainbergAjaeger, and my blog broke :( or i would blog about it.19:36
morganfainbergAjaeger, need to fix it before I can blog things :P19:37
zarojeblair: any idea why this issue occurs? https://bugs.launchpad.net/openstack-ci/+bug/134036019:38
uvirtbotLaunchpad bug 1340360 in openstack-ci "Gerrty fails to start on MAC" [Undecided,New]19:38
mordredkrotscheck: jeblair and I were discussing reducing the amount of slave types by taking advantage of the sudo features on the nodes19:38
mordredkrotscheck: and in doing pre-download caching of more things during image build19:38
mordredso that we're not necessarily downloading on every job19:38
*** duran has quit IRC19:39
sdaguefungi: so we're currently at 11 merges for the whole day right now. Which is basically an OpenStack Summit merge level, because of needing that patch.19:40
fungisdague: i would love to get some consensus from jeblair, mordred, clarkb or really any other infra core reviewers before unilaterally deciding to just bypass gating for that change19:40
sdaguewe've known the fix for 24 hrs, and the system isn't working to get it in. Which is frustrating.19:41
fungijeblair: digging into the changes needed for fixing promote and enqueue, since those are just adding requests to gearman we need some special way to tag those requests so they can be treated differently from normal injection?19:41
sdagueok, that's infe19:41
sdaguefine19:41
krotscheckmordred: I think in this case the performance hangup is the 8 minute compile time of node, so the download cache isn’t actually the biggest hangup. Or maybe I’m not understanding you right?19:42
reedmorganfainberg, general mlist, cc openstack-dev and I'll add it to the weekly newsletter19:42
jeblairfungi: no i think the change is in handling the request.  i'm planning on hacking on that in a bit.19:42
reedmorganfainberg, what's keystonmiddleware btw?19:42
fungijeblair: oh, okay. still trying to trace the path of the cli requests through the rpc client implementation19:43
fungiit's been a good learning experience19:43
*** pcrews has quit IRC19:44
mordredkrotscheck: no, you're right. the download cache is purely a next step in the future to make it even better19:44
*** tsg has quit IRC19:45
*** zz_gondoi is now known as gondoi19:45
*** tsg has joined #openstack-infra19:47
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to javascript build  https://review.openstack.org/10615219:48
krotscheckmordred: Is this what you had in mind ^^?19:48
*** sballe has quit IRC19:49
sdagueclarkb / jeblair / mordred: we've largely prevented anyone from landing code for integrated projects for 24hrs. I fear we're going to do this for another at least 6 hrs. And we have a 3 line patch that fixes it. It doesn't seem like it should be that contentious to merge that patch. :(19:49
mordredkrotscheck: looks great!19:50
*** maxbit_ has joined #openstack-infra19:50
mordredsdague: sorry - I've been in a week of day long meetings- link to patch?19:50
*** e0ne has quit IRC19:50
sdaguehttps://review.openstack.org/#/c/105854/19:51
*** hashar is now known as hasharAccounting19:51
*** pcrews has joined #openstack-infra19:51
*** shashankhegde has joined #openstack-infra19:52
*** zhiyan_ is now known as zhiyan19:52
krotscheckphschwartz: This’ll imact you as well - https://review.openstack.org/10615219:52
*** gpilz1 has joined #openstack-infra19:53
*** emagana has quit IRC19:53
*** maxbit has quit IRC19:54
*** yfried__ has joined #openstack-infra19:54
*** emagana has joined #openstack-infra19:54
*** sballe has joined #openstack-infra19:55
*** ominakov has joined #openstack-infra19:56
*** gpilz has quit IRC19:57
*** emagana_ has joined #openstack-infra19:57
*** arnaud has joined #openstack-infra19:57
*** emagana has quit IRC19:57
*** ominakov has quit IRC20:00
*** datsun180b has quit IRC20:01
*** marcoemorais has quit IRC20:03
*** bknudson has quit IRC20:04
*** Evgeny has quit IRC20:05
*** bknudson has joined #openstack-infra20:06
*** marcoemorais has joined #openstack-infra20:09
*** emagana_ has quit IRC20:09
*** emagana has joined #openstack-infra20:09
*** Sukhdev has quit IRC20:12
*** dstufft|laptop has quit IRC20:12
*** emagana has quit IRC20:14
openstackgerritVitaliy Lotorev proposed a change to openstack-infra/jenkins-job-builder: add logfilesize plugin support (doc,tests)  https://review.openstack.org/10337220:15
*** bknudson has quit IRC20:17
fungisdague: looks like 105854,3 is about to merge now20:19
*** jswarren has quit IRC20:19
*** duran has joined #openstack-infra20:20
*** msabramo has quit IRC20:21
Ajaegerfungi, jeblair, clarkb: Is there a chance to get my translation jobs in this week, please? Sorry for being impatient...20:22
*** adalbas has quit IRC20:22
AjaegerMy two top ones are: https://review.openstack.org/98238 https://review.openstack.org/105372 - and then there's 82384, 96132 and 105448.20:22
AjaegerWe already have first translations in transifex for e.g. barbican, climate and marconi.20:23
*** ociuhandu has joined #openstack-infra20:26
*** bknudson has joined #openstack-infra20:26
*** Guest58876 has quit IRC20:26
*** chianingwang has joined #openstack-infra20:26
*** pcm_ has joined #openstack-infra20:27
*** emagana has joined #openstack-infra20:27
openstackgerritA change was merged to openstack-infra/config: Make /var/run/puppet in apply test  https://review.openstack.org/10591620:28
openstackgerritSpencer Krum proposed a change to openstack-infra/config: Bump the apt module version from 1.1 to 1.4  https://review.openstack.org/10273920:29
*** julim_ has quit IRC20:30
*** blamar has quit IRC20:30
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Cause the promote command to ignore pipeline reqs  https://review.openstack.org/10616120:30
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Cause the enqueue command to ignore pipeline reqs  https://review.openstack.org/10616220:30
*** bknudson has quit IRC20:30
jeblairsdague, fungi: ^20:31
fungiAjaeger: quick question inline on 9823820:31
fungiAjaeger: otherwise lgtm20:31
fungioh, so it was the call to addChange() in _doPromoteEvent() i should have been looking at20:33
fungigah20:33
Ajaegerfungi: good catch!20:34
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add various translation jobs  https://review.openstack.org/9823820:35
Ajaegerfungi: rebased and remove the wrong line.20:35
Ajaegerfungi: thanks!20:36
*** dstufft|laptop has joined #openstack-infra20:38
fungiAjaeger: that refactoring patch reminds me, you're probably going to want to double check the stack starting at https://review.openstack.org/106107 for possible breakage to the translation scripts20:39
*** duran has quit IRC20:39
fungisince that's the only remaining place we're passing in project name to a slave script, i think20:39
Ajaegerfungi: will review, ,thanks!20:40
*** pcm_ has quit IRC20:40
*** dprince has quit IRC20:40
*** maxbit__ has joined #openstack-infra20:40
*** pcm_ has joined #openstack-infra20:40
*** denis_makogon has joined #openstack-infra20:41
anteaya<-- helping neutron devs learn gerrit queries to maximize efficientcy on review time20:42
sdaguefungi: thanks!20:43
*** maxbit_ has quit IRC20:44
*** bknudson has joined #openstack-infra20:47
*** bknudson has left #openstack-infra20:47
*** ociuhandu has quit IRC20:48
*** mfink has quit IRC20:49
*** dims has quit IRC20:49
*** dims has joined #openstack-infra20:50
*** salv-orlando has joined #openstack-infra20:50
Ajaegerfungi: That's a nice cleanup series!20:52
fungiAjaeger: mordred wrote most of it20:52
AjaegerStill nice ;) Thanks, mordred !20:52
clarkbok I am almost mostly back again20:53
Ajaegerfungi: Thanks for the approval and reviews!20:53
boris-42clarkb hi20:54
Ajaegerclarkb: You're fully welcome!20:54
*** andreaf has joined #openstack-infra20:54
openstackgerritA change was merged to openstack-infra/config: Add various translation jobs  https://review.openstack.org/9823820:54
* Ajaeger will monitor the new translation jobs the next days ;)20:55
*** mwagner_lap has quit IRC20:56
*** flaper87 is now known as flaper87|afk20:57
* Ajaeger calls it a day and hopes for some more reviews for https://review.openstack.org/105372 - and also 82384, 96132 and 105448! Good night!20:57
openstackgerritClark Boylan proposed a change to openstack-infra/config: Add 2 node experimental job to d-g  https://review.openstack.org/10553420:57
clarkbafazekas: ^ the node selection is a bit convoluted, so I went ahead and added what I think we need. I also think I should work harder on removing node specs from the JJB configs20:58
clarkbat least then we will remember to go hit zuul first20:58
*** Ajaeger has quit IRC20:58
*** denis_makogon_ has joined #openstack-infra21:00
*** msabramo has joined #openstack-infra21:01
*** harlowja is now known as harlowja_away21:01
*** mbacchi has quit IRC21:02
*** shayneburgess has joined #openstack-infra21:03
*** denis_makogon has quit IRC21:03
*** denis_makogon_ is now known as denis_makogon21:03
afazekasclarkb: thx21:05
*** Sukhdev has joined #openstack-infra21:05
*** aysyd has quit IRC21:05
*** ociuhandu has joined #openstack-infra21:06
*** ArxCruz has quit IRC21:06
dhellmannmorganfainberg: I usually send to the -dev list. I know zul at least follows there.21:07
sdagueaiopcpu ?21:08
*** harlowja_away is now known as harlowja21:08
clarkbsdague: all in one something21:08
clarkbafazekas: ^ can we make that clearer? maybe 2node?21:08
sdagueyeh, or multinode21:09
sdagueas that's what everyone's been calling it21:09
*** rkukura has quit IRC21:11
*** sballe has quit IRC21:11
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Fix import check interaction with namespace modules  https://review.openstack.org/10616921:12
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Relax H305 and H307 checks  https://review.openstack.org/10617021:12
afazekashttps://review.openstack.org/#/c/106043/1/devstack-vm-gate-wrap.sh,cm21:13
*** radez is now known as radez_g0n321:13
afazekasclarkb: I would like to give names based on the services distribution among the nodes21:14
*** ociuhandu has quit IRC21:14
*** maxbit__ has quit IRC21:14
*** atiwari has quit IRC21:15
afazekasclarkb: The d-g setup will be able to handle 1 special node and unlimited from the other (sub) at the first round21:15
*** mfer has quit IRC21:15
*** ociuhandu has joined #openstack-infra21:16
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to javascript build  https://review.openstack.org/10615221:16
afazekasthe comment from 124 explains what the aiopcpu means, but the full logic is not there21:17
clarkbsdague: ^21:17
fungianagram for "cuppa i/o"21:18
sdagueafazekas: so I think it's going to remain confusing. What about multi and multi-compute21:19
sdagueI'm not sure what I understand controler + compute is21:19
*** rkukura has joined #openstack-infra21:19
afazekassdague: controller type does not have compute service it has , but the others has compute but not api services21:20
clarkbright I think we may be overthinking this21:21
sdagueyeh, I think this is more complicated than we want at this stage21:21
clarkbif we just call it multinode or 2node etc we haven't baked in any expectations that may change21:21
sdaguewe want 2 kinds of setup21:21
sdagueregular, and compute only21:21
afazekasregular=aio21:22
afazekascpu = compute only  (n-cpu,q-agt, celio agent)21:22
*** markwash has quit IRC21:22
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for keystone-specs  https://review.openstack.org/10610021:23
*** tsg has quit IRC21:23
*** SumitNaiksatam has quit IRC21:24
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Added new javascript build targets  https://review.openstack.org/10617221:24
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Relax H305 and H307 checks  https://review.openstack.org/10617021:25
openstackgerritBen Nemec proposed a change to openstack-dev/hacking: Fix import check interaction with namespace modules  https://review.openstack.org/10616921:25
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for keystone-specs  https://review.openstack.org/10610021:25
*** dkliban is now known as dkliban_afk21:25
*** zhiyan is now known as zhiyan_21:26
afazekas'2node'  name  itself does not describes the roles of the 2 node21:26
clarkbafazekas: right in this case I think it may be desired21:26
clarkbafazekas: because I don't think we know yet what the roles will be21:26
*** hasharAccounting is now known as hashar21:27
stevemarjeblair, mind taking a look @ https://review.openstack.org/#/c/106100/ for the spec publishing... i'd appreciate any input :)21:27
*** denis_makogon has quit IRC21:27
*** jcoufal has quit IRC21:27
*** jpich has quit IRC21:28
clarkbryanpetrello: for those new jobs, are these not tests that should just run in the normal pecan test suite?21:28
sdagueclarkb / afazekas is there a sketch of the direction this is headed, I'm reading through the patch series now21:29
afazekas'aio plus cpu' says the primary node supposed to be regular/aio setup, the other node(s) supposed to be compute/hypervisor style node21:29
sdagueI was a little surprised we didn't just generate the sub_node localrc on the master21:29
clarkbsdague: well this change starts with adding a job21:30
clarkbsdague: then we will add the features to devstack-gate where most of the iteration will happen21:30
sdagueclarkb: yeh, I mean the devstack-gate patch series21:30
sdagueI'm actually fine with the job, I think the naming is a little confusing, but we can fix that later21:31
sdaguelet me go +1 that21:31
clarkbcool21:31
*** marcoemorais has quit IRC21:32
sdagueafazekas: it's not clear to me why - https://review.openstack.org/#/c/105150 is needed21:32
afazekassdague: I was also hesitant about what / whan and where to do..21:32
*** marcoemorais has joined #openstack-infra21:32
afazekassdague: If we lucky it works without that21:32
afazekasThe stack user runs the nova compute service21:32
sdagueso the way I kind of envisioned this....21:32
afazekasand he needs to ssh to the other nodes for migration21:33
*** marcoemorais has quit IRC21:33
sdagueafazekas: right, but it doesn't matter, they don't talk nfs or something else that requires uid match21:33
*** marcoemorais has joined #openstack-infra21:33
ryanpetrelloclark: they’re a bit more complicated than that21:33
sdagueso the way I envisioned this....21:33
afazekassdague: I can remove that patch from the chain21:33
ryanpetrellothey actually rely on tox itself to create virtualenvs, like you would with your own sample project: https://github.com/stackforge/pecan/blob/master/tox.ini#L1721:33
sdaguesetup_localrc takes a 3rd arg21:33
clarkbryanpetrello: oh its using that nested stuff21:34
clarkbryanpetrello: gotcha21:34
sdaguetakes a 3rd and 4th arg21:34
*** marcoemorais has quit IRC21:34
sdaguewhich is a type, which gets passed to the feature-matrix21:34
sdagueand a file to write out to21:34
*** marcoemorais has joined #openstack-infra21:34
sdagueso then if you are in multi node topology, you call that for compute localrc.compute21:35
*** mrda-away is now known as mrda21:35
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: Git rev-list --max-count needs an = for assignment  https://review.openstack.org/10617421:35
*** jamielennox|away is now known as jamielennox21:36
sdagueafazekas: also why do you think supporting n-net is challenging?21:37
afazekassdague: Which network-type do you think is usable with n-net ?21:38
sdaguewhatever's default in devstack, I think dhcp flat21:38
afazekasthe matadata-api service and the dhcp both can be problematic21:39
afazekasis all test vm on the same net ?21:39
afazekasIsn't the host system also has these services ?21:39
sdagueafazekas: yeh, but nova multihost puts a dnsmasq with every n-net21:40
sdaguednsmasq isn't on the main network21:40
sdagueit's just handing out to local computes21:40
sdagueand then rpc messages are going back and forth to keep the 2 in sync21:40
*** ociuhandu has quit IRC21:40
morganfainbergsdague, dtroyer, clarkb, mordred, ping https://review.openstack.org/#/c/100747/ this will enable gating on Apache + mod_wsgi by default21:40
*** dims_ has joined #openstack-infra21:41
sdaguemorganfainberg: +221:41
morganfainbergsdague :)21:41
clarkbmorganfainberg: is that new var set in stackrc or something?21:42
clarkbmorganfainberg: I am not sure familiar with devstacks many vars21:42
dtroyeryeah, just before sdague gets on a plane we change a default ;)21:42
morganfainbergclarkb, yes.21:42
sdaguedtroyer: it makes it more exciting :)21:42
clarkbdtroyer: nothing could go wrong21:42
fungijust before most of us get on planes, in fact21:42
fungigreat time to break stuff21:42
afazekassdague: So you do not see any potential issue with a flat/ multi-host n-net systems on the same net ?21:42
morganfainbergclarkb, we added that field / var a bit ago (changing how we deploy mod_wsgi + apache)21:42
dtroyerI wait until Sunday at least...21:42
morganfainbergdtroyer, lol21:43
*** msabramo1 has joined #openstack-infra21:43
sdagueafazekas: I don't think so. And I've actually run that 2nd level in vagrant21:43
sdaguethat's what my vagrant-devstack was actually all about initially21:43
dtroyerthar she goes...21:43
*** dims has quit IRC21:43
morganfainbergsdague, and clarkb, this enables us to disable apache2 for one of the tests in config (for full matrix tests). https://review.openstack.org/#/c/105308/21:44
*** msabramo has quit IRC21:44
morganfainbergi'll roll up the config change once we land that so one of the ds-g tempest runs will run keystone under eventlet instead of apache only (we haven't removed eventlet support)21:45
openstackgerritA change was merged to openstack-infra/config: Gate against pecan template scaffolding tests.  https://review.openstack.org/10519321:45
morganfainbergthanks guys :)21:46
*** marcoemorais has quit IRC21:47
asselinclarkb, would you mind reviewing this patch: should be quick and easy: https://review.openstack.org/#/c/105623/121:49
*** david-lyle has quit IRC21:49
sdaguewas chatting with jamielennox, has the zuul losing jobs thing been sorted - https://review.openstack.org/#/c/104067/ ?21:51
*** dustins has quit IRC21:52
sdaguefungi: or might that have been the failed promote?21:52
jamielennoxif i've got for example https://review.openstack.org/#/c/100733/ and https://review.openstack.org/#/c/104067/ that are marked as out for review, but aren't on status.openstack.org/zuul does that make them lost?21:52
jamielennox(there's at least one other as well21:52
*** gondoi is now known as zz_gondoi21:52
afazekassdague: is the n-api-meta sets up the metadata service redirection itself ?21:53
clarkbasselin: I take it the default doesn't work for some reason?21:53
fungisdague: jamielennox: hasn't been sorted. there's the issue https://review.openstack.org/104963 tries to solve (patch dequeued on parent failing to merge but gets no comment/-2 vote) and then there's the half a dozen changes which were in the gate with 105854 when i tried to promote it21:54
asselinyes, e.g. if there's a port21:54
asselinclarkb, yes, e.g. if there's a por21:54
fungisdague: jamielennox: which https://review.openstack.org/106161 should fix21:54
*** marcoemorais has joined #openstack-infra21:54
*** dizquierdo has joined #openstack-infra21:54
openstackgerritDavid Lenwell proposed a change to openstack-infra/config: new project called refstack-client  https://review.openstack.org/10618121:54
*** shayneburgess has quit IRC21:55
*** marcoemorais has quit IRC21:55
jamielennoxfungi: ok if i recheck will it kick it off again?21:55
*** marcoemorais1 has joined #openstack-infra21:55
fungijamielennox: yep21:55
*** annegent_ has joined #openstack-infra21:55
jamielennoxis there a bug # (not mentioned on those reviews)21:55
*** gpilz1 has quit IRC21:56
fungii would just use recheck no bug in this case, since you're rechecking due to a lack of feedback rather than due to a negative vote21:56
clarkbfungi: jeblair I am going to approve that zuul change now21:56
clarkbworking on the changes behind21:56
jamielennoxfungi: will do, thanks21:56
*** Evgeny has joined #openstack-infra21:56
clarkbfungi: jeblair: any other urgent changes I should look at that came up in the morning?21:59
*** gpilz has joined #openstack-infra22:00
openstackgerritA change was merged to openstack-infra/zuul: Cause the promote command to ignore pipeline reqs  https://review.openstack.org/10616122:00
*** gpilz has left #openstack-infra22:00
*** EntropyWorks has joined #openstack-infra22:01
*** eharney has joined #openstack-infra22:01
*** tsg has joined #openstack-infra22:02
*** amalagon has quit IRC22:02
openstackgerritA change was merged to openstack-infra/config: Add the ability to set zuul's gerrit baseurl  https://review.openstack.org/10562322:03
asselinclarkb, thanks!22:03
openstackgerritA change was merged to openstack-infra/zuul: Cause the enqueue command to ignore pipeline reqs  https://review.openstack.org/10616222:03
*** marcoemorais1 has quit IRC22:04
*** blamar has joined #openstack-infra22:04
sdagueafazekas: so, honestly, in first attempt we should ignore n-api-meta22:04
fungiclarkb: none i'm aware of22:04
*** marcoemorais has joined #openstack-infra22:04
sdaguen-net, config drive22:04
sdagueget those issued shooken out22:04
clarkbcool22:04
clarkbsdague: since there is nothing pressing should I approve your loganalyze stack?22:04
sdagueclarkb: sure22:04
sdagueI'll be around to hot fix if anything goes wrong22:05
clarkbstack is approved22:05
*** dizquierdo has quit IRC22:06
openstackgerritDavid Lenwell proposed a change to openstack-infra/config: new project called refstack-client  https://review.openstack.org/10618122:07
sdagueclarkb: thanks22:07
davidlenwellDoes anyone have a minute to tell me if I missed anything on the review above ^^22:08
davidlenwellhttps://review.openstack.org/#/c/106181/22:08
openstackgerritA change was merged to openstack-infra/os-loganalyze: move filtering mechanism to separate class  https://review.openstack.org/10294122:09
openstackgerritSteve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for keystone-specs  https://review.openstack.org/10610022:09
openstackgerritA change was merged to openstack-infra/os-loganalyze: introduce limit parameter  https://review.openstack.org/10294722:09
clarkbdavidlenwell: lgtm22:09
davidlenwellthanks clarkb22:09
davidlenwellis tomorrow new project friday or did you guys drop that?22:09
*** juzuluag has joined #openstack-infra22:10
openstackgerritA change was merged to openstack-infra/os-loganalyze: use wsgi environ  https://review.openstack.org/10552722:10
clarkbdavidlenwell: we stopped doing that because the tooling is reliable again22:10
davidlenwelloh yay22:11
davidlenwellso it will merge when it merges then22:11
clarkbyup22:11
davidlenwellDo you think by early next week is a safe bet?22:11
openstackgerritA change was merged to openstack-infra/os-loganalyze: allow for live stripping of control chars  https://review.openstack.org/10552822:11
clarkbmaybe? I mean we are all hopping on planes here shortly and spening a week in darmstadt22:11
clarkbso my guess is things will lag a bit22:12
*** kmartin has quit IRC22:12
davidlenwellwell being that I'll be there with you guys ;)22:12
openstackgerritA change was merged to openstack-infra/os-loganalyze: Move all presentation layer to view module  https://review.openstack.org/10591522:12
*** marcoemorais has quit IRC22:12
mattoliverauMorning22:13
*** kmartin has joined #openstack-infra22:14
*** dangers is now known as dangers_away22:14
*** marcoemorais has joined #openstack-infra22:15
*** msuriar_ is now known as msuriar22:15
*** atiwari has joined #openstack-infra22:16
*** signed8bit has quit IRC22:16
*** marcoemorais has quit IRC22:17
*** marcoemorais has joined #openstack-infra22:18
*** annegent_ has quit IRC22:18
sdagueclarkb: all looks good so far22:18
clarkbsdague: cool, it may not have applied yet /me looks at puppetboard22:19
clarkbsdague: http://puppetboard.openstack.org/node/static.openstack.org22:19
sdagueclarkb: ok22:19
clarkbsdague: going back to logstash, you will note we caught up after all the logstash daemons were restarted22:20
clarkbbut then we regressed back to the low throughput state... so hopefully tomorrow I will sit down and spend some time with latest logstash and get it tested22:21
sdaguecool22:21
sdagueso by the time I get to germany, you'll have fixed it all? :D22:21
clarkbsdague: https://bugs.launchpad.net/openstack-ci/+bug/1340445 is that the pg bug that was just squashed22:21
uvirtbotLaunchpad bug 1340445 in openstack-ci "gate failing when "asynchronous connection failed" in nova log" [Undecided,New]22:21
clarkbsdague: boy I hope so. so sick of it being sad22:22
sdagueclarkb: yes22:22
clarkbsdague: so what bug should I mark it duplicate of?22:22
*** oomichi has joined #openstack-infra22:24
sdagueClabbe: Bug 1338841 - asynchronous connection failed in postgresql jobs22:24
uvirtbotLaunchpad bug 1338841 in devstack "asynchronous connection failed in postgresql jobs" [Undecided,Fix released] https://launchpad.net/bugs/133884122:24
clarkbthanks22:24
anteayamattoliverau: hello, can you review this patch please? https://review.openstack.org/#/c/105926/22:25
anteayamattoliverau: neutron needs this to unstick their functional tests22:25
mattoliverauanteaya: looking now :)22:26
anteayamattoliverau: thank you22:26
*** armax has quit IRC22:26
*** david-lyle has joined #openstack-infra22:26
*** jamespage_ has joined #openstack-infra22:26
*** hashar has quit IRC22:27
*** marcoemorais has quit IRC22:29
*** pdmars has quit IRC22:29
krotscheckAnyone know of an example where a tox.ini includes a reference to a path resolved from the current directory?22:29
anteayamattoliverau: thank you22:29
anteayamattoliverau: how soon until jhesketh?22:29
mattoliverauanteaya: He usually pops before 9, so hopefully be here in the next 15 minutes or so.22:31
anteayamattoliverau: awesome thank you22:31
anteayais it 8:30am for you?22:31
clarkbkrotscheck: look at pecan22:32
clarkbI think pecan does that22:32
*** krtaylor has quit IRC22:32
krotscheckclarkb: It does, thansk!22:32
*** Evgeny has quit IRC22:32
*** andreaf has quit IRC22:32
*** masayukig has quit IRC22:32
*** reed has quit IRC22:32
*** trinaths has quit IRC22:32
*** ZZelle_ has quit IRC22:32
*** jgrimm has quit IRC22:32
*** markmc has quit IRC22:32
*** yamahata has quit IRC22:32
*** chuckC has quit IRC22:32
*** skraynev has quit IRC22:32
*** shardy has quit IRC22:32
*** rwsu has quit IRC22:32
*** arun has quit IRC22:32
*** mmitchell_ has quit IRC22:32
*** froek has quit IRC22:32
*** psedlak has quit IRC22:32
*** kashyap has quit IRC22:32
*** bnemec has quit IRC22:32
*** joa has quit IRC22:32
*** vipul has quit IRC22:32
*** tteggel has quit IRC22:32
*** isviridov has quit IRC22:32
*** dstanek has quit IRC22:32
*** pleia2 has quit IRC22:32
*** therve has quit IRC22:32
*** hughsaunders has quit IRC22:32
*** SergeyLukjanov has quit IRC22:32
*** NikitaKonovalov has quit IRC22:32
*** dmitryme has quit IRC22:32
*** sbadia has quit IRC22:32
*** chianingwang has quit IRC22:32
*** jgriffith has quit IRC22:32
*** hogepodge has quit IRC22:32
*** garyk has quit IRC22:32
*** obondarev has quit IRC22:32
*** marun has quit IRC22:32
*** zigo has quit IRC22:32
*** blamar has quit IRC22:32
*** eharney has quit IRC22:32
*** thedodd has quit IRC22:32
*** gyee has quit IRC22:32
*** adrian_otto has quit IRC22:32
*** mattymo has quit IRC22:32
*** saper has quit IRC22:32
*** atiwari has quit IRC22:32
*** tsg has quit IRC22:32
*** dstufft|laptop has quit IRC22:32
*** asselin has quit IRC22:32
*** Mithrandir has quit IRC22:32
*** sweston has quit IRC22:32
*** mancdaz has quit IRC22:32
*** zz_johnthetubagu has quit IRC22:32
*** uvirtbot has quit IRC22:32
*** krotscheck has quit IRC22:32
*** jamespd has quit IRC22:32
*** davidlenwell has quit IRC22:32
*** _shaps_ has quit IRC22:32
*** rgerganov has quit IRC22:32
*** sandywalsh has quit IRC22:32
*** dims_ has quit IRC22:32
*** andreykurilin_ has quit IRC22:32
*** bdpayne has quit IRC22:32
*** sabeen has quit IRC22:32
*** anonitus has quit IRC22:32
*** asettle has quit IRC22:32
*** rakhmerov has quit IRC22:32
*** akuznetsova has quit IRC22:32
*** matrohon has quit IRC22:33
*** cody-somerville has quit IRC22:33
*** enikanorov__ has quit IRC22:33
*** dangers_away has quit IRC22:33
*** IAX has quit IRC22:33
*** hemna_ has quit IRC22:33
*** bcrochet has quit IRC22:33
*** timrc has quit IRC22:33
*** annegentle has quit IRC22:33
*** grantbow has quit IRC22:33
*** Sukhdev has quit IRC22:33
*** pcrews has quit IRC22:33
*** wenlock has quit IRC22:33
*** mriedem has quit IRC22:33
*** prad has quit IRC22:33
*** jd__ has quit IRC22:33
*** nibalizer has quit IRC22:33
*** beagles has quit IRC22:33
*** sdague has quit IRC22:33
*** SpamapS has quit IRC22:33
*** maurosr has quit IRC22:33
*** hdd has quit IRC22:33
*** chmouel has quit IRC22:33
*** dimtruck has quit IRC22:33
*** proffalken has quit IRC22:33
*** sc68cal has quit IRC22:33
*** clarkb has quit IRC22:33
*** devananda has quit IRC22:33
*** jeblair has quit IRC22:33
*** slagle has quit IRC22:33
*** SlickNik has quit IRC22:33
*** Kiall has quit IRC22:33
*** jcooley has quit IRC22:33
*** portante has quit IRC22:33
*** briancline has quit IRC22:33
*** tnurlygayanov has quit IRC22:33
*** rkukura has quit IRC22:33
*** nati_ueno has quit IRC22:33
*** Alexei_987 has quit IRC22:33
*** torandu has quit IRC22:33
*** zzelle__ has quit IRC22:33
*** gangil has quit IRC22:33
*** katyafervent has quit IRC22:33
*** nelsnelson has quit IRC22:33
*** doug-fish has quit IRC22:33
*** gaelL has quit IRC22:33
*** anteaya has quit IRC22:33
*** jogo has quit IRC22:33
*** zul has quit IRC22:33
*** spiffxp_ has quit IRC22:33
*** yamahata__ has quit IRC22:33
*** nithyag__ has quit IRC22:33
*** kmartin has quit IRC22:33
*** arnaud has quit IRC22:33
*** miqui has quit IRC22:33
*** oanufriev has quit IRC22:33
*** dkehn has quit IRC22:33
*** changbl has quit IRC22:33
*** Shrews has quit IRC22:33
*** jamielennox has quit IRC22:33
*** Ng has quit IRC22:33
*** Hefeweizen has quit IRC22:33
*** msuriar has quit IRC22:33
*** jraim has quit IRC22:33
*** vponomaryov has quit IRC22:33
*** bradm has quit IRC22:33
*** thingee has quit IRC22:33
*** BobBall has quit IRC22:33
*** gothicmindfood has quit IRC22:33
*** cindyo has quit IRC22:33
*** zhiyan_ has quit IRC22:33
*** ciypro|afk has quit IRC22:33
*** salv-orlando has quit IRC22:33
*** otherwiseguy has quit IRC22:33
*** rcarrillocruz has quit IRC22:33
*** harlowja has quit IRC22:33
*** openstackgerrit has quit IRC22:33
*** tcammann has quit IRC22:33
*** homeless has quit IRC22:33
*** jp_at_hp has quit IRC22:33
*** mtreinish has quit IRC22:33
*** gargola has quit IRC22:33
*** mdenny has quit IRC22:33
*** vladan has quit IRC22:33
*** gema has quit IRC22:33
*** gilliard_ has quit IRC22:33
*** plars has quit IRC22:33
*** kevinbenton has quit IRC22:33
*** mugsie has quit IRC22:33
*** dkliban_afk has quit IRC22:33
*** spiffxp has quit IRC22:33
*** mfisch has quit IRC22:33
*** jhesketh has quit IRC22:33
*** Vek has quit IRC22:33
*** ekarlso has quit IRC22:33
*** charz has quit IRC22:33
*** gmurphy has quit IRC22:33
*** s0nea has quit IRC22:33
*** morganfainberg has quit IRC22:33
*** paul-- has quit IRC22:33
*** boris-42 has quit IRC22:33
*** david-lyle has quit IRC22:33
*** oomichi has quit IRC22:33
*** yfried__ has quit IRC22:33
*** shashankhegde has quit IRC22:33
*** markmcclain has quit IRC22:33
*** sweston_ has quit IRC22:33
*** carl_baldwin has quit IRC22:33
*** x1b2j has quit IRC22:33
*** loquacities has quit IRC22:33
*** dtroyer has quit IRC22:33
*** antonym has quit IRC22:33
*** pabelanger has quit IRC22:33
*** dougwig has quit IRC22:33
*** Alex_Gaynor has quit IRC22:33
*** serverascode has quit IRC22:33
*** wendar has quit IRC22:33
*** nikhil___ has quit IRC22:33
*** jroll has quit IRC22:33
*** pfallenop has quit IRC22:33
*** gnuoy has quit IRC22:33
*** mrda has quit IRC22:33
*** sileht has quit IRC22:33
*** AaronGr has quit IRC22:33
*** Daviey has quit IRC22:33
*** EntropyWorks has quit IRC22:33
*** vishy has quit IRC22:33
*** d34dh0r53 has quit IRC22:33
*** esmute has quit IRC22:33
*** ptoohill has quit IRC22:33
*** Hunner has quit IRC22:33
*** mrodden has quit IRC22:33
*** bodepd has quit IRC22:33
*** d0ugal has quit IRC22:33
*** phschwartz has quit IRC22:33
*** timfreund has quit IRC22:33
*** dhellmann has quit IRC22:33
*** lyxus has quit IRC22:33
*** dosaboy has quit IRC22:33
*** med_ has quit IRC22:33
*** JoshNang has quit IRC22:33
*** Guest56682 has quit IRC22:33
*** mnaser has quit IRC22:33
*** sulochan_ has quit IRC22:33
*** juzuluag has quit IRC22:33
*** praneshp has quit IRC22:33
*** elambert has quit IRC22:33
*** Ryan_Lane has quit IRC22:33
*** penguinRaider has quit IRC22:33
*** rfolco has quit IRC22:33
*** YorikSar has quit IRC22:33
*** mkerrin has quit IRC22:33
*** greghaynes has quit IRC22:33
*** NobodyCam has quit IRC22:33
*** GheRivero has quit IRC22:33
*** eglynn-office has quit IRC22:33
*** rickerc has quit IRC22:33
*** cdub has quit IRC22:33
*** fifieldt has quit IRC22:33
*** msabramo1 has quit IRC22:33
*** pcm_ has quit IRC22:33
*** primeministerp has quit IRC22:33
*** ildikov has quit IRC22:33
*** stevemar has quit IRC22:33
*** HenryG has quit IRC22:33
*** mestery has quit IRC22:33
*** flaviof_zzz has quit IRC22:33
*** jpeeler has quit IRC22:33
*** roaet_ has quit IRC22:33
*** mgagne has quit IRC22:33
*** Adri2000 has quit IRC22:33
*** BadCub_ has quit IRC22:33
*** zz_gondoi has quit IRC22:33
*** tristanC has quit IRC22:33
*** fungi has quit IRC22:33
*** jbryce has quit IRC22:33
*** dencaval has quit IRC22:33
*** enikanorov_ has quit IRC22:33
*** michchap has quit IRC22:33
*** fabo has quit IRC22:33
*** dtantsur has quit IRC22:33
*** afazekas has quit IRC22:33
*** zaro has quit IRC22:33
*** mika has quit IRC22:33
*** radez_g0n3 has quit IRC22:33
*** ttx has quit IRC22:33
*** StevenK has quit IRC22:33
*** simonmcc has quit IRC22:33
*** comstud has quit IRC22:33
*** alaski has quit IRC22:33
*** emagana has quit IRC22:33
*** melwitt has quit IRC22:33
*** cyeoh has quit IRC22:33
*** russellb has quit IRC22:33
*** cyli has quit IRC22:33
*** dolphm has quit IRC22:33
*** stevebaker has quit IRC22:33
*** adam_g has quit IRC22:33
*** plomakin_ has quit IRC22:33
*** dguerri has quit IRC22:33
*** notmyname has quit IRC22:33
*** flaper87|afk has quit IRC22:33
*** soren has quit IRC22:33
*** rossella_s has quit IRC22:33
*** ChanServ has quit IRC22:33
*** Clabbe has quit IRC22:33
*** mikal has quit IRC22:33
*** ruhe has quit IRC22:33
*** gpocentek has quit IRC22:33
*** tchaypo has quit IRC22:33
*** jamespage_ has quit IRC22:33
*** vipul has joined #openstack-infra22:36
*** isviridov has joined #openstack-infra22:36
*** bnemec has joined #openstack-infra22:36
*** tteggel has joined #openstack-infra22:36
*** kashyap has joined #openstack-infra22:36
*** SergeyLukjanov has joined #openstack-infra22:36
*** mmitchell_ has joined #openstack-infra22:36
*** masayukig has joined #openstack-infra22:36
*** Evgeny has joined #openstack-infra22:36
*** arun has joined #openstack-infra22:36
*** andreaf has joined #openstack-infra22:36
*** yamahata has joined #openstack-infra22:36
*** rwsu has joined #openstack-infra22:36
*** dmitryme has joined #openstack-infra22:36
*** NikitaKonovalov has joined #openstack-infra22:36
*** markmc has joined #openstack-infra22:36
*** jgrimm has joined #openstack-infra22:36
*** ZZelle_ has joined #openstack-infra22:36
*** chuckC has joined #openstack-infra22:36
*** sbadia has joined #openstack-infra22:36
*** joa has joined #openstack-infra22:36
*** psedlak has joined #openstack-infra22:36
*** froek has joined #openstack-infra22:36
*** skraynev has joined #openstack-infra22:36
*** therve has joined #openstack-infra22:36
*** doddstack has joined #openstack-infra22:36
*** david-lyle has joined #openstack-infra22:36
*** oomichi has joined #openstack-infra22:36
*** atiwari has joined #openstack-infra22:36
*** kmartin has joined #openstack-infra22:36
*** juzuluag has joined #openstack-infra22:36
*** blamar has joined #openstack-infra22:36
*** tsg has joined #openstack-infra22:36
*** eharney has joined #openstack-infra22:36
*** EntropyWorks has joined #openstack-infra22:36
*** msabramo1 has joined #openstack-infra22:36
*** dims_ has joined #openstack-infra22:36
*** rkukura has joined #openstack-infra22:36
*** Sukhdev has joined #openstack-infra22:36
*** salv-orlando has joined #openstack-infra22:36
*** pcm_ has joined #openstack-infra22:36
*** dstufft|laptop has joined #openstack-infra22:36
*** emagana has joined #openstack-infra22:36
*** arnaud has joined #openstack-infra22:36
*** yfried__ has joined #openstack-infra22:36
*** shashankhegde has joined #openstack-infra22:36
*** pcrews has joined #openstack-infra22:36
*** otherwiseguy has joined #openstack-infra22:36
*** andreykurilin_ has joined #openstack-infra22:36
*** primeministerp has joined #openstack-infra22:36
*** bdpayne has joined #openstack-infra22:36
*** melwitt has joined #openstack-infra22:36
*** sabeen has joined #openstack-infra22:36
*** nati_ueno has joined #openstack-infra22:36
*** Alexei_987 has joined #openstack-infra22:36
*** rcarrillocruz has joined #openstack-infra22:36
*** gyee has joined #openstack-infra22:36
*** markmcclain has joined #openstack-infra22:36
*** adrian_otto has joined #openstack-infra22:36
*** harlowja has joined #openstack-infra22:36
*** praneshp has joined #openstack-infra22:36
*** elambert has joined #openstack-infra22:36
*** Ryan_Lane has joined #openstack-infra22:36
*** stevemar has joined #openstack-infra22:36
*** sweston_ has joined #openstack-infra22:36
*** jgriffith has joined #openstack-infra22:36
*** anonitus has joined #openstack-infra22:36
*** hogepodge has joined #openstack-infra22:36
*** asettle has joined #openstack-infra22:36
*** wenlock has joined #openstack-infra22:36
*** asselin has joined #openstack-infra22:36
*** beagles has joined #openstack-infra22:36
*** torandu has joined #openstack-infra22:36
*** openstackgerrit has joined #openstack-infra22:36
*** carl_baldwin has joined #openstack-infra22:36
*** zzelle__ has joined #openstack-infra22:36
*** gangil has joined #openstack-infra22:36
*** garyk has joined #openstack-infra22:36
*** obondarev has joined #openstack-infra22:36
*** mattymo has joined #openstack-infra22:36
*** mriedem has joined #openstack-infra22:36
*** katyafervent has joined #openstack-infra22:36
*** marun has joined #openstack-infra22:36
*** rakhmerov has joined #openstack-infra22:36
*** akuznetsova has joined #openstack-infra22:36
*** tcammann has joined #openstack-infra22:36
*** nelsnelson has joined #openstack-infra22:36
*** ildikov has joined #openstack-infra22:36
*** prad has joined #openstack-infra22:36
*** homeless has joined #openstack-infra22:36
*** HenryG has joined #openstack-infra22:36
*** mestery has joined #openstack-infra22:36
*** penguinRaider has joined #openstack-infra22:36
*** rfolco has joined #openstack-infra22:36
*** doug-fish has joined #openstack-infra22:36
*** x1b2j has joined #openstack-infra22:36
*** saper has joined #openstack-infra22:36
*** gaelL has joined #openstack-infra22:36
*** jd__ has joined #openstack-infra22:36
*** flaviof_zzz has joined #openstack-infra22:36
*** matrohon has joined #openstack-infra22:36
*** cyeoh has joined #openstack-infra22:36
*** nibalizer has joined #openstack-infra22:36
*** zigo has joined #openstack-infra22:36
*** YorikSar has joined #openstack-infra22:36
*** Mithrandir has joined #openstack-infra22:36
*** mkerrin has joined #openstack-infra22:36
*** jp_at_hp has joined #openstack-infra22:36
*** sweston has joined #openstack-infra22:36
*** jpeeler has joined #openstack-infra22:36
*** cody-somerville has joined #openstack-infra22:36
*** mtreinish has joined #openstack-infra22:36
*** mancdaz has joined #openstack-infra22:36
*** zz_johnthetubagu has joined #openstack-infra22:36
*** loquacities has joined #openstack-infra22:36
*** oanufriev has joined #openstack-infra22:36
*** boris-42 has joined #openstack-infra22:36
*** miqui has joined #openstack-infra22:36
*** enikanorov__ has joined #openstack-infra22:36
*** gargola has joined #openstack-infra22:36
*** mdenny has joined #openstack-infra22:36
*** greghaynes has joined #openstack-infra22:36
*** vladan has joined #openstack-infra22:36
*** dkehn has joined #openstack-infra22:36
*** NobodyCam has joined #openstack-infra22:36
*** uvirtbot has joined #openstack-infra22:36
*** anteaya has joined #openstack-infra22:36
*** sdague has joined #openstack-infra22:36
*** gema has joined #openstack-infra22:36
*** jogo has joined #openstack-infra22:36
*** krotscheck has joined #openstack-infra22:36
*** SpamapS has joined #openstack-infra22:36
*** gilliard_ has joined #openstack-infra22:36
*** jamespd has joined #openstack-infra22:36
*** GheRivero has joined #openstack-infra22:36
*** davidlenwell has joined #openstack-infra22:36
*** eglynn-office has joined #openstack-infra22:36
*** rickerc has joined #openstack-infra22:36
*** zul has joined #openstack-infra22:36
*** changbl has joined #openstack-infra22:36
*** Shrews has joined #openstack-infra22:36
*** _shaps_ has joined #openstack-infra22:36
*** rgerganov has joined #openstack-infra22:36
*** plars has joined #openstack-infra22:36
*** cdub has joined #openstack-infra22:36
*** fifieldt has joined #openstack-infra22:36
*** jamielennox has joined #openstack-infra22:36
*** kevinbenton has joined #openstack-infra22:36
*** spiffxp_ has joined #openstack-infra22:36
*** mugsie has joined #openstack-infra22:36
*** BobBall has joined #openstack-infra22:36
*** Ng has joined #openstack-infra22:36
*** charz has joined #openstack-infra22:36
*** maurosr has joined #openstack-infra22:36
*** dencaval has joined #openstack-infra22:36
*** Hefeweizen has joined #openstack-infra22:36
*** yamahata__ has joined #openstack-infra22:36
*** sandywalsh has joined #openstack-infra22:36
*** nithyag__ has joined #openstack-infra22:36
*** dangers_away has joined #openstack-infra22:36
*** IAX has joined #openstack-infra22:36
*** hemna_ has joined #openstack-infra22:36
*** dtroyer has joined #openstack-infra22:36
*** bcrochet has joined #openstack-infra22:36
*** dkliban_afk has joined #openstack-infra22:36
*** spiffxp has joined #openstack-infra22:36
*** mfisch has joined #openstack-infra22:36
*** zz_gondoi has joined #openstack-infra22:36
*** antonym has joined #openstack-infra22:36
*** pabelanger has joined #openstack-infra22:36
*** roaet_ has joined #openstack-infra22:36
*** Alex_Gaynor has joined #openstack-infra22:36
*** mgagne has joined #openstack-infra22:36
*** dougwig has joined #openstack-infra22:36
*** serverascode has joined #openstack-infra22:36
*** Adri2000 has joined #openstack-infra22:36
*** BadCub_ has joined #openstack-infra22:36
*** tristanC has joined #openstack-infra22:36
*** msuriar has joined #openstack-infra22:36
*** jraim has joined #openstack-infra22:36
*** jbryce has joined #openstack-infra22:36
*** fungi has joined #openstack-infra22:36
*** russellb has joined #openstack-infra22:36
*** nikhil___ has joined #openstack-infra22:36
*** wendar has joined #openstack-infra22:36
*** timrc has joined #openstack-infra22:36
*** vponomaryov has joined #openstack-infra22:36
*** jhesketh has joined #openstack-infra22:36
*** Vek has joined #openstack-infra22:36
*** annegentle has joined #openstack-infra22:36
*** grantbow has joined #openstack-infra22:36
*** ekarlso has joined #openstack-infra22:36
*** bradm has joined #openstack-infra22:36
*** enikanorov_ has joined #openstack-infra22:36
*** jroll has joined #openstack-infra22:36
*** thingee has joined #openstack-infra22:36
*** pfallenop has joined #openstack-infra22:36
*** gmurphy has joined #openstack-infra22:36
*** michchap has joined #openstack-infra22:36
*** s0nea has joined #openstack-infra22:36
*** fabo has joined #openstack-infra22:36
*** dtantsur has joined #openstack-infra22:36
*** gnuoy has joined #openstack-infra22:36
*** d34dh0r53 has joined #openstack-infra22:36
*** paul-- has joined #openstack-infra22:36
*** afazekas has joined #openstack-infra22:36
*** gothicmindfood has joined #openstack-infra22:36
*** zhiyan_ has joined #openstack-infra22:36
*** cindyo has joined #openstack-infra22:36
*** ciypro|afk has joined #openstack-infra22:36
*** briancline has joined #openstack-infra22:36
*** portante has joined #openstack-infra22:36
*** jcooley has joined #openstack-infra22:36
*** Kiall has joined #openstack-infra22:36
*** SlickNik has joined #openstack-infra22:36
*** slagle has joined #openstack-infra22:36
*** jeblair has joined #openstack-infra22:36
*** devananda has joined #openstack-infra22:36
*** clarkb has joined #openstack-infra22:36
*** sc68cal has joined #openstack-infra22:36
*** proffalken has joined #openstack-infra22:36
*** zz_dimtruck has joined #openstack-infra22:36
*** chmouel has joined #openstack-infra22:36
*** hdd has joined #openstack-infra22:36
*** tnurlygayanov has joined #openstack-infra22:36
*** mrda has joined #openstack-infra22:36
*** sileht has joined #openstack-infra22:36
*** AaronGr has joined #openstack-infra22:36
*** Daviey has joined #openstack-infra22:36
*** zaro has joined #openstack-infra22:36
*** mika has joined #openstack-infra22:36
*** radez_g0n3 has joined #openstack-infra22:36
*** ttx has joined #openstack-infra22:36
*** vishy has joined #openstack-infra22:36
*** StevenK has joined #openstack-infra22:36
*** simonmcc has joined #openstack-infra22:36
*** cyli has joined #openstack-infra22:36
*** dolphm has joined #openstack-infra22:36
*** comstud has joined #openstack-infra22:36
*** stevebaker has joined #openstack-infra22:36
*** adam_g has joined #openstack-infra22:36
*** plomakin_ has joined #openstack-infra22:36
*** dguerri has joined #openstack-infra22:36
*** alaski has joined #openstack-infra22:36
*** notmyname has joined #openstack-infra22:36
*** flaper87|afk has joined #openstack-infra22:36
*** soren has joined #openstack-infra22:36
*** morganfainberg has joined #openstack-infra22:36
*** esmute has joined #openstack-infra22:36
*** ptoohill has joined #openstack-infra22:36
*** Hunner has joined #openstack-infra22:36
*** mrodden has joined #openstack-infra22:36
*** bodepd has joined #openstack-infra22:36
*** d0ugal has joined #openstack-infra22:36
*** JoshNang has joined #openstack-infra22:36
*** phschwartz has joined #openstack-infra22:36
*** timfreund has joined #openstack-infra22:36
*** dhellmann has joined #openstack-infra22:36
*** lyxus has joined #openstack-infra22:36
*** dosaboy has joined #openstack-infra22:36
*** med_ has joined #openstack-infra22:36
*** mnaser has joined #openstack-infra22:36
*** Guest56682 has joined #openstack-infra22:36
*** sulochan_ has joined #openstack-infra22:36
*** rossella_s has joined #openstack-infra22:36
*** ChanServ has joined #openstack-infra22:36
*** dickson.freenode.net sets mode: +o ChanServ22:36
*** niska has quit IRC22:36
*** prad has quit IRC22:36
*** Clabbe has joined #openstack-infra22:36
*** mikal has joined #openstack-infra22:36
*** ruhe has joined #openstack-infra22:36
*** gpocentek has joined #openstack-infra22:36
*** tchaypo has joined #openstack-infra22:36
*** juzuluag has quit IRC22:36
nikhil___anteaya: hope you'r still there :)22:36
*** hughsaunders has joined #openstack-infra22:37
anteayanikhil___: I am in the same space as you22:37
*** morgabra has quit IRC22:37
*** morgabra has joined #openstack-infra22:37
*** niska has joined #openstack-infra22:37
anteayanikhil___: check-tempest-dsvm-full?22:37
anteayanikhil___: that job?22:37
nikhil___anteaya: basically, am hoping to add/modify a test in tempest which is going to use a CONF value to determing where to pick image data bits from the node22:37
anteayaokay22:37
anteayado you know which test?22:37
mattoliverauanteaya: yeah 8:30.. yay netsplit22:37
nikhil___anteaya: ah, am not sure which job though22:37
nikhil___anteaya: 1 sec22:37
anteayamattoliverau: glad you are back22:37
*** andreykurilin_ has quit IRC22:38
anteayawell back being where I happen to be22:38
*** grantbow has quit IRC22:38
*** pleia2 has joined #openstack-infra22:38
anteayayay pleia2 is back22:38
clarkbyes it would be that job22:38
*** trinaths has joined #openstack-infra22:38
*** grantbow has joined #openstack-infra22:38
pleia2ah freenode :)22:38
*** reed has joined #openstack-infra22:39
clarkbthe infra jobs run defaults as much as possible22:39
anteayaclarkb: thanks22:39
clarkbI dont think we do anything special with images22:39
anteayapleia2: care to review https://review.openstack.org/#/c/105926/ ?22:39
*** bknudson has joined #openstack-infra22:39
anteayapleia2: I'm in the neutron sprint and they would like it in22:39
* pleia2 has a look22:39
anteayashopping for reviews22:39
anteayathanks22:39
anteayawaiting for jhesketh and his mighty +A22:40
anteayaclarkb has already +2's and I don't see other cores about22:40
nikhil___anteaya: clarkb : this is the specific set of tests http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/image/v2/test_images.py22:41
nikhil___clarkb: ah ok, so if I need to add a config value to the tempest tests to get the image data , how would that be possible?22:42
sdaguenikhil___: it's probably better to bring that to -qa22:42
pleia2anteaya: I think you need single quotes22:42
pleia2anteaya: see typing this in terminal: echo "Defaults:stack !requiretty"22:42
anteayak, I'll ask marun22:42
pleia2anteaya: vs this: echo 'Defaults:stack !requiretty'22:42
nikhil___sdague: gotcha, thanks22:43
anteayapleia2: marun tells me that he just copied what sdague told him to put22:45
sdagueanteaya: I'm allowed to be wrong some times :)22:45
anteayasdague: no22:45
anteayaI don't believe it22:45
anteayasdague: so double or single quotes?22:45
sdagueI think pleia2 is right22:45
anteayamarun is willing to respin22:45
anteayasdague: okay22:46
pleia2it's just that one line because ! is a special character in sh22:46
*** andreaf has quit IRC22:46
*** doug-fish has left #openstack-infra22:46
openstackgerritMaru Newby proposed a change to openstack-infra/config: Fix neutron func job sudo config.  https://review.openstack.org/10592622:48
mattoliveraupleia2: nice spot :)22:49
anteayapleia2: you are correct, I tried it in the terminal22:49
anteayapleia2: yay22:49
openstackgerritMichael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Removed nodeenv dependency  https://review.openstack.org/10619122:49
*** mmaglana has joined #openstack-infra22:49
pleia2glad I could help22:50
*** matrohon has quit IRC22:51
anteaya:D22:51
*** jerryz has joined #openstack-infra22:51
tchaypoI've only just realised that you guys don't seem to be coming to our mid-cycle #sadness22:52
anteayaclarkb: jenkins likes patchset 2 on marun's patch: https://review.openstack.org/#/c/105926/222:53
clarkbdidnt I +2 it?22:53
clarkboh new patchset22:53
anteayatchaypo: :(22:54
anteayasdague: can I get a +1 on marun's respin with single quotes? https://review.openstack.org/#/c/105926/2 jenkins has come back happy22:55
mikalHey, what's the release process for client libraries (novaclient in this case) these days?22:55
mikalI know that ttx has taken over tagging releases for the main project repos, as he done that for clients as well?22:55
morganfainbergdolphm, ^^22:56
*** marcoemorais has joined #openstack-infra22:56
dolphmmikal: release anytime, as necessary22:56
openstackgerritMichael Krotscheck proposed a change to openstack-infra/config: Updated storyboard build to use new test modules  https://review.openstack.org/10619322:56
dolphmmikal: use semver as appropriate22:56
sdagueanteaya: done22:56
mikaldolphm: semver?22:56
anteayasdague: thanks22:57
dolphmmikal: http://semver.org/22:57
*** marcoemorais has quit IRC22:57
*** marcoemorais has joined #openstack-infra22:57
pleia2tchaypo: tripleo? you guys are pretty solid with CI these days, don't need us! :)22:57
dolphmmikal: and to release: $ git tag -s %(milestone)s && git push gerrit %(milestone)s22:57
pleia2lots of infra experts on that team now22:58
tchaypopleia2: but we still like you!22:58
pleia2hehe22:58
tchaypoI was at the birthday party last night and ended up talking to someone who had lots of...22:58
tchaypolet's call them "questions" about the infra and if things could be tweaked22:58
tchaypobut had no idea how to find the people who ran it22:59
tchaypowhich blew my mind22:59
tchaypoI guess I've been lucky to be so close to the infra team right from the start22:59
*** dstufft|laptop has quit IRC22:59
*** david-lyle has quit IRC23:00
mordredtchaypo: hang on - you were talking about infra at a party?23:00
*** marcoemorais has quit IRC23:00
tchaypoopenstack birthday party23:01
pleia2some party23:01
pleia2;)23:01
*** marcoemorais has joined #openstack-infra23:01
*** pcm_ has quit IRC23:01
*** marcoemorais has quit IRC23:01
*** marcoemorais has joined #openstack-infra23:01
dolphmmikal: maybe useful- https://github.com/dolph/launchpad/blob/master/release_client.py23:02
clarkbtchaypo send them ourway23:02
morganfainbergannegentle, ping re: doc update (forgot to tag a change a docimpact) [sorry!!]23:02
clarkbalso ppint out its all in gerrit23:02
*** armax has joined #openstack-infra23:02
mikaldolphm: yeah, I can't find a client release doc on the wiki23:02
mikaldolphm: I am sure its there, but I can't find it23:02
morganfainbergannegentle, have an update to a Keystone API HTTP status return (due to breaking differences in apache vs eventlet deploymnet)23:03
*** dizquierdo has joined #openstack-infra23:03
morganfainbergannegentle, what do i need to provide to help you guys get the api-site updated.23:03
tchaypoI was planning to grill them this week than talk to you guys at the mid-cycle23:03
tchaypobut23:03
anteayamordred: hey can you review this? it would make marun happy: https://review.openstack.org/#/c/105926/23:04
jheskethMorning23:04
anteayamorning jhesketh23:04
anteayajhesketh: can you put this on your review list? https://review.openstack.org/#/c/105926/23:04
*** Sukhdev has quit IRC23:05
anteayawould be great if we go to dinner and neutron is impressed with the efficentcy of infra23:05
*** harlowja has quit IRC23:05
mikaldolphm: it looks like you run that script before you tag?23:05
*** harlowja has joined #openstack-infra23:05
dolphmmikal: yes23:06
jheskethanteaya: done23:06
anteayajhesketh: thank you23:06
anteayamordred or clarkb? https://review.openstack.org/#/c/105926/23:07
mikaldolphm: so, I run: "./release_client.py python-novaclient 2.18.0" and then follow the bouncing ball?23:07
zaroclarkb: take a look? https://review.openstack.org/#/c/106119/23:09
clarkbzaro: is that tested?23:09
*** bknudson has quit IRC23:09
*** armax has quit IRC23:10
*** armax has joined #openstack-infra23:10
openstackgerritDavanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Adding query for broken rax mirror  https://review.openstack.org/10619623:10
openstackgerritK Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file  https://review.openstack.org/10593023:10
clarkbsdague: http://logs.openstack.org/00/100000/2/check-tripleo/check-tripleo-overcloud-f20/5e2fb8b/console.html23:10
greghaynesclarkb: oh, hey23:11
clarkbsdague: that is 500ing for me. I am assuming that means os loganalyze broke23:11
greghaynesclarkb: my logs23:11
*** stevemar has quit IRC23:11
clarkbsdague: going to pull up server logs shortly23:11
zaroclarkb: i tested it23:11
zaroclarkb: works as expected.23:12
sdagueclarkb: yep23:12
*** carl_baldwin has quit IRC23:13
*** rkukura has quit IRC23:13
*** mestery has quit IRC23:13
dims_sdague, review to turn on elastic recheck for broken rax mirror - (https://review.openstack.org/106196) 120+ hits in last 12 hours23:13
clarkbsdague: http://paste.openstack.org/show/86016/23:14
*** HenryG has quit IRC23:14
sdagueclarkb: hmmmm...23:14
*** emagana has quit IRC23:14
*** emagana has joined #openstack-infra23:15
clarkbsdague: its using text view23:15
sdagueclarkb: yeh, that's weird23:15
sdaguealso, I don't know how that could not contain that item23:16
clarkbsdague: oh that may be the logstash workers grabbing data23:16
clarkbsdague: and different error for other 500s23:17
*** obondarev has quit IRC23:17
sdagueok, so I still don't know how that could be doing that23:17
clarkbexcept text view is what logstash workers want23:17
*** obondarev has joined #openstack-infra23:17
clarkbsdague: because the headers from urllib2 are basically nil23:17
clarkbbut I think we want text view when doing that23:17
sdagueright, but text view is fine23:17
* clarkb greps for specific IPs now23:17
sdagueno, I'm more concerned about how line.date doesn't exist :)23:18
clarkboh23:18
sdaguecan you look at the on disk code23:18
*** mdenny has quit IRC23:18
sdagueand make sure it CDed in to latest23:18
clarkbsure23:19
clarkb6c2c356a30dee34959ae050ec5af7c89e9c3391d is the commit in git there. Move all presentation layer to view module23:19
clarkbnow to check pip23:19
*** emagana has quit IRC23:19
clarkbos-loganalyze==96cdbbb so maybe not wtf23:20
clarkbhrm thats old23:20
clarkbso maybe there is mixing happening /me does surgery23:20
*** otherwiseguy has quit IRC23:20
*** marun has quit IRC23:20
clarkbhttp://paste.openstack.org/show/86017/ is my client error23:21
*** mfink has joined #openstack-infra23:21
*** obondarev has quit IRC23:22
*** morganfainberg is now known as morganfainberg_Z23:22
*** eharney has quit IRC23:22
*** armax has quit IRC23:22
clarkbok surgery complete23:22
clarkbgreghaynes: should work now23:23
clarkbsdague: I completely uninstalled os_loganalyze, reinstalled, then restarted apache23:23
*** ArxCruz has joined #openstack-infra23:23
*** markmcclain has quit IRC23:23
mikalHuh23:23
*** emagana has joined #openstack-infra23:24
mikaldolphm: python-novaclient has no milestones23:24
mikaldolphm: this is apparently a thing keystone does differently23:24
sdagueclarkb: so it seems good now, right?23:24
mordredmikal: milestones are for crazy people23:24
sdagueclarkb: so before this whole stack, we were self contained23:24
mikalmordred: please explain?23:24
*** pcm_ has joined #openstack-infra23:24
greghaynesclarkb: success!23:24
sdaguenow pip install is going to be important23:24
clarkbsdague: ya I think we are good23:24
mordredmikal: I'm just talking. ignore me23:24
sdagueclarkb: ok, great23:25
mikalmordred: so, what I was trying to do was ensure the "launchpad bits" happened for a python-novaclient release. Is that now magically done by me applying the tag, or should I do it manually?23:25
mordredmikal: manually23:25
mikalmordred: so if we don't use milestones for that, how do people know what was in each release?23:26
*** radez_g0n3 is now known as radez23:26
*** armax has joined #openstack-infra23:26
*** pcm_ has quit IRC23:27
*** gargola has quit IRC23:27
*** timrc is now known as timrc-afk23:27
mordredmikal: I'm not sure. maybe milestones are a good idea23:27
*** pcm_ has joined #openstack-infra23:27
mikalIt seems to me I need a launchpad admin to create a milestone for me?23:28
mikalI can't see how I can do it as a mortal?23:28
mikalfungi: you around? I need your LP admin skills.23:30
mikaljeblair: ^-- or you23:30
fungimikal: i can be around. 'sup?23:31
*** moted has joined #openstack-infra23:31
fungimikal: lemme guess, you don't have access to create milestones for nova?23:31
* fungi peeks23:32
mikalfungi: so, I am trying to do a python-novaclient release. Keystone uses milestones to mark things as released by a given release. python-novaclient historically hasn't done this, but it looks like a good idea to me23:32
mikalfungi: so, I need a milestone for python-novaclient created23:32
mikalfungi: or alteratively, to be granted admin rights to ptyhon-novaclient so I can do it myself23:32
*** rkukura has joined #openstack-infra23:34
jeblairi think membership in the drivers group should take care of that...23:34
*** emagana has quit IRC23:34
mikaljeblair: I can't see how to do it, but I've never tried before23:34
mikalCertainly there's not actions available to me on the milestone list page23:34
mikalJust an empty list23:34
jeblairmikal: out of curiousity, why does a client have milestones?23:35
jeblair(i ask to make conversation while i continue to poke)23:35
mikaljeblair: because no one has told me its a bad idea yet... This is my first time, I might well be wrong.23:35
mikaljeblair: keystone does it, and it makes sense to me to want to tag bugs as "fix released" when we release a fix for them23:35
mikaljeblair: but it is not something python-novaclient has historically done23:35
mikaljeblair: perhaps for a good reason no one has mentioned yet23:36
fungiyeah, here i was assuming nova... the client doesn't normally have milestones, it has bugs which get set fix-released when it reeases23:36
jeblairhow about that23:36
*** eharney has joined #openstack-infra23:36
mikalfungi: that set is done manually?23:36
mikalfungi: keystone (well, dolphm) has a script I am trying to use which does that leg work, but it requires a milestone to exist23:36
fungimikal: normally, i think, though it probably isn't hard to script since any bug which is fix-committed at the time the release is tagged should be switched to fix-released23:37
fungimikal: you're saying dolphm does this for python-keystoneclient?23:37
mikalIs there harm in having milestones for clients?23:37
mikalYes23:37
mikalhttps://launchpad.net/python-keystoneclient/+milestones23:37
fungiinteresting23:37
jeblairmikal: do you have the "register a series" button on https://launchpad.net/python-novaclient ?23:37
jeblairmikal: which goes here: https://launchpad.net/python-novaclient/+addseries23:38
fungii don't expect there's any harm in it, though they would be fairly arbitrary since the clients tend not to have any release schedule23:38
*** rkukura has quit IRC23:38
mikalI do have "Register a series"23:38
mikalI imagine a world in which the milestones are created at release time23:38
mikalAnd are just named for the release number23:38
mikalWhich seems to be what keystone does23:38
jeblairmikal: so according to that page, "milestones belong to series"23:39
wenlockcurious, why use LP to tell what was included in a release, why not use git?23:39
mikalwenlock: we use LP for this for the projects, just not the clients23:39
jeblairmikal: looking at keystoneclient... it looks like they created 0.0.x series... and 1.0.x... etc23:39
fungiwenlock: i think it's more about getting bugs closed out if they're appearing fixed in a release23:39
mikalwenlock: its really hard to find bugs in git commits sometimes23:39
mikaljeblair: they have a "trunk" series as well23:39
jeblairmikal: yeah, but with no milestones23:40
mikaljeblair: true23:40
*** pcm_ has quit IRC23:40
mikaljeblair: so, to pick a name for the series...23:40
jeblairmikal: so based on that example, i think the process would be to create some number-pattern series for novaclient, then add milestones to it23:40
wenlockohh things don't get taged?23:40
jeblairmikal: but i have not done this myself.  you may want to seek more expert advice if you're not comfortable23:41
* mikal shall flail23:41
jeblairmikal: 0.x.x and 1.x.x are the actual series names they used for keystoneclient23:41
wenlocki usually just use git whatchanged <lastversion>..<thisversion>23:41
*** doddstack has quit IRC23:42
mikalOh look, now I can create a milestone23:43
jeblairmikal: the values for the 0.x.x series in keystoneclient are: name:0.x.x; summary:"0.x.x is the current development series."; status:active development; branch and release url pattern are empty23:43
jeblairmikal: (if that helps answer "what should i enter when creating a new series?")23:43
jeblairmikal: everything you've just done lgtm23:45
mikaljeblair: yay!23:45
mikalYeah, I think it makes sense to copy keystone here23:45
*** homeless has quit IRC23:45
mikalThis first release in LP might just look a bit bigger than it deserves23:45
*** hogepodge has quit IRC23:46
*** elambert has quit IRC23:47
openstackgerritA change was merged to openstack/requirements: Update the version of keyring to avoid bug  https://review.openstack.org/9377023:49
*** radez is now known as radez_g0n323:51
*** Evgeny has quit IRC23:52
*** atiwari has quit IRC23:52
*** jp_at_hp1 has joined #openstack-infra23:53
*** jp_at_hp has quit IRC23:54
clarkbzaro: sorry it took so long. those changes lgtm23:56
*** adrian_otto has quit IRC23:58
*** Evgeny has joined #openstack-infra23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!