Wednesday, 2013-11-27

*** fbo is now known as fbo_away00:00
*** che-arne has quit IRC00:00
*** rongze has quit IRC00:00
*** jcooley_ has joined #openstack-infra00:01
openstackgerritA change was merged to openstack-infra/config: Add graphite graph of gate failure rates to e-r page
*** jcooley_ has quit IRC00:06
*** w_ has joined #openstack-infra00:07
*** nono1 has quit IRC00:09
*** nono1_ has quit IRC00:10
*** olaph has quit IRC00:10
*** sarob_ has joined #openstack-infra00:10
*** matsuhashi has joined #openstack-infra00:12
*** weshay has joined #openstack-infra00:12
*** sarob has quit IRC00:13
*** ryanpetrello has joined #openstack-infra00:13
*** ryanpetrello has quit IRC00:13
*** sarob has joined #openstack-infra00:14
*** sarob_ has quit IRC00:15
*** dkranz has joined #openstack-infra00:15
*** yamahata_ has joined #openstack-infra00:16
*** gyee has quit IRC00:18
jog0the new graph looks good
openstackgerritClark Boylan proposed a change to openstack-infra/config: Install graphite-web and carbon with pip.
openstackgerritA change was merged to openstack-infra/nodepool: Fix the logprint in
*** dolphm_a_ has joined #openstack-infra00:24
*** luisg has quit IRC00:25
openstackgerritA change was merged to openstack-infra/config: Use pip install instead of install
clarkboh hmm I just realized my d-g refactor will change the names of all of those jobs >_>00:25
jeblairi just logged into precise5 and verified that git clean -xfdq on .tox in that workspace does work00:26
*** dolphm_afk has quit IRC00:26
jeblairi do not know why the job failed at the time :(00:26
jeblairfungi, mordred: ^ fyi00:27
clarkbmaybe something had the file open? a stuck process00:28
clarkbs/the file/a file in .tox/00:28
*** dolphm_a_ has quit IRC00:28
* fungi is back, caught up on scrollback and following along00:28
jeblairclarkb: yeah; can't think of what though.00:28
jeblairlsof showed nothing00:29
jeblair(as expected, since it worked, so i expect it was transient)00:29
*** yamahata_ has quit IRC00:29
lifelessjeblair: how's your queue looking ? ;)00:30
fungiwe're going on the assumption that "warning: failed to remove .tox/" accompanied a nonzero return code from git-clean, failing out the job? bizarre circumstance to be sure00:30
clarkbfungi: that was my assumption00:30
*** amotoki has joined #openstack-infra00:30
jeblairlifeless: 8 reviews, but i'm caught up to "today" so i can reasonably task-switch to the gearman thing00:31
fungiso, yeah, with lsof turning up nothing post-mortem, i'd still go with "open file handle" but maybe only very, very briefly00:31
fungilike, i wonder if the git-reset had really finished when it returned control to the calling process00:32
lifelessjeblair: cool; thanks! I added a comment which I think will do the right thing, but I'm no expert00:33
lifelessjeblair: on
fungiclarkb: should we consider beefing up the git-clean calls in the run scripts with a || { sleep 1; git clean -blah } maybe?00:34
jeblairlifeless: is 'tripleo-gate' the job that is meant to run a test (eg, report failure to gerrit or similar)?00:36
jeblairfungi: couldn't hurt?00:36
clarkbfungi: maybe? would git reset open files in .tox? I suppose it probably does00:36
fungiclarkb: i suspect it could open files just about, you know, anywhere within the git root00:37
lifelessjeblair: yes, its devstack-gate but doing tripleo not devstack00:37
fungiclarkb: jeblair: i'll submit a "couldn't hurt" patch for those. belt and braces and what have you00:37
*** paul-- has joined #openstack-infra00:39
*** sarob has quit IRC00:40
*** sarob has joined #openstack-infra00:40
fungiclarkb: jeblair: was there a bug which prompted discussion of that gate-horizon-python27-django14 fail?00:41
clarkbArxCruz: you about? looking at and wondering about dprince's comment00:41
clarkbArxCruz: may not work with utf8 (working to check with a quick test) and is very debian specific00:42
*** sarob has quit IRC00:42
ArxCruzclarkb: I did the changes00:42
clarkbArxCruz: did you plan to update in a subsequent change?00:42
*** sarob has joined #openstack-infra00:42
clarkbnevermind i think it will handle utf800:43
ArxCruzclarkb: I'm not understanding00:43
*** sarob has quit IRC00:43
ArxCruzclarkb: you mean the Schrodinger's cat ?00:43
*** sarob has joined #openstack-infra00:44
clarkbArxCruz: yes, but I think I have convinced myself the cat isn't a problem00:44
clarkbArxCruz: but the deb stuff in will need to also do yum00:44
ArxCruzclarkb: okay, I can work on :)00:44
clarkbcool, I will go ahead and approve this first bit of work, but the whole stack may be unhappy if you throw it at fedora now :)00:45
mgagnelooks like it's a bad idea to rename a jenkins slave while there is a build running...00:48
jeblairlifeless: responded; i think the thing you identified as a possible issue is an issue00:49
lifelessjeblair: nuts; going to read00:51
*** pete5 has quit IRC00:52
*** markwash has quit IRC00:52
*** dolphm_afk has joined #openstack-infra00:53
openstackgerritA change was merged to openstack-infra/config: Adding nodepool compatibility with Fedora.
*** dolphm_afk has quit IRC00:58
lifelessjeblair: ok follow up q01:03
*** CaptTofu has quit IRC01:03
*** ^demon|away has quit IRC01:04
*** CaptTofu has joined #openstack-infra01:07
*** reed has quit IRC01:07
openstackgerritClay Gerrard proposed a change to openstack-dev/hacking: Add noqa support for H201 (bare except)
openstackgerritJeremy Stanley proposed a change to openstack-infra/config: If running git clean after reset then retry
*** markmcclain has joined #openstack-infra01:14
openstackgerritJeremy Stanley proposed a change to openstack-infra/devstack-gate: If running git clean after reset then retry
fungiaddressed for jenkins jobs, ggp and d-g ^01:18
clarkbjeblair: can you read my comments at and see if that is something we should be considering as more compute drivers are required to have testing01:19
clarkbfungi: ^ your opinion appreciated as well. looking at your change now01:19
*** nosnos has joined #openstack-infra01:20
fungiclarkb: thanks01:21
jog0what does the gate graph mean?01:22
jog05 lines coming off the top01:22
jog0oh never mind01:23
jog0it means lots of gate fails01:23
clarkbjog0: I think it is in the process of rerendering as it processes the results queue01:23
fungijog0: it means a lot of recalculation and merges considered01:23
clarkbjog0: and yes lots of gate fails forcing it to do that01:23
fungijog0: note the the "Queue lengths: 4 events, 39 results."01:23
fungionce those settle to 0/0 the subway map will probably make more sense too01:24
jog0fungi: what does that mean01:24
jog04 events01:24
fungievents received by zuul, results determined form the events01:24
fungier, from01:24
fungiresults determined from the jobs, rather. events are going to be gerrit stream events in this case?01:25
jog0so we have kept the gate  delay under 3 hours all day  from what I can tell01:25
jog0not too bad01:25
fungianyway, yes, it's recalculating the subway map now. looks like a slew of conflicting and/or failing horizon changes01:25
*** rongze has joined #openstack-infra01:26
fungioh, nice, a couple pbr changes further down which needed rebasing01:27
fungias well as a tempest one in the same boat01:27
jog0fungi: ahh I see now that makes sense01:27
*** rongze has quit IRC01:31
*** sjing has joined #openstack-infra01:31
clarkbjeblair: ArxCruz: for, is that new option required?01:32
clarkbjeblair: ArxCruz: I think we should make it optional so that we are backward compatible with old configs01:33
ArxCruzclarkb: yes, I will create a new patch for change in o-i/config01:33
clarkbArxCruz: that is the other option, but making it optional makes other users of zuul happy I think01:33
clarkbArxCruz: let us see what jeblair has to say01:33
clarkband I will leave my thoughts on the review01:33
ArxCruzclarkb: okay up to you guys01:33
*** mattoliverau has quit IRC01:34
*** matsuhashi has quit IRC01:34
lifelessjeblair: do you think it's possible to timeout in the client code for that race condition on unregistered functions?01:35
fungiclarkb: the multi-cell tempest idea isn't without merit. i think maybe you should float it in front of the #-qa crowd when they're around too01:35
clarkbfungi: good idea, I will do that01:36
fungiclarkb: my only concern (and this might just be showing my ignorance of the implementation) is that introducing various cell types in a single tempest run could make failures harder to pin down and classify, but maybe that's just a question of having the right logging detail01:37
clarkbfungi: it definitely does add some complexity01:37
clarkbfungi: unfortunately I think some of the problems with my ideas are that nova isn't capable of doing what I expect it to do01:38
fungii know people you can complain to about that, though i suspect the answer will be "patches welcome"01:38
clarkbfungi: I think this has been a long desired feature of nova01:39
*** herndon has quit IRC01:39
*** yamahata_ has joined #openstack-infra01:42
openstackgerritA change was merged to openstack-infra/git-review: Preserve merges when doing a rebase
*** sarob_ has joined #openstack-infra01:46
*** sarob has quit IRC01:49
*** mgagne has quit IRC01:50
*** matsuhashi has joined #openstack-infra01:51
*** sarob_ has quit IRC01:51
*** UtahDave has quit IRC01:52
*** dolphm_afk has joined #openstack-infra01:54
*** markmcclain has quit IRC01:55
*** senk has joined #openstack-infra01:56
clarkbzaro: I have comments there. lgtm but want to double check the diff list as it looks small01:57
*** dolphm_afk has quit IRC01:59
*** yongli has joined #openstack-infra02:02
*** bingbu has joined #openstack-infra02:05
*** yongli has quit IRC02:07
*** yongli has joined #openstack-infra02:08
*** bknudson has quit IRC02:08
*** rongze has joined #openstack-infra02:09
*** yongli has quit IRC02:10
*** guohliu has joined #openstack-infra02:11
*** yaguang has joined #openstack-infra02:12
*** melwitt has quit IRC02:12
*** yongli has joined #openstack-infra02:13
*** yongli has quit IRC02:16
*** yongli has joined #openstack-infra02:16
*** michchap has quit IRC02:18
*** senk has quit IRC02:19
*** weshay has quit IRC02:21
*** yongli has quit IRC02:24
*** yongli has joined #openstack-infra02:24
*** dims has quit IRC02:25
jog0 that looks a little short02:29
*** mattoliverau has joined #openstack-infra02:33
*** jerryz has quit IRC02:33
jog0did something change how we handle bugs with no hits?02:35
jog0because the last entry bug 1225664 doesn't appear to have any hits02:35
*** jhesketh has quit IRC02:35
uvirtbotLaunchpad bug 1225664 in devstack "Swift: No space left on device" [Undecided,Fix committed]
westmaasmordred: around?02:37
westmaasjust curious who owns the rs account you use for testing02:38
westmaasjeblair: ^^02:38
westmaasmostly I'm curious what the tenant ID is and what size image you use, if you don't use the base image02:41
clarkbwe use 8gb nodes02:43
clarkbwith 4vcpu02:43
clarkbthen start with the base precise and centos6 imagines and puppet them02:44
westmaasthink I found the tenant, thanks!02:49
*** Shrews has quit IRC02:49
*** fifieldt has joined #openstack-infra02:53
*** matsuhashi has quit IRC03:00
*** wenlock has joined #openstack-infra03:01
*** markwash has joined #openstack-infra03:01
openstackgerritlifeless proposed a change to openstack-infra/reviewstats: Fix importing of utils in two scripts.
openstackgerritlifeless proposed a change to openstack-infra/reviewstats: Remove unused import in reviews_for_bugs.
openstackgerritlifeless proposed a change to openstack-infra/reviewstats: Document the JSON schema a little.
*** paul-- has quit IRC03:42
*** reaper has joined #openstack-infra03:44
mikaljog0: you still around?03:55
*** jhesketh has joined #openstack-infra03:55
*** pcrews has quit IRC03:58
*** mihgen has joined #openstack-infra04:06
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Fix utils import
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Remove received reviews from output.
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Fix utils import
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Remove received reviews from output.
*** matsuhashi has joined #openstack-infra04:23
*** dolphm_afk has joined #openstack-infra04:25
*** chandankumar has quit IRC04:25
*** chandankumar has joined #openstack-infra04:25
*** dolphm_afk has quit IRC04:28
*** jcooley_ has joined #openstack-infra04:30
*** paul-- has joined #openstack-infra04:44
*** dolphm_afk has joined #openstack-infra04:44
*** rongze has quit IRC04:48
*** mriedem has quit IRC04:49
*** sandywalsh has quit IRC04:56
*** nicedice has quit IRC05:07
*** hartsocks has quit IRC05:07
*** yamahata_ has quit IRC05:08
*** hartsocks has joined #openstack-infra05:08
*** sarob has joined #openstack-infra05:15
*** rongze has joined #openstack-infra05:18
*** oubiwann has quit IRC05:19
lifelessAlex_Gaynor: the pbr patches need rebasing :)05:22
*** slong has joined #openstack-infra05:23
Alex_Gaynorlifeless: I didn't notice it was based on the other one, it's a different error message then when the patch itself has a merge conflict :/05:23
*** slong has left #openstack-infra05:24
*** colinmcnamara has joined #openstack-infra05:25
*** rongze has quit IRC05:27
*** colinmcnamara has quit IRC05:28
*** sandywalsh has joined #openstack-infra05:31
*** michchap has joined #openstack-infra05:34
openstackgerritMichael Davies proposed a change to openstack-infra/config: Adding in Matt Oliver to rcbau team
*** sjing has quit IRC05:40
openstackgerritMichael Davies proposed a change to openstack-infra/config: Adding in Matt Oliver to rcbau team
*** sjing has joined #openstack-infra05:42
*** sarob has quit IRC05:44
*** sarob has joined #openstack-infra05:45
*** sarob has quit IRC05:49
*** vipul is now known as vipul-away05:52
*** jorisroovers has joined #openstack-infra05:53
*** afazekas has joined #openstack-infra05:53
openstackgerritMichael Davies proposed a change to openstack-infra/config: Adding in Matt Oliver to rcbau team
*** SergeyLukjanov has joined #openstack-infra05:57
*** w_ has quit IRC05:57
*** senk has joined #openstack-infra05:58
*** jcooley_ has quit IRC05:59
*** jcooley_ has joined #openstack-infra05:59
*** vipul-away is now known as vipul06:01
*** jcooley_ has quit IRC06:05
*** dolphm_afk has quit IRC06:06
*** dolphm_a_ has joined #openstack-infra06:08
*** w_ has joined #openstack-infra06:09
yaguangstable/grizzly jenkins fails duo to error: Installed distribution iso8601 0.1.4 conflicts with requirement iso8601>=0.1.806:10
yaguangfull log is here
*** dolphm_a_ has quit IRC06:10
*** sarob has joined #openstack-infra06:11
*** CaptTofu has quit IRC06:11
*** CaptTofu has joined #openstack-infra06:12
*** rongze has joined #openstack-infra06:13
*** mrda has quit IRC06:23
*** mattoliverau has quit IRC06:29
*** boris-42 has joined #openstack-infra06:30
*** nosnos_ has joined #openstack-infra06:30
*** nosnos has quit IRC06:34
*** ArxCruz has quit IRC06:36
*** SergeyLukjanov is now known as _SergeyLukjanov06:37
*** _SergeyLukjanov has quit IRC06:38
*** guohliu has quit IRC06:42
*** yongli has quit IRC06:44
*** yongli has joined #openstack-infra06:44
*** w_ has quit IRC06:45
*** yongli has quit IRC06:47
*** yongli has joined #openstack-infra06:47
*** SergeyLukjanov has joined #openstack-infra06:52
*** SergeyLukjanov has quit IRC06:52
*** yongli has quit IRC06:57
*** yongli has joined #openstack-infra06:58
*** olaph has joined #openstack-infra07:00
*** matsuhashi has quit IRC07:05
*** matsuhashi has joined #openstack-infra07:05
*** nati_uen_ has quit IRC07:09
*** yonglihe_ has joined #openstack-infra07:13
*** yolanda has joined #openstack-infra07:13
*** yonglihe_ has quit IRC07:15
*** senk has quit IRC07:15
*** yonglihe_ has joined #openstack-infra07:15
*** yongli has quit IRC07:16
*** yonglihe_ has quit IRC07:16
*** yongli has joined #openstack-infra07:17
*** markwash has quit IRC07:17
*** yonglihe_ has joined #openstack-infra07:19
*** yonglihe_ has quit IRC07:19
*** slong has joined #openstack-infra07:19
*** paul-- has quit IRC07:19
*** yongli has quit IRC07:20
*** nosnos_ has quit IRC07:20
*** yongli has joined #openstack-infra07:21
*** nosnos has joined #openstack-infra07:21
*** dolphm_afk has joined #openstack-infra07:21
*** yonglihe_ has joined #openstack-infra07:22
*** yonglihe_ has quit IRC07:22
*** pblaho has joined #openstack-infra07:24
*** slong has quit IRC07:25
*** dolphm_afk has quit IRC07:25
*** denis_makogon has joined #openstack-infra07:26
*** yongli has quit IRC07:28
*** yongli has joined #openstack-infra07:28
*** yongli has quit IRC07:29
*** yongli has joined #openstack-infra07:30
openstackgerritSwann Croiset proposed a change to openstack-infra/config: Climate project: add gerrit tags ACL
*** markwash has joined #openstack-infra07:31
*** yongli has quit IRC07:32
*** yongli has joined #openstack-infra07:32
*** nati_ueno has joined #openstack-infra07:34
*** yongli has quit IRC07:38
*** yongli has joined #openstack-infra07:38
*** sarob has quit IRC07:46
*** sarob has joined #openstack-infra07:47
*** flaper87|afk is now known as flaper8707:49
*** yongli has quit IRC07:49
*** yongli has joined #openstack-infra07:50
*** yongli has quit IRC07:51
*** sarob has quit IRC07:51
*** yongli has joined #openstack-infra07:51
*** vipul is now known as vipul-away07:51
*** reaper has quit IRC07:53
*** yongli has quit IRC07:58
*** yongli has joined #openstack-infra07:59
*** boris-42 has quit IRC07:59
*** yonglihe_ has joined #openstack-infra07:59
*** ruhe has joined #openstack-infra08:01
*** matsuhashi has quit IRC08:01
*** matsuhashi has joined #openstack-infra08:03
*** yongli has quit IRC08:03
*** fifieldt has quit IRC08:03
*** yongli has joined #openstack-infra08:03
*** yongli has quit IRC08:04
*** fbo_away is now known as fbo08:05
*** yonglihe_ has quit IRC08:06
*** yongli has joined #openstack-infra08:06
*** yongli has quit IRC08:06
*** vipul-away is now known as vipul08:06
*** yongli has joined #openstack-infra08:07
*** yonglihe_ has joined #openstack-infra08:08
*** yonglihe_ has quit IRC08:10
*** yonglihe_ has joined #openstack-infra08:11
*** yonglihe_ has quit IRC08:11
*** yonglihe_ has joined #openstack-infra08:13
*** mihgen has quit IRC08:13
*** yonglihe_ has quit IRC08:13
*** yonglihe_ has joined #openstack-infra08:15
*** yonglihe_ has quit IRC08:15
*** yongli has quit IRC08:16
*** yongli has joined #openstack-infra08:17
*** yonglihe_ has joined #openstack-infra08:18
*** marun has quit IRC08:18
*** yonglihe_ has quit IRC08:18
*** paul-- has joined #openstack-infra08:27
*** yongli has quit IRC08:28
*** yongli has joined #openstack-infra08:29
*** yongli has quit IRC08:30
*** yongli has joined #openstack-infra08:30
*** yongli has quit IRC08:31
*** yongli has joined #openstack-infra08:31
*** yonglihe_ has joined #openstack-infra08:32
*** yonglihe_ has quit IRC08:33
*** che-arne has joined #openstack-infra08:34
*** sjing has quit IRC08:41
*** yongli has quit IRC08:42
*** yongli has joined #openstack-infra08:42
*** hashar has joined #openstack-infra08:42
*** denis_makogon has quit IRC08:44
*** SergeyLukjanov has joined #openstack-infra08:48
*** yonglihe_ has joined #openstack-infra08:52
*** yonglihe_ has quit IRC08:52
*** yongli has quit IRC08:53
*** yongli has joined #openstack-infra08:53
*** ruhe has quit IRC08:54
*** yonglihe_ has joined #openstack-infra08:54
*** yonglihe_ has quit IRC08:54
*** paul-- has quit IRC08:55
*** mihgen has joined #openstack-infra08:59
*** jpich has joined #openstack-infra09:01
*** nati_ueno has quit IRC09:01
*** markmc has joined #openstack-infra09:02
*** DinaBelova has joined #openstack-infra09:04
*** jcoufal has joined #openstack-infra09:05
*** derekh has joined #openstack-infra09:05
*** yongli has quit IRC09:09
*** yongli has joined #openstack-infra09:11
*** yassine has joined #openstack-infra09:12
*** yonglihe_ has joined #openstack-infra09:16
*** yongli has quit IRC09:16
*** yongli has joined #openstack-infra09:17
*** yongli has quit IRC09:17
*** dstanek has quit IRC09:21
*** yonglihe_ has quit IRC09:26
*** yongli has joined #openstack-infra09:26
*** yonglihe_ has joined #openstack-infra09:27
*** yonglihe_ has quit IRC09:27
openstackgerritValeriy Ponomaryov proposed a change to openstack-infra/config: Add gate-manila-devstack job
*** pblaho has quit IRC09:28
*** yongli has quit IRC09:29
*** yongli has joined #openstack-infra09:30
*** paul-- has joined #openstack-infra09:30
*** talluri has joined #openstack-infra09:30
*** yonglihe_ has joined #openstack-infra09:31
*** yonglihe_ has quit IRC09:32
openstackgerritSergey Lukjanov proposed a change to openstack-infra/config: Add gate-climate-devstack
*** yongli has quit IRC09:38
*** yongli has joined #openstack-infra09:39
*** yonglihe_ has joined #openstack-infra09:40
*** yonglihe_ has quit IRC09:42
*** yongli has quit IRC09:42
*** yongli has joined #openstack-infra09:42
*** yonglihe_ has joined #openstack-infra09:44
*** yonglihe_ has quit IRC09:46
*** yongli has quit IRC09:46
*** yongli has joined #openstack-infra09:47
*** yongli has quit IRC09:49
*** yongli has joined #openstack-infra09:49
*** yamahata_ has joined #openstack-infra09:50
*** matsuhashi has quit IRC09:51
*** ben_duyujie has joined #openstack-infra09:52
*** yonglihe_ has joined #openstack-infra09:52
*** yonglihe_ has quit IRC09:52
*** pblaho has joined #openstack-infra09:52
*** yonglihe_ has joined #openstack-infra09:54
*** yonglihe_ has quit IRC09:54
*** matsuhas_ has joined #openstack-infra09:55
*** yonglihe_ has joined #openstack-infra09:56
*** yonglihe_ has quit IRC09:57
openstackgerritSwann Croiset proposed a change to openstack-infra/config: Climate project: add gerrit tags ACL
*** ruhe has joined #openstack-infra10:05
*** osanchez has joined #openstack-infra10:07
*** ryanpetrello has joined #openstack-infra10:10
*** matsuhas_ has quit IRC10:11
*** matsuhashi has joined #openstack-infra10:11
*** ryanpetrello has quit IRC10:12
*** masayukig has joined #openstack-infra10:17
*** rongze has quit IRC10:21
*** nati_ueno has joined #openstack-infra10:21
*** jhesketh has quit IRC10:22
*** paul-- has quit IRC10:25
*** ruhe has quit IRC10:27
*** paul-- has joined #openstack-infra10:28
*** ruhe has joined #openstack-infra10:28
*** rongze_ has joined #openstack-infra10:31
*** ruhe has quit IRC10:33
*** boris-42 has joined #openstack-infra10:35
*** paul-- has quit IRC10:37
*** mrda has joined #openstack-infra10:38
*** DinaBelova has quit IRC10:42
*** ryanpetrello has joined #openstack-infra10:44
*** yamahata_ has quit IRC10:44
*** ryanpetrello has quit IRC10:44
*** paul-- has joined #openstack-infra10:45
*** SergeyLukjanov is now known as _SergeyLukjanov10:46
*** _SergeyLukjanov has quit IRC10:47
*** avishayb has joined #openstack-infra10:48
chandankumarAnybody can help me here?10:50
chandankumarI am not able to openstack Wiki through launchpad credentials10:51
chandankumarit is always saying There is no user by the name "chandankumar.093047". Usernames are case sensitive. Check your spelling,10:51
chandankumari have tried with changing username in different case, but not able to login10:52
chandankumarPlease help me?10:52
*** mrda has quit IRC10:57
*** bingbu has quit IRC10:59
sorenchandankumar: agrees that you don't exist.11:02
chandankumarsoren, i am viewing my profile11:03
chandankumarsoren, here is my
*** SergeyLukjanov has joined #openstack-infra11:04
*** ArxCruz has joined #openstack-infra11:04
chandankumarsoren, what is happening with it?11:05
sorenchandankumar: Well, a minus and a dot aren't the same thing.11:05
*** rongze_ has quit IRC11:06
*** DinaBelova has joined #openstack-infra11:06
*** jorisroovers has quit IRC11:06
*** jorisroovers has joined #openstack-infra11:06
chandankumarsoren, There is no user by the name "chandankumar-093047". Usernames are case sensitive. Check your spelling, or create a new account.11:06
chandankumarsoren, i have tried all of them, but donot why it is not working11:07
sorenSo you go to, click the login link and you end up on, right?11:07
*** pcm_ has joined #openstack-infra11:08
*** fbo is now known as fbo_away11:08
*** pcm_ has joined #openstack-infra11:08
chandankumarsoren, on clicking login i get this link
chandankumarsoren, there it doesnot come login.lauchpad.net11:09
*** paul-- has quit IRC11:09
chandankumarsoren, any ide11:10
sorenchandankumar: Try a different browser. You should definitely be taken to at some point in the process.11:10
*** matsuhashi has quit IRC11:10
sorenOr, use your current browser's inkognito mode, if it has such a mode.11:11
chandankumarsoren, i am suing firefox11:11
chandankumarhow to go in that mode?11:12
chandankumarsoren, in different browser i get loggined11:13
*** wenlock has quit IRC11:13
chandankumarsoren, Thank you11:15
sorenClear your cookies for the site then and you should be fine.11:15
*** rongze has joined #openstack-infra11:15
chandankumarsoren, yes11:15
sorenchandankumar: You're welcome.11:16
*** amotoki has quit IRC11:21
*** SergeyLukjanov has quit IRC11:34
*** SergeyLukjanov has joined #openstack-infra11:36
*** SergeyLukjanov is now known as _SergeyLukjanov11:37
*** ryanpetrello has joined #openstack-infra11:38
*** _SergeyLukjanov is now known as SergeyLukjanov11:38
*** smulcahy has joined #openstack-infra11:39
smulcahyI've had a gate failure but can't see the cause other than that keystone did not start which seems unrelated to my change -
smulcahyam I missing something or are there any other known issues with keystone failing to start?11:39
smulcahyI couldn't see anything obvious on
*** pcm_ has quit IRC11:42
*** ruhe has joined #openstack-infra11:42
*** ryanpetrello has quit IRC11:43
*** ruhe has quit IRC11:48
*** ruhe has joined #openstack-infra11:49
*** nati_ueno has quit IRC11:49
ttxhrm.. Who is this jishaomei who spams reviews with "starting gate jobs" comments ?11:53
*** jroovers has joined #openstack-infra11:53
*** nosnos has quit IRC11:53
jd__ttx: haha, now we have Jenkins spammer ;-)11:54
jd__(someone installed zuul with a default config or something?)11:54
*** jorisroovers has quit IRC11:55
*** ruhe has quit IRC12:00
openstackgerritArx Cruz proposed a change to openstack-infra/config: Zuul puppet support to zuul_url option
*** rfolco has joined #openstack-infra12:01
*** ArxCruz has quit IRC12:03
*** sandywalsh has quit IRC12:04
*** lcestari has joined #openstack-infra12:05
*** pcm_ has joined #openstack-infra12:06
*** masayukig has quit IRC12:09
*** pcm_ has quit IRC12:12
*** pcm_ has joined #openstack-infra12:13
*** yaguang has quit IRC12:14
*** Loquacity has quit IRC12:15
*** weshay has joined #openstack-infra12:17
*** jroovers has quit IRC12:18
*** CaptTofu has quit IRC12:28
*** CaptTofu has joined #openstack-infra12:28
*** yamahata_ has joined #openstack-infra12:32
*** ruhe has joined #openstack-infra12:35
*** mattymo has joined #openstack-infra12:37
mattymothis is just a general question regarding launchpad (no response in their channel) - anyone know how to set a restricted list of approvers for blueprints in a particular LP project?12:38
mattymoit's for a stackforge project, so it's still on topic12:38
*** avishayb has quit IRC12:41
*** avishayb has joined #openstack-infra12:42
*** [1]avishayb has joined #openstack-infra12:43
sorenHi. How does the elastic recheck thing guess which bugs are being hit?12:45
soren...and how can I provide hints for it?12:45
*** jorisroovers has joined #openstack-infra12:46
*** avishayb has quit IRC12:47
*** [1]avishayb is now known as avishayb12:47
*** jroovers has joined #openstack-infra12:47
ttxsoren: I think it relies on search patterns being posted as comments on bugs12:48
sorenI think I just found it, actually.12:49
*** fbo_away is now known as fbo12:49
sorenThe elastic-recheck project has a queries.yaml file that I think is what I want.12:49
ttxsdague: what does "UNSTABLE" mean in test results ? Looked into the logs but could not find a clear failure (
*** rfolco has quit IRC12:50
ttxmattymo: the project "drivers" have power to set blueprints fields12:50
*** jorisroovers has quit IRC12:51
*** SergeyLukjanov is now known as _SergeyLukjanov12:51
ttxsdague: I guess it's all truncated12:52
*** _SergeyLukjanov has quit IRC12:52
ttx(no console.html)12:53
*** sandywalsh has joined #openstack-infra12:54
openstackgerritSoren Hansen proposed a change to openstack-infra/elastic-recheck: Add pattern for bug 1236524
uvirtbotLaunchpad bug 1236524 in tempest "tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern fails sporadically" [Undecided,New]
sdaguettx: UNSTABLE means something went wrong with artifact collection12:56
sdagueso it's unknown12:56
ttxsdague: is it fair game to reverify no bug UNSTABLE stuff ?12:57
sdaguettx: yes12:57
ttxI guess I'll do that then12:57
sdaguesoren: ?? curious about your elastic-recheck diving :)12:57
BobBallIf we're removing reverify no bug , should we auto re-test unstable results once?12:58
ttxBobBall: or we could have a specific syntax. "reverify because UNSTABLE"12:58
BobBallyeah, that'd make sense12:59
sorenttx:  <-- Says canceled.12:59
ttxsoren: yeah, no reverifying it is12:59
sorensdague: I think I worked it out (see the elastic-recheck change proposed a few lines further up).12:59
ttxwow. When wa job gets cancelled due to something higher up failing, it gets automatically reverified when the root one gets reverified. Shiny.13:00
sorenWe've all been replaced by a small shell script. Darn.13:01
ttxsoren: it's just a matter of time13:01
ttxsmall shell scripts already fight our wars for us.13:01
*** jroovers has quit IRC13:02
BobBallwho would have thought that skynet would be written in bash13:03
sdaguesoren: do you have a review where it failed? we typically try to find an issue in one of the service logs which seems to be triggering it if we can as first stage triage, not just the test that failed.13:08
*** CaptTofu has quit IRC13:08
*** CaptTofu has joined #openstack-infra13:09
sdagueand that match hits a lot of logstash hits, so I'm wondering if we already have other fingerprints for most of that bug13:09
sorensdague: Hm. No. Let me see if I can find anything useful.13:09
*** sandywalsh_ has joined #openstack-infra13:11
*** dolphm_afk has joined #openstack-infra13:11
*** sandywalsh has quit IRC13:12
*** mkoderer has quit IRC13:13
*** Alex_Gaynor has quit IRC13:14
smulcahyI did a recheck on my review and it passed check-tempest-devstack-vm-full this but now fails on check-grenade-devstack-vm - whats the recommended way to deal with this?
smulcahy2013-11-27 12:07:12.829 | [ERROR] ./ Failure in upgrade-nova13:15
*** marun has joined #openstack-infra13:15
smulcahysounds like
uvirtbotLaunchpad bug 1249218 in grenade "Grenade - "Failure in upgrade-nova" due to apt-get failure" [Undecided,New]13:15
*** ben_duyujie has quit IRC13:19
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server
*** sandywalsh has joined #openstack-infra13:22
*** sandywalsh_ has quit IRC13:22
*** Alex_Gaynor has joined #openstack-infra13:23
*** talluri has quit IRC13:23
sdaguesmulcahy: hmm we should never be making apt calls13:25
*** alexpilotti has joined #openstack-infra13:25
*** dolphm_afk is now known as dolphm13:27
sorensdague: I see nothing interesting in any of the relevant logs :(13:32
*** SergeyLukjanov has joined #openstack-infra13:32
sdagueok. Can you put a known failing review into a comment on your patch? maybe I can swing around and see if I can help narrow it later13:35
*** thomasem has joined #openstack-infra13:35
*** Shrews has joined #openstack-infra13:35
smulcahysdague: thats an existing bug but looks like it bit my review - definitely trying to apt-get13:36
smulcahysdague: running a recheck now to see what happens this time :)13:36
sorensdague: I can... but I think I've found the cause of the bug, so I'll just try fixing that instead :)13:37
sdaguesoren: that works for me :)13:37
*** eharney has joined #openstack-infra13:37
sdaguesmulcahy: yeh, that one we should circle with infra on13:38
*** mkoderer has joined #openstack-infra13:38
*** DinaBelova has quit IRC13:40
*** DinaBelova has joined #openstack-infra13:40
*** dstanek has joined #openstack-infra13:42
*** dprince has joined #openstack-infra13:43
*** julim has joined #openstack-infra13:44
openstackgerritChuck Short proposed a change to openstack/requirements: Add HACKING.rst
*** CaptTofu has quit IRC13:53
*** CaptTofu has joined #openstack-infra13:53
*** mfer has joined #openstack-infra13:54
* fungi checks to see what's broken while he slept13:59
*** dolphm has quit IRC14:04
*** rnirmal has joined #openstack-infra14:06
zulsdague:  hey does the sqlite database needs to exist in the nova testsuite? while running nova in our buildds14:06
fungittx: jishaomei has been requesting a service account for ibm china to do third-party testing... i have to assume for a nova or neutron driver, but not certain14:06
* fungi circles back around to the ml to see if fellow ibmers finally steered them to provide the correct info. language barrier problems there, i've suspected14:07
mattymofungi, I'm having some issues with LP and maybe you have a fast answer. If not, it's fine.14:10
mattymofungi, in our fuel group anyone can approve their own blueprint, but I couldn't do that if I was to make a nova blueprint14:10
mattymowhy is that?14:10
fungimattymo: you're trying to find the members list for a drivers group on an lp project, right?14:10
mattymoI have someone who approved his own BP that isn't a driver14:11
mattymoand I'm trying to figure out how it's possible14:11
fungimattymo: it's almost certainly a configuration option for the project in lp14:11
* fungi looks to see if he can tell14:11
mattymoyeah but I couldn't find such an option14:11
*** dolphm has joined #openstack-infra14:12
fungimattymo: so the person who self-approved their bp was not in this list?
*** ruhe has quit IRC14:13
openstackgerritJulien Danjou proposed a change to openstack/requirements: Add support for Python 3 requirements
openstackgerritJulien Danjou proposed a change to openstack/requirements: Add support for Python 3 requirements
fungimmm, it's not in the obvious place (configure blueprints)14:14
*** michchap has quit IRC14:15
fungimattymo: i definitely can't find any relevant option on a project i control. next place i'd probably ask would be #launchpad (they seem to be fairly attentive when i've had to ask them things)14:17
*** ruhe has joined #openstack-infra14:18
mattymoI got some sort of contradicting answer - that anyone can change if they are a member of the base group14:18
mattymoand approve even14:18
mattymobecause it allows devels to move ahead without needing admins14:18
*** marun has quit IRC14:19
fungibase group meaning the project driver group, or some other group?14:19
*** senk has joined #openstack-infra14:20
fungii will admit, i haven't done anything with blueprints before since the infra team projects tend not to use them14:21
*** jergerber has joined #openstack-infra14:31
openstackgerritJulien Danjou proposed a change to openstack/requirements: Add oslo-incubator to automatic update
*** yamahata_ has quit IRC14:32
*** yaguang has joined #openstack-infra14:36
*** sgordon has joined #openstack-infra14:36
openstackgerritMatthew Treinish proposed a change to openstack-infra/reviewstats: Update tempest core group
*** sandywalsh_ has joined #openstack-infra14:39
*** marun has joined #openstack-infra14:39
*** sandywalsh has quit IRC14:39
openstackgerritChuck Short proposed a change to openstack/requirements: Add HACKING.rst
*** dims has joined #openstack-infra14:45
openstackgerritAntoine Musso proposed a change to openstack-infra/jenkins-job-builder: ModuleRegistry now caches entry points lookup
*** dolphm has quit IRC14:54
*** mriedem has joined #openstack-infra14:54
*** boris-42 has quit IRC14:54
*** dolphm has joined #openstack-infra14:54
*** oubiwann has joined #openstack-infra14:59
openstackgerritAntoine Musso proposed a change to openstack-infra/jenkins-job-builder: ModuleRegistry now caches entry points lookup
*** smulcahy has left #openstack-infra15:00
*** esker has joined #openstack-infra15:00
*** rcleere has joined #openstack-infra15:04
*** dprince has quit IRC15:06
sdaguemattymo: there is a seperate nova-drivers group that is the admins for the launchpad project15:08
sdagueonly they can change blueprint status15:08
*** talluri has joined #openstack-infra15:11
fungisdague: but what's odd is that the fuel project has a fuel-drivers group as its administrator and driver, yet someone apparently not a member of that group approved their own bp15:14
*** ryanpetrello has joined #openstack-infra15:16
*** pcm__ has joined #openstack-infra15:17
*** pcm_ has quit IRC15:19
*** ruhe has quit IRC15:20
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add new doctools project
*** ruhe has joined #openstack-infra15:22
*** ryanpetrello has quit IRC15:22
openstackgerritLiang Chen proposed a change to openstack-dev/pbr: Make sphinx builders configurable in LocalBuildDoc
*** avishayb has quit IRC15:23
*** sandywalsh_ has quit IRC15:23
alaskiA couple of us were trying to figure out lp fields for blueprints, and it seems that blueprint owners can set the definition to approved, but not the direction15:31
*** DinaBelova has quit IRC15:33
*** mriedem has quit IRC15:35
openstackgerritA change was merged to openstack-infra/reviewstats: Update tempest core group
openstackgerritA change was merged to openstack-infra/reviewstats: Fix importing of utils in two scripts.
openstackgerritA change was merged to openstack-infra/reviewstats: Remove unused import in reviews_for_bugs.
*** reaper has joined #openstack-infra15:39
openstackgerritA change was merged to openstack-infra/reviewstats: Document the JSON schema a little.
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Remove received reviews from output.
jeblairclarkb: I asked ArxCruz to make it a required parameter; optional was complicated, required seems like a Good Idea, and others in previous reviews agreed.15:42
*** mrodden has joined #openstack-infra15:43
clarkbjeblair: wfm, I will wait for the openstack-infra/config change before approving (though you can approve if you think it is a ppropriate)15:44
clarkbalso I am not actually awake yet :)15:44
*** senk has quit IRC15:44
*** senk has joined #openstack-infra15:45
SergeyLukjanovI'm working on moving ttx/openstack-releasing to openstack org15:45
SergeyLukjanovand it have launchpadlib in requirements15:46
SergeyLukjanovis it ok to propose it to the global requirements?15:46
*** pete5 has joined #openstack-infra15:46
jeblairSergeyLukjanov: it might be better to move it to openstack-infra or openstack-dev.15:46
SergeyLukjanovttx said that it'll be a part of release management program15:47
openstackgerritA change was merged to openstack-infra/config: If running git clean after reset then retry
clarkbjeblair: so I can approve the zuul config change then the zuul code change now?15:47
jeblairclarkb: i think so15:47
jeblairSergeyLukjanov: sure -- but it's not part of "OpenStack" -- the piece of software we are producing, so the openstack org may not be the right place15:48
jeblairSergeyLukjanov: and in fact, the requirements question you have indicates that exact problem -- we don't want to add launchpadlib to openstack/requirements because launchpadlib is not required for openstack15:49
SergeyLukjanovjeblair, sounds reasonable, looks like it should be discussed too15:49
clarkbjeblair: done15:49
SergeyLukjanovjeblair, it was about the right place15:49
openstackgerritA change was merged to openstack-infra/config: Zuul puppet support to zuul_url option
*** ryanpetrello has joined #openstack-infra15:52
jeblairSergeyLukjanov, ttx: I would chose between -infra and -dev based on whether it's something openstack developers are expected to use, or whether someone running a project like openstack would use.15:52
openstackgerritA change was merged to openstack-infra/zuul: Add the possibility to pass the zuul url
jeblairSergeyLukjanov, ttx: that leads me toward thinking -infra is the right place, but i'm not very familiar with the repo.15:52
SergeyLukjanovjeblair, that's a bunch of sh and py scripts for releasing OpenStack15:53
jeblairSergeyLukjanov, ttx: don't worry about the fact that there's an infra program; other git orgs have repos from different programs too.  :)15:53
*** alexpilotti has quit IRC15:53
*** jcooley_ has joined #openstack-infra15:53
ttxjeblair: that would be a release management program repo though15:54
ttxjeblair: hmm kay15:55
jeblairttx: i know.  i'm not claiming it.  i'm saying i think it's okay to have non-infra repos in the infra org.15:55
ttxjeblair: that could arguably be considered confusing though.15:55
jeblairttx: anyway, if you think it would be better in -dev, that's fine.15:55
jeblairttx: i thing it should not be in openstack/ though.15:55
*** UtahDave has joined #openstack-infra15:55
ttxjeblair: it's somethign that PTLs and release managers are expected to use. So it's a bit in between15:55
jeblairttx: ptl use changes things a bit, and maybe moves it closer to -dev in my mind.15:56
jd__does this type of failure ring a bell ?15:56
openstackgerritA change was merged to openstack/requirements: Set boto minimum version
ttxjeblair: so you think of github orgs as differentiating based on who the target user is ?15:56
jeblairttx: yes -- that's their primary purpose afaict -- so that when you go to list projects, you get projects of interest to you; either on github or git.o.o15:57
ttxjeblair: (FTR I think it's fine, it's just that the naming collides with program namespaces in a slightly confusing way in the -infra case)15:57
*** senk has quit IRC15:58
* ttx looks at the list to see if all projects abide to this rule15:58
*** wenlock has joined #openstack-infra15:58
jeblairttx: yes.  perhaps we want to preserve the org==program for infra.  but it's definitely not true for openstack-dev and openstack/15:59
openstackgerritA change was merged to openstack/requirements: Add oslo-incubator to automatic update
ttxtempest/grenade/devstack belonging to 2 separate orgs would be the major offender15:59
*** ruhe has quit IRC16:00
*** rnirmal has quit IRC16:00
jeblairttx: oh, are you looking at it in the other direction?  whether a program has repos in different orgs?16:00
jeblairttx: (though tempest==qa, devstack/grenade==devstack programs)16:01
ttxjeblair: no, looing at it from a user perspective. To me users of grenade and tempest are in the same category16:01
*** alexpilotti has joined #openstack-infra16:01
ttxAh, isn't grenade QA ?16:01
ttxwe really need tat mapping in programs.yaml16:01
jeblairttx: heh, i don't know if you don't.  :)16:02
ttxjeblair: ok. then grenade is QA :P16:02
*** jcoufal has quit IRC16:02
jeblairttx: anyway, tempest is an end-user product for openstack -- we expect it to have the same audience, as, say, nova.16:03
ttxjeblair: so yeah, it could belong to openstack-dev or openstack-infra depending on how you look at it.16:03
ttxthough I suspect the high adherence on our infrastructure makes it a -infra thing16:03
ttxas long as I keep control over those scripts i don't care that much16:05
jeblairsorting hat says... gryffindor!16:05
SergeyLukjanovttx, from my pov release-tools looks like to be placed to -infra org if compare with -dev one16:05
ttxSergeyLukjanov says... -infra!16:06
ttxSergeyLukjanov: you're now our new sorting hat.16:06
SergeyLukjanovjeblair, openstack-gryffindor? :)16:06
*** pblaho has quit IRC16:06
*** ruhe has joined #openstack-infra16:07
ttxjeblair: may I still retain +2 if it lands under infra org ?16:07
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Reformat nova.json
openstackgerritRussell Bryant proposed a change to openstack-infra/reviewstats: Add mriedem and dan-prince to nova-core
jeblairttx: it'll be all yours16:07
ttxMY PRECIOUS launchpadlib scripts16:07
*** michchap has joined #openstack-infra16:08
ttxnasty infra hobbit cant have it16:08
ttxjeblair: another topic. Any idea how "Force+Push" can be specified in the gerrit-dev UI ?16:09
ttxjeblair: it's documented but there doesn't seem to be UI support for it16:10
*** yolanda has quit IRC16:10
ttxjeblair: just to make sure Force+Push on refs/for/* wouldn't magically do the trick16:10
ttx(for branch deletion)16:10
jeblairttx: do you have a project i should look at?16:10
ttxjeblair: was playing with that one ^16:11
ttx"Force option"16:12
jeblairttx: if you add 'Push' perms for a ref, and then add a group to it, a 'force push' checkbox will show up.16:12
jeblairttx: so in other words, it's an extra option for the 'push' right.16:12
ttxhhhrm. I tried that and failed, let me retry16:12
ttxah yes. Weird16:13
ttxok thx16:13
jeblairjd__: the error is error: Couldn't resolve host '' while accessing
ttxjeblair: so yeah, force+push on refs/for/* doesn't allow branch deletion, while force+push on refs/heads/proposed/* allows proposed/* branch deletion16:16
ttxbut i suspect that would also let me have ultimate power.16:16
*** hartsocks has left #openstack-infra16:16
jeblairttx: that makes sense :( i think the safe thing is to wait for 2.8 for that16:16
ttxso maybe better to wait for REST16:16
devanandaclarkb: remember that db locking issue from last week? oslo guys suggested this fix:
ttxjeblair: ok, will proceed according to plan I just posted then16:17
clarkbdevananda: how does running testr with oslo lockutils help?16:17
devanandaclarkb: because
clarkbdevananda: so I think we may be talking past each other16:17
clarkbdevananda: the problem is that they are locking16:17
clarkbnot that they need to fix the locking16:18
jeblairttx: does your plan say you want to 'git push' to 'refs/heads/proposed/*' ?16:18
clarkbdevananda: each test process can have its own DB schema16:18
clarkbdevananda: then you don't worry about locks16:18
*** pcrews has joined #openstack-infra16:18
*** afazekas has quit IRC16:19
ttxjeblair: "git push gerrit milestone-proposed" to create MP branches (using Create reference perms)16:19
jeblairjd__: seems like rax's dns servers may have had a (hopefully temporary) problem.16:19
clarkbdevananda: I mean locking is one way to solve the problem... but imo is worse than the alternative of using different buckets16:20
jeblairttx: okay, that doesn't require that we add the 'push' perm (which would allow you to push an arbitrary commit to the branch (bypassing review))?16:20
jd__jeblair: what's weird is that zuul reverified on its own, is it new?
ttxjeblair: no it's actually leveraging existing permissions16:20
jd__or you did that behind the curtain :)16:20
clarkbjd__: check tests failed, gate tests passed16:21
jeblairjd__: no, first one was the check job, second gate.  someone approved the change before the check jobs reported back.16:21
jd__ah the approving was too fast, that's why I mixed, sorry guys :)16:21
openstackgerritA change was merged to openstack-infra/devstack-gate: If running git clean after reset then retry
jd__and thanks16:21
devanandaclarkb: sure. so the locking is only done on pgsql right now -- do i recall you saying there was an issue creating schemata on-demand for pg?16:21
ttxjeblair: (Release managers group already has "Create Reference" on refs/* for All-Projects)16:21
*** mgagne has joined #openstack-infra16:22
clarkbdevananda: there is no issue with pg (or shouldn't be)16:22
clarkbdevananda: mysql is the problem, we need to grant create and drop to the test user for scehams16:22
devanandahmm. well,
jeblairmarkmc:  maybe time for a wiki page update? :)16:23
clarkbdevananda: I don't think those tests are running on our slaves are they?16:23
*** nati_ueno has joined #openstack-infra16:24
clarkbdevananda: I don't see anything setting that env var that says postgres is available on our slaves16:24
clarkbthis almost feels like someone has reengineered a second way to do db testing...16:24
devanandaclarkb: i'm trying to sync them from oslo. and it failed repeatedly on taht16:24
markmcjeblair, heh :)16:24
devanandamaybe the problem is that I shouldn't be syncing this from oslo :p16:24
markmcjeblair, at least he's not terminating his first lines with a period16:24
clarkbdevananda: I think the problem is that oslo hasn't communicated what their needs are to us and have just done their own thing16:25
markmcjeblair, perhaps adopting all caps for commit messages would be cool, though16:25
clarkbdevananda: those tests will fail without locking if the same schema is used16:25
jeblairmarkmc: that seems canonical and authoritative enough for me!16:25
clarkbdevananda: the tests need to know to use different schemas and manage them properly16:25
devanandaclarkb: that's splendid. hi markmc :)16:26
markmcdevananda, hey16:26
devanandaer, i mean, hi dhellmann16:27
devananda(sorry markmc - so used to pinging you with oslo questions)16:27
markmcwhat's the story?16:27
markmcsounds like the infrastructure for running unit tests against real DBs ?16:27
markmcthe patches just landed?16:27
devanandamarkmc: db migration code in oslo16:27
devanandafairly recently, yes. i've tried to sync them to ironic and $fail16:28
markmc$fail == ?16:28
devanandawas my attempt to create a fix and port it back to oslo16:29
markmcok, hadn't seen the pgadmin-tests lock before16:29
devanandamarkmc: seems to have been this patch
markmcsounds like you've got it under control?16:31
*** mihgen has quit IRC16:32
devanandai can work around it, but i think clarkb doesnt like the lock-based solution in the first place16:32
sdaguemarkmc: this might have gotten missed because oslo doesn't run testr parallel16:32
clarkbright, locking is one way to solve the problem if we are limited to a single bucket, but we can make arbitrary buckets16:32
*** Hefeweizen has quit IRC16:33
clarkband as long as each hose only ever fills one bucket everything should just work (tm)16:33
*** cyeoh has quit IRC16:33
sdagueclarkb: sure16:33
*** thomasem has quit IRC16:33
*** rcleere has quit IRC16:34
sdagueI'm more generally concerned that oslo isn't running in parallel though, as it means the first time those components get run in parallel is after import into a project, which seems like a bad way to import broken16:34
markmcsdague, only background I can find on not running parallel:
markmcsdague, I've a vague recollection of filing a bug with more details16:34
clarkbsdague: I think that is a valid concern as well16:34
sdaguemarkmc: yeh, I should hound dhellmann about this. This seems like something that should be a pretty high priority to get addressed. just turning off parallel is punting pretty hard :)16:35
openstackgerritClark Boylan proposed a change to openstack-infra/config: defensive coding for
sdagueand kicking the can down the road to the next poor schmo16:36
clarkbjeblair: fungi: 54642 is an older change that was approved but failed due to a merge conflict. I went ahead and rebased it because I think I can just approve it, any opposition to me doing that? it was a very simple rebase16:36
uvirtbotLaunchpad bug 1192207 in oslo "Dependencies between tests in tests.unit.rpc.test_kombu:RpcKombuTestCase" [High,Triaged]16:37
markmcsdague, could be resolved when we get rid of rpc from oslo-incubator16:37
clarkbjeblair: fungi: is the diff between previously approved and rebased on that file16:37
jeblairclarkb: go for it16:37
markmcsdague, to be clear, it wasn't "switch of parallel" it was that we never enabled it16:38
markmcsdague, i.e. welcomed the port to nose even though we couldn't enable parallel at the time16:39
markmcfrom nose, rather16:39
sdaguemarkmc so ... I threw a comment on that bug. That seems completely fixable by making queue and topic names random strings16:40
openstackgerritA change was merged to openstack-infra/config: defensive coding for
sdaguewith no other effort16:40
SergeyLukjanovI'm installing devstack and it fails while uploading cirros images to glance with "500 Internal Server Error: Failed to upload image"  (
sdaguebut that's a cursory look at it, and I'm 20 minutes away from jumping in a car and driving to thanksgiving16:40
clarkboh cool found the change danprince made, reviewing that now and will approve assuming it looks good16:40
clarkbthat should make nodepool fedorable16:41
*** ryanpetrello has quit IRC16:42
clarkbjust approved that change, will kick off some nodepool image builds in a bit16:43
openstackgerritA change was merged to openstack-infra/config: Add merge-release-tags job to Savanna
openstackgerritA change was merged to openstack-infra/config: Update to install RPMs.
*** dolphm is now known as dolphm_afk16:44
*** cyeoh has joined #openstack-infra16:45
SergeyLukjanovjeblair, thanks for aprv merge-release-tags, could you please take a look at too? it's about missed milestone proposed branch section in ACL config for savanna16:46
SergeyLukjanovit adds savanna-milestone group usage16:46
zaroclarkb: opinion?
clarkbzaro: so, we slightly document tagging a release on the wiki. My concern is that python developers don't have as many suepr crazy insane notionsabout how a release tagging should work16:48
clarkbjava devs think automagic that creates a bunch of commits that add a remove versions to a file then push some resulting thing to a central repository is ok16:49
clarkbI am mostly concerned that the shift for them will be dramatic enough that it needs some explanation16:49
clarkbzaro: maybe, a new wiki page that is linked to under the simpler taggign a release section of the grrit page on the wiki16:51
clarkbthat way current documentation is nice and simple and leads folks to the in depth info16:51
*** yassine has quit IRC16:53
zaroyeah ok. so do you do not think that documenting the python release is necessary?16:54
clarkbzaro: I think we can probably descrieb it in terms that apply to python and java (rather than being super specific)16:54
*** thomasem has joined #openstack-infra16:54
*** reed has joined #openstack-infra16:55
*** thomasem has left #openstack-infra16:55
* zaro agrees16:55
*** herndon has joined #openstack-infra16:55
*** yaguang has quit IRC16:56
*** jcoufal has joined #openstack-infra16:58
zaroclarkb: what project are the wiki files in?17:03
clarkbzaro they are on the wiki :) just edit directly17:04
openstackgerritKhai Do proposed a change to openstack-infra/config: new maven plugin jobs to build and deploy maven plugins to maven nexus
*** zoresvit has quit IRC17:12
*** SergeyLukjanov has quit IRC17:12
fungiclarkb: no objections on rebasing/approving 54642 but i guess you already did, so cool17:12
*** esker has quit IRC17:12
*** ruhe has quit IRC17:13
zarodo you guys we should send gerrit events for  stackforge/clouddocs project to this channel?17:17
*** markmc has quit IRC17:19
zarofung, clarkb : opinion?17:21
jeblairzaro: i would not find them useful17:22
zaroalso what integrates gerrit and LP because clouddocs patches are not getting referenced in LP17:23
jeblairzaro: what's the lp project name?17:23
zarojeblair: ohh yeah. i forgot not project for this in LP. that's why.17:23
zarothe bug is in openstackci project17:24
*** reed has quit IRC17:24
jeblairzaro: yeah, you should just update that bug manually17:25
*** zoresvit has joined #openstack-infra17:25
*** bauzas has left #openstack-infra17:27
*** nati_ueno has quit IRC17:29
fungizaro: i tend to agree with jeblair about not having them update in this channel... maybe the docs channel would be interested in seeing updated on patches being merged to that though? you could ask them17:31
*** fbo is now known as fbo_away17:31
zarofungi: good idea. i'll ask.17:32
openstackgerritKhai Do proposed a change to openstack-dev/pbr: show transitive dependencies
openstackgerritAntoine Musso proposed a change to openstack-infra/gear: geard: wrong reference to setup_logging()
*** ^d has joined #openstack-infra17:38
*** dizquierdo has joined #openstack-infra17:40
zarofungi: this is annoying. LP won't pickup new gerrit patches when it's already referenced a patch.  take a look at this
uvirtbotLaunchpad bug 1172417 in openstack-ci "on check test for os/requiremests show transitive dependencies" [Low,In progress]17:41
zarothe ones taht are referenced have been abandoned.  i uploaded 2 new patches that do not appear in the bug.17:43
*** adalbas has quit IRC17:43
*** mfer has quit IRC17:44
*** mfer has joined #openstack-infra17:44
* fungi looks17:46
clarkbbuilding a new nodepool image for hpcloud az1 now17:46
fungizaro: new patchsets to existing reviews?17:46
*** chandankumar has quit IRC17:46
*** hashar has quit IRC17:47
fungizaro: remember, the script avoids adding comments to a bug unless it's mentioned in the commit message for patchset 117:47
fungizaro: that script would need some additional state management or an ability to search the bug comments if we wanted to make it figure out whether it's commented before17:47
clarkbjeblair: fungi: if the az1 image goes through I am going to approve
fungiclarkb: okay17:48
*** senk has joined #openstack-infra17:48
fungidprince isn't here or i'd ask him whether in-place yum upgrades of a fedora 18 image wouldn't get us fedora 19 anyway (similar to when we were using centos 6.3 images to effectively build centos 6.4 servers)17:49
*** jcooley_ has quit IRC17:51
*** jerryz has joined #openstack-infra17:51
*** dizquierdo has quit IRC17:52
*** derekh has quit IRC17:53
zarofungi: only if it's mentioned in ps 1?  what if the first time mentioned was somewhere > ps 1?17:53
fungizaro: then it won't automatically add a comment on the bug until it merges17:54
zarofungi: ok.  that's better than not at all.17:54
fungiright now that script maintains no state, and merely guesses based on the patchset number whether it should mention itself on the bug or not17:55
*** sandywalsh has joined #openstack-infra17:55
*** adalbas has joined #openstack-infra17:56
*** dolphm_afk is now known as dolphm17:56
bnemecdhellmann: sdague clarkb devananda: So the reason this got missed in Oslo is that it was only locking for postgres runs, which we don't do in Oslo.17:56
bnemecWhich is a bad thing for it to be doing anyway, obviously.17:56
bnemecAlso, I poked at the parallel testing thing the other day and ran into other issues besides the kombu tests.17:56
bnemecHaven't had a chance to look into it further.17:57
*** jerryz_ has joined #openstack-infra17:57
devanandabnemec: so, your fix,, seems to be what clarkb would like to avoid. that is, there's no need for a global lock at all around db tests17:58
*** nati_ueno has joined #openstack-infra17:58
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add new doctools project
bnemecdevananda: Yeah, that was a "better than what we had" change, not a final fix.17:58
devanandabnemec: ah, ok17:58
bnemecI'm very interested in the separate schemas because I'm pretty sure this locking is rather error prone right now.17:59
*** jerryz has quit IRC18:00
*** SergeyLukjanov has joined #openstack-infra18:00
bnemec(for example, if someone writes a test and forgets to add the lock decorator, or adds the wrong one, we might delete the db out from under them)18:00
*** SergeyLukjanov has quit IRC18:01
*** SergeyLukjanov has joined #openstack-infra18:02
*** morganfainberg is now known as needscoffee18:02
*** rnirmal has joined #openstack-infra18:03 failed, fix incoming18:05
*** needscoffee is now known as morganfainberg18:06
*** senk has quit IRC18:09
openstackgerritClark Boylan proposed a change to openstack-infra/config: Handle lack of rpms or debs in devstack-cache.
*** SergeyLukjanov_ has joined #openstack-infra18:09
clarkbjeblair: fungi ^ quick review on that would be good (to keep image builds working, as an alternative we can revert the change)18:10
clarkblet me paste the traceback in the gerrit coments too18:10
*** SergeyLukjanov has quit IRC18:12
clarkbfungi: thinking about your comment, that would be better, but do I want to fix that as part of this change?18:13
fungiup to you. i can +2 and add a follow-on patch with my suggestion18:14
jeblairclarkb: i like fungi's suggestion.  your call as to whether you want to fix now.  consider you have my +2 either way.18:14
devanandaclarkb: do you know if any othe rprojects use a periodic jenkisn job to keep their etc/$project/$project.conf.sample up to date?18:14
clarkbok let me just do it properly as fungi suggests18:14
clarkbdevananda: I don't18:14
jeblairclarkb: 1 sec18:14
jeblairclarkb: actually... i think we should gracefully handle not having either18:14
*** nicedice has joined #openstack-infra18:14
fungioh! interesting. what's the use case?18:15
jeblairthe use case is not needing any additional packages...18:15
fungibase image with no added packages at all maybe?18:15
jeblairthat seems unlikely, but possible.18:15
jeblairokay, i retract that, and agree with fungi's suggestion....18:15
jeblairbecause it's so unlikely at this point it's probably an error18:16
clarkbjeblair: ok18:16
jeblairand, hey, if we ever hit it, it'll be easy to fix.  :)18:16
fungimaybe a safer way to address the bare install use case would be to have an optional "none" key for those rarities18:16
jeblairfungi: right, but now we're getting into devstack territory; complicated.18:17
fungito be able to say "yes, i really don't want to add anything, it's not a mistake"18:17
jeblairfungi: these items are filled by examining devstack.18:17
fungiahh, very true18:17
fungii keep forgetting that the script is extremely devstack-implementation-detail-specific anyway18:18
jeblairfungi: so i think we're far more likely to hit the proposed exception line because something in this complex interaction broke, than we are because suddenly devstack doesn't actually require additional packages.18:18
fungicompletely agree there, and it's the former which worries me18:19
openstackgerritClark Boylan proposed a change to openstack-infra/config: Handle lack of rpms or debs in devstack-cache.
clarkbhow does that look?18:19
*** osanchez has quit IRC18:23
jeblairclarkb: aprvd18:24
fungiclarkb: the only reason the original patchset worried me at all was that it was taking us from a "everything breaks when no debs are specified" to "silently succeed when no debs are specified" with no fallback in case that was actually a mistake18:25
*** branen has quit IRC18:27
openstackgerritA change was merged to openstack-infra/config: Handle lack of rpms or debs in devstack-cache.
*** markmcclain has joined #openstack-infra18:27
*** markmcclain has quit IRC18:29
mferfolks, I'm starting to poke around I was wondering if there was a way I could automate the testing18:30
mfermaybe even against more than one version of Go18:30
mferanyone have any pointers where I could get started?18:30
*** jpich has quit IRC18:30
clarkbmfer: the openstack-infra/config project has modules/jenkins/manifests/params.pp and slave.pp. In there you can list the packages you need and get them to be installed18:31
clarkbour test slaves are precise and centos currently which may not give you up to date Go out of the box. I think go gcc is 1.0 on precise maybe18:31
mfercan you install from an outside PPA?18:32
*** melwitt has joined #openstack-infra18:32
clarkbbut basically you would use those puppet manifests to install Go, then you can add jobs in modules/openstack_project/files/jenkins_job_builder/config and have zuul run them with modules/openstack_project/files/zuul/layout.yaml18:32
fungiright. for anything which is not provided officially in ubuntu 12.04 (or in ubuntu cloud archive for precise once we get it added), you'd need to provide your own local install which ran under the same unprivileged user as the tests themselves18:32
*** ryanpetrello has joined #openstack-infra18:33
mferso, i'd need to create a jenkins job that installed go as the unpriviledged user and then run the test suite18:34
clarkbthere is a golang package too, not sure what version of go that provides on precise18:34
mferi'd want to test against 1.1 for now and 1.2 in a few weeks when it comes out18:34
*** ^d has quit IRC18:34
mferi might want to have it run against 2 different versions18:35
fungiwe have made a couple of ppa exceptions, but those are under some very specific circumstances... they're backports of packages available in trusty (14.04 lts), the ppas are maintained by ubuntu devs, and their use is purely to support officially-sanctioned testing initiatives (py3k and pypy conformance specifically)18:35
* clarkb installs golang on precise to see what that gets him18:35
clarkbright what is 2:1-5?18:36
fungithat seems to me to be pre-1.0.x18:36
*** dolphm_ has joined #openstack-infra18:37
clarkbgo version go118:37
sdaguewait, are we really putting go in the gate? does that mean we have to stop with the go jokes? :)18:38
fungitrusty has 1.1.2 which seems to be flowing in from debian, so if the ubuntu golang maintainers import 1.2 after release and before the freeze for trusty, we'll likely be able to provide access to it on our slaves around the middle of next year18:39
jog0sdague: ping18:39
*** reed has joined #openstack-infra18:39
*** dolphm has quit IRC18:39
jog0got a hard bug fingerprint, wanted to get a second pair of eyes on it18:39
mferso, ideally this would only be a gate for golang-client and nothing else18:39
clarkbmfer: bothers me18:40
sdaguejog0: ok, realize I'm tethered on 1xRTT right now (in a car)18:40
sdagueso ... slowness18:40
mferand the install should really only happen for golang-client if nothing else needs it. is that possible?18:40
jog0sdague: never mind18:40
jog0clarkb: ^  looking for a second pair of eyes on an elasticsearch query18:40
*** mrmartin has joined #openstack-infra18:40
clarkbmfer: the gophers PPA is apparently deprecated in favor of a much less automagic friendly process18:40
mferwell, isn't that fun18:41
sdaguejog0: if you have time, there is also an image race that's showing up a lot, that's not yet fingerprinted18:41
clarkbthat said writing a puppet module to deal with the less automagic friendly process may be the way to go18:41
jog0will keep my eyes out18:41
sdagueI think that's the only one I regularlly see pop in the tempest channel as unknown bug18:41
mferclarkb can it only be installed when the golang-client needs it and not for everyone else?18:41
jog0image race as in which project18:41
jog0I found a libvirt issue18:41
jog0libvirt is stacktracing :/18:41
clarkbmfer: you could encode that into your build stuff yes18:42
sdagueit's in setupClass of a compute test on ImageFilters18:42
fungijog0: this is with 0.9.8 right?18:42
sdaguesetupClass is building 3 images18:42
clarkbmfer: have a little wrapper that grabs godeb, installs go, if go is not already present in the workspace18:42
* jog0 checks18:42
sdagueand it seems like sometimes they don't complete18:42
clarkbmfer: that should all work as an unpriviledged test user, it will make the initial test run longer but once go is available shouldn't be much of a time sink18:42
jog0fungi: yes 0.9.818:42
jog0sdague: will keep my eye out for that one18:43
clarkbthough godeb may want to do a global install18:43
mferclarkb thanks. i'll investigate this further. this is my first time doing any of this in the openstack infrastructure.18:43
sdaguejog0: you should take that one to the ML and get danpb looped in. It's helpful to have the libvirt maintainer on the project :)18:43
clarkbmfer: cool, let me know how that goes, I am curious now18:44
fungijog0: perhaps that will increase developer interest in bug 1228977 in that case (i haven't had time to grab more info other than simply to confirm that 1.1.1 is probably still broken, but perhaps in different ways than 1.0.6 was)18:44
uvirtbotLaunchpad bug 1228977 in nova "n-cpu seems to crash when running with libvirt 1.0.6 from ubuntu cloud archive" [High,Confirmed]
clarkbmfer: think of it this way, if there is a non crazy way to build golang in your homedir as an unprivileged user, jenkins should be able to deal with that18:44
jog0fungi: good idea,18:44
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add a zuul client
jeblairthat was fun! ^18:45
fungijeblair: !!!18:45
jeblair"zuul enqueue --trigger gerrit --pipeline gate --project gtest-org/test --change 2372 --patchset 1"18:46
clarkbjeblair: the discussion mfer started may interest you (how to get newish Go on our test slaves)18:46
jog0something is wrong with that page18:46
clarkbdid the json jobs stop working?18:47
clarkbjog0: any new changes to e-r?18:47
fungijeblair: would this be a viable replacement for the trigger-job script?18:47
clarkbI am going to start a new hpcloud az1 image build18:47
jeblairjog0: you might try running the json output from e-r locally18:47
jeblairfungi: trigger-job script?18:47
*** ryanpetrello has quit IRC18:48
jeblairfungi, clarkb, jog0: "zuul enqueue" is to replace our use of "reverify no bug" (also, 'recheck no bug') when we go mucking with the zuul queue.  is pre-req for disabling 'reverify no bug'.18:48
fungijeblair: i get that it gives us a backdoor other than recheck/reverify comments for infra requeuing of changes, but wondering if we can also work zuul/tools/ into the client mostly as-is?18:48
clarkbjeblair: it is a prereq so that infra can redo those jobs without other core approval?18:49
jeblairfungi: ah, yes, is intended for that too, but needs a little expansion to handle extra fields that post jobs have.18:49
jeblairclarkb: yes, or using admin powers.18:49
mferclarkb pm?18:50
clarkbmfer: sure. though feel free to keep discussing here (jeblair and fungi and others are full of good ideas too)18:50
*** ^d has joined #openstack-infra18:50
*** ^d has joined #openstack-infra18:50
jog0clarkb: no new changes that I know of18:51
clarkbjog0: I would try what jeblair suggests, run the json output job locally18:51
jog0running '/ queries.yaml'18:51
*** ryanpetrello has joined #openstack-infra18:51
*** boris-42 has joined #openstack-infra18:54
*** branen has joined #openstack-infra18:57
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add a zuul client
dkranzclarkb: Is there an example of doing queries against logstash from python rather than the web ui?18:59
clarkbdkranz: in elastic-recheck18:59
clarkbdkranz: but not as documentation. pyelasticsearch is the lib elastic-recheck is using19:00
dkranzclarkb: ok, great.19:00
clarkbwhich does have documentation. There is also an elasticsearch client. Which we should look at at some point probably19:00
dkranzclarkb: Yeah, it is pretty useful stuff19:00
jeblairjog0: able to reproduce the e-r page bug, or do i need to look for a failure on the server?19:01
dkranzclarkb: I was going to use it to report on the frequency of the log error bugs in the whitelist19:01
clarkbdkranz: you can probably overload e-r to do that, maybe have a class of "bug" that doesn't report as a reason for failure, but can still be tracked19:01
clarkbwould require updating e-r but I think that use case is a good one19:02
*** talluri has quit IRC19:02
*** talluri has joined #openstack-infra19:02
dkranzclarkb: That's possible. I'll take a look.19:03
mferit appears godeb will ask for a password if now executed under sudo. so, that's out for a newer version of go19:03
clarkbmfer: if we bootstrap godeb with puppet it will run as root. The puppet to do that isn't terrible, but can be clunky as you have to wget the file, check sha1/md5, then run the commands to do an actual install19:04
clarkbwaiting on image builds is slow going. /me looks at zuul client19:05
*** mihgen has joined #openstack-infra19:05
jeblairclarkb: i don't expect we would do that for a non-openstack project19:05
clarkbjeblair: the build via puppet dance?19:06
jeblairclarkb: yep.19:06
mferjeblair it's a stackforge project19:07
mferan existing one. is that going to be fairly different19:07
jeblairthe build environment is primarily for openstack projects; if stackforge projects find it useful, they're welcome to use it, but that's not the main objective19:07
mferis there a way to do something different for stackforge projects?19:08
*** luisg has joined #openstack-infra19:08
jeblairmfer: different than what?19:08
openstackgerritAndreas Jaeger proposed a change to openstack-infra/config: Add new openstack-doc-tools project
mferwell, this is a language bindings. it would be idea to test it against the api.19:08
mferand it's in a language other than python to make the openstack api accessible in other languages19:09
mferhow can we test that well?19:09
*** ruhe has joined #openstack-infra19:10
jeblairmfer: the best bet would be to become an openstack project.19:11
jeblairmfer: some background:19:11
jeblairmfer: we have limited resources (especially people) and very complex systems, so we focus primarily on openstack projects19:12
jeblairmfer: in fact, that's what the TC asked us to do when they 'blessed' stackforge19:12
jeblairmfer: so we focus on configuring the test systems to be able to test where openstack is focused, we aren't able to accomodate test scenarios for stackforge projects that require significant work outside of that environment.19:13
pleia2jeblair: to make sure I tested the right thing, your comment re: is that you don't think we need that install headers line at all in anymore19:14
mferjeblair so, for example, we should try to get the golang-client to become an openstack project so we can update the testing environment for that. if it's going to remain on stackforge it may need outside testing. do I have that right?19:14
*** yolanda has joined #openstack-infra19:15
jeblairmfer: that's about the gist of it, at the moment at least.  unless you can get everything you need installed as an unprivileged user (i don't know how hard that is but could imagine it's not easy), or we change something about our test infrastructure (there are some plans in this area that may help but not immediately)19:15
jog0jeblair: e-r graph seems to work19:16
jeblairmfer: however, i do think it's worth exploring getting official recognition for your project...19:16
mferjeblair ok, i've got it19:16
*** fbo_away is now known as fbo19:16
jeblairmfer: as a user, i personally think that good client libs are something worth supporting.19:16
mferjeblair i agree entirely. i'd just like to have a better way to test them.19:17
clarkbjeblair: fungi: woot image build is working now. I will approve dprince's nodepool fedora job after lunch when I have time to babysit that19:17
mferi'll keep poking around and see what I can come up with19:17
jeblairmfer: i'm not sure how familiar you are with our community processes, governance, etc...19:18
jeblairmfer: but if you'd like to learn more about becoming an official program, you might start here:
jeblairmfer: or just start a thread on the openstack-dev mailing list about how the project can support client library efforts19:19
mferjeblair before I do that I think I'd like to see the codebase get into a relatively usable shape and have more than me looking at it. I just got the keys from the original developer who hasn't touched it in months19:21
mferi'll be thinking of it but i'd like to have the project be worthy of that and if something happened to me it wouldn't stop19:21
fungiif it's the project i'm thinking of, it never got touched after the initial import into our code review system19:21
*** jcooley_ has joined #openstack-infra19:22
mferyeah, pretty much19:22
*** pblaho has joined #openstack-infra19:22
mferi spoke with the dev. it seems they pivoted away from openstack so the work stopped19:22
jog0jeblair: so server logs may be in order19:24
jeblairmfer: i should add one more thing...19:26
jeblairmfer: if you want to run tests against a running openstack (as set up by devstack) -- those happen on single-use slaves19:26
jeblairmfer: and the test process starts with full root access.  so it actually should be pretty easy to do whatever you want in that case19:27
jeblairmfer: but i don't think we want to run unit tests on servers like that yet; so please don't abuse those19:27
jeblair(that's one of the projects that may make this easier in the long run, but we're not there yet)19:28
mferis there a plan to get there so I can abuse them?19:28
clarkbI am going to AFK here for a bit, running low on laptop battery and need to move from suburbs to city also lunch19:29
*** wenlock has quit IRC19:30
jeblairmfer: soon, i hope.19:30
*** rongze has quit IRC19:30
*** rongze has joined #openstack-infra19:31
fungiin about 45 minutes i have to disappear for an appointment and then to grab dinner, but hope to be back to working on things by 2300 utc19:32
*** nati_uen_ has joined #openstack-infra19:32
jeblairjog0: looks sane19:32
jeblairjog0: js console log makes it look like a flot related error19:33
*** CaptTofu has quit IRC19:34
jog0jeblair: ahh so needs an update to make things ints?19:34
*** CaptTofu has joined #openstack-infra19:34
*** ryanpetrello has quit IRC19:35
jeblairjog0: flot is the graphing library19:35
*** nati_ueno has quit IRC19:35
*** wenlock has joined #openstack-infra19:35
*** rongze has quit IRC19:36
devanandahas jenkins stopped submitting changes to global-requiremetns to individual projects?19:37
clarkbyes, it didn't work so we stopped it19:40
lifeless is ready for a second +219:40
*** pblaho has quit IRC19:44
zulhow can you find out a specific dependency version installed by tox19:46
lifelesspip freeze in the vm19:47
lifelesssorry, virtualenv19:47
jog0jeblair: oh19:47
jeblairjog0: bug 1225664 has no data in the json19:47
uvirtbotLaunchpad bug 1225664 in devstack "Swift: No space left on device" [Undecided,Fix committed]
*** CaptTofu has quit IRC19:47
*** CaptTofu has joined #openstack-infra19:48
jog0jeblair: in the past that ment the graph was just empty19:48
jog0at least thats what I thought19:48
*** jcooley_ has quit IRC19:49
jeblairjog0: yep.  i think flot updated.  it's CD.19:51
jeblairjog0: i have an old version locally, and it produces an empty graph.19:51
fungijgriffith: not sure whether you're around, but are you okay with (gating on cinderclient unit tests under pypy)?19:51
jog0jeblair: ahh19:52
jeblairjog0: i'll fix it19:53
jog0jeblair: thanks19:53
*** sgordon has left #openstack-infra19:54
*** jerryz_ has quit IRC19:57
*** jcooley_ has joined #openstack-infra19:58
*** rongze has joined #openstack-infra20:01
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Don't draw an e-r graph if no data
jeblairjog0: ^20:01
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Don't draw an e-r graph if no data
mferclarkb jeblair thanks for the help and pointers today.20:02
* mfer goes to relax now20:02
jeblairmfer: you're welcome.  sorry it isn't easy.  have fun!20:03
*** mfer has quit IRC20:03
jeblairwhat's a one-word imperative for "move something to the head of the queue"?20:04
*** vipul is now known as vipul-away20:06
*** vipul-away is now known as vipul20:06
reedI hear people yell "coming through" when they need to get off the bus20:06
*** rongze has quit IRC20:06
*** jcooley_ has quit IRC20:07
*** mihgen has quit IRC20:08
*** ruhe has quit IRC20:10
*** nati_uen_ has quit IRC20:14
lifelessI like bump20:15
pleia2I'd say jump20:16
lifelessoh man, ear worm20:17
lifelessjump, jump, jump, jump20:17
*** reed has quit IRC20:17
openstackgerritJeremy Stanley proposed a change to openstack-dev/pbr: Make ChangeLog more condensed
openstackgerritJeremy Stanley proposed a change to openstack-dev/pbr: Let git do mailmap mapping for us
fungilifeless: ^ tried addressing your suggestions on mordred's 52367 change there20:19
* fungi disappears for the next few hours20:19
*** nati_ueno has joined #openstack-infra20:20
*** vipul is now known as vipul-away20:21
*** jcooley_ has joined #openstack-infra20:23
*** mihgen has joined #openstack-infra20:25
*** adalbas has quit IRC20:28
lifelessfungi: thanks; reviewed.20:29
*** rongze has joined #openstack-infra20:31
*** fbo is now known as fbo_away20:31
*** mrmartin has quit IRC20:31
jeremyboh, is this where i knew pleia2's nick from? :)20:33
pleia2jeremyb :)20:33
^djeremyb: We need to stop hanging out in the same channels ;-)20:34
*** vipul-away is now known as vipul20:35
jeremybhah, but i knew chad was here20:36
jeremyb^d: was poking in #ubuntu and then later #ubuntu-website yesterday and pleia2 is the one that answered my question. i knew the nick was familiar but didn't know why20:37
fungiha, the optometrist office has an unsecured access somewhere nearby. hacking continues20:38
*** rongze has quit IRC20:40
openstackgerritA change was merged to openstack-infra/reviewstats: Reformat nova.json
openstackgerritA change was merged to openstack-infra/reviewstats: Add mriedem and dan-prince to nova-core
jgriffithfungi: delayed response but yes :)20:41
jgriffithfungi: added my +120:41
fungijgriffith: awesome. approving in that case. thanks!!!20:41
jgriffithfungi: welcome20:41
*** hashar has joined #openstack-infra20:43
*** weshay has quit IRC20:44
fungijeblair: also, my vote is for "jump the queue" since it's an established phrase with very similar implications20:44
*** yolanda has quit IRC20:44
openstackgerritA change was merged to openstack-infra/config: Run the cinderclient tests under PyPy in gate and check
fungiAlex_Gaynor: ^20:45
Alex_Gaynorfungi: thakns20:45
*** dolphm_ has quit IRC20:50
*** lcestari has quit IRC20:51
*** talluri has quit IRC20:52
fungiwow, that was a quick appointment. going to grab a bite and then back for more asap20:57
*** rwsu has quit IRC20:57
jeblairfungi: last appt before the optometrist goes home for the holiday? :)20:58
*** senk has joined #openstack-infra21:03
jesusaurusclarkb: did you ever resolve your elasticsearch garbage-collection woes?21:03
*** denis_makogon_ has joined #openstack-infra21:03
*** senk has quit IRC21:04
clarkbya I made the object cache GCable21:04
clarkblook in my json files one of them sets the flag21:05
*** markwash has quit IRC21:06
*** sarob has joined #openstack-infra21:08
*** fbo_away is now known as fbo21:09
Alex_GaynorIs pip broken or something?
*** wenlock_ has joined #openstack-infra21:15
jesusaurusclarkb: you may be interested in
jesusaurusare you sure you solved your problem?21:16
clarkbarg I guess not21:18
clarkbI havent had memory trouble since upgrading though21:18
*** wenlock_ has quit IRC21:20
jesusaurusI guess I should make upgrading more of a priority21:21
*** senk has joined #openstack-infra21:25
clarkbI am on 0.90.321:25
*** dolphm has joined #openstack-infra21:27
jesusaurustheyve released a 1.0.0-beta, so I was hoping to hold out for a 1.0.121:28
jesusaurusbut if I can online-upgrade to 0.90.5 I might try to do that21:28
clarkbAlex_Gaynor will look as soon as I figure out wifi here21:29
Alex_Gaynorclarkb: hehe, thanks21:29
*** ^d is now known as ^demon|meeting21:30
*** markwash has joined #openstack-infra21:30
*** rongze has joined #openstack-infra21:34
*** Loquacity has joined #openstack-infra21:36
*** senk has quit IRC21:36
*** mihgen has quit IRC21:36
*** jhesketh has joined #openstack-infra21:37
*** mrmartin has joined #openstack-infra21:38
*** rongze has quit IRC21:39
* clarkb is still waiting for the text with the confirmation code... go PSU21:40
*** mrmartin has quit IRC21:42
*** mattoliverau has joined #openstack-infra21:45
clarkbwoo I think I have teh internets now21:50
*** jcoufal has quit IRC21:52
clarkbapproving the fedora nodepool change now then looking at Alex_Gaynor's test failure21:52
*** talluri has joined #openstack-infra21:53
clarkbAlex_Gaynor: pbr require pip>=1.4, I think it found pip 1.0 which is the system installable version on precise21:54
Alex_Gaynorclarkb: so, what's up with the failing test, I didn't touch any of that :-)21:54
clarkbI have no idea, maybe grenade isn't reliably upgrading pip for us?21:54
clarkbmordred: if you are around ^ would be somethign you should look at21:54
*** nati_ueno has quit IRC21:55
openstackgerritA change was merged to openstack-infra/config: Add Fedora 19 to the nodepool (devstack-f19-check)
*** nati_ueno has joined #openstack-infra21:55
*** thomasem has joined #openstack-infra21:56
*** talluri has quit IRC21:57
jgriffithmikal: updated
uvirtbotLaunchpad bug 1254932 in cinder "Grenade failures due to failing to attach a volume" [High,Confirmed]21:57
jgriffithmikal: sadly I'm not sure what the root is yet, may need help from somebody more familiar w/ oslo's rpc and lock code21:58
*** SergeyLukjanov_ has quit IRC21:58
*** julim has quit IRC21:59
*** pcm__ has quit IRC21:59
clarkbI went ahaed and approved it got a lot of testing according to the comments and looks simple enough22:02
jeblairclarkb: do you have a 'test that a certain exception is raised' pattern handy?22:02
*** slong has joined #openstack-infra22:02
clarkbjeblair: for python?22:02
clarkbtesttools has an assert that checks a function results in a particular exception being thrown22:03
jeblairclarkb: that's what i'm after22:03
*** talluri has joined #openstack-infra22:03
clarkbI will grab a link to the docs22:03
jeblairclarkb: istr discussion about the right way to do this recently22:03
clarkbjeblair: assertRaises and expectedException22:04
jeblairclarkb: thx22:04
openstackgerritA change was merged to openstack-infra/config: create a jobwrapper span to address long job names spillover
clarkbpleia2: re did you test just the commands or the entire python module? (I think testing just the commands is reasonable, btu curious to know what was done)22:05
*** jcooley_ has quit IRC22:06
clarkbzaro: did you see my comment on ?22:07
*** talluri has quit IRC22:08
pleia2clarkb: I created a local.pp with the vcsrepos and exec commands for both22:09
clarkbpleia2: woot thanks22:10
clarkbI am going to remove the WIP tag22:10
clarkbsomeone with better bash foo than me. does putting the -d and -f in those variables do the right thing in test?22:11
clarkblocal testing for me seems to indicate we will just get true returned, but then how did the gate pass?22:13
lifelessclarkb: should22:16
*** boris-42 has quit IRC22:16
lifelessTE="-f /etc/hostname"22:17
lifeless$ [ $TE ] && echo yes22:17
lifeless[ ! $TE ] && echo yes22:17
*** thomasem has quit IRC22:18
clarkbya, I got it to work, apparently bash doesn't like it when give the var a value on the same line as test22:18
*** mrda has joined #openstack-infra22:18
clarkbis that because I was using a built in?22:23
*** alexpilotti has quit IRC22:24
*** alexpilotti_ has joined #openstack-infra22:24
clarkbno that doesn't seem to be it, I give up. More things to review22:24
fungijeblair: yes, i think she got the last eye exam before the optometrist headed out for a chilly five-day golf weekend or something22:25
*** jhesketh__ has joined #openstack-infra22:25
*** mattoliverau has quit IRC22:26
*** hashar has quit IRC22:30
*** michchap has quit IRC22:30
*** dolphm has quit IRC22:31
fungiclarkb: cool on 58360. i know it's annoyed at least a few people, including me, but was cosmetic so i had a hard time prioritizing the review ahead of my stale backlog22:31
clarkbI have approved, it won't take effect until nodepool restarts which I probably won't get to today (iirc jeblair has said approving nodepool changes in this manner is ok)22:31
clarkbfungi: yeah, I just got irritated enough to go review the fix22:31
clarkblooks so much better now22:32
openstackgerritA change was merged to openstack-infra/nodepool: Add ability to filter on flavor name
clarkbthough uhm, nodepool seems unhappy currently? maybe related to the f19 change? /me looks22:33
openstackgerritA change was merged to openstack-infra/nodepool: Fix old pre-nodepoold reference in README
*** michchap has joined #openstack-infra22:33
clarkbfungi: when you are back from dinner a second set of eyes may be handy22:33
mgagneclarkb: remember puppet-lint and literal $ symbols? xarses is about to fix that one:
clarkbgah, I think I see what the problem is22:33
clarkbmgagne: \o/22:33
zaroclarkb: yes. saw your comments. not sure how to verify diff list.  can mordred do that?22:34
clarkbfungi: jeblair: I am stopping puppet on nodepool.o.o to test really quick without puppet interferring22:34
clarkbzaro: you should be able to create those lists locally and make sure they are sane22:34
fungiclarkb: on 55827 the test builtin (and test itself) may be reporting on the *string* being nonzero length, which is an unfortunate default behavior22:34
*** rongze has joined #openstack-infra22:35
clarkbfungi: no once I put the variable setting on its own line it got happy22:35
clarkbfungi: not sure what was happening there22:35
fungiahh, yeah i think if you'd wrapped the invocation in "" that would have been the case, but what you have there is (probably?) okay22:37
clarkbfungi: yeah and it passes devstack-gate which it shouldn't if my question was an actual issue22:38
clarkbI have fixed nodepool locally, pushing a patch momentarily22:38
zaroclarkb: hmm. doesn't the check-requirements  job run on mutliple projects?22:38
zaroclarkb: is checking one project enough to verify?22:39
clarkbzaro: yes, but you can run that script on a VM of yours22:39
clarkbno checking one projects isn't enough22:39
*** rongze has quit IRC22:39
zaroclarkb: ok. so to narrow the scope, is there a list of projects we should verrify agains?22:40
clarkbzaro: the list of projects in the devstack project list22:41
clarkbzaro: there is a variable in devstack or devstack gate that lists them all22:41
openstackgerritClark Boylan proposed a change to openstack-infra/config: Properly escape Schrodinger's Cat in yaml.
fungiclarkb: zaro: not ?22:43
fungiyay quote escaping22:44
*** pete5 has quit IRC22:44
clarkbfungi: jeblair ^ I am watching nodepool with that change in place locally, it seems much happier22:44
* fungi will name his next release ☃22:44
clarkbaccording to graphs we are building a lot of servers22:45
fungithat is indeed a jarring change in the graph22:46
clarkbNotFound: No Image matching {'name': "Fedora 19 (Schrodinger's Cat)\n"}. (HTTP 404) apparently that made nodepool happy but not completely happy22:47
* clarkb does a nova flavor-list22:47
clarkber image-list22:48
fungiyeah, ram and disk sizes won't help you here22:48
openstackgerritA change was merged to openstack-infra/config: Properly escape Schrodinger's Cat in yaml.
clarkboh the yaml string literal added a newline22:49
* clarkb reads more about yaml strings22:49
mgagneclarkb: was about to comment: In JJB, double-quotes works for me. Can't say for nodepool.22:49
*** flaper87 is now known as flaper87|afk22:49
fungimgagne: so "Fedora 19 (Schrodinger\'s Cat)" i guess?22:49
mgagneno escape22:49
zarofungi: clarkb : ok, will do a few, but not all of those projects22:50
clarkbmgagne: it is the same yaml parser, I will give that a try22:50
fungier, right, base-image: "Fedora 19 (Schrodinger's Cat)"22:50
*** denis_makogon_ has quit IRC22:51
*** paul-- has joined #openstack-infra22:51
*** senk has joined #openstack-infra22:53
clarkbgah, git log is going to be ugly22:54
fungiclarkb: ?22:55
*** dkliban has quit IRC22:56
openstackgerritClark Boylan proposed a change to openstack-infra/config: Properly escape Schrodinger's Cat in yaml.
clarkblets try that22:57
*** jhesketh__ has quit IRC22:58
*** jhesketh__ has joined #openstack-infra22:58
* fungi will clearly approve *anything* the night before a major holiday... click!22:59
openstackgerritKhai Do proposed a change to openstack-infra/config: setup gerritbot messages to openstack-doc channel
clarkbfungi: 58871 is happier, but now we have quota limits on key errors for rax nodes23:00
clarkband it can't copy things to /opt apparently23:00
clarkbjeblair: fungi: either of those errors have an apparent cause?23:01
*** loq_mac has joined #openstack-infra23:02
*** paul-- has quit IRC23:02
*** mattoliverau has joined #openstack-infra23:04
*** talluri has joined #openstack-infra23:04
jeblairclarkb: there's weird sudo stuff going on in nodepool scripts, you have to be careful.23:04
jeblairclarkb: i don't understand 'quota limits on key errors for rax nodes'23:05
clarkbjeblair: let me get the exact error message23:05
*** paul-- has joined #openstack-infra23:05
clarkbOverLimit: Quota exceeded, too many key pairs. (HTTP 413)23:05
mgagnejeblair: isn't it related to ssh keys quota?23:05
jeblairmgagne: yes, sounds right23:05
clarkbmgagne: I think it is, but why would nodepool be trying to use different keys?23:05
clarkbshouldn't it use the existing key?23:05
jeblairclarkb: it creates a key for each node it spins up23:05
mgagnejeblair: AFAIK, a temp key is created before spawning a slave. in case of failure, I suspect keys aren't cleared properly OR too many slaves are spawn at the same time.23:06
clarkbjeblair: interesting, maybe it will be happy once the number of concurrent nodes it is spinning up falls?23:06
clarkbjeblair: I will poke at key listing to see if there is any obvious stale stuff23:06
jeblairclarkb: i would not be surprised if there has been significant leakage23:06
jeblairhopefully should be getting better now that the cleanup thread is working23:07
clarkbthere are definitely a bunch of keys there23:07
clarkbtrying to correlate them (or fail to) to existing servers23:08
*** talluri has quit IRC23:08
mgagnejeblair: looks like there's no metadata linked to keypair, there is no way to tell how old the key is.23:08
clarkbthere doesn't seem to be a 1:1 map between keypair and slave either23:09
fungithat's... well, gross is the only word which comes to mind23:10
*** eharney has quit IRC23:10
fungithey give you a quota on something autogenerated, but no correlation to what generated it23:11
*** alexpilotti_ has quit IRC23:11
clarkbthe keypair names are devstack-precise-check-####### vs the rax-ord-##### stuff for servers23:11
clarkbor maybe that means those are keys for image builds instead of server launche?23:11
fungitoo many simultaneous builds?23:12
clarkbor too many builds that didn't clean up after themselves23:12
*** ryanpetrello has joined #openstack-infra23:12
fungialso, kudos on the fauxfrench launche23:12
fungii will have to use that23:12
clarkbha, that was a tyop :)23:13
clarkbso seems to be working, the problems are external to having the image name23:13
lifelessclarkb: and that wasn't ?23:13
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add a zuul client
clarkbtyop was an intentional typo23:13
*** ^demon|meeting has quit IRC23:13
*** jcooley_ has joined #openstack-infra23:14
jeblairclarkb: yes, keypairs should only be created for image builds23:15
*** senk has quit IRC23:15
jeblairclarkb: so i was wrong earlier.  sorry.  am actually reading code now.23:16
*** ryanpetrello has quit IRC23:17
jeblairclarkb: a server should have a key_name attribute linking it to a key23:17
jeblairclarkb: (that is, servers that are being used to build an image)23:18
clarkbjeblair: gotcha, will try going that direction23:20
jeblairnova show d732995d-0784-4de5-8550-bffb0b2469fe|grep key23:20
jeblair| key_name               | devstack-f19-check-1385594034                                        |23:20
*** fbo is now known as fbo_away23:20
jeblairclarkb: so, er, every other key in the list should be able to be deleted.23:20
jeblairclarkb: and since there are quite a number of 'devstack-f19-check' keys, it seems like there's a bug.23:21
*** jcooley_ has quit IRC23:21
*** rnirmal has quit IRC23:22
clarkbjeblair: I think the bug must be when you bomb out trying to copy /opt the keypair isn't being removed23:22
sarobwe have a problem with redirects on
clarkbjeblair: I have the normal jenkins account creds sourced, nova list only shows static slaves. Do I have the wrong account? too much stuff going on for my head to keep it all straight...23:23
jeblairclarkb: ORD region23:23
jeblairclarkb: is where i was looking23:23
clarkboh I bet the region is different23:24
sarobas listed in repo openstack-manuals/www/.htaccess, should be redirecting to
jeblairsarob: that's exactly what it does for me, though training-guides is a 40423:25
sarobyeah, that problem too23:25
sarobit builds in the correct dir locally23:25
clarkbjeblair: though, is it worth cleaning those keys now if they are just going to leak all over again? probably better to fix the nodepool bug first23:25
jeblairclarkb: depends on if you want image builds to work or be broken23:26
sarobjeblair: i just updated the .htaccess file23:26
sarobjeblair: and renamed training-guide to training-guides and updated the pom.xml23:26
*** fifieldt has joined #openstack-infra23:27
sarobfifieldt jeblair idea why this went sideways?23:28
jeblairsarob: sorry, i'm digging into another problem now23:28
sarobnp, let me know if there is something i should be changing23:29
jeblairsarob: here are logs for your change
jeblairsarob: you might look for errors there23:30
fungisarob: training-guides vs training-guide (i see the latter on the ftp site). computers are fairly unfamiliar with the singular vs parallel dilemma in english?23:30
*** alexpilotti has joined #openstack-infra23:30
clarkbjeblair: are you digging into the nodepool thing?23:31
jeblairclarkb: yeah23:31
jeblairclarkb: i'm not trying to fix anything, that's all you23:31
jeblairclarkb: i'm trying to understand if the keys were attempted to be deteleted23:31
clarkbjeblair: ok, I don't think deleting keys will help anything until nodepool is happy, as the image builds will continue to leak23:32
clarkb* will continue to leak keys23:32
jeblairclarkb: very slowly, it'll work for a couple months23:32
*** heyongli has joined #openstack-infra23:33
fungisarob: it may be that training-guide is a greedy match which also matches a substring of training-guides23:33
clarkbjeblair: I will delete keys to see in that case23:33
fungisarob: but anyway, it looks like things are only being published into the "trunk/training-guide" (singular) directory. i don't see the plural version existing on the ftp server23:34
clarkbjeblair: there are a bunch of f19 keys from failed builds23:34
clarkbjeblair: I think it will leak quite quickly until f19 builds work23:34
jeblairclarkb: definitely.  i thought you fixed them.23:35
clarkbno, I was looking at the key thing :)23:35
clarkbI will look at the /opt stuff now23:35
jeblairclarkb: personally, i think you should revert the changes, delete the keys, and go have thanksgiving23:35
jeblairclarkb: but your call.  :)23:35
*** rongze has joined #openstack-infra23:36
clarkbjeblair: wfm (I do need to head out shortly), I will propose the revert now, modify the file by hand, delete keys, then start puppet when revert is in23:36
jeblairalso, we should not accept untested nodepool script changes.  i kind of thought these were tested.  i guess i'm going to have to be really really clear about asking that for each change.23:36
*** mattoliverau has quit IRC23:36
sarobfungi i think i figured it out the redirect is trunk/training-guide/ so it matches with the trailing /23:37
*** ryanpetrello has joined #openstack-infra23:37
sarobfungi: when adding back in the trailing string content the / has been matched and is gone23:37
clarkbjeblair: ++ I thought they were being tested offsite too23:38
clarkbnodepool config updated locally23:38
fifieldtsarob, you probably will need to pull in :
fifieldtand make changes there23:38
fungisarob: right, you may be hitting apache's implied rewrites matching on directory name23:38
fifieldtto get it to build23:38
*** dkliban has joined #openstack-infra23:38
*** rongze has quit IRC23:40
jeblairclarkb: ugh, nodepool is missing some logging info for me to be able to forensically determine what's going on.23:42
clarkbjeblair: :(23:42
openstackgerritClark Boylan proposed a change to openstack-infra/config: Revert "Add Fedora 19 to the nodepool (devstack-f19-check)"
clarkbjeblair: ^23:43
jeblairclarkb: aprvd23:43
*** paul-- has quit IRC23:44
fungisarob: fifieldt: so here...
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Improve image logging
fungiyou're passing "training guide" as a "manual" parameter to
fungithe openstack-{manual} job template23:45
fungithat wants to publish from doc/training-manual/target/docbkx/webhelp/**23:46
openstackgerritA change was merged to openstack-infra/config: Revert "Add Fedora 19 to the nodepool (devstack-f19-check)"
clarkbI am deleting f19 keypairs in ORD now23:46
fungi(er, passing "training-guide" with a hyphen i meant)23:46
fungiso probably the job name in openstack-infra/config needs to be pluralized in modules/openstack_project/files/jenkins_job_builder/config/projects.yaml and modules/openstack_project/files/zuul/layout.yaml23:48
fungisarob: fifieldt: ^23:49
fifieldtyes, I told sarob this over in docs :)23:49
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add a zuul client
fungififieldt: great! i'll shut up then ;)23:50
sarobfungi fifieldt: i working on it.23:50
fifieldthe's been very naughty :)23:50
sarobfungi fifieldt: thx for the reminder, im just scattered right now23:50
sarobfungi fifieldt: stupid thanksgiving makes everyone crazy23:50
fungisarob: i'm always scattered. no worries23:51
fifieldtOpenStack does that to us all, I'm beginning to believe23:51
fifieldtsarob, about 50% of our weekly staff meeting this week was regarding turkey23:51
fifieldtI can get the sense of it :D23:51
sarobthe smell is everywhere, not that im complaining about that part23:51
jeblairthis channel always smells like turkey23:52
sarobfifield fungi should i create it as a bug then patch?23:52
jeblairsarob: bugs aren't required for infra patches23:54
clarkbIAD is clean23:55
clarkbdouble checking ORD again23:55
fungisarob: what fifieldtb said. if your commit message explains what you're fixing, a bug on top of that is really just busywork i think23:55
fungier, jeblair sid that i guess. stupid irc client colors23:56
sarobfungi roger23:56
clarkbORD is clear23:56
*** dstanek has quit IRC23:57
*** ryanpetrello has quit IRC23:59
*** paul-- has joined #openstack-infra23:59

Generated by 2.14.0 by Marius Gedminas - find it at!