Wednesday, 2013-10-30

clarkbjamesmcarthur: gives me a message about needing to login to the schedule site and may be trying to talk to the last summit (in portland)00:03
clarkbjamesmcarthur: thought that may be related to the work you just did so FYI :)00:03
jamesmcarthurthanks! i'll pass that along.00:04
*** michchap has joined #openstack-infra00:05
*** Steap has joined #openstack-infra00:05
*** adrian_otto1 has joined #openstack-infra00:05
jamesmcarthurclarkb: no, but it's still something to be looked at.00:05
*** mriedem has joined #openstack-infra00:05
jamesmcarthurwill pass along to the foundation staff00:06
*** jesusaurus has joined #openstack-infra00:06
*** adrian_otto has quit IRC00:07
*** adrian_otto1 has quit IRC00:10
*** jamesmcarthur has left #openstack-infra00:10
*** SergeyLukjanov has joined #openstack-infra00:12
*** markwash has quit IRC00:14
*** smarcet has left #openstack-infra00:16
*** rakhmerov has quit IRC00:20
*** fbo is now known as fbo_away00:23
*** senk1 has quit IRC00:24
*** melwitt has quit IRC00:26
*** slong has quit IRC00:30
*** michchap_ has joined #openstack-infra00:30
*** matsuhashi has joined #openstack-infra00:30
*** hogepodge has quit IRC00:32
*** reed has quit IRC00:33
*** michchap has quit IRC00:33
*** oubiwann has quit IRC00:36
*** melwitt has joined #openstack-infra00:41
*** yaguang has joined #openstack-infra00:43
*** michchap_ has quit IRC00:44
fungisdague: looks like grenade's consistently failing after putting through00:46
clarkbfungi: I think that was a concern since we were asymettric before00:47
*** michchap has joined #openstack-infra00:47
fungieuca test failures in devstack for the ones i've looked at so far00:47
sdagueurg, it broke again ey? Do we have one that's made it all the way throught00:48
sdagueactually, euca I think is a different fail00:48
*** Ryan_Lane has quit IRC00:49
sdaguefungi: yuo got log url for one of these?00:49
sdaguegive me a few minutes to look before we straight revert it00:49
sdagueI need the logs server url00:49
fungii was just looking at console logs in jenkins for the ones i spotted in the zuul status page00:50
fungii can go hunting00:50
sdagueright, but I need the other artifact logs to figure out what's going on00:50
clarkbfor that one it is
sdagueperfect, thanks00:50
clarkbyou can do copy pasta with the scp copy paths to figure it out00:50
fungioh, clarkb beat me to one00:51
*** ericw has quit IRC00:53
sdagueok, so I think I know what broke.00:54
sdaguethis was actually the thing I was concerned would break, which is how does zuulifying "old" work00:54
*** SergeyLukjanov is now known as _SergeyLukjanov00:55
sdaguethat review is a nova change, and the logic in devstack-gate means that it actually set the old nova tree to the zuul master change00:55
*** jamesmcarthur has joined #openstack-infra00:55
*** _SergeyLukjanov has quit IRC00:55
fungiright, when we want to override it to look in havana^Wgrizzly00:56
fungigot any corresponding zuul ref, or fall back to branch tip00:56
fungier, for any00:56
*** jamesmcarthur has quit IRC00:57
*** julim has quit IRC00:57
sdagueso do we just need another $ZUUL_BRANCH=$BRANCH check?00:58
fungii think so, and at this point it should be self-testable since we're past the pre-reexec setup stuff00:59
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Only zuulify the tree if we are on the right branch
*** ericw has joined #openstack-infra01:00
sdagueI'm not sure01:01
*** ^demon has joined #openstack-infra01:01
*** ^demon has joined #openstack-infra01:01
sdaguethis would however explain the reverify bug I saw01:01
clarkbsdague: you missed a closing ] which isn't technically needed, but nice to have01:01
*** ^demon is now known as ^d01:01
sdaguealso, seriously, havana nova works with grizzly services except for ec2?01:01
fungialso, we do need to zuulify both branches i think, old and new, since there could be stable backport and master changes ahead of you in the queue01:01
*** sarob has quit IRC01:01
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Only zuulify the tree if we are on the right branch
sdaguefungi: we are01:02
*** sarob has joined #openstack-infra01:02
fungi[disclaimer: hadn't looked at the code yet, only the commit title]01:02
sdague511 is the new tree, and the old tree happens later01:02
openstackgerritMathieu Gagné proposed a change to openstack-infra/config: Remove use of undefined console-log-post publisher
clarkbdoes there need to be whitespace before the ]? bash whitespace rules always trip me up01:03
sdagueclarkb: probably :)01:03
*** nosnos has joined #openstack-infra01:03
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Only zuulify the tree if we are on the right branch
sdagueok, lets see what that looks like01:03
sdaguethough, sadly, it's hard to tell until we can see a nova change on top of it01:04
fungithere needs to be whitespace after the [ in case you need portability (most systems symlink .../bin/[ to .../bin/test) and so i'm in the habit of just whitespace padding square brackets01:04
*** dprince has quit IRC01:04
clarkbsdague: you can always reverify/approve a nova change then -2 it afterwards >_>01:04
*** ericw has quit IRC01:04
clarkbor remove the +A01:04
mgagneclarkb: what fungi said ^01:04
sdaguetrue, though that only helps if this is in the gate queue01:05
clarkbsdague: right and it is probably a bad thing to get into a habit of doing01:05
sdagueyep :)01:05
clarkbfungi: mgagne: right but bash has [/test as a built in01:05
sdagueI wonder if there is a way to test a d-g change on a whacky zuul ref scenario sanely01:05
fungiclarkb: which is why i referred to it as a habit. years and years of patching spaghetti shell on sco unix :(01:06
sdaguefungi: sco eh...01:06
mgagneclarkb: won't work anyway01:06
clarkbfungi: before I started hacking on d-g and friends I always tried to write portable bourne scripts, now I think bash has won01:06
clarkbmgagne: ah01:06
*** sarob has quit IRC01:06
clarkbmgagne: yup local test show it derps01:07
*** oubiwann has joined #openstack-infra01:07
sdagueone of the guys in the office actually bought 30 shares of sco common stock before they went under, and paid to have it turned into an actual stock certificate (and hung it up in his office)01:07
mgagne$ bash -c 'if ["1"=="1"]; then echo "works"; fi'01:07
mgagnebash: [1==1]: command not found01:07
clarkbits weird that it complains about ] missing since it actually doesn't need it01:07
clarkbbut maybe the built in does need it and I am thinking of /bin/[01:07
*** SergeyLukjanov has joined #openstack-infra01:08
*** ericw has joined #openstack-infra01:08
sdagueoh, crap, it's not an == is it01:08
mgagnesdague: they should be the same01:08
clarkbsdague: = is bourne == is bash iirc01:09
fungiyeah, i usually try to stick to = but we have both all over01:09
fungiand of course = gets you in trouble in other languages01:09
sdaguethat would actually be a good bash8 check.... :)01:09
fungiactually gets you in trouble in shell too if you're not paying attentiom01:09
sdagueso many december tasks01:10
clarkbsdague: its like a stack where you can push in the middle01:10
*** jhesketh__ has quit IRC01:10
sdaguemy november is so broken for getting anything done01:10
*** krotscheck has quit IRC01:10
mgagnefungi: if (current->uid = 0) ... =)01:11
fungiyes, fond memories of staring at c for hours trying to figure out what i did wrong, only to discover i meant ==01:12
sdagueclarkb: so this actually completely would explain why d-g was -2ed in the gate originally01:12
sdaguebecause there were nova changes in front of it01:12
sdagueand we had our crazy nova on master, everything else on grizzly01:12
sdaguewhich apparently passes all devstack exercises besides euca01:13
sdagueso kind of "go us"01:13
sdaguebecause I didn't think it would work that well01:13
sdaguethen when I finally got the rebase up, there was nothing in front of it in the gate01:13
sdagueand, honestly most of the ec2 tests actually passed01:14
*** yamahata has joined #openstack-infra01:15
mordredsdague: awesome01:15
sdagueso there is still an issue here.... it occurs to me01:16
sdagueor, maybe not01:16
sdagueI'm trying to get my head around what happens when we come in on stable/grizzly, but with a novaclient change, which is actually a master tree01:16
*** rakhmerov has joined #openstack-infra01:17
clarkbsdague: I think you test the havana -> ice house upgrade and call it good01:17
clarkbwhich is what it should do now right?01:17
*** jhesketh__ has joined #openstack-infra01:18
sdagueactually not, I think I need to check ZUUL_BRANCH against $branch, not against $BRANCH01:18
sdaguebecause we first try to find BRANCH on the project, and if it's not found, we set it to master01:18
sdaguewhich is how we can roll the clients to master01:19
sdaguebut then the ZUUL_BRANCH check on BRANCH is no good01:19
sdagueso then we just default to checking out master01:19
sdagueand the novaclient issue that happened before can happen again01:19
*** sdake has joined #openstack-infra01:19
sdaguesomeone want to double check that train of thought before I rev the patch01:19
clarkbmy brain is pretty well cooked, but I will give it a shot01:20
sdaguemordred: how cooked is your brain?01:20
clarkbsdague: wouldn't *client always default to checking out master?01:21
clarkbbecause there are no branches01:21
sdagueclarkb: right01:21
clarkbregardless of BRANCH or branch01:21
sdagueyes... but01:21
*** rakhmerov has quit IRC01:22
sdaguethe trick is how do we get to L141 -
sdagueL141 is "check out to the magic zuul ref"01:22
sdagueso if we ever bump out of there we get BRANCH instead01:22
clarkbright so don't we want to compare BRANCH and ZUUL_BRANCH?01:23
clarkboh wait01:23
clarkbI think I grok now. BRANCH can carry the fallback which may be something different01:23
*** ^d has quit IRC01:23
sdagueI think we want ZUUL_BRANCH==$branch01:23
sdaguewhich is the branch setup_workspace was called with01:24
sdagueright, because of the fallback01:24
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Only zuulify the tree if we are on the right branch
sdagueok, so I think that's right01:25
*** ericw has quit IRC01:26
* fungi is now where he can check it out01:27
mordredsdague: my brain is a jelly donut01:28
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Don't attempt to zuulify the old tree
sdagueso that last change is a fail safe01:28
mordredwe really need jeblair to not be on vacation don't we01:28
sdagueyeh, though I've almost grokked this now01:29
sdaguebut it would have been a ton easier with him around01:29
sdagueso, I think 54453 is the right fix, and should be put through the gate, and rainbows and unicorns01:29
sdaguebut... if it's not, 54458 should take us back to basically the old behavior01:30
*** ericw has joined #openstack-infra01:30
*** vipul is now known as vipul-away01:31
sdaguemy brain is also starting to go into mush land, as I started my day driving 1.5hrs to white plains for federal district jury duty01:31
sdaguebut on the upside, going to hong kong on friday got me dismissed off the jury, and exempt for the next 4 years :)01:32
clarkbjury duty! I haven't done that in a while. Watch I am going to get a summons now01:32
sdaguethe federal district one is a pain01:32
sdagueas it's a month01:32
sdagueand white plains, which is 1:15 => 1:30 depending on traffic from my place01:32
clarkbI have done two different counties01:33
sdaguebut at least I only had to go down physically twice01:33
sdagueclarkb: when you getting to HK?01:35
*** bingbu has joined #openstack-infra01:35
*** vipul-away is now known as vipul01:36
clarkbsdague: Sunday at 172001:37
sdagueok, cool. mtreinish and I are getting in Sat at 1900. Hoping to get a couple of days to time adjust. Wonder if there will be a Sunday night gathering of folks01:38
mordred sdague I arrive Sat too01:38
* mgagne hopes there will be gallons of coffee as he only arrives Monday night01:40
sdaguemordred: what part of town are you in pre-summit?01:40
mordredsdague: kowloon01:40
mgagneyou all make me worry about jet lag01:41
sdagueok we're over near victoria peak01:41
sdaguedansmith is over those parts as well, different hotel01:41
sdaguealso getting in Sat01:41
*** SergeyLukjanov has quit IRC01:42
*** ericw has quit IRC01:43
clarkbsdague: there is talk of doing the monday registration check in thing at 3pm and meeting folks there and scheming for monday afternoon/evening/night01:43
sdagueyep, jog0 pinged me about that01:43
clarkbso if you show up for that you will probably find a gaggle of us01:43
sdaguemkoderer was kicking off a qa core gathering, I'm going to try to get it to merge with the infra gathering :)01:44
sdaguewe should all be one happy family anyway01:44
*** markwash has joined #openstack-infra01:44
*** ericw has joined #openstack-infra01:45
*** nati_ueno has joined #openstack-infra01:46
fungiyeah, i get there sunday around 1930 local clocks01:46
fungier, saturday01:46
fungijust noticed we don't gate devstack-gate on grenade... grr01:47
clarkbwhoops :/01:47
clarkbfungi: we should lookat using layout templates so that we can avoid those problems01:47
*** esker has joined #openstack-infra01:50
sdaguefungi: are you sure?01:51
sdagueI'm actually pretty sure we do01:51
fungisdague: oh, heh. it's clearly getting late here ;)01:51
fungiin fact, that's what the patch failed on originally, so obviously we were01:52
sdagueI can't wait to see jeblair's reaction to all my failed d-g work this week, and the reverts when he looks at the git logs01:52
sdagueyeh, I was going to say01:52
fungii think he'll just be glad it's still running in his absence01:53
sdagueso realistically I don't think the test results on - are actually going to tell us anything, so my suggestion is that if anyone is feeling adventurous to push it through, then recheck a nova change that failed in the last hour and see if it passes01:53
sdagueand if everything is still screwed, 54458 will make it better, by giving up on trying to update "old"01:54
*** adalbas has quit IRC01:54
sdaguebut I need to wonder away from the computer and sleep01:54
*** nati_ueno has quit IRC01:55
fungii'll forego sleep a while longer01:55
sdaguesee folks in the mornign01:55
*** ericw has quit IRC01:56
*** nati_ueno has joined #openstack-infra01:57
anteayanight sdague01:57
*** dims has quit IRC02:01
*** dcramer_ has joined #openstack-infra02:02
*** sarob has joined #openstack-infra02:13
*** sarob has quit IRC02:13
*** sarob_ has joined #openstack-infra02:13
*** sarob has joined #openstack-infra02:14
*** ericw has joined #openstack-infra02:17
*** rakhmerov has joined #openstack-infra02:18
*** sarob_ has quit IRC02:18
*** guohliu has joined #openstack-infra02:20
*** ericw has quit IRC02:21
*** nati_ueno has quit IRC02:23
*** nati_ueno has joined #openstack-infra02:24
*** zul has quit IRC02:24
*** UtahDave has quit IRC02:27
*** nati_ueno has quit IRC02:28
*** ljjjustin has joined #openstack-infra02:31
*** ericw has joined #openstack-infra02:36
openstackgerritA change was merged to openstack-infra/devstack-gate: Only zuulify the tree if we are on the right branch
*** senk has joined #openstack-infra02:45
*** yamahata has quit IRC02:46
*** michchap has quit IRC02:48
*** esheffield_ is now known as esheffield02:48
*** rakhmerov has quit IRC02:48
*** rakhmerov has joined #openstack-infra02:49
*** gyee has quit IRC02:49
*** rakhmerov has quit IRC02:53
*** xchu has joined #openstack-infra02:55
fungirechecked a few minutes ago, watching to see if it passes now02:56
*** dcramer_ has quit IRC02:57
*** lnxnut has joined #openstack-infra02:58
*** yamahata has joined #openstack-infra02:59
*** mriedem has quit IRC02:59
*** anteaya has quit IRC03:00
*** guohliu has quit IRC03:01
fungino such luck03:02
*** sarob has quit IRC03:05
*** dcramer_ has joined #openstack-infra03:10
*** wenlock has joined #openstack-infra03:17
fungirechecked to the same end03:19
clarkbfungi: so it isn't happy?03:20
clarkbshould we revert?03:20
*** vipul has quit IRC03:20
*** melwitt has quit IRC03:20
fungisdague left us for this occasion03:21
*** vipul has joined #openstack-infra03:21
clarkbthat has my +203:21
fungiabout to approve, just collecting some links to include in the comment so he can have a jumpstart on investigating it tomorrow03:22
SlickNiklifeless: Sorry, didn't get your messages until now.03:33
SlickNiklifeless: Ideally we'd want the trove elements to live somewhere else too; we were thinking a different repo so that we can build the image every so often and use a "golden" image for integration test runs.03:34
lifelessSlickNik: sure, heat are going to do that too03:35
lifelessSlickNik: they'll be building it out of tripleo-image-elements though03:35
lifelessSlickNik: I don't particularly care either way FWIW :)03:35
SlickNiklifeless: ah, we were thinking of putting it into a different repo, but I think tripleo-image-elements makes sense.03:36
SlickNiklifeless: also I hear you about moving away from first-boot.d. Hope to get some time to look into it soon… :)03:37
fungiadrian_otto: if you wind up reading the logs, i was finally able to get manage-projects to run clean with no github api errors and stackforge/solum seems to clone successfully from the expected places now03:38
*** lnxnut has quit IRC03:42
*** lnxnut has joined #openstack-infra03:43
*** lnxnut has quit IRC03:47
*** rakhmerov has joined #openstack-infra03:47
fungi54458 looks like it's going to pass. at least succeeded grenade so i think we're in the clear with it03:51
fungii'll recheck the same nova changes once it merges03:52
*** beagles has quit IRC03:56
*** adrian_otto has joined #openstack-infra04:02
*** vipul is now known as vipul-away04:05
*** harlowja has quit IRC04:07
fungicrap, random failure on the last running job for it04:08
fungineeds to be reverified04:08
*** vipul-away is now known as vipul04:10
*** senk has quit IRC04:17
fungiseems it hit bug 121858204:17
fungilucky us04:18
*** rakhmerov has quit IRC04:18
*** yaguang has quit IRC04:24
*** nati_ueno has joined #openstack-infra04:29
*** Adri2000 has quit IRC04:32
*** oubiwann has quit IRC04:32
*** Adri2000 has joined #openstack-infra04:33
*** yaguang has joined #openstack-infra04:44
*** DinaBelova has joined #openstack-infra04:45
*** changbl has joined #openstack-infra04:50
openstackgerritA change was merged to openstack-infra/devstack-gate: Don't attempt to zuulify the old tree
fungiyay. second try's a charm04:55
*** vipul is now known as vipul-away05:02
*** SergeyLukjanov has joined #openstack-infra05:05
*** oubiwann has joined #openstack-infra05:09
*** jpeeler has quit IRC05:16
*** jpeeler has joined #openstack-infra05:18
*** vipul-away is now known as vipul05:19
fungisuccess on the rechecked nova changes, so we're in the clear05:21
*** zul has joined #openstack-infra05:27
*** nicedice__ has quit IRC05:29
*** zul has quit IRC05:32
mrdahey all, I'm seeing some failures from check-grenade-devstack-vm (ref  I don't think it's me.  Is there a known issue out there?05:35
mordredSlickNik, lifeless: did we ever sort out the heat-cfntools pbr issue?05:35
lifelessmordred: no05:35
lifelessmordred: also ?good morning?05:35
mordredlifeless: morning!05:36
*** oubiwann has quit IRC05:36
mordredlifeless: any better luck finding a reproducible test case for mordred?05:36
clarkbmrda: I think fungi just finished it with his comments at 0523 UTC05:36
mrdaok, thanks05:37
lifelessmordred: I have not had a time slice on it sorry05:39
lifelessmordred: one of those days05:39
mordredlifeless: it's ok. I haven't either05:39
* mordred just wanting to make sure people are blocking on him05:39
*** adrian_otto has quit IRC05:44
*** sdake has quit IRC05:46
fungimrda: yeah, should be resolved for now05:47
mrdathanks fungi, I've just "recheck no bug"d and we'll see how it goes05:47
clarkbI was just reading so radon seems relevant05:51
mordredalso- flake8 has a mccabe plugin05:51
mrdalifeless: that's pretty cool05:53
mordredradon's mi command mostly likes nova05:53
mrdaI like it that "mccabe" is close to "macabre"05:55
clarkbthe tex (I think it is tex) in the docs didn't format properly and makes the interesting bits hard to read05:56
*** zul has joined #openstack-infra06:01
clarkbttx: is it still to early to stop running the folsom jobs?06:01
clarkbttx: I semi hope that we might be able to pull them out before the summit (but not a huge deal if it happens after)06:01
*** denis_makogon has joined #openstack-infra06:06
*** wenlock has quit IRC06:08
*** blamar has quit IRC06:14
*** mrda has quit IRC06:43
lifelessmordred: since you are around -
*** mrda has joined #openstack-infra06:55
lifelesswhy is failing ?07:05
*** yaguang has quit IRC07:05
*** yaguang has joined #openstack-infra07:05
*** vipul is now known as vipul-away07:06
clarkbrequirements are changed and don't match contents of the global list07:06
lifelessclarkb: it's being changed by the global list sync job07:07
lifelessclarkb: so I don't understand how that can happen07:07
lifelessclarkb: also, the iso8601 change is broken because 0.5/0.6/0.7 are broken07:07
clarkboh I wonder if a change to a stable branch fired that off07:09
clarkbmordred ^ because it seems to be reverting versions07:09
*** mattymo has joined #openstack-infra07:12
*** SergeyLukjanov is now known as _SergeyLukjanov07:12
*** _SergeyLukjanov has quit IRC07:13
openstackgerritPeter Liljenberg proposed a change to openstack-infra/jenkins-job-builder: Added support for Jenkins plugin Blame upstream committers
*** AJaeger has left #openstack-infra07:32
*** jcoufal has joined #openstack-infra07:38
*** dkliban has joined #openstack-infra07:42
*** flaper87|afk is now known as flaper8707:44
*** hashar has joined #openstack-infra07:50
*** osanchez has joined #openstack-infra07:53
*** hashar has quit IRC07:56
*** pblaho has joined #openstack-infra08:18
*** guohliu has joined #openstack-infra08:19
*** flaper87 is now known as flaper87|afk08:22
*** mrda has quit IRC08:25
openstackgerritOleg Gelbukh proposed a change to openstack-infra/config: Add rubick project to stackforge
*** denis_makogon has quit IRC08:26
*** dkliban has quit IRC08:28
*** tkammer has joined #openstack-infra08:29
*** ljjjustin has quit IRC08:30
*** flaper87|afk is now known as flaper8708:32
openstackgerritOleg Gelbukh proposed a change to openstack-infra/config: Add rubick project to stackforge
*** osanchez has quit IRC08:35
ttxclarkb: I wanted to formally kill them during the stable branch session, so that we can address complaints (if any) directly and in-person08:37
ttxclarkb: but if it blocks useful work, I guess a thread on stable-maint would do08:38
*** dcramer_ has quit IRC08:39
*** mrda has joined #openstack-infra08:45
tsufievmordred, clarkb: could you please take a look at ?08:46
*** ljjjustin has joined #openstack-infra08:48
*** fbo_away is now known as fbo08:51
*** dcramer_ has joined #openstack-infra08:51
*** matsuhashi has quit IRC09:03
*** matsuhashi has joined #openstack-infra09:03
*** hashar has joined #openstack-infra09:04
*** derekh has joined #openstack-infra09:05
*** matsuhas_ has joined #openstack-infra09:08
*** matsuhashi has quit IRC09:08
*** jpich has joined #openstack-infra09:09
*** hashar_ has joined #openstack-infra09:11
*** hashar has quit IRC09:12
*** hashar_ is now known as hashar09:12
*** yassine has joined #openstack-infra09:13
*** ljjjustin has quit IRC09:14
*** mrda has quit IRC09:21
openstackgerritDzmitry Horbach proposed a change to openstack-infra/jenkins-job-builder: Jenkins Dynamic Parameter Plug-in support
*** plomakin has quit IRC09:23
*** plomakin has joined #openstack-infra09:23
*** dkliban has joined #openstack-infra09:23
*** CaptTofu has quit IRC09:24
*** rakhmerov has joined #openstack-infra09:25
rakhmerovhi, could you please give some tips on why the newly created repo at stackforge may be empty? The change request: Repo:, seed repo:
*** che-arne has joined #openstack-infra09:33
*** tkammer has quit IRC09:36
*** mugsie has quit IRC09:37
*** johnthetubaguy has joined #openstack-infra09:40
*** johnthetubaguy1 has joined #openstack-infra09:41
*** johnthetubaguy has quit IRC09:42
*** bingbu has quit IRC09:44
*** romcheg has joined #openstack-infra09:47
*** boris-42_ is now known as boris-4210:00
*** tkammer has joined #openstack-infra10:00
*** xchu has quit IRC10:01
*** osanchez has joined #openstack-infra10:02
*** alexpilotti has quit IRC10:05
*** fifieldt has quit IRC10:10
*** pcm_ has joined #openstack-infra10:12
*** pcm_ has quit IRC10:13
*** pcm_ has joined #openstack-infra10:13
openstackgerritSlickNik proposed a change to openstack-dev/pbr: Fixed pbr install to not error out and fail if git is not installed
*** tkammer has quit IRC10:15
SlickNik^^mordred / lifeless: This was the issue we were running into while building the trove guestagent image10:16
*** afazekas has joined #openstack-infra10:33
*** plomakin has quit IRC10:35
*** plomakin has joined #openstack-infra10:35
sdagueclarkb / fungi: did we fail things besides the stable / havana change ?10:41
openstackgerritA change was merged to openstack-dev/hacking: Updated from global requirements
sdaguegah, I put the conditional in the wrong spot....10:43
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Correct test for zuulifying the tree
*** jhesketh has quit IRC10:48
*** markmc has joined #openstack-infra10:54
jog0sdague: btw I am with you about  RPC testing has to be done in grenade10:59
jog0you convinced me pretty quickly11:00
*** matsuhas_ has quit IRC11:01
*** matsuhashi has joined #openstack-infra11:02
*** dims has joined #openstack-infra11:03
sdagueheh, nice11:05
sdagueand not only because I keep breaking the freaking gate?11:05
jog0sdague: I always thought long term it belonged there but short term it does too because of the zuulifcation of git stuff11:07
jog0the email draft for hacking 0.8.0 (which I am getting ready to cut momentarily)11:07
*** DinaBelova has quit IRC11:09
*** matsuhashi has quit IRC11:11
jog0cool, cutting release now11:12
*** DinaBelova has joined #openstack-infra11:14
*** yamahata has quit IRC11:20
*** flaper87 is now known as flaper87|afk11:24
*** yaguang has quit IRC11:25
openstackgerritJoe Gordon proposed a change to openstack/requirements: Switch to Hacking 0.8.0
*** CaptTofu has joined #openstack-infra11:37
*** alexpilotti has joined #openstack-infra11:44
*** hashar has quit IRC11:54
*** dcramer_ has quit IRC11:58
*** matsuhashi has joined #openstack-infra12:02
*** afazekas has quit IRC12:03
*** adalbas has joined #openstack-infra12:14
*** dprince has joined #openstack-infra12:14
fungirakhmerov: github was having serious issues when that change merged, and it appears it didn't get imported successfully. i've cleared that repository at the gerrit end and am re-running the import script now manually12:16
*** dhellmann is now known as dhellmann-afk12:16
fungisdague: i linked a couple failing changes on that approval12:16
fungiahh, new change i see12:17
*** jpeeler has quit IRC12:19
*** jpeeler has joined #openstack-infra12:19
*** esker has quit IRC12:23
*** dims has quit IRC12:25
*** dims has joined #openstack-infra12:25
*** tkammer has joined #openstack-infra12:26
*** nosnos has quit IRC12:27
rakhmerovfungi: thanks a lot, I hope it'll work this time12:29
*** anteaya- is now known as anteaya12:30
fungirakhmerov: i'll test when it finishes, troubleshoot if not, and let you know when it's usable12:30
*** hashar has joined #openstack-infra12:33
jog0just got devstack diablo running wow things looked different back then12:33
*** yamahata has joined #openstack-infra12:33
*** anteaya has quit IRC12:34
*** flaper87|afk is now known as flaper8712:35
*** anteaya has joined #openstack-infra12:37
*** yamahata has quit IRC12:39
*** afazekas has joined #openstack-infra12:40
*** CaptTofu has quit IRC12:44
*** CaptTofu has joined #openstack-infra12:45
*** yamahata has joined #openstack-infra12:46
*** thomasem has joined #openstack-infra12:46
*** beagles has joined #openstack-infra12:46
*** julim has joined #openstack-infra12:46
zul*cough* sorry
*** oubiwann has joined #openstack-infra13:02
fungii think i remember jgriffith saying he was cool with that13:04
*** SergeyLukjanov has joined #openstack-infra13:04
fungiif not we can always revert i guess13:05
*** hashar has quit IRC13:05
zulill bug jgriffith today about it just to make sure13:05
*** hashar has joined #openstack-infra13:05
openstackgerritA change was merged to openstack-infra/config: Make cinderclient-py33 gating
*** matsuhashi has quit IRC13:07
*** matsuhashi has joined #openstack-infra13:08
*** matsuhas_ has joined #openstack-infra13:09
*** matsuhashi has quit IRC13:10
*** guohliu has quit IRC13:10
*** weshay has joined #openstack-infra13:12
*** Bada has joined #openstack-infra13:13
*** mriedem has joined #openstack-infra13:13
*** tkammer_ has joined #openstack-infra13:15
*** tkammer has quit IRC13:18
*** guohliu has joined #openstack-infra13:23
*** tkammer has joined #openstack-infra13:23
*** odyssey4me has joined #openstack-infra13:27
*** ryanpetrello has joined #openstack-infra13:36
*** esker has joined #openstack-infra13:38
*** esker has quit IRC13:38
*** esker has joined #openstack-infra13:39
*** sandywalsh_ has joined #openstack-infra13:39
*** dstanek has joined #openstack-infra13:41
*** rcleere has joined #openstack-infra13:41
*** sandywalsh has quit IRC13:42
*** pblaho has quit IRC13:43
openstackgerritArx Cruz proposed a change to openstack-infra/zuul: Add the possibility to pass the zuul url
ArxCruzlifeless: ^13:46
ArxCruzhope you're happy now with all the changes. You make me learn testtools tonight ¬¬13:47
ArxCruzi mean, last night13:47
*** tkammer has quit IRC13:52
*** CaptTofu has quit IRC13:55
*** CaptTofu has joined #openstack-infra13:55
openstackgerritArx Cruz proposed a change to openstack-infra/devstack-gate: Add Fedora, Red Hat and CentOS compatibility
*** guohliu has quit IRC13:58
*** CaptTofu has quit IRC13:58
*** CaptTofu has joined #openstack-infra13:59
openstackgerritArx Cruz proposed a change to openstack-infra/zuul: Add the possibility to pass the zuul url
*** Bada has quit IRC14:00
*** mrodden has joined #openstack-infra14:02
*** dims has quit IRC14:02
*** mrodden has quit IRC14:03
sdaguecomments on this as a diagram to explain grenade - ?14:03
*** dims has joined #openstack-infra14:03
sdaguefungi: so I'm sure you don't trust me any more... however, I think, for real, I know the fix14:04
*** CaptTofu has quit IRC14:04
*** CaptTofu has joined #openstack-infra14:04
sdagueoh, you already +2ed it :)14:05
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server
fungisdague: the diagram looks good for a high-level view14:06
*** SergeyLukjanov has quit IRC14:06
sdagueyeh, this is in my "Jenkins Failed my Patch, what do I do?" talk14:06
fungi(answer: panic and take up drinking)14:06
*** tkammer has joined #openstack-infra14:07
sdagueto explain the various systems that we test, so it's easier to explain where things might not break14:07
fungiyeah, that's a good idea14:08
*** CaptTofu has quit IRC14:08
fungiso many of these tests are just black boxes to some devs, no matter how thoroughly we document and prominently publish the source for them14:08
sdagueI'm assuming these tracks will be recorded again, so we'll have a video of this14:09
*** CaptTofu has joined #openstack-infra14:09
*** jergerber has joined #openstack-infra14:09
fungiwhat is it javelin does? creates a faux production environment within devstack?14:09
openstackgerritsebastian marcet proposed a change to openstack-infra/config: Review and create Puppet configuration for dev server
*** pblaho has joined #openstack-infra14:10
*** devanand1 is now known as devananda14:11
*** lcestari has quit IRC14:11
*** guohliu has joined #openstack-infra14:13
*** ryanpetrello has quit IRC14:18
*** guohliu has quit IRC14:20
*** lcestari has joined #openstack-infra14:21
*** mrodden has joined #openstack-infra14:21
*** matsuhas_ has quit IRC14:25
*** matsuhashi has joined #openstack-infra14:25
*** markwash has quit IRC14:27
sdaguefungi: it creates a guest, with volumes, and a few objects14:27
sdagueso there is real state that has to survive the upgrade14:28
sdagueI was just going to talk to that14:28
sdagueour first test is that that javelin guest is still running when we bring up the n-cpu daemon14:28
sdagueso show it doesn't kill the guest on startup14:28
*** datsun180b has joined #openstack-infra14:29
*** matsuhashi has quit IRC14:30
*** wenlock has joined #openstack-infra14:35
*** ryanpetrello has joined #openstack-infra14:41
fungivery cool14:41
*** sileht has quit IRC14:43
*** sileht has joined #openstack-infra14:43
*** johnthetubaguy1 is now known as johnthetubaguy14:45
portanteWhere can I find the coverage and unit test history for accepted commits for a given project?14:48
*** alcabrera has joined #openstack-infra14:49
*** adrian_otto has joined #openstack-infra14:51
portantealso, not sure why, but this commit did not start its gate jobs right away, had to "reverify no bug" to get them going:
*** sarob has joined #openstack-infra14:52
*** Bada has joined #openstack-infra14:52
*** pcm_ has quit IRC14:53
fungiportante: i don't think coverage reports are being published and trended anywhere. that would be something for people interested in coverage reports to discuss with us and maybe work out an implementation as to what would be most effective14:55
fungifor the moment you have to dig individual reports out of the log server14:55
portantefungi: okay, thanks14:56
fungias for 54153, i have seen a few cases in recent months of zuul missing an event on the gerrit event stream, but no indication in either gerrit's or zuul's logs as to why... can't tell if gerrit failed to emit it or zuul failed to notice it14:57
fungii'm leaning toward the former, but i have no actual evidence to back it up14:57
*** sarob has quit IRC15:01
*** sarob has joined #openstack-infra15:02
*** tkammer has quit IRC15:03
portantefungi: okay, thanks15:03
*** sarob has quit IRC15:06
*** ljjjustin has joined #openstack-infra15:08
*** pcm_ has joined #openstack-infra15:10
*** senk has joined #openstack-infra15:12
*** senk1 has joined #openstack-infra15:13
*** UtahDave has joined #openstack-infra15:15
*** senk has quit IRC15:16
*** tkammer has joined #openstack-infra15:17
ryanpetrellocan I convince somebody to have a look at :)?15:17
ryanpetrelloI'd love to release a new version for the summit15:17
*** CaptTofu has quit IRC15:17
ryanpetrellobut want to be sure we have gating for important projects like this15:17
*** CaptTofu has joined #openstack-infra15:18
romchegMorning folks15:20
romchegI need some help with devstack-gate15:20
fungiromcheg: then you're in good company. i think we all need help with devstack-gate15:21
romchegfungi: indeed :)15:22
romchegI recently implemented a patch to devstack that can install Ironic15:22
wenlockhey morning, has anyone documented a way or is there a way to automate with cli change to add administrators push permission to refs/meta/config branch?  This is the manual step you currently have to do in gerrit setup from the UI.15:22
fungiryanpetrello: looks fine to me on first pass. with all the parameterization though my brain's a little twisted around so i'm not 100% sure i'm thinking it through15:22
romchegHowever, after I added ironic services to devstack-gate I get "Cloning not allowed in this configuration"15:23
fungiromcheg: i think for starters we need to make sure that nodepool is configured to pre-cache the ironic git repo on the slaves15:23
fungiwenlock: i think yolanda (robla) was working on that15:24
wenlockfungi cool.   when is he usually on?15:24
fungiwenlock: sounded pretty close to having it working15:24
wenlockdid he do the whole bit... or just that part?15:25
*** jcoufal is now known as jcoufal|afk15:25
rakhmerovfungi: FYI, mistral is still empty15:25
*** chandankumar has joined #openstack-infra15:25
fungiwenlock: i honestly can't remember what times yolanda comes around. was working on 100% automation of gerrit setup from scratch with no manual intervention, including initial administrative accounts15:26
romchegfungi: Ah, thanks. I will try to figure out the problem now15:26
wenlockintreasting, i should catch up to him and maybe we can exchange some stuff15:27
fungirakhmerov: i know, i'm continuing to hammer at the script but we're running into near constant github api errors and timeouts from it. i may just resort to manually cloning the repo and doing that bit of the setup15:27
wenlockfungi: ty for the lead15:27
*** wenlock has quit IRC15:27
rakhmerovfungi: ok, got it15:27
fungiromcheg: the nodepool prepare scripts are in openstack-infra/config (i believe in modules/openstack_project/files/nodepool directory)15:28
fungione of those, i forget which, embeds a list of projects to clone on the base image15:28
romchegfungi: Found it, thanks15:30
openstackgerritRoman Podoliaka proposed a change to openstack-infra/config: Add release config for tuskar components.
openstackgerritRoman Podoliaka proposed a change to openstack-infra/config: Add release config for tripleo-heat-templates
sdaguemordred or clarkb awake to look at the d-g script?15:30
*** dcramer_ has joined #openstack-infra15:31
*** rpodolyaka has joined #openstack-infra15:33
fungifinally got around to looking into the glut of deleting nodes in the nodepool graphs. most were in rax as suspected. did a nodepool delete on all of them and the graph is back to sane levels of deleting now15:33
*** sarob has joined #openstack-infra15:34
fungistepping out to grab an early lunch, but will bbiab15:36
*** senk has joined #openstack-infra15:37
*** adrian_otto has quit IRC15:38
openstackgerritArx Cruz proposed a change to openstack-infra/zuul: Add the possibility to pass the zuul url
*** adrian_otto has joined #openstack-infra15:38
*** senk1 has quit IRC15:40
*** Ryan_Lane has joined #openstack-infra15:40
*** ^d has joined #openstack-infra15:41
*** ^d has joined #openstack-infra15:41
*** blamar has joined #openstack-infra15:48
openstackgerritRoman Prykhodchenko proposed a change to openstack-infra/config: Precache Ironic and Ironic client
*** pblaho has quit IRC15:55
*** nati_ueno has quit IRC15:57
*** wenlock has joined #openstack-infra15:59
*** dkliban has quit IRC16:00
*** tkammer has quit IRC16:00
*** lnxnut has joined #openstack-infra16:00
*** romcheg has quit IRC16:03
*** honour has joined #openstack-infra16:03
*** hdd has joined #openstack-infra16:07
*** sdake has joined #openstack-infra16:08
*** Bada has quit IRC16:10
*** honour has quit IRC16:10
*** prodazhi has joined #openstack-infra16:10
*** ljjjustin has quit IRC16:10
*** jcoufal|afk is now known as jcoufal16:13
*** nicedice__ has joined #openstack-infra16:14
*** romcheg has joined #openstack-infra16:17
*** hashar is now known as hasharConfCall16:20
*** markwash has joined #openstack-infra16:23
mordredsdague: what you want me to look at?16:26
*** markmcclain has quit IRC16:32
*** SergeyLukjanov has joined #openstack-infra16:34
*** dstanek has quit IRC16:37
*** Ryan_Lane has quit IRC16:38
*** sandywalsh_ has quit IRC16:39
fungimordred: he's talking about
*** dansmith is now known as damnsmith16:40
*** damnsmith is now known as dansmith16:41
tsufievmordred: hi! could you take a look at ?16:42
*** hasharConfCall is now known as hashar16:42
clarkbsdague: I can look in about an hour or so16:46
*** jcoufal has quit IRC16:47
clarkbactuall I took a quick look at it now and +1 from me until I can give it proper time16:48
*** pcrews has quit IRC16:50
rpodolyakaHey, guys! Could you please take a look at and when you have a minute? We need those to be able to do releases of TripleO projects (tuskar, tuskar-ui, python-tuskarclient, tripleo-heat-templates). Thanks!16:52
*** yamahata has quit IRC16:54
*** sandywalsh_ has joined #openstack-infra16:54
*** CaptTofu has quit IRC16:58
*** CaptTofu has joined #openstack-infra16:58
*** ArxCruz_ has joined #openstack-infra16:59
*** sandywalsh_ has quit IRC17:00
*** reed has joined #openstack-infra17:02
*** aardvark has joined #openstack-infra17:02
*** ArxCruz has quit IRC17:03
*** WarrenUsui has quit IRC17:06
*** guohliu has joined #openstack-infra17:09
*** hashar has quit IRC17:09
reedhi all17:09
*** yassine has quit IRC17:10
sdagueclarkb: yeh, given the number of times I've messed this one up, I'm totally cool with it getting proper time17:10
*** sandywalsh_ has joined #openstack-infra17:13
*** davidhadas has joined #openstack-infra17:18
*** guohliu has quit IRC17:19
*** dstanek has joined #openstack-infra17:23
*** nati_ueno has joined #openstack-infra17:24
*** notmyname has quit IRC17:25
*** notmyname has joined #openstack-infra17:26
*** vipul-away is now known as vipul17:27
*** harlowja has joined #openstack-infra17:29
*** alcabrera is now known as alcabrera|afk17:32
*** hub_cap has joined #openstack-infra17:35
*** prad has joined #openstack-infra17:36
*** guohliu has joined #openstack-infra17:36
*** prad has quit IRC17:37
*** prad has joined #openstack-infra17:37
*** derekh has quit IRC17:41
*** starmer has joined #openstack-infra17:43
starmerHi, we're trying to get Gerrit gating set up, and I've sent an e-mail to the openstack-infra list for a service account.  Jus thought I'd ping the network in case someone can help set that up (the email is awaiting moderation).  Thanks!17:45
sdaguefungi: was there an upstream url for setting up your own fake d-g kind of thing? (this is for my slides for summit)17:45
pleia2starmer: I let your email through, it's just a super busy week for us with the summit coming up, I'm sure someone will have a look soon :)17:45
starmerpleia2: I completely understand. Thanks for the help!17:46
fungisdague: it's in the d-g readme, if you're thinking of
*** CaptTofu has quit IRC17:48
*** CaptTofu has joined #openstack-infra17:48
*** mattymo has quit IRC17:49
*** cody-somerville has quit IRC17:49
*** mattymo has joined #openstack-infra17:50
*** pcrews has joined #openstack-infra17:53
*** krotscheck has joined #openstack-infra17:54
reedfungi, whatever, just lets close the review 53472 with any decision and move on17:55
reedI can't stand leaving so many pending items before a long flight :)17:56
fungireed: mostly i'd like to get input from jeblair once he's around and available to discuss17:56
reedah! it's all the fault of the absents :)17:56
fungisince he committed the atc scripts and might have strong feelings about why they ended up in openstack-infra/config (though my suspicion is that it was just a convenient dumping ground at the time)17:57
*** ArxCruz_ has quit IRC17:57
reedfungi, I think it's a simple decision to make, honestly, I think convenience comes to mind17:57
reedyeah, I'm sure he just dropped it wherever it was convenient17:58
reedjust like I did :)17:58
*** ArxCruz has joined #openstack-infra17:58
reedI'm happy to take the offer by ttx to host it in odsreg17:58
fungias i said in the review, i'm okay with doing that for now and then discussing further. it's just as easy to move both as one17:58
fungiparticularly if we stick them in the same place though17:58
fungiso openstack-infra/config seems better short term than openstack-infra/odsreg17:59
reedapprove it and lets move on17:59
fungiunless openstack-infra/odsreg is the long-term place for them both to end up17:59
reedi give up17:59
* reed declares decision bankruptcy18:00
fungiagreed, it's bikeshed city and there's no way to make everyone happy. published is better than not published, just also don't want to go approving it when i'm the only infra core weighing in. but it's rotted there for a week, so can't say there wasn't opportunity to discuss. approving18:01
*** cody-somerville has joined #openstack-infra18:04
*** jerryz has joined #openstack-infra18:07
openstackgerritA change was merged to openstack-infra/config: Adds the script used to send summit invitations to ATC
fungireed: ^18:11
*** starmer has quit IRC18:11
lifelessSlickNik: ah git needed; do.18:11
* reed likes removing things from a list18:11
lifelessSlickNik: care to also file a bug that that isn't tested for?18:11
reednow going back to the Blueprint review process discussion18:12
reedfungi, where is mordred? already in HK?18:12
fungireed: mordred is like any good subatomic particle... he's everywhere and nowhere until you end up in the same room with him and collapse the wave function18:13
*** mattymo has quit IRC18:13
SlickNiklifeless: I'm not sure I completely understand what you mean by "that isn't tested for". Can you explain?18:13
*** denis_makogon has joined #openstack-infra18:13
SlickNiklifeless: It seems like pbr should continue to work even if git isn't installed.18:15
SlickNiklifeless: Ah, perhaps you meant have a test to test that, so that a regression of this won't occur.18:15
SlickNiklifeless: And I will gladly open a bug for that.18:16
*** starmer has joined #openstack-infra18:17
SlickNikAnd if it seems like I'm talking to myself — I'm still on my first cup of coffee. :)18:17
lifelessSlickNik: exactly what I mean.18:17
lifelessSlickNik: I suggest not sitting on your coffee; it will make your but hot.18:17
*** SergeyLukjanov is now known as _SergeyLukjanov18:18
*** starmer has quit IRC18:18
*** jpich has quit IRC18:19
*** _SergeyLukjanov has quit IRC18:19
SlickNikSmall price to pay if it means that it'll stop me from occasionally talking out of it…18:19
*** nati_ueno has quit IRC18:19
*** nati_ueno has joined #openstack-infra18:20
*** fungi has quit IRC18:21
*** SergeyLukjanov has joined #openstack-infra18:23
*** alcabrera|afk is now known as alcabrera18:23
SlickNikBut enough of that. I've filed bug for having a test for this case.18:24
*** nati_ueno has quit IRC18:24
*** SergeyLukjanov has quit IRC18:25
lifelessSlickNik: LOL18:25
lifelessSlickNik: coffee flavoured arse talk. Hopefully I can purge that memory by HK.18:25
clarkbfungi timed out :(18:27
clarkbsdague: I am looking at agan18:28
*** nati_ueno has joined #openstack-infra18:28
clarkbsdague: and I am trying to convince myself that this change changes the behavior of d-g18:28
clarkbCheckout zuul was 1 before18:29
*** osanchez has quit IRC18:29
clarkbso it would fall into checking the various conditions, if none of them match then do what we do when checkout zuul is 018:29
clarkbsdague: won't we fall through the conditions identically to before?18:29
*** markmc has quit IRC18:30
*** SergeyLukjanov has joined #openstack-infra18:30
openstackgerritA change was merged to openstack-infra/config: Remove docs-*-gate for murano-metadataclient project.
clarkbsdague: or were we hitting the exit in the inner if18:30
*** romcheg has quit IRC18:31
mordredSlickNik, lifeless: what about it doesn't work if git isn't installed?18:32
*** ryanpetrello has quit IRC18:32
mordredare you suggesting that it should work in a git clone without the existence of git? or that it should work in a tarball without the existence of git?18:32
*** dcramer_ has quit IRC18:32
* mordred goes to read the bug18:32
SlickNikmordred: it should work as a tarball (or download from pypi) without the existence of git.18:32
mordredyes. I agree with that18:33
mordredthank you! I can find and fix that18:33
*** romcheg has joined #openstack-infra18:33
mordredSlickNik: omg. you are a god child18:34
mordredwait. that didn't sound good18:34
mordredyou are something positive18:34
SlickNikHeh, no matter what that sounded like, I'll take it as a compliment.18:35
mordredclarkb: ^^ can I get you to review that? It's simple, but I think we need to land it and release, as there is a break in the wild18:35
*** DinaBelova has quit IRC18:36
clarkbmordred: ok18:36
clarkbsdague: please ping me when you get my comments above, I need a little extra convincing18:36
SlickNikmordred / clarkb: a fix and release would be nice. That way I don't have to come up with a workaround to unblock the trove integration-test gate. Thanks!18:37
mordredSlickNik: I will release as soon as that lands18:38
clarkbmordred: SlickNik: I am trying to decide if which git is the best way to check18:38
clarkbdoes python os come with something like that?18:38
clarkbseems like subprocess ought to be able to tell us maybe?18:39
mordreddhellmann-afk, dstufft, lifeless: you know deep weird python arcane questions ^^18:41
lifelesswhat's the question ?18:41
mordredany thoughts on the 'best' way to determine if an executable exists in the current path?18:41
mordredin python18:41
mordredother than shelling to which?18:41
clarkbmordred: I ask because _run_shell_command isn't returning an exit code and relying on output seems a little scary18:42
lifelessclarkb: subprocess.check_command18:42
clarkboh we can set throw_on_error18:42
clarkblifeless: danke18:42
lifelessor $ yeah, but tats a local library thing18:42
lifelesssubprocess.check_output if you want to capture the output.18:43
lifelessI think shelling out is fine18:43
lifelessotherwise you need to reimplement 'which' which has already been done, but since pbr is dep shy that means code copying or cleanroom18:43
lifelessall of which are fail18:43
clarkbSlickNik: mordred: do you think the exit code should be checked instead of the output?18:43
lifelessif which isn't installed and git is it will show as git not present18:44
lifelessbut I think that that is fine18:44
*** hogepodge has joined #openstack-infra18:44
mordredI agree18:44
mordredif which isn't installed, JEEZ18:44
*** fungi has joined #openstack-infra18:45
fungiyeesh. serious irc connection issues suddenly18:45
clarkbmordred: I have approved with a comment about using exit codes in general18:46
clarkbfungi: we missed you18:46
SlickNikI'm okay with that. The reason I went the which route was because I could re-use _run_shell_command() and not have to write more code wrapping another subprocess call.18:46
clarkbSlickNik: ya18:46
clarkbfungi: when failing before were we hitting the exit on line 143?18:47
clarkbfungi: sdague's change only makes sense to me if we were hitting that exit18:47
*** markwash has quit IRC18:47
SlickNikalso clarkb, I agree with your comment. Thanks!18:48
*** SnowDust has joined #openstack-infra18:48
*** markwash has joined #openstack-infra18:50
*** CaptTofu has quit IRC18:50
sdagueclarkb: so... here is my theory18:50
fungiclarkb: yeah, now i'm trying to remember what it was i changed there when we were running into branch setup problems a couple weeks ago. git blame to the rescue18:50
*** CaptTofu has joined #openstack-infra18:51
sdagueclarkb: that if is way more complicated than you realize18:51
sdagueit's actually 3 ORed sets of ANDed conditionals18:51
*** jcoufal has joined #openstack-infra18:51
sdagueso the problem is I actually put the branch check inside the first one18:52
*** flaper87 is now known as flaper87|afk18:52
sdaguewhich failed, as expected... but it meant L136 was actually executed18:52
sdague      { [ "$ZUUL_REF" != "" ] && \134              { [ "$ZUUL_REF" != "" ] && \18:52
sdague137              git fetch $ZUUL_URL/$PROJECT $ZUUL_REF ; } || \18:52
sdaguewhich means that FETCH_HEAD was modified to the zuul_ref regardless18:53
fungiahh, right. what i added was line 123 there, eventually. after spinning my brane for far too long on that if block18:53
clarkbsdague: OOOOHHHHH18:53
fungithough we talked about how we really ought to refactor that set of conditionals out into something less dense and easier to follow18:54
sdagueyeh, that's seriously dense code18:54
clarkbsdague: it has suddenly clicked18:54
*** esheffield has quit IRC18:54
clarkbsdague: fungi: should I go ahead and approve now? I should have time to grab lunch between approving and it merging18:54
sdagueyeh, lets try18:54
fungiclarkb: sure, i'll be here18:54
sdagueit's an easy revert if it goes wrong18:54
fungias long as irc doesn't decide to give me the finger again, anywaty18:55
fungier, anyway18:55
fungiclearly whoever wrote that initially decided to chain a couple of return codes to get the desired behavior out of a conditional on what was previously a single command18:56
fungiand then it snowballed with another and another18:56
sdaguemordred has the oldest fingerprints on that block from git blame, so I'll just hold him responsible :)18:57
fungiwe always seem to18:57
sdagueand I just found an easy nova +2 to put behind it in the gate18:58
sdaguewhich will prove whether it works or not18:58
* fungi fumes... i am ""<-this close to commenting out the github api calls in manage-projects and seeing how much faster it runs (and whether i can get it to succeed)18:58
sdaguewait, I thought I made those optional18:59
fungii think we're overrunning it now that we're at ~200 projects18:59
*** johnthetubaguy has quit IRC18:59
*** markwash has quit IRC19:00
fungievery time i try to run it i get ['not authorized', 'command failed', 'rate limit exceeded'][random(3)]19:00
fungino, wait, sometimes it's '502: server error' too19:01
clarkbwe hit the rate limit? awesome19:02
openstackgerritKhai Do proposed a change to openstack-infra/jeepyb: add an export option
sdaguefungi: wonder if we can ask the github guys for more rate19:02
sdagueclarkb: given the resets in the gate, you'll have plenty of time for lunch :)19:03
fungiclarkb: add to that the times where i try to run it and eventually cancel it after it runs for an hour without returning anything, presumably timing out the api socket19:04
clarkbwe could look into having them mirror from their side19:05
clarkband deal with that manually as a nice to have (I don't actually like this idea but would lessen the need for API calls)19:05
*** ^d has quit IRC19:06
fungiwell, in this case it's the calls to check github to see whether each project we host exists there so we know to create it when it doesn't19:09
clarkbfungi: right, when you have them mirror for you you do that all through email so we could just get rid of those checks19:09
clarkband deal with the project mirrors on github as more a best effort19:09
clarkb(I don't like giving up control though)19:09
fungibut i suspect running a separate api call to check each of them in rapid-fire every time we run manage-projects is overstepping some limits somewhere now that we have so many projects19:09
clarkbfungi: there is the script that closes pull requests too19:10
clarkbfungi: we should maybe make that one poll less often19:10
clarkband possibly use a different account?19:10
clarkbI am going to grab lunch now19:10
fungieat well19:10
*** odyssey4me has quit IRC19:14
*** senk has quit IRC19:15
*** danger_fo_away has quit IRC19:18
*** danger_fo_away has joined #openstack-infra19:19
*** nati_ueno has quit IRC19:19
*** ryanpetrello has joined #openstack-infra19:22
sdagueI think we're good19:23
sdagueI'm watching the grenade run on the nova change behind it19:23
sdaguewe at least didn't fail at the old point19:23
*** vipul is now known as vipul-away19:25
*** vipul-away is now known as vipul19:25
*** jaypipes has quit IRC19:28
*** markmcclain has joined #openstack-infra19:29
*** SnowDust has quit IRC19:30
*** danger_fo_away has quit IRC19:33
sdagueyep, grenade seems happy after that19:34
sdagueyay! probably figured this out19:34
pleia2hmm, is broken19:35
* fungi calls "not it"19:35
*** danger_fo_away has joined #openstack-infra19:37
*** nati_ueno has joined #openstack-infra19:40
sdagueman, when we get reset heavy in the gate, those py26 nodes end up being an interesting bottleneck19:42
*** ^d has joined #openstack-infra19:42
*** danger_fo_away has quit IRC19:42
Shrewspleia2: i believe brian is experimenting with a new way of publishing. probably related. see!topic/gearman/LQetfXKXo9c19:42
pleia2Shrews: ah, thanks :)19:42
pleia2found a cached version anyway, so I'm good19:43
*** danger_fo_away has joined #openstack-infra19:45
*** hashar has joined #openstack-infra19:47
*** ryanpetrello_ has joined #openstack-infra19:50
*** ryanpetrello has quit IRC19:51
*** ryanpetrello_ is now known as ryanpetrello19:51
*** senk has joined #openstack-infra19:55
*** mriedem has quit IRC19:55
*** markwash has joined #openstack-infra19:56
*** Ryan_Lane has joined #openstack-infra19:57
*** dolidze has joined #openstack-infra19:58
*** senk has quit IRC19:59
*** nati_ueno has quit IRC20:02
*** dprince has quit IRC20:06
*** adrian_otto has quit IRC20:07
bodepd_is there a way to track the status of accont requests?20:09
bodepd_is: is there an associated ticket?20:09
*** nati_ueno has joined #openstack-infra20:11
mgagnebodepd_: yes20:12
*** dolidze has quit IRC20:12
mgagnelooks to be on mailinglist20:13
mgagnebodepd_: ^20:13
mgagnebodepd_: best is to open a ticket for better follow-up. list isn't the best place for that.20:14
fungibasically if someone asks in here and i'm not busy i'll add it (that's not very often these days). if they open an openstack-ci bug on lp or e-mail the openstack-infra ml i'll follow up wherever they asked20:15
*** weshay has quit IRC20:16
fungiit's easier for me to not miss it if it's on the ml or in a bug, but on the flip side it takes longer for me to notice it compared to irc20:16
fungibut there's no set protocol20:17
*** guohliu has quit IRC20:17
*** senk has joined #openstack-infra20:20
*** thedodd has quit IRC20:20
lifelessclarkb: and the dependency20:21
lifelessfungi: ^20:21
* lifeless hunts other sympathetic reviewers.20:21
lifelessmordred: ^ !20:21
lifelessis it possible for me to get a new group? tripleo-releasers ? I'd like to have tripleo-ptl have me + tripleo-releasers, for clarity if folk are poking around in gerrit20:23
*** alcabrera has quit IRC20:23
fungithe original intent was that foo-ptl was short for "foo ptl and release management delegates"20:24
*** thedodd has joined #openstack-infra20:24
fungii'm not sure that we should promote gerrit as the official place for people to look up program technical leads20:25
lifelessfungi: I'm not promoting that, but other folk do suggest it from time to time.20:25
*** CaptTofu has quit IRC20:26
openstackgerritA change was merged to openstack-dev/pbr: Fixed pbr install to not error out and fail if git is not installed
openstackgerritA change was merged to openstack-infra/devstack-gate: Correct test for zuulifying the tree
*** CaptTofu has joined #openstack-infra20:26
lifelessfungi: however, since I won the 'get jeremy's attention' game; how about reviews :)20:27
fungiyeah, i'm looking at those at the moment20:28
fungii think someone filed a ci bug about the missing tuskar tarballs too?20:28
lifelessNg: or rpodolyaka: ^ probably20:29
lifeless-> hairdresser bbiab20:29
*** lcestari has quit IRC20:30
*** hogepodge_ has joined #openstack-infra20:32
*** melwitt has joined #openstack-infra20:32
clarkbfungi: yeah I saw that bug earlier today20:33
clarkblunch has been acquired. zaro took us on a long walk to a kebab place20:33
*** hogepodge has quit IRC20:33
*** hogepodge_ is now known as hogepodge20:33
clarkbsdague: woot20:34
*** dcramer_ has joined #openstack-infra20:35
sdagueDear Jim, Please never go on vacation again. K THX BAI20:35
clarkbfungi: re tuskar, have they just not merged any code?20:35
fungiNg: one thing which worries me about 52206 and 53190 is that the acls for those projects allow tags to be pushed by some fairly large groups of developers (20 in fact). are they all actually comfortable with the instructions on doing that safely, or should that permission be scaled back to a very small subset?20:35
clarkbfungi: I don't think we negotiate that :)20:36
fungiwell, it got through that way at some point (might have started out as a very small group)20:37
*** mrda has joined #openstack-infra20:37
fungibut the acls on those projects allow tripleo-core or groups which have included tripleo-core into them on tag refs20:38
clarkblifeless: Ng: reviewed20:38
fungiand it's grown to 20 members at this point20:38
mordredsdague: he's out the week after the summit too20:38
clarkbfungi: I think we should fix that20:39
zaroclarkb: more long walks to come in HK.20:39
clarkbmordred: I sort of forgive him for that because I have a feeling most of us will be zombies that week20:39
* fungi is always a zombie20:39
openstackgerritRoman Podoliaka proposed a change to openstack-infra/config: Add release config for tuskar components.
openstackgerritRoman Podoliaka proposed a change to openstack-infra/config: Add release config for tripleo-heat-templates
*** alcabrera has joined #openstack-infra20:46
clarkbfungi: any luck with tuskar?20:56
clarkbthe tarball jobs specifically20:56
*** afazekas has quit IRC20:56
*** marun has joined #openstack-infra20:58
clarkbmordred: are you going to release new pbr?20:59
mordredclarkb: I can't - behind firewall20:59
mordredclarkb: you want to?20:59
clarkbmordred: I can20:59
mordredclarkb: 0.5.2321:00
fungiclarkb: i hadn't hunted down the bug report yet21:00
SlickNikclarkb: <321:01
fungilast couple bugs about that which were opened, the projects lacked local machinery to create an sdist the way our jobs expect (particularly popular is forgetting testenv:venv section in tox.ini)21:01
SlickNikclarkb: ping me when it's done, so I can re-trigger trove-integration tests.21:02
clarkbtag pushed21:02
*** dkranz has quit IRC21:02
SlickNikclarkb: cool, thanks!21:02
clarkbSlickNik: I would retrigger in about an hour21:02
clarkbto make sure all of the bits trickle down to where they need to go (like the mirror)21:03
SlickNikclarkb: Good point. Thanks!21:04
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Communicate to user when we skip a requirement
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Base python 2.6 skip list on parsed names
*** nati_ueno has quit IRC21:07
*** nati_ueno has joined #openstack-infra21:08
*** nati_ueno has quit IRC21:08
*** nati_ueno has joined #openstack-infra21:09
clarkbfungi: I think tuskarclient hasn't merged any code21:10
*** dcramer_ has quit IRC21:12
fungithat seems like a good hypothesis. last commit was under the 0.1.1 tag a couple weeks ago21:12
fungier, 0.0.121:12
funginah, it has gerrit notes though...
clarkbright but if that tarball jobs went in after that merged21:13
fungioh, i see what you mean. post the config change to add the tarball job21:13
clarkbyeah tarball stuff went in a few days ago21:14
fungiyep, git log says 5 days after the last commit on that project21:17
*** nati_ueno has quit IRC21:18
*** nati_ueno has joined #openstack-infra21:18
*** senk has quit IRC21:19
*** pcrews has quit IRC21:20
*** senk has joined #openstack-infra21:20
*** nati_ueno has quit IRC21:22
*** senk has quit IRC21:23
*** rakhmerov has quit IRC21:24
*** dims has quit IRC21:25
*** jergerber has quit IRC21:25
*** pcm_ has quit IRC21:29
*** senk has joined #openstack-infra21:31
*** rcleere has quit IRC21:32
*** senk has quit IRC21:32
*** dkliban has joined #openstack-infra21:35
sdagueclarkb: ... ok, so that last patch isn't exactly perfect yet21:35
sdagueI did the novaclient revert revert and it passed21:36
sdagueit looks like it should be $ZUUL_BRANCH == $BRANCH after all21:39
lifelessclarkb: fungi: I'm not worried about that at the moment21:39
sdagueto handle the client case21:39
lifelessclarkb: fungi: though I will admit we didn't realise the permissions worked that way21:39
*** dims has joined #openstack-infra21:40
clarkbsdague: ok21:41
*** senk has joined #openstack-infra21:41
sdaguefortunately, it means we just aren't catching one case, but it's not busted21:42
clarkblifeless: I am worried about it21:42
clarkblifeless: because tags that don't get done correctly usually involve a fair amount of effort from infra to clean up after21:43
*** senk has quit IRC21:43
*** mkirk has quit IRC21:43
fungia lot of effort, to the point where it's often better not to clean them up and live with the mistake21:43
*** marun has quit IRC21:43
clarkbit is better to have a small group of people that do it semi often and understand the process which avoids problems21:43
lifelessclarkb: there are 20 core reviews for tripleo.21:44
clarkbright that is about 18-17 too many for tag privileges21:44
*** CaptTofu has quit IRC21:45
clarkbwe really need gerrit to make tags reviewable21:45
clarkbthen we can avoid this trouble21:45
fungifor comparison, across all of the integrated server projects, there are something like a total of three people tagging them for releases21:45
lifelessHaving some automation around 'good tag' rules would be nice21:45
*** CaptTofu has joined #openstack-infra21:45
lifelessclarkb: fungi: nevertheless, this is orthogonal to being able to do releases at all.21:45
lifelessclarkb: fungi: because the set of people is already enabled for e.g. os-apply-config, no ?21:46
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Ensure clients get tested correctly in upgrades
fungiyes, which is why i +2'd the patches, just raising a concern about the existing acl21:46
clarkbmordred: did you see jd__'s message about requirements proposing updates when stable/havana requirements change?21:46
lifelessfungi: cool, but I had the impression clarkb was holding off21:46
clarkblifeless: I am21:46
lifelessand I don't want that, as we have weeks of inventory building up21:46
openstackgerritKhai Do proposed a change to openstack-dev/pbr: show transitive dependencies
clarkbI think we should fix that before adding more projects that can be tagged21:46
fungithat's a reasonable concern21:47
lifelessclarkb: I think thats holding an unrelated change hostage21:47
clarkbit is a quick fix and should be corrected21:47
lifelessclarkb: which I am investigating now21:47
*** thomasem has quit IRC21:47
*** CaptTofu has quit IRC21:47
*** CaptTofu has joined #openstack-infra21:47
clarkblifeless: it isn't unrelated, aren't we adding more projects that use the group?21:48
clarkbwe are multiplying the surface area of breakage21:48
lifelessclarkb: we're fixing the broken config on existing projects21:48
lifelessclarkb: we've had no incidents of bad tags so far21:48
clarkbI must have changes confused then21:48
lifelessclarkb: from this group21:48
clarkbI thought we were talking about the Ng change with tuskar projects release stuff being added21:48
lifelessyes, they are broken at the moment21:48
lifelesswe can't do releases.21:48
lifelesswe want21:48
lifelesswe've wanted to for three weeks21:48
fungiwell, the changes add jobs to release based on tags to additional projects, but the acl already allows the tags to be pushed by the large set of people21:48
*** senk has joined #openstack-infra21:48
lifelessthe overly large set has existing for 2 months21:49
lifelessso bad tags can already be pushed to all of these projects21:49
fungiso the risk that someone pushes tags incorrectly to those projects already existst whether or not the jobs get added21:49
lifelessthey just won't trigger releases for the ones we're fixing.21:49
clarkblifeless: correct, but we are adding new ones now21:49
*** jcoufal has quit IRC21:49
lifelessno, again, we're not.21:49
lifelessthey can already push tags.21:49
clarkblifeless: can you point me to the change?21:49
clarkbbecause I am confused21:49
clarkblifeless: they can push tags but without the jobs bad stuff doesn't really happen21:49
fungiwell, some stuff does. the tags end up in the repository and replicated to all the mirrors21:50
lifelessclarkb: and
lifelessclarkb: neither of these change the tagging rules21:50
clarkblifeless: is the one I am concerned about21:51
lifelessclarkb: since we have had /zero/ incidents I think your fear of mistakes is out of proportion to the risk21:51
clarkbbecause it is changing what happens on a tag21:51
lifelessclarkb: and I've already said I'm looking into the fix you want21:51
clarkblifeless: why can't we just add a chnage to fix it?21:51
*** mrodden has quit IRC21:51
fungii will gladly expedite any acl patch to that effect21:52
lifelessclarkb: because we're here debating rather than doing that ?21:52
*** senk has quit IRC21:53
openstackgerritlifeless proposed a change to openstack-infra/config: Tagging of TripleO jobs should be tripleo-ptl.
lifelessclarkb: fungi: ^21:54
*** markmcclain has quit IRC21:54
*** rakhmerov has joined #openstack-infra21:55
clarkbit has my +221:55
clarkbfungi feel free to approve then I will lookat at the stack on 5319021:55
*** romcheg has left #openstack-infra21:56
*** adalbas has quit IRC21:56
openstackgerritA change was merged to openstack-infra/config: Tagging of TripleO jobs should be tripleo-ptl.
*** mgagne has quit IRC21:58
clarkbfungi: lifeless: stack approved21:59
*** mgagne has joined #openstack-infra21:59
*** SergeyLukjanov has quit IRC21:59
openstackgerritA change was merged to openstack-infra/config: Add release config for tuskar components.
lifelessclarkb: thank you22:00
openstackgerritA change was merged to openstack-infra/config: Add release config for tripleo-heat-templates
*** adrian_otto has joined #openstack-infra22:01
openstackgerritDennyZhang proposed a change to openstack-infra/config: defesive coding for
*** prad has quit IRC22:04
*** thedodd has quit IRC22:05
*** dstanek has quit IRC22:05
openstackgerritDennyZhang proposed a change to openstack-infra/config: defesive coding for
*** pcrews has joined #openstack-infra22:07
hasharhey there :-]22:10
hasharI got a quick question, if I want to add a sphinx extension, should I put it in requirements.txt or test-requirements.txt ? :D22:10
*** Ryan_Lane has quit IRC22:10
clarkbsdague: where did that 3A come from in your commit msg for the d-g change?22:11
sdaguebad keystroke?22:11
openstackgerritSean Dague proposed a change to openstack-infra/devstack-gate: Ensure clients get tested correctly in upgrades
clarkbhashar: runtime requirements should go in requirements.txt. If you only need it during doc build time I would put it in test-requirements.txt22:12
hasharso be it. thank you clarkb !22:12
clarkbhashar: I think ceilometer may be using a doc-requirements.txt too maybe22:12
clarkbhashar: but I would just do test-requirements. it is simple and works today22:12
hasharI am wondering whether pbr supports doc-requirements already22:12
clarkbhashar: I don't think there is direct support22:13
sdagueclarkb: I think I might have started in a weird editor for the commit message, and some arrow key went odd22:13
hasharclarkb: thank you very much.22:13
*** alcabrera has quit IRC22:15
*** dkliban has quit IRC22:16
*** senk has joined #openstack-infra22:17
*** senk has quit IRC22:18
*** gyee has joined #openstack-infra22:22
*** sandywalsh_ has quit IRC22:25
*** rakhmerov has quit IRC22:26
*** rakhmerov1 has joined #openstack-infra22:26
*** dims has quit IRC22:26
*** datsun180b has quit IRC22:26
*** dims has joined #openstack-infra22:27
*** rakhmerov1 has quit IRC22:30
anteayaHK money is large, the mony gets bigger the greater th denomination22:37
anteayalike euros but bigger22:37
openstackgerritDennyZhang proposed a change to openstack-infra/config: remove code duplication in run-*.sh
*** ryanpetrello_ has joined #openstack-infra22:39
*** ryanpetrello has quit IRC22:41
*** ryanpetrello_ is now known as ryanpetrello22:41
*** sandywalsh_ has joined #openstack-infra22:42
pleia2anteaya: neat22:46
*** sdake has quit IRC22:49
*** ryanpetrello has quit IRC22:49
*** esker has quit IRC22:52
clarkbare they plastic?22:52
*** shardy is now known as shardy_afk22:52
anteayajust the 10's22:53
anteayafor what my bank gave me at least22:54
openstackgerritAntoine Musso proposed a change to openstack-infra/zuul: doc: enhance gating reference with diagrams
openstackgerritAntoine Musso proposed a change to openstack-infra/zuul: doc: enhance gating reference with diagrams
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Added globbed parameters to the job specification
hasharclarkb: :-]22:59
hasharclarkb: browse at bottom for some nice graphs made possible with a sphinx plugin \O/22:59
clarkbhashar: nice!22:59
hashar .. similar to graphviz but way easier, python based and integrates with sphinx23:00
*** mdenny has quit IRC23:00
hashari luuuve python23:00
clarkbinteresting. the doc team is triyng to use graphviz in sphinx stuff, maybe I should point them at that to reduce the system dependencies23:01
hasharif that match their need23:01
hasharat worth, they could hack it and upstream their change23:01
hasharclarkb: another example for them
hasharthat more or less describe the gerrit/zuul/jenkins workflow23:02
*** mindjiver has quit IRC23:03
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Jenkins Ownership Plugin
*** gyee has quit IRC23:05
*** mindjiver has joined #openstack-infra23:07
*** gyee has joined #openstack-infra23:09
*** oubiwann has quit IRC23:17
*** fbo has quit IRC23:19
*** jhesketh has joined #openstack-infra23:20
openstackgerritlifeless proposed a change to openstack-infra/reviewday: Add all the TripleO projects.
openstackgerritlifeless proposed a change to openstack-infra/reviewday: Ignore editor backup files.
*** CaptTofu has quit IRC23:22
*** dcramer_ has joined #openstack-infra23:22
*** CaptTofu has joined #openstack-infra23:23
*** denis_makogon has quit IRC23:24
morganfainberganteaya, i just sent another of my coworkers to your vagrant blog post (and other blog posts) told him to hit you up if he has feedback ... or other cool tricks and such :)23:25
morganfainberganteaya, figured i'd give ya a heads up :)23:25
*** rakhmerov has joined #openstack-infra23:26
openstackgerritA change was merged to openstack-infra/jenkins-job-builder: Adding support for the Build Result Trigger plugin
*** UtahDave has quit IRC23:29
*** hashar has quit IRC23:33
*** pcrews has quit IRC23:35
*** rwsu has quit IRC23:38
*** julim has quit IRC23:39
*** wenlock has quit IRC23:43
*** gyee has quit IRC23:44
*** rwsu has joined #openstack-infra23:45
*** julim has joined #openstack-infra23:45
anteayamorganfainberg thank you for both, the complement and the heads up23:48
*** CaptTofu has quit IRC23:48
*** CaptTofu has joined #openstack-infra23:49
* morganfainberg goes back to watching ZuulTV23:50
*** markwash has quit IRC23:57
*** adrian_otto has quit IRC23:57
*** rakhmerov has quit IRC23:59

Generated by 2.14.0 by Marius Gedminas - find it at!