| sdague | so why did 62370,2 just restart? | 00:00 |
|---|---|---|
| clarkb | sdague: did it get reparented to avoid the git merge fail? | 00:00 |
| *** ociuhandu_ has quit IRC | 00:00 | |
| clarkb | jeblair: mordred: https://review.openstack.org/#/c/68782/ getting that approved would be excellent | 00:00 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add fingerprint for bug 1271962 https://review.openstack.org/69031 | 00:01 |
| jeblair | clarkb: i have like 5 million messages from jenkins to delete from the gerrit db. i'm a bit busy. | 00:01 |
| *** alexpilotti has joined #openstack-infra | 00:01 | |
| clarkb | woah | 00:02 |
| *** pcrews has joined #openstack-infra | 00:02 | |
| openstackgerrit | Peter Portante proposed a change to openstack-infra/elastic-recheck: Add fingerprint for bug 1268631 https://review.openstack.org/69068 | 00:02 |
| portante | flashgordon: whack-a-mole | 00:02 |
| flashgordon | portante: don't remind me | 00:02 |
| *** _ruhe is now known as ruhe | 00:04 | |
| jeblair | only 1587 | 00:05 |
| clarkb | sdague: also possible that the change ahead of it had a new patchset pushed to it | 00:05 |
| jeblair | to delete | 00:05 |
| portante | flashgordon: what to do about double hits? | 00:05 |
| clarkb | currnetly digging through logs to see if I can give a real reason | 00:05 |
| flashgordon | portante: this is a little nitty but https://review.openstack.org/#/c/69067/ | 00:05 |
| *** praneshp has joined #openstack-infra | 00:05 | |
| flashgordon | portante: not sure, maybe and another message:"" section | 00:06 |
| flashgordon | oh and great catc hon 69067 | 00:06 |
| *** flaper87 is now known as flaper87|afk | 00:07 | |
| *** sarob has joined #openstack-infra | 00:07 | |
| portante | flashgordon: thanks, luck really | 00:08 |
| openstackgerrit | Peter Portante proposed a change to openstack-infra/elastic-recheck: Updated fingerprint for bug 1261182 https://review.openstack.org/69067 | 00:09 |
| clarkb | sdague: http://paste.openstack.org/show/61870/ yup the merge fail | 00:11 |
| *** thuc has quit IRC | 00:12 | |
| *** thuc has joined #openstack-infra | 00:12 | |
| clarkb | jeblair: do we know why those comments happened? | 00:13 |
| jeblair | clarkb: yes | 00:14 |
| *** ociuhandu_ has joined #openstack-infra | 00:14 | |
| jeblair | clarkb: it's stopped. i'll be more verbose in a bit. | 00:14 |
| *** ociuhandu_ has quit IRC | 00:16 | |
| *** thuc has quit IRC | 00:17 | |
| *** boris-42 has quit IRC | 00:19 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Updated fingerprint for bug 1261182 https://review.openstack.org/69067 | 00:22 |
| vishy | do you guys still use https://jenkins.openstack.org/ to backend the zuul jobs? | 00:22 |
| vishy | or has it been moved somewhere else? | 00:22 |
| clarkb | vishy: we do, but only a very small percentage of them | 00:23 |
| clarkb | vishy: we have 8 jenkins masters now, that is one of them | 00:23 |
| openstackgerrit | Joshua Harlow proposed a change to openstack-dev/hacking: Add a tool that can fix the import order https://review.openstack.org/68988 | 00:25 |
| *** ociuhandu_ has joined #openstack-infra | 00:27 | |
| jeblair | clarkb: it seems that the check trigger was triggering itself and looping | 00:29 |
| jeblair | clarkb: i've cleaned up the duplicate messages in gerrit's db | 00:29 |
| flashgordon | portante: even with all your work the classifcation rate is dropping | 00:30 |
| jeblair | clarkb: and disabled puppet and reloaded zuul without that trigger in the config | 00:30 |
| *** ociuhandu_ has quit IRC | 00:31 | |
| clarkb | jeblair: ok | 00:31 |
| portante | flashgordon: ugh | 00:31 |
| jeblair | clarkb: at least, for messages with > 5 copies | 00:31 |
| portante | flashgordon: gotta head home, but will be available later to help, and hopefully on Monday | 00:32 |
| flashgordon | portante: thanks | 00:33 |
| portante | flashgordon: though that honkin' list of neutron jobs went away | 00:33 |
| flashgordon | portante: :) | 00:33 |
| portante | on the elastic recheck uncat page | 00:33 |
| *** gyee has quit IRC | 00:33 | |
| *** UtahDave has quit IRC | 00:34 | |
| *** ruhe is now known as _ruhe | 00:37 | |
| *** sarob has quit IRC | 00:39 | |
| *** CaptTofu has joined #openstack-infra | 00:40 | |
| *** branen has joined #openstack-infra | 00:40 | |
| *** yamahata has joined #openstack-infra | 00:40 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Revert "Ensure a recent (48h) check result" https://review.openstack.org/69071 | 00:40 |
| jeblair | clarkb: so it looks like if you leave the same vote value, the grantedon time doesn't get updated | 00:41 |
| flashgordon | wow 50 bugs on http://status.openstack.org/elastic-recheck/ | 00:41 |
| clarkb | jeblair: interesting | 00:41 |
| clarkb | jeblair: that is gerrit not updating the value? | 00:41 |
| jeblair | clarkb: right | 00:41 |
| jeblair | clarkb: an easy fix would be to have the check queue also leave a 0 vote... | 00:42 |
| jeblair | clarkb: though that increases the chattiness... (2 msgs for every jenkins run) | 00:42 |
| jeblair | clarkb: or we could rework the feature so that it looks for the timstamp of a message.... | 00:43 |
| jeblair | clarkb: ....though the messages aren't tied to the votes, so it'd be like "a verified vote from jenkins and also the newest message from jenkins is older than 48 hours) | 00:43 |
| clarkb | jeblair: I hate saying this. but what if we fix gerrit | 00:44 |
| jeblair | clarkb: is it a bug? | 00:44 |
| clarkb | jeblair: I would say so. If I explicitly leave a +1 vote the timestamp should update | 00:44 |
| clarkb | upstream will probably disagree with me though :) | 00:44 |
| jeblair | clarkb: want to make that change? my employer has not signed the gerrit cla. | 00:46 |
| jeblair | clarkb: (or maybe ask em in irc first) | 00:46 |
| *** melwitt has quit IRC | 00:46 | |
| clarkb | jeblair: sure /me hops into #gerrit | 00:46 |
| jeblair | clarkb: it is true that in the command line, you can explicitly leave or not leave a vote when you leave a message.. so your suggestion makes sense there. | 00:46 |
| jeblair | clarkb: that is not the case for the webui, but that's not what we're dealing with | 00:47 |
| clarkb | jeblair: I am assuming I won't get much of a response at this end of the week | 00:50 |
| jeblair | clarkb: just double checked: same behavior in 2.8 | 00:50 |
| fungi | mmm, good. i didn't miss much | 00:52 |
| clarkb | jeblair: you are in channel, let us see what happens | 00:52 |
| * fungi popped back into that channel too, out of curiosity | 00:53 | |
| jeblair | clarkb: i feel like the best short-med term solution is to make check chatty. :/ | 00:53 |
| clarkb | jeblair: wfm | 00:54 |
| fungi | for future reference, if anyone finds themselves stranded in the slc airport, the squatters brewery has opened a pub in concourse c | 00:54 |
| clarkb | jeblair: also the gerrit code baseis quite foreign to me now | 00:54 |
| *** ok_delta__ has joined #openstack-infra | 00:55 | |
| jeblair | clarkb: i'm going to think about the other option though, and do neither for now. maybe it wouldn't be too bad to say "have heard from jenkins within this amount of time and also have a +1 vote from jenkins" | 00:55 |
| *** dkehn has quit IRC | 00:56 | |
| clarkb | jeblair: found the line of code causing the problem, I should be able to fix this easily if upstream will take the patch | 00:56 |
| *** ativelkov has left #openstack-infra | 00:56 | |
| jeblair | fungi: are your nodepool cleanup hacks still working after my oom adventure? | 00:56 |
| *** ativelkov has joined #openstack-infra | 00:56 | |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Adding the tripleo repositories to PROJECTS https://review.openstack.org/68645 | 00:57 |
| *** ok_delta has quit IRC | 00:58 | |
| fungi | jeblair: i stopped doing oob deletes after we restarted nodepool yesterday, though i can start again (i did some spot deletes of stuff >5 hours old a couple times since) | 00:58 |
| *** dkehn has joined #openstack-infra | 00:58 | |
| jeblair | oh ok. no worries | 00:59 |
| openstackgerrit | A change was merged to openstack-infra/config: Revert "Ensure a recent (48h) check result" https://review.openstack.org/69071 | 00:59 |
| fungi | it was more important when we were flatlined at quota all the time, since deleting stuff which the periodic cleanup did't (or before it noticed) was buying us extra capacity | 00:59 |
| fungi | since clarkb's awesome throttle work, it's not really been as necessary | 01:00 |
| *** thuc has joined #openstack-infra | 01:01 | |
| fungi | and once we're cool with lifeless's delete queuing patches, it should hopefully be moot anyway | 01:01 |
| *** thuc has quit IRC | 01:02 | |
| fungi | also, looks like 68782 and 68990 are probably good to go, which ought to remove (or at least significantly reduce) one more cause of gate resets | 01:02 |
| *** thuc has joined #openstack-infra | 01:02 | |
| fungi | i'm digging back into the mysql slow log patch now in earnest, which will also likely help with that | 01:03 |
| openstackgerrit | Joshua Harlow proposed a change to openstack-dev/hacking: Add a tool that can fix the import order https://review.openstack.org/68988 | 01:07 |
| openstackgerrit | Joshua Harlow proposed a change to openstack-dev/hacking: Add a tool that can fix the import order https://review.openstack.org/68988 | 01:08 |
| *** SumitNaiksatam has quit IRC | 01:09 | |
| jeblair | fungi: aprvd those 2 | 01:12 |
| fungi | keen | 01:12 |
| clarkb | woot | 01:13 |
| jeblair | restarted puppet on zuul | 01:14 |
| *** CaptTofu has quit IRC | 01:15 | |
| openstackgerrit | Joshua Harlow proposed a change to openstack-dev/hacking: Add a tool that can fix the import order https://review.openstack.org/68988 | 01:15 |
| jnoller | if i offered candy, anyone able to +1 https://review.openstack.org/#/c/69008/6 | 01:15 |
| mordred | jnoller: what kind of candy? | 01:17 |
| jnoller | mordred: any kind you want, or dogecoin stickers ;) | 01:17 |
| *** CaptTofu has joined #openstack-infra | 01:18 | |
| clarkb | re neutron kernel trouble. precise does have newer kernels available that we could try | 01:18 |
| clarkb | I wonder if that would possibly make cloud archive libvirt happy too | 01:19 |
| clarkb | something to ponder | 01:19 |
| jnoller | thanks jeblair | 01:19 |
| clarkb | mordred: for changes like 69008 should we go ahead and approve them and deal with fallout later? | 01:19 |
| clarkb | mordred: I am not sure what the current situation of manage projects is | 01:19 |
| clarkb | mordred: maybe we can have puppet set an at job to avoid puppet weirdness? | 01:20 |
| clarkb | mordred: that is a really crazy idea, but possibly it will work | 01:20 |
| jnoller | clarkb: are project jobs breaking things? | 01:21 |
| jnoller | if project jobs are hanging zuul / gate I'd rather wait on this and see if I can help on gate | 01:22 |
| clarkb | jnoller: no, manage-projects just fails hard to properly create projects | 01:22 |
| clarkb | jnoller: mordred cannot reproduce when run manually so current assumption is that hen puppet runs it does so in a weird way breaking it | 01:22 |
| jnoller | ouch | 01:22 |
| clarkb | jnoller: so my silly idea is have puppet create an at job for now and not have puppet rtigger it directly :) | 01:23 |
| jnoller | clarkb: that's "eww" but effective | 01:23 |
| jnoller | I don't know enough puppet to dig in after the kids go to bed | 01:24 |
| clarkb | jeblair: 2.4 and 2.8 have completely different code paths for vote updates, but neither looks complicated. I will probably give fixing gerrit a shot | 01:24 |
| openstackgerrit | Joshua Harlow proposed a change to openstack-dev/hacking: Add a tool that can fix the import order https://review.openstack.org/68988 | 01:24 |
| mordred | clarkb: it's turned off in puppet | 01:25 |
| mordred | clarkb: you can approve at will - we just need to manually run it | 01:25 |
| clarkb | mordred: awesome thanks | 01:25 |
| mordred | clarkb: what's the "vote update/fix gerrit" thing? | 01:26 |
| clarkb | mordred: when you vote +1 multiple times in jenkins without changing any values, the grantedon column in the DB doesn't update | 01:27 |
| clarkb | mordred: so jeblairs zuul stuff can't reliably check if jenkins voted more recently than yesterday | 01:27 |
| clarkb | mordred: I pinged in #gerrit and they seem to think that is a bug and sicne I am CLAd with gerrit I can give a fix for that a shot | 01:27 |
| mordred | clarkb: ah. excellent | 01:28 |
| clarkb | in fact it just does a rollback if the only thing that would change is the timestamp | 01:29 |
| jnoller | thanks you guys | 01:29 |
| clarkb | jnoller: note, once that merges and after puppet applies one of us will need to run the manage-projects script by hand | 01:30 |
| jnoller | yup | 01:30 |
| jnoller | just saying thank you | 01:30 |
| jnoller | I'm opening the initial member bug | 01:30 |
| *** yamahata has quit IRC | 01:31 | |
| clarkb | I might also trick zaro into looking at it since he has well versed in gerrit testing atm | 01:31 |
| *** markmcclain has joined #openstack-infra | 01:33 | |
| * clarkb walks home. AFK for a bit | 01:36 | |
| *** gokrokve has joined #openstack-infra | 01:37 | |
| fungi | devstack patch for making query logging optional... https://review.openstack.org/69075 | 01:38 |
| *** dtroyer has quit IRC | 01:38 | |
| *** dtroyer has joined #openstack-infra | 01:39 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add python-openstacksdk, see https://wiki.openstack.org/wiki/UnifiedSDK https://review.openstack.org/69008 | 01:39 |
| *** thuc has quit IRC | 01:40 | |
| *** thuc has joined #openstack-infra | 01:40 | |
| *** wenlock has quit IRC | 01:42 | |
| *** jhesketh_ has joined #openstack-infra | 01:43 | |
| *** thuc has quit IRC | 01:45 | |
| fungi | clarkb: if we're approving api/sdk projects into stackforge at the moment, https://review.openstack.org/61954 and https://review.openstack.org/62069 are probably ready to go too | 01:45 |
| *** greghaynes has quit IRC | 01:46 | |
| *** SumitNaiksatam has joined #openstack-infra | 01:46 | |
| *** AlexF_ has joined #openstack-infra | 01:47 | |
| mordred | fungi: I'm thinking once we land all of these I can log in and run by hand again and see if anything breaks for me | 01:49 |
| clarkb | ++ | 01:49 |
| mordred | jeblair: ^^ if you're around, could you un-2 that? | 01:50 |
| mordred | jeblair: https://review.openstack.org/#/c/62069/ that is | 01:50 |
| fungi | i've still got a question out to mark c. about potential trademark issues with including the term "openstack" in the short names of unofficial projects, but i can't seem to get a timely answer so i'm in favor of just assuming it's fine until someone actually says it's not | 01:52 |
| clarkb | ypu need to twitter at him | 01:54 |
| fungi | i'm just not cool enough for teh tweeterz | 01:54 |
| *** greghaynes has joined #openstack-infra | 01:55 | |
| *** CaptTofu has quit IRC | 01:56 | |
| flashgordon | mordred: you had an idea about that one I think ^ | 01:56 |
| *** flashgordon is now known as jog0 | 01:57 | |
| fungi | nova casual nick fridays only extend to the end of utc friday i guess | 01:57 |
| mordred | I think it's fine, personally | 01:57 |
| fungi | i do too | 01:57 |
| mordred | the concern is whether or not there is an implication that the thing is part of openstack, or is a thing intended to consume opensatck | 01:58 |
| fungi | i would have liked to get a semi-official confirmation to that effect, but it doesn't strike me as something which risks brand confusion | 01:58 |
| mordred | it pretty clearly seems like the later to me, as it stands | 01:58 |
| *** xchu has quit IRC | 01:58 | |
| jog0 | fungi: it extends to friday business hours and being 6pm here | 01:58 |
| mordred | right | 01:58 |
| jog0 | OpenStack's X vs X for OpenStack | 01:59 |
| jog0 | you see what DefCore wants to do? | 01:59 |
| fungi | jog0: the issue being that in short project names there's limited real-estate to clarify the difference | 02:00 |
| mordred | jog0: no. what do they want to do? | 02:00 |
| fungi | jog0: i recommend dialling into future defcore conference calls. after all, they reach out to the community by having an irc channel where they can post the join.me url for their meetings | 02:01 |
| jog0 | mordred: see #5 http://robhirschfeld.com/2014/01/06/openstack-defcore/ | 02:01 |
| *** markmcclain has quit IRC | 02:02 | |
| jog0 | fungi: I defer to my boss for that kind of work usually. cough cough | 02:02 |
| mordred | ugh | 02:02 |
| fungi | also, they seem to be conveniently scheduled at the same times as tc and project meetings, and don't appear on the official meeting schedule | 02:02 |
| mordred | yeah | 02:02 |
| mordred | that's why I've stopped going to them | 02:02 |
| jog0 | they want 'OpenStack Compute Project Nova ' not '“OpenStack Nova' | 02:02 |
| mordred | what I enjoy about programs vs. projects ... | 02:02 |
| mordred | is taht they're assuming programs are a concept that has anything to do with the board | 02:03 |
| mordred | which I believe would need to be asserted first | 02:03 |
| jog0 | heh, or something a non dev needs to know about | 02:03 |
| fungi | it was also suggested on the last call that the board should scale back the official list of programs to just compute, storage and network | 02:03 |
| mordred | it's an interesting point they make though, tbh | 02:03 |
| *** kraman has quit IRC | 02:04 | |
| mordred | and one that we've also only danced aroudn a little bit | 02:04 |
| mordred | such as Deployment/TripleO being "official" but none of the projects in it being "integrated" | 02:04 |
| jog0 | mordred: one massive issue with the official project thing: too long of a name | 02:04 |
| mordred | fungi: well - the board can't do that | 02:04 |
| fungi | i know, that's why i found the suggestion amusing | 02:04 |
| mordred | fungi: so I'll be excited to see them attempt to try | 02:04 |
| mordred | what the board CAN do | 02:05 |
| fungi | i think some board members (present company excluded) don't realize where their reach actually ends | 02:05 |
| mordred | is EXPAND the list of official things past nova and swift | 02:05 |
| mordred | :) | 02:05 |
| jog0 | is write blog posts | 02:05 |
| mordred | jog0: yes. and write blog posts | 02:05 |
| fungi | blog posts fix everything | 02:05 |
| jog0 | anyway mordred have fun with that one | 02:07 |
| * jog0 wonders off while laughing at the board | 02:07 | |
| jog0 | wanders* | 02:08 |
| clarkb | jog0: wondering off seems like fun too | 02:10 |
| clarkb | like day dreaming | 02:10 |
| fungi | mordred: there seems to be a lot of noise still about designing refstack... what if we just deployed havana branches of the integrated projects with mostly-default but minimally redundant configuration on top of the tripleo bm cloud and ran a subset of tempest tests against it? | 02:10 |
| clarkb | fungi: or just tripleo itself | 02:11 |
| clarkb | whcih should be close to master | 02:11 |
| fungi | that seems to me to be at least 90% of the "challenge" met right there | 02:11 |
| openstackgerrit | A change was merged to openstack-infra/config: Adding empty gce-api project to stackforge https://review.openstack.org/61954 | 02:13 |
| clarkb | fungi: so it looks like one of those changes you pointed out has been approved and the other has a jeblair -2 | 02:13 |
| fungi | and i say havana because the defcore committee still seems focused on coming up with havana validation requirements by the icehouse release (why they don't see benefit in developing in parallel with icehouse in time for the icehouse release is still a mystery to me) | 02:13 |
| clarkb | I figure we should try running by hand with the ones approved so far and deal with jeblair -2 in the future? | 02:13 |
| fungi | sure | 02:13 |
| clarkb | fungi: hrm, ya seems like they should be looking forward | 02:13 |
| clarkb | since we move and near c and havana is old | 02:13 |
| *** changbl has joined #openstack-infra | 02:14 | |
| fungi | especially since havana will have about 9 months of security support left when icehouse releases | 02:14 |
| *** oubiwann_ has joined #openstack-infra | 02:14 | |
| *** AlexF_ has quit IRC | 02:22 | |
| *** salv-orlando has quit IRC | 02:25 | |
| *** esker has joined #openstack-infra | 02:25 | |
| *** VijayT has quit IRC | 02:28 | |
| *** ArxCruz has quit IRC | 02:30 | |
| *** salv-orlando has joined #openstack-infra | 02:34 | |
| *** saper has quit IRC | 02:35 | |
| clarkb | we should install http://bropages.org/ on all of our servers | 02:36 |
| clarkb | >_> | 02:36 |
| fungi | wow that is so... just wow. next they'll make it capable of scraping stackexchange and ubuntu forums for questionable advice | 02:39 |
| *** saper has joined #openstack-infra | 02:40 | |
| openstackgerrit | A change was merged to openstack-infra/config: Expands ldap to deal with nonstandard ldap configs. https://review.openstack.org/64456 | 02:44 |
| jnoller | dat moment when you keep refreshing stackforge | 02:44 |
| mordred | clarkb: um. wow | 02:44 |
| mordred | clarkb: think I should run the thing for jnoller ? | 02:44 |
| jnoller | lol | 02:45 |
| jnoller | I should be parenting | 02:45 |
| jnoller | but they're cool right now | 02:45 |
| mordred | jnoller: bah | 02:45 |
| *** emagana_ has quit IRC | 02:45 | |
| fungi | mordred: just say you did and then let him keep refreshing it for days | 02:45 |
| mordred | jnoller: stick em ina box with some cobras | 02:46 |
| mordred | jnoller: either they learn to deal with that situation or they don't | 02:46 |
| clarkb | mordred: I think you should go for it | 02:46 |
| *** emagana has joined #openstack-infra | 02:46 | |
| mordred | running | 02:47 |
| mordred | jnoller: /var/lib/git/stackforge/python-openstacksdk.git/ | 02:50 |
| mordred | gah | 02:50 |
| mordred | jnoller: http://git.openstack.org/cgit/stackforge/python-openstacksdk | 02:50 |
| mordred | is what I meant | 02:50 |
| *** emagana has quit IRC | 02:51 | |
| clarkb | mordred: and the other project was created fine as well? | 02:51 |
| clarkb | mordred: I am seriously tempted to write a change that schedules an at job for manage-projects | 02:51 |
| clarkb | such a hack but if it works | 02:51 |
| jnoller | mordred: i love you | 02:51 |
| clarkb | mordred: also, I noticed that our pull request closer bot doesn't seem to work anymore | 02:51 |
| clarkb | mordred: I think that may be related to the number of api requests manage-projects is making? | 02:52 |
| *** VijayT has joined #openstack-infra | 02:52 | |
| mordred | clarkb: haha | 02:52 |
| mordred | clarkb: well... funny story | 02:53 |
| mordred | I was thinking about making that be a zuul thing once I wrote the github zuul trigger thing | 02:53 |
| mordred | clarkb: because then instead of polling for things, we can just have zuul respond to github events and fire an action | 02:53 |
| mordred | which is hella more betterer | 02:53 |
| clarkb | mordred: neat | 02:53 |
| *** jerryz has quit IRC | 02:53 | |
| fungi | clarkb: the pull request closer is broken for a while. there are tracebacks in /var/spool/mail/gerrit2 for it, but i haven't had time to dig into the cause | 02:54 |
| *** gokrokve has quit IRC | 02:54 | |
| *** gokrokve has joined #openstack-infra | 02:54 | |
| fungi | i've had a paste of it up in a browser tab at home for weeks, hoping i'd get far enough down the stack of other to-do tabs to exhume it | 02:55 |
| mordred | clarkb: yup. gce-api worked too | 02:56 |
| *** gokrokve_ has joined #openstack-infra | 02:57 | |
| *** gokrokve has quit IRC | 02:59 | |
| *** AlexF_ has joined #openstack-infra | 02:59 | |
| *** wenlock has joined #openstack-infra | 03:01 | |
| *** gokrokve_ has quit IRC | 03:02 | |
| fungi | i will express again to no one in particular that it's really frustrating that doesn't "just work" when called in the scope of a puppet exec | 03:02 |
| mordred | yah | 03:03 |
| *** rakhmerov has quit IRC | 03:05 | |
| fungi | ahh, time to board the next flight. bbiab | 03:07 |
| *** pcrews has quit IRC | 03:07 | |
| clarkb | fungi: have fun in pheonix | 03:07 |
| clarkb | I suppose not doing the rename works out because you will be in the wrong part of the coutrny | 03:07 |
| *** oubiwann_ has quit IRC | 03:14 | |
| openstackgerrit | A change was merged to openstack/requirements: Allow use of oslo.messaging 1.3.0a4 from pypi https://review.openstack.org/68040 | 03:16 |
| *** beekneemech has quit IRC | 03:21 | |
| *** gokrokve has joined #openstack-infra | 03:22 | |
| *** dcramer_ has joined #openstack-infra | 03:23 | |
| *** bnemec has joined #openstack-infra | 03:25 | |
| *** sarob has joined #openstack-infra | 03:26 | |
| *** sarob has quit IRC | 03:27 | |
| openstackgerrit | A change was merged to openstack/requirements: Add openstack-doc-tools https://review.openstack.org/65361 | 03:28 |
| *** praneshp has quit IRC | 03:31 | |
| *** praneshp has joined #openstack-infra | 03:33 | |
| *** rakhmerov has joined #openstack-infra | 03:34 | |
| *** AlexF_ has quit IRC | 03:39 | |
| *** CaptTofu has joined #openstack-infra | 03:52 | |
| *** jasondotstar has joined #openstack-infra | 04:02 | |
| *** sarob has joined #openstack-infra | 04:05 | |
| *** coolsvap has quit IRC | 04:08 | |
| *** praneshp has quit IRC | 04:11 | |
| *** gokrokve has quit IRC | 04:21 | |
| *** gokrokve has joined #openstack-infra | 04:22 | |
| *** rwsu has quit IRC | 04:25 | |
| *** gokrokve has quit IRC | 04:26 | |
| *** esker has quit IRC | 04:26 | |
| *** senk has joined #openstack-infra | 04:26 | |
| *** esker has joined #openstack-infra | 04:27 | |
| *** mriedem has joined #openstack-infra | 04:27 | |
| *** sarob has quit IRC | 04:29 | |
| *** ok_delta__ has quit IRC | 04:30 | |
| *** senk has quit IRC | 04:31 | |
| *** mriedem has quit IRC | 04:36 | |
| *** mriedem has joined #openstack-infra | 04:41 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 04:42 | |
| *** esker has quit IRC | 04:49 | |
| *** mriedem has quit IRC | 04:51 | |
| *** VijayT has quit IRC | 04:55 | |
| *** rakhmerov has left #openstack-infra | 05:03 | |
| *** greghaynes has quit IRC | 05:05 | |
| *** greghaynes has joined #openstack-infra | 05:10 | |
| *** CaptTofu has quit IRC | 05:12 | |
| *** CaptTofu has joined #openstack-infra | 05:13 | |
| *** HenryG has quit IRC | 05:14 | |
| *** AaronGr is now known as AaronGr_Zzz | 05:16 | |
| *** CaptTofu has quit IRC | 05:18 | |
| clarkb | fungi: http://www.ustream.tv/recorded/42950577 now we know what you do in utah | 05:19 |
| *** dstanek has quit IRC | 05:22 | |
| fungi | the wireless internet on my next flight had better not be broken like on the one i was just on. growl | 05:23 |
| clarkb | fungi: I'm sorry. also you should've helped with the drawing because lol | 05:23 |
| fungi | yeah, i didn't even realize they did that | 05:25 |
| fungi | pretty hilarious | 05:25 |
| fungi | i guess that's what claire was editing footage for yesterday when we were sitting quietly in the lounge getting work done | 05:26 |
| *** pcrews has joined #openstack-infra | 05:26 | |
| *** pcrews has quit IRC | 05:36 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 05:36 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 05:37 | |
| *** praneshp has joined #openstack-infra | 05:38 | |
| openstackgerrit | A change was merged to openstack/requirements: nova api validation fw requires jsonschema >= 2.0.0 https://review.openstack.org/66464 | 05:40 |
| openstackgerrit | A change was merged to openstack/requirements: Remove oauth2 requirement https://review.openstack.org/68422 | 05:40 |
| openstackgerrit | A change was merged to openstack/requirements: Bump python-savannaclient version to >=0.4.1 https://review.openstack.org/66723 | 05:55 |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 06:08 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 06:09 | |
| *** jasondotstar has quit IRC | 06:12 | |
| *** wenlock has quit IRC | 06:13 | |
| mordred | Alex_Gaynor, jnoller: I just cookiecuttered your new repo. merry christmas | 06:30 |
| *** coolsvap has joined #openstack-infra | 06:34 | |
| *** coolsvap has quit IRC | 06:34 | |
| *** harlowja is now known as harlowja_away | 06:52 | |
| *** CaptTofu has joined #openstack-infra | 07:14 | |
| *** CaptTofu has quit IRC | 07:18 | |
| *** morganfainberg is now known as morganfainberg|z | 07:29 | |
| *** markwash has quit IRC | 07:43 | |
| *** yamahata has joined #openstack-infra | 07:45 | |
| *** markwash has joined #openstack-infra | 08:02 | |
| *** denis_makogon_ has joined #openstack-infra | 08:03 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add logging to #openstack-meeting-3 https://review.openstack.org/67152 | 08:08 |
| *** dkliban has quit IRC | 08:11 | |
| *** lttrl has joined #openstack-infra | 08:21 | |
| *** openstack has joined #openstack-infra | 08:22 | |
| *** yolanda_ has joined #openstack-infra | 08:33 | |
| *** lttrl has quit IRC | 08:35 | |
| *** afazekas has joined #openstack-infra | 09:04 | |
| *** CaptTofu has joined #openstack-infra | 09:15 | |
| *** luqas has joined #openstack-infra | 09:16 | |
| *** CaptTofu has quit IRC | 09:19 | |
| *** praneshp has quit IRC | 10:00 | |
| *** markwash has quit IRC | 10:01 | |
| *** max_lobur_afk is now known as max_lobur | 10:02 | |
| *** yamahata has quit IRC | 10:19 | |
| *** luqas has quit IRC | 10:31 | |
| *** boris-42 has joined #openstack-infra | 10:49 | |
| *** luqas has joined #openstack-infra | 11:01 | |
| *** CaptTofu has joined #openstack-infra | 11:15 | |
| fungi | yay! my maildir for openstack mailing lists no longer claims >1500 unread messages | 11:17 |
| *** CaptTofu has quit IRC | 11:20 | |
| *** wenlock has joined #openstack-infra | 11:26 | |
| *** wenlock has quit IRC | 11:30 | |
| *** coolsvap has joined #openstack-infra | 11:54 | |
| *** denis_makogon_ has quit IRC | 11:57 | |
| *** david-lyle has quit IRC | 12:04 | |
| sdague | fungi: craziness | 12:13 |
| *** yolanda_ has quit IRC | 12:21 | |
| *** coolsvap has quit IRC | 12:30 | |
| *** yolanda_ has joined #openstack-infra | 12:32 | |
| *** coolsvap has joined #openstack-infra | 12:32 | |
| *** jasondotstar has joined #openstack-infra | 12:37 | |
| *** alexpilotti has quit IRC | 12:39 | |
| *** flaper87|afk is now known as flaper87 | 12:44 | |
| *** yolanda_ has quit IRC | 12:50 | |
| *** yolanda_ has joined #openstack-infra | 12:52 | |
| *** CaptTofu has joined #openstack-infra | 12:53 | |
| *** yolanda_ has quit IRC | 12:57 | |
| *** CaptTofu has quit IRC | 12:57 | |
| *** CaptTofu has joined #openstack-infra | 13:04 | |
| *** coolsvap has quit IRC | 13:33 | |
| fungi | craziness is that i still have another 4 hours in the phx airport. then i hop a plane which touches down in aus and bna on the way to rdu | 13:38 |
| fungi | but it was good for catching up on e-mail and bugs | 13:39 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: stop being rediculous with our time formats https://review.openstack.org/68765 | 13:40 |
| *** nati_ueno has joined #openstack-infra | 13:40 | |
| fungi | the gate also did a lot of catching up | 13:41 |
| sdague | yep | 13:44 |
| sdague | yeh, I noticed the fungi furious emailing | 13:44 |
| sdague | the sliding window definitely helped | 13:45 |
| fungi | certainly seems that way | 13:46 |
| fungi | that and fixing or mitigating lots of bugs | 13:46 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: stop being rediculous with our time formats https://review.openstack.org/68765 | 13:47 |
| sdague | yep | 13:47 |
| anteaya | fungi: phx is not a bad airport | 13:48 |
| sdague | fungi: also curious that the tripleo jobs are stacking up on waiting for something | 13:48 |
| anteaya | just sux that there are no beds in there | 13:48 |
| fungi | anteaya: yeah, it's been pleasant. i found several places where they had televisions running cartoons | 13:48 |
| *** dkliban has joined #openstack-infra | 13:48 | |
| sdague | nice | 13:48 |
| fungi | also, had the place mostly to myself. very peaceful except for the vacuum cleaners | 13:49 |
| anteaya | fungi: yay for cartoons | 13:49 |
| anteaya | ha ha ha | 13:49 |
| fungi | sdague: gate-tripleo-deploy jobs use a node type specific to the tripleo bare metal cloud | 13:50 |
| sdague | fungi: yep, that's what I expected | 13:50 |
| sdague | so the tripleo cloud is not working to provide those resources? | 13:50 |
| sdague | seems like waiting for 3+hrs probably means it's just down | 13:51 |
| anteaya | just looking at my inbox | 13:51 |
| fungi | looks like there are two tripleo-precise nodes building in the tripleo-test-cloud provider currently, according to nodepool list | 13:51 |
| fungi | but they may be failing to build | 13:51 |
| anteaya | the emails dealing with 3rd party test accounts has me scared | 13:52 |
| anteaya | just in terms of the number of them | 13:52 |
| fungi | lifeless: http://paste.openstack.org/show/61879/ | 13:53 |
| fungi | anteaya: embrace the chaos | 13:53 |
| * anteaya runs screaming into the abyss | 13:53 | |
| sdague | yeh, I think we need to realize that gerrit ui isn't really sufficient for this. And rethink how we are collecting results. | 13:54 |
| fungi | what frightened me was the thread on the -dev ml from some new driver author stating that they'd installed jenkins and wanted to know how they were supposed to configure it to contribute code to the project | 13:54 |
| sdague | heh | 13:54 |
| * fungi cries | 13:55 | |
| fungi | lifeless: and now with actual traceback http://paste.openstack.org/show/61880/ | 13:57 |
| fungi | that's probabably more helpful | 13:58 |
| fungi | probababababably | 13:58 |
| anteaya | so on that note, these new 3rd party testing accounts, do they have verification voting on or off by default? | 13:58 |
| * anteaya tenses up | 13:58 | |
| fungi | we still haven't approved the documentation letting people know that all those instructions about how to vote won't actually work until some nebulous authority (not it!) confirms they're "stable" | 13:59 |
| anteaya | so that means they have voting turned on? | 13:59 |
| anteaya | :( | 13:59 |
| fungi | yep | 13:59 |
| anteaya | a sense another misarable week on the horizon | 14:00 |
| * anteaya cries | 14:00 | |
| fungi | the last teams whose service accounts i've disabled keep coming back to me trying to explain why it's okay to turn them back on again. i really don't want to be the decision maker on that since it doesn't affect me directly | 14:00 |
| *** blitzrage is now known as leifmadsen | 14:01 | |
| fungi | many of them seemed to be under the impression that if they weren't running voting systems by last week, their drivers were all going to be deleted | 14:02 |
| anteaya | yeah | 14:03 |
| anteaya | hence mikal's desire to get this issue in front of the tx | 14:03 |
| anteaya | tc | 14:03 |
| anteaya | which happened for the first time last week | 14:03 |
| fungi | thus a scramble at the last moment to add numerous partially-working bots | 14:03 |
| *** nati_ueno has quit IRC | 14:03 | |
| anteaya | but needs more conversationi | 14:03 |
| anteaya | yes | 14:03 |
| *** nati_ueno has joined #openstack-infra | 14:04 | |
| anteaya | and of the dozen or so just added, I have money on better than half of them not getting voting right | 14:04 |
| anteaya | for various and sundry reasons | 14:04 |
| anteaya | well when I get hit up, I will just come back here and request that voting get turned off on various accounts when it happens | 14:05 |
| fungi | i've +2'd the documentation update for it, but don't want to go approving a proscriptive policy text as the only +2 | 14:06 |
| anteaya | right | 14:06 |
| anteaya | I hear that | 14:06 |
| anteaya | you are playing your role exactly as I rely on you to | 14:07 |
| anteaya | thank you | 14:07 |
| anteaya | my frustration is with all these new account holders | 14:07 |
| fungi | so long as we have some consistent communication that we're retroactively revoking voting for all third-party service accounts, i'm fine doing it. but these people's configurations are going to break and fail to be able to comment on reviews from that point until they adjust their configuration to not try to vote any longer | 14:07 |
| anteaya | it is like driving in snow in vancouver, I know what I am doing but I stay off the road anyway | 14:07 |
| anteaya | right | 14:08 |
| anteaya | they don't understand the difference between commenting and voting | 14:08 |
| fungi | and i've already tested out the "ptl approves voting" suggestion. getting ptls to respond to the driver authors e-mail pleas to reinstate voting rights seems to be a bit of a bottleneck | 14:09 |
| anteaya | yes | 14:10 |
| fungi | maybe getting them approved as part of the weekly meeting for a particular program would be more constructive | 14:10 |
| anteaya | as I had figured it would | 14:10 |
| anteaya | but I had no data point to back up my thoughts | 14:10 |
| anteaya | that's an idea | 14:10 |
| anteaya | would force the 3rd party testing people to at least attend one meeting | 14:11 |
| fungi | at least it's a realtime conversation where there are enough people present to reach consensus, and meetbot can even be used to vote on them | 14:11 |
| anteaya | I agree | 14:11 |
| anteaya | it is worth a try | 14:11 |
| fungi | and then we have a public record | 14:11 |
| anteaya | and takes the responsibility off of infra | 14:11 |
| anteaya | yes | 14:11 |
| fungi | and then i'm perfectly happy to point the maintainers of those bots back to the deciding body and/or their decrees | 14:12 |
| anteaya | makes sense to me | 14:12 |
| anteaya | the thing is getting it in place | 14:12 |
| anteaya | because here comes another wave | 14:13 |
| fungi | well, the pain will spur people to action more quickly this time, perhaps | 14:13 |
| *** CaptTofu has quit IRC | 14:13 | |
| *** CaptTofu has joined #openstack-infra | 14:14 | |
| fungi | crikey! the gate's so shallow now that every change in it is currently being tested! | 14:14 |
| fungi | d'oh, someone just added a new change to spite me | 14:14 |
| anteaya | woohoo | 14:14 |
| anteaya | they were listening | 14:15 |
| fungi | we also have an inversion error or something in the enqueued time calculations... it very briefly showed as being in the gate for -1 hours and something | 14:15 |
| anteaya | we will see what action comes out of the pain this round | 14:15 |
| anteaya | personally I am considering going back to bed and pulling the covers over my head | 14:15 |
| anteaya | some soft singing in the background couldn't hurt either | 14:15 |
| anteaya | and a cat | 14:16 |
| anteaya | ha ah aha | 14:16 |
| anteaya | that would be our time travelling contributor | 14:16 |
| *** CaptTofu has quit IRC | 14:18 | |
| *** dcramer_ has quit IRC | 14:20 | |
| sdague | fungi: yeh, that was me :) | 14:26 |
| sdague | I'm going through some of my review queue | 14:26 |
| fungi | i need to be doing that, but am a bit on the spacey side so i'm just going to stick to catching up on more of my e-mail backlog instead for now | 14:27 |
| *** luqas has quit IRC | 14:38 | |
| *** mriedem has joined #openstack-infra | 14:41 | |
| *** mriedem is now known as mcrodermang | 14:44 | |
| *** nati_ueno has quit IRC | 14:44 | |
| *** nati_ueno has joined #openstack-infra | 14:44 | |
| *** DinaBelova_ is now known as DinaBelova | 14:45 | |
| anteaya | fungi: I'm going through my email and can't see the emails that are posted by people wanting the have voting turned on for their systems | 14:45 |
| anteaya | do they use the [neutron] tag? | 14:46 |
| pleia2 | anteaya: infra mailing list | 14:46 |
| pleia2 | some folks also submit bugs against openstack-ci | 14:47 |
| fungi | anteaya: the most recent one was e-mailing me privately, and then asked me to e-mail markmcclain (i told them to e-mail him instead and cc me if they liked, but agree cc'ing a ml would have been better) | 14:47 |
| fungi | anteaya: but remember not all of these third-party systems are neutron-related. we've had misbehaving ones for nova drivers too | 14:48 |
| anteaya | pleia2: yeah I'm reading the infra ml | 14:48 |
| anteaya | yes | 14:48 |
| pleia2 | ah, ok | 14:48 |
| fungi | and it sounds like we're likely to end up with similar requests from driver authors for cinder and ironic too | 14:49 |
| pleia2 | I guess most on the ml have just been setting up accounts, not talking about voting | 14:49 |
| anteaya | just trying to track down the trail you mentioned of ptls being a bottle neck for not turning systems back on when they request it | 14:49 |
| anteaya | pleia2: so far | 14:49 |
| anteaya | I have been making it a habit of looping in the infra ml when addressing issues with 3rd party systems | 14:49 |
| fungi | anteaya: yeah, if the current one in question contacts me again asking for an update, i'll tell them to ask on the -dev ml and use a project tag for whatever their driver is in | 14:50 |
| anteaya | for lack of a better way to track conversation | 14:50 |
| anteaya | thanks | 14:50 |
| anteaya | and if I miss it, do point me to it | 14:50 |
| fungi | because not only do i not want to be the one making that decision, i also don't want to be a go-between | 14:50 |
| anteaya | I hear that | 14:51 |
| anteaya | I don't mind being the go between at this moment | 14:51 |
| anteaya | since most of teh pain comes from neutron | 14:51 |
| *** CaptTofu has joined #openstack-infra | 14:51 | |
| anteaya | but it isn't my decision either, unless some group decides they want me to exercise my judgement in that capacity | 14:51 |
| anteaya | which noone has indicated they do | 14:52 |
| fungi | however, many of these driver authors seem hesitant to speak in public irc channels or mailing lists and seem to want to use private messaging and personal e-mail messages. hopefully the project will break them of those tendencies | 14:52 |
| anteaya | agreed | 14:52 |
| anteaya | they fear of speaking in public leads to many of the problems they are experiencing and foisting on the rest of us | 14:52 |
| anteaya | s/they fear/their fear | 14:53 |
| *** oubiwann has quit IRC | 14:55 | |
| anteaya | as a side note, on observation from code sprint is the folks that have the hardest time interacting remotely seem to have a higher tendencey of driving windows | 14:55 |
| *** dcramer_ has joined #openstack-infra | 14:57 | |
| *** nati_ueno has quit IRC | 15:04 | |
| fungi | that microsoft thing? ew | 15:06 |
| anteaya | yeah | 15:07 |
| anteaya | so this neutron patch is in the gate on a reverify bug <bug number> https://review.openstack.org/#/c/66609/ | 15:07 |
| anteaya | do you want to see what it does or do you want it out? | 15:08 |
| anteaya | isolated tests are passing about 30% of the time still | 15:08 |
| anteaya | nothing has been merged to neutron since last week: http://git.openstack.org/cgit/openstack/neutron/log/ | 15:09 |
| fungi | fun | 15:09 |
| anteaya | yeah | 15:10 |
| anteaya | so snipe it out or leave it in? | 15:10 |
| anteaya | it removes a dependency | 15:11 |
| sdague | anteaya: if you don't think it's going to pass, I'd take it out | 15:11 |
| anteaya | it has a 30% chance of passing isolated tests | 15:12 |
| sdague | anteaya: collectively? | 15:12 |
| sdague | or each one | 15:12 |
| fungi | it also might be worth pointing out to the people reverifying it that there's little hope of it merging until something is done about the failing jobs | 15:12 |
| anteaya | ah, I don't know | 15:12 |
| sdague | fungi: I've given up on educating people here | 15:12 |
| anteaya | fungi: yeah, that was teh song I was singing all last week | 15:12 |
| sdague | I honestly think reverify just needs to be removed | 15:12 |
| anteaya | got a bit of blow back from folks who thought I was overstepping by using gerrit comments to drive behaviour | 15:13 |
| anteaya | my response was what choice do I have, nothing else is working? | 15:13 |
| sdague | fungi: yuo know what's about to happen? | 15:13 |
| *** DinaBelova is now known as DinaBelova_ | 15:14 | |
| fungi | 11-way merge? | 15:14 |
| anteaya | https://review.openstack.org/#/c/67708/ | 15:14 |
| fungi | ahh, 6-way anyway. a couple of those 0-minute-remaining changes further down still have jobs running | 15:15 |
| sdague | fungi: more importantly.... we're going to drop the gate down to changes that have been approved in the last 2 hrs | 15:15 |
| dolphm | i'm trying to test a log stash query and expecting to get the failed gate run i'm referencing... is there any reason why it wouldn't come back as a result? (delay in processing logs or something?) | 15:16 |
| fungi | yup | 15:16 |
| fungi | dolphm: extremely recent result? if so, then yes there's a bit of a delay | 15:16 |
| dolphm | fungi: it's from a failed run 8 hours ago | 15:17 |
| fungi | dolphm: oh, it should have been indexed long ago then. which log file? there are some logs which don't get loaded into logstash | 15:17 |
| dolphm | http://logs.openstack.org/46/63546/5/gate/gate-tempest-dsvm-postgres-full/37bd7e9/console.html | 15:18 |
| fungi | console.html should always be loaded | 15:18 |
| dolphm | and my query... http://logstash.openstack.org/#eyJmaWVsZHMiOltdLCJzZWFyY2giOiJtZXNzYWdlOlwiIFNTSEV4Y2VwdGlvbjogRXJyb3IgcmVhZGluZyBTU0ggcHJvdG9jb2wgYmFubmVyXCIgQU5EIG1lc3NhZ2U6XCIgRmFpbGVkIHRvIGVzdGFibGlzaCBhdXRoZW50aWNhdGVkIHNzaCBjb25uZWN0aW9uIHRvIGNpcnJvc1wiIEFORCBmaWxlbmFtZTpcImNvbnNvbGUuaHRtbFwiIiwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJvZmZzZXQiOjAsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxMzkwN | 15:18 |
| dolphm | jYzMDM3MDI5fQ== | 15:18 |
| anteaya | I've submitted a new patchset, so it should be out of the gate when the 25+ events are processed | 15:18 |
| anteaya | sdague: have you seen 67708 yet? | 15:19 |
| anteaya | it would be a fine time for fungi to approve it | 15:19 |
| dolphm | (short URL to the same query) http://bit.ly/1dXKTQQ | 15:20 |
| fungi | anteaya: new patchset of what? | 15:20 |
| sdague | dolphm: we were losing console logs for a while | 15:20 |
| fungi | but we shoudn't have lost any 8 hours ago, right? | 15:20 |
| sdague | dolphm: so you can only match on single lines | 15:20 |
| dolphm | sdague: oooh... | 15:21 |
| sdague | which is a limitation of logstash | 15:21 |
| sdague | each line is a document | 15:21 |
| sdague | not each log file | 15:21 |
| anteaya | fungi: I sniped the neutron patch | 15:21 |
| anteaya | out of the gate | 15:21 |
| dolphm | harumph. | 15:21 |
| fungi | anteaya: oh, that | 15:22 |
| anteaya | yeah | 15:23 |
| sdague | fungi: how do you feel about +A this - https://review.openstack.org/#/c/61892/ | 15:23 |
| sdague | as my d-g +2 still hasn't shown up ;) | 15:23 |
| sdague | we really do want the libvirt logs | 15:24 |
| anteaya | https://review.openstack.org/#/c/67708/ <-- removes reverify entirely | 15:25 |
| fungi | sdague: -1 (it will conflict, but it also needs to go into $BASE/logs now). i'll leave a comment | 15:26 |
| fungi | sdague: i'm +2/a on the overall idea, fwiw | 15:29 |
| sdague | ok | 15:29 |
| sdague | that's been pretty long standing issue, so we need to get that collection in soon | 15:29 |
| fungi | but we changed that function up quite a bit yesterday chasing the enospc->jenkins offlines your slave during log collection bug which was causing some gate resets | 15:29 |
| sdague | I need to catch up on the d-g changes... been ignoring everything the last week | 15:30 |
| *** cody-somerville has quit IRC | 15:30 | |
| openstackgerrit | Dolph Mathews proposed a change to openstack-infra/elastic-recheck: query for bug 1200731 https://review.openstack.org/69132 | 15:33 |
| *** jasondotstar has quit IRC | 15:35 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 15:35 | |
| sdague | top of gate entered 1h 20min ago | 15:41 |
| sdague | so nice when this stuff works | 15:41 |
| dolphm | (woo!) | 15:41 |
| dolphm | sdague: fungi: thanks for the tips regarding log stash | 15:41 |
| sdague | dolphm: no problem | 15:41 |
| fungi | dolphm: almost as good as stock tips | 15:41 |
| *** pcrews has joined #openstack-infra | 15:43 | |
| *** DinaBelova_ is now known as DinaBelova | 15:43 | |
| sdague | you don't want my stock tips | 15:44 |
| anteaya | don't invest in the Canadian dollar right now | 15:44 |
| * fungi should have invested in icelandic currency when they crashed. would have made for a great vacation fund | 15:45 | |
| *** blamar has quit IRC | 15:45 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:45 | |
| dolphm | how long does log stash retain records? | 15:46 |
| *** cody-somerville has joined #openstack-infra | 15:46 | |
| fungi | dolphm: two weeks | 15:46 |
| fungi | (roughy) | 15:46 |
| fungi | (er, roughly) | 15:46 |
| anteaya | fungi: yeah, no kidding | 15:47 |
| fungi | could have lived a month in one of those hot springs resorts for almost nothing | 15:48 |
| anteaya | it would make a nice place to run away to | 15:51 |
| anteaya | hard to keep the laptop dry in the hot springs | 15:52 |
| dolphm | so, when does /elastic-recheck/ earn a top level link on status.openstack.org? | 15:52 |
| fungi | dolphm: i think they were working on the final feature-parity gap before replacing the current recheck page with it | 15:53 |
| *** HenryG has joined #openstack-infra | 15:53 | |
| *** dstanek has joined #openstack-infra | 15:57 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 15:57 | |
| sdague | dolphm: yeh, honestly, https://review.openstack.org/#/q/status:open+project:openstack-infra/config+branch:master+topic:gatestatus,n,z needs to happen first as well | 15:59 |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:59 | |
| *** fallenpegasus has joined #openstack-infra | 16:02 | |
| *** thuc_ has joined #openstack-infra | 16:03 | |
| mordred | sdague: I really want to break that stuff out into an app that's not just embedded in the config repo | 16:04 |
| sdague | mordred: that's fine, submit the patches :) | 16:04 |
| mordred | sdague: I've been working on it :) | 16:05 |
| anteaya | sdague: can you vote on this? https://review.openstack.org/#/c/68969/ | 16:05 |
| anteaya | and then if sean likes it can you approve it please, mordred? | 16:06 |
| sdague | anteaya: sure | 16:06 |
| anteaya | thanks | 16:06 |
| *** yamahata has joined #openstack-infra | 16:06 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 16:07 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 16:07 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov | 16:07 | |
| dolphm | when you mark bugs as dupes in lp, is /rechecks/ smart enough to aggregate failures together? | 16:09 |
| *** jasondotstar has joined #openstack-infra | 16:09 | |
| openstackgerrit | A change was merged to openstack-infra/config: Add logging to #openstack-gate https://review.openstack.org/68969 | 16:10 |
| *** dstanek_afk has joined #openstack-infra | 16:11 | |
| anteaya | thanks mordred | 16:11 |
| sdague | dolphm: I'm not sure | 16:13 |
| sdague | /rechecks/ is kind of crap | 16:13 |
| *** dstanek has quit IRC | 16:13 | |
| sdague | mordred: are the new rax nodes all performance? | 16:14 |
| mordred | sdague: yeah | 16:15 |
| sdague | because they kind of seem slow... though I haven't run numbers yet | 16:15 |
| sdague | so I think one adjustment to the sliding window algorithm we need is to bump the window when anything in the window succeeds | 16:16 |
| sdague | because otherwise we end up running very few d-g nodes, as we get chunks lined up ready to go, but we haven't bumped the window yet | 16:17 |
| *** openstack has joined #openstack-infra | 16:19 | |
| *** alexpilotti has joined #openstack-infra | 16:22 | |
| *** lttrl has joined #openstack-infra | 16:23 | |
| jnoller | mordred: poke | 16:23 |
| jnoller | sdague: all the rackspace nodes should be performance flavors; but what OS flavor did you guys pick? | 16:24 |
| *** CaptTofu has quit IRC | 16:26 | |
| *** CaptTofu has joined #openstack-infra | 16:27 | |
| *** DinaBelova is now known as DinaBelova_ | 16:27 | |
| *** dkliban has quit IRC | 16:28 | |
| jnoller | sdague mordred - you want the PV-HVM OS images | 16:28 |
| *** lttrl has quit IRC | 16:29 | |
| jeblair | clarkb: ack and cool on gerrit fix. | 16:30 |
| jeblair | mordred: -2 removed | 16:30 |
| jeblair | jnoller: looking | 16:30 |
| sdague | jnoller: https://github.com/openstack-infra/config/blob/master/modules/openstack_project/templates/nodepool/nodepool.yaml.erb#L52 | 16:31 |
| *** CaptTofu has quit IRC | 16:31 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 16:31 | |
| *** DinaBelova_ is now known as DinaBelova | 16:31 | |
| *** luqas has joined #openstack-infra | 16:32 | |
| jeblair | jnoller: i only see 'Fedora 19 (Schrodinger's Cat) (PVHVM beta)' for that | 16:32 |
| jeblair | sdague: have you correlated slowness with zones? istr that yesterday the slow nodes we were looking at were all from iad | 16:33 |
| sdague | I haven't yet. I have a script, but I need to rework it to poll all the jenkins | 16:33 |
| sdague | and ... it's saturday :) | 16:34 |
| sdague | so I was just working through low complexity reviews that I felt like I got behind on | 16:34 |
| jnoller | jeblair: I can enable the pv-hvm images for the OS you need (see: http://developer.rackspace.com/blog/welcome-to-performance-cloud-servers-have-some-benchmarks.html) | 16:35 |
| jnoller | if you drop me an email (jesse.noller@rackspace.com) with the account # and which OS you all need I can flip the bit. They're still being rolled out | 16:36 |
| jeblair | jnoller: will it show up as an additional image? that way we can spin up some test jobs with it to validate... | 16:36 |
| jnoller | Yup! | 16:36 |
| jnoller | different ID on the image | 16:37 |
| jnoller | it may take until monday unless the person with the accounts control is also working today :) | 16:37 |
| *** max_lobur is now known as max_lobur_afk | 16:38 | |
| jnoller | mordred: just poking about https://review.openstack.org/#/c/69104/ vs https://review.openstack.org/#/c/69097/ | 16:38 |
| jeblair | jnoller: cool, sounds great thanks; email sent | 16:39 |
| jnoller | jeblair: what OS | 16:41 |
| sdague | jnoller: Ubuntu 12.04 | 16:43 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Unlaunchpadify projects.yaml https://review.openstack.org/62189 | 16:43 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Track direct-release projects in projects.yaml https://review.openstack.org/62190 | 16:43 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Split config from projects list https://review.openstack.org/62187 | 16:43 |
| *** dcramer_ has quit IRC | 16:43 | |
| mordred | clarkb: ok - I think I fixed that series up and should be good now - I also squashed two of them, because the jeepyb change, which is landed, handles both names, so there was no need for two steps | 16:44 |
| mordred | jnoller: oh! great - I didn't see that you'd done that - ignore mine | 16:45 |
| mordred | jnoller: I was merely trying to be helpful :) | 16:45 |
| jnoller | mordred: Thank you, I really appreciate it | 16:45 |
| jnoller | I was just like huh what zuul git omg | 16:45 |
| mordred | jnoller: people are like that all the tie | 16:46 |
| mordred | tie | 16:46 |
| *** DinaBelova is now known as DinaBelova_ | 16:46 | |
| mordred | time | 16:46 |
| mordred | dammit | 16:47 |
| mordred | I need coffee | 16:47 |
| anteaya | I liked tie | 16:47 |
| mordred | jeblair: thanks on the -2 - btw - the current working theory is still sadly holding up | 16:47 |
| jnoller | jeblair: email sent - I'll let you know when they enable the image ID on the account | 16:47 |
| mordred | jeblair: I've now run a NUMBER of these by hand and all have worked - something about running via puppet is causing hives | 16:47 |
| anteaya | yay 5 in post | 16:47 |
| *** dstanek_afk has quit IRC | 16:50 | |
| mordred | yay 502's from pypi! | 16:50 |
| mordred | dstufft: ^^ fwiw | 16:50 |
| dstufft | mordred: we're doing maintenance at the moment :] | 16:50 |
| sdague | yet again, openstack-ci - the health checker of the internet | 16:52 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Clarify required parameters in query_builder https://review.openstack.org/67756 | 16:52 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Stop logging skipped bugs https://review.openstack.org/68810 | 16:53 |
| jnoller | oh god dstufft is here | 16:54 |
| mordred | dstufft: ok. as long as you know about it - not a huge deal here | 16:54 |
| jnoller | o_O | 16:54 |
| mordred | jnoller: oh yeah. dstufft is our magical unicorn of pypi and pip | 16:55 |
| jnoller | he's mine too | 16:55 |
| *** dcramer_ has joined #openstack-infra | 16:55 | |
| mordred | jnoller: I have literally no idea what we'd do without being able to poke him from time to time | 16:55 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Account for both possible projects.yaml names https://review.openstack.org/69139 | 16:55 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Unlaunchpadify projects.yaml https://review.openstack.org/62189 | 16:55 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Track direct-release projects in projects.yaml https://review.openstack.org/62190 | 16:55 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Split config from projects list https://review.openstack.org/62187 | 16:55 |
| *** dstanek_afk has joined #openstack-infra | 17:00 | |
| mordred | fungi: this one: https://review.openstack.org/#/c/69139/ need to land before the others can pass - because the test is in jenkins_slave_scripts and has to land before the repo can use it to test | 17:01 |
| dstufft | mordred: jnoller :D | 17:02 |
| *** dstanek_afk has quit IRC | 17:02 | |
| dstufft | mordred: we just moved PyPI off of a VM that radomly kernel paniced on OSUOSL hardware onto half a dozen racksapce cloud servers heh | 17:02 |
| fungi | i think i've hit that zone where after you've been up for more than 24 hours suddenly you feel completely awake and clear-headed again | 17:04 |
| fungi | but now it's time to board another plane | 17:05 |
| anteaya | I hope you get some sleep | 17:07 |
| anteaya | or do you want to just stay awake? | 17:07 |
| fungi | i just want to stay awake at this point | 17:10 |
| anteaya | okay | 17:11 |
| *** elasticio has joined #openstack-infra | 17:11 | |
| anteaya | I hope you stay awake then | 17:11 |
| openstackgerrit | A change was merged to openstack-infra/config: Account for both possible projects.yaml names https://review.openstack.org/69139 | 17:14 |
| clarkb | fungi: I looked at grabbing configs eith logs in d-g and gave up because configs are too scattered. what I was hoping to do was tarball /etc/openstack/* and be done but config locations are static for many projrcts | 17:15 |
| *** fallenpegasus has quit IRC | 17:19 | |
| *** fallenpegasus has joined #openstack-infra | 17:20 | |
| *** yamahata has quit IRC | 17:21 | |
| *** thuc_ has quit IRC | 17:21 | |
| *** markwash has joined #openstack-infra | 17:22 | |
| *** thuc has joined #openstack-infra | 17:22 | |
| *** DinaBelova_ is now known as DinaBelova | 17:22 | |
| *** kraman has joined #openstack-infra | 17:25 | |
| *** thuc has quit IRC | 17:26 | |
| *** fallenpegasus has quit IRC | 17:28 | |
| mordred | clarkb: I'd REALLY like to poke people about that | 17:29 |
| mordred | you know, next time I get half a second to spend on tilting at a new windmill | 17:29 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Unlaunchpadify projects.yaml https://review.openstack.org/62189 | 17:31 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Track direct-release projects in projects.yaml https://review.openstack.org/62190 | 17:31 |
| openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Split config from projects list https://review.openstack.org/62187 | 17:31 |
| mordred | clarkb: also, those above shoudl have taken care of your and zaro's comments | 17:31 |
| *** denis_makogon_ has joined #openstack-infra | 17:34 | |
| *** dcramer_ has quit IRC | 17:37 | |
| *** DinaBelova is now known as DinaBelova_ | 17:38 | |
| anteaya | mordred: are you lacking for windmills? | 17:40 |
| mordred | anteaya: no. plenty of windmills | 17:40 |
| anteaya | that's what I had thought | 17:42 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add --noirc to tox run job https://review.openstack.org/68972 | 17:48 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add basic unit tests for the bot https://review.openstack.org/68778 | 17:48 |
| *** jasondotstar has quit IRC | 17:52 | |
| sdague | jeblair / mordred: can we get a +A on this - https://review.openstack.org/#/c/63551/ - it would have helped on some debug this past week | 17:52 |
| dtroyer | clarkb, mordred: re: moving configs - there is support in devstack to set XXX_CONF_DIR, you'd have to do each project though…I thought I has set it up to move tham all, wouldn't be hard to do though… | 17:56 |
| *** kraman has quit IRC | 18:01 | |
| *** fbo_away is now known as fbo | 18:04 | |
| *** DinaBelova_ is now known as DinaBelova | 18:09 | |
| *** fallenpegasus has joined #openstack-infra | 18:11 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 18:12 | |
| *** luqas has quit IRC | 18:20 | |
| *** senk has joined #openstack-infra | 18:26 | |
| *** senk1 has joined #openstack-infra | 18:29 | |
| *** senk has quit IRC | 18:31 | |
| *** fallenpegasus has quit IRC | 18:32 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for bug 1267326 https://review.openstack.org/69144 | 18:34 |
| *** coolsvap has joined #openstack-infra | 18:39 | |
| *** coolsvap has quit IRC | 18:42 | |
| lifeless | fungi: is that still happening | 18:45 |
| *** dkliban has joined #openstack-infra | 18:46 | |
| * fungi checks | 18:46 | |
| lifeless | I'm going to guess so since nodepool just show two nodes in the head | 18:46 |
| lifeless | shot | 18:47 |
| lifeless | ok, I see the failure | 18:47 |
| lifeless | hang a sec | 18:47 |
| lifeless | the neutron dhcp agent has updated its list correctly | 18:51 |
| lifeless | for both networks | 18:52 |
| lifeless | and it's answering on eth0 and eth1 correctly | 18:53 |
| lifeless | fungi: (nova console-log $uuid shows that cloud-init thinks networking isn't | 18:53 |
| fungi | lifeless: still dying on "Exception: Timeout waiting for ssh access" | 18:53 |
| fungi | sorry for the lag. i'm on airplane wireless (and will be for the next 6 hours or so) | 18:54 |
| lifeless | its ok | 18:54 |
| lifeless | so one possible thing would be it not signallings dnsmasq | 18:54 |
| lifeless | I'm going to restart the dhcp agent | 18:54 |
| lifeless | et voila | 18:55 |
| lifeless | so https://bugs.launchpad.net/neutron/+bug/1271344 | 18:55 |
| fungi | i'll watch it for a sec to make sure they stick around | 18:56 |
| *** oubiwann has joined #openstack-infra | 18:57 | |
| lifeless | fungi: | 18:57 |
| lifeless | fungi: https://bugs.launchpad.net/neutron/+bug/1271344 | 18:58 |
| * fungi nods | 18:59 | |
| *** cody-somerville has quit IRC | 18:59 | |
| fungi | i find it hard to believe openstack has bugs | 18:59 |
| fungi | </sarcasm> | 19:00 |
| *** krtaylor has quit IRC | 19:00 | |
| *** coolsvap has joined #openstack-infra | 19:00 | |
| lifeless | fungi: SHOCK AND HORROR | 19:00 |
| clarkb | fungi: both d-g changes failed in the gate early this morning | 19:04 |
| clarkb | fungi: I am going to be afk a bit today so probably can't shepherd them in | 19:04 |
| *** emagana has joined #openstack-infra | 19:05 | |
| fungi | clarkb: i'll be around--i'll reinject them | 19:05 |
| *** praneshp has joined #openstack-infra | 19:05 | |
| fungi | lifeless: one of them (1208036) switched to used, so i suspect it's working | 19:06 |
| fungi | though it's cycling through its second slave quickly... i only ever see it in building state and then it's suddenly replaced by anoter | 19:09 |
| jnoller | sdague jeblair I got the person on the horn, they should show up if you dump the image list from novaclient - but I'll confirm the image ID for you when I get home | 19:09 |
| *** emagana has quit IRC | 19:10 | |
| *** ociuhandu has joined #openstack-infra | 19:10 | |
| fungi | Exception: Timeout waiting for ssh access | 19:11 |
| fungi | lifeless: is it possible something's going on with not being able to launch any subsequent servers after the first one? | 19:12 |
| lifeless | fungi: has it done more than one cycle? | 19:14 |
| lifeless | fungi: if so I'll punch the agent again | 19:14 |
| *** miqui has quit IRC | 19:14 | |
| fungi | it's done dozens | 19:16 |
| lifeless | me stabs | 19:17 |
| *** praneshp has quit IRC | 19:17 | |
| *** thuc has joined #openstack-infra | 19:22 | |
| *** thuc has quit IRC | 19:27 | |
| *** coolsvap has quit IRC | 19:29 | |
| *** yolanda_ has joined #openstack-infra | 19:32 | |
| *** markwash has quit IRC | 19:35 | |
| lifeless | fungi: both have ssh host keys now so I expect both to be ok | 19:39 |
| fungi | lifeless: now there are two ready nodes which are 20 minutes old | 19:39 |
| fungi | heh | 19:39 |
| lifeless | great | 19:39 |
| lifeless | so | 19:39 |
| lifeless | *if* this happens again | 19:39 |
| lifeless | please point any tripleo-cd-admin at the ci-overcloud control node and that bug | 19:39 |
| lifeless | or even just say 'there is a tripleo critical bug about this' | 19:39 |
| lifeless | and we'll fix | 19:40 |
| lifeless | s/if/when/ | 19:40 |
| fungi | lifeless: i'll ring the claxon in #tripleo next time, just wasn't sure whether you expected them to be working yet | 19:41 |
| *** miqui has joined #openstack-infra | 19:42 | |
| lifeless | fungi: I don't want to mess up your pretty logs | 19:42 |
| lifeless | (and yes, we expect everything to be working) | 19:43 |
| lifeless | fungi: hey, since you're stuck on a plane | 19:43 |
| lifeless | fungi: care to help me understand something? | 19:43 |
| lifeless | in http://logs.openstack.org/43/67343/7/check/gate-tripleo-deploy/5a7b282/console.html | 19:44 |
| lifeless | fungi: oh, *now* it shows me. NVM. | 19:44 |
| lifeless | fungi: have our changes to the ndoepool scripts not landed on the nodepool server? | 19:45 |
| *** jcooley_ has joined #openstack-infra | 19:47 | |
| *** pcrews has quit IRC | 19:47 | |
| fungi | mmmpossibly? | 19:52 |
| fungi | which changs specifically? | 19:52 |
| fungi | changes | 19:52 |
| fungi | lifeless: if you mean prep script changes, it may not have built new images since | 19:54 |
| lifeless | fungi: yeah we altered prepare_$stuff | 19:54 |
| lifeless | fungi: if puppet was disabled they wouldn't be on disk; otherwise could you delete the old image and make it build new? | 19:54 |
| *** jcooley_ has quit IRC | 19:55 | |
| *** jcooley_ has joined #openstack-infra | 19:55 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 19:58 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov | 19:58 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 19:59 | |
| openstackgerrit | lifeless proposed a change to openstack-infra/config: Raise the tripleo-test-cloud max-servers. https://review.openstack.org/69149 | 19:59 |
| *** jcooley_ has quit IRC | 20:00 | |
| *** jcooley_ has joined #openstack-infra | 20:00 | |
| fungi | lifeless: sure thing | 20:02 |
| fungi | previous image was 17.14 hours old | 20:04 |
| lifeless | ANCIENT | 20:04 |
| *** jcooley_ has quit IRC | 20:04 | |
| lifeless | fungi: 69149 should be innocuous too :) | 20:05 |
| *** jcooley_ has joined #openstack-infra | 20:05 | |
| *** yolanda_ has quit IRC | 20:10 | |
| *** bknudson has quit IRC | 20:10 | |
| openstackgerrit | A change was merged to openstack-infra/config: Raise the tripleo-test-cloud max-servers. https://review.openstack.org/69149 | 20:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Build tripleo-fedora nodepool nodes https://review.openstack.org/68809 | 20:13 |
| fungi | might as well ^ while i keep tabs on the tripleo-precise image build | 20:15 |
| lifeless | thanks! | 20:15 |
| lifeless | now I expect the fedora build to fail, pleia2 was looking at the script changes needed to support that properly | 20:17 |
| *** praneshp has joined #openstack-infra | 20:19 | |
| *** jcooley_ has quit IRC | 20:21 | |
| fungi | okay | 20:21 |
| *** jcooley_ has joined #openstack-infra | 20:21 | |
| lifeless | hmm | 20:21 |
| lifeless | I'd really love it if /config changes triggered a test node build | 20:21 |
| lifeless | I wonder how hard that would be | 20:22 |
| lifeless | we'd need access to credentials on a cloud somewhere (I don't want to build in qemu :P) | 20:22 |
| *** SergeyLukjanov_a is now known as SergeyLukjanov | 20:23 | |
| *** jcooley_ has quit IRC | 20:27 | |
| *** kraman has joined #openstack-infra | 20:28 | |
| *** krtaylor has joined #openstack-infra | 20:33 | |
| *** kraman has quit IRC | 20:35 | |
| *** praneshp_ has joined #openstack-infra | 20:41 | |
| fungi | tripleo-fedora image is now building too | 20:41 |
| *** salv-orlando has quit IRC | 20:43 | |
| *** praneshp has quit IRC | 20:43 | |
| *** praneshp_ is now known as praneshp | 20:43 | |
| *** yolanda_ has joined #openstack-infra | 20:49 | |
| *** yolanda_ has quit IRC | 20:51 | |
| fungi | yeah, it bailed out on the fedora image | 20:52 |
| *** dkliban has quit IRC | 21:09 | |
| *** thuc has joined #openstack-infra | 21:23 | |
| *** DinaBelova is now known as DinaBelova_ | 21:24 | |
| *** thuc has quit IRC | 21:37 | |
| *** fallenpegasus has joined #openstack-infra | 21:38 | |
| *** ok_delta has joined #openstack-infra | 21:39 | |
| *** alexpilotti has quit IRC | 21:40 | |
| *** persia has quit IRC | 21:45 | |
| *** persia has joined #openstack-infra | 21:46 | |
| *** persia is now known as Guest65922 | 21:46 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 21:48 | |
| *** fbo is now known as fbo_away | 21:48 | |
| *** Guest65922 has quit IRC | 21:50 | |
| *** persia__ has joined #openstack-infra | 21:51 | |
| *** denis_makogon_ has quit IRC | 22:06 | |
| *** boris-42 has quit IRC | 22:16 | |
| fungi | lifeless: how long would you expect a tripleo-precise image to take to build? it's approaching 2.5 hours in a building state | 22:27 |
| *** fallenpegasus has quit IRC | 22:39 | |
| anteaya | fungi: what leg are you on now? | 22:49 |
| anteaya | have you left aus? | 22:49 |
| fungi | anteaya: on the final bna->rdu stretch now | 22:50 |
| anteaya | woohoo | 22:52 |
| anteaya | go you | 22:52 |
| anteaya | how much longer until you land? | 22:52 |
| fungi | about an hour. then i need to go hunting for my luggage which probably arrived last night | 22:55 |
| anteaya | ah | 22:56 |
| anteaya | the fun never stops | 22:56 |
| *** flaper87 is now known as flaper87|afk | 22:58 | |
| openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/reviewstats: Update openstack-infra/storyboard https://review.openstack.org/69150 | 23:00 |
| openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/reviewstats: Update Storyboard https://review.openstack.org/69150 | 23:01 |
| *** dcramer_ has joined #openstack-infra | 23:06 | |
| *** chuck__ has joined #openstack-infra | 23:08 | |
| openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/reviewstats: Update Storyboard https://review.openstack.org/69150 | 23:10 |
| *** dcramer_ has quit IRC | 23:28 | |
| *** gokrokve has joined #openstack-infra | 23:31 | |
| *** thuc has joined #openstack-infra | 23:34 | |
| *** thuc has quit IRC | 23:39 | |
| dstufft | mordred: Ok, almost 9 hours later, the migration is done now ;) If you see any problems now let us know! | 23:49 |
| *** jnoller has quit IRC | 23:52 | |
| *** jnoller has joined #openstack-infra | 23:52 | |
| jnoller | sdague jeblair can you check out the OS images returned by nova list and see if you see ID 7818a834-d255-41cf-bd72-ac153b3d5406 | 23:53 |
| jnoller | sdague jeblair - I'll send an email but essentially nova boot hello2 --flavor performance1-1 --image 7818a834-d255-41cf-bd72-ac153b3d5406 --key-name mykey --poll should work even if it's not show on image-list | 23:56 |
| *** jnoller_ has joined #openstack-infra | 23:58 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for bug 1267326 https://review.openstack.org/69144 | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!