Sunday, 2013-08-18

*** dina_belova has joined #openstack-infra00:07
*** Ritz-Laptop has quit IRC00:10
*** mberwanger has joined #openstack-infra00:10
*** Ritz-Laptop has joined #openstack-infra00:10
*** Ritz-Laptop has quit IRC00:10
*** dina_belova has quit IRC00:12
openstackgerritChuck Short proposed a change to openstack/requirements: python3: Add mox3 dependency  https://review.openstack.org/4249300:23
mordredjeblair: ping00:37
jeblairmordred: pong00:37
mordredjeblair: http://ci.openstack.org/gerrit.html#renaming-a-project step 5 and 700:37
mordredjeblair: how are those steps affected by our new jenkins overlords00:37
jeblairmordred: i think there are several things that could be updated there.  let me finish what i'm doing and i'll just propose a change.00:38
mordredjeblair: cool. thanks! I'll be working on preparing scripts and changes and stuff00:38
mordredhttp://paste.openstack.org/show/44416/ <-- there's the list of moves/deletes00:44
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add option to include job name in report  https://review.openstack.org/4249400:47
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add testresult commentlink  https://review.openstack.org/4249500:47
jeblairhttps://review-dev.openstack.org/#/c/2372/ ^ is what that looks like.00:47
*** toddmorey has quit IRC00:47
jeblairmordred: are you ready for the os*config moves now?  (are they ready to use the openstack mirror?)00:48
mordredjeblair: the requirements change is proposed - and lifeless said he's ok with going ahead and doing them00:48
jeblairgroovy00:49
jeblairmordred: you should check out https://review-dev.openstack.org/#/c/2372/ while i update those docs00:49
mordredjeblair: yes. that's awesome00:50
*** xchu has joined #openstack-infra00:53
jeblairmordred: do you know what's needed to move the repos on git.o.o?00:54
*** Ryan_Lane has joined #openstack-infra00:54
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Update project rename instructions  https://review.openstack.org/4249700:57
jeblairmordred: ^ updated instructions, to the best of my knowledge, with a TODO item for 'move stuff on git.o.o'.00:57
mordredjeblair: I'll dig to that and also update the instructions00:57
jeblairmordred: i'm _guessing_ that cgit should be able to handle a filesystem move out from under it.00:58
mordredjeblair: it should - although the projects in question will be unusable until the cgit config file is updated and cgit is restarted00:58
jeblairmordred: so my first cut at it would be "just try mv";  but i guess if we wanted to be careful, we could shut it down and start it up along with gerrit00:58
mordredor - actually, I guess it just runs each time, right?00:58
mordredjeblair: I think we need to stop puppet00:59
jeblairon git.o.o?00:59
mordredyeah. because - oh, wait, no, it's only going to run on subscribed changes00:59
jeblairmordred: yeah.  i'll go ahead and add that to my update.00:59
mordredso it should be fine00:59
mordredI'm going to just try the mv00:59
jeblairok.00:59
jeblairstanding down.00:59
mordredwhee!01:00
mordredjeblair: also: modules/launchpad_sync/files/update_gerrit_users.py still exists01:00
mordred:)01:00
jeblair:)01:00
jeblairi have disabled all of the devstack-gate related jobs on jenkins01 and jenkins0201:00
jeblair(except the inprogress and complete jobs)01:01
mordredneat01:01
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Add option to include job name in report  https://review.openstack.org/4249401:02
jeblairmordred: when do you think you will do the deed?01:03
mordredjeblair: as soon as I have the puppet change done and all the sql written01:03
mordredalmost done with puppet01:04
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Rename and delete a set of projects  https://review.openstack.org/4249801:04
mordredk. there's the puppet01:04
*** toddmorey has joined #openstack-infra01:05
jeblairmordred: ok.  i'm about to go to dinner; i'll merge the devstack-gatectomy change after you're done.01:05
mordredjeblair: cool! I should be done with the moves by then01:05
jeblairmordred: taking a quick look at your change ^01:05
mordredplease do01:05
mordredjeblair: http://logs.openstack.org/97/42497/1/check/gate-config-puppet-syntax/513320b/console.html01:07
mordreddid you see that?01:07
jeblairjbjohnso: did you add openstackci to pyghmi on pypi?01:07
jeblair(i don't see it there)01:07
*** dina_belova has joined #openstack-infra01:08
jeblairmordred: i did not01:08
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Rename and delete a set of projects  https://review.openstack.org/4249801:10
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Update project rename instructions  https://review.openstack.org/4249701:10
jeblairmordred: that works for me locally now; i wonder if that was a repack race condition or something.01:11
jeblairchecking the workspace where that job ran01:12
*** dina_belova has quit IRC01:13
jeblairmordred: yeah, it works now, even in that git repo01:13
mordredhttp://paste.openstack.org/show/4441701:15
mordredjeblair: awesome01:15
mordredjeblair: there's the sql script01:15
mordredoh - wait - lemme add the delete01:15
jeblairmordred: i don't see a diff betwen ps1 and 2?01:15
jeblairmordred: i think your sql updates are backwards01:16
mordreddamn. are they?01:16
mordredDAMMIT you are right. thank you01:16
*** Ryan_Lane has quit IRC01:16
jeblairnp01:16
mordredhttp://paste.openstack.org/show/4441801:19
jeblairmordred: openstack/triple-heat-templates"01:21
jeblairmordred: i think triple is missing an 'o'01:21
mordrednah. it's a new thing01:21
mordredscrew the o01:21
jeblairmordred: triple-heat sounds, uh, hot.01:22
mordredright?01:22
*** toddmorey has quit IRC01:22
openstackgerritA change was merged to openstack-infra/config: Update project rename instructions  https://review.openstack.org/4249701:22
jeblairmordred: otherwise lgtm01:22
jeblairmordred: i'm going to go stand in line for pizza now.01:23
mordredhave fun!01:23
jeblairthat is considered fun in berkeley!01:23
*** toddmorey has joined #openstack-infra01:24
*** fifieldt has joined #openstack-infra01:34
mordred#status alert gerrit unavailable for a few minutes for project rename maintenance01:36
mordred#status alert gerrit unavailable for a few minutes for project rename maintenance01:36
mordredweird01:36
* fifieldt hits refresh madly01:39
mordredok. should be back up01:42
* fifieldt confirms01:42
mordredwell, gerrit is back up...01:47
mordredfungi, clarkb, jeblair: ping01:47
mordredif any of you are around...01:47
mordredzuul is not coming back up01:47
clarkbmordres check the pid/lock file01:53
clarkbmordred delete it if you need to01:53
mordredyup. just found the lock file01:54
mordrednow it seems to be runing01:54
clarkbthe init script will shoe you where it is but I think var run zuul01:54
clarkbmordred did that help?01:55
mordredclarkb: yes. all working now01:55
clarkbwoot01:55
mordredclarkb: the new instructions include deleting the pid file01:55
mordredbut not the lock file01:55
mordredI will update them01:55
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Include instructions for deleting lock file  https://review.openstack.org/4249901:56
openstackgerritA change was merged to openstack-infra/config: Rename and delete a set of projects  https://review.openstack.org/4249801:57
*** openstackgerrit has quit IRC01:59
*** openstackgerrit has joined #openstack-infra02:00
*** toddmorey has quit IRC02:00
*** sdake_ has quit IRC02:02
clarkbmordred: the init script should do that for you. did it not?02:03
mordredclarkb: no02:03
clarkb:( should probably file a bug for that02:03
*** mberwanger has quit IRC02:04
clarkbmordred you missed pyghmi :P02:06
clarkbnot a big deal02:07
mordredclarkb: dammit02:07
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Move python-impi to pyghmi for real  https://review.openstack.org/4250202:08
*** toddmorey has joined #openstack-infra02:08
mordredyeah - the repo was moved02:08
*** dina_belova has joined #openstack-infra02:08
mordredit's realy just about the now empty python-ipmi replicas02:09
openstackgerritA change was merged to openstack-infra/config: Include instructions for deleting lock file  https://review.openstack.org/4249902:10
openstackgerritA change was merged to openstack-infra/config: Move python-impi to pyghmi for real  https://review.openstack.org/4250202:10
*** dina_belova has quit IRC02:13
* fungi reviews new-style rename workflow02:20
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Ensure that setup_requires are installed  https://review.openstack.org/4233802:53
openstackgerritMonty Taylor proposed a change to openstack-dev/pbr: Rework run_shell_command  https://review.openstack.org/4233702:53
*** mberwanger has joined #openstack-infra02:58
openstackgerritMonty Taylor proposed a change to openstack-infra/reviewstats: TripleO projects moved to openstack org  https://review.openstack.org/4251103:04
*** dina_belova has joined #openstack-infra03:09
*** dina_belova has quit IRC03:14
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Move the acls files for t-i-e and t-h-t  https://review.openstack.org/4251203:15
mordredjeblair, fungi, clarkb: ok. slightly sloppy - but the renames should be finished03:15
openstackgerritA change was merged to openstack-infra/config: Move the acls files for t-i-e and t-h-t  https://review.openstack.org/4251203:17
*** mberwanger has quit IRC03:23
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Add ability to do smart backwards compat testing  https://review.openstack.org/4194503:25
*** sdake has quit IRC03:26
openstackgerritA change was merged to openstack/requirements: Ignore the ending of commit messages.  https://review.openstack.org/4225503:27
openstackgerritA change was merged to openstack-infra/config: Modify running of sqlalchemy-migrate tests  https://review.openstack.org/3930403:29
openstackgerritA change was merged to openstack/requirements: Uncap testscenarios.  https://review.openstack.org/4225603:29
openstackgerritA change was merged to openstack/requirements: New fixtures release.  https://review.openstack.org/4225703:29
openstackgerritA change was merged to openstack/requirements: Add pystache  https://review.openstack.org/4248403:29
openstackgerritA change was merged to openstack/requirements: Ignore common files that should never be added.  https://review.openstack.org/4225803:29
openstackgerritA change was merged to openstack-infra/config: Adds Jenkins jobs for python-tuskarclient  https://review.openstack.org/4188703:30
*** changbl has quit IRC03:33
*** xchu_ has joined #openstack-infra03:36
*** xchu has quit IRC03:38
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Use cgit server instead of github for everything  https://review.openstack.org/3817703:41
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Rename github-org to repo-group  https://review.openstack.org/3817803:41
*** nayward has joined #openstack-infra03:45
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add requirements gating jobs to tripleo  https://review.openstack.org/4251303:53
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add requirements gating jobs to tripleo  https://review.openstack.org/4251303:54
openstackgerritMonty Taylor proposed a change to openstack/requirements: Remove upper bounds on lifeless test libraries  https://review.openstack.org/4251504:00
*** dina_belova has joined #openstack-infra04:09
*** dina_belova has quit IRC04:14
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Build a devstack-gate image with diskimage-builder  https://review.openstack.org/3887104:38
*** nayward has quit IRC04:38
*** toddmorey has quit IRC04:54
*** dkliban has joined #openstack-infra05:00
*** sdake_ has joined #openstack-infra05:08
*** dina_belova has joined #openstack-infra05:10
clarkbmordred: http://www.jeffknupp.com/blog/2013/08/16/open-sourcing-a-python-project-the-right-way/05:15
*** dina_belova has quit IRC05:15
mordredclarkb: too many people are senselessly obsessed with git-flow05:32
mordredclarkb: otoh - might be interesting to make a cookiecutter stackforge project and a cookiecutter openstack project05:34
*** SergeyLukjanov has joined #openstack-infra05:39
*** sdake_ has quit IRC05:52
*** toddmorey has joined #openstack-infra05:54
*** DennyZhang has joined #openstack-infra05:58
*** toddmorey has quit IRC05:59
*** dina_belova has joined #openstack-infra06:10
*** dina_belova has quit IRC06:15
*** thomasbiege has joined #openstack-infra06:24
*** thomasbiege has quit IRC06:24
*** mikal has quit IRC06:33
*** mikal has joined #openstack-infra06:34
*** pabelanger has quit IRC06:37
*** dina_belova has joined #openstack-infra06:37
*** pabelanger has joined #openstack-infra06:38
*** DennyZhang has quit IRC06:52
*** toddmorey has joined #openstack-infra06:55
*** SergeyLukjanov has quit IRC06:58
*** toddmorey has quit IRC07:00
*** Ryan_Lane has joined #openstack-infra07:10
*** fbo_away is now known as fbo07:12
*** fbo is now known as fbo_away07:22
*** dina_belova has quit IRC07:26
*** dina_belova has joined #openstack-infra07:36
*** dina_belova has quit IRC07:49
*** toddmorey has joined #openstack-infra07:56
*** Ryan_Lane has quit IRC08:01
*** UtahDave has joined #openstack-infra08:03
*** toddmorey has quit IRC08:05
*** odyssey4me3 has joined #openstack-infra08:34
*** cthulhup has joined #openstack-infra08:36
*** boris-42 has joined #openstack-infra08:39
*** cthulhup has quit IRC08:49
*** dina_belova has joined #openstack-infra08:49
*** cthulhup has joined #openstack-infra08:50
*** cthulhup_ has joined #openstack-infra08:51
*** dina_belova has quit IRC08:54
*** cthulhup has quit IRC08:54
*** dina_belova has joined #openstack-infra09:00
*** toddmorey has joined #openstack-infra09:01
*** dina_belova has quit IRC09:04
*** toddmorey has quit IRC09:05
*** SergeyLukjanov has joined #openstack-infra09:05
*** dina_belova has joined #openstack-infra09:15
*** cthulhup_ has quit IRC09:52
*** toddmorey has joined #openstack-infra10:01
*** toddmorey has quit IRC10:05
*** dkehn_ has joined #openstack-infra10:18
*** dkehn has quit IRC10:20
*** cthulhup has joined #openstack-infra10:23
*** dkehn has joined #openstack-infra10:26
*** dkehn_ has quit IRC10:28
*** cthulhup has quit IRC10:31
*** SergeyLukjanov has quit IRC10:44
*** kiall has quit IRC10:44
*** kiall has joined #openstack-infra10:48
*** UtahDave has quit IRC10:49
*** kiall has quit IRC10:50
*** kiall has joined #openstack-infra10:57
*** toddmorey has joined #openstack-infra11:02
*** kiall has quit IRC11:03
*** kiall has joined #openstack-infra11:04
*** toddmorey has quit IRC11:06
*** kiall has quit IRC11:06
*** dina_belova has quit IRC11:08
*** jhesketh has joined #openstack-infra11:11
*** kiall has joined #openstack-infra11:16
*** dkehn has quit IRC11:26
*** dkehn has joined #openstack-infra11:30
*** thomasbiege has joined #openstack-infra11:42
*** mikal has quit IRC11:46
*** mikal has joined #openstack-infra11:47
*** thomasbiege has quit IRC11:48
*** toddmorey has joined #openstack-infra12:03
*** SergeyLukjanov has joined #openstack-infra12:07
*** toddmorey has quit IRC12:07
*** SergeyLukjanov has quit IRC12:13
*** dina_belova has joined #openstack-infra12:14
*** fifieldt has quit IRC12:15
*** jjmb has joined #openstack-infra12:36
*** mberwanger has joined #openstack-infra12:38
*** dina_belova has quit IRC12:41
*** toddmorey has joined #openstack-infra13:03
*** mberwanger has quit IRC13:04
*** annegentle has quit IRC13:07
*** toddmorey has quit IRC13:08
*** mberwanger has joined #openstack-infra13:10
*** dina_belova has joined #openstack-infra13:11
*** dina_belova has quit IRC13:20
*** mberwanger has quit IRC13:21
*** thomasbiege has joined #openstack-infra13:33
*** mberwanger has joined #openstack-infra13:39
*** mberwanger has quit IRC13:40
*** thomasbiege has quit IRC13:42
*** cthulhup has joined #openstack-infra13:59
*** toddmorey has joined #openstack-infra14:04
*** cthulhup has quit IRC14:07
*** romero_ has quit IRC14:07
*** toddmorey has quit IRC14:09
jeblairnodepool did not last the night; it looks like it had too many open files; watching it now suggests that's related to novaclient/requests/urllib3; it looks like the socket fds stick around even after being shutdown.14:09
*** xchu_ has quit IRC14:12
*** cthulhup has joined #openstack-infra14:12
*** sgviking has quit IRC14:20
*** sgviking has joined #openstack-infra14:21
*** CaptTofu has joined #openstack-infra14:22
*** thomasbiege has joined #openstack-infra14:24
*** changbl has joined #openstack-infra14:28
*** fbo_away is now known as fbo14:31
*** fbo is now known as fbo_away14:33
*** mriedem has joined #openstack-infra14:37
*** sgviking has quit IRC14:41
*** thomasbiege has quit IRC14:48
*** thomasbiege has joined #openstack-infra14:53
*** toddmorey has joined #openstack-infra15:05
*** SergeyLukjanov has joined #openstack-infra15:07
*** dina_belova has joined #openstack-infra15:07
*** toddmorey has quit IRC15:10
*** thomasbiege has quit IRC15:12
*** thomasbiege has joined #openstack-infra15:13
jeblairif i explicitly close the internal requests session that the novaclient client object holds, connections get properly cleaned up, but not otherwise, it seems.15:14
*** sdake_ has joined #openstack-infra15:18
*** sdake_ has joined #openstack-infra15:18
*** toddmorey has joined #openstack-infra15:21
*** dina_belova has quit IRC15:24
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Cache novaclient objects  https://review.openstack.org/4252715:33
jeblairwe're about 120 fd's away from exhaustion again; ^ that change should address the issue15:34
Alex_Gaynorjeblair: I notice that change is on top of the sqlalchemy patch set, and not master15:36
*** SergeyLukjanov has quit IRC15:37
jeblairAlex_Gaynor: yes, the sqlalchemy patch set is in production because it also solves production issues (this is a little bit cowboy at the moment; hopefully it'll settle down soon)15:38
Alex_Gaynorhehe15:38
Alex_Gaynorby the way, do we run anything like sentry for the openstack infrastructure?15:39
jeblairAlex_Gaynor: the only monitoring we have atm is cacti15:40
jeblair(and hundreds of developers on irc)15:41
Alex_Gaynorbest monitoring system ever.15:41
Alex_Gaynor(followed closely by "a twitter search")15:42
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Remove devstack launch nodes and jobs  https://review.openstack.org/4226315:43
jeblairthat's a rebase ^15:44
*** thomasbiege has quit IRC15:46
openstackgerritA change was merged to openstack-infra/config: Remove devstack launch nodes and jobs  https://review.openstack.org/4226315:46
*** thomasbiege has joined #openstack-infra15:46
*** nayward has joined #openstack-infra15:50
clarkbjeblair do you need to do anything more than set oldclient to None to get it to clean up?15:54
clarkbor does gsrbage collecting the entire object work fine?15:55
jeblairclarkb: it does not; that will leak file descriptors... however...15:56
jeblairclarkb: that should only happen if the configuration for a client changes (or we drop a client)15:57
jeblairclarkb: i considered explicitly closing the session there, but that could affect lingering operations in other threads15:57
*** thomasbiege has quit IRC15:57
*** thomasbiege has joined #openstack-infra15:58
jeblairclarkb: so i figured i'd just punt on that for now, considering that it is not likely to happen often in practice (almost never).15:58
clarkbok15:58
*** dina_belova has joined #openstack-infra16:00
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Run nodepool cleanup every 5 mins  https://review.openstack.org/4252816:01
*** SergeyLukjanov has joined #openstack-infra16:02
*** woodspa has joined #openstack-infra16:02
*** sgviking has joined #openstack-infra16:03
jeblairthat ^ is also in production, and i just restarted nodepool with the client cache code16:03
*** CaptTofu has quit IRC16:04
*** CaptTofu has joined #openstack-infra16:04
clarkbare those jobs reentrant?16:06
clarkb(slightly worried we will get overlapping delete crons)16:06
jeblairi believe apscheduler caps it at 1 at a time, but they should be.16:07
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Cache novaclient objects  https://review.openstack.org/4252716:09
*** thomasbiege has quit IRC16:15
*** cthulhup has quit IRC16:17
jeblairi have confirmed that there are no jobs referencing the devstack-update jobs, and have deleted the devstack-launch slaves from jenkins16:20
jeblairthe hosts still exist, in case we decide we need to roll-back (but we'd have to reconfigure the jobs and re-add the slaves, so it would probably take about 20 minutes)16:20
*** dims has quit IRC16:24
*** changbl has quit IRC16:27
*** changbl has joined #openstack-infra16:29
*** odyssey4me3 has quit IRC16:41
*** dina_belova has quit IRC16:48
*** SergeyLukjanov has quit IRC16:49
*** ftcjeff has joined #openstack-infra17:02
*** mikal has quit IRC17:03
*** mikal has joined #openstack-infra17:04
*** woodspa has quit IRC17:10
*** dina_belova has joined #openstack-infra17:13
mordredjeblair: morning17:15
mordredjeblair: so the novaclient requests thing- should we also submit a patch to novaclient to cause it to clean up after itself properly?17:16
mordredjeblair: also, +2 to the change - I've been not APRVing any nodepool change to leave that to you for now, fwiw17:18
*** dina_belova has quit IRC17:19
clarkbmordred: is git flow cargo culted? or does it just work well with the github PR workflow?17:25
mordredI think it works wel with the github PR workflow - it also lets you do a branch model in git without understanding how that works17:26
mordredand it embodies the still-lingering 'wisdom' that feature branches are a great idea17:26
mordredclarkb: btw: root@review:~# manage-projects17:27
mordredFailed to add groups file for project: stackforge/clouddocs-maven-plugin17:27
clarkbI think what bothered me most about that is it was so specific. eg git flow and not just git, travis and not CI, py.test and not write tests.17:27
clarkband without that you can't be a good project17:28
*** cthulhup has joined #openstack-infra17:28
clarkbmordred: did I write a bad acl file?17:28
mordredyeah.17:28
mordredotoh, I think the post was similar to some of what we do too...17:29
mordredin that we've said "you're just going to do things this way"17:29
mordredand there is benefit in people just having a consistency17:29
*** dina_belova has joined #openstack-infra17:29
clarkbdefinitely and a lot of the suggestions were good17:30
mordredit just makes me sad that a consistency that makes sense are almost all choices I don't like :)17:30
clarkbalso I think there is a big difference between "you will do this to use openstack infra" and "you will do this to be a good open python project17:32
*** cthulhup has quit IRC17:33
clarkbI am not sure about the clouddocs thing17:34
mordredyeah17:34
mordredclouddocs?17:34
mordredreadthedocs?17:34
clarkbmordred the error you pasted above17:34
mordredoh. hahah17:34
mordredsorry - context switching17:34
clarkbdid my change not have an acl file in it?17:36
*** CaptTofu has quit IRC17:38
*** jhesketh has quit IRC17:39
*** CaptTofu has joined #openstack-infra17:39
clarkbhttps://github.com/openstack-infra/config/commit/f810b5cd777df1f688e016c66b5833925ffb465917:39
clarkbI think that is the issue17:39
*** changbl has quit IRC17:39
*** cthulhup has joined #openstack-infra17:40
*** thomasbiege has joined #openstack-infra17:43
mordredclarkb: well - in other news, I _did_ add acls files for tripleo-image-elements and tripleo-heat-templates17:45
mordredclarkb: and I cannot get them to apply to gerrit17:45
mordredI've verified that they are on gerrit17:45
mordredI've fun manage-projects again17:45
*** thomasbiege1 has joined #openstack-infra17:46
mordredoh!17:46
mordredthey are empty on gerrit17:46
mordredand re-running puppet worked17:48
*** cthulhup has quit IRC17:48
*** thomasbiege has quit IRC17:49
mordredso, that seems to take care of my problem :)17:49
mordredclarkb: from that blog post, I did start poking at making a cookiecutter template for openstack projects17:50
*** thomasbiege1 has quit IRC17:51
*** jhesketh has joined #openstack-infra17:52
*** nayward has quit IRC18:02
*** nayward has joined #openstack-infra18:02
*** thomasbiege has joined #openstack-infra18:05
*** sdake has joined #openstack-infra18:05
*** sdake has quit IRC18:05
*** sdake has joined #openstack-infra18:05
*** CaptTofu has quit IRC18:09
*** CaptTofu has joined #openstack-infra18:10
*** SergeyLukjanov has joined #openstack-infra18:12
*** CaptTofu has quit IRC18:42
*** thomasbiege has quit IRC18:42
*** CaptTofu has joined #openstack-infra18:42
clarkbmordred: neat. any chance that could tie into manage-projects?18:45
clarkbmordred: also, if you want sonething to do could you spot check the mysql backups on therpad.o.o before I roll that out everywhere?18:46
clarkbmordred they will be in /var/backup/mysql_backups18:46
mordredoh - yes I could!18:47
mordredclarkb: "sudo pip install cookiecutter ; cookiecutter https://github.com/emonty/cookiecutter-openstack.git"18:51
mordredgive it a try18:51
*** cthulhup has joined #openstack-infra18:59
*** cthulhup has quit IRC19:03
*** SergeyLukjanov has quit IRC19:12
*** changbl has joined #openstack-infra19:16
jeblairmordred, clarkb: i'm always wary of people trying to tell me the one-true-way to do something.  especially if they're trying to sell me a book.19:29
jeblairwhich that guy is19:29
clarkbjeblair: the cookiecutter project seems like a potentially useful thing though19:32
clarkbbut overall I agree19:32
jeblairclarkb: oh yeah19:32
jeblairclarkb: remember the discussion about the scp console copy thread?19:32
jeblairi think it's not causing a _problem_ per se...19:32
jeblairbut i do think nodepool is cutting it off, even under normal circumstances19:33
openstackgerritMonty Taylor proposed a change to openstack-infra/config: Add cookiecutter templates repo  https://review.openstack.org/4253019:33
jeblairjust looking at some random logs here http://logs.openstack.org/50/41350/3/check/gate-tempest-devstack-vm-full/9c98c0c/console.html and http://logs.openstack.org/50/41350/3/check/gate-tempest-devstack-vm-full/81d91c4/console.html19:33
mordredjeblair: I'm glad you feel that way - I have a set of working cookiecutter templates now :)19:33
jeblairmordred: cool.  i could have used that last week.  :)19:34
clarkbjeblair: maybe we should look at tying the copy plugin to the event plugin19:34
jeblairclarkb: maybe.  all our ideas about how to do that sounded meh.19:34
clarkbjeblair: werent you going to add a delay? is that not helping?19:34
mordredjeblair: and I agree with clarkb - we should make manage_projects use cookiecutter to create the new empty repo19:35
jeblairclarkb: i did not add a delay, because i thought it was causing a problem only in exceptional circumstances.19:35
mordredjeblair: we have all three inputs needed at manage_projects level already19:35
jeblairmordred: *nod*19:35
mordredand it's possible to call cookiecutter via python functions too :)19:35
jeblairclarkb: how much of a delay you reckon we should add?19:35
mordredjog0: ^^19:35
clarkbjeblair: a minute is probably plenty (the logstash stuff waits one minute before moving on)19:36
mordred(then, if I get really fancy, 'gating' this repo should create a new repo with the template, and then run all of the different tox jobs on that repo to make sure that it's compliant)19:36
jeblairmordred: nice19:38
jeblairmordred: i think that's a good idea for an additional pbr gate19:38
mordredmm. yes. good call19:39
openstackgerritJames E. Blair proposed a change to openstack-infra/nodepool: Delay 1 min before deleting node  https://review.openstack.org/4253119:40
*** carlp-away has joined #openstack-infra19:41
jeblairthat is now running ^19:41
mordredjeblair: lgtm19:44
jeblairclarkb: http://logs.openstack.org/53/41353/6/check/gate-tempest-devstack-vm-neutron-full/dc511e2/console.html19:44
jeblairclarkb: ^ that seemed to do the trick19:44
openstackgerritJames E. Blair proposed a change to openstack-infra/config: Add testresult commentlink  https://review.openstack.org/4249519:45
clarkbjeblair: great19:48
openstackgerritA change was merged to openstack-infra/nodepool: Use a sensible SQLAlchemy session model  https://review.openstack.org/4245319:49
openstackgerritA change was merged to openstack-infra/nodepool: Tune SQLAlchemy pool parameters  https://review.openstack.org/4247519:49
openstackgerritA change was merged to openstack-infra/config: Run nodepool cleanup every 5 mins  https://review.openstack.org/4252819:49
mordredclarkb: I'd like to explore changing our babel/locale layout19:49
clarkbmordred: to support different domains like horizon or?19:50
mordredclarkb: we put it into $project purely to get it installed into a knowable location as a hack around egg installs - but it's not really where it's supposed to go19:50
openstackgerritA change was merged to openstack-infra/nodepool: Cache novaclient objects  https://review.openstack.org/4252719:50
openstackgerritA change was merged to openstack-infra/zuul: Add option to include job name in report  https://review.openstack.org/4249419:50
mordredclarkb: I think I'd like to move the locale dir back to the top level now that pbr is smart enough to be able to deal with that - and install the files into share/ like normal things19:50
mordredclarkb: but I'm not going to work on that today19:51
lifelessdo we gate on qpid and 0mq with tempest tests?19:57
lifelessor just rabbit?19:57
lifelessmordred: / clarkb: ^19:58
clarkbjust rabbit iirc. there is a daily ∅mq job19:59
*** dina_belova has quit IRC19:59
jeblairweird.  we have a gate-tempest-devstack-vm-postgres-zeromq-full job that is not invoked.19:59
*** thomasbiege has joined #openstack-infra20:00
jeblairmaybe a half-complete project?20:00
jeblair(that's really going to bust the width on the status page if we do run it)20:00
*** thomasbiege has quit IRC20:01
*** CaptTofu has quit IRC20:06
*** CaptTofu has joined #openstack-infra20:07
jeblairmordred, clarkb: should we go ahead and put the commentlink change into production today, since zuul is mostly idle, or wait till (probably) next weekend?20:11
jeblairi think the main risk would be that it looks like poo in some particular browser; but that could probably be fixed with a css change that doesn't require anything be restarted.20:11
*** colinmcnamara has joined #openstack-infra20:11
Alex_GaynorSeem pretty low risk to do it today20:12
Alex_Gaynorjeblair: not sure if you saw, but I left a note on one of the zuul patches, but it was already in the land queue20:12
jeblairAlex_Gaynor: ah, must have been right after i hit the button20:13
jeblairAlex_Gaynor: thanks, I think you are right.  I will fix that now.20:13
*** toddmorey has quit IRC20:14
openstackgerritJames E. Blair proposed a change to openstack-infra/zuul: Fix unbound variable re job_name_in_report  https://review.openstack.org/4253320:16
jeblairAlex_Gaynor: ^20:17
Alex_Gaynorjeblair: already reviewed :)20:17
clarkbjeblair this will make the zuul comments prettier? I haven't had a chance to grok the gerrit config changes but that seems like the intent20:19
jeblairclarkb: yes; they will look approximately like the contents of the boxes in the status page20:19
clarkbI am fine with trying it now. shouldn't prevent results from being reported20:19
*** cody-somerville has quit IRC20:21
jeblairok, so zuul's signal handling needs some work; i think i killed the gear server when putting it into graceful shutdown20:21
openstackgerritA change was merged to openstack-infra/config: Add testresult commentlink  https://review.openstack.org/4249520:25
openstackgerritA change was merged to openstack-infra/zuul: Fix unbound variable re job_name_in_report  https://review.openstack.org/4253320:26
jeblairi have restarted zuul with those changes20:27
jeblairrestarting gerrits20:28
jeblairAlex_Gaynor, clarkb, mordred: https://review.openstack.org/#/c/42416/20:32
jeblairyou can see the output there20:32
Alex_Gaynornice!20:32
jeblairi think i'd like to try a subtle zebra-stripe background to lead between the two columns, but even with that gap, i think it's easier to read than before (and the gap won't be as large for many projects with longer job names)20:33
* jeblair now rejoins his sunday, which is already in progress.20:35
clarkbit looks a little funny on my phone but so does most of gerrit20:37
clarkbbut it is much more concise. I like it20:37
*** dina_belova has joined #openstack-infra20:59
*** thomasbiege has joined #openstack-infra21:02
*** dina_belova has quit IRC21:04
*** dina_belova has joined #openstack-infra21:09
*** dina_belova has quit IRC21:14
*** dkliban has quit IRC21:20
*** thomasbiege has quit IRC21:22
*** CaptTofu has quit IRC21:34
*** boris-42 has quit IRC21:38
*** sgviking has quit IRC21:57
*** sgviking has joined #openstack-infra21:57
*** erfanian has quit IRC22:03
*** sgviking has quit IRC22:07
*** dina_belova has joined #openstack-infra22:10
*** dina_belova has quit IRC22:15
*** sdake has quit IRC22:29
chmouelfyi: i created that for emacs people and browsing file directly on cgit https://github.com/chmouel/openstack-cgit-browse-file22:48
jeblairchmouel: that is so cool :)23:06
*** dkliban has joined #openstack-infra23:08
*** dina_belova has joined #openstack-infra23:10
*** dina_belova has quit IRC23:15
*** marun has quit IRC23:36

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!