19:00:43 #startmeeting infra 19:00:44 Meeting started Tue Mar 31 19:00:43 2015 UTC and is due to finish in 60 minutes. The chair is jeblair. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:00:45 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 19:00:47 o/ 19:00:48 The meeting name has been set to 'infra' 19:00:48 #link agenda https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Agenda_for_next_meeting 19:00:48 #link previous meeting http://eavesdrop.openstack.org/meetings/infra/2015/infra.2015-03-24-19.00.html 19:00:52 #topic Actions from last meeting 19:00:52 o/ 19:00:56 anteaya cause a problem statement and requirements regarding election tooling to be sent to the infra list so various solutions can be discussed 19:00:56 #link https://etherpad.openstack.org/p/XU4qRouXIH 19:01:11 anteaya: thanks for that 19:01:13 o/ 19:01:16 welcome 19:01:22 Hello! 19:01:26 o/ 19:01:28 o/ 19:01:35 anteaya: i think you are expecting some input on that. and i think i promised to give you some. 19:01:38 so unless we have some more edtis to that or any objections I'll send that out this afternoon 19:01:46 jeblair: you mentioned it yes 19:01:47 so i should do that before then, then. :) 19:01:57 jeblair: thanks, that would be most welcome, thank you 19:02:27 and tristanC not sure if you have had a chance to review the etherpad yet 19:02:36 tristanC: let me know what you think 19:02:37 and anyone else, pitch in soon. i think the point was to try to make the requirements clear so we can effectively propose and evaluate solutions 19:02:44 yes 19:02:53 clarkb make sure bandersnatch is being updated 19:02:53 #link https://review.openstack.org/#/c/167382/ 19:03:02 anteaya: don't forget to clean up my comment about self editing 19:03:09 clarkb: will do 19:03:30 clarkb: did a thing^ yay! :) 19:03:40 i think that's self-explanator 19:03:41 y 19:03:43 I did, it just needs another +2 then either I can approve or someone else 19:03:47 fungi send announcement email for renames 19:03:47 #link http://lists.openstack.org/pipermail/openstack-dev/2015-March/059948.html 19:03:51 happened 19:03:55 fungi did that and more! 19:03:58 and how 19:04:00 jeblair document openstack id deployment mechanism in http://ci.openstack.org/openstackid.html 19:04:00 #action jeblair document openstack id deployment mechanism in http://ci.openstack.org/openstackid.html 19:04:05 jeblair did not do that thing 19:04:06 :( 19:04:11 o/ 19:04:15 that is okay, we have this week 19:04:18 #topic Schedule next project renames 19:04:48 so there's murano; no further communication on that change 19:04:52 are any murano people around? 19:04:52 if someone comes up with a bit more time to test the utf8 conversion, we could consider doing it along with the murano move 19:05:06 ++ 19:05:26 zaro: are you still working on that? 19:05:30 also did we get the xstatic package rename correct and the fallout yesterday was unrelated to the new name? 19:05:37 serg_mel seems to not be in here 19:05:42 clarkb: we got it correct. someone deleted the old name from pypi. 19:05:44 aiui that is the case but may be worth following up on to make sure that doesn't need more changes 19:05:49 jeblair: sorry i dropped the ball on that. will do it this week. 19:05:52 jeblair: gotcha 19:05:53 zaro: np 19:06:24 okay, we'll wait for the murano folks to re-engage 19:06:37 clarkb: as fungi explained to me we have no control over someone deleting a package from pypi that is in global requirements 19:06:51 other than to ask them to please put it back 19:06:54 anteaya: yup I was worried that we didn't get the rename correct 19:06:56 i don't think anyone knows what's going on with gantt yet. 19:06:58 or to stop depending on it 19:07:12 i don't actually know the motivation for the gantt discussion? 19:07:13 clarkb: yup 19:07:21 is it just cleaning up the openstack namespace? 19:07:27 yes 19:07:31 jeblair: yes it appears to be 19:07:42 andereas likes things in order 19:07:45 if so, i'd prefer to just let it sit until someone decides to either do something with it or that nothing will ever be done with it 19:07:49 hey 19:07:54 jeblair: ++ 19:07:55 \o 19:07:58 "it's a seemingly abandoned effort in an ostensibly official repo namespace" seems to be the entirety of the concern 19:07:59 it seems like folks are saying 'this might still happen in the future' 19:08:01 jeblair: I agree 19:08:09 * mordred has submitted a patch to gantt to delete all the files 19:08:11 fwiw 19:08:22 mordred: and I +2'd it 19:08:25 bauzas: woot! 19:08:26 mordred: that should provide more data :) 19:08:38 there is a thread on the mailing list about what to call the effort so they can't yet agree on naming 19:08:42 oh - it failed the docs job 19:08:48 so yeah, agreed on the plan to clean up the repo 19:09:02 mordred: saw that, probably needs a recheck 19:09:05 bauzas: are you okay leaving it there for now until there's a plan to move forward? 19:09:13 anteaya: well, i think that's more around avoiding using the gantt name to refer to other activities related to scheduler decomposition 19:09:21 jeblair: I like mordred's idea to clean up 19:09:31 jeblair: and keep it as it is 19:09:32 fungi: okay well in any case, there is lack of agreement 19:09:40 ok. 19:09:45 fungi: I sent an email about that 19:09:50 yep, i read it 19:10:14 * fungi probably spends too much time trying to read a lot of what crosses the -dev ml 19:10:22 http://lists.openstack.org/pipermail/openstack-dev/2015-March/060179.html 19:10:25 #agreed merge mordred's change to delete all content from gantt repo, but otherwise, leave as-is until there is a more substantive plan to move forward with the effort or it is truly abandoned 19:10:33 anyone disagree with that ^ ? 19:10:38 * fungi agrees 19:10:46 * anteaya has no problem with that 19:10:48 sounds like a plan to me 19:10:49 o/ 19:10:51 I also have to check with the Foundation about the legals for the codename 19:10:52 +1 19:10:54 (i can undo it if we do, fwiw) 19:11:15 cool, sounds like we're okay then, and there are no pending project renames 19:11:22 bauzas: thanks! :) 19:11:34 #topic Priority Efforts (Swift logs) 19:11:34 #link https://review.openstack.org/#/q/status:open+topic:enable_swift,n,z 19:12:03 looks like the footer changes are still outstanding and could use a review 19:12:12 jeblair: we are waiting on your response to jhesketh at https://review.openstack.org/#/c/167158/2 19:12:22 jeblair: I think the footer changes all have the necessary +2s though 19:12:22 i think jhesketh is back from leave so we can progress there 19:12:48 cool, will review 19:12:59 #topic Priority Efforts (Nodepool DIB) 19:12:59 #link https://review.openstack.org/#/q/status:open+topic:dib-nodepool,n,z 19:13:04 mordred: have your etherpad link handy? 19:13:08 yeah - one sec 19:13:17 #link https://etherpad.openstack.org/p/dib-nodepool-merges 19:13:18 found it 19:13:21 https://etherpad.openstack.org/p/dib-nodepool-merges 19:13:23 oh 19:13:40 so - this is pretty darned near close 19:13:52 all of the pieces now exist, pending code review and bug finding 19:14:01 and the etherpad provides some nice narrative structure so we can see how it will all fall in to place 19:14:32 given the nature of the thing, it still make take a week or two to finish landing, as some of these changes we'll want to watch 19:14:50 and as clarkb has pointed out, we'll need to test that devstack runs properly on the -minimal based images 19:15:28 but I think we'd have to do that if we modifed the cloud images to remove cloud-init as well, because $unknown_knockon_effects 19:15:40 but we're quite close 19:15:46 mordred: i reviewed all the infra changes in there yesterday, i can probably do another pass to catch updates today or tomorrow 19:15:56 jeblair: I've rebased a few things since then 19:16:19 I am trying to review the related changes and get my nodepool changes for multiple image types up to par 19:16:34 clarkb: we shoudl add that change to the etherpad 19:16:39 i think it's there 19:16:40 if we haven't already 19:16:42 cool 19:17:07 yup I added it 19:17:12 anything else to talk about here? 19:17:14 so it will be affecting in some way to that: https://etherpad.openstack.org/p/Nodepool_benchmarks . Shall i add this to that etherpad as well? 19:17:23 working through comparing the results of 164447 on various devstack-.* sample nodes from our providers and comparing the result to the equivalent bare-.* samples 19:17:44 oh, we were going to briefly bikeshed on new-world-order platform identifiers 19:17:48 oh yeah 19:18:12 I'd like to suggestion we name our things $distro-$release once there is no bare/trusty distinction 19:18:14 we could do ubuntu14.04-timestamp and centos7-timestamp 19:18:18 yolanda: i think they are separate efforts 19:18:26 clarkb: I'd say trusty not 14.04 19:18:29 since we don't have an equivalent devstack-centos6 worker to move bare-centos6 jobs onto, i need to make something. best not to call it "devstack-centos6" since we won't likely run devstack on it 19:19:05 basically, I don't thin kwe should have things named centos6 and centos7 if we don't also have ubuntutrusty 19:19:13 it's a small bikeshed 19:19:19 and because i patterned dib's release/version support on the idea i could match it to our node labels, i'll want to tweak that too if we want to use something different than we do now 19:19:30 and then I think because ubuntutrusty looks weird, we should add a - 19:19:39 er, s/dib/bindep/ 19:19:48 so centos-7, centos-6, ubuntu-trusty, fedora-21 19:19:55 though dib also has something similar apparently. so converging our identifier format would be good, i think 19:20:19 what's the dib thing that is similar? 19:20:24 that maps to DIB's $DISTRO_NAME-$DIB_RELEASE, 19:20:26 anyway, if there are no objections to mordred's proposal, i'll go with centos-6 as the new node label 19:20:42 the list mordred wrote maps to that 19:20:44 * anteaya doesn't object 19:20:46 greghaynes: does that match what mordred is sugg... 19:20:49 cool :) 19:21:08 clarkb: okay with $distro-$release? 19:21:11 ok - now what color trusty do we want? 19:21:11 jeblair: sure 19:21:13 theres a caveat with centos7 actually, but thats a dib bug 19:21:19 I only suggested numbers for consistency ut I don't care 19:21:27 greghaynes: and it's fine with the centos-minimal element :) 19:21:29 with the expectation that we'll do ubuntu-something as well (i don't care if we mix release codenames and version numbers personally) 19:21:35 its all going to get grepped and sed'd the same either way 19:21:50 mordred: numbers or names? 19:21:56 I think trusty is the common form for ubuntu, and 7 is the common for centos 19:21:58 so I think we shoudl use those 19:22:06 if we have debian images, I think we shoudl use names too 19:22:16 mordred: and numbers for fedora? 19:22:21 because I _CERTAINLY_ have no idea what number jessieis 19:22:22 yeah, it's more that centos just doesn't have good release names 19:22:22 cause fedora does have names 19:22:23 jeblair: yes 19:22:36 I don't hear people use them as much - but I could be very wrong about that 19:22:43 DIB is all name based fwiw 19:22:56 greghaynes: what does dib call centos 6 and 7? 19:22:57 er, no 19:23:00 greghaynes: so it uses fedora-beefy-miracle? 19:23:05 so ... fedora uses numbesr for fedora-minimal 19:23:08 * fungi loves that name 19:23:11 thats wrong, yea ;) its name based for ubuntu, number for everything else 19:23:12 you have to pass in 21 to $DIB_RELEASE 19:23:19 otherwise the chroot building will not work 19:23:20 but we can incorporate beefy-miracle 19:23:28 it really has to do with mirror paths 19:23:41 so maybe "gravitate toward current dib behavior, whatever that is" is what we're suggesting? 19:23:47 we cannot, sadly, use beefy-miracle 19:23:59 #agreed use $distro-$release (eg 'ubuntu-trusty', and 'fedora-21') for image names, matching usage in dib where possible 19:24:03 look good ^ ? 19:24:04 jeblair: ++ 19:24:05 we don't use the names for fedora, but then they use things like "Schrödinger" which introduces other types of fun 19:24:07 jeblair: ++ 19:24:17 great! thanks for suffering through the bikeshed 19:24:29 fungi: should we paint our trusty purple? 19:24:38 #topic Priority Efforts (Migration to Zanata) 19:24:38 #link https://review.openstack.org/#/q/status:open+topic:zanata,n,z 19:25:07 oh hi there 19:25:12 are the changes ready for widespread review now? 19:25:33 I have reviewed a few of them and I would say they are ready 19:25:36 jeblair: so we landed the base change. i think we can start reviewing and landing what i've got up on the board now 19:25:53 i've also reviewed stevenk's fine work on the client 19:25:55 cinerama: oh that merged, awesome 19:26:13 and now i'm doing some testing with that to see what we'll need to add to it. 19:26:14 cool; should we, oh, spin up a server? 19:26:30 jeblair: bit nervous there 19:27:01 jeblair: but i think we're close. i'd like to test a couple more things here 19:27:09 cinerama: cool, no prob 19:27:14 maybe before EOW or early next week tho 19:27:46 cinerama: if you say yes now it will probably take that long anyway 19:27:58 anteaya: hey that's a good point 19:28:11 also we should see if pleia2 wants to do most of the work there 19:28:17 never turn down teh offer of a server 19:28:32 anteaya (& others) this is my first rodeo so any advice is really helpful 19:28:34 i'm happy to volunteer to try and boot a server running that when you're satisfied that it's time 19:28:47 cinerama: it is dev only anyway 19:28:54 not much can go wrong 19:28:58 and feed you details on whatever puppet errors end up preventing it, if any 19:29:30 fungi: (psst, volunteer to backup pleia2 booting a server so she can gain xp) 19:29:34 jeblair: yeah i was thinking for pairing & stuff waiting for pleia2 before we set up might be good 19:29:45 or help pleia2 through it, yes! i missed that comment above ;) 19:30:01 she's out for a bit, right? will she be back next week? 19:30:23 * fungi didn't pay close attention to when she said she was getting back 19:30:39 yes next week 19:30:52 so that will probably work with cinerama's timetable anyway 19:31:00 and she has been wanting a server for some time 19:31:00 that sounds good 19:31:05 fwiw 19:31:18 anything else? 19:31:34 #topic Priority Efforts (Downstream Puppet) 19:31:35 #link https://review.openstack.org/#/q/status:open+topic:downstream-puppet,n,z 19:32:04 from my side, i couldn't progress so much there but there are some changes with pending reviews, and some others i answered the reviews 19:32:17 I have log server puppet scripts refactored and waiting on reviews 19:32:33 nothing from me 19:32:42 everything with topic downstream-puppet from my side 19:32:48 asselin_: I said I would review and didn't sorry about that 19:33:13 cool, plenty of stuff to review this week :) 19:33:18 #topic Priority Efforts (Askbot migration) 19:33:18 #link https://review.openstack.org/#/q/status:open+topic:askbot-site,n,z 19:33:21 yay reviewing 19:33:49 the pgsql module should be accepted into governance today and we can create that 19:34:33 i think that's the big thing here, right? anything else? 19:34:53 oh, right, mrmartin is unavailable today 19:35:10 yeah, once we get that created, we can move forward safely 19:35:19 we could in theory move forward without it and add it later 19:35:22 the solr stuff got in right? so indexing is working 19:35:40 reed sent an e-mail to the -community ml about scheduling the cut-over 19:35:44 * fungi finds a link 19:36:01 fungi, thanks 19:36:32 #link http://lists.openstack.org/pipermail/community/2015-March/001102.html 19:36:43 did reed just drop off? 19:36:49 seems so 19:36:53 bad timing :( 19:37:16 maybe san francisco got hit by an comet 19:37:18 april 6 is easter monday 19:37:18 anyway, the migration steps in the spec are confirmed working from my initial test, so the maintenance should be brief 19:37:51 i loosely timed all the steps and should be able to finish within half an hour 19:38:07 is that date set? 19:38:12 fungi: how many people to do the work, just one or a group? 19:38:34 anteaya: i can do the maintenance steps since i've already done them once 19:38:49 fungi: when you set up the dev instance? 19:38:55 just one person, plus some people to do usage tests to make sure it's still doing what it is supposed to 19:39:10 i expect i'll be around then to pitch in if needed 19:39:18 monday is an interesting choice though 19:39:20 fungi: so I guess it is up to you, when do you want to do it? 19:39:25 clarkb: it's not a dev instance, it's the new server, we just haven't switched dns over pending a second database dump 19:39:32 fungi: gotcha 19:39:51 My only monday restriction is I have to afk about 6pm PDT 19:39:52 I see 2 choices on the linked email 19:39:53 which should be fine 19:40:21 yeah, reed what was the motivation for monday? because a lot of people won't be trying to use it on a common international holiday? 19:41:05 if those are the choices, i think we should go with monday so that we can land the puppet changes beforehand 19:41:11 i'm guessing it was more that he looked at browser analytics to find weekly low-points in traffic volume 19:41:28 I can be around to help test 19:41:55 so monday? 19:42:12 wfm 19:42:13 #info ask.o.o migration probably happening on Monday April 6th, 10am PDT 19:42:16 :) 19:42:23 #topic Puppet Testing 19:42:23 #link https://review.openstack.org/#/c/164908/ 19:42:26 i'll follow up to the ml thread 19:42:31 oops 19:42:34 #topic Priority Efforts (Upgrading Gerrit) 19:42:34 #link https://review.openstack.org/#/q/status:open+topic:gerrit-upgrade,n,z 19:42:46 fungi, because monday is the first available day for me 19:43:06 reed: oh, okay great! 19:43:09 fridays are bad at doing complex things, if they fail the weekend is damaged :) 19:43:16 so we're waiting on utf8 testing 19:43:33 are we still targeting 2.9, or is it worth looking at 2.10 yet? 19:43:53 i believe we have > 1 month, so even that should be doable 19:43:56 zaro: are you about? 19:44:02 2.11 is already in rc 19:44:03 yes 19:44:13 so it may be good to 2.10 if nothing bad comes up in testing just to get us closer? 19:44:15 zaro: 2.10? thoughts? 19:44:26 2.10 may get us WIP plugin, yeah? 19:44:42 no. it won't 19:44:56 i'm fine with trying 2.10 19:45:13 #action zaro to continue utf8 testing 19:45:30 #action zaro test gerrit 2.10 19:45:41 zaro: what does wip plugin need? 19:46:00 zaro: I'd like close connection functionality whichever one we select 19:46:03 uhmm, lots of stuff i think. 19:46:14 REST endpoints don't seem to work 19:46:33 wip plugin requires >=2.11 according to http://eavesdrop.openstack.org/meetings/infra/2015/infra.2015-02-10-19.01.html 19:46:38 some core stuff needs to get approved as well. still sitting in review 19:47:20 i took yesterday to test it more deeply and entered some issues in to the gerrit issue tracker. 19:47:36 zaro: what's 'it' ^ ? 19:47:46 https://code.google.com/p/gerrit/issues/list?can=2&q=WIP+plugin 19:47:52 ah, wip plugin 19:48:02 zaro: anything else we should be working on? 19:48:26 one change would ike to merge soon is 19:49:08 https://review.openstack.org/#/c/155448/ 19:49:55 otherwise just reviews on gerrit-upgrade topic 19:50:02 zaro: thanks! 19:50:04 #topic Zuul layout split using (tristanC) 19:50:04 #link https://review.openstack.org/#/c/152290/ 19:50:07 tristanC: around? 19:50:12 yes! 19:50:22 zaro: is that change in 2.10? 19:50:31 which one? 19:50:33 tristanC: you have a change to implement that! :) 19:50:33 so well, the spec is up for review since sometime already... 19:50:47 zaro: 155448 19:50:49 clarkb: ohh, not sure. i can check 19:50:56 tristanC: yeah the spec merged: http://specs.openstack.org/openstack-infra/infra-specs/specs/zuul_split.html 19:51:35 tristanC: i want to try to let jhesketh's connection changes land soon 19:51:53 and I experiment with a split of openstack current layout here: https://review.openstack.org/#/c/163243/ 19:52:02 tristanC: it's getting close and the rebases for that are becoming troublesome 19:52:34 tristanC: would it be okay to defer merging this until after that merges? 19:52:58 jeblair: it should be easy to refactor/rebase though, not sure about the design though... I put the code in the layoutvalidator and it could be somewhere more meaningfull 19:53:36 tristanC: okay, i'll try to review it before then to give you some feedback while we wait 19:53:47 jeblair: that would be awesome :) 19:53:57 #topic Puppet Testing 19:53:58 #link https://review.openstack.org/#/c/164908/ 19:54:20 so there's a proposed change that added some puppet rspec tests to one of our puppet modules 19:54:34 and it struck some of us as being unecessary 19:54:47 i wonder if we can articulate a policy on puppet testing 19:54:52 rspec is a whole ruby testing framework 19:54:59 in particular about half of the tests essentially rewrite the module 19:55:06 clarkb: indeed 19:55:07 which if you are doing a lot of ruby is worthwhile 19:55:08 which to me is redundant and does not add much value 19:55:25 my sense of the crowd is you will find rspec more effort that is is worth 19:55:34 i'm much more interested in functional tests; the puppet apply tests are really useful i think 19:55:50 and since we have nodes with sudo, i bet we can do more 19:55:59 i find that tests useful, but it's quite hard to find real problems there and discriminate from the others 19:56:09 yeah, "will this break" is more helpful to me than "is this right" 19:56:25 yolanda: absolutely. but problems do cause it to fail at least. it's kept _so many_ things from breaking production 19:57:00 so i wonder if we could functionally test each module on a node? 19:57:04 i know, i'd like if some efforts can be dedicated to cleanup the error logs there. Some are just warnings , or incorrect settings 19:57:23 have a simple manifest that uses the module and runs for real on a node? 19:57:28 jeblair: we could probably ship a tiny site.pp/node def for each module and run that then do specific sanity cheks 19:57:33 jeblair: ya that 19:57:36 yolanda: i fear that most of those errors are entirely because of running with --noop 19:57:44 jeblair, i'm doing sort of a thing with vagrant actually 19:57:44 fungi: i think you may be right 19:57:51 ++ to func tests 19:57:59 When I've looked at puppet-rspec before, my sense has always been that it's not worth the hassle - it's a whole nother language to learn and seems to largely result in you having to write your change twice in unrelated languages 19:58:05 clarkb: yes, https://review.openstack.org/#/c/155448/ is in gerrit stable-2.10 branch. 19:58:06 jeblair: I like the idea, it should be simple and help us determine where the boundary between openstack_project and everything else is 19:58:14 tchaypo: yes, that is rspec 19:58:27 jeblair: then test that interface 19:58:27 Other people I know have used them successfully but they spent a lot more time writing ruby/puppet than I did 19:58:28 so the changes i write, are tested functionally on a node, we could do something like that but using nodepool 19:58:30 so is there an existing pattern/framework for "run a simple manifest and do some checks"? should we just write a manifest, and use something like envassert after it runs? 19:58:33 it is written for tdd 19:58:34 anteaya: I agree - it seems like more hassle than it's worth 19:58:41 mordred: for us, oh yes 19:58:44 we don't tdd 19:58:45 for us. yes 19:58:47 my concern is do we want to spend 60 nodes per change to anything 19:58:52 well, not in that way 19:58:54 I get the feeling they're useful for people who spend a lot of time writing puppet but they raise the barrier for entry 19:59:00 tchaypo: ++ 19:59:02 nibalizer: just one 19:59:04 nibalizer: we could do this just on the modules 19:59:21 jeblair: right, we would test the interfaces modules expose individually 19:59:22 right, functional test, not integration test 19:59:27 instead of the entire thing composed together 19:59:27 nibalizer: so a puppet-httpd change would consume one node to run the single test to test the httpd module 19:59:41 ya okay 19:59:41 ++ 19:59:42 nibalizer: and we would not run these on the system-config repo 19:59:49 im super down for this 19:59:54 reserving the puppet apply as the 'integration' test 20:00:07 nibalizer: want to hack out a POC for one of the modules? 20:00:08 i took the gerrit module out the other day and it was rough using it standalone without prebuilt hiera 20:00:12 jeblair: yea its on my list 20:00:16 im thinking envassert 20:00:23 or beaker but :sigh: 20:00:25 oh look at the time 20:00:26 cool. i'll leave the feedback on 164908 about not wanting rspec 20:00:30 thanks everyone! 20:00:33 #endmeeting