16:01:52 #startmeeting cinder 16:01:53 Meeting started Wed Sep 3 16:01:52 2014 UTC and is due to finish in 60 minutes. The chair is jgriffith. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:01:54 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:01:56 The meeting name has been set to 'cinder' 16:01:59 hola everybody 16:01:59 mep 16:02:01 hello all 16:02:03 hi 16:02:04 hi 16:02:08 hi 16:02:09 hi 16:02:09 o/ 16:02:11 hello 16:02:19 hi 16:02:22 so just a few things to start.... 16:02:27 #topic J3 16:02:35 o/ 16:02:46 We went ahead and set the whels in motion to tag J3 this morning 16:03:11 There were two SMB patches granted exceptions that we'll focus on when RC1 opens 16:03:33 We shouldn't approve anything new after this point 16:03:49 hi 16:03:50 keep the J3 target map clean 16:04:02 so the incremental backups patch is out then? 16:04:05 #topic folks requesting exceptions for drivers 16:04:10 hemna: yes 16:04:12 ok 16:04:16 I'll -2 it now then. 16:04:28 Can you add comments 16:04:36 jgriffith which bugs priority will be acceptable after j3? 16:04:37 on the patch so I can address them 16:04:38 Sorry, my client died. 16:04:38 Murali__: I'll explain in a sec 16:04:47 ok. 16:04:53 So, even the items in flight are getting -2'd now? 16:04:54 e0ne: bugs are always allowed to be fixed for the most part 16:05:06 jgriffith: question for you. Is the driver implemenation of CG considered a bug fix or feature? Is it too late to merge that? 16:05:14 everybody please wait a second 16:05:25 you can't all ask me questions at once about different topics :) 16:05:45 There are two drivers that were in process 16:05:57 rhe00_: had an X-IO driver 16:06:09 and joa with his scality driver 16:06:39 yes 16:07:02 jgriffith, I just -2'd his driver because he doesn't have any cert logs, FYI. 16:07:05 I'd like to get input from other core memebers 16:07:11 hemna: which ? 16:07:22 jgriffith, joa's scality rest block driver 16:07:32 hemna: k 16:07:53 anybody have any input on these two, other than what hemna just pointed out on Scality driver? 16:08:13 jgriffith: I need to look at the Scality driver. 16:08:19 I think eharney had issues with the SMB driver breaking the nfs driver 16:08:22 I had reviewed the X-IO one before I believe. 16:08:24 did that get ironed out? 16:08:28 so I think maybe I'm not being clear...... 16:08:29 hemna: that was fixed 16:08:37 do we want to do exceptions for these? 16:08:40 bahhh 16:08:42 weeeeeee 16:08:49 Sheesh. 16:08:51 SMB driver had enough +2s to merge but we held off to get final signoff from Eric 16:08:55 eharney, ok cool. 16:08:59 I'd support that one getting an exception 16:09:00 wow... that was awesome 16:09:50 DuncanT: I am ok with that if eharney is ok with it. 16:09:54 I'd be ok with the SMB driver. it's waiting on jenkins currently 16:09:54 FYI the SMB patches already have an exception 16:09:57 yes, i am 16:09:58 ok 16:10:04 I'm specifically asking aobut the two drivers 16:10:08 XIO and Scality 16:10:10 so exceptions for X-IO and scality? 16:10:23 hemna: yes, that's the question on the table 16:10:38 X-IO appears to have had virtually no review so hard to say 16:10:40 XIO at least has driver cert results 16:10:51 hemna: +1 16:11:14 Scality I'm told has been running cert runs, haven't seen the results posted though 16:11:24 hey all 16:11:25 I'm surprised joa isn't ehre 16:11:47 freenode is having problems 16:11:53 my client keeps dropping 16:12:16 I don't see any core reviews on X-IO yet 16:12:17 rhe00 is here for X-IO, and I'm hoping for an exception. :) 16:12:36 hemna: Where is that review? 16:12:47 https://review.openstack.org/#/c/116186/ 16:12:58 the driver was submitted Aug 21. feature freeze date 16:13:01 :( 16:13:25 hemna: Thanks. Doh, I guess I hadn't looked at that one. 16:14:09 so general thoughts on exceptions for drivers? 16:14:13 X-IO was very late and has had almost no reviews, I think we punt it 16:14:20 I think X-IO was too late 16:14:23 and no real reviews 16:14:24 DuncanT: thank you for voicing an opinion 16:14:33 hemna: ditto 16:14:49 I think that seems logical DuncanT 16:15:13 I missed seeing that review too.. 16:15:24 Ok, so shall we punt on both of them? 16:15:44 jgriffith: Wasn't scality further along in the process? 16:16:03 jungleboyj_: well, depends on how you define "further along" :) 16:16:11 ok doing a quick review on the X-IO driver, I see problems with it. 16:16:16 soren, I vote no on it for Juno 16:16:25 jgriffith: :-) 16:16:25 While feeling sorry for Joa, I vote to punt that one too 16:16:26 *Sigh* s/soren/so 16:16:31 did the scality one get much feedback other than name debates? 16:16:44 OK... anybody from core want to champion one of them? 16:16:50 if not we'll punt I think 16:16:58 joa has at least been active recently trying to get feedback 16:17:04 eharney: There's been a fair bit of discussion on their snapshot approach, but no actual problems found 16:17:30 hemna: That is my concern. 16:17:30 Honestly I don't have a problem if people want to review and work on it 16:17:34 make a decision next week 16:17:38 DuncanT: yeah I've looked at it a bit but can't gauge how close it is 16:17:52 I'd be ok with giving the scality driver a bit more time. 16:17:53 ok, let's review the code 16:17:56 get those cert logs up today 16:18:02 and review the code 16:18:02 depending on what happens in the next 24 hours I'll make a call 16:18:04 jgriffith: Lets get reviews on scality and SMB. 16:18:10 jgriffith: Punt XIO. 16:18:16 jungleboyj_: +2 16:18:17 X-IO should be out IMHO. 16:18:23 sounds good 16:18:26 ok 16:18:31 jgriffith: I'm back from burning man, so I can pitch in ;) 16:18:40 then can I please get it marked for the next release? 16:18:48 rhe00_: absolutely 16:18:49 so I don't miss that train as well 16:19:05 Ok, scality is in 16:19:08 let's move on 16:19:10 already missed icehouse with a narrow margin and then fumbled for Juno 16:19:25 #topic moving brick out of cinder 16:19:35 eOne isn't here :( 16:19:41 e0ne ;( 16:19:48 ahh... there you are 16:20:16 i hope Emma and Ben are here too 16:20:26 so... short and sweet 16:20:28 +1 16:20:31 stackforge 16:20:40 but currently there's little value 16:20:58 I'd say we have to work out solving the "real" problem 16:21:11 the LVM code inparticular as is is not ready or good 16:21:15 stackforge is much easier. it could be moved to oslo later 16:21:16 There are multiple 'real' problems 16:21:37 so I'd like to regroup on this later TBH 16:21:46 jgriffith, you want to do this for Juno ? 16:21:55 it's not well thought out, and there's still no movement on what we actually want here 16:21:59 hemna: huh? Helll noooo 16:22:02 ok :) 16:22:19 let's discuss this after we get Juno under our belt 16:22:20 Isn't one of the real problems that cinder and nova have different implementations of the same code (i.e. how to attach to stuff that cinder creates)? 16:22:21 i think that sounds like a good plan... i'm glad this is being discussed but it's not clear what the basic ideas are 16:22:30 I think there's still a lot of misconception and lack of focus here 16:22:37 I think there is value on having something outside of cinder that handles LUN discovery (a la brick connectors) 16:22:37 eharney: :) 16:23:00 e0ne: let's sync up later 16:23:02 jgriffith: you decided that Ban will be responsible for moving it from Cinder 16:23:10 e0ne: I'll give you the ugly history 16:23:17 Ban? 16:23:20 e0ne: ok 16:23:26 e0ne: huh? 16:23:35 link https://etherpad.openstack.org/p/cinder-meetup-summer-2014 16:23:44 I guess the decision is do we want an agent that cinder/nova can talk to that does this, or just a library (brick) ? 16:23:56 agent 16:24:06 I think the agent makes more sense long term IMO 16:24:16 agent, but it is a hard thing to design 16:24:31 and the agent needs a concrete API that cinder/nova can talk to 16:24:36 and then get buy off from Nova 16:24:40 *sigh* 16:24:48 so brick is dead, long live cinder-agent? 16:24:50 hemna: there was a nova-spec on this, I think 16:24:59 bswartz: that's what brick was supposed to be 16:25:04 bswartz, well it's not dead yet... 16:25:04 anyway... 16:25:09 let's move on 16:25:12 bswartz: Brick is a library that has many useful bits for building the agent 16:25:19 DuncanT, +1 16:25:19 we have higher priorities right now 16:25:34 #topic Cinder CI tests and FC 16:25:36 yeah sorry for the hyperbole -- I think I get the gist and I have no disagreement 16:25:37 asselin__: 16:25:42 bswartz: :) 16:25:44 maybe we can start small and just have the simple agent that does the LUN discover and report back. 16:26:08 Ok... 16:26:15 asselin__: has pass-through FC working 16:26:16 hemna: Probably best to write a spec and we can discuss it then? 16:26:18 yayyy 16:26:21 DuncanT, agreed 16:26:23 good job asselin__ 16:26:27 asselin__: great! 16:26:36 #topic cut off dates for Kilo 16:26:38 thanks 16:26:44 asselin__ congrats! 16:26:45 asselin__: oh.. you're here 16:26:54 asselin__: anything inparticular you want to share here? 16:27:08 he was just missing the FC drivers on the blade yesterday and then everything fell into place 16:27:19 well I got it working yesterday. Lots of credit to hemna and Rahul Verma (our summer intern) 16:27:46 asselin__: we should try this soon. thanks! 16:27:51 it's been running overnight, but there are some stability problems. Not sure if it's related to FC or not. 16:28:18 the scripts are in my github repo. Link is in the meeting minutes. 16:28:53 asselin__: how many commits can your CI handle in a day? 16:29:17 so it'd be good for others to try out. 16:30:02 xyang1, we're limited to 1 job at a time now. So about 24/day is a good guess. 16:30:21 asselin__: thanks. good to know 16:30:30 1 job per node at any time 16:30:31 1 job = 1 driver. We have 3 drviers, so 3 jobs simultaneously. 16:30:37 due to FC passthrough 16:30:51 ok 16:31:13 right, we do 1 fc job at a time, 1 iscsi job at a time, and 1 other iscsi job that doesn't require a 2nd eth 16:32:33 so, please try it out. let me know what works or not. bug fixes are appreciated. 16:33:22 documentation is still poor, so do your best and ask me questions. 16:33:30 poor -> non-existent 16:34:35 that's it, unless anyone has questions, or freenode is having issues. 16:34:40 Ok.. thanks asselin__ 16:34:51 back to cut-off dates 16:34:53 jungleboyj_: 16:35:06 jgriffith: Thanks. 16:35:24 jgriffith: Just wanted to nail down what is expected for Kilo. 16:35:33 No drivers after Kilo1? 16:35:48 jungleboyj_: I'm good with that 16:35:49 +1 16:35:59 I think avishay would like to say "NO new drivers." 16:36:10 jgriffith: :) 16:36:13 jgriffith: Well, we already have some deferred. ;-) 16:36:20 but I think K1 is a good compromise 16:36:23 so when is Kilo1? 16:36:23 jungleboyj_, +1 16:36:23 jungleboyj_: yup 16:36:32 rhe00_: don't know yet 16:36:35 I think we wanted to target Kilo for stabilization no? 16:36:37 jgriffith: i think drivers are less harmful...i'd like to see less new features 16:36:37 jgriffith: ok, good to know. we'll target k-1:) 16:36:39 jgriffith: How about adding support for features into drivers? 16:36:39 rhe00_: will likely be around Dec 16:36:43 Kilo will be early december most likely 16:36:49 I like the idea of K1. We're not saying 'no' to drivers, and also we're ensuring we've good amount of time for stabilizing/improving cinder 16:37:00 December 5 is my bet 16:37:11 jungleboyj_: i'm not sure it's reasonable to restrict adding support for features into drivers 16:37:14 Ok, anybody object to running with that for the K release? 16:37:24 eharney: we'll get to that next :) 16:37:33 jgriffith: Works for me. 16:37:42 ok.. going once? 16:37:46 jgriffith: +8 16:37:48 i'll say i'm +0 on the k-1 driver limit 16:37:51 speak now or don't wine to me in 2 months 16:37:59 eharney: fair enough 16:38:06 jgriffith: I found the dates always keep moving:) 16:38:15 xyang1: indeed they do 16:38:21 xyang1: If we set them earlier they won't move out so far. 16:38:30 jgriffith, +1 on drivers at K1. 16:38:37 +1 from me too 16:38:40 xyang1: the idea is we'd like to have a release where we spend more of our efforts on the core project and stability 16:38:41 why would you want to prevent new drivers? 16:38:51 jgriffith: understand 16:38:54 rhe00_: we don't want to prevent them 16:39:06 ok, that's what it sounded like 16:39:08 Can we put a big, loud, clear statement on the mailing list today, so that people can't say they didn't know? (I'll send it, and a reminder at summit time) 16:39:08 rhe00_: but adding a dozen drivers in the last milestone of every release sucks 16:39:10 rhe00_, they just need to be in by K1. 16:39:18 DuncanT, +2 16:39:26 rhe00_: we'd at least like to have them submitted early 16:39:29 rhe00_: We want to focus on other reviews and fixes. 16:39:32 rather than at the last minutes 16:39:36 rhe00_: New drivers suck up review time like crazy 16:39:41 ok, understood. 16:39:45 because we all know there's no better time than the last minute 16:39:59 #topic no new driver features 16:40:09 I'm certainly not a proponent of that 16:40:10 #action Duncan to go advertise this decision on the mailing list 16:40:24 i don't think this one makes sense unless there's something i'm missing 16:40:29 jungleboyj_: are you saying you'd propose that? 16:40:30 I think we want /more/ drivers to fix up missing features, not fewer 16:40:37 eharney, +1 16:40:42 eharney: doesn't make sense to me either, but jungleboyj_ posted it 16:40:49 DuncanT: +1 16:41:02 +1 16:41:03 for Kilo, we'll have several things we need to get in for our drivers now that some new stuff landed in J. 16:41:05 jgriffith: No, just wanted to make sure the expected dates are documented. 16:41:09 DuncanT: agreed... still waiting for jungleboyj_ to say something 16:41:11 ahhh 16:41:18 existing drivers should always be allowed to update to support cinder features IMO. 16:41:28 So, K3 for new driver features being proposed still? 16:41:28 +1 16:41:31 jungleboyj_: well that's not an expectation, and I fear now it will just cause confusion :( 16:41:35 hemna: +1 16:41:38 DuncanT: +1 16:41:47 hemna: Not necessarily after feature freeze - testing and stabilisation takes time 16:41:55 jungleboyj_: i think so, because some driver features are fairly small and there isn't really a reason to block them as a whole 16:41:59 DuncanT, sure that goes w/o saying I thinks. 16:42:02 DuncanT, jgriffith: can we get an etherpad list of the drivers to still review through for this release? 16:42:07 jungleboyj_: I don't think we need more beuarocracy 16:42:15 ie dates for *everything* 16:42:18 i agree, drivers should be able to enable features 16:42:22 thingee, I think it's only the scality driver now 16:42:24 thingee: there's only 3 16:42:28 thingee, X-IO is out 16:42:34 thingee: SMB and Scality Block Driver 16:42:39 SMB has two patches 16:42:40 but you can still review it. :) 16:42:48 jgriffith: Ok ... So, nothing that needs to be documented there. Forget that I worried about it. 16:42:50 rhe00_: yes... sorry :) 16:42:54 jungleboyj_: :) 16:42:59 jungleboyj_: i think it's assumed to be part of the feature freeze 16:43:06 the bigger question..... 16:43:07 er never mind, read that wrong 16:43:08 jgriffith: I reup'd the datera driver. no changes except rebase and regenerate config https://review.openstack.org/#/c/109481/11 16:43:08 I think it might be worth making clear here that we mean no problem with drivers implementing their bit of existing cinder features 16:43:13 #topic new features in Kilo 16:43:18 eharney: jgriffith Thanks! 16:43:18 Rather than crazy new features 16:43:26 DuncanT: fair enough 16:43:43 DuncanT, do you have the etherpad URL for the Kilo stabilization items? 16:43:49 frankly if people want to optimize their drivers, add internal things etc that's fine by me 16:43:53 make your driver better 16:44:08 +1 16:44:10 so there's different thoughts on Kilo 16:44:12 we actually went through that list here and are trying to see how much we can contribute to them for Kilo. 16:44:17 we might try and take on some of them. 16:44:18 the question that have come up: 16:44:20 https://etherpad.openstack.org/p/cinder-kilo-stabilisation-work 16:44:29 DuncanT, thanks 16:44:33 1. Should we just cease introducing ANY new features in Kilo 16:44:49 2. Should we allow limited new features, and if so up until what milestone? 16:45:06 -1 on no new features at all, things like differential backup I want ot see in 16:45:10 3. If we do a 'stability' release like this, willl people actually participate/contribute? 16:45:20 No new features that don't have PoC code before the summit? 16:45:32 3. YES! :) 16:45:41 hemna: I know you will :) 16:45:45 Ok... 16:45:52 so I don't like option 1 myself 16:45:54 3. Yes from us (the other bit of HP) 16:46:00 I prefer option 2 16:46:09 jgriffith, +2 on 2. 16:46:15 3 will take care of itself so whatever 16:46:16 I like #2 16:46:35 #2 is good. We just need to come up with a date 16:46:37 I don't know how I feeel about the no new features that don't have POC code at summit 16:46:40 jgriffith: +2 seems reasonable? Do we set K1 again? 16:46:52 that came out wron=g :) I prefer option 2 16:46:55 I DO say no summit sessions for features without POC code 16:47:08 kmartin: Thanks, I needed a laugh! 16:47:18 As far as cutting off features.... 16:47:19 +1 for #2 16:47:30 jgriffith: sounds good to me, and any new feature should comply with the stabalization code - no submitting code that needs immediate cleanup 16:47:33 First, I'd like to be VERY picky and selective about features 16:47:42 avishay: +1 16:47:45 kmartin, #1 go take a #2 16:47:48 avishay: + 16:48:09 Who does #2 work for? 16:48:12 I'd propose that we're very picky about any new features being proposed. There needs to be a very clear benefit and win for Cinder 16:48:24 end of K2, and they must be merged by then not just submitted 16:48:29 and not just "vendor xyz would like to support abc" 16:48:39 yah 16:48:46 kmartin: I think that seems reasonable 16:48:59 The only feature I want to see is differential backup, and that should be merged before K1 hopefully 16:49:05 That gives an entire milestone for testing and stability improvements 16:49:09 I things like multi-attach are a bit tricky, because it involves nova more than anything. 16:49:20 DuncanT: I know I know.. you want differential backups :) 16:49:24 kmartin: +2 16:49:24 but I like the by K2 target. 16:49:39 I am with Duncan :) 16:49:47 does anybody disagree with limited features and cut off being K2? 16:49:55 Murali__: I'm with both of you :) 16:50:05 i'm wary it will get in the way of smaller things that could go into K-3 without much issue 16:50:42 for large cinder-wide features, sure 16:50:48 eharney: valid point 16:50:59 eharney: +1 16:50:59 eharney: We want it to get in the way - we want to push people towards working on testing, stabilisation, correctness, docs etc 16:51:03 so here's the thing... for me at least; I'm not a fan of strict black and white rules 16:51:09 I'm thinking more of guidelines here 16:51:15 DuncanT: it's not really obvious to me that will be the outcome 16:51:25 DuncanT: people may just work on their features shooting for M-1 instead 16:51:26 rules are made to be broken 16:51:31 jgriffith, +1 there should be a case by case exception if possible. 16:51:34 I think that introducing rigid rules causes more harm than good 16:51:35 or we'll turn into nova. 16:51:38 er, L-1 16:51:41 the project of no. 16:51:48 jgriffith: +1 16:51:52 hemna: agreed 16:51:55 eharney: That is always a risk, hopefully their feature will be better tested by then at the least 16:51:56 Ok, so let's call these things "Guidelines" 16:52:02 and "Goals" 16:52:15 hema: +1 16:52:17 Guidelines: 16:52:25 1. New drivers submitted by K1 16:52:39 2. New features are limited and ideally merged by K2 16:53:00 3. K3 is dedicated to stability and bug fixing 16:53:13 2. ...and POC at summit ? 16:53:20 4. or course item 3 applies to all milestones 16:53:41 if a new feature lands in K-2 that involves driver enablement, we might want K-3 to get it supported in drivers... 16:53:42 5. POC required for any summit session related to new features 16:53:42 PoC at summit for all summit sessions? 16:53:59 eharney: yeah, that's always a "special" case IMO 16:54:00 why do we have two #2's ? 16:54:10 kmartin: because avishay added another one :) 16:54:14 jgriffith: yeah but we have to write these special cases down if we're going to list all these guidelines :) 16:54:15 :) 16:54:19 :) 16:54:22 otherwise nobody can figure out what's going on 16:54:24 eharney: agreed 16:54:35 kmartin, didn't you know that 2 was after 2 and before 3? 16:54:41 :P 16:54:44 I like the guidelines they are clear and to the point, +1 16:54:57 jgriffith, yah awesome job. +2! 16:54:58 sounds good to me 16:54:59 Ok, everybody good with those 5 items as guidelines for Kilo? 16:55:06 anything that should be added? 16:55:07 +1 16:55:10 sounds good 16:55:11 +1 16:55:14 jgriffith: +2 16:55:18 +1 16:55:22 #action jgriffith to add these guidelines to the wiki page 16:55:29 jgriffith: and ML? 16:55:40 jgriffith: what is the requirement for CI on the drivers? 16:55:49 gotta run, bye all 16:55:53 avishay: DuncanT already stated he took an action item to post to ML 16:55:58 I'll leave that one to him 16:56:10 Not a problem 16:56:10 xyang1: I'm glad you asked :) 16:56:23 #topic third party CI 16:56:32 yes please make sure that thoughts on CI in Kilo get written down somewhere solid as well 16:56:37 * DuncanT is highly disappointed no to see more systems posting by now 16:56:52 so first let's talk about the rest of Juno 16:57:15 I still expect to see people getting this up and running before we close out 16:57:49 If you remember I had different views on this at the summit 16:58:02 but the bottom line is what we have sucks 16:58:07 all the way around 16:58:31 and I'm sorry, not to offend anybody, but putting up somethign that doesn't work is worse than not putting something up at all 16:58:48 this whole approach isn't working for me quite frankly 16:58:50 jgriffith: now the FC passthough is working we can focus on stability, no more excuses for us 16:59:03 jgriffith: I think part of the problem is not having a good clear direction on HOW to set up the CI. 16:59:07 kmartin: but my point is and has been... you shouldn't be voting if you're not stable 16:59:17 and if your system doesn't publish results 16:59:38 wouldn't it be possible to "clone" an environment that works instead of having every single vendor go through all the gotchas on their own? a VM or something? 16:59:39 I've had a CI system running for weeks, but I'm not voting because I was having intermittent failures 16:59:48 rhe00_: there are LOTS of options 16:59:57 rhe00_: DuncanT has his KISS_CI 16:59:58 I don't think anyone has 3rd party CI voting yet? 17:00:05 rhe00_: I have my version of it using ansible 17:00:13 asselin__: has Jenkins 17:00:25 xyang1: has Jenkins as well 17:00:56 I think it might help if we posted a wiki/blog about setups for the different approaches. 17:01:01 Bottom line is with the exception of a few most have just ignored third party CI requirements 17:01:09 hemna: fair enough 17:01:29 jgriffith, time 17:01:30 hi guys - almost done? 17:01:32 hemna: I'll write up mine this week and get it published to my blog and share it 17:01:42 Ok... let's head over to cinder channel 17:01:46 #endmeeting cinder