16:00:01 #startmeeting Cinder 16:00:02 Meeting started Wed Oct 29 16:00:01 2014 UTC and is due to finish in 60 minutes. The chair is thingee. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:03 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:05 The meeting name has been set to 'cinder' 16:00:09 Hi 16:00:15 Hello all 16:00:20 hi 16:00:22 hi 16:00:23 hi 16:00:26 Agenda items for today: 16:00:28 #link https://wiki.openstack.org/wiki/CinderMeetings 16:00:29 .o/ 16:00:47 hi 16:00:54 #topic Discuss the brick spec/effort for Kilo 16:00:58 #link https://review.openstack.org/#/c/129069/ 16:01:01 hemna: you're up 16:01:01 hi 16:01:06 o/ 16:01:10 mornin 16:01:18 ok so Brick 16:01:32 o/ 16:01:34 I liked eharney's suggestion of making brick a subproject of Cinder 16:01:37 hi 16:01:38 a la python-cinderclient 16:01:46 hello 16:01:51 so cinder PTL is the PTL of brick and cinder core's are cores of brick. 16:02:16 * DuncanT- appears from the coffee fumes 16:02:25 +1 16:02:27 Makes sense to me. 16:02:32 +1 16:02:33 hemna: +1 16:02:34 hemna: thingee so not to throw a major wrench in the works.... 16:02:38 +1 16:02:42 o/ 16:02:48 but I still am not sure brick is going the right direction here 16:03:12 Can you outline the direction you think it should go in, John? 16:03:19 jgriffith: I think the general idea of accepting brick if it goes in a direction we can agree on the summit, hemna's proposal is fine 16:03:22 hi 16:03:30 DuncanT-: thingee hemna https://wiki.openstack.org/wiki/CinderBrick 16:03:31 Ok 16:03:35 fair enough 16:03:39 ignore me :) 16:04:03 I still want to see brick exist as a lib. simply to help remove the dupe code between Cinder and Nova. 16:04:14 hemna: that's easy to say :) 16:04:18 jgriffith: but it would be helpful for you to raise these points to hemna outside of the meeting so that he can have things in a better state for his summit session 16:04:23 hemna: my point is it's weird 16:04:38 hemna: thingee it's weird to have iscsi stuff and LVM stuff in a lib 16:04:43 why is removing duplicate code 'weird' ? 16:04:46 and not touch anything we hoped to accomplish 16:04:58 but that's just part of the lib. 16:05:09 the other side still needs effort and work from folks. 16:05:11 hemna: IMHO eliminating dup target/initiator code can be done another way 16:05:16 hemna: as can duplicate LVM code 16:05:21 just like everything else we do in OpenStack....baby steps 16:05:34 but I keep pointing out that the LVM code as is today likely won't be consumable by anybody else 16:05:39 Ok 16:05:46 I'll shut up :) 16:05:49 so I say then, help contribute the local volume management into brick and we're good. 16:06:42 I don't know that side of the code quite as well as you do, so I'm hoping to get help from you and the rest of Cinder to drive that piece of it. 16:06:43 hemna: but then you've got 4 disjointed things under that umbrella 16:06:49 * jgriffith NOW shuts up 16:06:50 :) 16:06:52 which is why I think it's good to be owned as a subproject of Cinder. 16:07:34 hemna: yeah, I'm down with that, but that's sort of not the point I'm trying to make 16:07:49 anyway 16:07:52 ok I'm still trying to understand your point I guess. 16:07:53 jgriffith: Would it be better to have multiple specific libs? 16:07:57 I'm completely missing it. 16:07:58 I'm the only one with anything to say so let's talk next week :) 16:08:19 smcginnis: probably... and probably consider oslo for *some* of it 16:08:26 jgriffith: I find the whole brick thing frustrating. Mainly because I feel like anytime work that is not done by you, you're unhappy with the direction. To be fair I know you're unhappy with the current state of brick, but I think it would be valuable for you to help hemna. 16:08:36 thingee: wow! 16:08:39 thingee: ok 16:08:42 I'd like to see this move forward, so we don't have yet another release where nothing happens. 16:08:54 as I said, feel free to move forward 16:09:00 I'll be quiet 16:09:08 jgriffith: that does us no good. 16:09:38 hi! Sorry, late 16:09:40 jgriffith: what are your objections with giving guidance? 16:09:56 thingee: I thnk you and I should talk offline 16:10:14 ? 16:10:22 and move along 16:10:50 #agreed if brick's direction is accepted, it'll be a subproject under cinder like cinderclient 16:10:57 and not regarding brick itself, but your statement just for the record 16:11:13 +1 16:11:26 #topic Discuss the volume type extra specs cinder-spec 16:11:28 thingee: +1 16:11:38 ok so the extra specs thing 16:11:39 +1 16:11:39 #link https://review.openstack.org/#/c/127646/ 16:11:49 I think it might be worth talking about this in a session ? 16:12:07 my coworker and I have been hashing on this one for a while 16:12:21 she's done a great job on the specs and has some screen shots of what we'd like to see 16:12:47 I can show them in Paris if anyone is interested 16:12:54 thingee: am I incorrect that we shouldn't roll up 3 specs in one proposal? 16:12:58 hemna: I am. 16:13:00 thingee: if so I can remove my -2 16:13:19 jgriffith: I agree that splitting them makes things easier to comment on and move forward in pieces 16:13:21 I know winston-d has had some questions about the implementation, and I'd like to get some clarity on it 16:13:26 oh wait... already done... sort of 16:13:35 jgriffith, I believe she split the specs up into 3 specs already 16:13:52 hemna: Any chance of getting them online or emailed before hand? Easier to think ahead than see subtle issues while thinging on your feet 16:14:02 hemna: yeah, that's what I just noticed :) 16:14:04 hemna: thanks! 16:14:10 DuncanT-, sure. I have a .ppt that she made that I can put somewhere 16:14:13 hemna: you will be work on cinder part and Julie focuses on Horizon I guess? 16:14:18 or just put the screens on a site for all to see. 16:14:22 hemna: Cheers 16:14:35 winston-d, I'll probably end up doing a bunch of the Cinder work 16:14:48 jgriffith: yeah seems fine to me. 16:14:48 jgriffith, np 16:15:09 ok, so I'll get those screenshots up before I bail for Paris 16:15:19 hemna: +1,thx 16:15:50 #topic Discuss the differential backup patch 16:16:00 #link https://review.openstack.org/#/c/110068/ 16:16:04 Murali: you're up 16:16:07 yes 16:16:16 Thanks Mike. 16:16:31 I heard couple of concerns on the specs and implementation. 16:16:48 if the design is expandable later for incremental 16:17:01 and the driver interface to support differential 16:17:10 I would like to know any other concerns. 16:17:22 Can you quickly define the two terms please? 'deferential .v. incremental' 16:17:36 interview question 16:17:46 Incremental is the delta from last backup 16:17:53 differential is delta from last full backup. 16:18:02 thingee, :) 16:18:17 right now the implementation is for differential. 16:18:21 Thanks 16:19:51 Right now the implementation uses local_path to get host path to the snapshot. 16:19:58 Murali: Could you summarize the concerns with the spec or what is needed to proceed? 16:19:59 Murali: I have not looked at the patch myself, so I will have to look to hemna DuncanT- eharney and xyang1 for thoughts 16:20:09 that is good for LVM, but does not work for other backups. 16:20:24 local_path doesn't work for any of the iSCSI drivers 16:20:27 i haven't looked at this one in a bit but i'm certainly interested in reviewing it further 16:20:30 This is something I need to look into. Duncan/Xing has some suggestions. 16:21:02 create a hidden volume from a snapshot and read the volume to calculate delta. 16:21:05 It also ties teh backup service to the cinder-volume service, which I'm trying to fix (fix is only needed for the LVM code, the rest already work AFAICT) 16:21:07 as long as Murali can explain the current design doesn't prevent it to be extended to support incremental, I'm fine with it 16:21:29 xing1: I will do that. 16:21:36 Duncan't concern about local_path needs to be addressed as well 16:22:03 ok. 16:22:09 It looks to me that the data structures are all good for incremental - the management code will need to be smarter for incremental, particularly delete, but that is only code and we have smart people 16:22:37 #agreed differential backups needs to have a path to extend to incremental 16:22:39 so if the base driver do a create volume from snapshot and use local_path only in L 16:22:42 yes, i think changing from "full backup id" to "parent id" etc. fixed most of my concerns around there at the basic level 16:22:45 only in LVM driver 16:23:16 that's kind of what Duncan suggested, I think. that seems to be fine 16:23:50 Murali: I'll try to take a look at this week before travels. 16:24:02 Murali: thank you for working on this 16:24:04 thanks a lot. 16:24:07 no problem. 16:24:08 and everyone for helping 16:24:32 Murali: question about your definition: 1st full backup, in your def, 2nd backup = delta diff to 1st, what about 3rd backup? 3rd will be delta against 1st as well? 16:24:48 3rd will be delta from 1st 16:25:21 Murali: I see, thx. 16:25:36 #topic Discuss Updating Third Party Wiki 16:25:40 #link https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers 16:25:44 patrickeast: hi! 16:26:04 hey, so first off, thanks for updating the requirements on that page thingee 16:26:05 so from a previous meeting 16:26:05 #link http://eavesdrop.openstack.org/meetings/cinder/2014/cinder.2014-10-15-16.00.txt 16:26:25 the only piece of that remaining that i was wondering about is what we wanted to do for drivers added in Juno 16:26:34 since the table w/ bugs is labeled for icehouse 16:26:37 patrickeast: yeah honestly I did it *after* I saw your agenda item :) 16:26:52 patrickeast: good point, I need to update that too. 16:27:15 and i guess whether or not we are still doing the bug thing if we have a CI up and running 16:27:26 do we just link to ci results or... 16:27:45 I think there's no point doing the bug thing when you have CI - that's the point of CI 16:27:53 DuncanT-: +1 16:27:55 DuncanT-: +1 16:28:05 DuncanT-: +1 16:28:14 DuncanT-: +1 16:28:19 my only main concern with CI's though is there's still not a good solution for vendors. 16:28:28 thingee? 16:28:36 DuncanT-, +1 16:28:44 What do you mean? 16:28:50 thingee, it is getting better though 16:29:15 but slowly 16:29:28 DuncanT-: there's still not a reliable way to get a ci system running. Last I spoke about this, I found using asselin puppet stuff not 100%. I have been talking to him though 16:29:51 yes, I'm working to get the solution into -infra 16:30:12 there's been lot's of upstream changes lately, so stability is not there 16:30:29 I think once we get a solution in -infra it will be more stable and easier for everyone to use 16:30:30 thingee: Hopefully every vendor who sets one up will help smooth the process. I've no problem at all streading a bit of the pain to vendors, hopefully it provides some motivation to fix things - this has worked well so far 16:30:37 I don't know if it makes sense, but maybe instead of vendors getting frustrated with trying to setup their own ci, maybe put that energy to helping asselin and co 16:31:19 and then any changes that would 'break' 3rd party ci, might get caught at the gate. 16:31:30 sigh 16:31:52 maybe duplicating the OpenStack Infra isn't the best answer 16:32:16 thingee: Taht seems the logical solution to me, but then getting any vendor to talk about their CI experiences initially was like pull teeth. 16:32:18 jgriffith: that's true. I know you had a working solution that was much simpler. 16:32:26 I would rather call it, re-using 16:32:35 asselin, +1 16:32:46 thingee: yeah, the problem is there are "lots" of little one offs like mine out there 16:32:50 thingee: Frankly I don't /care/ which route they take, though I try to guide them into cooperating 16:32:54 thingee: which is bad as well 16:32:58 DuncanT's KISS CI gets my vote 16:33:01 right now, it's duplicating, and since we're out of tree, it's painful 16:33:37 infra's interested b/c then one solution can benefit all of openstack projects/programs 16:33:55 thingee: CI /will not happen/ unless there is a forcing function, and while I'm entirely flexible as to how that forcing function works, backing off until somebody has doen all the work for them does not put pressure on anybody to find the resources to do the work 16:34:12 DuncanT-: I can agree with that 16:34:18 bswartz: Use jgriffith's fork, he's way ahead of me now 16:34:30 link? 16:34:47 thingee, DuncanT : Also while dicussing last week there was an idea for a seperate CI pipeline for projects which can have an impact but are still WIP do we have any plan regarding that ? 16:34:57 bswartz: Give me 5 16:34:58 bswartz: https://github.com/j-griffith/sos-ci 16:35:20 probably needs a refresh, I'll have a look later this morning 16:35:42 "sort of simple" I love it 16:35:44 patrickeast: to answer the original point of this topic, I will update the wiki 16:35:50 Suggestions about making something like kiss-ci a more official option resulted in some very rude comments from -infra team members 16:35:51 bswartz: I've added some things for multiple nics etc 16:35:53 thingee: haha thx 16:36:42 and so to make sure i understand, for my driver that landed in Juno since we have CI we don't need to put up an updated bug w/ test results? 16:36:57 patrickeast: you're golden as far as I'm concerned 16:37:01 kk 16:37:14 #topic Project suggestions for OpenStack OPW 16:37:29 #link https://wiki.openstack.org/wiki/OutreachProgramForWomen/Ideas 16:38:17 I have listed myself as a mentor for the Gnome Outreach program for women. OpenStack has been doing this since 2012 and it would be great to have other members of cinder that have time to give guidance. 16:38:27 signup for mentor is in that link 16:38:47 but mainly it would be great if people have ideas of cinder projects that would be good for someone participating for the few months 16:39:01 to later present their work at the next next summit 16:39:48 * DuncanT- has some gate ideas, nothing cinder specific ATM 16:40:12 even if you don't want to spend the time to add a project to the wiki page and know of some new enhancements to cinder, just ping me and I'll take care of it 16:40:43 just would appreciate people being mindful of ideas that we would like to see happen this release that would be good canididates for the short time we can work with someone. 16:40:55 #topic Liaison for Cinder third party CI 16:41:27 asselin: ^^ :) 16:41:56 #idea have a cinder liaison to help in #openstack-infra channel and ML with ci questions relating to storage 16:42:29 so anteaya and co have to deal with all projects in ci systems. If we want ci systems there has to be someone that can handle block storage cis. 16:42:33 also, to help identify ci systems that need to be disabled 16:42:43 asselin: yes was just going to get to that 16:43:03 on the infra ML, it's mostly guessing work on whether to reenable. 16:44:04 so I thought this would be great for people who already have their ci setup to participate 16:44:35 patrickeast, xyang1 ^ 16:44:59 thingee: I can help of course, I think asselin has the most knowledge 16:45:05 I can help with ci questions 16:45:18 DuncanT-? 16:45:19 i'm game to help out, i agree though that asselin would be best for the liaison role 16:45:19 One thing that would make a difference I think is for the XXX has been disabled mails on the list to be flagged with what project(s) they CI for, so that I can filter - I follow the list occasionally but it is hard to tell what is relevant 16:45:45 I think -infra wanted a core? member to decide which to enable/disable in case of issues 16:45:58 I instantly thought about asselin, but I was concerned about this distracting with the important infra work you're already doing 16:46:20 * DuncanT- can do it, but I'm not currently running a CI system 16:46:37 DuncanT-: not a requirement, but if you want to watch the lists that's fine. 16:46:50 DuncanT- your company is 16:46:57 I can help with ci setup and watching the mailing list. 16:47:30 I'm not actively monitoring the results of other ci-systems however. 16:47:46 yeah so that's important I think for disable/renable 16:47:47 thingee: I've been somewhat defacto ddoing the job to a degree since anteaya pokes me from time to time, might as well put my name on it if nobody else is suitable. I can work with asselin just fine 16:48:00 it sure would be nice to have a health meter of 3rd party Cinder CI's 16:48:09 I want to script some CI monitoring and dashboard, so moving that up my priorities is fine 16:48:16 like that one page we saw in Ft. Collins with the graphs 16:48:17 How about DuncanT- watches the list, and asselin you can help in #openstack-infra? 16:48:18 that was cool 16:48:30 yes, there's going to be discussions on monitoring third party ci at the summit 16:48:44 I think anteaya had that link previously 16:48:46 I think whoever handles disable/enable should have somewhat of a history of the ci from gerrit's standpoint 16:48:47 hemna: +1 16:48:50 thingee, I can do that 16:49:01 DuncanT-: is that fine? 16:49:02 hemna: I'd propose a dashboard as the single version of truth 16:49:07 Fine by me, yeah 16:49:10 jgriffith, +1 16:49:30 jgriffith: I'll code it, you can tell me what I got wrong ;-) 16:49:35 hemna: yeah, anteaya showwed that and personally I think it's the way to go 16:49:38 CI's break all the time as of no fault of the infrastructure and or upstream patches. 16:49:45 DuncanT-: awesome! 16:49:48 #link third party summit etherpad https://etherpad.openstack.org/p/kilo-third-party-items 16:49:48 #agreed DuncanT- will handle the openstack infra ML for reenable/disable CI | asselin will help for block storage ci's in #openstack-infra 16:50:02 By code I quite possibly mean 'steal', like all the great artists 16:50:18 jgriffith, agreed. that dashboard was great. 16:50:19 #topic New Drivers deadline in Kilo 16:50:19 DuncanT-: of course, you'd be a fool not to do it that way :) 16:50:37 DuncanT-, whatever it takes brother :) 16:51:00 Per DuncanT-'s email earlier to the list about only accepting drivers in k-1 16:51:31 I would like to do a cut off of accepting new bps and in general cutting off new drivers being proposed in K-1 16:51:38 thingee: DuncanT- was K-1 a made decision? 16:51:42 thingee: ahh... yeah, ok 16:51:49 how do I get my driver on the review list for K-1? 16:51:52 proposals in K-1 16:51:56 jgriffith: That's what we said in FC 16:51:58 jgriffith: yeah I don't have the links handy, it was in some previous meeting and then brought up on the ML 16:52:04 rhe00: Post the code! 16:52:11 DuncanT-, +1 16:52:18 DuncanT-: yeah, thought so but there's been miscom on a number fo things so wanted to clarify 16:52:24 does that mean that new drivers have to be proposed but not merged by K-1? 16:52:25 thingee: is 12/18 the drop dead date? 16:52:28 rhe00, yah, get the code in gerrit as soon as you can. even if it's WIP. 16:52:37 DuncanT: it was posted before Juno 16:52:44 wording there sounded like "submission" not proposal 16:52:44 xyang1: I just mean proposals. an intent to submit a new driver 16:52:50 important distinction IMO 16:52:56 rhe00: Ah, poke some people for reviews then, including me 16:52:57 just want to make sure it is marked correctly so it isn's overlooked 16:53:04 thingee: what about driver code submission date? 16:53:28 * DuncanT- would like code up before K1... 16:53:44 * jgriffith would propose close of K2 for submitted patches 16:53:47 DuncanT-, +1 16:53:49 #idea deadline to accept new driver blueprints for Kilo ends Nov 7th 16:53:53 'Intent' is easy... Vaguely working code is harder, and long running driver reviews suck up lots of time 16:53:57 and is there are cutoff for merging new drivers? depending on how slow the author and reviewers are, the review/update cycle can take weeks for a driver to go from submitted to merged 16:54:05 if it is close to K2, then that is similar to Juno? 16:54:28 I'd say aim to merge before K2 16:54:31 If we're following our previous discussion, we would want the code merged in k-1 16:54:36 DuncanT-: I'm down with that 16:54:38 DuncanT-: +1 16:54:54 but the code needs to be in k-1 16:54:54 DuncanT-, +1 16:55:01 DuncanT-: thingee TBC... you're saying merged BEFORE k-2 opens up? 16:55:08 ie last items for K-1? 16:55:09 this is getting kind of confusing 16:55:20 eharney: +1 16:55:26 eharney: indeed 16:55:26 I''m confused 16:55:30 jgriffith: I don't think we can manage that, sadly 16:55:37 DuncanT-: I don't either 16:55:39 let me try this again 16:55:42 DuncanT-: that's why I called i tout 16:55:50 I think code up before K1, merged before (end of) K2 16:56:09 blueprint deadline Nov 7th, code should be in gerrit by K-1 16:56:11 With the first being a hard cutoff 16:56:22 I thought the original plan was to get driver code submitted by K-1 16:56:25 i thought we weren't doing blueprints/specs for new drivers anyway 16:56:25 thingee: ummm... that might not bfly 16:56:40 jgriffith: not sure what bfly is 16:56:50 thingee: hehe... "fly" 16:57:04 thingee: you might want to give some amount of time after communicating the policy at the summit 16:57:08 jgriffith: ok 16:57:15 eharney: I thought at least not spec 16:57:27 eharney: no specs, but still need bps IMO 16:57:29 fine Nov 15 for bp deadline 16:57:38 for k-1 16:57:47 and k-1 is the only time to get drivers in 16:57:59 thingee: so bp 11/15, code submission 12/18? 16:58:05 yes 16:58:09 thingee: thanks 16:58:12 er 16:58:12 sold! 16:58:20 12/18 submission or merged in 16:58:21 xyang1, +1 16:58:25 12/18 is k-1 16:58:39 eharney: Submission 16:58:43 eharney: submitted 16:58:45 ok 16:58:46 code submitted by 12/17 won't be merged by 12/18 16:59:01 any deadline for merge? or is that fuzzy? 16:59:01 submitted just means posted to gerrit not merged 16:59:13 is there a driver code merge deadline? 16:59:16 thingee: can we cover any non-driver blueprints/specs deadlines so we're all on the same page there too? 16:59:18 Ki-2? 16:59:21 ok I'll send this to the list replying to duncan's original email 16:59:22 k-2 16:59:33 hey... can we just say: 16:59:34 this includes bp/specs for k-1 16:59:43 they should be submitted to k-2 or k-3 16:59:47 for non-drivers 16:59:54 We will not accept any driver/code *submissions* after 12/17 17:00:02 #endmeeting