16:00:04 #startmeeting cinder 16:00:05 Meeting started Wed Apr 22 16:00:04 2015 UTC and is due to finish in 60 minutes. The chair is thingee. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:06 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:08 The meeting name has been set to 'cinder' 16:00:09 Hello. 16:00:14 hi everyone! 16:00:16 Hi 16:00:24 hi 16:00:31 Hi 16:00:33 hi 16:00:38 Hi 16:00:48 Hello All ! 16:00:49 hello 16:00:51 announcements! 16:00:51 Hi 16:00:54 hi 16:00:56 Common CI solution 16:00:58 http://lists.openstack.org/pipermail/openstack-dev/2015-April/061929.html 16:01:16 This is of interest in our group from asselin 16:01:55 o/ 16:01:57 hi 16:02:08 recommend interested in parties in helping improve our common CI solution for third parties to reach out to asselin to contribute 16:02:22 o/ 16:02:25 ok lets get started with the meeting 16:02:34 sounds like a good idea the common ci soln 16:02:38 mornin 16:02:39 #link https://wiki.openstack.org/wiki/CinderMeetings#Next_meeting 16:02:44 hola 16:02:48 85 3rd part CIs registered? wow... 16:02:55 #topic Cinder Liberty Midcycle Meetup Planning 16:03:04 #link https://etherpad.openstack.org/p/cinder-liberty-midcycle-meetup 16:03:23 we don't have a plan 16:03:35 should get a place/date figured out soon 16:03:39 when do we plan to have it? 16:03:48 we might be able to host it here in CA 16:03:53 that etherpad is not opening for me 16:03:54 can't wait until design summit? 16:03:58 I've spoken with my mgr in the past about it. 16:04:01 hemna: that'll be nice 16:04:13 I'll have to ping him again to make sure 16:04:39 when did we have the fort collins one? 16:04:44 thingee: The sooner the better. 16:04:57 we did fort collins the first time around, last year 16:05:03 I don't mind going back! :) 16:05:11 my fly rod can come with me there. :P 16:05:14 *fish on* 16:05:28 Certainly happy to host in FC again if that sorts people 16:05:29 Mid-late August seems about right 16:05:31 was trying to remember the date of the midcycle then 16:05:40 got it 16:05:44 For Collins worked great as well. 16:05:44 jan 25th or 27th 16:05:47 cebruns: hey! 16:05:57 was hoping you were going to show up to this topic :) 16:06:02 was the one for fort colling if i remember 16:06:19 vilobhmm1: I think that was Kilo midcycle 16:06:28 oh ok 16:06:34 Yep - was thinking we could host, but Intel CO site is going through renovations (no big conference rooms) 16:06:40 vilobhmm1: nahh... it was summer 8/10/14 16:06:55 Don't think people want to do Phx in August. :) 16:06:55 jgriffith: thanks 16:07:07 lol 16:07:07 Yeah, looks like it was that first week in August. 16:07:13 cebruns: ha yeah not so much 16:07:15 jgriffith : oh okay 16:07:15 yah, Phx is warm in August. 16:07:19 o/ 16:07:27 maybe M midcycle 16:07:54 cebruns: No thank you. 16:07:59 we could 'save' Roseville, CA for winter midcycle meetup 16:08:01 ok so wanted to put that out there. I would like to have things figured out soon so I can coordinate with other projects. 16:08:04 Phx in January, yes. 16:08:05 wx here usually isn't bad. 16:08:14 last time we had people who were sad nova's was happening the same time as Cinder 16:08:56 thingee: which is bad? 16:08:58 it would be great if I could delegate this to someone like jungleboyj did last time. ;) 16:09:04 shouldn't be too hard to coordinate it w/ the Nova meetup 16:09:24 thingee: You want me to lead this again? 16:09:38 Is scottda about? 16:09:40 thingee: Or looking for someone to step up and run it for their site? 16:09:41 jungleboyj, can I put in a request for wifi this time around? 16:09:47 hemna: :-p 16:09:49 :P 16:09:51 so whoever can offer a spot. please add it to the etherpad and we'll revisit and decide next week maybe? 16:10:13 i'll ask my manager this week 16:10:18 ok I'll ping my mgr about it and see. 16:10:27 DuncanT: Yeah, scottda did a great job! 16:10:27 we've got office in Mounting View, CA 16:10:27 I'd like to help out where possible though for L midcycle - at least get a dinner on the books or something... 16:10:28 i am not even offering :) 16:10:29 I'll ask here in Colorado Springs as well 16:10:30 e0ne: In Mascow, yes! 16:10:42 winston-d_: Kharkiv or Lviv:) 16:10:53 jungleboyj: He/we are happy to host again 16:10:55 me too will ask 16:10:55 yes also people who can host dinners, please feel free to list those in the etherpad as well 16:11:06 How big of a facility is needed? 16:11:10 thingee: Yeah, I can check into that again. 16:11:12 we have good beer here in Roseville 16:11:18 How many people in one room? Any need to have breakout rooms? 16:11:20 hemna: +1 16:11:21 avishay: We could sort something between us? 16:11:26 hemna: I have heard. :-) Now we are talking about the important stuff. 16:11:29 jungleboyj: how many were at the last meetup? 16:11:31 :) 16:11:41 hey 16:11:44 DuncanT: i don't think many will get travel approval :) 16:11:47 ~28 ... Let me double check. 16:11:57 esker: ^ 16:12:01 jungleboyj: thx 16:12:14 ok good, conversations started. 16:12:35 thingee: I'll add to the etherpad if I can confirm one of our locations... want to validate we can get various IT network types to agree before I do so though... 16:12:51 thingee: 21 16:12:53 esker: yes wifi was lacking at the last meetup 16:12:54 good beer should be an ingredient in the weighing function for this decision 16:12:56 They tend to be rather intractable about things... 16:13:04 tbarron: +2 16:13:10 tbarron: +A 16:13:12 we all had to tether to jungleboyj's phone 16:13:16 tbarron: +2/A 16:13:23 :) 16:13:24 Ft. Collins has many breweries... :) 16:13:32 * jungleboyj sighs 16:13:35 +1 16:13:39 Hey, it worked. 16:13:42 jungleboyj: How much did you get charged last time? 16:13:44 beer is a weight function, not filter? :) 16:13:45 jungleboyj: never going to let that go. we can laugh about it now 16:13:48 jungleboyj: You pulled it off. 16:13:52 jungleboyj: :) 16:14:01 xyang1: It was all in my plan. :-) 16:14:03 potential NetApp locations I might be able to offer up... Austin, TX, Raleigh, NC, Sunnyvale, CA 16:14:07 They did eventually fix it a few weeks later. 16:14:12 any preferences? 16:14:17 avishay: temperature is the filter 16:14:23 #action to send announcement on dev ML for midcycle meetup planning 16:14:23 winston-d_: :) 16:14:25 I'd like to see the east coast. NC 16:14:28 FWIW, Ft. Collins has the beer thing covered rather well :-) 16:14:29 avishay: they already filtered out PHX for summer 16:14:30 :P 16:14:32 esker: I can find good beer in Austin or Raleigh for sure 16:14:36 :) 16:14:36 #action thingee to send announcement on dev ML for midcycle meetup planning 16:14:40 winston-d_: sounds about right 16:14:42 esker: I hear the NetApp Tel Aviv office is nice, right on the beach 16:14:50 DuncanT: :D 16:15:02 DuncanT: true... beach volleyball at lunch... 16:15:03 DuncanT: I will never get travel approval for that 16:15:07 Haven't been to NC yet. 16:15:15 DuncanT, esker: and it's not too far for me:) 16:15:15 Austin is... not pleasant... in the summer though, right?? 16:15:28 Yeah 16:15:28 DuncanT: neither is tel aviv 16:15:28 DuncanT: this is true 16:15:30 avishay: :-) 16:15:36 NC or CA would be my preference. 16:15:55 #topic OpenStack Liberty Summit Proposals 16:15:57 avishay: for Tel Aviv, can you just walk there? 16:16:03 smcginnis: Or CO again. 16:16:11 #link https://etherpad.openstack.org/p/cinder-liberty-proposed-sessions 16:16:18 Actually, CO would probably be my top preference. 16:16:22 I have listed the number of slots available in each 16:16:27 winston-d_: 10 minute drive 16:16:32 fish bowl, working session, sprints 16:16:42 avishay: nice 16:16:44 HP can host in Fort Collins for sure...I'll look into free beer from the local breweries. 16:16:53 well put the locations on the etherpad 16:16:56 (not kidding about the beer, I've connections) 16:16:57 scottda: ++++1 :) 16:17:00 thingee: what is sprint slot? something like at pycon? 16:17:04 scottda, lol! 16:17:04 CO it is. Hah 16:17:15 LOL 16:17:20 e0ne: it's suppose to be a time for us to actually do work, while everyone is present 16:17:32 :) 16:17:33 * jungleboyj will bring my wifi jammer to even the playing field. ;-) 16:17:40 :) 16:18:03 also we can have talks like we did in paris where we talk about mock, or certain ide's, etc. 16:18:18 it's the slots for everything else basically. 16:18:23 and will last throughout friday 16:18:29 i've missed these talks:( 16:18:31 you can work and drink beer at the same time right ? 16:18:39 jungleboyj: :) 16:18:47 hemna: sure 16:18:48 hemna: sure 16:18:53 ok phew 16:19:05 thingee: are these slots spread out Tuesday - Friday during the summit? 16:19:27 hemna: Heck yeah. 16:19:45 rhe00: that was my understanding yes. So fish bowl is good to get user's opinions and will be the normal larger audience sessions we've had in the past. 16:20:09 thingee: ok 16:20:25 working sessions will be more low key. mainly hashing out internal bits to things users may or may not really care about 16:20:32 it will be a smaller room for sure. 16:20:42 So we have more working sessions than slots proposed. What's the process for selection? 16:21:00 so everyone who proposed a topic, please keep that in mind and move things around if necessary. I think some of the ones under working session have catchy titles 16:21:03 smcginnis: voting! 16:21:03 like live migration 16:21:16 thingee : ok thanks for the clarification knowing diff between fish bowl and sprint was nice 16:21:36 %s/sprint/working session i mean 16:22:06 smcginnis: yeah last time I kind of just discussed each one with people and we merged things, decided on other topics that might be more important to discuss in person and what made sense for the Friday only topics 16:22:29 thingee: Did that work well? Seemed good as an attendee. 16:23:05 smcginnis: yes the friday meetup/sprint thing was a success I thought. The room was packed for Cinder and people could barely hear me 16:23:18 that's going to be addressed this time. because well, people need to hear me. 16:23:20 thingee: Yeah, that room was loud. 16:23:33 Yeah, that was good but the room was not. 16:23:39 it was basically useless in that room. 16:23:50 should have a dedicated room this time 16:24:03 hemna: We should have just started our own party on our side of the room. 16:24:16 bring a keg, boom box. 16:24:17 thingee : have a suggestion; can we merge topics that address the same problem and have a bunch of us who are working on similar problem propose a combined session…i feel that way content of the talk will also be richer and we can cover different problem rather than different varient of smae problem ? 16:24:23 need to bring a bullhorn? 16:24:29 Thought it was fun to watch DuncanT go over and stare at the other group. 16:24:30 vilobhmm1: yes please 16:24:40 jungleboyj: lol 16:25:29 ok so please keep this all in mind and merge, move stuff around. Next meeting we will be finally deciding on things. 16:25:38 ok cool 16:25:41 also leave your name next to a topic so I know who is leading this 16:25:49 and so I can coordinate with you 16:25:57 anyone else want to add something to this? 16:26:00 Seems like some sessions might be good as fishbowl, like: Asyncronous Error Reporting to the end user 16:26:13 #action thingee to start clean up before next Cinder meeting to decide on topics 16:26:24 cebruns: Yeah, that might be a good thougyht. 16:26:29 cebruns: but that's rather technical actually 16:26:30 #action thingee to send reminder the Dev ML on decisions happening next week 16:27:09 winston-d_: Ok - was just judging by the title. 16:27:23 winston-d_: would you benefit from some parts getting user feedback? 16:27:51 winston-d_: There's no point designing the technical side until we know what sort of errors should go, if any 16:28:12 winston-d_: There's never been any agreement at all on that... 16:28:47 I would say getting user feedback and then working out more technical stuff on friday 16:28:49 DuncanT: well, yeah, I have to agree. 16:29:02 thingee : one quick question if we don't get enough fish bowl slots or something like that can the extra slots be moved to proposed working sessions :) 16:29:05 thingee: Are we locked on 5 fishbowls and 8 working? I remember some talk about moving those numbers. 16:29:12 we can still discuss technical stuff at the fish bowl... 16:29:17 entries for fish bowl session 16:29:32 ok 16:29:36 cebruns: yeah, I'll give up some fishbowl sessions if we don't use them 16:29:40 We can also use some of the sprint time to hit things that we don't get to in Working sessions. Right? 16:29:54 vilobhmm1: I could see, but might drive ttx crazy 16:30:12 * ttx is alreday high on steroids 16:30:21 LOL 16:30:25 jungleboyj: +1 16:30:27 haha 16:30:31 sleep deprivation probably 16:30:40 :-) 16:30:44 ttx: get some fish oil :) 16:30:52 jungleboyj: yes 16:30:54 I'll get A BEER NOW 16:31:02 ttx +2 16:31:11 IMHO: probably better to keep fishbowls (as a sign that we want user feedback/input) and make them more technical if needed. 16:31:25 cebruns: +2 16:31:27 the popular word in today's meeting is beer apparently.. 16:31:33 cebruns: +1 16:31:45 thingee: I was noticing that 16:31:46 thingee: We should make it into a drinking game. 16:31:56 LOL - should've brought up mid-cycle last. :) 16:32:14 ok, anything else for this topic? 16:32:15 thingee, what's your point? 16:32:17 :P 16:32:30 * thingee has no point 16:32:31 could the "Volume Migration: Current state and future direction" be moved to a fish bowl session 16:32:57 kmartin: could be conference session 16:33:03 kmartin: Are the problems interface or implementation? 16:33:04 kmartin: I don't see why not. 16:33:24 how about live migration? 16:33:28 DuncanT: I think that is an area that has caused a lot of user confusion. 16:33:38 it in the working session now and I know it a big issue with users 16:34:02 jungleboyj: kmartin: If it's a user issue then moving it sounds sensible 16:34:03 jungleboyj: would you or vincent lead that one (migration)? 16:34:03 and live migration 16:34:25 Also, can I request people try to get their outlines up well before the conference? Analysing a design cold has turned out to be a disaster, year on year 16:34:27 live migration always seems to be in a perpetual state of failure. 16:34:31 winston-d_: Vincent I believe since he has been actively working those issues. 16:34:49 would like to see jgriffith and ameade on the live migration topic 16:35:24 thingee, +1 push live migration was recently added to the gate 16:35:43 ameade: you present? 16:36:16 not sure if the live migration tests were written in a way to have block storage attached 16:36:25 kmartin tests added on the nova side? 16:36:30 jungleboyj: ok 16:36:30 ok, well I'll talk to ameade later about it. 16:36:36 xyang1, yes 16:36:45 winston-d_: Will verify with him. 16:36:50 thingee: ameade has a conflicting mtg today but I'll follow up with him 16:37:09 thingee: I'll follow up with ameade 16:37:11 tbarron: thanks. just would like to see this maybe be a fishbowl instead 16:37:40 and maybe jgriffith can help out since he has a popular blog post about it ;) 16:37:43 thingee: understood 16:37:54 #topic Open Discussion 16:38:14 kmartin: That will involve 2 compute nodes 16:38:36 kmartin: the problem is you have to have multinode to test live-migratoin 16:38:46 kmartin: and we don't have multi-node gate testing currently 16:39:02 as people with block storage transport protocols know... 16:39:11 kmartin: did live-migration break again? I patched Kilo and Juno 16:39:15 jgriffith: Makes sense. I was wondering about it 16:39:17 I believe jogo added this ability recently, I'll look for the patch 16:39:20 kmartin: but that was a couple months ago 16:40:00 kmartin: he's working on it yes, but it's not gating as of yet 16:40:10 kmartin: but I'm still confused, is there a new bug/problem again? 16:40:36 kmartin: NM, I guess I'll just set it up and test it on my side again 16:40:57 ok seems like we have no open discussions 16:41:10 jgriffith, on some backend yes, others work fine 16:41:15 jgriffith: Which did you test with? LVM? 16:41:29 kmartin: xyang1 I tested with LVM and of course SF 16:41:29 thingee, so if no one else has an open topic, I have one. 16:41:35 Ok 16:41:37 hemna: sure 16:41:37 kmartin: xyang1 so iSCSI in general works 16:41:39 jgriffith, thingee : there was a review posted by jgriffith on seperating unit tests under tests/unit so going ahead whats the plan ? we seperate out unit and functional tests or anything else ? 16:41:58 vilobhmm1: yeah, the idea is to split those 16:41:59 vilobhmm1: yeah did that merge yet? 16:42:01 jgriffith, there are a few assumptions that nova makes during live migration that causes failures 16:42:03 vilobhmm1: and add functional tests 16:42:16 vilobhmm1: I have a slew of functional tests to start with once things land 16:42:28 hemna: there are a lot of assumptions :) 16:42:34 nova assumes the target information is always the same for the 2 initiator hosts 16:42:42 hemna: and there are several that I fixed, and others on the Nova team fixed 16:42:58 i think it needs few https://review.openstack.org/#/c/175583/ +2 before it again runs into merge conflict :P 16:43:17 hemna: ummm 16:43:25 it assumes the target portal, ip and lun id are going to be the same between the first host and the 2nd host, when for some arrays, those values will be different 16:43:39 jgriffith : thanks for letting me know 16:43:45 hemna: it's the same volume and we don't do multi-attach so why would it be different? 16:43:56 hemna: the iqn is stored in the Volume DB object 16:44:05 hemna: that shouldn't change that I'm aware of 16:44:14 not all arrays export volumes the same way. it might not even be the same LUN id on the array for host 1 vs. host 2 16:44:22 and in fact it does for 3PAR 16:44:34 hemna: well... they kinda have to :) 16:44:49 * jungleboyj needs to drop. Back on in a little while. 16:44:50 hemna: I mean, unless you go back and recall attach 16:44:50 hemna: can't nova just login instead of doing an additional export? 16:44:54 hemna: For us, everything is different on a different host 16:44:55 hemna: or ensure export 16:45:01 so when nova attaches the volume to the 2nd host, it then tries to detach from the original host, and it can't find the volume to detach 16:45:23 hemna: I'm pretty familiar with how it works and what it does :) 16:45:24 because it's using the information for the destination host (as the BDM has been updated after the destination attach) 16:45:33 hemna: But live migration worked last time we tested it. Broken again? 16:45:33 o/ 16:45:37 hemna: I'm just trying to understand what's broke :) 16:45:40 the bdm information is wrong on detach 16:45:50 hemna: as of when? 16:45:51 anyway, we can take this offline 16:46:05 hemna: was this your open topic? :P 16:46:10 thingee, no 16:46:10 heh 16:46:18 hemna: I thought that was fixed? 16:46:24 xyang1, nope 16:46:25 xyang1: +1 16:46:31 xyang1, we see it today 16:46:40 hemna: that's weird, because it's been tested by multiple people 16:46:49 hemna: Your team tested it in Juno? 16:46:50 hemna: hmm... bummer, ok. I'll test it again 16:47:01 hemna: Maybe broken again? 16:47:12 if the target portal, and lun id is the same from the 2 attaches, it will be fine 16:47:23 xyang1: hemna so FWIW the backport to Juno did finally land. Took a long time, but it landed 16:47:25 if it changes on the 2nd attach, it breaks. 16:47:37 I'll confirm here again today just to make sure. 16:47:48 hemna: your topic? :) 16:47:57 hemna: Are you testing in trunk or another release? 16:48:07 we tested in kilo 16:48:17 haven't tested on truck in a few weeks 16:48:35 thingee, so, how are we going to do CI with os-brick 16:48:36 :P 16:48:53 we need to make sure that when os-brick patches get pushed up to gerrit, that cinder CI tests get fired off 16:49:06 because it affects copy volume <--> image operations against each driver. 16:49:24 I want to make sure that os-brick changes don't break cinder 16:49:57 that's a good question 16:50:05 xyang1, jgriffith: a few defects regarding the identical IQNs and luns issues https://bugs.launchpad.net/nova/+bug/1423772 & https://bugs.launchpad.net/nova/+bug/1288039 16:50:05 Launchpad bug 1423772 in OpenStack Compute (nova) "During live-migration Nova expects identical IQN from attached volume(s)" [Medium,Confirmed] 16:50:05 i think we can do it by manually pulling in the cinder patch that remove's brick and uses os-brick 16:50:06 Launchpad bug 1288039 in OpenStack Compute (nova) "live-migration cinder boot volume target_lun id incorrect" [High,Confirmed] - Assigned to Bartosz Fic (bartosz-fic) 16:50:44 asselin, do we need to always have Depends-On: ASDASD131231231 in commit messages for os-brick? 16:50:53 not sure if that does anything though for CI 16:51:02 kmartin: thanks. We'll test again 16:51:07 hemna, I don't think that's sufficient b/c the cinder code won't use it 16:51:34 ok 16:51:44 hemna, oh, you mean the os-brick patch has depends-on cinder patch that removes brick? 16:51:51 I'd like to get it ironed out before my cinder patch to remove cinder/brick lands 16:51:59 asselin, no 16:51:59 hemna, that may work 16:52:31 asselin, I just want a way to kick off 3rd party CI tests on os-brick patch submissions 16:52:32 jgriffith,seems that are making progress on multi-node gate https://review.openstack.org/#/c/173614/ & https://review.openstack.org/#/c/141530/ two that landed might be more 16:52:42 but make cinder use the os-brick patch as part of the tests. 16:52:54 to make sure that 1) Cinder doesn't break and 2) drivers don't break. 16:53:36 yes...I think my 1st proposal would work: run ci on each os-brick patch. then in cinder, for that job, cherry pick the cinder patch removing os-brick. 16:53:50 assumes no cherry pick conflicts 16:54:08 asselin, is this something that we can do w/o making every 3rd party CI vendor do? 16:54:24 and by we, I mean...cinder or infra ? 16:54:51 hemna, yes...maybe good to see if we can get an infra job on it 16:55:01 5 minute warning 16:55:01 and any 3rd party ci who's interested 16:55:36 well every 3rd party driver IS interested whether they know it or not :) 16:56:17 hemna: +1 16:56:21 ok I'm not sure I'm understanding how it can be done just yet 16:56:33 hemna: lets talk about it later today 16:56:37 but I'm just concerned. os-brick's tests are simple right now. they are just unit tests and pep8 16:56:45 just sounds like another project to run against for me and should be added as a CI req at some point 16:56:45 thingee, ok please. 16:56:46 yes, let's take it offline 16:57:05 anything else from anyone? 16:57:48 oh in case people didn't notice, os-brick 0.1.0 was tagged. issues with the job to make the pypi release happen. I'll be checking with infra later when things aren't hectic 16:58:05 I'll also be approving more cinderclient changes today to get ready for the next tag release 16:58:19 which includes version discovery! 16:58:34 and backwards compat. messy stuff 16:58:36 :)! 16:58:53 thanks everyone 16:58:55 #endmeeting