16:00:03 #startmeeting Cinder 16:00:04 Meeting started Wed Jul 15 16:00:03 2015 UTC and is due to finish in 60 minutes. The chair is thingee. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:05 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:07 Howdy 16:00:08 The meeting name has been set to 'cinder' 16:00:10 Hi! 16:00:14 hi everyone 16:00:18 Hi 16:00:20 Hi folks. 16:00:20 o/ 16:00:20 hi 16:00:25 hi 16:00:28 #topic announcements 16:00:30 hi 16:00:32 Hello! 16:00:40 hello 16:00:47 Hello everyone.. 16:00:54 Hello 16:00:59 hi 16:01:02 hi 16:01:08 o/ 16:01:14 #info hemna is continuing with the brick switch in nova, please help and review! 16:01:17 #link https://review.openstack.org/#/c/175569/ 16:01:30 o/ 16:01:35 Hello 16:01:47 #info Nova patches in flight for multi-attach support, please help and review! 16:01:48 hi 16:01:50 #link https://etherpad.openstack.org/p/liberty-volume-multiattach 16:01:51 hi 16:02:00 hi 16:02:02 hi 16:02:03 hi 16:02:17 #info Propose your topics for the Cinder Midcycle meetup! 16:02:19 #link https://etherpad.openstack.org/p/cinder-liberty-midcycle-meetup 16:02:27 you should see the header with "topics" 16:02:36 o/ 16:02:46 #action thingee to mention this in the mailing list 16:02:48 yo 16:03:00 o/ 16:03:03 o/ 16:03:07 o/ 16:03:21 #info apache/nginx support in cinder api will be approved assuming no objections this week 16:03:23 #link https://review.openstack.org/#/c/192683/6 16:03:43 #info clone consistency group spec will be approved this week assuming no objections 16:03:45 #link https://review.openstack.org/#/c/194834/4 16:03:50 thingee: thank you 16:04:13 #info incremental backup enhancement spec will be approved this week assuming no objections 16:04:17 #link https://review.openstack.org/#/c/187926/8 16:04:22 thingee: thanks 16:04:42 #info os-brick 0.3.0 will be released this week 16:05:04 +1 16:05:14 nice 16:05:16 Cool 16:05:17 #info cinderclient 1.3.1 is released with version discovery removed 16:05:18 thingee, thanks 16:05:29 alright lets get started! 16:05:35 One other announcement in case folks don't keep up on the mailing list: M release == Mitaka now. 16:05:36 Agenda for today https://wiki.openstack.org/wiki/CinderMeetings#Next_meeting 16:05:45 smcginnis: yes thank you :) 16:06:00 Wow. 16:06:19 * jgriffith starts a pool on whether it changes again :) 16:06:20 so I moved scottda's topic up because he has to cut out early 16:06:27 #topic Cinder <-> Nova API fixes Update 16:06:29 scottda: hi 16:06:32 HI 16:06:32 smcginnis: Was so hoping for Musashi! 16:06:33 Sounds Japanese. 16:06:37 #link https://etherpad.openstack.org/p/CinderNovaAPI 16:06:51 I vote for Miku. 16:06:54 jungleboyj: Might get there yet. ;) 16:07:03 So, I'm trying to corral all the info, bugs, design ideas, work in this etherpad... 16:07:19 Actually they all sound the same to me. :-) 16:07:28 jungleboyj: Me too 16:07:35 scottda, I still have some work on my TODO list for this, mostly regarding live migration 16:07:38 I've put some goals, just my ideas. Please comment if they seem crazy or if you can think of other goals that involve fixing cinder-nova 16:07:49 I've listed ~20 bugs. 16:07:51 scottda, I'm going to document the drivers that have potential problems with initialize_connection 16:08:05 Not an exhaustive list, just that I got exhausted from searching. 16:08:11 hemna: Add me to your list. :) 16:08:19 I've put some design ideas and questions.... 16:08:28 Please add and comment to that if you are interested. 16:08:36 #action scottda is corral all the bugs, design ideas in etherpad https://etherpad.openstack.org/p/CinderNovaAPI 16:08:36 scottda: appreciate your efforts 16:08:37 smcginnis, heh ok. yah live migration is still a mess due to several things, but mostly because of how nova is calling cinder in some cases. 16:08:44 scottda: wondering if we could take a small step back maybe. 16:08:47 I think I'll put out a survey on design ideas prior to the mid-cycle 16:08:49 scottda: so first, awesome job!!! 16:08:51 sure jgriffith 16:09:00 scottda: really great details and info here 16:09:17 scottda: but I twinge a little when I see things like "assumptions are wrong" 16:09:21 scottda: about "xyz" 16:09:43 scottda: the reason being is that we have never clearly defined these things to say who's right/wrong 16:09:43 * scottda is looking for that part 16:09:55 makes sense jgriffith 16:10:10 I think one goal is to clearly define the API 16:10:20 scottda: I'm wondering if we should start by proposing what the flow "should" be form Cinder's point of view (and in some cases why) 16:10:21 having spent a great deal of time looking at this myself, nova is making some assumptions about cinder, what it can call and when, that just happen to not work for everyone. 16:10:32 hemna: and there it is again :) 16:10:43 yes, there it is again. 16:10:54 I've been spending a great deal of time on this the last few weeks. 16:11:07 That's Goal #4 jgriffith , but I don't necessarily care about the ordering. 16:11:16 scottda, +1 16:11:19 hemna: My point is rather than continuing to just say "nova makes assumptions", lets define what we want these interfaces to do/mean 16:11:30 jgriffith: +1 16:11:34 scottda: yes... so if I can finish :) 16:11:36 jgriffith, sure, that's always been our plan 16:11:42 scottda: if possible I would like to have a rough idea of a timeline based on volunteers what we can commit to in liberty 16:11:49 but I think what we had to do first is understand what nova is doing right now and why it doesn't work. 16:11:59 scottda: I think it would be ideal and much easier for all of us to help out here if we started by defining the interface/s 16:12:01 first, jgriffith please finish.. 16:12:14 scottda: of course not this entire list, but some movement instead of us coming with yet another etherpad on this subject. 16:12:27 thingee: LOL 16:12:55 scottda: so what I was trying to ask.... do *you* see any benefit in starting out by laying out the definition of the calls/interface first? 16:13:01 scottda: that wasn't meant to come across what you're doing is a waste of time. I just want some people to commit to some work here. 16:13:04 scottda: then proceeding from there? 16:13:22 Sure. I figured that after gathering input we would discuss this at the mid-cycle. 16:13:34 scottda: fi we did that, then I *think* it would be fairly easy to go forth and conquer 16:13:57 you have to understand the problem points first before you can propose solutions. 16:13:59 I imagine that there will be enough contention on things that we won't be able to come to consensus without being (mostly) face-to-face 16:14:02 scottda: ahh.. yeah, I suppose that's not so far into the future at this point 16:14:12 hemna: You have to have a definition to start IMHO 16:14:12 scottda: I'm assuming we have communicated anything in the nova meetings yet because of how much yet has been defined? 16:14:26 thingee: correct 16:14:31 johnthetubaguy: ^ 16:14:50 I had hoped that post-midcycle we'd have some concrete plan and consensus to take to Nova 16:15:24 so do reach out to me, if/when you want to get things reviewed in Nova, will do my best to make that happen for you 16:15:24 scottda: Ok, that makes sense. Honestly it might be late for L to make changes in Nova... but I'd be curious depending on what we come up with how much we could just fix up on the Cinder side anyway 16:15:38 johnthetubaguy: Great, I/we will do. 16:15:39 scottda: but anyhow, that's a completely different disucssion 16:15:52 scottda: Thanks for listening to me 16:15:56 alright so who is going to lay out the the definitions of the calls/interfaces? 16:15:59 jgriffith: +1, see what we can do, then prep for M in nova. 16:16:04 I think it will take >= 2 cycles for all this to change (nova and cinder) 16:16:18 I think it's 2 separate things at this point. 1) what can we do short term to make stuff work for L and 2) what do we do long term to fix the API and interaction. 16:16:23 #info it maybe too late to get changes into Nova at this point, may prep for M 16:16:24 thingee: I'm happy to do a first draft.. then hemna and scottda or anybody else can jump in and shred it up :) 16:16:37 I tried to capture long and short goals under Goals 16:16:46 jgriffith: that would be great 16:16:54 jgriffith: can you commit to that be ready to show at the midcycle? 16:16:56 thingee: I can start it based on what we did in nova-volume when most of those calls were created 16:16:58 trying to get a backlog nova-spec merged before the summit sounds like a good goal for that stuff (and getting a summit session if we don't agree in time) 16:17:03 thingee: yes 16:17:07 jgriffith: thank you! 16:17:14 thingee: wait.. when is the mid-cycle? 16:17:16 johnthetubaguy: +1 to summit session 16:17:17 * jgriffith jokes 16:17:18 jgriffith: haha 16:17:41 jgriffith: Make sure you get your travel arranged. :) 16:17:46 scottda: in a happy world, we will have agreed the plan by then, but if not, yeah, a joint summit session might be a good plan 16:17:55 hemna: short term seems like bug fixes, long term is discussion, docs, and mid-cycle wrangling over issue IMO 16:18:01 scottda, +1 16:18:05 #action jgriffith will write a first draft of defining call/interface 16:18:05 smcginnis: LOL... funny thing is I do have to do that... I'll be traveling all the week before ;) 16:18:09 jgriffith will travel by horse 16:18:20 :) 16:18:23 scottda, leeantho and I have been working hard on the bug fix side for live migration at least. it's a mess. 16:18:31 scottda: that sounds good 16:18:33 tbarron: +1 16:18:58 just tie him to his saddle after he visits microbreweries ... 16:19:00 scottda: great anything else? 16:19:03 Cool. Please comment wildly in the etherpad on the big stuff, i.e goals and design 16:19:09 that's it. Thanks all. 16:19:21 #topic Volume Migration Improvement has made some progress 16:19:24 vincent_hou: hi 16:19:26 o/ 16:19:29 Hi 16:19:44 I have a quick update with all cinder folks. 16:19:44 #info volume status management is waiting for comments 16:19:47 #link https://review.openstack.org/#/c/186312/ 16:19:58 I made some progress in the volume migration for L. 16:20:02 #info migration status management waiting for comments 16:20:04 #link https://review.openstack.org/#/c/189614/ 16:20:25 Have got 2 patches submitted for cinder . one for client. one for tempest. 16:20:29 #info tempest tests 16:20:29 #link https://review.openstack.org/#/c/195443/ 16:20:38 #info cinder client changes 16:20:38 #link https://review.openstack.org/#/c/189547/ 16:20:39 You are welcome to download them and try them. 16:21:02 I love you folks' comments BTW. 16:21:39 The volume has a better status and migration status management, with the migration progress. 16:21:45 :-) 16:22:00 vincent_hou: great! 16:22:17 Tempest can check if the retype/migration work among any drivers, if you configure two backends. Any back-end! 16:23:05 Cinder client can help you to check the migration status and progress if available. 16:23:26 vincent_hou: great thanks 16:23:35 vincent_hou: great for your much work. 16:23:36 anyone have objections they'd like to raise with some of this progress? 16:23:59 vincent_hou: Thanks for your work on this! 16:24:08 vincent_hou: Thank you very much! 16:24:39 ok with that then... 16:24:51 #topic Add Fujitsu ETERNUS DX Volume Driver (again) 16:24:59 Fdaisuke: hi 16:25:07 #link https://review.openstack.org/#/c/201500/ 16:25:13 I'm here 16:25:27 thingee: hi 16:25:34 Fdaisuke: are you aware of previous openstack mailing list posts about this subject? 16:26:07 My question is, if it was dropped in Kilo, why wasn't this addressed prior to L1 instead of waiting until now? 16:26:26 smcginnis: maybe they didn't know it was dropped :) 16:26:26 smcginnis: +1 on your question 16:26:27 yes, I understand the deadline was already past. 16:26:45 jgriffith: :) We should probably talk about that one too. 16:27:07 smcginnis: indeed :) 16:27:16 Fdaisuke: we also have other vendors with drivers removed in K, that didn't make the cut in L-1. It wouldn't really be fair for us to make an exception here. 16:27:25 Fdaisuke: but this was communicated well ahead of time http://lists.openstack.org/pipermail/openstack-dev/2015-May/064072.html 16:27:42 so, we planned re-merging of our driver for L, assuming the deadline would be l-3 as it was k-3. 16:28:23 thingee, when was the driver removed? K ? 16:28:34 We couldn't fit our schedule to it as there're a lots of stuff to do such as purchasing new servers, assign people, etc. 16:28:43 hemna: Yep 16:29:03 smcginnis, then I'd say, they missed the L deadline. M isn't that far away. 16:29:05 Fdaisuke: so I'm going to tell you what I tell everyone in this situation. You have priorities, and so does the community. Vendors don't define the timelines here, the community does. I absolutely welcome you to join the community and participate in these discussions so they're not a surprise. 16:29:15 hemna: +1 16:29:43 thingee: ++ 16:29:53 thingee: +1 16:29:58 hemna: thingee +1 to both of you 16:31:56 Fdaisuke: the cinder community working towards this effort has been known for almost two years now. Things really being defined in a long email i sent in January 2015. This being a timing issue at this point is not really a good excuse. 16:32:42 Fdaisuke: http://lists.openstack.org/pipermail/openstack-dev/2015-January/054614.html 16:33:08 Fdaisuke: Try to stay more with the cinder community. IRC, Mail list, etc. 16:33:52 thingee: do you have those links on your copy area? :P impossible to find that so fast 16:34:13 erlon: I do certain finds from the archive page of the mailing list. 16:34:26 erlon: trust search engine and your memory ;) 16:34:48 Fdaisuke: I'm going to move on from this topic, but please start making preparations for M. 16:34:54 thingee: Would be good to spend a few minutes talking at the meetup about how to find stuff in the mailing list. :-) 16:35:10 winston-d_: I would have to rely on the search engine, my memory is a disaster 16:35:12 #topic Move cinderclient-dsvm-functional job to (non)voting queue 16:35:15 e0ne: hi 16:35:22 thingee: hi 16:35:28 so mtreinish explained I'm crazy here for proposing this for a meeting topic 16:35:31 I agree 16:35:41 so any strong objections with this? 16:35:47 LOL 16:35:56 heh 16:35:56 quick topic:) 16:36:02 thingee: the part about the job, or you being crazy? 16:36:03 :) 16:36:04 thingee: heh, I think we can all agree to blame jgriffith and move on :) 16:36:11 #info job stats 16:36:13 #link 16:36:13 http://graphite.openstack.org/render/?width=877&height=548&_salt=1436533755.887&from=00%3A00_20150524&until=23%3A59_20150715&target=stats.zuul.pipeline.experimental.job.check-cinderclient-dsvm-functional.FAILURE&target=stats.zuul.pipeline.experimental.job.check-cinderclient-dsvm-functional.SUCCESS&target=stats.zuul.pipeline.experimental.openstack.python-cind 16:36:13 erclient.total_changes&title=check-cinderclient-dsvm-functional 16:36:14 +A on both motions 16:36:17 dang it 16:36:30 #info review request 16:36:32 #link https://review.openstack.org/#/c/200522/ 16:36:42 +1 16:36:50 thingee: rebase an I'm good with it for sure!! 16:36:54 err... e0ne 16:36:57 excellent! 16:37:06 #agreed rebase and merge it! 16:37:12 i've updated change request 16:37:17 * jgriffith was just waiting for rebase 16:37:34 DuncanT: ++ 16:37:34 jgriffith: done 16:37:42 e0ne: me too :) 16:37:46 e0ne: anything else? 16:37:55 thingee: no, thank you 16:37:58 thingee: got that link from me? ;P 16:38:10 it was too quickly for me 16:38:12 it's a bit long, though... 16:38:12 flip214: link? 16:38:17 oh 16:38:20 graphite.openstack.org/render... 16:38:27 flip214: https://wiki.openstack.org/wiki/CinderMeetings#Next_meeting 16:38:30 flip214: last item 16:38:38 #topic open discussion 16:38:42 no problem 16:38:57 Blueprints for driver changes? 16:39:00 thingee: I've got a couple things :) 16:39:11 jgriffith: you have the floor 16:39:20 thingee: thanks! 16:39:24 so first.. replication V2 16:39:31 me too, id like to discus about our HBSD2 CI status 16:39:44 I put a POC up to try and give a clearer picture of what was in the spec 16:39:55 * jungleboyj is excited! 16:39:56 https://goo.gl/eTNPrb 16:40:20 #info replication v2 16:40:24 #link https://review.openstack.org/#/c/155644/ 16:40:37 So most of the comments are detail things... but a couple bigger ones 16:40:57 well... not really big ones; the auto-failover thing 16:41:04 everybody agree on just leaving that out for now? 16:41:19 yea 16:41:22 +1 16:41:28 i think the initial version of this doesn’t really need it, right? 16:41:30 jgriffith: +1 16:41:32 +1 16:41:33 and anybody have any glaring objections to the current direction? 16:41:37 y 16:41:49 One question that came up fro me when doing this was (well couple questions): 16:41:53 jgriffith, +1 16:41:53 +1 16:42:17 1. The existing V1 stuff... just replace it's API calls and reuse them, or keep them and make it a config option to fall back for a deprecation period? 16:42:17 jgriffith: Still need to actually review closely. 16:42:20 #agreed auto-failover isn't needed in the initial version 16:42:28 jgriffith: please reference this when needed ^ 16:42:32 :) 16:42:39 can I close https://bugs.launchpad.net/cinder/+bug/1298135 ? anyone affected by that? 16:42:39 Launchpad bug 1298135 in Cinder "Cinder should handle token expiration for long ops" [Medium,Confirmed] - Assigned to j_king (james-agentultra) 16:42:39 thingee: :) 16:43:02 the other question I had.... 16:43:18 Haven't read that spec since it first came out. Will take another look. 16:43:39 Config versus just using update_targets? 16:43:44 j_king: We're affected by it, not looked at the implied trusts stuff yet 16:43:56 Swanson: sorry.. forget the spec.... just look at this: https://review.openstack.org/#/c/200269/ 16:44:09 IMO it's easier to get an idea from that than the spec 16:44:23 on opinions on the two questions there? 16:44:34 jgriffith: thanks! 16:44:35 j_king: we met this issue few times 16:44:38 jgriffith: sorry not familiar to comment 16:44:38 Yayyy! /me has full liberty :) 16:44:54 jgriffith: more info on config vs. update_targets? 16:45:02 or is it too much detail to go into? 16:45:12 jgriffith: As far as leaving an option to go back to V1 and having an option. I think we want to just move forward with V2. I know Tao and Ronen are looking at the impact on the existing code right now but their first impression is that we can move forward pretty easily. 16:45:14 dannywilson: so initially I thought "use config file to specify replication targets to a driver" 16:45:23 dannywilson: ++ 16:45:30 DuncanT: I have some ideas/code I can put into a WIP review but it looks like it might not work without some help from keystone folks. 16:45:33 dannywilson: but then I wrote a little code that introduced an "add_target" method to the api 16:45:43 making the config file seem somewhat pointless 16:45:56 j_king: DuncanT do you mind waiting till I finish this topic? 16:46:01 sure. 16:46:06 sure 16:46:06 or have your side conversation elsewhere? 16:46:31 dannywilson: so using the API is trivial IMO 16:46:35 jgriffith: add_target would be called on a per volume basis? 16:46:47 dannywilson: no, it would be called for a backend 16:47:04 dannywilson: specify valid secondary configs via that call 16:47:20 dannywilson: then it's up to you to set up which (or all) via type specification 16:47:31 dannywilson: which can be auto-handled by driver, or explicit or whatever you want 16:47:47 dannywilson: but my main goal here is to remove as much of the vendor unique stuff from the main code 16:47:48 jgriffith: gotcha 16:47:56 so is the thought here that there would also be api’s to change the targets, list them, etc? 16:48:02 and leave most of the burden on the driver, rather than the proper cinder code 16:48:06 thingee: Thanks for the comments. We might sounded like we're not aware of all the announcements in the past, but we're :) Since our driver is not completely new one, we thought we could find a chance to discuss it for Liberty inclusion. 16:48:14 patrickeast: yes... admin API's 16:48:21 gotcha 16:48:31 patrickeast: and only two... "list" and "update" 16:49:10 patrickeast: dannywilson please see: https://review.openstack.org/#/c/200269/1/cinder/volume/manager.py L#2737 16:49:24 jgriffith: +1 for apis, makes it easier to change as well (though that probably doesn't happen often) 16:49:26 patrickeast: I don't have the list method in there though 16:49:53 dannywilson: Hope not, but regardless at least there' s no downtime or restart of services to make a change 16:50:12 jgriffith: right 16:50:21 I guess nobody has looked at this yet, so we can table the conversation for now 16:50:37 DuncanT: j_king all yours 16:50:47 Oh.. no, wait 16:50:49 jgriffith: solved it out of band. :) 16:50:49 one other thing :) 16:50:56 j_king: cool! 16:51:04 Blueprints for driver changes? Like, say, mine? https://review.openstack.org/#/c/199631/ 16:51:25 * jgriffith puts on flame retardant suit! 16:51:28 https://review.openstack.org/#/c/201812/ 16:51:30 Swanson: Added it as a midcycle meeting topic to discuss bps and bugs. 16:51:30 jgriffith: Will be on it ASAP. 16:51:55 I don't want to take up meeting time arguing and trying to justify, but happy to have a conversation in channel 16:52:14 and explain the rationale in more detail as well as pros/cons etc 16:52:32 which could lead to an updated commit message 16:53:02 Can we talk about the HBSD2 CI status? 16:53:10 real quick 16:53:19 erlon: sure 16:53:52 so, our CI was disabled, we had it turn off due a bug we where working 16:54:30 after a power failure, we bring up the machine, and it stated to post failure status into gerrit 16:55:08 as, the change has just being merged, we needed it enabled again to test against the new patch 16:55:42 erlon: I do think you were disabled too quickly. There are certainly others that deserve it more. 16:56:14 anteaya: Anita asked to talk to you guys to ask her to re-enable it 16:56:40 smcginnis: yep, surely, I not even notice that 16:56:45 erlon: I'll look at the stats 16:57:17 thingee: you mean the stats of this CI? 16:57:52 erlon: I'll look at the announce third party list 16:57:57 anything else from anyone? 16:58:02 thingee: ok 16:58:05 2 minute warning. 16:58:18 #endmeeting