Wednesday, 2012-06-06

*** dolphm has joined #openstack-meeting00:01
*** maoy has joined #openstack-meeting00:02
*** matwood has quit IRC00:15
*** johnpostlethwait has quit IRC00:18
*** dwcramer has joined #openstack-meeting00:19
*** dolphm has quit IRC00:20
*** jdurgin has quit IRC00:25
*** dendrobates is now known as dendro-afk00:27
*** dendro-afk is now known as dendrobates00:29
*** joearnold has joined #openstack-meeting00:37
*** joearnold has quit IRC00:40
*** somik has quit IRC00:40
*** gyee has quit IRC00:41
*** littleidea has joined #openstack-meeting00:43
*** dolphm has joined #openstack-meeting00:49
*** martine has joined #openstack-meeting00:51
*** dolphm has quit IRC00:58
*** joearnold has joined #openstack-meeting01:06
*** littleidea has quit IRC01:10
*** dendrobates is now known as dendro-afk01:19
*** ryanpetrello has joined #openstack-meeting01:23
*** maoy has quit IRC01:29
*** bencherian has quit IRC01:36
*** adjohn has quit IRC01:43
*** dolphm has joined #openstack-meeting02:02
*** danwent has quit IRC02:03
*** joearnold has quit IRC02:11
*** Mandell has quit IRC02:11
*** dolphm has quit IRC02:14
fcojj02:19
pvok02:28
*** PotHix has quit IRC02:38
*** novas0x2a|laptop has quit IRC02:46
*** mnewby has quit IRC02:50
*** gongys has joined #openstack-meeting02:52
*** littleidea has joined #openstack-meeting02:52
*** Zhang has joined #openstack-meeting02:53
*** Zhang is now known as Guest3837902:53
*** zhhuabj has joined #openstack-meeting02:55
*** s0mik has joined #openstack-meeting02:55
*** dolphm has joined #openstack-meeting03:00
*** blamar has joined #openstack-meeting03:00
*** martine_ has joined #openstack-meeting03:02
*** ewindisch_ has joined #openstack-meeting03:03
*** LinuxJedi_ has joined #openstack-meeting03:04
*** devcamca- has joined #openstack-meeting03:05
*** ewindisch has quit IRC03:05
*** devcamcar has quit IRC03:05
*** LinuxJedi has quit IRC03:05
*** ewindisch_ is now known as ewindisch03:05
*** martine has quit IRC03:05
*** edygarcia has joined #openstack-meeting03:06
*** ewindisch_ has joined #openstack-meeting03:09
*** ewindisch has quit IRC03:09
*** ewindisch_ is now known as ewindisch03:09
*** blamar has quit IRC03:10
*** dolphm has quit IRC03:13
*** littleidea has quit IRC03:13
*** littleidea has joined #openstack-meeting03:15
*** joearnold has joined #openstack-meeting03:15
*** garyk has quit IRC03:16
*** dwcramer has quit IRC03:18
*** novas0x2a|laptop has joined #openstack-meeting03:19
*** ywu has quit IRC03:22
*** anderstj has joined #openstack-meeting03:25
*** garyk has joined #openstack-meeting03:27
*** troytoman-away is now known as troytoman03:37
*** zhhuabj has quit IRC03:44
*** Guest38379 has quit IRC03:44
*** danwent has joined #openstack-meeting03:44
*** johnpostlethwait has joined #openstack-meeting03:56
*** jgriffith_away is now known as jgriffith04:00
*** s0mik has quit IRC04:10
*** mnewby has joined #openstack-meeting04:12
*** dolphm has joined #openstack-meeting04:23
*** Mandell has joined #openstack-meeting04:25
*** martine_ has quit IRC04:26
*** dolphm has quit IRC04:28
*** anderstj_ has joined #openstack-meeting04:32
*** anderstj has quit IRC04:32
*** s0mik has joined #openstack-meeting04:33
*** joearnold has quit IRC04:36
*** s0mik has quit IRC04:40
*** jgriffith is now known as jgriffith_away04:44
*** edygarcia has quit IRC04:48
*** troytoman is now known as troytoman-away05:02
*** johnpostlethwait has quit IRC05:02
*** littleidea has quit IRC05:02
*** bencherian has joined #openstack-meeting05:09
*** danwent has quit IRC05:24
*** anderstj_ has quit IRC05:31
*** adjohn has joined #openstack-meeting05:36
*** adjohn has quit IRC05:37
*** sleepsonthefloor is now known as sleepsonzzz05:38
*** s0mik has joined #openstack-meeting05:50
*** s0mik has quit IRC05:53
*** mikal has quit IRC06:13
*** mikal has joined #openstack-meeting06:14
*** Mandell has quit IRC06:17
*** markmc has left #openstack-meeting06:19
*** ravi has joined #openstack-meeting06:21
*** ryanpetrello has quit IRC06:45
*** ravi has quit IRC06:48
*** bencherian has quit IRC06:56
*** ttrifonov_zZzz is now known as ttrifonov07:11
*** garyk has quit IRC07:14
*** novas0x2a|laptop has quit IRC07:18
*** novas0x2a|laptop has joined #openstack-meeting07:19
*** garyk has joined #openstack-meeting07:40
*** mnewby has quit IRC08:56
*** mikal has quit IRC09:25
*** derekh has joined #openstack-meeting09:49
*** mikal has joined #openstack-meeting09:54
*** dolphm has joined #openstack-meeting10:21
*** ehm has joined #openstack-meeting10:38
*** nijaba has quit IRC10:44
*** nijaba has joined #openstack-meeting10:46
*** dolphm has quit IRC10:47
*** sandywalsh_ has joined #openstack-meeting10:53
*** sandywalsh has quit IRC10:54
*** markvoelker1 has joined #openstack-meeting10:59
*** jaypipes has quit IRC11:10
*** dolphm has joined #openstack-meeting11:23
*** dolphm has quit IRC11:27
*** martine has joined #openstack-meeting11:45
*** milner has joined #openstack-meeting11:45
*** milner has quit IRC11:46
*** dwcramer has joined #openstack-meeting11:55
*** littleidea has joined #openstack-meeting12:02
*** martine_ has joined #openstack-meeting12:08
*** martine has quit IRC12:11
*** littleidea has quit IRC12:15
*** milner has joined #openstack-meeting12:40
*** milner has quit IRC12:41
*** milner has joined #openstack-meeting12:41
*** dwcramer has quit IRC12:46
*** garyk has quit IRC12:52
*** ncode has joined #openstack-meeting12:57
*** martine_ has quit IRC13:00
*** ayoung has joined #openstack-meeting13:04
*** sandywalsh has joined #openstack-meeting13:13
*** littleidea has joined #openstack-meeting13:14
*** sandywalsh_ has quit IRC13:14
*** garyk has joined #openstack-meeting13:15
*** ryanpetrello has joined #openstack-meeting13:30
*** jgriffith_away is now known as jgriffith13:39
*** dwcramer has joined #openstack-meeting13:40
*** gongys has quit IRC13:41
*** Mandell has joined #openstack-meeting13:44
*** nikhil_ has joined #openstack-meeting13:46
*** nikhil_ is now known as Guest7457613:46
*** edygarcia has joined #openstack-meeting13:49
*** jmeredit has joined #openstack-meeting13:50
*** GheRivero_ has joined #openstack-meeting13:55
*** LinuxJedi_ is now known as LinuxJedi13:58
*** krtaylor has quit IRC14:02
*** garyk has quit IRC14:03
*** jmeredit_ has joined #openstack-meeting14:16
*** jmeredit has quit IRC14:16
*** jmeredit_ is now known as jmeredit14:16
*** krtaylor has joined #openstack-meeting14:18
*** jmeredit has quit IRC14:19
*** jmeredit has joined #openstack-meeting14:19
*** jmeredit has left #openstack-meeting14:19
*** davidkranz has quit IRC14:43
*** garyk has joined #openstack-meeting14:44
*** nijaba has quit IRC14:45
*** davidkranz has joined #openstack-meeting14:45
*** blamar has joined #openstack-meeting14:45
*** lloydde has joined #openstack-meeting14:46
*** bencherian has joined #openstack-meeting14:46
*** nijaba has joined #openstack-meeting14:48
*** nijaba has quit IRC14:48
*** nijaba has joined #openstack-meeting14:48
*** blamar_ has joined #openstack-meeting14:50
*** blamar has quit IRC14:51
*** blamar_ is now known as blamar14:51
*** garyk has quit IRC15:05
*** edmc has joined #openstack-meeting15:06
*** anderstj has joined #openstack-meeting15:06
*** jakedahn is now known as jakedahn_zz15:07
*** anderstj has quit IRC15:08
*** ryanpetrello has quit IRC15:09
*** ryanpetrello has joined #openstack-meeting15:09
*** mnewby has joined #openstack-meeting15:10
*** jgriffith has quit IRC15:12
*** jgriffith has joined #openstack-meeting15:13
*** danwent has joined #openstack-meeting15:16
*** rnirmal has joined #openstack-meeting15:18
*** Mandell has quit IRC15:20
*** joearnold has joined #openstack-meeting15:28
*** littleidea has quit IRC15:37
*** milner has quit IRC15:38
*** littleidea has joined #openstack-meeting15:39
*** milner has joined #openstack-meeting15:39
*** milner_ has joined #openstack-meeting15:39
*** milner_ has quit IRC15:40
*** dolphm has joined #openstack-meeting15:41
*** Gordonz has joined #openstack-meeting15:43
*** milner has quit IRC15:43
*** Gordonz has joined #openstack-meeting15:44
*** milner has joined #openstack-meeting15:44
*** garyk has joined #openstack-meeting15:49
*** jakedahn_zz is now known as jakedahn15:51
*** markmcclain has joined #openstack-meeting15:51
*** bencherian has quit IRC15:56
*** renuka has joined #openstack-meeting15:57
*** sleepsonzzz is now known as sleepsonthefloor15:57
*** dolphm has quit IRC15:59
jgriffithWeekly cinder meeting time... anybody here today?16:00
renukahere16:01
jgriffithrenuka: Hey there16:01
jgriffith#startmeeting16:01
openstackMeeting started Wed Jun  6 16:01:38 2012 UTC.  The chair is jgriffith. Information about MeetBot at http://wiki.debian.org/MeetBot.16:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:01
jgriffithFolks are typicall a bit late so we'll give them a few minutes16:02
jgriffithrenuka: how did the meetup go?16:02
renukasure16:02
*** clayg has joined #openstack-meeting16:02
renukajgriffith: it was good, i think... I may have had more beginners than we expected16:02
claygo/16:03
*** rnirmal_ has joined #openstack-meeting16:03
jgriffithNow we're getting somewhere :)16:03
renukajgriffith: Here's my slides if anyone finds them useful http://www.slideshare.net/aptegetusername/openstack-cinder16:04
sleepsonthefloorhello!16:04
*** rnirmal has quit IRC16:04
*** rnirmal_ is now known as rnirmal16:04
jgriffithrenuka: Very cool, thanks!16:04
jgriffithsleepsonthefloor: Howdy16:04
jgriffithOk, we've got a descent turn out today so let's get started16:05
jgriffith#topic status16:05
*** openstack changes topic to "status"16:05
jgriffithThe past week has been really good thanks to a lot of help from sleepsonthefloor16:05
jgriffithCurrently he's ben able to use the cinder service in devstack16:05
*** ewindisch_ has joined #openstack-meeting16:05
*** rnirmal has quit IRC16:06
*** ewindisch has quit IRC16:06
jgriffithThis includes creating a volume and attaching it16:06
*** ewindisch_ is now known as ewindisch16:06
*** rnirmal has joined #openstack-meeting16:06
jgriffithThere's a bunch of work in Draft status right now in both the client and in nova16:06
jgriffithI think by the end of the week we should be ready to push these out16:07
jgriffithsleepsonthefloor: Do you want to mention anything about the keystone work you're doing now?16:07
sleepsonthefloorjgriffith: sure - we need to do a little tweaking to the keystone middleware to pass a service catalog...16:07
sleepsonthefloorthis will allow services like nova to know where to find services like cinder16:08
sleepsonthefloorright now, we are hard-coded to find cinder at 127.0.0.116:08
*** Gordonz_ has joined #openstack-meeting16:08
sleepsonthefloorin the long run, glance and quantum should also use the catalog to find their respective services, I believe16:09
sleepsonthefloor(right now they are defined in flags)16:09
sleepsonthefloorshould have that today16:09
*** s0mik has joined #openstack-meeting16:09
jgriffithExcellent!16:09
jgriffithThat might change my strategy a bit...16:09
claygI thought when nova-api was serving the openstack/volumes api - it already required an entry in the service catalog for python-novaclient16:09
clayg^ same for glance16:09
uvirtbotclayg: Error: "same" is not a valid command.16:09
renukasleepsonthefloor: (pardon my ignorance) but why can't they continue to be flags? or are we combining some amount of cleanup with this?16:10
sleepsonthefloorclayg: yes that is the service catalog is returned to the nova client yes, but that information is not readily available in nova16:11
*** Gordonz has quit IRC16:11
claygsleepsonthefloor: ah yes, I see your point, nova flags define where glance is... same thing for now for cinder16:11
*** s0mik has quit IRC16:11
sleepsonthefloorrenuka: I mention that as an aside, that would not be a cinder-related change16:12
renukasleepsonthefloor: gotcha16:12
jgriffithsleepsonthefloor: So we could still use a flag for "which" volume service to use and then the catalogue to figure out where/how to connect if it's cinder yes?16:12
sleepsonthefloorclayg: when nova validates a token, keystone does not return the service catalog associated with the token - need some tweaking to make that happen16:12
sleepsonthefloorjgriffith - yes16:13
jgriffithsleepsonthefloor: Or more accuratley which volume_api to use16:13
sleepsonthefloorjgriffith: I think we would stick with the flag for which volume.api16:13
claygare their any relevant nova patches needed with devstack c/7042 - or is everything mostly already in nova and cinder master16:14
jgriffithsleepsonthefloor: Sounds good16:14
sleepsonthefloorclayg: yes there are several16:14
claygi didn't see them in renuka's awesome slides (thanks renuka!)16:14
renukaI remember there was some talk in the summit before last about how we should "expose" a volume to a host only when an attach request comes in, for better security... have we planned for that in any way?16:14
renukaclayg: sure :)16:15
sleepsonthefloorclayg: there are patches for devstack + cinder + cinder client + nova and soon to be keystone16:15
jgriffithrenuka: I think with having the service outside of nova that's going to happen by default16:15
claygI think cinder could choose do to the export in initialize_connection instead of create_volume, nova-compute would have all relevant info when making the initialze call16:16
jgriffithclayg: exactly16:16
claygsleepsonthefloor: ok, well if you can get a list of working patches that I should be testing - I can help test16:17
sleepsonthefloorclayg: great - I will do that one sec16:17
jgriffithrenuka: clayg Vishy wrote up the steps... #link http://etherpad.openstack.org/cinder-worksheet16:17
renukajgriffith: right, but if we need to use keystone for the auth, do we need to do anything special?16:17
claygjgriffith: ok, I'll need to go through that then - thanks16:17
jgriffithrenuka: You mean in terms of the connection info etc?16:18
renukajgriffith: yes16:18
jgriffithrenuka: The work sleepsonthefloor is doing now covers it I believe16:19
renukajgriffith: IIRC that was the proposal, to have some auth at that stage, so if anyone were to hack into a compute server, they cannot take over all the storage16:19
jgriffithrenuka: there's still a risk for attached/connected volumes16:20
jgriffithI don't know how we fix that yet16:20
jgriffithI don't recall the discussion at the last summit, or the proposal... maybe you could elaborate on it?16:21
*** letterj has joined #openstack-meeting16:22
sleepsonthefloorclayg: http://etherpad.openstack.org/jDMBYz4VKp16:22
claygso it looks like the cinder-worksheet is sorta "pre" sleepsonthefloor's patches (share rpc, db, etc.)16:22
claygsleepsonthefloor: perfect16:22
jgriffithclayg: Yeah, that worksheet is kinda "dead"16:23
jgriffithclayg: but it has some of the initial thoughts/descriptions that might be useful16:23
jgriffithclayg: going forward we wanted to use blueprints/bugs, the worksheet was really just initial stages16:23
claygI think i was kinda up to speed to that point (I may have even seen that before), I'll update sleepsonthefloor's new sheet if I have anything to note.16:24
jgriffithclayg: sounds good16:24
renukajgriffith: This was the session: http://essexdesignsummit.sched.org/event/ce1dee155c9b9c62d395d001ff8e0ae4  ... I don't know much of it myself, I just remembered the proposal, so was curious16:24
jgriffithrenuka: Ok, thanks...  quick glance;16:25
letterjHi.   I would like to ask a couple of questions.16:26
*** s0mik has joined #openstack-meeting16:26
jgriffithI think that by having the attach go through the cinder service via token might address this16:26
claygrenuka: I was in that meeting - I think the generally folks felt that it would be an improvement, but still had some holes.  I don't think the presenters ever submitted patches.16:26
jgriffithrenuka: I'll have to read it more closely later and see16:26
renukacool16:26
jgriffithletterj: Sure, are they related to current topic?16:26
jgriffithletterj: If not, maybe wait til we finish status discussion?16:27
letterjok,16:27
jgriffithSo we sort of medled status and outstanding items...16:28
jgriffithDoes anybody have anything to add/ask about current status or shall we got to specific outstanding items?16:29
jgriffiths/got/go/16:29
jgriffithAlright, let's talk about the things left for F216:29
jgriffith#topic Items for F216:29
*** openstack changes topic to "Items for F2"16:30
jgriffithWe already mentioned that patches and pieces that sleepsonthefloor is working on16:30
jgriffithThe other significant thing is some refactoring in the ec2 side of the house16:30
jgriffithI'm working on this and should have it ready end of day today or tomorrow16:31
jgriffithMostly right now it's a matter of making the tests work16:31
jgriffithec2's creat_volume should just call into the cinder api and "work" without too much hassle16:32
jgriffithWe got most of the direct db calls factored out when we did the uuid migration so that's good16:32
claygjgriffith: I don't really see how eucatools are going to work with ec2 and ebs provided by seperate services - is this a requirement for F2?16:32
jgriffithclayg: I wanted to have a functional replacement for nova-volume for f216:33
jgriffithclayg: depending on the interpreter that may or may not include eucatools16:33
*** edygarcia has quit IRC16:34
*** cdub has quit IRC16:34
jgriffithclayg: But I don't see why they wouldn't just point to the cinder api instead of todays volume.api?16:34
jgriffiththe cinder API is a full abstraction so...16:34
jgriffithwhat am I missing?16:35
*** cdub has joined #openstack-meeting16:35
claygjgriffith: I guess I don't see why either - I'm not eucatools expert, but I would have assumed if it was working - it was routing all requests (create & attach) through the nova-compute-api16:35
jgriffithclayg: ahhh16:35
jgriffithclayg: No, it goes to both nova-compute-api and nova-volume-api16:35
claygI don't think the client will be smart enough to make create to cinder then attach to nova, so nova (or whoever is providing ec2 compat) will have to re-route requests to the appropriate service)16:35
jgriffithclayg: Yeah, but in most places it's already doing that today16:36
claygjgriffith: ok16:36
jgriffithIt's seperated fairly nicely between the api's16:36
jgriffithclayg: could be that I just haven't stumbled across the section that blows up in my face yet16:37
jgriffithwe'll see16:37
jgriffithif eucatools isn't ready by f2 I think that will be ok, but it's going to take away from what we can do for f3 etc16:37
*** joesavak has joined #openstack-meeting16:39
jgriffithAnything else on f2 action items?  Anybody see anything they want to work on?16:39
jgriffith#topic outstanding reviews16:40
*** openstack changes topic to "outstanding reviews"16:40
jgriffith#link https://review.openstack.org/#/q/status:open+cinder,n,z16:40
jgriffithNot too much here, I think the jekins issues should be fixed so I'll resubmit I5cd73a2516:41
claygsleepsonthefloor: get the big stuff first - https://review.openstack.org/#/c/8073/10/nova/volume/api.py,unified16:41
clayg:)16:41
jgriffithclayg: :)16:41
jgriffithclayg: That and the other "big" one are still drafts16:42
sleepsonthefloorclayg: :)16:43
jgriffithI need: #link https://review.openstack.org/#/c/8076/16:43
claygjgriffith: that's all just pep816:43
clayg?16:44
jgriffithYeah, so then when the drafts are ready we'll be set16:44
jgriffithThe other one that failed jenkins I think I can just go in and +2/a it again and jenkins will try it again16:45
jgriffithclayg: I know it seems irrelevant, but there are a few things in draft or in personal branches that will be showing up "soon"16:45
jgriffithclayg: Plus, doesn't do us much good if we can pass jenkins pep8 tests16:46
jgriffiths/can/can't/16:46
claygno it's fine, I'm checking it out now16:46
*** anderstj has joined #openstack-meeting16:47
jgriffith#topic unassigned blueprints16:47
*** openstack changes topic to "unassigned blueprints"16:47
*** edygarcia has joined #openstack-meeting16:47
*** edygarcia has quit IRC16:47
claygsleepsonthefloor: I'm I missing a patch that would show where nova acctually uses volumes/cinder.py?16:47
sleepsonthefloorclayg - ah yes, I may have to push a few more devstack changes16:48
sleepsonthefloorI'll update the devstack patch in a few mins16:48
jgriffith#link https://blueprints.launchpad.net/cinder16:49
sleepsonthefloorjust need volume_api_class=nova.volume.cinder.API16:49
jgriffithOk, so we've got a number of things here, just wanted to do the weekly check to see if anybody wanted to sign up for any of these?16:49
jgriffithAlso need to add one for snapshots...16:50
jgriffithhttps://bugs.launchpad.net/nova/+bug/100886616:50
uvirtbotLaunchpad bug 1008866 in nova "Creating volume from snapshot on real/production/multicluster installation of OpenStack is broken" [Undecided,New]16:50
sleepsonthefloorclayg - updated16:51
sleepsonthefloorhttps://review.openstack.org/#/c/7042/16:51
jgriffithIt would be great if folks see some things here they might be interested in working on.16:52
jgriffithAll the pieces should be in place later this week to start hitting these16:52
*** jakedahn is now known as jakedahn_zz16:52
*** mnewby has quit IRC16:53
jgriffithJust let me know if somebody wants to grab any of these16:53
jgriffith#topic open discussion16:53
*** openstack changes topic to "open discussion"16:53
jgriffithletterj: You had some questions?16:54
*** anderstj_ has joined #openstack-meeting16:54
letterjyes,   I was looking at the api.   Should there be a force-detach16:54
*** joesavak has quit IRC16:55
letterjalso, what is a reserve volume?16:55
*** joesavak has joined #openstack-meeting16:56
*** anderstj has quit IRC16:56
claygletterj: reserve volume is mark volume as attaching16:56
*** mnewby has joined #openstack-meeting16:56
letterjso it's just a status change16:56
jgriffithletterj: detach doesn't need a force, it isn't dependent16:56
renukaletterj: reserve volume is required for a race condition that can arise when multiple simultaneous attaches are called for the same volume16:57
*** edygarcia has joined #openstack-meeting16:57
letterjIf a detach gets stuck in an error state how is that handled?16:58
*** derekh has quit IRC16:58
jgriffithletterj: The detach actually just modifies the columns in the db16:58
jgriffithAre you referring to the compute side possibly?16:58
renukajgriffith: he probably means the operation as a whole, when issued from command line or horizon16:59
renukado we have states in the attach/detach process? i.e. can we say if the attach/detach went through on the compute side? at that point, we can do something on the volumes side of the world17:01
*** blamar has quit IRC17:02
letterjI'm asking about what happens when the states get out of sync.    nova state vs cinder state17:02
*** blamar has joined #openstack-meeting17:02
letterjand there is more clean up to do than just updating a db field.17:02
jgriffithletterj: ahhh... so for example compute thinks it's attached and volumes/cinder thinks it's detached17:03
letterjyes or the other way around17:03
jgriffithletterj: right..17:03
renukawe shouldn't change the state until we get a detach success from compute17:04
jgriffithletterj: I think that definitely needs to be looked at17:04
renukawouldn't that be pretty straight forward?17:04
jgriffithrenuka: Yes, I believe so.  But as he mentions the other diretion is still possible as well17:04
jgriffithBy adding the force option we can recover from either situation17:04
renukawe don't change the state until we get attach success from compute?17:04
*** novas0x2a|laptop has quit IRC17:05
*** novas0x2a|laptop has joined #openstack-meeting17:06
letterjI just asking because there is nothing to handle thing stuck in error-detaching or error-attaching situation in nova currnently except manually hacking17:06
jgriffithletterj: I think I understand where you're coming from17:07
renukaletterj: currently, since we don't use cinder, these states are not very cleanly separated17:07
jgriffithsimilar to the stuck in "creating" problem17:07
sleepsontheflooryeah, was going to say, I think the issues letterj mention may not be cinder-specific17:07
letterjyes sir17:07
jgriffithletterj: It's an existing problem and yes it needs to be addressed17:07
jgriffithletterj: If there's not a bug perhaps you could file one?17:08
renukaletterj: also, it may not be as simple as force, for example, what if there was an error on the hypervisor side while detaching... not sure how cinder would be able to "force" it... or are you suggesting that we manipulate our db anyway17:08
letterjI filed a bug quite a while ago  https://bugs.launchpad.net/nova/+bug/94438317:08
uvirtbotLaunchpad bug 944383 in nova "There is no way to recover/cleanup  a volume in an "attaching" state" [Medium,Confirmed]17:08
jgriffithletterj: Yeah, sorry just found it17:08
jgriffithso another thought is rather than "force" etc maybe some special recovery actions/functions17:09
claygrenuka: I do think that cinder should be able to destroy the remote connection and update it's db as "available" even if the consumer (nova) can not respond to the users's reqeust17:09
*** dolphm has joined #openstack-meeting17:10
jgriffithclayg: But there's a problem here because we "don't know" what the actual state is17:10
renukaclayg: what if detach has actually failed and the volume is still attached to the instance on the compute host?17:10
jgriffithclayg: renuka so if we run with a force we catch the exception for the invalid state and just perform the steps anyway maybe17:11
claygrenuka: I can cirtainly see that possibility, but it would be nice if you could still request cinder to break down the connection.17:11
*** Mandell has joined #openstack-meeting17:12
claygrenuka: I think the more likely case would nova says it's attached (host still has a connection) but the guest no longer sees the volume.17:13
renukahmm ok I agree with "needs some thought" because any inconsistency here could lead to corrupting a users data... e.g. attaching the volume to more than 1 instance where it is possible17:13
renukaalso billing, because cinder thinks it is detached, while the user still has access to it17:13
*** dolphm has quit IRC17:14
claygI would imagine most storage providers are going to bill on volumes that exist and take up space regardless of attached/in-use status17:15
claygI don't think cider should allow a "second attachment" even if nova *does* thinkg it's not in use.17:15
jgriffithclayg: I agree on the second attachment, unless it's an attach to the same instance_uuid17:16
letterjOne other case I can think of is that if the guest goes away for what ever reason you might want to perform a detach locally in cinder without tying it to a nova transaction.17:16
edmcClassic "split brain" problem… only solution is a common/shared arbitration mechanism (e.g. a "third vote")17:17
renukaok so we're talking of "cleanup" rather than force detach by the looks of it? maybe we need an admin api to purge any bad connections?17:17
jgriffithrenuka: That was my thought earlier, rather than force some api call that does sync/cleanup or whatever we decide to call it17:18
letterjIf things don't work correctly "cleanup" will usually be required17:18
claygrenuka: I think the problem exists outside of cleanup, and has value to end-users - particularlly when the client is something besides nova.  In the case where cinder recieves a "foricibly terminate any remote connections for the volume" message - if nova supports it - we could warn them we're doing it.17:18
jgriffithbut takes the point from edmc and does a compare of sorts17:18
jgriffithclayg: That could be "part" of the cleanup no?17:19
jgriffithclayg: ie they run a terminate and it fails, now they need to run cleanup17:19
jgriffithmy point here is if you want to do it correctly/safely the implementation looks the same regardless of what you call it17:20
claygjgriffith: yes, if they can.  If not - we can still expose a force_detach to make the volume available - _regardless_17:20
jgriffithif it's a force-detach or a cleanup17:21
*** johnpostlethwait has joined #openstack-meeting17:21
letterjBut I also think nova is gong to have to have something like this as well as cinder17:21
renukaclayg: why does this need to be user facing?17:21
jgriffithOk, so we're all in agreement that there's an issue here that needs to be addressed17:21
letterjCool.  Thanks for taking my question.17:22
claygrenuka: Who else but the user can say if the volume should or should not be attached to an instance?17:23
renukaI have a quick question... you can get back to me with the answer17:23
renukaclayg: the user can say detach of course... in case of an error, we either invoke cleanup automatically or as some kind of purge daemon process... why should the user be involved with the force?17:24
*** danwent has quit IRC17:24
*** danwent has joined #openstack-meeting17:25
renukaSo as for my question, next thursday, at the Openstack meetup, we were trying to get the attendees to do an end-to-end feature, something that is super simple, but touches most of the stack17:25
renukaif anyone has any low-hanging-fruit kind of feature suggestions, please send me an email17:25
claygrenuka: if the client (nova) never sent cinder the detach command - we don't know what the user wants.  So the cleanup all falls to nova.  Which I think is less than ideal.17:25
DuncanTWow, massive meeting! Sorry I'm (ridiculously) late17:26
sleepsonthefloorrenuka: see https://github.com/cloudbuilders/simple_horizon_plugin and https://github.com/cloudbuilders/simple_nova_extension17:26
renukasleepsonthefloor: thanks17:27
jgriffithOk, one last question to throw out17:27
jgriffithclayg asked about why attach/detach etc is an extension and not core api17:28
claygapparently all I do is sit around and pontificate the nature of attach and detach all day17:28
*** markmcclain has quit IRC17:28
jgriffithMy thought was extension because we may use cinder for "other things" and these could look differently depending17:28
jgriffithclayg: :)17:28
renukahahaha17:28
*** markmcclain has joined #openstack-meeting17:29
DuncanTattach/detach are the only parts (so far) that have to get their hands dirty dealing with nova17:29
jgriffithdoes anybody have any strong opinions/thoughts around this? besides clayg :)17:29
jgriffithDuncanT: connection info as well17:29
DuncanTBut connection info is an opaque action, still completely within cinder, yes? Attach is the first time the hypervisor in involved?17:30
*** edygarcia has joined #openstack-meeting17:31
renukai think logically, connection info is "more core" than attach, by DuncanT's reasoning17:31
letterjI agree with clay on the attach/detach issue17:31
claygto clarify (hopefully), I had thought that almost any backend for cinder would want a notification on attach and detach (if for nothing else but book keeping in cinder) - so why not make it core17:31
claygintialize_connection/terminate_connection would work find in this context - whatever the core api wants to call them17:32
*** GheRivero_ has quit IRC17:32
jgriffithjust FYI I currently have no real preference on this whatsoever, just wanted feedback from everybody else17:33
renukaIt would be nice to have a good reason why they should not be core, if we decide to make them extensions17:34
jgriffithrenuka: so they're already implemented as extensions thanks to sleepsonthefloor17:35
claygjgriffith: I'm ok with sleepsonthefloor's current patch and appreciate all of his hard work of course, but at somepoint it'd be nice to have a clean core api that make sense in multiple context.17:35
jgriffithSo part of this also just stems from how vish laid it out in the worksheet17:36
renukaperhaps we need vish's opinion then17:36
vishyhello?17:36
claygwhoa17:36
renukaoh cool.. i was going to suggest question for mailing list :)17:37
*** bencherian has joined #openstack-meeting17:37
jgriffithvishy: So the question is attach/detach and connection info being core api versus extension17:37
vishyjgriffith: so initialize_connection / terminate_connection should be core imo17:38
vishyattach/detach reserve/unreserve i'm not so sure about it.17:38
*** dolphm has joined #openstack-meeting17:39
vishyattach/detach should probably be generalized into just metadata17:39
claygboom17:39
vishyreserve/unreserve possibly could be to if we can force atomic metadata updates somehow17:39
*** edygarcia_ has joined #openstack-meeting17:41
jgriffithclayg: does this work for you?17:41
claygjgriffith: yeah, sounds like it's a longer term plan, but maybe before f-final we could have init/term in CORE?17:42
*** letterj has left #openstack-meeting17:43
claygspeaking of f-final - when does nova-compute-volume-extensions get removed?  when does nova-volume-api get deprecated?17:43
*** edygarcia has quit IRC17:44
*** edygarcia_ is now known as edygarcia17:44
*** lloydde has quit IRC17:44
vishyclayg: if we have feature parity by f-2 we replace it17:44
vishyduring f-317:45
claygso there's no deprecation period?  upgrading from essex to folsom is migrating from nova-volumes to cinder?17:45
jgriffithclayg: That's what I'm hoping for17:48
jgriffithWe're way over today17:48
jgriffitheverybody good for now, or should we hash some more of this out?17:49
*** dwcramer has quit IRC17:50
jgriffithOk, thanks everyone!17:50
jgriffith#endmeeting17:50
*** openstack changes topic to "OpenStack meeting channel. See http://wiki.openstack.org/Meetings for schedule and http://eavesdrop.openstack.org/meetings/openstack-meeting/ for meeting logs"17:50
openstackMeeting ended Wed Jun  6 17:50:22 2012 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:50
claygI'm good, pleanty of stuff to look at - thanks all!17:50
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-06-16.01.html17:50
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-06-16.01.txt17:50
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack-meeting/2012/openstack-meeting.2012-06-06-16.01.log.html17:50
jgriffiththanks clayg !!17:50
vishyclayg: that depends.  We will send out an email to the ml when we have finished feature parity and migration and switch the default17:50
vishyclayg: if there is need for it, we will leave the code in for f deprecated17:51
claygvishy: ok, reasonable as always - but what about the poor volume extensions - rip those out sooner yeah?17:51
vishyclayg: I think we can probably pull the volume extensions for sure17:52
vishyclayg: afaik everyone is using the volume api now17:52
vishyclayg: we have to leave the attach extension in though obviously.17:52
*** troytoman-away is now known as troytoman17:54
claygvishy: yeah, maybe rip out and trim it down to just attach at the same time17:56
*** milner_ has joined #openstack-meeting17:56
*** milner has quit IRC17:58
*** edmc has quit IRC17:58
*** littleidea has quit IRC18:00
*** edmc has joined #openstack-meeting18:01
*** gyee has joined #openstack-meeting18:02
*** dwcramer has joined #openstack-meeting18:03
*** novas0x2a|laptop has quit IRC18:06
*** PotHix has joined #openstack-meeting18:15
*** hggdh has quit IRC18:18
*** zigo has joined #openstack-meeting18:20
*** hggdh has joined #openstack-meeting18:21
*** oubiwann1 is now known as oubiwann18:23
*** renuka has quit IRC18:26
*** s0mik has quit IRC18:26
*** adjohn has joined #openstack-meeting18:32
*** novas0x2a|laptop has joined #openstack-meeting18:35
*** s0mik has joined #openstack-meeting18:35
*** s0mik has quit IRC18:35
*** s0mik has joined #openstack-meeting18:37
*** glenc has quit IRC18:45
*** glenc has joined #openstack-meeting18:51
*** oubiwann has quit IRC18:52
*** edygarcia has quit IRC18:57
*** oubiwann has joined #openstack-meeting18:57
*** edygarcia has joined #openstack-meeting19:14
*** gyee has quit IRC19:15
*** clayg has left #openstack-meeting19:37
*** edygarcia has quit IRC19:39
*** edygarcia has joined #openstack-meeting19:39
*** zigo has quit IRC19:43
*** bencherian has quit IRC19:53
*** adjohn has quit IRC19:54
*** markmcclain has quit IRC19:57
*** nati_ueno has joined #openstack-meeting19:59
*** LinuxJedi is now known as review-dev20:03
*** review-dev is now known as LinuxJedi20:03
*** derekh has joined #openstack-meeting20:05
*** dwcramer has quit IRC20:14
*** markmcclain has joined #openstack-meeting20:30
*** nati_uen_ has joined #openstack-meeting20:32
*** nati_ueno has quit IRC20:36
*** ttrifonov is now known as ttrifonov_zZzz20:37
*** dwcramer has joined #openstack-meeting20:42
*** mnaser has joined #openstack-meeting20:44
*** mnaser has joined #openstack-meeting20:44
*** joearnold has quit IRC20:45
*** dolphm has quit IRC21:01
*** gyee has joined #openstack-meeting21:02
*** adjohn has joined #openstack-meeting21:04
*** bencherian has joined #openstack-meeting21:04
*** s0mik has quit IRC21:05
*** nati_uen_ has quit IRC21:07
*** nati_ueno has joined #openstack-meeting21:08
*** s0mik has joined #openstack-meeting21:12
*** s0mik has quit IRC21:13
*** s0mik has joined #openstack-meeting21:14
*** s0mik has quit IRC21:14
*** s0mik has joined #openstack-meeting21:18
*** rnirmal has quit IRC21:18
*** ewindisch has quit IRC21:29
*** mattray has joined #openstack-meeting21:32
*** jgriffith has quit IRC21:35
*** edygarcia_ has joined #openstack-meeting21:36
*** edygarcia has quit IRC21:39
*** edygarcia_ is now known as edygarcia21:39
*** derekh has quit IRC21:54
*** matwood has joined #openstack-meeting21:58
*** dwcramer has quit IRC21:59
*** joesavak has quit IRC22:01
*** nati_uen_ has joined #openstack-meeting22:01
*** joearnold has joined #openstack-meeting22:02
*** jgriffith has joined #openstack-meeting22:04
*** nati_ueno has quit IRC22:05
*** Guest74576 has quit IRC22:11
*** mnaser has quit IRC22:12
*** s0mik has quit IRC22:15
*** matwood has quit IRC22:18
*** ywu has joined #openstack-meeting22:22
*** markmcclain has quit IRC22:22
*** edygarcia_ has joined #openstack-meeting22:23
*** blamar has quit IRC22:26
*** edygarcia has quit IRC22:26
*** edygarcia_ is now known as edygarcia22:26
*** s0mik has joined #openstack-meeting22:28
*** ywu has quit IRC22:29
*** edygarcia_ has joined #openstack-meeting22:40
*** edygarcia has quit IRC22:43
*** edygarcia_ is now known as edygarcia22:43
*** s0mik has quit IRC22:45
*** s0mik has joined #openstack-meeting22:46
*** nati_uen_ has quit IRC22:47
*** nati_ueno has joined #openstack-meeting22:48
*** s0mik has quit IRC22:49
*** ncode has quit IRC22:49
*** mattray has quit IRC22:51
*** jakedahn_zz is now known as jakedahn22:55
*** zul has quit IRC23:03
*** zul has joined #openstack-meeting23:05
*** joearnold has quit IRC23:06
*** anderstj_ has quit IRC23:06
*** s0mik has joined #openstack-meeting23:08
*** s0mik has quit IRC23:09
*** mattray has joined #openstack-meeting23:19
*** mattray has quit IRC23:19
*** s0mik has joined #openstack-meeting23:19
*** dwcramer has joined #openstack-meeting23:20
*** mnaser has joined #openstack-meeting23:24
*** troytoman is now known as troytoman-away23:31
*** markmcclain has joined #openstack-meeting23:35
*** edygarcia has quit IRC23:35
*** nati_uen_ has joined #openstack-meeting23:36
*** nati_ueno has quit IRC23:39
*** mnaser has quit IRC23:48
*** arosen1 has quit IRC23:57
*** ywu has joined #openstack-meeting23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!