Wednesday, 2016-03-16

*** baojg has quit IRC00:01
*** yangyapeng has quit IRC00:03
*** gouthamr has joined #openstack-manila00:22
*** openstack has joined #openstack-manila00:26
*** gouthamr has quit IRC00:27
*** mtanino has quit IRC00:28
openstackgerritdaiki kato proposed openstack/python-manilaclient: Fix typos  https://review.openstack.org/29318200:29
openstackgerritGoutham Pacha Ravi proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311300:31
*** erlon has quit IRC00:37
*** eharney has quit IRC00:37
*** docaedo has quit IRC00:55
*** docaedo has joined #openstack-manila01:01
*** david-lyle has joined #openstack-manila01:04
*** yangyapeng has joined #openstack-manila01:10
*** Yogi1_ has joined #openstack-manila01:12
*** yangyapeng has quit IRC01:22
*** gouthamr_ is now known as gouthamr01:23
*** yangyapeng has joined #openstack-manila01:24
*** docaedo has quit IRC01:24
*** cknight has joined #openstack-manila01:29
*** docaedo has joined #openstack-manila01:31
*** akshai has quit IRC01:33
*** esker has joined #openstack-manila01:37
*** kaisers1 has joined #openstack-manila01:44
*** kaisers has quit IRC01:45
*** baojg has joined #openstack-manila01:59
*** akshai has joined #openstack-manila02:05
*** akshai_ has joined #openstack-manila02:07
*** Yogi1_ has quit IRC02:09
*** Yogi1 has joined #openstack-manila02:10
*** akshai has quit IRC02:10
*** baojg has quit IRC02:17
*** ganso has quit IRC02:19
*** baojg has joined #openstack-manila02:20
*** amrith is now known as _amrith_02:24
openstackgerritMerged openstack/manila: HDS-HNAS: fixed exception when export not found  https://review.openstack.org/29136602:31
*** houming has joined #openstack-manila02:36
*** Yogi1 has quit IRC02:54
*** gouthamr has quit IRC03:06
*** baojg has quit IRC03:08
*** baojg has joined #openstack-manila03:10
*** esker has quit IRC03:11
*** houming has quit IRC03:14
*** houming_ has joined #openstack-manila03:14
*** baojg has quit IRC03:42
*** baojg has joined #openstack-manila03:43
*** akshai_ has quit IRC03:52
openstackgerritGoutham Pacha Ravi proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324303:59
*** esker has joined #openstack-manila04:01
*** cknight1 has joined #openstack-manila04:03
*** cknight has quit IRC04:04
*** esker has quit IRC04:06
*** akshai has joined #openstack-manila04:36
*** cknight1 has quit IRC04:38
*** baojg has quit IRC04:45
openstackgerritzhongjun proposed openstack/manila: Fix the scheduler choose a disable share service  https://review.openstack.org/29324604:54
*** sgotliv has joined #openstack-manila04:57
*** sgotliv has quit IRC05:03
zhongjunbswartz: ping, Could you please tag this bug(#1557854) to RC1? Thanks05:04
*** akshai_ has joined #openstack-manila05:04
*** akshai has quit IRC05:07
openstackgerritMerged openstack/manila: Fix delete when share not found in update_access  https://review.openstack.org/29127905:29
openstackgerritMerged openstack/manila: glusterfs volume layout: take care of deletion of DOA shares  https://review.openstack.org/29217705:29
*** sgotliv has joined #openstack-manila05:30
*** esker has joined #openstack-manila05:33
*** esker has quit IRC05:38
openstackgerritMerged openstack/manila: update quota of origin user on share extend/shrink  https://review.openstack.org/29172505:38
*** sgotliv has quit IRC05:40
*** akshai_ has quit IRC05:44
*** david-lyle has quit IRC05:45
*** david-lyle has joined #openstack-manila05:45
*** yangyape_ has joined #openstack-manila05:56
*** yangyapeng has quit IRC06:00
*** yangyapeng has joined #openstack-manila06:07
*** yangyape_ has quit IRC06:10
openstackgerritzhongjun proposed openstack/manila: Fix the scheduler choose a disable share service  https://review.openstack.org/29324606:18
*** sgotliv has joined #openstack-manila06:18
*** esker has joined #openstack-manila06:49
*** esker has quit IRC06:54
openstackgerritThomas Bechtold proposed openstack/manila: Use sslutils from oslo_service  https://review.openstack.org/28938207:01
*** lpetrut has joined #openstack-manila07:15
*** nkrinner has joined #openstack-manila07:17
*** rraja has joined #openstack-manila07:21
*** esker has joined #openstack-manila07:23
*** esker has quit IRC07:28
*** darkwsh has joined #openstack-manila07:33
*** a_ta has joined #openstack-manila07:33
*** a_ta has quit IRC07:38
*** sgotliv has quit IRC07:38
*** sgotliv has joined #openstack-manila07:42
*** chlong has quit IRC07:42
openstackgerritValeriy Ponomaryov proposed openstack/manila: Fix update of access rules in ZFSonLinux driver  https://review.openstack.org/29328907:44
openstackgerritValeriy Ponomaryov proposed openstack/manila: Fix update of access rules in ZFSonLinux driver  https://review.openstack.org/29328907:46
*** sgotliv has quit IRC07:55
*** lpetrut has quit IRC08:04
openstackgerritdaiki kato proposed openstack/manila: Fix typos  https://review.openstack.org/29330208:17
*** yangyapeng has quit IRC08:23
*** yangyapeng has joined #openstack-manila08:26
*** ig0r_ has quit IRC08:39
*** dalgaaf has joined #openstack-manila08:55
*** yangyapeng has quit IRC08:56
*** esker has joined #openstack-manila09:12
*** esker has quit IRC09:16
*** sgotliv has joined #openstack-manila09:19
*** esker has joined #openstack-manila09:32
*** esker has quit IRC09:39
openstackgerritTom Patzig proposed openstack/manila: service instance: also recognize instance name  https://review.openstack.org/26977709:43
*** openstackgerrit has quit IRC09:53
*** openstackgerrit_ is now known as openstackgerrit09:53
*** openstackgerrit has quit IRC09:53
*** openstackgerrit_ has joined #openstack-manila09:54
*** openstackgerrit_ is now known as openstackgerrit09:54
*** openstackgerrit_ has joined #openstack-manila09:55
*** openstackgerrit has quit IRC09:55
*** openstackgerrit has joined #openstack-manila09:56
*** tpsilva has joined #openstack-manila10:07
openstackgerritMarc Koderer proposed openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051110:09
*** lpetrut has joined #openstack-manila10:09
*** yangyapeng has joined #openstack-manila10:23
mkoderer___tpatzig: dgonzalez: ready for review/test https://review.openstack.org/#/c/290511/1010:23
*** yangyapeng has quit IRC10:23
openstackgerritMarc Koderer proposed openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051110:31
*** a_ta has joined #openstack-manila10:35
*** a_ta has quit IRC10:40
*** ociuhandu has quit IRC10:55
tpsilvavponomaryov: sorry about that :)10:56
openstackgerritTiago Pasqualini da Silva proposed openstack/manila: Fix Hitachi HNAS driver version  https://review.openstack.org/29317511:03
*** esker has joined #openstack-manila11:04
vponomaryovtpsilva: ?11:06
tpsilvavponomaryov: breaking the zfs driver11:06
vponomaryovtpsilva: I +2'ed it personally ))11:06
vponomaryovtpsilva: ><11:06
tpsilvavponomaryov: it happens :)11:06
*** esker has quit IRC11:08
*** merooney has joined #openstack-manila11:12
openstackgerritValeriy Ponomaryov proposed openstack/manila: Make ZFSonLinux driver handle snapshots of replicated shares properly  https://review.openstack.org/29337711:15
*** _amrith_ is now known as amrith11:16
*** merooney has quit IRC11:17
*** openstackgerrit has quit IRC11:18
*** openstackgerrit has joined #openstack-manila11:18
openstackgerritValeriy Ponomaryov proposed openstack/manila: Make ZFSonLinux driver handle snapshots of replicated shares properly  https://review.openstack.org/29337711:21
*** merooney has joined #openstack-manila11:22
*** ganso has joined #openstack-manila11:31
*** amrith has left #openstack-manila11:32
*** erlon has joined #openstack-manila11:44
openstackgerritTom Patzig proposed openstack/manila: service instance: also recognize instance name  https://review.openstack.org/26977711:48
openstackgerritAlexey Ovchinnikov proposed openstack/manila-image-elements: Fix for image name  https://review.openstack.org/29338511:49
openstackgerritMarc Koderer proposed openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051111:52
*** yangyapeng has joined #openstack-manila11:56
*** merooney has quit IRC12:00
openstackgerritAlexey Ovchinnikov proposed openstack/manila: LXC/LXD: Fix for incorrect user handling bug  https://review.openstack.org/29287112:03
*** merooney has joined #openstack-manila12:06
openstackgerritTiago Pasqualini da Silva proposed openstack/python-manilaclient: Reverted fix access rules functional tests  https://review.openstack.org/29339212:11
openstackgerritTiago Pasqualini da Silva proposed openstack/python-manilaclient: Revert fix access rules functional tests  https://review.openstack.org/29339212:12
*** aovchinnikov has joined #openstack-manila12:13
*** a_ta has joined #openstack-manila12:15
openstackgerritTiago Pasqualini da Silva proposed openstack/manila: Fix Hitachi HNAS driver version  https://review.openstack.org/29317512:19
openstackgerritCsaba Henk proposed openstack/manila: glusterfs: Implement update_access() method  https://review.openstack.org/29115112:20
openstackgerritCsaba Henk proposed openstack/manila: ganesha: implement update_access  https://review.openstack.org/28260212:20
openstackgerritTiago Pasqualini da Silva proposed openstack/manila: Fix Hitachi HNAS driver version  https://review.openstack.org/29317512:21
*** a_ta has quit IRC12:22
*** ociuhandu has joined #openstack-manila12:25
*** JoseMello has joined #openstack-manila12:27
*** pcaruana has quit IRC12:28
*** akshai has joined #openstack-manila12:29
*** gouthamr has joined #openstack-manila12:33
*** timcl has joined #openstack-manila12:39
*** merooney has quit IRC12:45
*** cknight has joined #openstack-manila12:49
*** merooney has joined #openstack-manila12:51
*** csaba has quit IRC12:52
gouthamrvponomaryov: ping12:56
vponomaryovgouthamr: pong12:56
*** csaba has joined #openstack-manila12:56
gouthamrhi vponomaryov! the cDOT fix for the snapshot instances bug is here: https://review.openstack.org/#/c/293243/112:56
*** eharney has joined #openstack-manila12:57
gouthamrvponomaryov: i feel like the driver i/fs should be as open as possible for all possible implementations.. given that we don't want the driver to ask the database for these objects..12:58
vponomaryovi/fs?12:58
gouthamrvponomaryov: interfaces12:58
gouthamrvponomaryov: would appreciate your review on that when you have time.12:58
vponomaryovgouthamr: when ZFS part is finished, and now I have there problem12:59
vponomaryovgouthamr: would be great to have list of snapshot instances for "create_replica" method12:59
gouthamrvponomaryov: so that you would be able to send the snapshots immediately?13:00
vponomaryovgouthamr: kind of13:01
gouthamrvponomaryov: we could do that.. what do you think of the amount of information being handed down? :P between ameade and me, the joke is that all of these are becoming sqldumps.13:01
gouthamrvponomaryov: i'm not sure what the best approach is here.13:02
ameade+113:03
*** kaisers1 has quit IRC13:09
*** kro_sinus_hell is now known as krot_sinus_purga13:15
*** krot_sinus_purga is now known as kro_sniffles13:15
*** smcginnis_away is now known as smcginnis13:15
*** merooney has quit IRC13:17
*** kaisers has joined #openstack-manila13:19
*** xyang1 has joined #openstack-manila13:19
mkoderer___gouthamr: vponomaryov: hi, the keystone v3 patch should be fine now https://review.openstack.org/#/c/290511/13:20
mkoderer___feedback is welcome :)13:20
gouthamrthanks mkoderer___.. will take a looj13:22
gouthamrlook*13:22
mkoderer___gouthamr: btw I tried to run netapp-ci but it seems to ignore me13:22
gouthamrmkoderer___: i saw the job running on the netapp-ci.. it's running :)13:23
mkoderer___gouthamr: :) ok fine13:23
gouthamrmkoderer___: will vote in roughly 39 minutes13:23
*** ig0r_ has joined #openstack-manila13:24
mkoderer___gouthamr: ah it already commented to the patch .. fine fine13:25
*** merooney has joined #openstack-manila13:25
gouthamrvponomaryov: create replica only takes model update for the replica.. if we pass snapshot instances through, it would need to take snapshot instance updates too?13:25
*** kaisers has quit IRC13:26
vponomaryovgouthamr: creating replica, I create all source snapshots too13:27
vponomaryovgouthamr: so, I would say yes, we should handles snapshot instances too13:27
gouthamrvponomaryov: in the netapp implementation ameade used the provider location to name snapshots so that all snapshots used the same "name" across replicas. that way, if a new unknown snapshot is being queried in the update_replicated_snapshot call, we just correlate the provider location from any of the other snapshot instances and query for its availability, or initiate an update of the replica so that teh snapshot makes its way and is updated13:28
gouthamr on the next update_replicated_snapshot call13:28
*** kaisers has joined #openstack-manila13:28
*** martyturner has joined #openstack-manila13:28
vponomaryovgouthamr: ok, I will think more and try to workaround13:28
ameadethis could be something we change in newton13:29
gouthamrvponomaryov: sure .. thank you.13:29
gouthamrameade: yes, cknight wanted to know how we can improve the interfaces for these things.. because its a similar problem we may have when we have the generic groups he was proposing13:30
ameadetrue story13:30
gouthamrhaha yes, so lets do it in (fig) newton13:30
* gouthamr thinks this would need wider participation and discussion among other driver developers.. we should speak about it in Austin13:31
*** dustins has joined #openstack-manila13:37
*** porrua has joined #openstack-manila13:46
openstackgerritMerged openstack/manila: Fix update of access rules in ZFSonLinux driver  https://review.openstack.org/29328913:48
openstackgerritMerged openstack/manila: service instance: also recognize instance name  https://review.openstack.org/26977713:49
*** akerr has joined #openstack-manila13:52
*** merooney has quit IRC13:52
*** mtanino has joined #openstack-manila13:54
*** houming_ has quit IRC13:56
*** martyturner has quit IRC13:57
*** merooney has joined #openstack-manila13:58
*** merooney has quit IRC13:58
*** merooney has joined #openstack-manila13:58
*** a_ta has joined #openstack-manila14:00
*** Yogi1 has joined #openstack-manila14:01
*** martyturner has joined #openstack-manila14:01
openstackgerritDustin Schoenbrun proposed openstack/manila: Add common capabilities matrix to devref  https://review.openstack.org/28850414:02
openstackgerritAlex Meade proposed openstack/manila: NetApp cDOT: Fix status updates for replicas  https://review.openstack.org/29180314:03
openstackgerritYogesh proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311314:03
*** timcl has quit IRC14:04
*** timcl has joined #openstack-manila14:08
*** absubram has joined #openstack-manila14:11
*** absubram_ has joined #openstack-manila14:12
*** absubram has quit IRC14:15
*** absubram_ is now known as absubram14:15
*** baojg has joined #openstack-manila14:31
openstackgerritMerged openstack/manila: Fix HNAS snapshot creation on deleted shares  https://review.openstack.org/29180614:38
*** absubram has quit IRC14:40
*** absubram has joined #openstack-manila14:43
*** merooney has quit IRC14:51
openstackgerritRodrigo Barbieri proposed openstack/manila: HDS-HNAS: Fix exception in update_access not found  https://review.openstack.org/29135814:51
mkoderer___bswartz: https://bugs.launchpad.net/bugs/1555554 I have a fix for it.. and I would keep the milestone on it14:56
openstackLaunchpad bug 1555554 in Manila "LXC/LXD driver add neutron port binding without checking port state" [Medium,New] - Assigned to Marc Koderer (m-koderer)14:56
*** merooney has joined #openstack-manila14:56
mkoderer___for me it's a critical issue that causes race conditions14:56
bswartzmkoderer___: http://lists.openstack.org/pipermail/openstack-dev/2016-March/089522.html14:58
*** timcl has quit IRC15:02
*** mlima has quit IRC15:02
bswartzoh mkoderer___ I see your bugfix doesn't actually touch the driver15:03
bswartzsorry I untargeted all bugs with LXD in the name15:03
bswartzmkoderer___ can you rename the bug please?15:03
*** mlima has joined #openstack-manila15:05
vponomaryovgouthamr: ping15:07
gouthamrvponomaryov: pong15:08
vponomaryovgouthamr: my local testing shows that "share manager" should call "update_replicated_snapshots" right after each creation of replica15:08
openstackgerritMerged openstack/manila: Check share-network in 'share create' API  https://review.openstack.org/25635315:08
vponomaryovgouthamr: if we do not do so, then exists one case when we can get race15:08
gouthamrvponomaryov: it is called on the same interval as the replicas..15:08
vponomaryovgouthamr: exactly, race appears when it is not called yet15:09
gouthamrvponomaryov: what's the race you're seeing?15:09
*** timcl has joined #openstack-manila15:09
vponomaryovgouthamr: here scenario:15:09
gouthamrvponomaryov: i've been testing with setting it as low as possible, 60 seconds.15:09
vponomaryovgouthamr: 1) create share; 2) create snapshot; 3) create replica; 4) promote replica not waiting periodic update; 5) delete old active replica; 6) try delete snapshot15:10
vponomaryovgouthamr: this is the problem, we should call it after each creation of share15:10
vponomaryovgouthamr: that's all15:10
vponomaryovgouthamr: on step 6 we will not have "provider_location"15:11
vponomaryovgouthamr: because it was not populated15:11
vponomaryovgouthamr: OR15:11
vponomaryovgouthamr: you can copy "provider location" always for all replicas15:12
vponomaryovgouthamr: then it will be the best15:12
vponomaryovgouthamr: solution, I think15:12
gouthamrvponomaryov: we could do that.. its not exactly a race.. its a known situation.. provider_location is a solution we tried since we name the snapshots the same across replicas on the NetApp backend. what if drivers want the provider location to be different across replicas?15:13
vponomaryovgouthamr: I find it useful too to use exactly "same" value15:13
vponomaryovgouthamr: it is "replicas"15:13
vponomaryovgouthamr: are you aware about cases where replicated snapshots have different names?15:14
vponomaryovgouthamr: completely different?15:14
vponomaryovgouthamr: without any common part?15:14
gouthamrvponomaryov: makes sense, ameade and I did think really hard about this... but then we realized that it is called 'provider' location for a reason.. i.e, drivers would use them how they want.. isn't that correct?15:15
*** david-lyle has quit IRC15:15
*** david-lyle has joined #openstack-manila15:15
gouthamrvponomaryov: not aware of such a situation.15:15
vponomaryovgouthamr: it is called so, because ofcompatibility with Cinder ))15:15
gouthamrvponomaryov: ah15:15
vponomaryovgouthamr: or, at least, you can make it conditional15:16
gouthamrvponomaryov: so we had this workaround in the netapp driver, where we correlate the provider location from the other snapshot instances that are passed in the update call..15:16
vponomaryovgouthamr: when we return some special key, manager should consider it and copy providr locations15:16
*** ociuhandu has quit IRC15:16
gouthamrameade: ^^15:16
vponomaryovgouthamr: see, each driver has such problem, share manager should be updated to solve it for them15:16
gouthamrvponomaryov: i think that's a good idea..15:17
gouthamrvponomaryov: will think about this and ping you in a bit..15:18
vponomaryovgouthamr: I have about 30 min, then I will be available tomorrow15:18
vponomaryovgouthamr: if you agree, it is enough for me15:18
gouthamrvponomaryov: what do you think about the workaround? the driver's getting all the snapshot instances..15:19
vponomaryovgouthamr: "provider location" was the only reason for it in my case15:19
openstackgerritAlexey Ovchinnikov proposed openstack/manila: Revert "LXC/LXD driver"  https://review.openstack.org/29349815:19
vponomaryovgouthamr: if we have at least one proper snapshot instance then it is not required and manager can do its stuff15:20
vponomaryovgouthamr: I suppose same is true for NetApp driver15:21
gouthamrvponomaryov: if you promote a replica where the snapshot instance was in 'creating' state, it will be set to 'error'15:22
vponomaryovgouthamr: why error? gap between "ok" snapshot creation and next update is HUGE15:22
*** ociuhandu has joined #openstack-manila15:23
gouthamrvponomaryov: yes. you're correct15:23
*** Yogi1 has quit IRC15:23
vponomaryovgouthamr: most snapshot creations should be fast15:23
vponomaryovgouthamr: too fast for 60 sec15:23
gouthamrvponomaryov: at this point, if the snapshot is in 'error', the admin would need to be involved to reset the state15:24
vponomaryovgouthamr: it is different story15:24
gouthamrvponomaryov: if the admin can confirm that the snapshot is really there on the share that got promoted15:24
openstackgerritAlexey Ovchinnikov proposed openstack/manila: Revert "Fix pylxd hard dependencies"  https://review.openstack.org/29350315:24
vponomaryovgouthamr: we need set provide location with each new registration of snapshot instance15:24
*** Yogi1 has joined #openstack-manila15:25
vponomaryovs/provide/provider/15:25
gouthamrvponomaryov: okay, ill copy it from the active replica's snapshot instance15:25
vponomaryovgouthamr: what about condition?15:25
gouthamrvponomaryov: but allow drivers to update it to whatever they want in the update_replicated_snapshot call15:25
vponomaryovgouthamr: or leave it for future when driver with unique provider locations appear?15:25
bswartzaovchinnikov: your revert patch wasn't based on master15:25
vponomaryovgouthamr: I am ok with possibility to update15:26
gouthamrvponomaryov: awesome. it will be in the next patch :)15:26
vponomaryovgouthamr: ty15:26
gouthamrvponomaryov: no, thank you!15:26
aovchinnikovbswartz: hmm, it seems there is another patch in the way. does that mean that it should be done manually or it is ok to revert them one by one?15:29
*** david-lyle_ has joined #openstack-manila15:34
*** david-lyle has quit IRC15:34
*** jasonsb has joined #openstack-manila15:37
openstackgerritAlex O'Rourke proposed openstack/manila: 3PAR remove file tree on delete when using nested shares  https://review.openstack.org/29020915:44
*** rraja has quit IRC15:48
openstackgerritAlexey Ovchinnikov proposed openstack/manila: Revert "LXC/LXD driver"  https://review.openstack.org/29352315:48
bswartzaovchinnikov: we should block any further changes that affect LXD but the removal patch should be based master15:51
bswartzbased on master15:51
mkoderer___bswartz: cknight: can I ask for a review on https://review.openstack.org/#/c/290511/15:52
mkoderer___I would really like to get keystone v3 working :)15:52
cknightmkoderer: Sure.  I'm not a Keystone expert, so you might want to find one of those, too.15:53
mkoderer___cknight: good idea... I will ask someone from the keystone team15:53
*** martyturner has quit IRC16:01
*** merooney has quit IRC16:01
*** cknight has quit IRC16:02
*** rraja has joined #openstack-manila16:03
*** baojg has quit IRC16:03
*** martyturner has joined #openstack-manila16:04
*** dustins has quit IRC16:07
*** a_ta has quit IRC16:11
*** a_ta has joined #openstack-manila16:12
openstackgerritMerged openstack/manila: glusterfs/common: don't suppress vol set errors  https://review.openstack.org/28468316:12
*** a_ta has quit IRC16:12
*** a_ta has joined #openstack-manila16:12
*** adrianofr_ has joined #openstack-manila16:18
*** david-lyle_ is now known as david-lyle16:20
*** cknight has joined #openstack-manila16:30
*** timcl has quit IRC16:31
*** timcl has joined #openstack-manila16:49
*** merooney has joined #openstack-manila16:52
*** nkrinner has quit IRC16:54
*** sgotliv has quit IRC16:57
*** merooney has quit IRC17:05
*** lpetrut has quit IRC17:07
cknightganso: ping17:09
gansocknight: pong17:11
cknightganso: It seems I should also submit a patch with ShareResourceNotFound.  https://github.com/openstack/manila/blob/master/manila/share/drivers/netapp/dataontap/cluster_mode/lib_base.py#L105017:13
*** merooney has joined #openstack-manila17:13
gansocknight: ideally yes17:16
*** vbellur has quit IRC17:17
gansocknight: share is deletable with force-delete now17:17
*** a_ta has quit IRC17:18
*** a_ta has joined #openstack-manila17:19
gansocknight: so you can either throw ShareResourceNotFound17:19
gansocknight: or allow error if update_access does not find share in backend17:20
cknightganso: I see, so if the backend resource is gone, I have to issue a force delete.  The way I've done it in my driver, a non-admin can delete a share in that case.  Maybe I'll leave it as-is.17:20
gansocknight: yes, but then your calls to update_access may succeed while your share is gone from backend17:22
*** merooney has quit IRC17:23
*** a_ta has quit IRC17:23
gansocknight: and user will never know because he will not see logs17:24
cknightganso: it's definitely a trade-off.  I was surprised to discover update_access being called in the delete path.  It'd be nice to know in update_access that a delete is in progress, but that might not be simple.17:25
cknightbswartz: ^^ How important is this to you?17:26
*** sage has quit IRC17:27
*** lpetrut has joined #openstack-manila17:28
*** sage has joined #openstack-manila17:29
gansocknight: that's a different solution, it is simple, access helper would swallow exception if status is deleting. But that would also change current behavior of an error being thrown if rules cannot be removed properly when deleting a share (if share is indeed in the backend)17:29
*** jasonsb has quit IRC17:29
cknightganso: I only want to swallow the exception in the driver's update_access if the share is gone and it is about to be deleted.  I don't have enough info do that now.17:31
gansocknight: share['status']?17:32
cknightganso: oh, interesting, perhaps I could look for a 'deleting' status.17:33
cknightganso: thanks, why didn't I think of that?17:33
gansocknight: then again, if you are going to make this change, why not throw ShareResourceNotFound?17:34
cknightganso: The design point in our driver is to not blow up if a user deletes something that is already gone.  It's a corner case, to be sure, but I don't like frustrating users trying to delete stuff.17:35
cknightganso: And I can throw the exception in a non-delete path.17:36
rrajabswartz: hi! what's the deadline for driver doc fixes to make it for mitaka release?17:38
*** johnthetubaguy_ has joined #openstack-manila17:39
*** johnthetubaguy has quit IRC17:41
*** johnthetubaguy_ is now known as johnthetubaguy17:41
*** lpetrut has quit IRC17:43
*** lpetrut has joined #openstack-manila18:05
openstackgerritAlex Meade proposed openstack/manila: NetApp cDOT: Fix status updates for replicas  https://review.openstack.org/29180318:07
openstackgerritAlex O'Rourke proposed openstack/manila: 3PAR remove file tree on delete when using nested shares  https://review.openstack.org/29020918:14
*** martyturner has quit IRC18:14
*** a_ta has joined #openstack-manila18:18
openstackgerritAlex O'Rourke proposed openstack/manila: 3PAR remove file tree on delete when using nested shares  https://review.openstack.org/29020918:18
*** dustins has joined #openstack-manila18:23
*** akshai has quit IRC18:25
*** akshai has joined #openstack-manila18:33
*** vbellur has joined #openstack-manila18:36
*** amit2131 has quit IRC18:55
*** amit213 has joined #openstack-manila18:55
openstackgerritDustin Schoenbrun proposed openstack/manila: Add common capabilities matrix to devref  https://review.openstack.org/28850419:00
dustinstpsilva: ^^ See if that's a little more to your liking :)19:01
bswartztpsilva: ping19:08
tpsilvabswartz: pong19:13
bswartztpsilva: I wanted to talk to you about https://review.openstack.org/#/c/287758/19:14
bswartztpsilva: was going to suggest google hangout but it's still busted19:14
tpsilvabswartz: I'm in a meeting right know, but it should finish in a few minutes... I'll ping you after it finishes, ok?19:16
tpsilvadustins: looks great, thank you!19:16
bswartzk19:17
dustinstpsilva: you're welcome!19:17
*** gouthamr has quit IRC19:23
*** merooney has joined #openstack-manila19:24
*** kro_sniffles is now known as kro_mnckn_doc19:27
tpsilvabswartz: I'm at my desk now19:28
tpsilvabswartz: hangouts is fine for me19:29
*** akshai has quit IRC19:30
bswartzhangouts isn't working19:30
bswartzand I have no idea why19:30
* bswartz is technologically challenged19:30
tpsilvaoh... weird19:30
tpsilvaskype?19:30
bswartzskype seems to be unavailable on fedora19:31
tpsilvabswartz: hm... any ideas? I'm ok with irc as well19:34
bswartzyeah IRC is fine it's just slower19:34
tpsilvayep19:34
*** akerr has quit IRC19:34
bswartzcknight and I were reviewing your patch, and it seems to make thing better than they are now, but it's not immune to race conditions19:35
*** ociuhandu has quit IRC19:35
bswartzI'm trying to decide if we should push for a perfect solution in Mitaka, or if we should take this good solution and continue to iterate in Newton19:36
tpsilvaI agree that it would not be completely immune to race conditions, I just can't think of one right now, but I'm pretty sure there is19:37
bswartzwell my main regret with the current design is that we should not have removed the per-rule status19:37
tpsilvaprobably these 2 statuses for all the rules is not the best approach19:38
tpsilvaexactly19:38
bswartzI think that we need to add that column back in and use it to track for each rule, whether it's been applied or not19:38
cknighttpsilva: The race is this: if the backend sets the rules to ACTIVE after the API layer reads the rule status, the API layer could think they are still out of sync and drop the request.19:38
*** akshai has joined #openstack-manila19:39
bswartztpsilva: I don't think it's a good idea to make DB schema changes this late in the release, and I don't see another way to make this completely reliable19:39
*** gouthamr has joined #openstack-manila19:40
bswartzwe could introduce more states and move the checking from the API to the manager, which would solve some problems19:40
tpsilvawe could block the requests if access_rules_status is out of sync, but this would change the behavior19:41
bswartzno we should never block requests -- that breaks legacy behavior19:41
tpsilvaI mean, disallow any requests to rules if they are not active19:41
tpsilvawhy?19:41
bswartzin the past you could send 100 access allow requests and they would all succeed19:42
tpsilvaoh I see19:42
bswartzwe should preserve that user experience19:42
tpsilvawhat would you suggest? could we somehow lock the update_access_rules method and make sure all the calls come as they were queued?19:44
*** gouthamr_ has joined #openstack-manila19:44
bswartzif the api service changed the rule state to needs_update and the manager changed the rule state to updating, then the manager could simply ignore any RPC calls for shares which were updating19:45
tpsilvabut would that solve the race condition that cknight described above?19:45
bswartzin the design the API service would always send the RPC19:45
bswartzlet me think19:45
bswartzyes because the API service would send the RPC no matter what19:46
cknightit would move any potential race to the manager, but you's still have multiple calls to update_access_rules in parallel19:46
tpsilvayou're right, the manager would make this check to update or not, not api19:46
bswartzso no matter where the manager is in its processing, it will get another RPC telling it to do more work19:46
bswartzthe manager could decide to drop the RPC if it already has pending working to do the update19:47
cknightif you make that change *and* use a lock in the manager, it could be done safely.19:47
bswartzthe key is to use 2 different states19:47
cknightand when we adopt tooz, that would also solve the HA issue19:47
*** gouthamr has quit IRC19:48
cknighta lock is effectively a state, so would you really need 2 states?19:48
bswartzso if the manager starts doing an update, and the API service gets a new request, it changes the state back to needs_update, and the manager sees after it's done that it needs another update19:48
bswartzI'm suggesting a method which would work without tooz, but only with 1 instance of the manager running19:48
bswartzthe moment you have 2 managers handling the same share a different class of issues pops up19:49
cknightRight.  But can we design for both just as easily?19:49
cknightUsing a lock (which later is backed by tooz) would do that, right?19:49
bswartzmany things need to be redesigned to deal with multiple managers19:49
bswartzI don't think it's simple as relying on distributed locking19:50
bswartzdistributed locked in necessary but not sufficient to solve the problem when you have 2 managers19:51
bswartzyou need to handle recover paths when a manager crashes while holding a lock19:51
cknightok, I agree your suggestion will work well with just 1 manager.19:51
cknighttiago, did you understand Ben's solution?19:51
tpsilvaI did, I just got lost when you started talking about multiple managers... didn't know manila allowed that19:52
bswartztpsilva: also, assuming you understood it, is it something that can be done in <24 hours?19:52
cknighttpsilva: you can do it, but there is another class of concurrency issues that can occur19:52
bswartzwe're going to need to start punting bugs and this bug is bad enough that I'll take a good fix over a perfect fix19:52
cknighttpsilva: multiple processes on separate systems can pull from the event queue, so distributed locks would be needed to make it reliable.19:53
bswartztpsilva: yes it's often referred to as Active/Active HA (high availability) and it's something that was intended to work across openstack but it's not tested and there are numerous known issues19:53
cknighttpsilva: people do it anyway, though19:53
tpsilvabswartz: looks like that would not require that much work.. I intent to start working on that early tomorrow19:54
cknighttpsilva: we need it merged tomorrow.  I'll review it as soon as it's available (and I'm awake)19:54
bswartzokay let's leave cknight -1 on it and plan for another patchset19:54
tpsilvaok... it should be up before the meeting19:54
cknighttpsilva: thanks!19:55
*** ig0r_ has quit IRC19:55
tpsilvacknight, bswartz: no problem, thank you for finding these edge cases19:55
*** ociuhandu has joined #openstack-manila19:56
*** merooney has quit IRC20:00
*** mlima has quit IRC20:01
*** timcl has quit IRC20:02
*** sgotliv has joined #openstack-manila20:10
*** martyturner has joined #openstack-manila20:15
bswartzrraja: for docs, talk to the docs team about their deadlines -- for manila dev docs, you can push changes any time, but we WILL NOT backport dev docs changes ever20:17
bswartzmarkstur_: ping re https://bugs.launchpad.net/manila/+bug/152501020:18
openstackLaunchpad bug 1525010 in Manila "manila 3par mediator message missing proper 3parclient pip package name" [Medium,Confirmed] - Assigned to Mark Sturdevant (mark-sturdevant)20:18
rrajabswartz: thanks!20:25
*** dencaval has quit IRC20:27
*** Yogi1 has quit IRC20:29
*** lpetrut has quit IRC20:44
*** sgotliv has quit IRC20:44
*** cknight has quit IRC20:48
*** abhi has quit IRC20:48
*** yangyapeng has quit IRC20:58
*** yangyapeng has joined #openstack-manila20:59
*** dustins has quit IRC21:04
*** yangyapeng has quit IRC21:04
openstackgerritClinton Knight proposed openstack/manila: NetApp cDOT: Raise ShareResourceNotFound in update_access  https://review.openstack.org/29370821:04
*** yangyapeng has joined #openstack-manila21:06
*** ganso has quit IRC21:09
*** a_ta has quit IRC21:12
*** DericHorn-HP has joined #openstack-manila21:12
*** DericHorn-HP has quit IRC21:12
*** a_ta has joined #openstack-manila21:12
*** a_ta has quit IRC21:17
*** kro_mnckn_doc has quit IRC21:19
*** porrua has quit IRC21:29
*** eharney has quit IRC21:30
*** abhi has joined #openstack-manila21:30
*** darrenc is now known as darren_afk21:31
*** abhi has quit IRC21:31
*** abhi has joined #openstack-manila21:32
*** csaba has quit IRC21:33
*** rraja has quit IRC21:42
*** csaba has joined #openstack-manila21:46
*** darren_afk is now known as darrenc21:46
*** absubram has quit IRC21:49
*** absubram has joined #openstack-manila21:50
*** darkwsh has quit IRC21:50
*** tpsilva has quit IRC22:17
*** erlon has quit IRC22:17
*** martyturner has quit IRC22:26
*** chlong has joined #openstack-manila22:32
*** dalgaaf has quit IRC22:38
*** JoseMello has quit IRC22:39
*** vbellur has quit IRC22:42
*** xyang1 has quit IRC22:52
*** cknight has joined #openstack-manila22:54
*** merooney has joined #openstack-manila23:00
*** krotscheck has joined #openstack-manila23:11
*** akshai has quit IRC23:24
*** vbellur has joined #openstack-manila23:40
*** chlong has quit IRC23:41
*** cknight has quit IRC23:55
openstackgerritMark Sturdevant proposed openstack/manila: Fix error logged for wrong HPE 3par client  https://review.openstack.org/29376323:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!