Friday, 2016-03-18

*** yangyape_ has quit IRC00:03
*** lpetrut has quit IRC00:28
*** mtanino has quit IRC00:29
openstackgerritAlex Meade proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324300:29
openstackgerritAlex Meade proposed openstack/manila: Data Replication: Ensure Snapshots across replicas  https://review.openstack.org/29265900:29
*** lpetrut has joined #openstack-manila00:31
*** merooney has quit IRC01:00
*** yangyapeng has joined #openstack-manila01:12
*** merooney has joined #openstack-manila01:12
*** ganso has quit IRC01:19
*** ociuhandu has quit IRC01:25
*** ociuhandu has joined #openstack-manila01:26
*** yangyapeng has quit IRC01:27
*** yangyapeng has joined #openstack-manila01:28
openstackgerritdaiki kato proposed openstack/manila-image-elements: Fix typos  https://review.openstack.org/29435701:32
*** yangyapeng has quit IRC01:34
*** yangyapeng has joined #openstack-manila01:35
*** scottda_vacation has quit IRC01:45
*** yangyape_ has joined #openstack-manila01:49
*** yangyapeng has quit IRC01:53
*** lpetrut has quit IRC01:54
*** baojg has joined #openstack-manila01:54
*** a_ta has joined #openstack-manila01:56
*** a_ta has quit IRC02:00
*** csaba has quit IRC02:15
*** csaba has joined #openstack-manila02:16
*** houming has joined #openstack-manila02:21
*** yangyape_ has quit IRC02:46
*** yangyapeng has joined #openstack-manila02:47
*** a_ta has joined #openstack-manila02:47
*** a_ta has quit IRC02:52
*** cknight has joined #openstack-manila02:55
openstackgerritdaiki kato proposed openstack/puppet-manila: Fix typos  https://review.openstack.org/29437503:00
*** ociuhandu has quit IRC03:17
*** ociuhandu has joined #openstack-manila03:21
*** houming has quit IRC03:24
openstackgerritGoutham Pacha Ravi proposed openstack/manila: NetApp cDOT: Fix status updates for replicas  https://review.openstack.org/29180303:24
*** houming has joined #openstack-manila03:25
*** houming has quit IRC03:28
*** houming has joined #openstack-manila03:50
*** houming has quit IRC04:07
*** sgotliv has joined #openstack-manila04:14
*** merooney has quit IRC04:23
*** baojg has quit IRC04:28
*** cknight has quit IRC04:28
*** shausy has joined #openstack-manila04:30
openstackgerritGoutham Pacha Ravi proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324304:31
openstackgerritGoutham Pacha Ravi proposed openstack/manila: Data Replication: Ensure Snapshots across replicas  https://review.openstack.org/29265904:31
*** merooney has joined #openstack-manila04:37
*** baojg has joined #openstack-manila04:40
*** merooney has quit IRC04:42
*** a_ta has joined #openstack-manila04:53
*** a_ta has quit IRC04:58
*** bswartz has quit IRC05:02
*** houming has joined #openstack-manila05:03
*** markstur_ has joined #openstack-manila05:08
*** markstur_ has left #openstack-manila05:09
*** rhagarty has quit IRC05:13
*** rhagarty has joined #openstack-manila05:13
*** bswartz has joined #openstack-manila05:29
*** bswartz has quit IRC05:46
*** pcaruana has quit IRC06:18
*** nkrinner has joined #openstack-manila06:19
openstackgerritMerged openstack/manila: Revert "LXC/LXD driver"  https://review.openstack.org/29352306:32
*** baojg has quit IRC06:55
*** baojg has joined #openstack-manila07:14
*** baojg has quit IRC07:25
*** pcaruana has joined #openstack-manila07:57
*** aovchinnikov has joined #openstack-manila08:21
*** gregsfortytwo has quit IRC08:34
*** gregsfortytwo has joined #openstack-manila08:34
*** a_ta has joined #openstack-manila08:55
*** yangyape_ has joined #openstack-manila08:55
*** yangyapeng has quit IRC08:58
*** a_ta has quit IRC08:59
openstackgerritMerged openstack/puppet-manila: releasenotes: add notes for Mitaka cycle  https://review.openstack.org/29425909:18
*** yangyape_ has quit IRC09:26
*** yangyapeng has joined #openstack-manila09:26
*** merooney has joined #openstack-manila09:40
*** merooney has quit IRC09:45
*** lpetrut has joined #openstack-manila09:53
*** baojg has joined #openstack-manila09:53
openstackgerritAlexey Ovchinnikov proposed openstack/manila: Fix for incorrect LVMMixin exception message  https://review.openstack.org/29448109:59
*** ociuhandu has quit IRC10:04
*** tpsilva has joined #openstack-manila10:06
*** lpetrut has quit IRC10:25
*** yangyapeng has quit IRC10:36
*** lpetrut has joined #openstack-manila10:38
*** merooney has joined #openstack-manila10:41
*** sgotliv has quit IRC10:41
*** lpetrut has quit IRC10:43
*** merooney has quit IRC10:46
*** lpetrut has joined #openstack-manila10:57
*** baojg has quit IRC10:58
*** ganso has joined #openstack-manila11:00
*** mlima has joined #openstack-manila11:00
*** ociuhandu has joined #openstack-manila11:00
*** lpetrut has quit IRC11:06
*** juzuluag has joined #openstack-manila11:27
openstackgerritValeriy Ponomaryov proposed openstack/manila: Make ZFSonLinux driver handle snapshots of replicated shares properly  https://review.openstack.org/29337711:41
*** lpetrut has joined #openstack-manila11:53
*** a_ta has joined #openstack-manila11:53
*** yangyapeng has joined #openstack-manila11:57
*** a_ta has quit IRC11:58
*** mlima_ has joined #openstack-manila12:01
*** mlima has quit IRC12:04
*** rraja has joined #openstack-manila12:10
*** rraja has quit IRC12:10
*** jcsp has quit IRC12:10
*** cknight has joined #openstack-manila12:27
*** bswartz has joined #openstack-manila12:31
openstackgerritRodrigo Barbieri proposed openstack/manila: Fix manage API ignoring type extra specs  https://review.openstack.org/29426912:39
openstackgerritValeriy Ponomaryov proposed openstack/manila: Make ZFSonLinux driver handle snapshots of replicated shares properly  https://review.openstack.org/29337712:41
tpsilvacknight: ping12:41
cknighttpsilva: pong12:41
tpsilvacknight: Good morning Clinton12:41
tpsilvacknight: regarding this https://review.openstack.org/#/c/287758/15/manila/share/api.py@113612:42
tpsilvacknight: by ignoring requests with status active in manager, wouldn't it possibly drop some unprocessed rules?12:43
cknighttpsilva: Good morning Tiago.  I wasn't certain when I wrote that, but how else could you get a new rule in the manager with the state active?12:44
cknighttpsilva: The state should be out-of-sync when a new rule arrives, unless you had already handled it.12:45
*** timcl has joined #openstack-manila12:46
tpsilvacknight: that's true, unless there's a problem somewhere else12:46
tpsilvawhich I really hope it doesn't12:46
tpsilvacknight: well, I'll make this change then and I'll upload a new patch soon12:46
cknighttpsilva: OK, but I suggest you get a second opinion from Ben or Rodrigo, in case one of them can see a flaw in the logic.12:47
tpsilvacknight: comparing the rules would be great, but we don't have a way of getting the rules set on the backend12:47
cknighttpsilva: Yeah, I figured that.12:47
cknighttpsilva: And FWIW, the race (which leads to an extra rule at the manager) doesn't affect my driver, since I always replace all the rules.  But others would be affected.12:48
*** openstackgerrit has quit IRC12:48
*** openstackgerrit has joined #openstack-manila12:49
tpsilvacknight: yep, my driver works the same way12:49
*** xyang1 has joined #openstack-manila12:49
gansocknight, tpsilva: it is worth to note that when the recursive call is triggered, it is always recovery mode. For drivers that implement add_rules and delete_rules, it will be less efficient. And for drivers that do not implement update_access, they will run in fallback mode, which we have not  tested12:50
*** houming has quit IRC12:53
*** alejandrito has joined #openstack-manila12:56
*** cknight has quit IRC12:59
*** shausy has quit IRC13:08
*** akshai has joined #openstack-manila13:22
*** sgotliv has joined #openstack-manila13:24
*** cknight has joined #openstack-manila13:25
*** sgotliv has quit IRC13:31
openstackgerritMarc Koderer proposed openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051113:38
openstackgerritMarc Koderer proposed openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051113:40
openstackgerritMarc Koderer proposed openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051113:42
*** cknight has quit IRC13:54
*** a_ta has joined #openstack-manila13:56
openstackgerritTiago Pasqualini da Silva proposed openstack/manila: Fix update_access concurrency issue  https://review.openstack.org/28775813:57
*** esker has joined #openstack-manila13:58
*** eharney has joined #openstack-manila13:58
bswartzmkoderer__ mkoderer: 3 patches in 5 minutes?14:00
vponomaryovbswartz: he has patch-gun ))14:03
bswartzaovchinnikov: I was assuming you'd just create a branch on an existing repo14:05
bswartzaovchinnikov: but I mirrored your repo as a branch on my tree:14:05
bswartz https://github.com/bswartz/manila/tree/lxdbackup14:05
*** ociuhandu has quit IRC14:05
aovchinnikovbswartz: oh, ok, my bad. should I remove mine or it won't produce too much confusion?14:07
*** erlon has joined #openstack-manila14:07
*** martyturner has joined #openstack-manila14:11
openstackgerritMerged openstack/manila: NetApp cDOT: Fix status updates for replicas  https://review.openstack.org/29180314:11
bswartzit doesn't matter much14:12
*** nkrinner has quit IRC14:12
aovchinnikovok14:12
bswartzjust pointing you that you could have forked manila and put it in a side branch on your repo14:12
*** cknight has joined #openstack-manila14:13
*** aovchinnikov has quit IRC14:15
*** ChanServ changes topic to "9 bugs left until RC1"14:19
openstackgerritAlex Meade proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324314:23
openstackgerritAlex Meade proposed openstack/manila: Data Replication: Ensure Snapshots across replicas  https://review.openstack.org/29265914:23
*** akerr has joined #openstack-manila14:31
*** baojg has joined #openstack-manila14:33
*** baojg has quit IRC14:35
*** akerr has quit IRC14:36
*** pcaruana has quit IRC14:38
openstackgerritValeriy Ponomaryov proposed openstack/manila: Make ZFSonLinux driver handle snapshots of replicated shares properly  https://review.openstack.org/29337714:44
openstackgerritValeriy Ponomaryov proposed openstack/manila: [DEBUG] Replicated snapshot tests debug  https://review.openstack.org/29462614:48
eskerHello, Manila community!14:49
eskerPlease consider taking 10 seconds to respond to this highly critical poll asking about what you prefer in the way of a Manila project logo:14:49
eskerhttps://www.surveymonkey.com/r/J8266ZH14:49
eskerAgain... highly critical ;-)14:50
eskerWinner will get submitted to the project subject to the same review process as anything else...14:50
bswartznice14:50
bswartzthis deserves a twitter post14:50
eskerTweet away, please!14:50
eskerWas just about to contact you asking you to circulate whether appropriate.14:51
bswartzganso: why does this have APIImpact? https://review.openstack.org/#/c/294269/15:03
*** gouthamr has joined #openstack-manila15:05
*** mtanino has joined #openstack-manila15:10
gansobswartz: because it changes a certain API behavior, before on such error, it would return 202 and the share would have "managing_error" status... now it returns 409 right away15:11
gouthamrganso: +115:24
mkoderer___esker: great!15:26
eskermkoderer___: perhaps a humorous interlude whilst in the throes of RC1 activities (if that applies)... ;-)15:27
bswartzganso: but there's no microversion15:29
bswartzwe don't want a microversion because we're fixing behavior in all versions15:29
bswartzI guess I'm trying to understand what APIImpact really means15:30
*** martyturner has quit IRC15:30
*** baojg has joined #openstack-manila15:30
*** timcl1 has joined #openstack-manila15:31
openstackgerritYogesh proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311315:31
*** martyturner has joined #openstack-manila15:31
*** david-lyle has quit IRC15:32
*** david-lyle has joined #openstack-manila15:33
*** timcl has quit IRC15:33
gouthamrbswartz: APIImpact is a flag to get reviewer attention on APIImpact.. not all APIImpacts lead to microversion changes..15:34
mkoderer___esker: voted. great work15:36
bswartzif it was only meant for reviewers it should go in the gerrit comments15:36
bswartzcommit messages are stored forever15:36
vponomaryovtoabctl: ping15:36
mkoderer___bswartz: https://review.openstack.org/#/c/290511/ after a +1 of jamie it's ready for merge15:36
mkoderer___bswartz: when is the finial deadline to get it in RC1 ?15:36
bswartzmkoderer___: today15:37
vponomaryovtoabctl: is it correct to say that this -> https://review.openstack.org/#/c/289382/5 still does not work on py3?15:37
vponomaryovtoabctl: tests you fixed are skipped15:37
mkoderer___bswartz: your timezone?15:38
bswartzmkoderer___: what's left to be done?  why would a few hours make a difference?15:39
gouthamrbswartz: that's one argument.. but we use a number of flags in openstack.. DocImpact, APIImpact and the likes.15:39
mkoderer___bswartz: as cknight stated.. we might wait for jamies review15:39
mkoderer___not sure which time zone he's in15:39
*** rraja has joined #openstack-manila15:40
bswartzI'll give him a few hours to take a look but I won't wait15:40
mkoderer___bswartz: ok fine up to you15:41
cknighttpsilva: I'm happy with your code.  It seems to work with multiple clients doing multiple rapid adds & deletes.  Just going to check the unit test coverage now.15:41
tpsilvacknight: great! the coverage is not good enough. I plan on bumping it after lunch...15:43
*** ociuhandu has joined #openstack-manila15:43
*** baojg has quit IRC15:43
vponomaryovmkoderer___, bswartz: based on time of his reviews, he is on west coast15:43
*** Yogi1 has joined #openstack-manila15:44
vponomaryovmkoderer___, bswartz: in best case it is about 6 hours to wait15:44
bswartztpsilva: you have -1 from jenkins15:44
mkoderer___vponomaryov: I ping him and we'll see.. but I have a good feeling with the current state15:44
tpsilvabswartz: yeah, I saw that... weird that I cannot run this test on my environment15:45
bswartztpsilva: failed this unit test: manila.tests.share.test_manager.ShareManagerTestCase.test_delete_share_instance_not_found_2_delete_share15:45
tpsilvabswartz: but I'll fix that as well15:45
cknighttpsilva: I look forward to seeing how you unit test your recursive method.15:46
cknighttpsilva: It's not difficult, but you'll definitely want to ensure it's working in a test.15:46
openstackgerritAlex Meade proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324315:58
*** david-lyle has quit IRC16:00
*** david-lyle has joined #openstack-manila16:01
*** martyturner has quit IRC16:03
gansovponomaryov, cknight, bswartz, xyang1, markstur: Could you please take a quick look  https://review.openstack.org/#/c/294575/ ?16:04
bswartznow isn't a good time to deal with liberty stuff16:04
bswartzliberty can wait until next week16:04
bswartzit's already noon here and we still have 9 bugs16:05
*** martyturner has joined #openstack-manila16:07
*** timcl has joined #openstack-manila16:07
*** mkoderer___ is now known as mkoderer__16:08
bswartzif we can get some eyes on https://review.openstack.org/#/c/289441 it looks pretty simpl16:09
bswartzit's gotten unlucky with jenkins timeouts16:09
marksturbswartz, There's an awful lot of red in those Jenkins results16:10
bswartzthey're all timing out16:10
*** timcl1 has quit IRC16:10
bswartzmight have been unlucky and chosen a slow node16:10
bswartzif something in the patch is actually making things slower than we won't merge i16:11
bswartzit16:11
bswartzbut the code doesn't look bad16:11
bswartzit just adds a lock16:11
*** a_ta has quit IRC16:11
*** a_ta has joined #openstack-manila16:12
marksturbswartz, gate-manila-tempest-minimal-dsvm-lvm FAILURE in 1h 06m 16s16:14
marksturbswartz, I'm not convinced one way or the other, but it smells like this patch might be causing the timeouts16:14
bswartzindeed...16:15
marksturbswartz, 9 more "Oops" and we're done.16:15
bswartzokay I'm looking at logs more closely16:15
bswartzrofl16:15
bswartzI honestly don't know how gerrit flipped which patch I was reviewing16:16
bswartzwas supposed to be https://review.openstack.org/#/c/294269/16:16
*** rraja has quit IRC16:16
*** a_ta has quit IRC16:16
* bswartz might have too many firefox windows open at the same time...16:16
bswartzmarkstur: if we see another timeout I'll throw that bug out16:17
bswartzit was only medium16:17
marksturbswartz, Yeah. I'm still not sure, but today would be a bad day to push something that locks us up.16:18
marksturbswartz, It could easily be a CI issue (bad luck), but usually we don't see all those jobs timeout.  It is usually just an unlucky few.16:19
*** timcl has quit IRC16:22
*** vbellur has quit IRC16:25
*** sgotliv has joined #openstack-manila16:26
*** ociuhandu has quit IRC16:26
bswartzvponomaryov: are there any remaining things left in the ZFS patch?16:32
bswartzI saw you pushed a debug patch to test it16:32
vponomaryovbswartz: couple of tempest tests fail on it16:32
vponomaryovbswartz: locally too16:32
vponomaryovbswartz: but using only tempest16:32
vponomaryovbswartz: looks like concurrency16:32
bswartzexisting merged tests? or proposed tests?16:32
vponomaryovbswartz: and since NetApp does not face such problem, I suspect NetApp Ci works slower16:33
vponomaryovbswartz: proposed16:33
bswartzyour debug patch doesn't Depends-On the proposed tests though16:33
vponomaryovbswartz: it does16:34
bswartzhttps://review.openstack.org/#/c/294626/ this one?16:38
bswartzI see 3 depends -- the core change and the 2 driver changes16:38
bswartzoh it has an unmerged parent16:38
bswartzokay nevermind16:38
*** ociuhandu has joined #openstack-manila16:42
mkoderer__bswartz: I will finish for today.. pls merge https://review.openstack.org/#/c/290511/ if possible :)16:43
*** timcl has joined #openstack-manila16:44
*** pcaruana has joined #openstack-manila16:47
openstackgerritEmilien Macchi proposed openstack/puppet-manila: CI test - never merge  https://review.openstack.org/29471216:49
vponomaryovganso: ping16:51
gansovponomaryov: pong16:51
vponomaryovganso: about https://review.openstack.org/#/c/294269/16:51
vponomaryovganso: scheduler should not be involved16:51
vponomaryovganso: it is used only for scheduling craetion of shares16:51
gansovponomaryov: migration uses it to validate as well16:51
gansovponomaryov: why?16:51
vponomaryovganso: why do oyu need scheduler?16:52
vponomaryovganso: API can do it easily16:52
gansovponomaryov: to run filters16:52
gansovponomaryov: not easily. For capabilities that are lists, and can accept True and False, it is not so easy16:52
gansovponomaryov: scheduler already does this16:52
gansovponomaryov: yesterday someone said Cinder does the same, uses scheduler to validate16:53
*** martyturner has quit IRC16:55
*** martyturner has joined #openstack-manila16:59
vponomaryovbswartz: do you know that replication tests do not run in NetApp CI at all?17:00
vponomaryovbswartz: I am talking about all replication tests in Tempest17:00
*** timcl1 has joined #openstack-manila17:00
vponomaryovbswartz: NetApp driver replication feature is not tested in OpenStack CI17:00
vponomaryovYogi1, akerr, gouthamr: ^17:02
*** timcl has quit IRC17:02
gouthamrvponomaryov: no multibackend tests run on the netapp CI as of today17:02
gouthamrvponomaryov: we're working on reporting these tests soon.17:03
vponomaryovgouthamr: O.O17:03
*** timcl1 has quit IRC17:04
gouthamrvponomaryov: we're enhancing our CI to support migration tests, replication tests, multi AZ tests and multi node tests.. we should start reporting some/all of these very soon. they're currently being worked on.17:05
*** mlima_ is now known as mlima17:05
*** timcl has joined #openstack-manila17:06
*** a_ta has joined #openstack-manila17:28
*** timcl has quit IRC17:28
*** timcl has joined #openstack-manila17:29
*** ChanServ changes topic to "8 bugs left until RC1"17:32
bswartzgouthamr: it's just an issue of multibackend right?17:32
bswartzit's not an issue of the tests themselves17:33
gouthamrbswartz: yes..17:33
bswartzand we've run the multibackend tests but they don't report17:33
bswartzdo you know what's so hard about making the multibackend tests report?17:33
gouthamrbswartz: replication tests are required to be multibackend tests, else if we're replicating between pools on the same backend we may not be catching all the issues17:34
bswartzgouthamr: ignoring replication, why is it hard to run multibackend tests in public CI system?17:34
gouthamrbswartz: it would be real easy to just turn them on right now, we have one backend reporting multiple pools17:34
* bswartz wishes akerr were here17:35
gouthamrbswartz: oh.. we haven't done all the configuration work for it17:35
gouthamrbswartz: its not hard17:35
bswartzis it expensive?17:35
bswartzwhy would we have chosen not to do it?17:35
gouthamrbswartz: not expensive17:35
gouthamrbswartz: the work we're doing now would have our CI be reporting multibackend all the time.17:37
bswartztpsilva: ping re https://review.openstack.org/#/c/287758/17:37
bswartzgouthamr: nearly all the gate tests run that way17:37
bswartzgouthamr: I think we should ask all the CI systems to run multibackend17:37
tpsilvabswartz: pong17:37
tpsilvabswartz: working on it... getting more tests17:38
bswartztpsilva: back from lunch? new patchset soon?17:38
gouthamrbswartz: i agree.17:38
bswartzok17:38
tpsilvabswartz: problem is, the test that is currently failing17:38
tpsilvabswartz: we cannot find it :)17:38
bswartztpsilva: lol17:38
tpsilvabswartz: asked ganso to check if I'm not crazy... he couldn't find it either17:38
*** vbellur has joined #openstack-manila17:39
*** mlima has left #openstack-manila17:39
bswartztpsilva: https://github.com/openstack/manila/blob/master/manila/tests/share/test_manager.py#L216717:40
bswartzit's this one ^17:40
tpsilvaoh, my patch probably needs a rebase17:40
tpsilvadidn't think that17:40
tpsilvasorry hehe :)17:41
bswartzganso added that test 21 days ago according to blame17:42
cknightmakes sense.  I always blame ganso.17:42
bswartzmaybe ganso is the crazy one if he can't find the test he wrote17:42
gansoI am crazy, nothing new here17:43
cknight:-)17:43
*** a_ta has quit IRC17:43
bswartzI'm still trying to figure out when this merged though17:43
*** a_ta has joined #openstack-manila17:43
bswartzone of the things that drives ME crazy is that gerrit retains the timestamp of the commiter's push to gerrit when it merges, not the timestamp when gerrit actually merged it17:44
*** david-lyle_ has joined #openstack-manila17:44
*** david-lyle has quit IRC17:45
bswartzAny reason not to merge https://review.openstack.org/#/c/289382/ now?17:45
*** david-lyle_ is now known as david-lyle17:46
bswartzand anyknow know Jamie Lennox's IRC handle?17:46
cknightbswartz: it can merge, just need another reviewer17:46
bswartznm it appears to be jamielennox17:46
*** a_ta has quit IRC17:48
*** akshai has quit IRC17:49
*** timcl has quit IRC17:56
openstackgerritGoutham Pacha Ravi proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324317:57
openstackgerritGoutham Pacha Ravi proposed openstack/manila: Data Replication: Ensure Snapshots across replicas  https://review.openstack.org/29265917:57
mkoderer__bswartz: just saw jamies timezone is UTC+11 (AEDT).. for him it's middle of the night18:00
*** martyturner has quit IRC18:01
*** timcl has joined #openstack-manila18:03
bswartzmkoderer__: okay thanks -- if he reviews after it merges and finds any problems we'll have to file another bug18:03
mkoderer__bswartz: +118:03
*** martyturner has joined #openstack-manila18:03
*** lpetrut has quit IRC18:06
tpsilvabswartz, ganso: yep, rebased my patch and now I can find the test18:07
tpsilvanew patch should be up in a moment18:08
bswartzawesome18:08
*** JoseMello has joined #openstack-manila18:08
bswartztpsilva: your fix is important because the last manilaclient bugfix depends on it18:09
bswartzI cannot tag the client until your fix goes in18:09
vponomaryovbswartz, cknight, please, see comment to commit with snapshot replication - https://review.openstack.org/#/c/292659/1018:15
vponomaryovbswartz, cknight: share manager sets "error" status to "ok" snapshot18:16
vponomaryovbswartz, cknight: so, I would say we have design bug there18:17
openstackgerritGoutham Pacha Ravi proposed openstack/manila: NetApp cDOT: Handle replicated snapshots  https://review.openstack.org/29324318:18
vponomaryovbswartz, cknight: current approach is ok only if creation of replica is slow operation - slower than time of nearest snapshot instances periodic update18:18
*** akshai has joined #openstack-manila18:19
bswartzvponomaryov: I'm not sure what your first comment refers to18:19
bswartzvponomaryov: I agree with you about the second issue -- it's something to address in the future however18:20
vponomaryovbswartz: em, all of these are single issue18:20
openstackgerritTiago Pasqualini da Silva proposed openstack/manila: Fix update_access concurrency issue  https://review.openstack.org/28775818:21
tpsilvabswartz, cknight: ^18:21
tpsilvahope it's ok now18:21
gouthamrvponomaryov: Yogesh's next patch adds the wait for snapshot before promotion18:21
bswartzvponomaryov: it should not be allowed to promote a replica that is not in sync, and the replica should not be in sync until it has all the snapshots18:21
bswartzit's the test's responsibility to wait18:21
vponomaryovbswartz: share manager does not allow update it from "create replica" call18:22
vponomaryovbswartz; but should allow it, it is design bug18:22
bswartzalso, if you create a snapshot and immediately promote before snapshot is active, you expect that snapshot to go to error18:22
vponomaryovbswartz: snapshot resource exists and it is ok18:22
vponomaryovbswartz: share manager just does not set available status18:22
bswartzvponomaryov: I agree it's a design bug. I don't want to fix it now18:23
gouthamrvponomaryov: we spoke about this yesterday, at length. :)18:23
gouthamrvponomaryov18:23
bswartzthe driver interface for replication needs a lot of work18:23
bswartzhowever that should not prevent us from shipping something that works in mitaka18:23
gouthamrvponomaryov: i would say a driver setting a replica to in_sync in the create_replica call is bad design..18:23
bswartzthe alternative is to disable replication APIs and cut the RC with no replication18:23
gouthamrvponomaryov: you'll be waiting on that call for a long time if the share is huge18:23
gouthamrthere're tradeoffs to both these approaches,18:24
vponomaryovgouthamr: driver call and API are different things18:24
bswartzI would have been nice if we noticed these issues weeks ago when there was time to fix them18:25
vponomaryovgouthamr: user will not wait for call, he will wait for status18:25
bswartznow we're stuck shipping the best thing we have time to get done18:25
gouthamrvponomaryov: we'll revisit this with the multiple database updates that you're suggesting.18:25
vponomaryovbswartz: ZFSonLinux fix is ready18:25
gouthamrvponomaryov: for now, the tests will wait.18:25
vponomaryovgouthamr: tests can be fixed easily18:26
vponomaryovgouthamr: even now18:26
bswartzvponomaryov: ty18:26
bswartzgouthamr: wait for what18:26
vponomaryovgouthamr: after promote of replica and deletion of another just wait for absense of second replica, then wait for status of snapshot18:27
gouthamrvponomaryov: it's fixed. we're running them multiple times, they'll be up asap.18:27
gouthamrvponomaryov: yep. done18:27
bswartzgouthamr: why wait?18:27
vponomaryovbswartz: it is workaround for bug18:27
vponomaryovbswartz; for tempest tests18:27
bswartzI'm asking is there going to be a patchset 7, and if so, when?18:28
bswartzerr18:28
gouthamrbswartz: for tempest tests?18:28
bswartzyes18:29
gouthamrbswartz: i think only the tests need another patch18:29
bswartzgouthamr: when?18:29
gouthamrbswartz: in a bit. They're running for the 3rd time right now (each run takes 15 mins) :)18:29
vponomaryovgouthamr: you run all the tests? ))18:30
bswartzgouthamr: if it passed 2 times, just push it18:30
bswartzI don't understand what we expect to happen the 3rd time18:30
bswartzyou realize we're not shipping mitaka tomorrow right?18:30
cknightbswartz: 3rd time is a charm.  Everyone knows that!18:30
bswartzyou'll have time to find and fix more bugs18:31
gouthamrbswartz: yes ^^18:31
gouthamr:P18:31
bswartzright now we need to cut RC118:31
bswartzRIGHT NOW18:31
gouthamrbswartz: we're testing the debris that gets left behind, vponomaryov pointed out some stuff18:31
ameadethat's just for the tests18:31
ameadewhich we dont have to wait for we discussed18:31
bswartzI would like the tests in RC118:32
bswartzwe don't need them but I would like them18:32
ameadeyeah def, lets get the patches they depend on in now18:32
bswartzameade: the gate doesn't make you wait -- you can workflow things in parallel18:33
*** a_ta has joined #openstack-manila18:33
bswartzI guess what I'm saying is, unless you know something is wrong with the latest test patch, upload it so we can review it18:34
gansobtw, is it possible to create a share without a type?18:34
bswartzganso: no18:34
gansobswartz: great, thanks18:34
bswartzganso: if you don't specify one, you get the default type18:35
bswartzand the default type is required to exist18:35
*** lpetrut has joined #openstack-manila18:37
bswartzcknight: you saw latest https://review.openstack.org/287758 ?18:37
cknightbswartz: yes, looking already18:38
cknighttpsilva: I see a couple test gaps that should be quick to close18:38
bswartztpsilva: you know that initialization and initialisation are both correct english right?18:39
bswartzjust different regional spellings18:39
tpsilvabswartz: yes.. us vs uk18:40
tpsilvabswartz: why?18:40
bswartzI saw you fixed it in your patch18:40
tpsilvacknight: where?18:40
bswartzerr wait18:40
bswartzoh that came from the rebase not your change18:40
bswartzsorry I was comparing PS16 and PS1718:40
tpsilvayep, the rebase messed the diff18:40
bswartzsomebody else made that spelling change18:40
cknighttpsilva: posted comment18:41
tpsilvacknight: right, thank you18:41
openstackgerritYogesh proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311318:41
bswartzyogi1: ty18:41
Yogi1bswartz np18:41
openstackgerritRodrigo Barbieri proposed openstack/manila: Fix manage API ignoring type extra specs  https://review.openstack.org/29426918:46
gansocknight, bswartz: ^18:46
cknightganso: looking18:48
bswartztpsilva: will it be easy to cover those code paths?18:48
tpsilvabswartz: yes, I'm already working on that18:49
tpsilvabswartz: yes, I'm already working on that18:52
tpsilvaoops, wrong window18:52
vponomaryovYogi1: it still will fail18:52
*** a_ta has quit IRC18:52
vponomaryovYogi1: no waits after promote and replica delete steps18:52
Yogi1vponomaryov: wait for what after promote?18:53
vponomaryovYogi1: also, two tests require additional waiters and only one got it in PS718:53
cknightganso: Patch looks fine.  I know there isn't time now, but it seems we should have a Tempest test to validate the fix.18:54
Yogi1One was already sent in earlier patch18:54
bswartzmore test coverage!18:54
* bswartz shakes fist18:54
vponomaryovYogi1: hm, nevermind, waiters will not help18:54
gansocknight: there is a semi negative test, the one I updated18:54
cknightganso: nvm, I see it now, thanks.  nice job.18:55
vponomaryovYogi1: ZFSonLinux will still fail on two tests18:55
gansocknight: in order for the test to suceed, it must behave according to the change18:55
gansocknight: thanks18:55
vponomaryovYogi1: you will get active replica in https://review.openstack.org/#/c/293113/6..7/manila_tempest_tests/tests/api/base.py too18:55
vponomaryovYogi1: and "exceptions.BadRequest" is expected error in case of attempt to delete active18:56
vponomaryovYogi1: you should be ok only with "NotFound" there18:56
cknightbswartz: Who else is reviewing the sslutils fix?  https://review.openstack.org/#/c/289382/18:57
cknightganso: Have you looked at it?18:57
Yogi1vponomaryov : therefore I am ignoring that if there is active replica18:57
openstackgerritGoutham Pacha Ravi proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311318:58
Yogi1vponomaryov I don't think we have NotFound exception18:58
gansocknight: started but did not finish18:58
gansocknight: will try to finish now18:59
bswartzxyang1 markstur ganso toabctl: https://review.openstack.org/#/c/289382/ https://review.openstack.org/#/c/294269/18:59
Yogi1vponomaryov the client returns BadRequest18:59
vponomaryovYogi1: it is for active and last one18:59
vponomaryovYogi1: "clear_resources" call can be concurrent19:00
gouthamrvponomaryov: concurrent for the same class?19:01
vponomaryovYogi1: so, better to add base method that tries delete share replica and wraps NotFound19:01
gansocknight: we got some failures19:01
vponomaryovYogi1: and provide it to addCleanup19:01
gansocknight: how about a recheck?19:01
cknightganso: where?19:02
vponomaryovYogi1: and in test do both, call addCleanup first then you can delete share replica in the middle of the test19:02
gansocknight: zfs and generic-no-share-servers CI19:02
gansocknight: https://review.openstack.org/#/c/289382/19:02
openstackgerritTiago Pasqualini da Silva proposed openstack/manila: Fix update_access concurrency issue  https://review.openstack.org/28775819:02
gouthamrvponomaryov: that approach is fine. but the current approach will work fine too... it ensures the share can be deleted , even if addCleanup is not added19:04
cknightganso: OK, done.  25 failures on ZFS.  Perhaps vponomaryov should look at that.  https://review.openstack.org/#/c/289382/519:04
gansocknight: yea, looked at no-share-servers error, seemed random19:04
vponomaryovcknight: TypeError: update_access() takes at least 5 arguments (4 given)19:04
gansovponomaryov: ah, right19:05
gansocknight: well, we should recheck in order to run on updated tree19:05
vponomaryovcknight: there is very old CI report19:05
bswartzjust 2 days...19:06
vponomaryovbswartz: 2 days!19:06
vponomaryovbswartz: in our case it is ages19:06
gansobswartz: lots of stuff merged in 2 days19:06
vponomaryovgouthamr: fi it worked in you lab does not mean it is ok19:07
vponomaryovgouthamr: you delete there untracked stuff19:07
vponomaryovgouthamr: random stuff19:07
vponomaryovgouthamr: only registered ones shoudl be delted19:07
gouthamrvponomaryov: but you're trying to delete the share19:08
bswartzlooks like keystonev3 patch passed19:08
gouthamrvponomaryov: why do you care about its untracked replicas19:08
*** ChanServ changes topic to "7 bugs left until RC1"19:08
gansolaunchpad says 8 ^19:09
gouthamrvponomaryov: alright, we can try your approach. however, i think this works for now. i want to see if any ZFS failures exist on this patch.19:09
gouthamrganso: could it be me closing two bugs with one patch? :P19:09
vponomaryovgouthamr: exists for sure, 2 tests will fail19:09
gansogouthamr: could be :)19:09
vponomaryovgouthamr:  same as in http://logs.openstack.org/26/294626/1/check/gate-manila-tempest-dsvm-postgres-zfsonlinux/6b9e0e4/logs/testr_results.html.gz19:09
gouthamrvponomaryov: meh :(19:09
vponomaryovgouthamr: want make a bet? ))19:10
gouthamrvponomaryov: lol, i trust your CI knowledge too much to risk my money19:10
vponomaryovgouthamr: there is russian saying: "the one who does not accept risk does not drink champagne"19:11
gouthamrvponomaryov: bswartz once promised me scotch for all the risks i've been taking of late19:12
vponomaryovgouthamr: and? ))19:12
gouthamrvponomaryov: im still waiting :P19:12
*** chlong has quit IRC19:12
vponomaryovbswartz, cknight: https://review.openstack.org/#/c/289382/ this one fixes only half of the bug19:13
vponomaryovbswartz, cknight: second part is about fixed py34 support19:13
*** a_ta has joined #openstack-manila19:14
openstackgerritMerged openstack/manila: Fix keystone v3 issues for all clients  https://review.openstack.org/29051119:14
cknightvponomaryov: What remains?  Reenabling the SSL + py3 tests?19:16
vponomaryovcknight: yes19:17
vponomaryovcknight: so, it should have been "partial_fix"19:17
*** ociuhandu has quit IRC19:18
cknightvponomaryov: That's a 2-line change to reenable those.19:18
vponomaryovcknight: yes, but they will fail19:18
cknightvponomaryov: And we can do that anytime.  But yes, 'Partial-fix' would have been better.19:18
vponomaryovcknight: bug still exists , we just change with it place where we get options, that all19:19
cknightvponomaryov: oh, so is it just the tests that don't work with py3, or does the wsgi code not work with py3?19:19
vponomaryovcknight: the latter19:20
vponomaryovcknight: wsgi SSL code19:20
cknightvponomaryov: ah, OK, I get it.  thanks.19:20
vponomaryovcknight: so, it is not critical to merge it even as partial fix19:21
cknightvponomaryov: that's up to bswartz, then19:21
vponomaryovcknight: only if SSL oslo code gets fixed after some time19:21
bswartzvponomaryov: well we have that other bug still open19:22
bswartzlet's target it at N-1 and someone should assign themselves19:22
bswartzpy3 doesn't need to work in mitaka19:22
bswartzwe don't support it19:22
vponomaryovbswartz: most of our code is compatible with it19:23
bswartzyes but we don't have tempest coverage for py319:24
vponomaryovbswartz: just several of things are skipped and SSL wsgi tests among them19:24
bswartzshow me passing tempest tests with py3 and I'll start to care more about py3 bugs19:25
bswartzvponomaryov: you're referring to unit tests, right?19:25
vponomaryovbswartz: yes19:25
cknightganso: sorry, i jumped the gun and workflow'ed the manage fix.  I guess we'll see if it passes the check queue.19:26
bswartzvponomaryov: we care about py3 compatibility at unit test level only -- because it means we're not HORRIBLY broken on py319:26
bswartzthere's a lot of evidence that actual functional tests on py3 won't pass without a ton more work19:27
*** lpetrut has quit IRC19:27
gansocknight: https://review.openstack.org/#/c/289382/19:28
gansocknight: now we really need a recheck19:28
cknightbswartz: ^^ Are you going to retarget this, or must we fix the conflict?19:28
*** akshai has quit IRC19:30
*** sgotliv has quit IRC19:33
openstackgerritBen Swartzlander proposed openstack/manila: Use sslutils from oslo_service  https://review.openstack.org/28938219:38
bswartzthere19:39
bswartzfreaking merge conflicts19:39
bswartzthis is why it's better to merge everything as early as humanly possible19:39
bswartzvponomaryov: are you ready to merge https://review.openstack.org/#/c/292659/ ?19:41
bswartzthat's the big one19:41
bswartzglusterfs CI is reporting "unstable" now19:42
tpsilvayep, glusterfs just failed on my patch19:42
*** akshai has joined #openstack-manila19:43
*** ociuhandu has joined #openstack-manila19:45
*** a_ta has quit IRC19:45
*** a_ta has joined #openstack-manila19:46
*** a_ta has quit IRC19:46
*** a_ta has joined #openstack-manila19:46
*** akerr has joined #openstack-manila19:47
bswartzYogi1: you failed pep819:47
Yogi1yeah just saw that19:48
bswartzgouthamr: it was actually our commit to yogi1's patch19:48
bswartzs/our/your/19:48
Yogi1Will pix and send it again19:48
Yogi1s/pix/fix/19:48
openstackgerritYogesh proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311319:59
*** dencaval has quit IRC20:02
openstackgerritGoutham Pacha Ravi proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311320:03
*** timcl has quit IRC20:07
*** akshai has quit IRC20:14
*** akshai has joined #openstack-manila20:18
*** akshai has quit IRC20:23
*** a_ta has quit IRC20:24
*** a_ta has joined #openstack-manila20:25
*** ChanServ changes topic to "6 bugs left until RC1"20:26
*** a_ta has quit IRC20:29
*** a_ta has joined #openstack-manila20:29
*** akerr has quit IRC20:30
gansohttps://review.openstack.org/#/c/294269/ is ready for workflow20:34
bswartzganso: thanks20:37
gansobswartz: =D20:37
*** alejandrito has quit IRC20:37
bswartzganso: have you reviewed https://review.openstack.org/#/c/287758/ ?20:38
gansobswartz: yes, waiting for jenkins20:38
gansobswartz: I tested it on my lab as well20:38
gansobswartz: depending on errors in CI, may be good to go20:38
bswartzjenkins is in bad shapre today20:39
gansobswartz: yes20:39
bswartzeverything is done except the voting tempest job20:39
gansobswartz: coverage test got stuck20:39
bswartzchances are high it will timeout20:39
bswartzso a recheck will be needed20:39
gansobswartz: no o_O20:39
bswartzif you can review the other test results and +2 then we will just recheck until it passes the voting job20:39
gansobswartz: voting job has passed20:39
bswartzoh wait20:40
bswartzyou're right20:40
bswartzo_O20:40
bswartzI didn't line up the blue bar right on my screen20:40
bswartzsince it's nonvoting we should be g2g20:40
*** akshai has joined #openstack-manila20:42
gansobswartz: too many errors in job that failed, but nothing in m-shr o_O20:42
gansobswartz: no valid host was found everywhere in m-sch20:42
bswartzwhat are you looking at?20:43
gansobswartz: guess devstack failed setting up vm20:43
gansobswartz: no-share-servers job for 28775820:43
bswartzyeah20:43
gansobswartz: coverage test will fail as well... do you want to re-run for those two?20:45
bswartzI want to get the +2s and +A and then fight the gate afterwards20:45
gansobswartz: it succeeded o_O20:45
bswartzanyone can recheck endlessly20:45
bswartzthe important thing is to determine that no more patchsets are needed20:46
gansobswartz: agreed20:46
bswartzand remember that if we find new bugs we can fix them in RC220:46
bswartzthis is a huge improvement to what we have now20:46
bswartzso I want it in20:46
gansobswartz: I assured it works in generic NFS, CIFS and HNAS... was mostly worried about other vendors20:48
bswartzvendors with broken CI deserve what they get20:48
bswartzand I expect manual testing to be done on RC1 and bugs to be filed if that uncovers any issues20:49
bswartzthe whole point of RC1 is to give everyone something to do they manual regression tests on20:49
bswartzs/they/their/20:50
gouthamrvponomaryov: still here?20:50
gansobswartz: what's RC2 date?20:50
bswartzwhen all the bugs found after RC1 are fixed20:51
bswartz:-p20:51
gansobswartz: or punted20:51
bswartzcorrect20:51
bswartzthere is no date20:51
bswartzwe pray RC2 isn't needed at all20:51
bswartzbut if it is, we figure out what needs to be in and we get that done20:52
bswartzRC2 can happen up until like a day before the official release20:52
bswartzsame w/ RC3, RC4, etc20:52
gansobswartz: great20:53
bswartzthe bar for getting a fix in gets higher and higher though as we try to eliminate risk20:53
*** a_ta has quit IRC20:55
*** a_ta has joined #openstack-manila20:55
*** a_ta has quit IRC21:00
*** vbellur has quit IRC21:02
*** vbellur has joined #openstack-manila21:04
*** david-lyle has quit IRC21:06
*** david-lyle has joined #openstack-manila21:07
*** vbellur has quit IRC21:13
*** gouthamr has quit IRC21:21
openstackgerritMerged openstack/manila: Fix manage API ignoring type extra specs  https://review.openstack.org/29426921:21
*** Yogi1 has quit IRC21:22
*** akshai_ has joined #openstack-manila21:23
*** furlongm_ has joined #openstack-manila21:25
*** esker has quit IRC21:26
*** furlongm has quit IRC21:26
*** akshai has quit IRC21:26
*** kambiz has quit IRC21:26
*** dhellmann has quit IRC21:26
*** kambiz has joined #openstack-manila21:26
*** dhellmann has joined #openstack-manila21:26
*** esker has joined #openstack-manila21:26
*** rhagarty has quit IRC21:27
*** rhagarty has joined #openstack-manila21:28
*** rhagarty has quit IRC21:29
openstackgerritMerged openstack/manila: Fix update_access concurrency issue  https://review.openstack.org/28775821:35
*** mtanino has quit IRC21:39
openstackgerritYogesh proposed openstack/manila: Add tests to ensure snapshots across replicas  https://review.openstack.org/29311321:48
*** xyang1 has quit IRC21:56
*** erlon has quit IRC21:57
ameadebswartz: looks ready https://review.openstack.org/#/c/292659/1021:59
ameadehttps://review.openstack.org/#/c/293243/921:59
ameadeneeds +2s again21:59
*** juzuluag has quit IRC22:01
*** cknight has quit IRC22:30
*** vbellur has joined #openstack-manila22:36
*** martyturner has quit IRC22:50
*** jasonsb has joined #openstack-manila22:51
*** akshai_ has quit IRC23:04
*** JoseMello has quit IRC23:29
*** cknight has joined #openstack-manila23:32
*** gouthamr has joined #openstack-manila23:54
*** gouthamr_ has joined #openstack-manila23:55
*** gouthamr has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!