14:00:14 #startmeeting cinder 14:00:15 Meeting started Wed Apr 22 14:00:14 2020 UTC and is due to finish in 60 minutes. The chair is rosmaita. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:16 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:20 The meeting name has been set to 'cinder' 14:00:20 #link https://etherpad.openstack.org/p/cinder-ussuri-meetings 14:00:20 #topic roll call 14:00:22 o/ 14:00:25 hi 14:00:26 o/ 14:00:29 o/ 14:00:33 hi 14:00:36 o/ 14:00:51 hi 14:00:57 hi 14:01:06 hi 14:01:18 hello 14:01:20 hi 14:01:33 hi 14:01:35 hi 14:01:41 hi 14:01:47 hi 14:01:53 wow, big turnout 14:02:13 #topic announcements 14:02:27 ok, the big announcement is that RC-1 gets released tomorrow 14:02:33 and the stable/ussuri branch is cut 14:02:56 that means all bugfixes must go to master 14:03:05 Wow, how did we get here so fast? 14:03:06 and then be proposed as backports to stable/ussuri 14:03:16 if they are going to be included in the release 14:03:22 so, if you have such a bug 14:03:33 please tag it with 'ussuri-rc-potential' 14:03:50 and better yet, add it to this etherpad so it gets visibility: 14:04:02 #link https://etherpad.opendev.org/p/cinder-ussuri-rc-backport-potential 14:04:23 but yeah, it did seem to sneak up kind of fast 14:04:35 :-) 14:05:00 Reviewers should also keep in mind string freeze. 14:05:13 smcginnis: thanks for mentioning that 14:05:34 we aren't supposed to change any translatable strings any more in ussuri 14:05:49 unless they contain profanity 14:05:54 but i haven't seen any of those 14:06:01 (please don't take it as a challenge) 14:06:04 :) 14:06:39 i think that's basically it -- please test and look for bugs as time allows 14:07:08 * jungleboyj start getting creative. 14:07:12 i will watch the gate to see that things in flight have merged and then put up a release patch for RC-1 14:07:37 last item is the victoria PTG 14:07:42 (virtual ptg) 14:08:08 #link https://etherpad.openstack.org/p/cinder-victoria-ptg-planning 14:08:29 no one put any suggested good/bad times on it 14:08:49 sometime tomorrow i will put in our requests for time slots 14:09:02 so if you have a preference to express, please say so on the etherpad 14:09:20 look at last week's meeting log for details about the available slots, etc 14:09:30 #topic macrosan driver situation 14:09:45 #link https://etherpad.opendev.org/p/cinder-ussuri-driverstuff 14:09:59 ok. so this is a strange situation 14:10:12 they've got the third party CI running more or less reliably 14:10:29 but are having trouble with their "mark as supported again" patch 14:10:36 which is backwards from what we usually see 14:11:06 anyone here from macrosan? 14:11:43 i will just repeat what he said in the channel earlier today 14:11:58 ok, thanks 14:12:21 on the revert patch, the CI isn't able to work on the code 14:12:42 but after some refactoring, adding lines 14:12:46 the CI seems to work 14:13:02 see PS2 14:13:03 https://review.opendev.org/#/c/721428/2/cinder/volume/drivers/macrosan/devop_client.py 14:13:05 Ugh. 14:13:48 yeah, that's a 1358 line change just on that file 14:13:55 And we asked them to just do the revert. 14:14:03 i'm not really familiar with CI system, but i think the only way to allow CI to function is to let them do the refactor which is just adding lines 14:14:24 or change the CI functionality 14:14:28 i'm not sure 14:14:31 Can we have them submit the refactor as a dependent follow-up patch? 14:15:09 whoami-rajat: this is ruffian-sheep working on this, right? 14:15:24 but i see more changes 14:15:27 rosmaita, yep 14:15:44 some function name changes and parameters as well 14:15:49 yeah, i see him in the cinder channel all the time 14:16:40 so whoami-rajat, as you understand it, the situation is that the revert-only patch passes all *our* CI, but not theirs 14:17:13 yep 14:18:10 i don't know what to do ... they have worked really hard on the CI, which is great, we want to encourage that 14:18:24 but we don't want to merge something that doesn't pass their own ci 14:18:31 even the logs aren't available to check the failure 14:19:22 yeah, it's important for them that their driver is marked supported for ussuri 14:20:14 smcginnis: how much would the release team scream if we try to get this as an RC-2 ? 14:20:42 That should be fine. 14:21:04 And if small updates are needed to the revert to get it to work now, that is fine. 14:21:11 ok, thanks 14:21:19 But it can't be changing ever single line in the file like they've been doing. 14:21:35 right, i don't know how that is even happening 14:21:51 whoami-rajat: you are probably closest to their time zone 14:22:00 At least part I'm assuming is changing LF to CRLF. 14:22:43 whoami-rajat: can you work with ruffian-sheep a bit more 14:22:51 rosmaita, yeah, i will update him but it would be great if any driver maintainer helps them as i think the main issue is regarding the CI 14:23:07 good point 14:23:19 any driver maintainer volunteers? 14:24:14 c'mon, it's worth karma points 14:24:49 i will try to help him work it out 14:25:21 ok, and hopefully some driver maintainer will remember that what goes around, comes around, and will also help 14:26:00 ok, so our official stance for the record is: 14:26:08 :D 14:26:37 we will give them until early next week to get this sorted out 14:26:43 smcginnis: How is that generic CI setup coming? ;-) 14:26:48 i guess must merge by tuesday? 14:27:09 jungleboyj: Haha, nowhere. 14:27:13 i think that's reasonable time to work it out 14:27:19 :-) 14:27:50 ok, i already see some bugs nominated on the rc-potential etherpad, so we're most likely going to have an RC-2 14:28:03 which will allow me to procrastinate on the release note 14:28:26 ok, thanks everyone, i know it's a boring discussion, but very important to the party concerned 14:28:43 #topic NetApp E-series driver discussion 14:28:44 rosmaita++ 14:28:50 Kvisle: that's you 14:28:59 i think most of this has been discussed on the agenda? 14:29:08 Hi 14:29:22 It seems so, but if I understand it right: 14:29:53 - Someone needs to step up and take driver maintainer and CI-responsibility for a new driver which CAN be based on the old code. That someone is very unlikely to be Netapp. 14:30:09 (needs, as in ... for me to get what I want) 14:30:46 Have I understood things correct? 14:30:54 yes 14:31:16 only thing i would add is "extremely very unlikely" 14:31:37 but in any case, if you want to use it for lenovo hardware 14:31:50 would be better testing it on an actual lenovo backend anyway 14:31:57 Whoa, did someone say Lenovo? 14:32:05 Yes 14:32:20 jungleboyj: line 90 on the agenda 14:32:25 Lenovo DE-Series are based on Netapp E-series, that's the case in point why I want to revive the driver 14:32:51 Whoa. So you are reviving the E-Series driver for DE-Series? 14:33:01 Kvisle: your interest is mainly as a driver consumer, is that correct? 14:33:42 I could probably do this for a week a year at most 14:33:48 so yes, consumer 14:33:56 I have a question regarding the deprecation announcement which I found odd -- it was suggested that one should use the LVM driver in stead. I have no idea how that would solve any problems whatsoever. Is there anything I don't understand about how the LVM driver works? 14:35:00 Maybe the suggestion was to use LVM on top of a pool of storage provided by the E-Series? 14:35:18 smcginnis: yes 14:35:28 Ah, interesting. 14:35:40 That's certainly an option for any storage that doesn't have its own driver. 14:35:50 ++ 14:36:30 jungleboyj: is there any interest at lenovo in doing this? 14:36:35 Or ceph. I don't have the telemetry results right now but our customers tends to use eseries w/ lvm or ceph 14:36:37 Though, I was frustrated when the e-series driver got deprecated for this reason. 14:36:43 this == create a DE-series driver 14:37:16 :-) I would love to say yes but I pushed this internally a while back, when they were deprecating, and got no traction. 14:37:43 Kvisle: you don't happen to represent a transnational telco, do you? 14:38:10 He he. 14:38:22 I represent a service provider in Norway, which is pretty large in Norwegian sense :D 14:39:09 i guess your best bet is talk to your lenovo rep and see if you can get something rolling 14:39:20 That seems like the next step for me, yes. 14:39:42 ok, thanks for bringing this up. anything else? 14:39:52 No - that's it. Thank you. 14:39:58 Kvisle: Please feel free to reach out to me. I am at Lenovo and can do my best to get you in touch with the right people. 14:40:11 jungleboyj: that's great! 14:40:24 #topic Continued discussion of: Cinder throws error creating incremental backup from parent in another project 14:40:27 jbryant1@lenovo.com Will need to involve your account team as well though. 14:40:37 ganso: the floor is yours 14:40:52 ok so, I included as much info as I could in the agenda etherpad 14:40:58 I submitted patches for 2 possible fixes 14:41:04 they are very simple 14:41:15 but their semantics are ultimately different 14:41:26 and I don't see any technical disadvantage to any of them 14:41:34 so I think we need to decide which we will go with 14:41:53 can we state what the (a) and (c) options are again? 14:42:03 yes 14:42:18 so (a) will create the backup always in the same project as the volume 14:42:33 regardless of who creates it 14:43:32 (c) will have separate trees 14:44:07 The admin or anybody else that is not running the same project as the volume's project will not be able to create an incremental backup and will create a new full one, which the new incremental backups (for that project) will follow 14:45:04 #link https://review.opendev.org/#/c/720741/ 14:45:06 i think (a) is just the wrong thing to do 14:46:19 eharney: semantically feels wrong to me too. I actually was not sure (c) was simple until I implemented it 14:46:36 in the analisys etherpad I listed their dependencies. I intend to backport this to queens 14:47:21 I can't find the patch for solution (c) 14:47:22 I also found 2 more bugs, and both (a) and (c) require different fixes (one of each of those 2 new bugs). So it is double bug-fix, and the fixes are already included in the WIP pathces I submtited 14:47:35 would you mind to share it ganso ? 14:47:42 WIP Patches: https://review.opendev.org/#/c/720741/ and https://review.opendev.org/#/c/720833 14:47:48 thanks 14:48:10 I listed the 2 new bugs in the agenda etherpad as well 14:48:39 so, do we all incline to (c)? do we vote? 14:48:56 option (c) makes sense, if we have to patch up some things along the way, that sounds ok to me 14:48:56 btw, the CI is green on both. I got 2 runs on the (c) fix but CI failed in different voting jobs 14:49:08 I didn't trigger it again to spare CI resources 14:50:40 i may be misunderstanding this, but (c) seems to be much different from the current model, where any user can create an entry in the backup chain 14:50:57 (C) will give each user their own complete backup chain 14:51:05 i'm not sure it is 14:51:30 is it actually possible for a user to create a backup in the same chain as another user? i.e. an incremental based on someone else's full? 14:51:35 that seems like it should fail now 14:51:44 rosmaita: I believe the current model is kinda glitchy, as it causes the bug we are trying to fix, but it would be good for us to discuss what the proper expectations are 14:51:45 I agree with Eric on (a), that patch means that the demo user can delete backups created by the admin 14:52:00 eharney: User yes I think, but not different project. Is that what you mean? 14:52:18 eharney: yes, but they land in different projects. The chain (if you consider parent-child backups) is indeed just one currently 14:53:32 enriquetaso: but why exactly shouldn't this be allowed, if the volume owner is the demo user? 14:54:05 i meant different projects 14:55:15 if we want to have a single chain that can involve different projects, I think the fix is neither (a) or (c) 14:55:21 ok, so volume V in project P. User A and B in P. A creates a full backup of V, B then creates an incremental -- that sould be ok 14:55:38 ganso: i don't think we want that at all 14:55:51 rosmaita: yes that is ok. As users A and B are in P 14:55:59 yes, no cross-project shenanigans 14:56:16 ganso: ok, so on model (c), that will not be possible 14:56:20 also: would it make sense to have an tempest-like test to check those issues are (finally) working as expected, when the final decision is made? 14:56:25 A must create the incremental 14:56:38 or, B must do another full before creating an incremental 14:57:00 tosky: That would be great. 14:57:03 tosky: +++++++++++++++++ 14:57:15 ganso, what will be the state of backup if a user from some other project tries to create a backup? i guess it should be error 14:57:32 rosmaita: actually no, they are in the same project. When the admin creates the backup in the use case reported in the bug, the admin is not part of the project 14:57:58 ganso: right 14:57:59 rosmaita: I can double check that use case, but I am 99% sure it works for (c) 14:58:03 It is nice to have a test oriented person here! 14:58:17 ganso: i will read through the etherpad and leave some questions 14:58:24 we are just about out of time again 14:58:38 whoami-rajat: if the user of that other project can see the volume, then it will create another tree for fix (c) 14:59:16 so the current summary is eharney thinks that (a) is too restrictive 14:59:33 (a) is just the wrong model of ownership 14:59:56 1 minute warning. 14:59:57 ganso: even if you don't have time to write a series of tempest tests for this, could you please make sure to document the expected workflow and some negative tests which covers the discovered bugs are well documented in one of the etherpads, so that tests can be created based on them? 14:59:57 ok I will abandon (a) and focus on (c) 15:00:25 tosky: sure, but I think we are still debating on the expected workflow 15:00:31 yep, that's for the after 15:00:34 thanks! 15:00:36 ++ 15:00:50 ok, have to close now, continue in cinder channel 15:00:53 #endmeeting