21:00:46 #startmeeting swift 21:00:46 Meeting started Wed Feb 24 21:00:46 2016 UTC and is due to finish in 60 minutes. The chair is notmyname. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:00:48 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 21:00:51 The meeting name has been set to 'swift' 21:00:55 who's here for the swift team meeting? 21:00:58 o/ 21:01:02 . 21:01:05 o/ 21:01:05 o/ 21:01:06 o/ 21:01:08 Hi 21:01:10 o/ 21:01:12 hi 21:01:12 o/ 21:01:17 * onovy 21:01:17 hi 21:01:22 hello 21:01:29 o/ 21:01:39 hello 21:01:40 o/ 21:01:41 notmyname: np ;) 21:01:54 welcome, everyone 21:02:02 here 21:02:04 acoles: mattoliverau: cschwede: ? 21:02:08 acoles: :-) 21:02:12 o/ 21:02:48 thanks for coming. agenda is at 21:02:50 #link https://wiki.openstack.org/wiki/Meetings/Swift 21:03:21 sorry, just saw clayg going into a meeting... 21:03:26 a different meeting! 21:03:35 ok, first up...hackathon! 21:03:40 #topic hackathon 21:03:43 o/ 21:03:44 it's next week 21:03:50 #link https://etherpad.openstack.org/p/swift-hackathon-feb-2016 21:04:04 also, FWIW, no team meeting in here next week, in lieu of the hackathon 21:04:21 I hope everyone has all their travel logistics figured out 21:04:25 if not, good luck 21:04:52 there's a ton of great topics on the etherpad. please continue to update that. we'll use it as a starting point for our discussions next week 21:05:03 acoles: anything to share that we need to know about logistics? 21:05:08 (wear a coat) 21:05:15 yes, that ^^ 21:05:37 look for email I sent earlier today with a few more bits of info 21:05:47 thanks for keeping us informed on that 21:05:52 including my mobile number in case anyone needs that 21:05:54 are there any questions from anyone about the hackathon? 21:07:27 ok. that's easy, then :-) 21:07:33 phew 21:07:35 next up... 21:07:47 #topic reviewer stats and community-starred patches 21:08:11 if you haven't seen already, http://not.mn/swift/swift_community_dashboard.html is something that I've made and has had some success and usefulness to people already 21:08:13 #link http://not.mn/swift/swift_community_dashboard.html 21:08:32 3 areas on it. I'll sumarize quickly 21:08:56 review stats measures the time it takes for a patch author to respond to a reviewer and a reviewer to respond to an author 21:08:59 cool 21:09:16 current reported time is the mean. if I can find a better metric, I may switch to that 21:09:58 my goal is to keep "reviewers" winning. ie responding faster that patch authors. that means that any review holdup is on authors and not reviewers. the goal is to lower overall time a patch spends in review 21:10:06 second section is the community starred patches 21:10:20 that's the top 20 patches that are starred by the community 21:11:11 basically, if you've ever made any gerrit comment on any swift patch, I'll pull down whatever patches you currently have starred. then weight your star by your level of involvement in swift (active = higher score). then sum up to totals for each starred patch and take the top 20 21:11:26 the idea is that these are likely to be the patches that are most important to people in the community 21:12:01 my goal here is to encourage reviews on important things. I think this is slightly better than "the PTL has starred this, so I'll review it" 21:12:15 it lets us all vote on what's important to swift 21:12:54 the third section is a list of patches that have had zero comments from any reviewer, listed oldest first 21:13:00 the goal is to have this list be empty 21:13:23 any questions on it for now? 21:13:30 it's linked in the -swift channel topic, too 21:13:32 great idea, looking great 21:14:00 i would like to know the meaning of color. 21:14:32 no meaning. the only color rules are for visited and unvisited links 21:14:53 i see. thanks 21:14:55 thanks for all your work - great idea 21:15:15 I resurrected the stylesheet from a personal project I worked on probably 7 or 8 years ago. in related news, I no longer love CSS. CSS is evil ;-) 21:15:44 also, if you happen to love CSS and have a good eye for design, I've got some stuff you can work on ;-) 21:16:49 so third list looks sorted according to the date *last updated*, is it in your intention? 21:17:21 kota_: number 1 in the unreviewed patches should be the one that's been the longest without any comment or activity. 21:17:43 the data is coming from gerrit, whcih only sorts by last activity. I pull it down and pass it through reversed(). that's it 21:18:04 the idea is that the top of that list will be stuff that's languished the longest without comments 21:18:05 notmyname: is swiftclient included here? 21:18:05 i thought *listed oldest first* you said means oldest orderd the date of initial commit, maybe i was wrong, though :P 21:18:20 I realise it's never going to make the list even if it is :( 21:18:29 joeljwright: no. swiftclient is not yet included. I've got some integration with that staged, but it's not complete yet 21:18:39 make sense. 21:19:00 cool, thanks 21:19:06 joeljwright: I definitely want to have swiftclient included. it will not get left out 21:19:24 what I meant was due to the weighting it probably needs to be separated 21:19:30 the hardest part there will be the starred patches, actually. I've already got the review timings and unreviewed list done 21:20:11 FWIW, this is all tightly integrated with the same scripts that generate those graphs I've talked about before 21:20:18 acoles: cue eye rolling ;-) 21:20:24 yay! graphs! 21:20:49 i'm wondering how we could monitor whether a review that falls of the top 20 starred list has done so because it was merged, people removed stars, or it just got overtaken in time as more reviewers add more stars? 21:21:00 notmyname: you have to forgive and forget!) 21:21:05 lol 21:21:07 starflation 21:21:50 it's all a work in progress :-) 21:22:10 acoles: we need top of the pops style rank changes shown on each update 21:22:37 * acoles imagines it like the music charts "last week's number 2 drops to number 7" 21:22:47 joeljwright: right, that!) 21:22:52 acoles: lol 21:23:02 hello patchbot 21:23:19 ok, let's move on to talk about actual code stuff instead of all this meta-swift stuff ;-) 21:23:31 #topic auditors don't finish bug 21:23:38 https://bugs.launchpad.net/swift/+bug/1183656 21:23:38 Launchpad bug 1183656 in OpenStack Object Storage (swift) "object auditors don't finish" [Critical,In progress] - Assigned to Christian Schwede (cschwede) 21:23:45 patch 279440 21:23:46 notmyname: https://review.openstack.org/#/c/279440/ - swift - Skip already checked partitions when auditing obje... 21:23:47 notmyname, maybe I should borrow your CSS for the abandoner.. It uses none 21:24:05 cschwede: here? 21:24:15 what's the status of this patch and closing this bug? 21:24:57 mattoliverau: you left a review last week saying you had "a bit more to do". have you had a chance to do those things yet? 21:25:50 Yeah a little, been testing it, seems to be working, want to play/stress it a little more, will update later today 21:26:06 ok, thanks 21:26:25 I left a question for cschwede there too 21:26:36 But will chase it up today :) 21:26:42 since this is a critical bug that will block any release, I'd like to have another core added as a reviewer who is looking at it too. any volunteers? 21:27:03 yup 21:27:27 add in my task list to do today. 21:27:30 kota_: thanks 21:27:50 On a related note, torgomatic and patch 212824? 21:27:51 Zyric_: https://review.openstack.org/#/c/212824/ - swift - Let developers/operators add watchers to object audit 21:27:53 ideally, I'd love to see that land this week so we can roll a release next week 21:28:09 Zyric_: we'll get there in a bit :-) 21:28:15 Cool :) 21:28:17 oh, next release? last mitaka release? 21:28:41 onovy: perhaps. but maybe we can squeeze in two more. a bigger one and then a minor one 21:28:58 next week I want to look at the timings with everyone to see what's reasonable 21:29:01 because i have one big think which i want to land before mitaka release :) 21:29:11 *thing 21:29:17 ok, let's get to that in a bit 21:29:28 moving down the agenda wiki... 21:29:36 #topic copy middleware ready for review 21:29:48 tdasilva: you added this. is this for awareness or for a particular question 21:29:54 ? 21:29:58 just awareness 21:30:02 ok 21:30:07 first two patches there already have one +2 21:30:13 and are simpler to review 21:30:19 patch 260179 patch 263902 patch 156923 21:30:20 notmyname: https://review.openstack.org/#/c/260179/ - swift - decouple versioned writes from COPY 21:30:21 notmyname: https://review.openstack.org/#/c/263902/ - swift - Re-format the SLO manifest file on new multipart-m... 21:30:22 notmyname: https://review.openstack.org/#/c/156923/ - swift - Refactor server side copy as middleware 21:30:26 then the 3rd is copy middleware itself which is also ready for review 21:30:35 thank you for working on it 21:30:51 thanks to acoles, jrichli, ppai 21:30:57 note we now have in these patches copy middleware to the left of dlo/slo and copy_hooks are gone 21:30:58 yes. absolutely 21:31:03 gool! 21:31:08 also, *cool 21:31:20 goal! 21:31:21 wow 21:31:33 yay 21:31:36 and it also removes a blocker for crypto work, right? 21:31:40 it was a team goal! 21:31:41 I'll keep my eye in that one too (once back from doctors) 21:31:46 yes! thanks everyone 21:31:53 yes this is a blocker for crypto 21:32:01 ok 21:32:10 I suspect we'll be looking at these next week :-) 21:32:26 i already added it as a topic on the etherpad ;-) 21:32:26 :) 21:32:59 #topic swiftclient logging issue 21:33:05 patch 282363 21:33:05 notmyname: https://review.openstack.org/#/c/282363/ - python-swiftclient - Do not reveal auth token in swiftclient log messag... 21:33:18 this one is a critical issue blocking a swiftclient release 21:33:34 thanks joeljwright for grabbing it and getting a good patch set 21:33:55 we've worked through a few issues on this, so it's certainly ready for other reviews 21:34:21 I'm hoping to look at this one today 21:34:36 i'll try to get to it tomorrow 21:34:37 and that should allow for a swiftclient release, too 21:34:39 acoles: thanks 21:34:57 one question I did want to ask 21:35:02 yeah, what's up? 21:35:07 do we need to backport this for 2.7 21:35:18 the current code is not py26 compatible 21:35:27 and neither are the tests in general now 21:36:12 we've never backported anything for swiftclient before. and the way the release have changed, now that's possible, I suppose 21:36:16 we're only just announcing no more py26 21:36:27 and leaving them with a critical issue 21:36:37 joeljwright: how much work is the backport from your perspective? 21:36:38 was just a thought 21:36:45 nothing much 21:36:57 I used a dict comprehension because I could, so it's a trivial change 21:37:03 if there's a patch, I'm happy to backport it 21:37:20 I'm glad you mentioned somethng about that. reminded me of a skipped topic 21:37:26 but I don't know how to make a patch for a previous release 21:37:48 joeljwright: instead of branching off of master, branch off of stable/ 21:37:51 joeljwright: i can help 21:37:55 thanks acoles 21:37:59 acoles: thanks 21:38:04 #topic swiftclient docs 21:38:31 you may have noticed that our official in-tree docs, as presented on the openstack site, are rather terrible 21:38:33 #link http://docs.openstack.org/developer/python-swiftclient/ 21:38:43 just yesterday I found out why 21:39:11 for client projects, those docs are only rebuilt and republished for every release 21:39:19 for the server projects, it's done every commit (see http://docs.openstack.org/developer/swift/) 21:39:43 that would explain all the MIA docs 21:39:45 we've landed several good changes for swiftclient docs already. and there are several more proposed 21:39:47 joeljwright: right 21:40:02 so we can choose to do either the per release docs or the per commit docs 21:40:06 that's the choice before us 21:40:09 what do you think? 21:40:21 per release does seem to make more sense for clients 21:40:22 pros and cons? 21:40:31 once we have decent docs 21:40:55 joeljwright: I'm not sure I understand that. why is per-release better for a client? 21:41:02 I guess I don't see the difference... 21:41:08 they might not always update if there isnt a new release 21:41:10 People will be using the docs assuming it works for the latest stable.. So kinda makes sense 21:41:11 IMO per-commit is better because docs changes will get to users faster 21:41:17 well, changes in behaviour reflected before release might be confusing 21:41:33 notmyname: if we go per-commit, is there a url to use for the docs for a specific version? 21:41:35 Tho having the ability to update docs without having to cut a release is a big win 21:41:44 yeah, true 21:41:48 acoles: my question too 21:41:54 one idea I've heard is to have what acoles just said. soemthing for 2.7, 2.6, 2.X, etc 21:42:16 but then, shouldn't we do that for swift also? 21:42:55 it's a difficult question though - adding generally applicable updates to lots of places is a pain 21:42:58 also, I'm not really concerned with the general case (for a generic client, when is the best time to publish docs). I'm worried about our specific case. do we think per-commit docs will break end users of swiftclient 21:43:38 hopefully our release cycle will be fast enough not to confuse people 21:43:40 how does one for latest release and one for commit sound? Two links at the top level? 21:43:52 the python docs have a nice **introduced in version xx** style 21:44:06 for new features 21:45:01 #vote what's your initial opinion: should we build docs per release or per commit? per-release, per-commit 21:45:13 * notmyname doesn't know if that works. seems like no 21:45:28 #startvote what's your initial opinion: should we build docs per release or per commit? per-release, per-commit 21:45:28 Begin voting on: what's your initial opinion: should we build docs per release or per commit? Valid vote options are per-release, per-commit. 21:45:29 Vote using '#vote OPTION'. Only your last vote counts. 21:45:37 quick straw poll 21:45:38 #vote per-commit 21:45:40 #vote per-commit 21:45:42 #vote per-release 21:45:43 #vote per-commit 21:45:44 I'm thinking per release makes sense (I guess) but having docs managed 1 way to avoid confusion is better, so I think I'm leaning to per commit. 21:45:54 #vote per-release 21:45:55 #vote per-release 21:46:01 #vote per-release 21:46:02 i think swift and swift client should be consistent 21:46:08 #vote per-commit 21:46:09 #vote per-commit 21:46:09 #vote per-commit 21:46:12 #vote per-commit 21:46:12 #vote per-commit 21:46:16 #vote per-release 21:46:19 #vote per-release 21:46:26 #vote per-release 21:46:27 #vote per-commit 21:46:40 anyone else? 21:46:51 #endvote 21:46:52 Voted on "what's your initial opinion: should we build docs per release or per commit?" Results are 21:46:53 per-commit (9): gmmaha, siva_krishnan, notmyname, tdasilva, sarafraj, Zyric_, onovy, ho_away, mattoliverau 21:46:54 per-release (7): acoles, takashi, kota_, jrichli, torgomatic, joeljwright, timburke 21:46:59 very interesting 21:47:01 thank you 21:47:15 no agreement for now. we will discuss further 21:47:39 I'd be fine with per-commit if we had an obvious way of showing features that aren't yet available, and where major new features/changes were made 21:47:59 I'll bring this topic up again. for now, especially if we'll have a swiftclient release soon, it doesn't matter too much 21:48:06 :) 21:48:12 it's obnoxious when the docs have .do_what_i_mean() in them, and you want that, but it's only on master and not pypi 21:48:23 #topic auditor watchers 21:48:34 this is stuff torgomatic and Zyric_ are working on 21:48:34 torgomatic: +1 21:48:42 yes, watch them. WATCH THEM ALL 21:48:58 also note that Zyric_'s outreachy internship is officially over next monday. (although i hope she will stay involved) 21:49:03 i don't know...imagine when encryption gets delivered (i'm assuming there will be changes to client too), now if someone is searching on the web about the feature, they will find the docs for the server but not the client 21:49:11 I will :) 21:49:34 torgomatic: Zyric_: anythign we need to bring up here about the audit watcher patches? 21:50:30 Previously mentioned patch 279440 was blocking the object watcher getting through, and the object watcher is preventing the account watcher getting though 21:50:30 Zyric_: https://review.openstack.org/#/c/279440/ - swift - Skip already checked partitions when auditing obje... 21:50:55 I've got a revision I'm working on, but one of my unit tests ends up SIGINT-ing the testrunner somehow (!), and that kills the test run 21:50:57 so that's bad 21:51:35 wow. that sounds fun 21:51:46 (for me to hear about after you fix it) ;-) 21:51:52 Indeed that doesn't sound good. Is there any way I can help, or something else that might be useful I could do? 21:52:12 eh, I'll throw what I've got up there with a SkipTest in it so people can look 21:52:16 after the meeting, that is 21:52:19 ok, thanks 21:52:25 Thank you 21:52:34 #topic open discussion 21:52:42 onovy: you mentioned some patches you want in a swift release 21:52:51 yep https://review.openstack.org/#/c/238799/ 21:52:51 onovy: patch 238799 - swift - Change schedule priority of daemon/server in config 21:53:00 that hasn't landed yet? 21:53:12 bah! 21:53:13 no :( 21:53:31 New concurrent reads patch is up, just fyi 21:53:50 mattoliverau: great! 21:53:52 cool 21:53:56 And I almost have the sharding shrink algorithm working (I hope) 21:53:56 i would like to have review for patch 213608 21:53:57 ho_away: https://review.openstack.org/#/c/213608/ - swift - Add functional test for access control (container ... 21:54:00 onovy: I've starred it 21:54:07 notmyname: thanks 21:55:02 if you're gonna review stuff on a plane, merge this https://review.openstack.org/#/c/283828/ since it cuts 3 minutes (ish) off a full test run 21:55:02 torgomatic: patch 283828 - swift - Fix StatsD tests to not use real DNS 21:55:04 Turns out shrinking is rather complicated.. I might write a spec on it to get people's opinion 21:55:50 mattoliverau: I'm sortof of the mind that shrinking is v2. (but I haven't thought deeply about it recently) 21:56:16 If anyone can get a chance to review this patch it would be appreciated: https://review.openstack.org/#/c/283815/ 21:56:17 awelleck: patch 283815 - python-swiftclient - Query string functionality for containers 21:56:21 notmyname: how do we decide what bugs go critical to block a release? or...how do we ensure that non-critical bug fixes eventually make it into a release? we can't star bugs :) 21:56:35 notmyname: yeah, I'm OK with that too.. But I'm still going to push ahead :) 21:56:40 acoles: good question, and I don't have an answer other than "we talk about it" 21:57:13 awelleck: I'll add it to my list, but I may not get to it quickly 21:57:31 notmyname: for example https://bugs.launchpad.net/swift/+bug/1540884 IDK if I would argue it is critical but I'd like to see the fix land before mitaka 21:57:31 Launchpad bug 1540884 in OpenStack Object Storage (swift) "Object copied by container-sync may have older timestamp than source" [High,In progress] - Assigned to Alistair Coles (alistair-coles) 21:57:44 joeljwright: thanks 21:58:43 acoles: ok 21:58:54 time's up for this week's meeting 21:59:03 no meeting next week (in lieu of the hackathon) 21:59:11 :( 21:59:14 thank you for coming today. thank you for working on swift 21:59:17 #endmeeting