21:00:16 #startmeeting swift 21:00:17 Meeting started Wed Oct 18 21:00:16 2017 UTC and is due to finish in 60 minutes. The chair is notmyname. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:00:18 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 21:00:20 The meeting name has been set to 'swift' 21:00:22 who's here for the swift team meeting? 21:00:22 o/ 21:00:26 o/ 21:00:28 🌯 21:00:31 o/ 21:00:31 o/ 21:00:36 o/ 21:00:37 At least for the first little bit. 21:00:40 hi 21:00:45 hi 21:01:06 hi 21:01:08 torgomatic: is that a... burrito? 21:01:25 timburke: yep. burrito emoji is best emoji. 21:01:50 welcome to everyone, and torgomatic's burrito 21:01:54 Oh, that is what that is. I thought it was like a dinosaur arm or something. 21:02:07 #link https://wiki.openstack.org/wiki/Meetings/Swift 21:02:10 there's the agenda 21:02:30 note we didn't have an 0700 meeting (nothing was on the agenda, and no one brought up any topics) 21:02:57 #topic bug triage 21:03:06 let's go slightly out of order... 21:03:12 #link https://etherpad.openstack.org/p/swift-bug-triage-list 21:03:19 there's the bug triage etherpad 21:03:30 and tdasilva brough up the question of another bug triage day 21:03:36 tdasilva: any more to say on that? 21:03:54 #link https://bugs.not.mn/project/swift/bug_trends/None 21:03:57 not really..was just wondering if we shoud do it again or not... 21:04:44 everyone, please share your thoughts 21:04:54 seems like a good idea to me 21:05:01 I'm up for it 21:05:19 Can't believe it's been a month already! 21:05:39 yeah, probably would be good 21:06:08 IMO the main "good" of it is to have the designated time for it 21:06:25 just be careful that our outgoing bugs don't stay above our incoming bugs for too long, or we'll have to borrow bugs to make ends meet 21:07:03 if you need more bugs, I can get back to writing some patches... 21:07:25 torgomatic: lol that's the idea :p 21:07:35 Cinder has plenty of bugs ... we will share. 21:07:48 lol 21:07:59 so when do we do it? next week? in two weeks ont he 1st? 21:08:34 any strong preferences? 21:08:50 I don't mind, either works.. tho the 1st does sound cool 21:09:19 And just before the summit, for those gojnf 21:09:27 Going even 21:09:57 ^come on auto correction, can you guess what I'm saying this early :p 21:09:58 also has the advantage of being the next scheduled 0700 meeting day 21:10:28 any opposition to setting a bug triage day to two weeks from today? 21:10:44 Of no one else has other strong opinions, let's do the 1st.. sold 21:11:13 ok, two weeks from now it is 21:11:24 bug triage day scheduled! 21:11:26 wfm 21:11:32 * acoles adds it to calendar 21:11:34 #topic new release 21:11:34 I somehow managed to not much do bug triage on bug triage day last time 21:11:45 ... it mostly had to do with that day being already booked with meetings 21:11:57 do we need a new swift release soon? 21:11:59 ... and I can't just NOT do any coding ... 21:12:18 clayg: and the next bug triage day? You have 2 weeks to book it up again ;) 21:12:35 I'm inclined to say yes we should cut a release. there's some good stuff there, and it's been about 2 months since the last one 21:12:35 well - is it on a wednesday? I think I missed the decision/date? 21:12:35 notmyname: we *always* need a new release. it just keeps getting better! 21:12:42 timburke: right on! 21:12:46 timburke: +2 21:12:49 notmyname: this week is Quest M1, correct? 21:12:52 clayg: two weeks from today 21:13:05 tdasilva: +2 where are we at on openstack release-y bits? 21:13:18 I don't think that's mattered before, has it? 21:13:19 so it *is* on a wednesday :'( 21:13:35 clayg: you can do it on a tuesday if you want :-) 21:13:39 notmyname: not the specific date - but we're going to want to do a release for Q 21:13:47 notmyname: no, just a good coincidence for the downstream testers that do care about it thou... 21:13:49 notmyname: that's a good idea! I'll try that 21:14:20 lol, not Quest, Queens! 21:14:22 right. aside from the end-of-cycle release, the openstack milestone dates don't stongly influence us 21:14:30 * notmyname likes Quest better ;-) 21:14:58 clay or you can be an honorary Australian and do it on Thursday, case 2 weeks from today is a Thursday here ;) 21:15:02 maybe it just accident - but I always liked it when we do a "slight after the upstream with stuff we decided not to merge at the last minute for upstream" release - then something in the upstream RC phase as the "probably about what is going into the upstream release sans a few things that aren't quite polished/pushed" and then another one... FOR the upstream release 21:15:39 that ends up ~5-6 releases a year, or one every other month-ish and that feels about right more or less 21:15:53 the upstream queens release isn't until late february or early march 21:16:10 oh, so we're just late with our after pike release? 21:16:23 was pike 2.15 or 2.14? 21:16:23 only "late" if you expected it earlier 21:16:31 pike was 2.15.1 21:16:37 that was our last release about 2 months ago 21:16:53 ok... let me start over and rephrase :-) 21:17:19 let's do a release soon! I'll set up the priority reviews page, and please make sure you tage any bugs as critical that should block a release 21:17:22 :-) 21:17:43 this will be for swift 2.16.0 21:17:47 notmyname: good idea, and thanks :) 21:17:59 yeah so we're right on time? 21:18:27 Yup, it's the perfect time for release :) 21:18:35 pike was August 21:18:39 +1 21:18:51 https://wiki.openstack.org/wiki/Swift/version_map 21:18:57 pike was august 21 21:19:14 2 months ago, almost to the day 21:19:53 I'll get working on the logistics for it 21:20:26 and I think this will be good, especially considering the feature branches currently in play. gives us a reasonable lead time for landing one or more before the next release (or openstack q) 21:20:32 speaking of... 21:20:41 #topic ongoing work checks 21:20:51 how's container sharding going this week? 21:21:14 I know acoles has made some good progress on shrinking 21:21:15 notmyname: we should definitely release before landing some of the big feature branches 21:21:21 maybe? 21:21:34 what else is going on? anything you need to bring up for discussion or that blocks anything? 21:21:42 #link https://trello.com/b/z6oKKI4Q/container-sharding 21:21:47 Yeah, acoles has been working more on a new and better shrinking alg 21:21:53 I'm hopeful that the 'simpler' shrinking approach is going to do the job. 21:21:57 notmyname: timburke has the SLO heartbeat change - I think that's a good 'en 21:22:00 And related probe tests 21:22:08 oh... just on sharding - my bad 21:22:21 found some systemic bugs last week that once fixed have got the shrink test passing 21:22:49 Not as much work this week unfortunately. But that's mostly me being busy 21:23:13 acoles is awesome 21:23:16 this week I've been working on collating listings from multiple shards 21:23:29 mattoliverau: something blocking you that we can help with, or is it more on other $DAYJOB commitments? 21:23:38 me too :-( i at least got my merge commit in last friday, but i haven't done my follow-up address-review-comments patch yet (iirc) 21:24:55 Yeah, $DAYJOB.. and not giving me as much time :( home life a little busy this week too 21:25:09 ok 21:25:34 sounds good. thanks for all your work on it this week 21:25:45 how about the s3api work? 21:25:54 kota_: and tdasilva have been doing a lot there, I've seen 21:26:19 early of this week, swift3 got a new release 21:26:26 swift3 has had it's "final" tag 21:26:27 yay! 21:26:35 and I'm starting to migrate the code to s3api feature branch 21:26:45 and the code was merged to the feature branch? or has it not landedyet? 21:26:49 https://review.openstack.org/#/c/512284/ 21:26:50 patch 512284 - swift (feature/s3api) - Import all swift3 code as s3api 21:27:20 not yet, thought it's just a full copy though. 21:27:25 kota_: I started moving some of the files around: https://review.openstack.org/#/c/513170/1 21:27:26 patch 513170 - swift (feature/s3api) - Continue merge swift3 middleware 21:27:32 note to everyone that we are *not* preserving the git history from the swift3 codebase into swift 21:27:46 1. tdasilva minds to save git history.... 21:28:20 tdasilva: great 21:28:35 oh, yeah, 21:28:58 notmyname: thanks for covering the issue for notification to all 21:29:21 done for the 1, above. 21:29:26 any question on this? anything from kota_ or tdasilva for questions for the group? 21:29:48 note that when we do the final merge, it'd probably be nice to have one commit that is a straight copy, with follow-on commits to move things into position 21:30:08 timburke: that's what I was planning to 21:30:16 perfect :-) 21:30:27 timburke: kota's patch does that with some very minor changes 21:30:44 and then my follow-on patch starts moving things around 21:31:02 yup 21:31:45 kota_: maybe we can continue some planning after this meeting on #openstack-swift channel? 21:31:48 what is the burndown list for merge to master? Are we still defining that scope or do we have a pretty clear picture? 21:31:59 tdasilva: sure 21:32:16 clayg: excellent question 21:32:20 is there anything that looks like a "beta" - since for awhile going with the last commit to swift3 is probably a better option for new deployments than trying out s3api to figure out what we missed? 21:32:25 I have a general idea of the merge to master stuff 21:32:36 clayg: we started writing down some tasks on an etherpad, but I was thinking it would be nice to have a trello board like sharding.... 21:32:50 remove some of the s3_acls configs and redo how the bucket is mapped to (account, continaer) 21:32:57 tdasilva: +1 21:33:21 like torgomatic was talking bucket registries - I sure wouldn't want to see us starting this process if we're holding on that - but if stuff is going to "change wildy in backwards incompatible ways" after the merge we need to have something that steers people away from building on this new hawtness until we're ready to support it 21:34:00 https://etherpad.openstack.org/p/s3api-middleware 21:34:09 yep, I'd hate to have something on master that we then break compatibility with, because then we've either got to figure an upgrade path or deal with angry users 21:34:54 tdasilva: notmyname: to me that sounds like we're still defining scope ... but idk ... maybe we can get it "all" done w/o having massive pressure to continue to make (perhaps minor) improvements to swift3 21:35:15 kota_: tdasilva: can I set up a trello board for the eventual merge to master? 21:35:36 notmyname: sure, +1 21:35:39 torgomatic: i'm on with it "on master" and having integration testing hawtness going *while* we break it (personally) 21:35:44 sounds good. 21:35:48 but we'd have to make it like idk, BETA or something 21:35:51 clayg: yeah, your concern is that we'll have to keep updating swift3 while we're working on big s3api stuff before a merge to master? 21:36:04 clayg: as long as we've got enough barriers that people don't accidentally start using it, that 's probably fine 21:36:24 notmyname: well I saw us celebrate "we're done with swift3" and that means either we're close to a merge of s3api to mater or we're liars ;) 21:37:06 torgomatic: the point where people can start using it is when we get to stop working on swift3? 21:37:22 clayg: I think 'we're done with swift3' meant more as in: 'soft freeze, swift3 won't get more big ticket features' 21:37:25 i could be wrong about that point too... if the runway is short enough we can tell people to hold their breath 21:37:26 yeah, we're liars. i'm about to do some manual testing on my own 1.12.0.1, and i already see some of what 1.12.0.2 will need 21:38:04 or we can "work" on swift3 but not like "massive" efforts - just like small improvements and stuff that looks more like bug fixes (which I think kota & tim were planning on doing anyway) 21:38:06 not that i think a soft freeze on swift3 was a bad move -- i just need to keep customers happy 21:38:26 ok yeah soft freeze - i love it 21:38:34 timburke: right...maintenance mode?? 21:38:36 I'll get a trello baord updated with that so we can see what's left and how much we're liars or how close we are :-) 21:38:50 the idea is "don't go redesigning on implementing huge things in swift3 that's not where it's at; we could use help over here where it's at" 21:39:03 clayg: +1 21:39:15 timburke: thanks for the clarity 21:39:34 ok, next up.. 21:39:40 notmyname: i might have to pick one of these feature branches to start paying attention to :\ 21:39:48 i don't know that i added any clarity, but w/e... 21:39:54 clayg: no problem :-) 21:40:04 m_kazuhiro: kota_: I've seen a lot of discussion this week on symlinks 21:40:07 what's going on? 21:40:19 timburke: probably i was just confused - you do good speaking clearly - so when you talk it tends to clear things up for me ;) 21:40:35 Please wait a little.... 21:40:44 symlinks! 21:40:58 i thought m_kazuhiro got conclusions on some remaining issues. 21:40:58 we're gunna post to them and then 307 - it's amazing 21:41:09 m_kazuhiro: you want me to come back to this topic? 21:41:46 notmyname: If I can, it is good for me. 21:41:53 ok 21:42:16 clayg: any updates for the big "remove eventlet" work? 21:42:25 anything on pete's patch or tsync or anything? 21:43:12 pete is going to do another rev - it's going to be great 21:43:27 next thing from me on replication will be for priority db replicators 21:43:48 I think after that I'm probably mostly interested in worker pattern expansion beyond reconstructor 21:44:09 this is getting the goodness we've got in the object replicators into the DB replicators? 21:44:22 fwiw, we already see how that'd be nice to have on feature/deep :-) 21:44:35 oh, yeah, that makes sense :-) 21:44:40 i'm not sure when we're going to work on fixing the REPLICATE api rehash on-disk protoc stuff 21:45:11 clayg: is there anything you need from the rest of us? 21:45:43 i mean not unless someone has some cycles and really cares about reducing bullshit iops on object devices 21:46:33 i'm still in squeeze what we can out of what we have mode - but "somewhere" down the road i also have opinions about a better world... 21:46:33 rledisez: what's up with LOSF work? 21:46:45 clayg: :-) 21:47:01 not much. alecuyer's been working on finding that bug 21:47:11 a bit tricky, but he's on the right track 21:47:32 i hope better news next week 21:47:46 ok 21:47:55 m_kazuhiro: are you ready? 21:48:04 notmyname: OK 21:48:18 #link https://etherpad.openstack.org/p/swift_symlink_remaining_discussion_points 21:48:18 We got conclusions for some of remaining discussion points. Then, our remaining discussion points are only 2. And I’m updating symlink patch for review comments. 21:48:39 great 21:48:55 when do you expect to have it in gerrit ready for comments? 21:50:08 Last of next week of early of next next week. In my current plan. 21:50:22 ok, thank 21:50:27 #topic open discussion 21:50:40 we have a few minutes left. anything that needs to be brought up by anyone? 21:50:52 oh! clayg you mentioned the slow-SLO patch 21:51:12 slow slow slow 21:51:12 actually that's timburke's 21:51:24 well of *course* it's timburke's!? 21:51:25 Lol slow slow patch :) 21:51:50 https://review.openstack.org/509306 21:51:51 patch 509306 - swift - Let clients request heartbeats during SLO PUTs 21:52:12 @timburke you gunna fix the xml thing? with the in the response? 21:52:40 regardless I think it's a great idea and seems to WOMM 21:52:49 coverage/docs looks good 21:52:50 idk... i'd intentionally *not* called out support for xml responses, even though i knew it was available 21:52:56 I think it's pretty mergable 21:53:17 oh but the docs *do* call out xml? 21:53:28 maybe better for me to just rip that part out 21:53:52 i guess - except we *do* response xml - but then the xml response is acctually for a bulk delete :\ 21:54:10 oh - you mean just like don't respond xml!? 21:54:15 that plan I love 100% +# 21:54:35 #xmlwhatwhonow 21:54:54 clayg: so we can rip out xml but we can't have this opt-out because that could break clients? ;-) 21:56:12 notmyname: I think that's false equivalence - but i'm acctually open to any discussion on what needs to be done to get this patch mergable 21:56:19 I mean, a reasonable position is to rip out xml support when the client does opt-in, so that's a little bit of a joke :-) 21:56:24 clayg: WINKY FACE! 21:56:25 i'm mostly interested in getting the heartbeat api released - so... 21:57:12 yeah, it's a Good Thing to have 21:57:14 notmyname: yeah yeah - i'm not complaining! false equivalence is great technique to setup an argument! attack from a defensible posistion! 21:58:08 anyway... let's keep talking about XML responses to slow-SLOs in -swift and gerrit. and let's get this merged ASAP :-) 21:58:45 there's lot's going on. I don't know why I expect anything different, but wow. thank you, everyone, for your work to make swift awesome(r)! 21:59:06 +2 get merged! timburke let us know if we can help - you can't fix all the things (s3api, deep, slo)... acctually who am I kidding - this is timburke we're talking about - carry on 21:59:07 thanks for coming today 21:59:15 #endmeeting