Wednesday, 2022-09-14

opendevreviewMerged openstack/swift master: Set irrelevant-files for openstacksdk-functional-devstack job  https://review.opendev.org/c/openstack/swift/+/85751100:49
opendevreviewOpenStack Proposal Bot proposed openstack/swift master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/swift/+/85691104:33
opendevreviewMatthew Oliver proposed openstack/swift master: trace: Add RequestTraceMiddleware with OpTel  https://review.opendev.org/c/openstack/swift/+/85755906:48
opendevreviewMatthew Oliver proposed openstack/swift master: Prepare tracing by adding a WSGI mixin for middlewares  https://review.opendev.org/c/openstack/swift/+/79781107:48
opendevreviewMatthew Oliver proposed openstack/swift master: trace: Add RequestTraceMiddleware with OpTel  https://review.opendev.org/c/openstack/swift/+/85755907:48
opendevreviewGhanshyam proposed openstack/python-swiftclient master: Switch to 2023.1 Python3 unit tests and generic template name  https://review.opendev.org/c/openstack/python-swiftclient/+/85670409:26
opendevreviewAlistair Coles proposed openstack/swift master: sharder: trivial tidy up of unit tests  https://review.opendev.org/c/openstack/swift/+/85760810:12
opendevreviewAlistair Coles proposed openstack/swift master: sharder: always get ranges from root while shrinking  https://review.opendev.org/c/openstack/swift/+/85771814:28
opendevreviewMerged openstack/swift master: sharder: trivial tidy up of unit tests  https://review.opendev.org/c/openstack/swift/+/85760816:50
opendevreviewAlistair Coles proposed openstack/swift master: sharder: always get ranges from root while shrinking  https://review.opendev.org/c/openstack/swift/+/85771817:11
opendevreviewAlistair Coles proposed openstack/swift master: WIP: sharder: update shard shard_ranges from root more often  https://review.opendev.org/c/openstack/swift/+/85290517:11
opendevreviewTim Burke proposed openstack/swift master: ring: Introduce a v2 ring format  https://review.opendev.org/c/openstack/swift/+/83426118:45
opendevreviewTim Burke proposed openstack/swift master: ring: Add a rebalance history in the ring  https://review.opendev.org/c/openstack/swift/+/83462118:45
opendevreviewTim Burke proposed openstack/swift master: Ring v2/history follow-up  https://review.opendev.org/c/openstack/swift/+/85554818:45
opendevreviewTim Burke proposed openstack/swift master: Add swift-ring-info utility  https://review.opendev.org/c/openstack/swift/+/85723418:45
opendevreviewTim Burke proposed openstack/swift master: proxy: Use last-primaries table  https://review.opendev.org/c/openstack/swift/+/85775818:45
opendevreviewTim Burke proposed openstack/swift master: Ring v2/history follow-up  https://review.opendev.org/c/openstack/swift/+/85554820:47
opendevreviewTim Burke proposed openstack/swift master: Add swift-ring-info utility  https://review.opendev.org/c/openstack/swift/+/85723420:47
opendevreviewTim Burke proposed openstack/swift master: proxy: Use last-primaries table  https://review.opendev.org/c/openstack/swift/+/85775820:47
*** timburke__ is now known as timburke20:59
kotamorning20:59
timburkeo/20:59
timburke#startmeeting swift21:00
opendevmeetMeeting started Wed Sep 14 21:00:03 2022 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
opendevmeetThe meeting name has been set to 'swift'21:00
timburkewho's here for the swift meeting?21:00
kotahi21:01
timburkesorry for missing the last meeting -- i fell down a bit of an existential hole trying to write my ptl candidacy, and still didn't get around to doing it21:02
timburkebut, i've finally caught up a bit on the mailing list! should've done it sooner21:02
timburkefirst up21:03
timburke#topic openstack antelope21:03
kotano worries, thanks for the ptl nomination21:03
timburkewith the zed cycle coming to a close, the official name for the next cycle is out! looping back to A, looks like the first release of 2023 will be OpenStack Antelope21:04
kotawe're back to A!21:04
timburkei vaguely wanted to propose we start taking letters from On Beyond Zebra, but never actually brought it up :-)21:07
timburkethink something like https://i.pinimg.com/originals/90/cc/de/90ccde246b7d04704388248e11a754a5.jpg21:07
kotalol21:08
timburkeanyway, not much to discuss about it, but figured i ought to announce it in case anyone else missed it21:08
timburke#topic ptg21:09
timburkei also discovered that the ptg in Ohio has been changed to be all-virtual again!21:09
timburke#link https://lists.openstack.org/pipermail/openstack-discuss/2022-August/029879.html21:09
timburkeunfortunately, i'd stopped paying much attention to emails with "ptg" in the title, as i knew we couldn't hope for much presence21:10
timburkebut fortunately, we *are* presumed to be attending!21:11
timburke#link https://lists.openstack.org/pipermail/openstack-discuss/2022-August/030225.html21:11
kotaoh, all-virtual21:11
timburkenot sure whether someone submitted an update to the team signup for me, or diablo_rojo or somebody just kind of knew that swift would want some time if it was virtual :-)21:12
timburkei still need to reserve some time slots -- i'll try to get a doodle up21:13
kota:-)21:13
timburkeand set up an etherpad21:13
timburkei'd also encourage everyone to register21:14
timburke#link https://openinfra.dev/ptg/21:14
* kota registered just now21:16
timburkethe dates are October 17-21 -- i think since it went virtual, we may have picked up an extra day21:16
timburkebut it's not far off now! a little over a month away21:16
timburkethose were the two main things i wanted to call out from the broader ecosystem21:17
timburke#topic ring v221:17
timburkethe only other thing i wanted to bring up was that i've continued to poke at the new ring format and mattoliverau's extension to it to add a rebalance history21:18
timburkea couple new patches came out of it21:18
timburke#link https://review.opendev.org/c/openstack/swift/+/85723421:18
timburkeadds a new swift-ring-info utility, which takes a ring.gz and tells you some basic info about it (what ring-builder version it corresponds to, which ring format version it uses, how many replicas, partitions, etc.)21:20
timburke#link https://review.opendev.org/c/openstack/swift/+/85775821:20
timburkeis a first pass at having the proxy use the rebalance history when trying to GET/HEAD21:20
timburkewe've seen some cases where that latter patch could come in handy: a lot of clients (including python-swiftclient) like to make HEADs before PUTting a bunch of data -- but if you've got issues with some nodes, you may not get back enough 404s to be confident in returning that to the client21:22
kotai see21:24
timburkein particular, we've occasionally had a node go offline and another primary be slow to respond -- and with the default rebalance_missing_suppression_count of 1, a set of responses like (404, timeout, no route to host) from primaries and nothing but 404s from handoffs,21:25
timburkethe proxy can't be sure whether the 404 was because the primary was recently given the assignment and waiting to be filled, or there's genuinely no data to be found in the cluster21:25
timburkethe idea of the patch is to add a for_read kwarg when getting more nodes -- when true, we add in nodes from the rebalance history at the start of the handoff list21:27
kotasounds nice21:28
timburkeand when we do, *we include an index* so it looks kind of like a primary -- that way, we can treat its 404 as more or less "authoritative"21:28
timburkeone of the last primary or the new primary could reasonably be expected to 404 during a rebalance, but presumably not *both* unless no one else has data, either21:29
timburkeit needs tests, but i've managed to use it to good effect in my saio21:29
timburkeanyway, that's all i've got for this week21:30
timburke#topic open discussion21:30
timburkekota, anything else you'd like to bring up?21:30
kotanot from me, thanks21:31
timburkeoh! one more thing: i'll be out of town next week -- in light of the ptg, i might see if mattoliverau is interested in running the meeting, but i think it's fair to assume we'll skip it21:32
timburkei'll make sure the agenda gets updated21:33
kotagood to know, I'll be in later summer vacation in the next week.21:33
kotaso I am going to be absent too.21:33
timburkeyeah, we may as well skip then :-)21:33
timburkeall right, i'll let you get on with your morning then21:34
kotathanks timburke21:34
timburkethanks for coming kota! enjoy your vacation21:34
timburke#endmeeting21:34
opendevmeetMeeting ended Wed Sep 14 21:34:21 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:34
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2022/swift.2022-09-14-21.00.html21:34
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2022/swift.2022-09-14-21.00.txt21:34
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2022/swift.2022-09-14-21.00.log.html21:34
kotalet me be offline for breakfast21:34
timburkehmm... so if we find an rsync tempfile at https://github.com/openstack/swift/blob/2.30.0/swift/obj/diskfile.py#L992-L993 -- do we ever clean it up? i mean, we don't want to be over-zealous in cleaning it up -- but surely we'd want to *eventually*23:23
*** timburke_ is now known as timburke23:33
timburkeah! it's the auditor: https://github.com/openstack/swift/blob/2.30.0/swift/obj/auditor.py#L302-L308 -- looks like we default to waiting a half-hour?23:35

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!