| opendevreview | Tim Burke proposed openstack/swift master: utils: Add crc32c function https://review.opendev.org/c/openstack/swift/+/909800 | 00:13 |
|---|---|---|
| opendevreview | Tim Burke proposed openstack/swift master: s3api: Add support for additional checksums https://review.opendev.org/c/openstack/swift/+/909801 | 00:13 |
| opendevreview | Tim Burke proposed openstack/swift master: WIP: s3api: Additional checksums for MPUs https://review.opendev.org/c/openstack/swift/+/909802 | 00:13 |
| opendevreview | Tim Burke proposed openstack/swift master: Add support of Sigv4-streaming https://review.opendev.org/c/openstack/swift/+/836755 | 00:13 |
| opendevreview | Merged openstack/python-swiftclient master: CI: Fix py36 and py37 jobs https://review.opendev.org/c/openstack/python-swiftclient/+/910369 | 00:41 |
| opendevreview | Merged openstack/python-swiftclient master: Authors / changelog for 4.5.0 https://review.opendev.org/c/openstack/python-swiftclient/+/910267 | 01:50 |
| opendevreview | Anish Kachinthaya proposed openstack/swift master: add documentation for accessing expired objects https://review.opendev.org/c/openstack/swift/+/910286 | 02:43 |
| opendevreview | Matthew Oliver proposed openstack/python-swiftclient master: Add formpost subcommand to generate signature https://review.opendev.org/c/openstack/python-swiftclient/+/833954 | 03:09 |
| opendevreview | Jianjian Huo proposed openstack/swift master: proxy: use cooperative tokens to coalesce updating shard range requests into backend https://review.opendev.org/c/openstack/swift/+/908969 | 06:24 |
| opendevreview | Merged openstack/swift master: staticweb: Work with prefix-based tempurls https://review.opendev.org/c/openstack/swift/+/810754 | 07:42 |
| opendevreview | Alistair Coles proposed openstack/swift master: tests: create debug_logger in setUp https://review.opendev.org/c/openstack/swift/+/910505 | 12:40 |
| opendevreview | Alistair Coles proposed openstack/swift master: s3api: return 400 if partNumber and Range sent https://review.opendev.org/c/openstack/swift/+/906906 | 14:23 |
| opendevreview | Alistair Coles proposed openstack/swift master: s3api: Support GET/HEAD request with ?partNumber https://review.opendev.org/c/openstack/swift/+/894580 | 14:29 |
| opendevreview | Alistair Coles proposed openstack/python-swiftclient master: Add transaction id to errors https://review.opendev.org/c/openstack/python-swiftclient/+/903770 | 16:22 |
| opendevreview | Merged openstack/swift master: tests: Clear txn id on init for all debug loggers https://review.opendev.org/c/openstack/swift/+/909033 | 17:05 |
| opendevreview | Merged openstack/swift master: zero bytes manifests are not legacy https://review.opendev.org/c/openstack/swift/+/910443 | 17:34 |
| opendevreview | Jianjian Huo proposed openstack/swift master: common: add memcached based cooperative token mechanism. https://review.opendev.org/c/openstack/swift/+/890174 | 19:32 |
| opendevreview | Jianjian Huo proposed openstack/swift master: proxy: use cooperative tokens to coalesce updating shard range requests into backend https://review.opendev.org/c/openstack/swift/+/908969 | 19:32 |
| kota | good morning | 21:00 |
| mattoliver | morning! | 21:00 |
| mattoliver | timburke: we meeting today? | 21:02 |
| timburke | oh yeah! | 21:02 |
| timburke | #startmeeting swift | 21:02 |
| opendevmeet | Meeting started Wed Feb 28 21:02:56 2024 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:02 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:02 |
| opendevmeet | The meeting name has been set to 'swift' | 21:02 |
| timburke | who's here for the swift meeting? | 21:03 |
| mattoliver | o/ | 21:03 |
| kota | o/ | 21:03 |
| mattoliver | I might have to duck outside at some point as someone is coming to borrow a honey extractor, and they may come during this meeting. Just a heads up :) | 21:04 |
| timburke | no worries :-) | 21:05 |
| timburke | first up | 21:05 |
| timburke | #topic swiftclient release | 21:05 |
| timburke | thanks for reviewing some swiftclient patches recently mattoliver! | 21:06 |
| timburke | we've got a release request up now for a 4.5.0 | 21:06 |
| mattoliver | nps, and nice! | 21:06 |
| timburke | #link https://review.opendev.org/c/openstack/releases/+/910210 | 21:06 |
| patch-bot | patch 910210 - releases - Release final python-swiftclient for 2024.1 Caracal - 2 patch sets | 21:06 |
| mattoliver | My bad fir not getting to it sooner as there are other patches that could have been good in the release.. but still have we have is better then it was before :) | 21:07 |
| mattoliver | *what we have is better then it was before | 21:07 |
| timburke | it doesn't include the transaction id or formpost subcommand, but that just ensures we'll have some notes to 4.6.0, right? ;-) | 21:07 |
| mattoliver | lol, good point ;) | 21:07 |
| timburke | kind of related to releases... | 21:11 |
| timburke | #topic unmaintained branches | 21:11 |
| timburke | there's also a proposal to move victoria through xena branches to unmaintained status | 21:12 |
| timburke | #link https://review.opendev.org/c/openstack/releases/+/910418 | 21:12 |
| patch-bot | patch 910418 - releases - [swift] Transition EM branches to Unmaintained - 1 patch set | 21:12 |
| timburke | there was a similar thing for yoga -- and it wound up involving some weird/annoying churn around release notes | 21:13 |
| mattoliver | sounds good to me, seeing as we at nvidia use master :P but would be nice to hear from redhat, as they're the ones who do the long extended maintence thing | 21:13 |
| timburke | so i might push for EOLing at least the client branches sooner rather than later | 21:13 |
| mattoliver | sounds like a good start | 21:13 |
| timburke | since client in particular so rarely gets stable patches | 21:14 |
| timburke | next up... | 21:15 |
| timburke | #topic py312 | 21:15 |
| timburke | most all the py312 patches have landed now! | 21:16 |
| timburke | iirc, tests should all pass now | 21:16 |
| kota | excellent | 21:16 |
| timburke | well, all *swift* tests | 21:16 |
| timburke | #link https://review.opendev.org/c/openstack/pyeclib/+/839643 | 21:17 |
| patch-bot | patch 839643 - pyeclib - Drop support for liberasurecode<1.4.0 - 10 patch sets | 21:17 |
| timburke | pyeclib has a lingering use of pkg_resources, which isn't so readily available in py312 | 21:17 |
| timburke | it was only being used to check the libec version, though -- so if we drop support for ancient libec, we get the pkg_resource cleanup "for free" | 21:18 |
| mattoliver | oh cool | 21:19 |
| timburke | that patch would also (finally!) put to bed | 21:19 |
| timburke | #link https://bugs.launchpad.net/swift/+bug/1639691 | 21:19 |
| patch-bot | Bug #1639691 - EC: Swift can return corrupted Data and be able to go data lost at isa_l_rs_vand policy with >=5 parities (Fix Released) | 21:19 |
| mattoliver | oh double awesome! | 21:19 |
| mattoliver | kk, I'll put it on my list to review | 21:19 |
| kota | that's much old one. | 21:20 |
| timburke | thanks. i can look at getting a pyeclib release together, too. i might wait until after the caracal cycle wraps, though, just to avoid some confusion | 21:21 |
| timburke | and if i'm doing that, i might freshen up p 817498 too :D | 21:22 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/817498 - pyeclib - Add Dockerfile to build manylinux wheels - 9 patch sets | 21:22 |
| timburke | it'd be *real* fancy if i could figure out how to get binary wheels published to pypi! | 21:23 |
| mattoliver | oh yeah :hmm: | 21:24 |
| timburke | i've been using them to great effect at home ;-) to the point that i often lean on my home wheels for various dev environments, too | 21:24 |
| timburke | oh! there was one more python-next patch i wanted to call out -- it's still just causing deprecation warnings on py312, but will cause failures on py313 | 21:27 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/887908 | 21:27 |
| patch-bot | patch 887908 - swift - Stop using cgi.parse_header - 3 patch sets | 21:27 |
| timburke | mattoliver took a look recently! (thanks!) it's still on me to follow-up | 21:28 |
| mattoliver | yup and when you do, I'll be ready to look again :) | 21:29 |
| mattoliver | or I could just double check things :P | 21:29 |
| mattoliver | *myself | 21:29 |
| timburke | i think there's a fair question of how much to fully support every possible variation of header params vs only as much as we seem to use ourselves | 21:30 |
| timburke | but i should take a closer look at which headers actually need this kind of parsing | 21:31 |
| timburke | next up | 21:32 |
| timburke | #topic expirer delay | 21:32 |
| timburke | there's been some good progress on the various expirer patches, and now we even have some docs patches! | 21:32 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/874806 | 21:33 |
| patch-bot | patch 874806 - swift - Add per account grace period to object expirer - 10 patch sets | 21:33 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/907762 | 21:33 |
| patch-bot | patch 907762 - swift - expirer: add per-container grace period - 8 patch sets | 21:33 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/909928 | 21:33 |
| patch-bot | patch 909928 - swift - add documentation for grace period - 5 patch sets | 21:33 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/874710 | 21:34 |
| patch-bot | patch 874710 - swift - Add x-open-expired to recover expired objects - 27 patch sets | 21:34 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/907774 | 21:34 |
| patch-bot | patch 907774 - swift - add enable open expired in proxy config - 13 patch sets | 21:34 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/910286 | 21:34 |
| patch-bot | patch 910286 - swift - add documentation for accessing expired objects - 3 patch sets | 21:34 |
| timburke | we might still want to squash some of those together (the last three, in particular, i think i'd rather see all as one patch), but i think they'll be able to land soon-ish | 21:36 |
| timburke | :-( i see at least one of those patches failed tests because of https://bugs.launchpad.net/swift/+bug/2028175 | 21:38 |
| patch-bot | Bug #2028175 - intermittent probe test failure: test_reconciler_move_object_twice (New) | 21:38 |
| mattoliver | oh a ton of work | 21:38 |
| timburke | and thinking about it more, i think it might hint at a general reconciler bug | 21:38 |
| mattoliver | yeah, and its a probe test, so at least something to dig into | 21:42 |
| timburke | basically: when we first see that an object in policy A should be in policy B, we create a job to move us from "object in A at time t0" to "tombstone in A at time t0_1 and object in B at time t0_2", right? | 21:42 |
| timburke | so when we later find out that it should *really* be in policy C... the proper, settled state depends on whether the reconciler was previously settled or not! | 21:43 |
| timburke | you could *either* end up with "B@t0_2 -> C@t0_4" *or* "A@t0 -> C@t0_2" units of work | 21:44 |
| mattoliver | oh right. | 21:45 |
| mattoliver | I would think that t0_2 would win, but I guess spit brain | 21:45 |
| timburke | unfortunately, i don't have a good clean way to fix it in mind (yet) | 21:45 |
| timburke | but we should probably think about it some more (especially if we want to have any hope of cluster-assisted policy migration) | 21:46 |
| mattoliver | +1 | 21:46 |
| timburke | all right, i think that's all i really wanted to bring up | 21:47 |
| timburke | #topic open discussion | 21:47 |
| timburke | anything else we should talk about? | 21:47 |
| mattoliver | I haven't really pushed any of my patches forward this week so probably not much to say. | 21:48 |
| mattoliver | So yeah I'm good. Expecting someone to turn up at anytime anyway :) | 21:49 |
| timburke | you pushed on https://review.opendev.org/c/openstack/python-swiftclient/+/833954 ! i'll take another look | 21:49 |
| patch-bot | patch 833954 - python-swiftclient - Add formpost subcommand to generate signature - 8 patch sets | 21:49 |
| mattoliver | oh yeah I did that | 21:49 |
| mattoliver | reworked it to look a little more like swiftclient's tempurl | 21:49 |
| mattoliver | including using all the existing time stuff (because that at least makes sense) | 21:49 |
| mattoliver | although it doesn't allow normal UTC times as the expires query param | 21:50 |
| timburke | nice! i was thinking i'd like to see that as a follow-up if nothing else :-) | 21:50 |
| mattoliver | originally I wanted to keep it just like it was in swiftclient so it wouldn't be confusing.. | 21:51 |
| mattoliver | but then realised people using swiftclient would expect it to be more familar to swiftclient rather then swift :) | 21:51 |
| mattoliver | sorry, originally keep it like it was in swift | 21:51 |
| timburke | still, if the user can specify a more readable timestamp, that's a definite win even if we're ensuring it's expressed as seconds-since-epoch | 21:52 |
| mattoliver | +1 | 21:52 |
| mattoliver | also the code was there in a helper method, so stupid not to use it :P | 21:53 |
| timburke | oh! something i probably won't act on just yet, but good to keep in mind: acoles expressed an interest in a new feature branch! give us somewhere that we could all collaborate on a new swift-native MPU implementation | 21:53 |
| zaitcev | python -c 'import time; print(time.time())' | 21:54 |
| zaitcev | swift-native what implementation? | 21:54 |
| mattoliver | oh we haven't needed one of those in a while. All the work Al has been putting into planning, yeah he has big plans and I might be warrented | 21:54 |
| timburke | multi-part upload -- sorry, S3-ism | 21:54 |
| mattoliver | zaitcev: I meant the formpost signature generation. | 21:55 |
| zaitcev | I dimly recall we talked about something like a new and improved SLO | 21:55 |
| timburke | yup! now that acoles is on it, it's way more likely to get to completion ;-) | 21:56 |
| timburke | i think https://bugs.launchpad.net/swift/+bug/1813202 is probably the most glaring reason we want something better than SLO -- there'll almost certainly be a new async-cleanup daemon involved | 21:56 |
| patch-bot | Bug #1813202 - s3api does not clean up orphan segment parts when MPU is overwritten (Confirmed) | 21:56 |
| mattoliver | there was a tool in swift to generate it. And have moved it to swiftclient (list we did for tempurl) and tempurl allows you to pass in seconds, or use abreviations or even provide and absolute UTC time when providing the expiry. | 21:56 |
| timburke | https://review.opendev.org/c/openstack/swift/+/800701 touches on some motivation, too, though | 21:56 |
| patch-bot | patch 800701 - swift - Delete s3api MPU segments when the manifest expires - 32 patch sets | 21:56 |
| timburke | conversely, we've *also* seen users unwittingly delete their segments then be confused as to why the large object stopped working... | 21:58 |
| timburke | i think it probably makes the most sense to hold off on creating the branch until we've got a starting point to hack on, but i'm excited to have something we think has enough scope and interest to warrant a feature branch again :-) | 21:59 |
| mattoliver | +100 | 22:00 |
| timburke | all right, we're at time | 22:00 |
| timburke | thank you all for coming, and thank you for working on swift! | 22:00 |
| timburke | #endmeeting | 22:00 |
| opendevmeet | Meeting ended Wed Feb 28 22:00:51 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:00 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/swift/2024/swift.2024-02-28-21.02.html | 22:00 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/swift/2024/swift.2024-02-28-21.02.txt | 22:00 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/swift/2024/swift.2024-02-28-21.02.log.html | 22:00 |
| opendevreview | Anish Kachinthaya proposed openstack/swift master: add documentation for accessing expired objects https://review.opendev.org/c/openstack/swift/+/910286 | 22:22 |
| *** Guest500 is now known as diablo_rojo_phone | 23:26 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!