Wednesday, 2025-05-14

opendevreviewMerged openstack/python-swiftclient master: CI: Fix up the testing matrix  https://review.opendev.org/c/openstack/python-swiftclient/+/94968700:44
opendevreviewMerged openstack/swift master: Add support of Sigv4-streaming  https://review.opendev.org/c/openstack/swift/+/83675505:23
opendevreviewMerged openstack/swift master: utils: Add CRCHasher and crc32c implementation  https://review.opendev.org/c/openstack/swift/+/90980005:23
opendevreviewMerged openstack/pyeclib master: Drop support for Python 2.7, 3.5-3.9  https://review.opendev.org/c/openstack/pyeclib/+/93809805:32
opendevreviewMerged openstack/swift master: Drop support for py36  https://review.opendev.org/c/openstack/swift/+/94968405:37
opendevreviewAlistair Coles proposed openstack/swift master: Add config option for whether to skip s3_acl-requiring tests  https://review.opendev.org/c/openstack/swift/+/94971609:54
opendevreviewAlistair Coles proposed openstack/swift master: trivial: statsd tests: remove references to delegate methods  https://review.opendev.org/c/openstack/swift/+/94655910:03
opendevreviewAlistair Coles proposed openstack/swift master: Add test/s3api/test_object.py  https://review.opendev.org/c/openstack/swift/+/94199413:25
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: merge master to feature/mpu  https://review.opendev.org/c/openstack/swift/+/94976614:50
acoleswell that ^^ wasn't so bad14:52
opendevreviewAlistair Coles proposed openstack/swift feature/mpu: merge master to feature/mpu  https://review.opendev.org/c/openstack/swift/+/94976616:18
opendevreviewTim Burke proposed openstack/swift master: CI: run func tests during rolling upgrade job  https://review.opendev.org/c/openstack/swift/+/94978417:03
opendevreviewTim Burke proposed openstack/swift master: CI: run func tests during rolling upgrade job  https://review.opendev.org/c/openstack/swift/+/94978417:58
opendevreviewAlistair Coles proposed openstack/swift master: Configurable expiring_objects_task_container_per_day  https://review.opendev.org/c/openstack/swift/+/93337318:37
opendevreviewAlistair Coles proposed openstack/swift master: refactor: remove iter_task_accounts_to_expire  https://review.opendev.org/c/openstack/swift/+/91963918:37
opendevreviewAlistair Coles proposed openstack/swift master: Parallel distributed task container iteration  https://review.opendev.org/c/openstack/swift/+/91836618:38
opendevreviewAlistair Coles proposed openstack/swift master: Object-server: return 409 if x-delete-at is newer than queue entry  https://review.opendev.org/c/openstack/swift/+/93244718:38
opendevreviewAlistair Coles proposed openstack/swift master: Delete s3api MPU segments when expiring the manifest  https://review.opendev.org/c/openstack/swift/+/80070118:38
opendevreviewMerged openstack/swift feature/mpu: merge master to feature/mpu  https://review.opendev.org/c/openstack/swift/+/94976620:45
timburkealmost meeting time!20:53
timburke#startmeeting swift21:02
opendevmeetMeeting started Wed May 14 21:02:55 2025 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:02
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:02
opendevmeetThe meeting name has been set to 'swift'21:02
mattoliverWife is sick and I'm on kids, might not be very available this morning  😔21:03
timburkewho's here for the swift meeting?21:03
mattoliverKinda21:03
timburkemattoliver, oh no! hope she feels better soon! my wife and daughter are sick today, too21:03
timburkefortunately, she's at an age where having her home sick isn't so much of a disruption -- my son would need a lot more things21:04
timburkeas usual, the agenda's at21:04
timburke#link https://wiki.openstack.org/wiki/Meetings/Swift21:04
timburkefirst up21:05
timburke#topic aws-chunked21:05
timburkestuff's been merging!21:05
timburkethanks mattoliver!21:05
timburkeso we have support for the new protocol21:05
timburke#link https://review.opendev.org/c/openstack/swift/+/83675521:05
timburkeand crc32c available21:05
timburke#link https://review.opendev.org/c/openstack/swift/+/90980021:06
timburkenext up is to actually start verifying checksums during upload21:06
timburke#link https://review.opendev.org/c/openstack/swift/+/94407321:06
timburkeit needs a bit of work at the moment, though -- i tried bumping up our minimum-required boto3 (to make sure that we get a particular behavior in one of the cross-compat tests), but the new minimum requires py38+ :-/21:07
timburkei'm going to try to address that this afternoon21:08
timburkei also got a patch up at the end of the chain to address one of the known-gaps -- s3token support in particular21:09
timburke#link https://review.opendev.org/c/openstack/swift/+/94967121:09
timburkei don't think there's much to discuss about the chain, just wanted to give a status update21:10
mattoliverYeah it seemed it still needed some work21:10
timburke#topic dropping py36 support21:10
timburkewe're doing it!21:10
timburkeswift and pyeclib patches have already merged21:10
timburke#link https://review.opendev.org/c/openstack/swift/+/94968421:11
mattoliverI went a landing spree 21:11
timburke#link https://review.opendev.org/c/openstack/pyeclib/+/93809821:11
timburkeyeah you did :-)21:11
timburkeand i wrote a swiftclient patch when i did the swift one21:11
timburke#link https://review.opendev.org/c/openstack/python-swiftclient/+/94968521:11
mattoliverNow we just need to remove 3.7 for the chunked thing ;)21:12
mattoliverKk will look at the swiftclient one today21:13
timburkei'm hopeful that we can drop py37 (and probably py38) soon-ish -- i know mattoliver and alexander have been trying to get us (NVIDIA) off py37 and onto py31021:13
timburkebut even just dropping py36 should unblock some other work, like some packaging issues other folks have seen21:13
timburke#link https://review.opendev.org/c/openstack/swift/+/899958/21:13
timburkespeaking of swiftclient...21:14
timburke#topic swiftclient release21:14
jianjianrecently I was blocked by one failed py36 test case, that's awesome we are going to get it removed!21:14
timburkewe're getting close to the Flamingo-1 milestone, so the release team is looking for a client library release from us. i'll work on getting an authors/changelog patch up this week21:15
mattoliverKk, let's double check the open client patches as well then 21:16
timburkei think the only thing i'd really like to see land before we cut a release is that drop-py36 patch -- if anyone has others, let me know21:16
timburkeoh, maybe there are a few other things we oughta dust off: https://review.opendev.org/q/p:openstack/python-swiftclient+is:open+-age:52w+branch:master21:18
timburkei'll try to take a look at the formpost patch21:18
timburke#link https://review.opendev.org/c/openstack/python-swiftclient/+/83395421:18
timburkei feel like it was close21:18
jianjianI will look at this patch again: https://review.opendev.org/c/openstack/python-swiftclient/+/91870121:19
timburkethe default-encoding thing seems... unfortunate :-(21:20
jianjianit broke my testing of very large number of uploads a few times, if there is no pending review issue, let's get it merged.21:20
mattoliverPartnum support seems pretty useful too.. so I'll take a look at that. (And any follow ups on the form post one, thanks Tim, I haven't looked at that in ages too)21:21
jianjianI mean that issue broke my testing, I did not see the issue happening with the fix "Fix retries for bytes, BytesIO"21:22
timburkei mean, what i'd *really* like with the partnum work would be parallel downloads -- but i don't think we could realistically get that together this week21:22
mattoliverYeah kk21:22
timburkebut yeah, retrying with bytes and BytesIO seems like it ought to be a no-brainer21:23
timburkeall right, i've just got one more topic this week21:23
timburke#topic s3api and conditional writes21:23
timburkewe had a user report of 501s the other day, and i *think* it comes down to AWS having added support for if-match and if-none-match like a year and a half ago or so21:24
timburkei didn't get direct evidence of it, but it sure seems like what's going on is the library they're using wants to send `if-none-match: *` during PUTs to prevent overwrites21:26
timburkebut swift already supports that! so i put together a patch to have s3api allow the request through21:26
timburke#link https://review.opendev.org/c/openstack/swift/+/94968021:26
timburkeit'd be nice if we could eventually support the full range of conditional write headers, but i worry that we'll want to get full-consistency before trying, or users will be disappointed and confused21:28
timburkeall right, that's all i've got21:29
timburke#topic open discussion21:29
timburkeanything else we should talk about this week?21:29
mattoliverGreat I'll take a look (if-none-match) patch21:31
timburkethanks21:31
mattoliverNope, I mean I think the so_tomestamping patch is coming along. 21:31
indianwhocodeso/21:32
mattoliverI've been seeing an intermittent test failure, not sure it's related, will check on master today.21:32
jianjianyeah, "if-none-match: *" would be useful to unblock some users to keep their app or database working with swift21:32
mattolivertimburke: how do you think ring 2 is looking?21:32
timburkeyeah! i'm confused by those spotty failures, too, mattoliver21:32
jianjianwill finish review on that as well21:33
timburkeafaik, ring v2 is pretty good. i went and took out some unneeded interfaces i'd added to the RingData structure; i should probably poke clayg about re-reviewing21:34
mattoliverKk21:35
jianjianclay was also happy with the swiftclient fix byte retries patch, I just sent it to be merged: https://review.opendev.org/c/openstack/python-swiftclient/+/91870121:38
timburkegate's not happy tho :-(21:39
timburkeall right, i'm gonna call it -- sounds like my kid does need some help21:39
timburkethank you all for coming, and thank you for working on swift!21:39
timburke#endmeeting21:39
opendevmeetMeeting ended Wed May 14 21:39:54 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:39
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2025/swift.2025-05-14-21.02.html21:39
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2025/swift.2025-05-14-21.02.txt21:39
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2025/swift.2025-05-14-21.02.log.html21:39
-opendevstatus- NOTICE: Setuptools 80.7.0 broke python package installs for many affecting CI jobs. That release has been yanked and it should be safe to recheck failed changes.22:01

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!