| opendevreview | Jianjian Huo proposed openstack/swift master: proxy: add new metrics to account/container_info cache for skip/miss https://review.opendev.org/c/openstack/swift/+/885798 | 18:43 |
|---|---|---|
| opendevreview | Tim Burke proposed openstack/swift master: updater: Redirect to root on client errors https://review.opendev.org/c/openstack/swift/+/887740 | 20:07 |
| kota | Good morning | 20:56 |
| clayg | i pay like five bucks a month, or $10/yr or something for this irccloud account - maybe I should do a swift meeting every now and again!? | 20:57 |
| timburke | clayg, i mean, if you like, i can add an account for you to me znc ;-) | 20:58 |
| timburke | #startmeeting swift | 21:00 |
| opendevmeet | Meeting started Wed Jul 5 21:00:22 2023 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| opendevmeet | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| zaitcev | o7 | 21:00 |
| kota | o/ | 21:01 |
| clayg | kota: it was so good to see you in SF! | 21:02 |
| kota | clayg: absolutely! | 21:02 |
| clayg | zaitcev: I'm thinking about going to hang in Austin next - you wanna meet up and drive go karts or show me where you park your plane?! | 21:02 |
| timburke | i didn't get around to updating the agenda, but there's a handful of patches worth mentioning | 21:04 |
| timburke | #topic py311 testing | 21:04 |
| timburke | https://review.opendev.org/c/openstack/swift/+/886541 merged, giving us a voting py311 unit test job! | 21:04 |
| timburke | thanks clayg and mattoliver for reviewing | 21:05 |
| timburke | next step (imo) is to get a func test job going, too, or at least switching my dev env :-) | 21:06 |
| timburke | #topic ssync non-ascii metadata corruption | 21:06 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/884240 | 21:07 |
| timburke | could still use some reviews. i think i got unit test coverage for all the changes now, though | 21:07 |
| timburke | i think acoles is out this week, though -- might have to wait until next week | 21:10 |
| clayg | heh, I think i still dev on py3.8 - do we do a lot of different python versions with functests currently? | 21:11 |
| clayg | ssync metadata corruption! I thought the annoying metadata corruption bug you were dealing with had something to do with py3 pickles?! | 21:12 |
| timburke | 3.6, 3.8, and 3.9 iirc -- though i'll run 3.10 in dev (and at home) | 21:13 |
| timburke | clayg, it's another bug :-( | 21:13 |
| timburke | the first one was about reading py2 metadata after upgrading to py3; this one happens even in clusters that have *only ever been* py3 | 21:14 |
| clayg | oh you're right - i'm on 3.10 in dev too - py3.8 in prod, which is EOL after Q124! | 21:14 |
| clayg | yikes, sounds nasty - and we lucked out with encryption. it worked under py2 tho?! | 21:15 |
| timburke | clayg, no, we're py3.7 in prod, we're already in trouble ;-) | 21:15 |
| clayg | 😭 | 21:16 |
| timburke | ok, one more patch to draw attention to | 21:16 |
| timburke | #topic recoverable timeouts and SLO manifests | 21:17 |
| timburke | we noticed a (rare) issue where we'd get EC decode errors trying to do some ranged GETs into an SLO | 21:18 |
| clayg | zaitcev: kota: did y'all see https://bugs.launchpad.net/swift/+bug/2020667 when it came in? seems legit bad | 21:18 |
| kota | not yet. looking | 21:19 |
| timburke | i eventually tracked it down to an optimization i'd done to try to reduce the backend round-trips: previously, we'd try to get the range from the manifest, likely get back a 417, then need to make a new request to get the whole thing | 21:21 |
| timburke | following https://github.com/openstack/swift/commit/e8b654f3 though, the proxy would tell the object server to ignore any Range and send the whole object if it looked like an SLO manifest | 21:22 |
| timburke | the trouble is that when we hit a recoverable node timeout and try to pick up the stream with another node, we never *unset* that flag, so we get the whole object (er, frag archive) when we really *did* just want part of it | 21:23 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/887235 | 21:24 |
| timburke | should fix it, though | 21:24 |
| clayg | oh yeah, i remember that one! | 21:25 |
| clayg | nice find 👍 | 21:25 |
| timburke | i think that's all i've got for this week -- if anyone's got review bandwidth for the ssync bug or the recoverable timeout bug, i'd appreciate it | 21:27 |
| timburke | #topic open discussion | 21:27 |
| timburke | what else should we bring up this week? | 21:27 |
| timburke | all right, i'll call it then | 21:30 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:30 |
| timburke | #endmeeting | 21:30 |
| opendevmeet | Meeting ended Wed Jul 5 21:30:48 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:30 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/swift/2023/swift.2023-07-05-21.00.html | 21:30 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/swift/2023/swift.2023-07-05-21.00.txt | 21:30 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/swift/2023/swift.2023-07-05-21.00.log.html | 21:30 |
| clayg | zaitcev: do you have a bot that responds o7 to start meeting commands or are you really here? I'm going to track you down if I decide to make a trip to Austin this summer. | 21:33 |
| mattoliver | Oh bugger, I slept in and forgot about the meeting, school holidays has messed with my timing. Sorry. | 21:50 |
| zaitcev | clayg: Sounds cool. Write me to zaitcev@yahoo.com | 21:54 |
| timburke | mattoliver, no worries! i figured you were just on vacation or something ;-) | 22:21 |
| DHE | oh, activity! :) | 22:29 |
| opendevreview | Merged openstack/swift master: Fix handling of non-ASCII accounts https://review.opendev.org/c/openstack/swift/+/877146 | 22:48 |
| opendevreview | Merged openstack/swift master: tests: Stop requiring <1ms test runtime https://review.opendev.org/c/openstack/swift/+/887226 | 22:48 |
| opendevreview | Merged openstack/swift master: s3api: emit metrics for error responses https://review.opendev.org/c/openstack/swift/+/887267 | 22:48 |
| opendevreview | Merged openstack/swift master: docs: Format metrics in fixed-width font, not italics https://review.opendev.org/c/openstack/swift/+/884444 | 22:48 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!