| opendevreview | Alistair Coles proposed openstack/swift master: sharder: emit misplaced stats to statsd https://review.opendev.org/c/openstack/swift/+/850904 | 10:04 |
|---|---|---|
| opendevreview | Alistair Coles proposed openstack/swift master: sharder: emit stats for shard DBs created or existing https://review.opendev.org/c/openstack/swift/+/850905 | 10:04 |
| opendevreview | Matthew Oliver proposed openstack/swift master: Sharder: Fall back to local device in get_shard_broker https://review.opendev.org/c/openstack/swift/+/850597 | 11:28 |
| opendevreview | Alistair Coles proposed openstack/swift master: sharder/replicator: emit stats for DBs created or existing https://review.opendev.org/c/openstack/swift/+/850905 | 13:03 |
| opendevreview | Alistair Coles proposed openstack/swift master: sharder: process deleted DBs https://review.opendev.org/c/openstack/swift/+/849548 | 14:51 |
| opendevreview | Alistair Coles proposed openstack/swift master: sharder/replicator: emit stats for DBs created or existing https://review.opendev.org/c/openstack/swift/+/850905 | 16:00 |
| opendevreview | Alistair Coles proposed openstack/swift master: Sharder: Fall back to local device in get_shard_broker https://review.opendev.org/c/openstack/swift/+/850597 | 16:04 |
| acoles | rebase ^^ | 16:05 |
| kota | good morning | 20:56 |
| timburke_ | kota, o/ | 20:58 |
| *** timburke_ is now known as timburke | 20:58 | |
| kota | timburke_: o/ | 20:58 |
| timburke | #startmeeting swift | 21:00 |
| opendevmeet | Meeting started Wed Jul 27 21:00:06 2022 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| opendevmeet | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| zaitcev | o | 21:00 |
| zaitcev | o7 | 21:00 |
| kota | hi | 21:00 |
| timburke | as usual, the agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
| timburke | first up | 21:01 |
| timburke | #topic sha1 deprecations | 21:01 |
| timburke | the server patches have merged! | 21:01 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/845862 | 21:01 |
| timburke | to walk back the deprecation a bit in tempurl | 21:02 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/833713 | 21:02 |
| mattoliver | o/ (sorry im late) | 21:02 |
| timburke | to do a similar sort of deprecation for formpost | 21:02 |
| acoles | o/ | 21:02 |
| timburke | i started on a similar patch for /info calls | 21:03 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/850787 | 21:03 |
| timburke | but it needs some more work -- maybe i'll get to it for next week | 21:03 |
| timburke | there's still one open question for me around the sha1 deprecation | 21:04 |
| timburke | and that's what should happen with the client backport at https://review.opendev.org/c/openstack/python-swiftclient/+/847398 | 21:05 |
| timburke | now that we've walked back the deprecation process such that sha1 is still allowed by default, i'm not sure it's still necessary. i'll follow up on it | 21:06 |
| timburke | anybody have any questions or comments about the patches? | 21:07 |
| zaitcev | not me | 21:07 |
| mattoliver | I'll revisit the client one too | 21:07 |
| timburke | thanks -- i'm not completely sure what was going on with the gate -- there's a decent chance that our non-master jobs are currently busted :-/ | 21:09 |
| timburke | all right. let's keep the merge-train rolling | 21:09 |
| timburke | #topic stuck sharding DBs | 21:09 |
| timburke | nothing new has actually merged yet here, but the outstanding patches are progressing well | 21:10 |
| acoles | we unstuck some dbs! | 21:10 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/849548 | 21:10 |
| timburke | for processing deleted DBs | 21:11 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/850597 | 21:11 |
| timburke | for trying harder to find a device to use as a handoff | 21:11 |
| acoles | that one is new since last week's meeting^^^ | 21:11 |
| acoles | the db's we're trying to get sharded are on nodes that are retiring and turns out they had no devices with non-zero weight in the ring :( so the sharder couldn't find a device on which to cleave shard dbs | 21:12 |
| acoles | the solution is to just *pick a device* for the temporary shard dbs, even if zero weight | 21:13 |
| mattoliver | Yeah so progress could be made | 21:14 |
| timburke | you can run into similar issues with the reconciler -- but since it would happen during the _post_replicate_hook(), we'd log the error then go ahead and delete the handoff (assuming everything sync'ed) | 21:14 |
| mattoliver | The latest patchset has the fallback moved to find_local_handoff_for_part so they both should get the fallback | 21:15 |
| acoles | ☝️ | 21:16 |
| timburke | 👍 i'll take another look this week | 21:16 |
| timburke | #topic SLO resource leak | 21:16 |
| mattoliver | Thanks | 21:16 |
| timburke | OVH spotted a bug recently: https://bugs.launchpad.net/swift/+bug/1980954 | 21:17 |
| timburke | and even provided a fix | 21:17 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/850357 | 21:17 |
| timburke | i had a thought for how we might make it a little less resource-intensive | 21:18 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/850782 | 21:18 |
| timburke | since the original patch would drain the response iter (which could amount to several gigs) before closing | 21:19 |
| timburke | thanks for helping review them both, zaitcev! | 21:19 |
| zaitcev | np | 21:19 |
| zaitcev | But I think I bikeshedded something there | 21:19 |
| zaitcev | Oh, I remember now, n/m | 21:19 |
| timburke | i feel i should point out that there is an upgrade concern for my follow-up, though: if you've still got pre-2.24.0 object nodes, the slo-delete call could 500 | 21:20 |
| zaitcev | Sorry, I'm not seeing the scenario. | 21:22 |
| zaitcev | The first patch just adds the drain. Seems like no impact. | 21:22 |
| zaitcev | The follow-up has 2 consistent actions that do not happen one without the other... And it's fully implemented on the proxy. | 21:23 |
| timburke | it's a concern in the follow-up. with it, if you've got an object-server that doesn't have https://github.com/openstack/swift/commit/e8b654f3 then it won't know about X-Backend-Ignore-Range-If-Metadata-Present, so it'll respect the Range that was sent and the json.loads() will fail | 21:24 |
| zaitcev | oh... that old | 21:25 |
| timburke | i could probably add some special casing to have it fall back to old behavior if it sees an SLO respond with just one byte... or we could just allow the 500, and let the client retry | 21:26 |
| timburke | yeah, it puts it at Feb 2020 -- part of why i wanted to flag it up and get people's opinions | 21:26 |
| timburke | well, we can sort it out on the review. maybe i'll at least try writing the fallback, see how bad it gets | 21:29 |
| timburke | #topic ring v2 | 21:30 |
| timburke | mattoliver has a +2 on | 21:30 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/834261 | 21:30 |
| mattoliver | yeah I do | 21:30 |
| timburke | anyone else want to weigh in before we go ahead and merge? | 21:30 |
| mattoliver | nows the chance to have a say on the new ring on disk format. | 21:31 |
| timburke | well, now, and the last two ptgs, and... ;-) | 21:32 |
| timburke | maybe i'll see if i can get clayg to take a look later by threatening him to have to support a new file format he hasn't thoroughly looked at :P | 21:33 |
| mattoliver | lol | 21:34 |
| timburke | all right. one last thing i forgot to add to the agenda | 21:34 |
| acoles | I'll try to cast an eye over it...but I can't promise | 21:34 |
| timburke | thanks acoles | 21:34 |
| timburke | #topic PTG in ohio | 21:34 |
| timburke | unfortunately, NVIDIA recently sent out an email saying "We are suspending business travel in order to prioritize our investments, effective immediately. Travel for internal meetings, conferences, and events should be cancelled. Use virtual meetings instead." | 21:34 |
| timburke | so... i don't think acoles, clayg, mattoliver, or i are likely able to go :-( | 21:35 |
| kota | oh | 21:36 |
| timburke | but i'd be happy to help with planning if other people are going to be able to get together there | 21:36 |
| timburke | to make sure you'd have a room, etc. | 21:36 |
| kota | could we plan another virtual setting of ptg for a specific project? | 21:36 |
| zaitcev | I see the final touch-up for dark data watcher is slated for PTG, so is this okay to poke acoles now? Since he's not coming anyway. | 21:38 |
| zaitcev | Well the ring v2 is clearly more important but I hope this is simpler | 21:38 |
| zaitcev | https://review.opendev.org/c/openstack/swift/+/787656 | 21:38 |
| timburke | i see no reason we couldn't do a virtual meetup outside of the context of a PTG :-) | 21:38 |
| acoles | +1 | 21:38 |
| kota | +1 | 21:38 |
| mattoliver | great idea | 21:39 |
| zaitcev | You know | 21:39 |
| zaitcev | When Covid just hit, in a few months our management started a crackdown on coworking speakeasies. | 21:40 |
| zaitcev | Apparently teams would get together in locked and abandoned offices | 21:40 |
| zaitcev | Or in hotels that still operated | 21:40 |
| zaitcev | We should rent a cabin at Lake Tahoe. | 21:41 |
| acoles | reminds me of the fallback to the airbnb in Dublin during the snow :) | 21:41 |
| timburke | i'd be real tempted :-) biggest trouble is getting someone to pay for flights for acoles, kota, and mattoliver ;-) | 21:42 |
| timburke | i guess the question then would be, when would you all like to do a virtual meeting? i'm guessing we'd want something along the lines of our previous vPTGs for structure... | 21:44 |
| timburke | maybe i'll put together a doodle poll to pick a week in the next couple months | 21:47 |
| timburke | all right, that's all i've got | 21:48 |
| mattoliver | that's a good idea. | 21:48 |
| timburke | #topic open discussion | 21:48 |
| timburke | anything else we should bring up this week? | 21:48 |
| acoles | depeding on if anyone is going to the in person ptg, we could go virtual the same week | 21:48 |
| acoles | that'd save me changing my calendar ;-) | 21:49 |
| timburke | now that the sha1 patches are mostly in order, i think i'll try to get a release together | 21:50 |
| timburke | let me know in the next week or so if there's any other patches you think ought to land before a release | 21:50 |
| mattoliver | kk | 21:51 |
| timburke | ok, i'm calling it | 21:52 |
| timburke | thank you all for coming, and thank you all for working on swift! | 21:52 |
| timburke | #endmeeting | 21:53 |
| opendevmeet | Meeting ended Wed Jul 27 21:53:03 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:53 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/swift/2022/swift.2022-07-27-21.00.html | 21:53 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/swift/2022/swift.2022-07-27-21.00.txt | 21:53 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/swift/2022/swift.2022-07-27-21.00.log.html | 21:53 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!