Wednesday, 2023-09-27

klamathI noticed that new OS's format XFS with CRC=1 and reflink=1, is there any best practices on this front?  im assuming if we want the disk mountable past 2038 we should include these options for bigtime but is there any performance implications noticed on these two flags yet?16:42
opendevreviewAlistair Coles proposed openstack/swift master: sq: call _calculate_slo_attributes directly when needed  https://review.opendev.org/c/openstack/swift/+/89669618:15
opendevreviewClay Gerrard proposed openstack/swift master: Refactor SLO size/etag sysmeta tests  https://review.opendev.org/c/openstack/swift/+/89646619:09
opendevreviewClay Gerrard proposed openstack/swift master: slo: refactor GET/HEAD response handling  https://review.opendev.org/c/openstack/swift/+/89357819:09
opendevreviewClay Gerrard proposed openstack/swift master: slo: part-number=N query paramater support  https://review.opendev.org/c/openstack/swift/+/89457019:09
opendevreviewClay Gerrard proposed openstack/swift master: SLO drain manifests  https://review.opendev.org/c/openstack/swift/+/89672119:09
timburkeklamath, i don't know that anyone's looked into it specifically from swift's perspective. i'd expect the crc to be reasonably cheap, but i'm not at all sure what to expect out of reflink. we'd be interested in hearing about any performance differences you see, though!19:40
opendevreviewMerged openstack/swift master: diskfile: Pass extension when creating DiskFileWriters  https://review.opendev.org/c/openstack/swift/+/89482020:11
opendevreviewMerged openstack/swift master: proxy-server: fix node error limiting  https://review.opendev.org/c/openstack/swift/+/89052720:17
opendevreviewMerged openstack/swift master: proxy-server: add replicated GET path tests  https://review.opendev.org/c/openstack/swift/+/89580220:17
opendevreviewClay Gerrard proposed openstack/swift master: slo: refactor GET/HEAD response handling  https://review.opendev.org/c/openstack/swift/+/89357820:44
opendevreviewClay Gerrard proposed openstack/swift master: slo: part-number=N query paramater support  https://review.opendev.org/c/openstack/swift/+/89457020:44
timburke#startmeeting swift21:00
opendevmeetMeeting started Wed Sep 27 21:00:49 2023 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
opendevmeetThe meeting name has been set to 'swift'21:00
timburkewho's here for the swift team meeting?21:00
acoleso/21:01
zaitcevo/21:01
timburkeas usual, the agenda's at21:02
timburke#link https://wiki.openstack.org/wiki/Meetings/Swift21:02
timburke(though i forgot to update the date)21:02
timburkefirst up21:03
timburke#topic vPTG21:03
timburkeonly a month away now!21:03
timburkeplease vote on meeting times; i'll plan on selecting and scheduling them this coming week21:03
timburke#link https://framadate.org/liKzqQw5lZQW8Pvf21:03
timburkeand please add topics to the etherpad -- i haven't yet, either, but i know we have interesting topics to discuss!21:04
timburke#link https://etherpad.opendev.org/p/swift-ptg-caracal21:04
timburkeany questions/comments/ideas around the ptg?21:05
zaitcevWell, it's a vPTG. How about that.21:06
timburkeall right, next up21:08
timburke#topic py31221:08
timburkepython keeps moving forward! and it keeps removing things :P21:09
zaitcevLe sigh.21:10
timburke3.12.0 will be coming out next week, and i wanted to try to stay ahead of things a little, so i started testing out the latest rc21:10
timburkedependencies look like they'll be a little interesting...21:11
timburkegreenlet seems on top of it -- they've got their own rc out that seems to work on py31221:11
timburkeeventlet still doesn't technically support py310... though it seems to work well enough on py310 and py311 for our purposes21:12
timburke(and least, for a development environment -- there may well be some issues lurking that you'd notice in prod)21:13
timburkemaster eventlet on py312, though, doesn't work -- there are some ssl helpers that got removed, some changes to _thread that need to get mirrored in eventlet.green.thread...21:14
timburkeand keystonemiddleware (at least) is using pkg_resources, which has been removed21:15
timburkecoming back to code in swift: distutils has also been removed21:17
zaitcevNext step, port Swift from eventlet to Gunicorn.21:17
zaitcevUgh21:17
timburkewhich is the real story behind the chain ending at21:17
timburke#link https://review.opendev.org/c/openstack/swift/+/89647321:17
timburkethere's a handful of patches all removing our use of distutils; most of them are only in tests, only that last one touches code under swift/21:18
acoleskeystonemiddleware is out of tree right?21:19
timburkezaitcev, you say that -- i wonder if we might be able to really truly drop py2, then switch it all out to async stuff...21:19
timburkeacoles, yeah -- there are some unit tests that cause us to import it, though21:20
acolesah21:20
zaitcevacoles: if you're willing to do that, there's a far wider selection that just gunicorn.21:20
timburkehttps://github.com/openstack/swift/blob/master/test/unit/common/middleware/s3api/test_s3api.py#L38 in particular21:21
timburkezaitcev, and as a happy side-effect, own the wsgi server/http parsing part21:23
timburkewe've been doing that more and more anyway; may as well rip off the bandaid, right?21:23
acoles🩹21:24
timburketwo bits of good news on the py312 front:21:25
timburkefirst, we already got rid of our use of pkg_resources under swift/ -- though a quick grep says we still need to fix up test/unit/obj/test_auditor.py21:26
timburkesecond, there didn't seem to be any show-stoppers like the segfault we discovered when we started testing under py31121:27
zaitcevHow unfortunate, I bet it's what loads watchers.21:29
zaitcevI can look at that.21:29
zaitcevMeanwhile, acoles would do great to look at https://review.opendev.org/c/openstack/swift/+/787656, which I updated recently.21:29
timburkei think that's all i've got to say about py312 -- if you've got cycles to spare helping out, i could use some reviews on that chain (they should all be pretty quick!) and we ought to stamp out that last `import pkg_resources` that isn't in some `try/except ImportError` handling21:30
acolesack21:30
timburkezaitcev, yes and no -- see https://github.com/openstack/swift/blob/master/swift/common/utils/__init__.py#L5847-L5852 -- on newer python, we're fine using importlib21:31
timburkeall right, last topic i had21:33
timburke#topic stable gates21:33
timburkerecently, i wanted to backport a patch to wallaby to fix an issue noticed by klamath21:33
timburkethen was sad to see that most (all?) of the py2 jobs failed21:34
timburkethis got me looking at the broader state of stable gates in general21:34
timburke2023.1 and zed were fine; yoga and xena were also broken21:35
timburkeyoga is now fixed21:35
timburke#link https://review.opendev.org/c/openstack/swift/+/89628221:35
timburkebut i want to fix xena and wallaby as well -- so i'll probably be working on that over the next week21:36
timburkeonce those are working again (and i get that patch backported), i'll start checking even older branches21:36
timburkeall right, that's all i've got21:37
timburke#topic open discussion21:37
timburkeanything else we should bring up this week?21:37
zaitcev\()/21:38
timburkeall right, i'll let you guys go then21:41
timburkethank you all for coming, and thank you for working on swift!21:42
timburke#endmeeting21:42
opendevmeetMeeting ended Wed Sep 27 21:42:10 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:42
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2023/swift.2023-09-27-21.00.html21:42
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2023/swift.2023-09-27-21.00.txt21:42
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2023/swift.2023-09-27-21.00.log.html21:42
timburkethanks for all the reviews, zaitcev!22:35
opendevreviewJianjian Huo proposed openstack/swift master: Proxy: Use shard-format for auto cont GETs and updating  https://review.opendev.org/c/openstack/swift/+/89560222:38
opendevreviewTim Burke proposed openstack/swift stable/xena: [stable-only] Fix gate  https://review.opendev.org/c/openstack/swift/+/89632222:41
opendevreviewASHWIN A NAIR proposed openstack/swift master: slo: refactor GET/HEAD response handling  https://review.opendev.org/c/openstack/swift/+/89357823:40
opendevreviewMerged openstack/swift master: tests: swiftclient supports insecure  https://review.opendev.org/c/openstack/swift/+/89647023:41
opendevreviewMerged openstack/swift master: tests: boto is always <3.0  https://review.opendev.org/c/openstack/swift/+/89647123:41
opendevreviewMerged openstack/swift master: tests: Stop using distutils.dir_util.mkpath  https://review.opendev.org/c/openstack/swift/+/89647223:41
opendevreviewASHWIN A NAIR proposed openstack/swift master: slo: refactor GET/HEAD response handling  https://review.opendev.org/c/openstack/swift/+/89357823:45
opendevreviewMerged openstack/swift master: Swap find_executable for which  https://review.opendev.org/c/openstack/swift/+/89647323:50

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!