Wednesday, 2024-02-21

opendevreviewMatthew Oliver proposed openstack/python-swiftclient master: Add formpost subcommand to generate signature  https://review.opendev.org/c/openstack/python-swiftclient/+/83395402:51
opendevreviewTim Burke proposed openstack/swift master: stats: Allow emission of labeled metrics  https://review.opendev.org/c/openstack/swift/+/89696805:16
opendevreviewTim Burke proposed openstack/swift master: Move proxy-logging to labeled metrics  https://review.opendev.org/c/openstack/swift/+/89696905:16
opendevreviewMatthew Oliver proposed openstack/swift master: SIGUSR2 signals print process info on wsgi servers  https://review.opendev.org/c/openstack/swift/+/90963705:23
opendevreviewMatthew Oliver proposed openstack/swift master: SIGUSR2 signals print process info on wsgi servers  https://review.opendev.org/c/openstack/swift/+/90963705:29
opendevreviewThomas Goirand proposed openstack/swift master: drive-full-checker  https://review.opendev.org/c/openstack/swift/+/90752310:45
opendevreviewThomas Goirand proposed openstack/swift master: drive-full-checker  https://review.opendev.org/c/openstack/swift/+/90752311:44
opendevreviewAlistair Coles proposed openstack/swift master: diskfile: add test_open_meta_file_unlinked  https://review.opendev.org/c/openstack/swift/+/90967414:39
zigoIs there a problem with the CI's release notes thingy?16:06
zigohttps://a2c2b9c0506b0b396571-e07636147bed59ede28bbdb888fbf884.ssl.cf1.rackcdn.com/907523/30/check/build-openstack-releasenotes/11422a7/job-output.txt16:06
timburkezigo, strange -- i know the stable/yoga branch was recently renamed to unmaintained/yoga; seems likely to be fallout from that? https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/V7H6M5ANYOMFWSZ5BJSWAXVNQCUXI6D7/16:16
opendevreviewClay Gerrard proposed openstack/swift master: test: all primary error limit is error  https://review.opendev.org/c/openstack/swift/+/90969116:17
timburkezigo, for the time being, i'd be content to drop the release note -- i usually put together a patch with all notes for a release anyway16:32
opendevreviewClay Gerrard proposed openstack/swift master: test: all primary error limit is error  https://review.opendev.org/c/openstack/swift/+/90969116:32
zigotimburke: If I remove the release notes, it wont trigger the job?!?16:33
zigoThat'd be surprising.16:35
timburkezigo, it only runs if a subset of files gets touched: https://opendev.org/zuul/zuul-jobs/src/commit/f2208ed3c350cbe2ea87a8be932cb36d23f8544b/zuul.d/python-jobs.yaml#L594-L59917:08
timburkewhich seems reasonable; nothing should have changed with regard to the built notes (short of some change in reno itself)17:09
opendevreviewTim Burke proposed openstack/python-swiftclient master: lint: Up-rev hacking  https://review.opendev.org/c/openstack/python-swiftclient/+/90949817:14
timburkezigo, actually -- i realized that i missed https://review.opendev.org/c/openstack/swift/+/908433 -- once that merges, the releasenotes job should pass18:29
patch-botpatch 908433 - swift - reno: Update master for unmaintained/yoga - 1 patch set18:29
opendevreviewMerged openstack/swift master: Add ClosingIterator class; be more explicit about closes  https://review.opendev.org/c/openstack/swift/+/90465218:35
opendevreviewMerged openstack/swift master: reno: Update master for unmaintained/yoga  https://review.opendev.org/c/openstack/swift/+/90843318:45
opendevreviewMerged openstack/python-swiftclient master: reno: Update master for unmaintained/yoga  https://review.opendev.org/c/openstack/python-swiftclient/+/90843118:45
opendevreviewTim Burke proposed openstack/python-swiftclient master: CI: constrain deps for tests  https://review.opendev.org/c/openstack/python-swiftclient/+/90978918:58
opendevreviewASHWIN A NAIR proposed openstack/swift master: s3api: return 400 if partNumber and Range sent  https://review.opendev.org/c/openstack/swift/+/90690619:15
opendevreviewMerged openstack/swift master: test: all primary error limit is error  https://review.opendev.org/c/openstack/swift/+/90969119:52
opendevreviewASHWIN A NAIR proposed openstack/python-swiftclient master: Support part-num in python swiftClient  https://review.opendev.org/c/openstack/python-swiftclient/+/90202020:07
timburke#startmeeting swift21:05
opendevmeetMeeting started Wed Feb 21 21:05:45 2024 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:05
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:05
opendevmeetThe meeting name has been set to 'swift'21:05
timburkesorry, got distracted working on a patch :-)21:05
mattoliverhow dare you :P 21:06
mattolivero/21:06
timburke#topic releases21:06
timburkeit's that time again! i really need to get some new releases proposed soon21:07
timburkei think the deadline for client's technically next week, but iirc they like it if i do it a little earlier21:07
timburkeif you've got any more patches to get in this cycle, now's a good time to get them on people's radars!21:08
mattoliverahh yeah kk. Well we have some python swiftclient patches to land so that's timely ;) 21:08
mattoliverThis one p 83395421:09
patch-bothttps://review.opendev.org/c/openstack/python-swiftclient/+/833954 - python-swiftclient - Add formpost subcommand to generate signature - 7 patch sets21:09
mattoliverand the up-rev patch so I can run pep on py3.12 21:09
mattoliverp 90949821:10
patch-bothttps://review.opendev.org/c/openstack/python-swiftclient/+/909498 - python-swiftclient - lint: Up-rev hacking - 2 patch sets21:10
mattoliverThanks for lookin at the last one today timburke 21:10
timburkeyeah, i was about to thank you for that one -- i think it can definitely get in, and it was handy that it kicked the tires on the build-openstack-releasenotes job21:10
timburkep 848926 might be nice, too -- and we'll see where p 903770 is21:11
patch-bothttps://review.opendev.org/c/openstack/python-swiftclient/+/848926 - python-swiftclient - shell: Print friendly account byte quotas - 3 patch sets21:11
patch-bothttps://review.opendev.org/c/openstack/python-swiftclient/+/903770 - python-swiftclient - Add transaction id to errors - 5 patch sets21:11
timburkep 909789 might be good, too, though i'd need to investigate the entrypoints issue some more first21:12
patch-bothttps://review.opendev.org/c/openstack/python-swiftclient/+/909789 - python-swiftclient - CI: constrain deps for tests - 1 patch set21:12
timburkespeaking of cycles turning over, it's also election time, so there's another thing i should be doing but haven't 🙃21:13
mattoliverlol, timburke for PTL!21:14
claygtimburke: PTL for life!  don't quit on us like notmyname 😡21:14
mattoliverrofl21:14
timburkeyou two just don't want to find yourselves needing to do it instead ;-)21:14
clayg💯21:14
mattoliverthat and your great at it!!21:15
timburkea swift release will need to happen fairly soon, too -- so if there's anything you feel strongly about, add it to the priority reviews wiki (which i'll update after the meeting to at least pick up those swiftclient patches)21:16
timburke#link https://wiki.openstack.org/wiki/Swift/PriorityReviews21:16
mattoliverkk21:16
timburke(oh hey -- that still has p 809969 on it! we actually merged something we said we cared about!)21:17
patch-bothttps://review.opendev.org/c/openstack/swift/+/809969 - swift - sharding: don't replace own_shard_range without an... (MERGED) - 16 patch sets21:17
acoleswait, you mean we accidentally worked on a priority ;-)21:17
mattoliver\o/ the system works.. when we get acoles to fix it :P  21:17
timburkeok, i'm glad i'm not the only one feeling punchy this week :-)21:18
clayg🤣21:18
indianwhocodeso/21:18
indianwhocodeshttps://review.opendev.org/c/openstack/python-swiftclient/+/902020 is on my radar although i don't think it will be ready for the release until i managed to get it all the related part-num patches by next week!21:19
patch-botpatch 902020 - python-swiftclient - Support part-num in python swiftClient - 4 patch sets21:19
timburkeaside from that, i don't think i've really got anything new to bring up -- and since we've got so many, how about i just open up the floor for people to bring up more patches for the priority reviews page ;-)21:19
timburke#topic patchfest21:20
mattoliverlol21:20
indianwhocodeswe have https://review.opendev.org/c/openstack/swift/+/906906 that could use another pass21:20
patch-botpatch 906906 - swift - s3api: return 400 if partNumber and Range sent - 5 patch sets21:20
opendevreviewAlistair Coles proposed openstack/swift master: WIP s3api: add more MPU cross-compat  tests  https://review.opendev.org/c/openstack/swift/+/90775121:20
mattoliveroh yeah, I was going to take a look at the partnum chain.. will now that indianwhocodes is back!21:21
timburkeacoles, you reminded me that i never posted my attempt at resolving some of those! i should figure out where i put that...21:22
mattolivertimburke: I think we should add your static web tempurl prefix patch. I've +2ed it ;) 21:22
indianwhocodesI am still going through the chain, the one that has some unresolved comments that i need to address is this one ref : https://review.opendev.org/c/openstack/swift/+/89458021:22
patch-botpatch 894580 - swift - s3api: Support GET/HEAD request with ?partNumber - 96 patch sets21:22
timburkep 81075421:22
patch-bothttps://review.opendev.org/c/openstack/swift/+/810754 - swift - staticweb: Work with prefix-based tempurls - 14 patch sets21:22
mattoliverthanks, I was looking for it21:22
jianjianlooking at this one from acoles, https://review.opendev.org/c/openstack/swift/+/89091921:23
patch-botpatch 890919 - swift - proxy-server: de-duplicate _get_next_response_part... - 22 patch sets21:23
mattoliverI whipped up a "what about something like this" patch based on our SRE wanting to be able to get the error_limited nodes. Tracing will grab that for them too.. but who knows how long that'll take to land. p 909637 21:23
patch-bothttps://review.opendev.org/c/openstack/swift/+/909637 - swift - SIGUSR2 signals print process info on wsgi servers - 2 patch sets21:23
jianjianseems I need rebase it first21:23
mattoliverThat idea comes from a feature of dd. Which if you send a USR1 or USR2 (I forget which) it'll print the status. That's how you used to have to do it before more modern dd.21:24
mattoliverWe could also extend it to dump the dict and get the running work pids settings.21:25
indianwhocodesI want to rebase fix this one before the release next week.p 89091921:25
timburkep 89091921:25
patch-bothttps://review.opendev.org/c/openstack/swift/+/890919 - swift - proxy-server: de-duplicate _get_next_response_part... - 22 patch sets21:26
mattoliverNot married to it.. but was kinda interesting I thought. Tim mentioned maybe a domain socket api.. that could work too :) 21:26
acolesjianjian: indianwhocodes : why does this need rebasing https://review.opendev.org/c/openstack/swift/+/890919 ? 21:26
patch-botpatch 890919 - swift - proxy-server: de-duplicate _get_next_response_part... - 22 patch sets21:26
timburkeoh yeah yeah, jianjian mentioned that one, too :-)21:26
indianwhocodesit has a merge conflict, but it could use reviews too.21:27
timburkei like rebasing -- i could do that instead of writing a nomination email ;-)21:27
mattoliverlol21:27
acolesI don't see any merge conflict21:27
indianwhocodesAm I the only one seeting it, lol ?21:28
timburke:-/ gerrit sees it...21:28
acolesbut yes I'd love reviews21:28
jianjianI am seeing it too.21:28
indianwhocodeshttps://usercontent.irccloud-cdn.com/file/HQqRdTNy/Screenshot%202024-02-21%20at%201.28.21%E2%80%AFPM.png21:28
jianjiandoing rebase, conflicts in test/unit/proxy/controllers/test_base.py21:28
acolesugh yeah, caching :/21:29
jianjian++<<<<<<< HEAD21:29
jianjian +        factory = CaptureIteratorFactory(handler._iter_parts_from_response)21:29
jianjian +        with mock.patch.object(handler, '_find_source', mock_find_source):21:29
jianjian +            with mock.patch.object(21:29
jianjian +                    handler, '_iter_parts_from_response', factory):21:29
jianjian +                resp = handler.get_working_response(req)21:29
jianjian +                resp.app_iter.close()21:29
jianjian +        # verify that iter exited21:29
jianjian +        self.assertEqual({1: ['next', '__del__']}, factory.captured_calls)21:29
jianjian++=======21:29
jianjian+         with mock.patch.object(handler, '_find_source',21:29
jianjian+                                mock_find_source):21:29
jianjian+             resp = handler.get_working_response()21:29
jianjian+             resp.app_iter.close()21:29
jianjian++>>>>>>> c06296250 (proxy-server: de-duplicate _get_next_response_part method)21:29
indianwhocodesit is not a biggie21:29
indianwhocodesi believe its just one file21:29
acoleshah, that'll teach me to merge something! I'll get it sorted21:29
mattoliveroh hey I had draft comments on that.. that probably means I started reviewing it at some point.. will do that again.. and maybe reply this time : P21:30
indianwhocodeshttps://review.opendev.org/q/has:draft21:31
opendevreviewTim Burke proposed openstack/swift master: proxy-server: de-duplicate _get_next_response_part method  https://review.opendev.org/c/openstack/swift/+/89091921:31
indianwhocodestim taught me that ^21:31
mattoliveryeah, or I can just be surprised by past me on occasion :P 21:31
mattoliverthanks 21:31
timburke😳 mine goes on for more than one page...21:31
indianwhocodes😭21:32
mattoliveroh mine too21:32
mattoliverbugger21:32
mattoliverbut some are 6 years old.. better hit review on those :P 21:32
mattoliverwoah oldest is 9 years old.. bad Matt!21:33
claygi have a lot of draft comments on patches that are *merged* 🤷‍♂️21:33
jianjianTim fixed merge conflict, nice!21:33
mattoliveryeah me too21:33
jianjianI had one too :-)21:33
mattolivermaybe something like: https://review.opendev.org/q/has:draft+status:open but my gerrit-fu isn't as good as tims21:34
timburkeseemed pretty good to me :-)21:36
indianwhocodesp 83675521:37
patch-bothttps://review.opendev.org/c/openstack/swift/+/836755 - swift - Add support of Sigv4-streaming - 9 patch sets21:37
mattoliverturns out status:open covers merge conflict etc, so yeah seems to work.21:37
indianwhocodesTim, I know you took over and its messy code21:37
mattoliverOh yeah I looked. So are we taking it over then? 21:37
timburkeyeah, i'm still playing with that -- indianwhocodes, if you get a chance, maybe try warp against p 90895321:38
patch-bothttps://review.opendev.org/c/openstack/swift/+/908953 - swift - Get basic write support for mountpoint-s3 - 2 patch sets21:38
indianwhocodesnoted.21:38
opendevreviewAlistair Coles proposed openstack/swift master: proxy: don't use recoverable_node_timeout with x-newest  https://review.opendev.org/c/openstack/swift/+/90828721:39
mattoliverSeeing as we have other swift users submitting cool tools like p 907523 is it something we should try and review and get in too? 21:39
patch-bothttps://review.opendev.org/c/openstack/swift/+/907523 - swift - drive-full-checker - 30 patch sets21:39
mattolivermaybe I'll poke our SRE for them to take a look too. although our controller probably does similar things21:40
timburkemy plan for aws-chunked (currently) looks like p 909049, then "add support for additional checksum", then squash together the two patches for aws-chunked21:40
patch-bothttps://review.opendev.org/c/openstack/swift/+/909049 - swift - s3api: Improve checksum-mismatch detection - 1 patch set21:40
mattoliverkk21:40
timburkebut i owe patchsets for all that work (when i said i got distracted, that was what i was working on :-)21:40
mattoliverwell that's a good distraction and your definitely forgiven :) 21:41
indianwhocodesand you got labeled metrics as well, phew21:41
timburkei'd very much like to get the fullness checker in for this release -- it's a useful tool that people shouldn't need to reinvent everywhere21:42
mattoliver+121:45
indianwhocodesdum question but do you think we might need a doc in there ?21:45
acolesI need to drop, bye y'all :wave21:45
timburkewe could always use more docs ;-)21:45
timburkeacoles, o/21:45
acoles👋21:46
jianjianbye21:46
timburkeindianwhocodes, whether we should hold off on merging until there are docs kinda depends on the patch -- i generally err toward getting code out there, even if its under-documented, and if i feel like docs are *so* important that we *do* need them, take a stab at writing them myself21:47
mattoliverok big questoin.. if we're going to have a new swift release soon... should we make it the last one with py2 ;) 21:49
mattolivermaybe too big as question for 10mins left of meeting 21:49
timburkemattoliver, i'd love to! just as soon as i no longer have py2 code wanting to import it ;-)21:49
mattoliverI know.. just hoping we're getting close enough21:49
timburkewe've already *technically* dropped support for py2 for a while -- those poor fools still relying on py2 CI are on their own ;-)21:50
mattoliverand maybe light a fire under ourselves21:50
timburkeall right, i think we've got most of the patches out -- i think i'll call it (and get on with updating the priority reviews)21:54
indianwhocodesI had a minor suggestion for the channel head maybe we can interchange positions for priority reviews with logs, since i feel that takes precedence ?21:54
timburkegood idea! i'll see whether i can update the topic...21:55
timburkethank you all for coming, and thank you for working on swift!21:56
timburke#endmeeting21:56
opendevmeetMeeting ended Wed Feb 21 21:56:07 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:56
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2024/swift.2024-02-21-21.05.html21:56
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2024/swift.2024-02-21-21.05.txt21:56
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2024/swift.2024-02-21-21.05.log.html21:56
indianwhocodesthanks!21:56
timburkehttps://wiki.openstack.org/wiki/Swift/PriorityReviews updated!22:02
timburkeindianwhocodes, doesn't look like i can change it: "#openstack-swift :You're not channel operator" and attempting to op: "You do not have access to the OP command on channel #openstack-swift"22:13
timburkei could probably get someone else to change it, or give me permissions to op... but i'm not sure it's worth the effort22:15
clarkbtimburke: https://opendev.org/openstack/project-config/src/branch/master/accessbot/channels.yaml#L264 you'd edit this file entry to add you to a new ops listing for this channel (there are examples in the file)22:44
opendevreviewThomas Goirand proposed openstack/swift master: drive-full-checker  https://review.opendev.org/c/openstack/swift/+/90752322:47
opendevreviewTim Burke proposed openstack/swift master: s3api: Refactor how we handle expected errors  https://review.opendev.org/c/openstack/swift/+/75155523:02
opendevreviewAnish Kachinthaya proposed openstack/swift master: add enable open expired in proxy config  https://review.opendev.org/c/openstack/swift/+/90777423:27
opendevreviewTim Burke proposed openstack/swift master: s3api: Improve checksum-mismatch detection  https://review.opendev.org/c/openstack/swift/+/90904923:33
opendevreviewTim Burke proposed openstack/swift master: utils: Add crc32c function  https://review.opendev.org/c/openstack/swift/+/90980023:33
opendevreviewTim Burke proposed openstack/swift master: s3api: Add support for additional checksums  https://review.opendev.org/c/openstack/swift/+/90980123:33
opendevreviewTim Burke proposed openstack/swift master: WIP: s3api: Additional checksums for MPUs  https://review.opendev.org/c/openstack/swift/+/90980223:33
timburkestill pretty rough/ugly, but that's ^^^ what i'm thinking of putting in front of the aws-chunked stuff...23:34
timburkei still need to see what they do to listings on for-realsy S3, but i think the approach is mostly solid -- needing to touch the encrypter was a little unfortunate, though, and i still need to get some slo changes so it can validate segment checksums... and there's a whole host of error cases to investigate23:36
opendevreviewAnish Kachinthaya proposed openstack/swift master: add enable open expired in proxy config  https://review.opendev.org/c/openstack/swift/+/90777423:38

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!