| *** diablo_rojo has joined #openstack-swift | 00:03 | |
| *** paladox is now known as paladox_UK_IN_EU | 00:20 | |
| timburke | seongsoocho, \o/ glad to hear it | 00:32 |
|---|---|---|
| openstackgerrit | Tim Burke proposed openstack/swift master: py38: cgi lost some names https://review.opendev.org/688594 | 00:51 |
| timburke | rledisez, if you get a chance, i'd love to get your opinion on the state of the etag_quoter patch -- in particular, the conversation around https://review.opendev.org/#/c/700056/6/swift/common/middleware/etagquoter.py@21 | 00:56 |
| patchbot | patch 700056 - swift - Middleware that allows a user to have quoted Etags - 7 patch sets | 00:56 |
| *** paladox_UK_IN_EU is now known as paladox | 01:24 | |
| *** gyee has quit IRC | 01:52 | |
| *** psachin has joined #openstack-swift | 03:36 | |
| *** evrardjp has quit IRC | 05:34 | |
| *** evrardjp has joined #openstack-swift | 05:34 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: container-sync: Sync static links similar to how we sync SLOs https://review.opendev.org/698139 | 05:36 |
| openstackgerrit | Tim Burke proposed openstack/swift master: New Object Versioning mode https://review.opendev.org/682382 | 05:36 |
| openstackgerrit | Tim Burke proposed openstack/swift master: s3api: Implement object versioning API https://review.opendev.org/673682 | 05:36 |
| timburke | ^^^ my edits on the versioning chain | 05:36 |
| timburke | i kept the three patches we had stacked before, but moved the versioning-specific parts of p 698139 to the versioning patch (keeping just the static link stuff, some middleware re-org, and adding sync-to to get_container_info) | 05:38 |
| patchbot | https://review.opendev.org/#/c/698139/ - swift - container-sync: Sync static links similar to how w... - 15 patch sets | 05:38 |
| timburke | i'm still not entirely happy with the 412 stuff, but when i picked at it, things started to unravel :-/ | 05:38 |
| timburke | i'll see what i can do with it tomorrow | 05:39 |
| *** manuvakery has quit IRC | 05:42 | |
| *** manuvakery has joined #openstack-swift | 05:42 | |
| *** tkajinam has quit IRC | 06:01 | |
| *** tkajinam has joined #openstack-swift | 06:03 | |
| *** ccamacho has quit IRC | 06:26 | |
| *** tkajinam_ has joined #openstack-swift | 07:01 | |
| *** tkajinam has quit IRC | 07:03 | |
| *** heso has joined #openstack-swift | 07:12 | |
| *** tkajinam__ has joined #openstack-swift | 07:47 | |
| *** tkajinam_ has quit IRC | 07:50 | |
| *** ccamacho has joined #openstack-swift | 07:50 | |
| *** manuvakery has quit IRC | 07:54 | |
| *** tesseract has joined #openstack-swift | 07:56 | |
| *** f0o has quit IRC | 07:58 | |
| *** cjloader has quit IRC | 07:59 | |
| *** fungi has quit IRC | 07:59 | |
| *** ormandj has quit IRC | 07:59 | |
| *** toanster has quit IRC | 07:59 | |
| *** rledisez has quit IRC | 07:59 | |
| *** Jeffrey4l has quit IRC | 07:59 | |
| *** godog has quit IRC | 07:59 | |
| *** csmart has quit IRC | 07:59 | |
| *** Anticimex has quit IRC | 07:59 | |
| *** baffle has quit IRC | 08:02 | |
| *** Jeffrey4l has joined #openstack-swift | 08:02 | |
| *** godog has joined #openstack-swift | 08:02 | |
| *** Anticimex has joined #openstack-swift | 08:02 | |
| *** irclogbot_2 has quit IRC | 08:04 | |
| *** irclogbot_2 has joined #openstack-swift | 08:05 | |
| *** rdejoux has joined #openstack-swift | 08:12 | |
| openstackgerrit | Thiago da Silva proposed openstack/swift master: Return correct etag for raw manifest https://review.opendev.org/703933 | 08:17 |
| *** tkajinam__ has quit IRC | 08:29 | |
| *** tkajinam has joined #openstack-swift | 08:29 | |
| *** tkajinam has quit IRC | 08:35 | |
| *** rpittau|afk is now known as rpittau | 08:43 | |
| *** cjloader has joined #openstack-swift | 08:45 | |
| *** fungi has joined #openstack-swift | 08:45 | |
| *** f0o has joined #openstack-swift | 08:45 | |
| *** ormandj has joined #openstack-swift | 08:45 | |
| *** toanster has joined #openstack-swift | 08:45 | |
| *** rledisez has joined #openstack-swift | 08:45 | |
| *** orwell.freenode.net sets mode: +v rledisez | 08:45 | |
| *** openstackstatus has quit IRC | 08:48 | |
| *** pcaruana has joined #openstack-swift | 09:30 | |
| *** mkrai_ has joined #openstack-swift | 09:36 | |
| mkrai_ | Hello Everyone, I am trying to understand Swift worflow for PUT request. Is there any document available for the same? | 09:36 |
| tdasilva | mkrai_: not sure if there's any official docs, but found this online: https://openstack.nimeyo.com/104076/openstack-swift-internal-working-of-put-command | 09:51 |
| mkrai_ | tdasilva, Thanks I will take a look. | 09:53 |
| *** jistr has quit IRC | 10:06 | |
| *** jistr has joined #openstack-swift | 10:06 | |
| openstackgerrit | Merged openstack/swift master: Allow bulk to fwd some headers at tar extraction https://review.opendev.org/701736 | 11:03 |
| *** rpittau is now known as rpittau|bbl | 11:21 | |
| *** rcernin has quit IRC | 12:15 | |
| *** jvisser has joined #openstack-swift | 12:16 | |
| *** rcernin has joined #openstack-swift | 12:20 | |
| *** rcernin has quit IRC | 12:26 | |
| *** jvisser has quit IRC | 12:28 | |
| *** jvisser has joined #openstack-swift | 12:28 | |
| *** baffle has joined #openstack-swift | 12:38 | |
| *** csmart has joined #openstack-swift | 12:38 | |
| *** mkrai_ has quit IRC | 12:48 | |
| *** pawan-gupta has joined #openstack-swift | 12:57 | |
| *** rpittau|bbl is now known as rpittau | 13:00 | |
| *** jvisser has quit IRC | 13:23 | |
| *** mkrai_ has joined #openstack-swift | 13:24 | |
| *** mkrai_ has quit IRC | 13:50 | |
| openstackgerrit | Merged openstack/swift stable/train: py3: Fix formpost unicode filename issues https://review.opendev.org/703654 | 13:55 |
| *** jvisser has joined #openstack-swift | 14:02 | |
| *** jvisser has quit IRC | 14:07 | |
| *** jvisser has joined #openstack-swift | 14:24 | |
| *** mkrai_ has joined #openstack-swift | 14:28 | |
| *** pcaruana has quit IRC | 15:04 | |
| *** psachin has quit IRC | 15:13 | |
| *** gyee has joined #openstack-swift | 16:14 | |
| *** mkrai_ has quit IRC | 16:18 | |
| DHE | Anyone seen object servers hanging and ignoring connections until killed off? Stack trace of one of them: https://paste.centos.org/view/8b147894 I guess there's a lock deadlock somehow when syslogging based on the stack? | 16:23 |
| DHE | I assume some package needs updating... | 16:24 |
| *** ccamacho has quit IRC | 16:26 | |
| ormandj | anybody having issues w/ SLO + s3 api using the aws s3 cli (https://github.com/wbingli/awscli-plugin-endpoint) to specify custom endpoint, of course? we're seeing: "The Content-MD5 you specified did not match what we received." (400) errors on each part | 16:38 |
| *** tesseract has quit IRC | 16:41 | |
| ormandj | actually, seems to impact all usage of aws cli | 16:58 |
| ormandj | not just SLOs | 16:58 |
| *** mkrai has joined #openstack-swift | 17:02 | |
| timburke | ormandj, sounds familiar -- https://bugs.launchpad.net/swift/+bug/1810397 or maybe what got fixed with https://review.opendev.org/#/c/660196/ | 17:08 |
| openstack | Launchpad bug 1810397 in OpenStack Object Storage (swift) "Remove ETag header from request in CompleteMultipartUpload" [Medium,Fix released] | 17:08 |
| patchbot | patch 660196 - swift - s3api: Allow clients to upload with UNSIGNED-PAYLOAD (MERGED) - 1 patch set | 17:08 |
| timburke | ormandj, what version of swift is this? | 17:08 |
| *** rdejoux has quit IRC | 17:09 | |
| *** diablo_rojo has quit IRC | 17:15 | |
| *** rpittau is now known as rpittau|afk | 17:21 | |
| *** diablo_rojo has joined #openstack-swift | 17:22 | |
| timburke | DHE, sounds kinda like https://bugs.launchpad.net/swift/+bug/1710328 ... but every py3-ready swift should have that fix :-/ | 17:25 |
| openstack | Launchpad bug 1710328 in OpenStack Object Storage (swift) "object server deadlocks when a worker thread logs something" [High,Fix released] - Assigned to Samuel Merritt (torgomatic) | 17:25 |
| timburke | might be worth installing gdb and running https://github.com/swiftstack/python-stack-xray/blob/master/python-stack-xray on a hung server to see all of the greenthreads' stacks, too | 17:26 |
| *** mkrai has quit IRC | 17:31 | |
| *** evrardjp has quit IRC | 17:34 | |
| *** evrardjp has joined #openstack-swift | 17:34 | |
| ormandj | timburke: stein | 17:36 |
| ormandj | even with a tiny 1 byte file it's happening using aws cli, not using that plugin, just specifying endpoint manually | 17:37 |
| ormandj | i verified the right region is being set in aws cli, same for endpoint | 17:37 |
| ormandj | getting back 400s from swift proxy | 17:37 |
| ormandj | (2.21.0 to be clear) | 17:38 |
| ormandj | looks like .1 from your post fixes something w/ multipart, but it's failing even on small single part files (1810397), https://review.opendev.org/#/c/660196/ is definitely it though | 17:39 |
| patchbot | patch 660196 - swift - s3api: Allow clients to upload with UNSIGNED-PAYLOAD (MERGED) - 1 patch set | 17:39 |
| ormandj | x-amz-content-sha256:UNSIGNED-PAYLOAD | 17:40 |
| timburke | *nods* i backported it to stein (p 675437) but it was released in 2.21.1 | 17:41 |
| timburke | https://github.com/openstack/swift/blob/2.21.1/CHANGELOG#L17 | 17:42 |
| timburke | i think there's also a aws-cli config option to work around it... let me see... | 17:43 |
| DHE | timburke: wow that's old... I'm running 2.23.1 so it should be good | 17:45 |
| timburke | this guy! https://docs.aws.amazon.com/cli/latest/topic/s3-config.html#payload-signing-enabled | 17:45 |
| ormandj | i'd rather us upgrade to .1 and fix both of these :) | 17:46 |
| ormandj | thanks for the quick assist on this, and the fix itself | 17:46 |
| timburke | DHE, agree -- it was just the most-similar thing i could think of :-/ | 17:46 |
| DHE | hmmm... maybe disabling threading would help then? | 17:48 |
| DHE | if it's indeed a related issue... | 17:48 |
| *** psachin has joined #openstack-swift | 17:59 | |
| DHE | was considering UDP based syslogging, but it still uses the same fundamental code so, no... | 18:21 |
| *** psachin has quit IRC | 18:43 | |
| timburke | clayg, tdasilva i think http://paste.openstack.org/show/788724/ should make recovery from a primary with no archive a good bit easier | 18:48 |
| *** openstackgerrit has quit IRC | 18:51 | |
| *** heso has quit IRC | 19:13 | |
| ormandj | timburke: so fun thing, ubuntu cloud archives for bionic has 2.21.1 in proposed | 19:15 |
| ormandj | any chance it could be promoted? | 19:16 |
| timburke | ¯\_(ツ)_/¯ | 19:17 |
| timburke | maybe ask coreycb? | 19:17 |
| ormandj | coreycb: hello my new friend ;) | 19:17 |
| *** gmann is now known as gmann_lunch | 19:26 | |
| *** gmann_lunch is now known as gmann | 19:52 | |
| * DHE is downgrading to python 3.6 in a "throw science at the wall and see what sticks" strategy... | 20:08 | |
| *** openstackstatus has joined #openstack-swift | 20:09 | |
| *** ChanServ sets mode: +v openstackstatus | 20:09 | |
| *** jvisser has quit IRC | 20:12 | |
| coreycb | ormandj: we're aiming to get that released monday - you can it track at https://bugs.launchpad.net/cloud-archive/+bug/1858934 | 20:50 |
| openstack | Launchpad bug 1858934 in Ubuntu Cloud Archive stein "[SRU] stein stable releases" [High,Fix committed] | 20:50 |
| timburke | DHE, i'm a great fan of experimentalism and empiricism ;-) | 21:00 |
| timburke | let me know how it goes | 21:00 |
| timburke | clayg, tdasilva i just noticed something a little funny with versioning... | 21:01 |
| timburke | you do an SLO PUT to a versioned container, you get a version id in your headers. so far, so good | 21:01 |
| timburke | you turn on heart-beating... no more version id :-/ | 21:02 |
| DHE | timburke: well I'm not a python guy so I don't have many other options if the experts (you) don't know what's up... | 21:02 |
| *** rcernin has joined #openstack-swift | 21:04 | |
| timburke | DHE, i still think the stack xray script may be helpful -- it should give us a much better picture of what's going on in that object server, hopefully giving us some ideas about why we're waiting on a lock that never releases... | 21:04 |
| DHE | stack xray? | 21:09 |
| DHE | google found it | 21:09 |
| DHE | should work, i have debug symbols in my python build... | 21:10 |
| zaitcev | there's also ghis: https://review.opendev.org/70513 | 21:16 |
| patchbot | patch 70513 - swift - Add Guru Meditation - 4 patch sets | 21:16 |
| zaitcev | It is one of those always bridesmaid, never a bride kind of patches. | 21:16 |
| *** diablo_rojo has quit IRC | 21:16 | |
| *** irclogbot_2 has quit IRC | 21:18 | |
| *** tonyb has quit IRC | 21:19 | |
| *** aluria has quit IRC | 21:19 | |
| *** cwright has quit IRC | 21:19 | |
| *** openstackstatus has quit IRC | 21:20 | |
| *** cwright has joined #openstack-swift | 21:26 | |
| *** tonyb has joined #openstack-swift | 21:26 | |
| *** irclogbot_1 has joined #openstack-swift | 21:26 | |
| *** diablo_rojo has joined #openstack-swift | 21:34 | |
| *** diablo_rojo has quit IRC | 21:37 | |
| tdasilva | timburke: interesting, going to start going through your patches in a bit | 21:39 |
| *** diablo_rojo has joined #openstack-swift | 21:39 | |
| *** jvisser has joined #openstack-swift | 21:45 | |
| *** aluria has joined #openstack-swift | 22:01 | |
| *** diablo_rojo__ has joined #openstack-swift | 22:09 | |
| *** diablo_rojo has quit IRC | 22:11 | |
| *** jvisser has quit IRC | 22:17 | |
| mattoliverau | morning | 22:21 |
| *** diablo_rojo__ is now known as diablo_rojo | 22:46 | |
| *** tkajinam has joined #openstack-swift | 23:07 | |
| *** diablo_rojo has quit IRC | 23:42 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!