| *** rcernin has quit IRC | 00:06 | |
| *** rcernin has joined #openstack-swift | 00:13 | |
| *** tkajinam has quit IRC | 01:55 | |
| *** tkajinam has joined #openstack-swift | 01:55 | |
| *** psachin has joined #openstack-swift | 03:39 | |
| *** gyee has quit IRC | 04:15 | |
| *** m75abrams has joined #openstack-swift | 05:04 | |
| *** gtema has joined #openstack-swift | 06:44 | |
| *** baojg has quit IRC | 06:58 | |
| *** rcernin has quit IRC | 07:48 | |
| *** gtema has quit IRC | 07:51 | |
| *** gtema has joined #openstack-swift | 07:57 | |
| *** rcernin has joined #openstack-swift | 08:18 | |
| *** gtema has quit IRC | 08:47 | |
| *** rcernin has quit IRC | 09:07 | |
| *** baojg has joined #openstack-swift | 09:51 | |
| *** rcernin has joined #openstack-swift | 10:15 | |
| *** baojg has quit IRC | 10:17 | |
| *** baojg has joined #openstack-swift | 10:18 | |
| *** rcernin has quit IRC | 10:30 | |
| *** baojg has quit IRC | 10:51 | |
| *** baojg has joined #openstack-swift | 10:51 | |
| *** baojg has quit IRC | 11:07 | |
| *** baojg has joined #openstack-swift | 11:08 | |
| *** takamatsu has joined #openstack-swift | 12:12 | |
| *** rcernin has joined #openstack-swift | 12:22 | |
| *** m75abrams has quit IRC | 12:23 | |
| *** gtema has joined #openstack-swift | 12:54 | |
| *** m75abrams has joined #openstack-swift | 13:01 | |
| *** m75abrams has quit IRC | 13:17 | |
| *** m75abrams has joined #openstack-swift | 13:18 | |
| *** rcernin has quit IRC | 13:31 | |
| *** ianychoi has joined #openstack-swift | 14:05 | |
| *** gtema has quit IRC | 14:08 | |
| *** tkajinam has quit IRC | 14:47 | |
| *** hoonetorg has quit IRC | 14:55 | |
| *** irclogbot_0 has quit IRC | 14:55 | |
| *** m75abrams has quit IRC | 14:56 | |
| *** hoonetorg has joined #openstack-swift | 14:57 | |
| *** irclogbot_0 has joined #openstack-swift | 14:57 | |
| *** m75abrams has joined #openstack-swift | 15:00 | |
| *** gyee has joined #openstack-swift | 15:25 | |
| *** m75abrams has quit IRC | 15:26 | |
| *** ormandj has joined #openstack-swift | 16:07 | |
| ormandj | how are people dealing with mass deletes of large containers (50mil+ objects)? | 16:07 |
|---|---|---|
| *** psachin has quit IRC | 16:12 | |
| DHE | short term I'd just use the swift CLI tool. it has a mode to do that. | 16:17 |
| DHE | 50 million is a bit much though. not sure if there's any timeout or authentication issues | 16:18 |
| ormandj | you talking about bulk delete? | 16:21 |
| ormandj | yeah, we can use the API for that, i was just curious if there was a 'better' way that people had discovered w/ backend access | 16:22 |
| ormandj | obviously the whole operation is painful, the container sqllite db is over 50G | 16:22 |
| ormandj | but that's the fun of running object storage in the real world, not everyone is going to keep containers small :) | 16:22 |
| *** baojg has quit IRC | 16:26 | |
| *** baojg has joined #openstack-swift | 16:27 | |
| timburke | ormandj, you might look at https://github.com/openstack/swift/blob/master/swift/cli/container_deleter.py -- basically, it does a bunch of listings and puts objects in a queue for the expirer to chew on | 16:34 |
| timburke | idk that anyone's used it for *that* many objects, but you might be able to make some modifications to make it more suitable | 16:35 |
| ormandj | timburke: let me take a gander, thank you as always | 17:30 |
| ormandj | timburke: i think we're running into: https://bugs.launchpad.net/swift/+bug/1858259 on ussuri, too | 17:36 |
| openstack | Launchpad bug 1858259 in OpenStack Object Storage (swift) "Upload failed if filename is unicode string in formpost (python3)" [High,Fix released] | 17:36 |
| ormandj | 2.25, but it says it was fixd in 2.24.0 | 17:37 |
| timburke | i thought we fixed that in https://review.opendev.org/#/c/701497/ ... is there a traceback? | 17:38 |
| patchbot | patch 701497 - swift - py3: Fix formpost unicode filename issues (MERGED) - 3 patch sets | 17:38 |
| ormandj | timburke: will send you what i have | 17:38 |
| *** manuvakery has joined #openstack-swift | 17:59 | |
| *** baojg has quit IRC | 18:30 | |
| *** baojg has joined #openstack-swift | 18:30 | |
| *** rledisez has quit IRC | 19:37 | |
| *** alecuyer has quit IRC | 20:03 | |
| *** rledisez has joined #openstack-swift | 20:04 | |
| *** ChanServ sets mode: +v rledisez | 20:04 | |
| *** alecuyer has joined #openstack-swift | 20:05 | |
| *** theintern_ has joined #openstack-swift | 20:05 | |
| *** manuvakery has quit IRC | 20:09 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Stop syncing empty suffixes list https://review.opendev.org/741538 | 20:13 |
| *** baojg has quit IRC | 20:35 | |
| *** baojg has joined #openstack-swift | 20:36 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: probe tests: Get rid of `server` arg for device_dir() and storage_dir() https://review.opendev.org/741544 | 20:51 |
| ormandj | timburke: would you need any feedback on: https://review.opendev.org/#/c/737856/ ? we've had it in production a good while now to work around: https://bugs.launchpad.net/swift/+bug/1884991 | 21:21 |
| openstack | Launchpad bug 1884991 in OpenStack Object Storage (swift) "s3api on py3 doesn't use the bytes-on-the-wire when calculating string to sign" [Undecided,In progress] | 21:21 |
| patchbot | patch 737856 - swift - py3: Stop munging RAW_PATH_INFO - 2 patch sets | 21:21 |
| ormandj | no problems so far :) | 21:21 |
| timburke | it never hurts to leave a review ;-) | 21:24 |
| ormandj | copy! need anything more on the other 'new' issue? | 21:24 |
| timburke | thanks for reminding me about it -- definitely don't want to forget about it | 21:25 |
| ormandj | yeah, especially with a working fix that's now fairly heavily tested | 21:25 |
| timburke | haven't had a chance to dig into the new issue yet, unfortunately. proxy pipeline might be useful -- i'm sure you've mentioned it before, but i forget | 21:28 |
| ormandj | timburke: no worries at all! pipeline = catch_errors gatekeeper healthcheck proxy-logging cache listing_formats authtoken s3api container_sync tempurl s3token ratelimit keystoneauth copy container-quotas account-quotas slo dlo versioned_writes symlink bulk keymaster encryption proxy-logging ceilometer proxy-server | 21:29 |
| *** baojg has quit IRC | 21:34 | |
| *** baojg has joined #openstack-swift | 21:35 | |
| openstackgerrit | Tim Burke proposed openstack/swift-bench master: Drop testing for py27 https://review.opendev.org/741553 | 22:19 |
| openstackgerrit | Tim Burke proposed openstack/swift-bench master: Switch to victoria jobs https://review.opendev.org/741554 | 22:19 |
| *** rcernin has joined #openstack-swift | 22:43 | |
| *** rcernin has quit IRC | 22:47 | |
| mattoliverau | morning | 22:54 |
| *** rcernin has joined #openstack-swift | 22:54 | |
| *** tkajinam has joined #openstack-swift | 23:02 | |
| *** theintern_ has quit IRC | 23:04 | |
| *** gyee has quit IRC | 23:16 | |
| *** hoonetorg has quit IRC | 23:16 | |
| *** irclogbot_0 has quit IRC | 23:16 | |
| *** gyee has joined #openstack-swift | 23:22 | |
| *** hoonetorg has joined #openstack-swift | 23:22 | |
| *** irclogbot_0 has joined #openstack-swift | 23:22 | |
| *** baojg has quit IRC | 23:27 | |
| *** baojg has joined #openstack-swift | 23:28 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: docs: Improve replication-network remakerings https://review.opendev.org/741559 | 23:39 |
| kota_ | morning | 23:55 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!