Tuesday, 2017-07-11

*** bkopilov has joined #openstack-swift00:00
*** JimCheung has joined #openstack-swift00:12
openstackgerritClay Gerrard proposed openstack/swift master: WIP: Add multiple worker processes strategy to reconstructor  https://review.openstack.org/47841600:18
*** hieulq has quit IRC00:21
*** two_tired has joined #openstack-swift00:28
*** hieulq has joined #openstack-swift00:36
*** tonanhngo has joined #openstack-swift00:36
*** tonanhngo has quit IRC00:40
*** kiennt has joined #openstack-swift00:41
*** tonanhngo has joined #openstack-swift00:42
*** tonanhngo has quit IRC00:49
kota_morning00:50
kota_oh, the reconstructer change was merged?00:50
claygjust the one that skips the primary suffix hashing in handoffs_only mode00:50
claygnext up is make the do_listdir work like the replicator (on do_listdir/suffix-double-check on 10% of parts per pass)00:51
claygthen multi-process reconstructor - I'm testing in lab literally right now!!!00:51
claygjust got it installed00:51
kienntgood morning, i saw Swift already had assert:supports-rolling-upgrade tag. How do you test rolling upgrade in gate job?  I am woking on Heat rolling upgrade and have to setup the CI to test this. But now, i don't know how to do it.00:52
kienntthank you :000:52
claygabout to kick off adding a node - last time it took ~24 hrs00:52
claygkiennt: cschwede might know something about rolling upgrade gate tests, but he's having some kind of bouncer problem these days (that or he just doesn't like us anymore)00:54
*** bkopilov has quit IRC00:54
claygtdasilva: timburke: you guys are gate masters?  do you know anything about the rolling upgrade test stuff that cschwede was fighting with for months back when?00:54
tdasilvaclayg, kiennt: yeah, best person to contact is cschwede, but best time to contact him is EU time00:55
tdasilvanot sure what's going on with his bouncer00:56
*** bkopilov has joined #openstack-swift00:57
* clayg yells out to into the void his longing for cschwede00:57
kienntclayg, tdasilva: oh thank you, guys. I will ping cschwede later.00:59
*** tovin07_ has joined #openstack-swift01:10
*** bkopilov has quit IRC01:16
*** bkopilov has joined #openstack-swift01:16
claygtdasilva: are probetests jacked?  did you open any bugs or anything?01:18
tdasilvaclayg: I did not open a bug, talked to rledisez but he had not seen the problem. are you able to reproduce it?01:19
claygno, i just keep noticing the community cluster probetest jobs failing01:19
claygi rarely run the whole suite - any one's in particular you noticed were giving you troubles so I can do a more targeted search?01:20
clayg... maybe I can spin up an out-of-band vsaio - I recently got the aws-vagrant provider working with it again!01:20
tdasilvayeah, at least these errors look like the same ones i'm running into: https://review.openstack.org/#/c/467710/01:20
patchbotpatch 467710 - swift - Clean up some assertions in test_reconstructor01:20
*** cshastri has joined #openstack-swift01:20
tdasilvaso the partition_power increase tests fail very consistently for me01:21
claygoic, random ECONNREFUSED01:21
tdasilvayep01:21
tdasilvarestart service, head request, fail01:22
claygthe partpower tests were the only ones that passed in that run!01:22
tdasilvapassed? ERROR: test_canceled (test.probe.test_object_partpower_increase.TestECPartPowerIncrease01:25
*** JimCheung has quit IRC01:34
*** Mype has joined #openstack-swift01:34
*** RayLei has joined #openstack-swift01:35
MypeHello, is it recommanded to generate a token per action on OpenStack Swift ? I have a image hosting service and there is a lot of operation per minute, so I was wondering if it's the best way to use Swift01:35
claygtdasilva: oh, i was looking at TestObjectPartPowerIncrease I guess?01:35
claygMype: "token per action" ??? like https://docs.openstack.org/swift/latest/api/temporary_url_middleware.html ???01:36
claygor something something keystone token?01:37
RayLeiI would like to ask whether the security issues of swauth super users have a solution?01:38
claygRayLei: Mype: are you two asking about similar or unrelated things (!?)01:39
RayLeiWell, you can answer his question first01:42
claygRayLei: I tried he didn't respond - but your question standing on it's own seems to lack context - are you referring to a bug report or something you perceive as a "known issue" with swauth super users security?01:45
*** klamath has quit IRC01:46
*** klamath has joined #openstack-swift01:47
*** gkadam has joined #openstack-swift01:49
RayLeiI used swauth, it's super password inside the configuration file inside, i think it's very unsafe, and I know that swauth's superuser is .super_admin, which is unsafe for people who use swauth as an important certification .Is it possible to propose a solution?01:52
*** klamath has quit IRC01:52
*** abhitechie has joined #openstack-swift01:52
*** klamath has joined #openstack-swift01:53
claygi think the contributing guide is up-to-date - swauth it managed through gerrit just like other /openstack stuff -> https://github.com/openstack/swauth/blob/master/CONTRIBUTING.rst01:55
claygi don't really see any open issues about the super_admin_key   https://bugs.launchpad.net/swauth ???01:57
*** mat128 has joined #openstack-swift01:57
*** Sukhdev has quit IRC01:57
claygRayLei: you may be the first person to have any opinion on swauth's super_admin_key being a config option???01:58
*** bkopilov has quit IRC01:59
RayLeimaybe ,I have mentioned a related issue, but until now no one has responded to me01:59
claygoh.. here in channel?  I probably just missed it02:00
claygor whoever was around paying attention at the time - or maybe no one was paying attention02:00
claygthe bug reports or the ML sometimes is better for stuff that has low volume/attention02:00
RayLeiit's here https://bugs.launchpad.net/swauth/+bug/165895902:01
openstackLaunchpad bug 1658959 in Swift Authentication "how to encrypt swauthkey,In a production environment, it's too insecure" [Undecided,In progress] - Assigned to ray (rayoslei)02:01
claygso it's marked as in progress and assigned - that normally means someone is working on a solution?  but in this case - that is you?02:03
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Add small note for handoffs_only acceleration  https://review.openstack.org/48237602:03
RayLeiMaybe i can provide a demo, but i expect openstack-swauth core worker can offer a program out02:06
clayga demo or like... a patch?02:07
Mypeclayg: i was about generating a token on keystone every time a new object is sent to the container02:08
claygthat seems like a lot of tokens to validate against keystone - why not keep resuing the same one?  swift will try and keep a cache of the fact that it's valid and not talk to keystone quite so often - which should make things more fast-ish!02:09
clayga'ight - i gotta let this rebalance run02:10
RayLeiAt first it could be a demo due to personal time constraints02:10
Mypetoken expires, that's the problem :/02:10
claygI think I got it tuned up where it should take less than 24 hours - but it's not super obvious blazing fast yet02:10
Mypecan't have a token that doesn't expire?02:10
claygMype: I would expect keystone token expiry is configurable by the operator (in keystone config) - but not generally a user feature02:11
claygMype: if you try to use a token and it's expired - can you just get a new one *then* instead of everytime whether you need it or not?02:11
claygkota_: thanks!02:12
Mypethere is no other way to do without token ? That could be easier to manage, like with just login and password on the curl request to Swift02:13
MypeI also can't change keystone settings as i'm with OVH OpenStack provider02:13
claygwell, tempurls work pretty well - all of the authorization is handled internally to swift you don't have to talk to external service - the authentication is done via signed request and hmac - but that could work for you?02:14
claygMype: you could look at like https://docs.openstack.org/swift/latest/api/temporary_url_middleware.html02:14
Mypemy container is public so i don't need tempurls i think ? I just use the API to manage object (send, delete etc)02:15
claygRayLei: I'm not sure what you mean by "demo" then - but if you have something you can show and you can put it on the web - just link it on the bug report?  If you need some "help" from other people #1 unassign the bug from yourself and #2 ask for help (like in here, like you're doing now, or on the openstack-operators or openstack-dev mailing lists)02:16
claygMype: you allow public writes into the container?  there's not a lot of use-cases where that's a good fit... but YMMV02:16
Mypeclayg: not writing access, just public acces to read all objects on the container02:17
claygnormally even "x-container-read: .r:*" requires some sort of authn/authz to write - you can use keystone or tempurls - if neither of those solutions work - you can invent your own solution!  But I think you probably either want to use keystone tokens more like swiftclient does - or you want to use tempurls02:19
claygi gotta run02:19
claygGL!02:19
MypeThanks!02:19
RayLeiThanks!02:19
RayLeiSee You02:20
*** klamath has quit IRC02:28
*** RayLei has quit IRC02:32
*** vint_bra has joined #openstack-swift02:35
*** abhitechie has quit IRC02:57
*** Mype has quit IRC02:59
*** vint_bra has quit IRC03:06
*** bkopilov has joined #openstack-swift03:18
*** abhitechie has joined #openstack-swift03:21
*** gyee has quit IRC03:23
*** pdardeau has joined #openstack-swift03:30
*** abhitechie has quit IRC03:35
*** abhitechie has joined #openstack-swift03:36
*** chsc has joined #openstack-swift03:38
*** chsc has joined #openstack-swift03:38
*** links has joined #openstack-swift03:41
*** winggundamth has joined #openstack-swift03:42
*** abhitechie has quit IRC03:46
*** pdardeau has left #openstack-swift03:51
*** psachin has joined #openstack-swift04:00
*** wasmum has quit IRC04:14
*** abhitechie has joined #openstack-swift04:15
openstackgerritMerged openstack/swift master: Untangle ServersPerPortStrategy.bind_ports  https://review.openstack.org/47285104:16
*** wasmum has joined #openstack-swift04:28
*** abhitechie has quit IRC04:30
*** abhitechie has joined #openstack-swift04:30
*** chsc has quit IRC04:33
*** two_tired has quit IRC04:55
*** abhitechie has quit IRC04:57
*** abhinavtechie has joined #openstack-swift04:57
*** chsc has joined #openstack-swift05:01
*** chsc has quit IRC05:12
*** d0ugal has joined #openstack-swift05:23
*** abhitechie has joined #openstack-swift05:28
*** abhinavtechie has quit IRC05:28
*** abhitechie has quit IRC05:32
*** abhitechie has joined #openstack-swift05:34
*** kiennt has quit IRC05:41
*** rcernin has joined #openstack-swift05:41
notmynamewe've got the 0700 meeting this week. still looking for a chair05:50
* notmyname is going to bed, but will check in the morning05:51
*** d0ugal has quit IRC05:52
*** mat128 has quit IRC05:54
*** kiennt has joined #openstack-swift05:56
*** gkadam has quit IRC05:56
*** gkadam has joined #openstack-swift05:58
*** pcaruana has joined #openstack-swift06:04
*** ChubYann has quit IRC06:07
*** abhitechie has quit IRC06:09
*** gokhan has joined #openstack-swift06:12
*** abhitechie has joined #openstack-swift06:15
*** gkadam has quit IRC06:17
*** gkadam has joined #openstack-swift06:17
*** gkadam has quit IRC06:18
*** gkadam has joined #openstack-swift06:19
openstackgerritMerged openstack/swift master: Clean up some assertions in test_reconstructor  https://review.openstack.org/46771006:19
*** gkadam has quit IRC06:21
*** klrmn has quit IRC06:25
*** abhitechie has quit IRC06:36
*** abhitechie has joined #openstack-swift06:36
*** gkadam has joined #openstack-swift06:44
*** gkadam has quit IRC06:46
*** hieulq has quit IRC06:50
*** tovin07_ has quit IRC06:52
*** kiennt has quit IRC06:52
*** tovin07_ has joined #openstack-swift07:01
*** tesseract has joined #openstack-swift07:02
*** hieulq has joined #openstack-swift07:05
* mattoliverau is taking a forced vacation (during unemployment so not sure I can actually take leave). The Power adaptor of my new laptop died and now I'm computer-less, well until the new replacement arrives so I can charge the battery. I have irc on phone so still contactable.07:06
*** gokhan has left #openstack-swift07:07
*** cschwede has joined #openstack-swift07:21
*** ChanServ sets mode: +v cschwede07:21
*** xrb has joined #openstack-swift07:22
*** xrb has quit IRC07:22
*** skudlik has joined #openstack-swift07:25
*** skudlik has left #openstack-swift07:25
*** xrb has joined #openstack-swift07:27
*** tovin07__ has joined #openstack-swift07:31
*** openstackgerrit has quit IRC07:33
*** tovin07_ has quit IRC07:33
*** cshastri has quit IRC07:35
*** cbartz has joined #openstack-swift07:35
*** hieulq has quit IRC07:44
*** tovin07__ has quit IRC07:45
*** hieulq has joined #openstack-swift08:02
*** oshritf has joined #openstack-swift08:07
*** tovin07_ has joined #openstack-swift08:10
*** abhitechie has quit IRC08:12
*** abhitechie has joined #openstack-swift08:23
*** gkadam has joined #openstack-swift08:25
*** mvk has quit IRC08:26
*** gkadam is now known as gkadam-afk08:26
*** gkadam-afk has quit IRC08:26
xrbhi all, trying to give ACL right on a bucket to a user from another tenant (using the S3 interface and the s3cmd command).. Cannot make it work... Still getting 404 NoSuchBucket when trying to access the bucket from the other user...08:27
xrbwhat I tried so far08:28
xrbs3cmd setacl --acl-grant=full_control:<project_id>:<user_id> s3://abc08:28
xrbs3cmd setacl --acl-grant=full_control:<project_id>:* s3://abc08:28
xrbs3cmd setacl --acl-grant=full_control:*:* s3://abc08:28
xrball this, but still does not work. Any way how to debug this?08:29
xrb(setting the acl works, but access from the other user does not)08:29
*** kiennt has joined #openstack-swift08:30
*** winggundamth has quit IRC08:39
*** winggundamth has joined #openstack-swift08:42
*** mvk has joined #openstack-swift08:55
*** RayLei has joined #openstack-swift08:57
RayLeiHow to understand the container-sync mechanism in depth?09:04
*** winggundamth has quit IRC09:16
acolesRayLei: there is a description here https://docs.openstack.org/swift/latest/overview_container_sync.html09:16
*** mvk has quit IRC09:37
*** links has quit IRC09:37
RayLeiI have seen it, but I have doubts about how the container-sync process and container sync point work09:38
*** links has joined #openstack-swift09:39
*** links has quit IRC09:44
*** links has joined #openstack-swift09:49
*** mvk has joined #openstack-swift09:51
*** d0ugal has joined #openstack-swift09:53
*** openstackgerrit has joined #openstack-swift09:53
openstackgerritAlistair Coles proposed openstack/swift master: Fix StopIteration noise in obj/test_replicator.py  https://review.openstack.org/48248809:53
*** d0ugal has quit IRC09:59
*** RayLei has quit IRC10:02
*** hieulq has quit IRC10:06
*** kiennt has quit IRC10:08
*** tovin07_ has quit IRC10:08
*** links has quit IRC10:13
*** hieulq has joined #openstack-swift10:26
*** gkadam has joined #openstack-swift11:00
*** hieulq has quit IRC11:05
*** bkopilov has quit IRC11:11
*** hieulq has joined #openstack-swift11:19
*** gkadam has quit IRC11:24
*** silor has joined #openstack-swift11:36
*** kei_yama has quit IRC11:45
*** links has joined #openstack-swift11:45
*** hieulq has quit IRC11:51
*** links has quit IRC11:59
*** silor has quit IRC12:04
*** gkadam has joined #openstack-swift12:05
*** hieulq has joined #openstack-swift12:05
*** silor has joined #openstack-swift12:08
*** hieulq has quit IRC12:16
*** hieulq has joined #openstack-swift12:32
*** MVenesio has joined #openstack-swift12:32
*** mat128 has joined #openstack-swift12:32
*** bkopilov has joined #openstack-swift12:33
*** abhitechie has quit IRC12:38
*** openstackgerrit has quit IRC12:47
*** gkadam_ has joined #openstack-swift12:51
*** gkadam has quit IRC12:54
*** silor has quit IRC12:58
*** silor has joined #openstack-swift12:59
*** gkadam__ has joined #openstack-swift13:04
*** gkadam_ has quit IRC13:06
*** openstackgerrit has joined #openstack-swift13:08
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873613:08
*** gkadam__ has quit IRC13:11
openstackgerritChristopher Bartz proposed openstack/swift master: Account Quota Factor for Storage Policies.  https://review.openstack.org/48255813:12
*** hieulq has quit IRC13:17
*** hieulq has joined #openstack-swift13:33
*** ukaynar has joined #openstack-swift13:37
*** klamath has joined #openstack-swift13:40
*** hieulq has quit IRC13:46
*** mat128 has quit IRC13:49
*** abhitechie has joined #openstack-swift13:49
*** mat128 has joined #openstack-swift13:50
*** klamath has quit IRC13:52
*** klamath has joined #openstack-swift13:53
*** d0ugal has joined #openstack-swift13:54
*** klamath has quit IRC13:57
*** klamath has joined #openstack-swift13:58
*** jistr is now known as jistr|call13:58
*** d0ugal has quit IRC14:00
*** hieulq has joined #openstack-swift14:01
*** tovin07 has joined #openstack-swift14:08
*** gyee has joined #openstack-swift14:27
*** rcernin has quit IRC14:38
*** rcernin has joined #openstack-swift14:40
*** klrmn has joined #openstack-swift14:42
openstackgerritAlistair Coles proposed openstack/swift master: Fix StopIteration noise in obj/test_replicator.py  https://review.openstack.org/48248814:42
*** klrmn has quit IRC14:43
*** openstackgerrit has quit IRC14:48
*** hieulq has quit IRC14:51
*** ukaynar has quit IRC14:51
*** ukaynar has joined #openstack-swift14:52
*** ukaynar has quit IRC14:56
*** ukaynar has joined #openstack-swift15:02
*** hieulq has joined #openstack-swift15:06
*** chsc has joined #openstack-swift15:10
*** chsc has joined #openstack-swift15:10
*** chsc has quit IRC15:16
*** abhitechie has quit IRC15:16
*** abhitechie has joined #openstack-swift15:17
*** psachin has quit IRC15:18
*** rcernin has quit IRC15:18
*** jistr|call is now known as jistr15:22
*** hieulq has quit IRC15:24
*** abhinavtechie has joined #openstack-swift15:27
*** catintheroof has joined #openstack-swift15:28
*** abhitechie has quit IRC15:30
*** ukaynar has quit IRC15:37
*** ukaynar has joined #openstack-swift15:37
*** hieulq has joined #openstack-swift15:41
*** ukaynar has quit IRC15:42
*** SkyRocknRoll has joined #openstack-swift15:42
*** abhinavtechie has quit IRC15:44
*** tonanhngo has joined #openstack-swift15:55
*** chsc has joined #openstack-swift16:01
*** chsc has joined #openstack-swift16:01
*** vint_bra has joined #openstack-swift16:09
timburkegood morning16:15
*** chsc has quit IRC16:23
*** cbartz has quit IRC16:24
*** tovin07 has left #openstack-swift16:25
notmynamegood morning16:26
*** hieulq has quit IRC16:27
*** vint_bra has quit IRC16:29
xrbAnyone has an input regarding this ACL for cross-tenant users through S3 issue from above?16:30
*** cbartz has joined #openstack-swift16:32
*** ChubYann has joined #openstack-swift16:36
timburkexrb: what's the access key id look like when attempting cross-tenant access? i'm fairly certain you'll need something like `AUTH_other_project:access_key_id` instead of just `access_key_id` (search for force_tenant in https://github.com/openstack/swift3/blob/master/swift3/s3_token_middleware.py)16:41
*** hieulq has joined #openstack-swift16:42
*** ukaynar has joined #openstack-swift16:43
*** ukaynar has quit IRC16:43
*** tonanhngo has quit IRC16:50
*** JimCheung has joined #openstack-swift16:54
notmynamestill don't know who's on for chairing the 0700 meeting this week (ie tonight/tomorrow morning)16:59
notmynamewhich means I'm up, I think16:59
*** hieulq has quit IRC17:00
*** klrmn has joined #openstack-swift17:07
*** itlinux has joined #openstack-swift17:09
*** JimCheung has quit IRC17:10
*** JimCheung has joined #openstack-swift17:11
*** hieulq has joined #openstack-swift17:16
*** openstackgerrit has joined #openstack-swift17:18
openstackgerritChristopher Bartz proposed openstack/swift master: Account Quota Factor for Storage Policies.  https://review.openstack.org/48255817:18
*** cbartz has quit IRC17:18
*** chsc has joined #openstack-swift17:33
*** tonanhngo has joined #openstack-swift17:34
*** tonanhngo has quit IRC17:35
*** tonanhngo has joined #openstack-swift17:36
tdasilvanotmyname: weren't they going by alphabet order?17:50
notmynameyeah17:50
notmynamebut it's ok. I'll do the 0700 meeting17:50
notmynamewe're getting closer to doing some releases, so I want to be there anyway17:51
*** hieulq has quit IRC18:03
*** ukaynar has joined #openstack-swift18:10
*** hieulq has joined #openstack-swift18:19
*** tesseract has quit IRC18:25
*** ukaynar has quit IRC18:53
*** ukaynar has joined #openstack-swift18:58
*** tonanhngo has quit IRC19:00
*** mvk has quit IRC19:11
*** silor has quit IRC19:24
*** cschwede has quit IRC19:26
*** SkyRocknRoll has quit IRC19:34
claygtimburke: one of these commits says "redis bucket database" https://github.com/open-io/swift3/commits/master19:36
claygi'd never heard of open-io until today - I always find *new* opensource object storage systems interesting - i always wonder "but... why?"19:37
timburkeyes it does19:37
claygtimburke: but... https://github.com/openstack/swift3/commits/master doesn't... does it!?19:39
timburkethey reached out to kota_ and i about getting some of those upstream -- see https://review.openstack.org/#/c/482485/ for example19:39
patchbotpatch 482485 - swift3 - Implement "GET Bucket (List Objects) Version 2"19:39
claygoh, noice19:39
timburkeunfortunately, i haven't had a chance to circle back around on swift3 development much lately. otherwise we'd probably have a functional gate :-/19:40
*** JimCheung has quit IRC19:43
tdasilvaclayg: I think I heard about openio in Barcelona. I think they are doing something like "no need to rebalance data when you scale out???" i was curious...19:43
openstackgerritMerged openstack/swift master: Add small note for handoffs_only acceleration  https://review.openstack.org/48237619:46
*** SkyRocknRoll has joined #openstack-swift19:46
*** itlinux has quit IRC19:47
*** hieulq has quit IRC19:50
*** saint_ has joined #openstack-swift19:56
*** ukaynar has quit IRC19:58
*** JimCheung has joined #openstack-swift19:58
*** JimCheung has quit IRC20:03
*** ukaynar has joined #openstack-swift20:09
*** itlinux has joined #openstack-swift20:11
*** JimCheung has joined #openstack-swift20:14
*** ukaynar has quit IRC20:18
*** MVenesio has quit IRC20:25
*** SkyRocknRoll has quit IRC20:31
*** hieulq has joined #openstack-swift20:33
*** SkyRocknRoll has joined #openstack-swift20:48
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873620:49
*** mat128 has quit IRC20:57
*** tonanhngo has joined #openstack-swift21:01
*** catintheroof has quit IRC21:04
*** tonanhngo has quit IRC21:06
*** pcaruana has quit IRC21:23
*** SkyRocknRoll has quit IRC21:43
*** saint_ has quit IRC21:45
*** dfflanders has joined #openstack-swift21:48
notmynamehttps://wiki.openstack.org/wiki/Swift/PriorityReviews updated with some sections for the next releases22:24
notmynamethere's 2 tracked high-priority bugs that don't currently have patches22:25
notmynamelikely related to each other22:25
notmynamehttps://bugs.launchpad.net/swift/+bug/1572719 and https://bugs.launchpad.net/swift/+bug/156865022:25
openstackLaunchpad bug 1572719 in OpenStack Object Storage (swift) "Client may hold socket open after ChunkWriteTimeout" [High,Confirmed]22:25
openstackLaunchpad bug 1568650 in OpenStack Object Storage (swift) "Connection between client and proxy service does not closes" [High,Confirmed] - Assigned to drax (devesh-gupta)22:25
*** dr_gogeta86 has quit IRC22:30
claygnotmyname: I think they're both correctly classified as "High" and shouldn't block the release.22:49
claygnotmyname: i'm not sure when/how we should address those - I'd guess *when* someone who uses SwiftStack runs into those we'll have to do them - so it's basically a landmine...but for right now I'm not breaking off the reconstructor scaling22:51
claygif anything the work might stretch to include replicators - esp for geo-replicated clusters - we need a handoffs_only worker running all the time (and another sync_only worker)22:58
notmynameclayg: what about https://review.openstack.org/#/c/448480?22:59
patchbotpatch 448480 - swift - DB replicator cleanup22:59
notmynameno bug linked on it, but it seems pretty important22:59
claygyeah afaik that's still terrible and we should totally review/merge it22:59
claygI want to say I had some cluster with an unmounted container db - that hit the "super every ssd replica" bug23:00
notmynamethe meetings will be going over these things to get reviewers etc23:00
claygwhen we *fixed* the bug - i'm pretty sure I noted it doesn't cleanup until the drive that started everything gets remounted23:01
clayg... and the cluster we had that was effected swapped out the bad drive by the time they upgraded23:01
claygIIRC23:01
*** tonanhngo has joined #openstack-swift23:03
*** tonanhngo has quit IRC23:08
*** itlinux has quit IRC23:10
*** chsc has quit IRC23:22
*** klamath has quit IRC23:25
*** tonanhngo has joined #openstack-swift23:30
*** kei_yama has joined #openstack-swift23:33
*** tonanhngo has quit IRC23:35
*** d0ugal has joined #openstack-swift23:37
*** tonanhngo has joined #openstack-swift23:42
*** tonanhngo has quit IRC23:48
*** tonanhngo has joined #openstack-swift23:51
*** tonanhngo has quit IRC23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!