Wednesday, 2019-07-10

*** altlogbot_2 has joined #openstack-swift00:29
*** altlogbot_2 has quit IRC00:37
*** altlogbot_1 has joined #openstack-swift01:07
openstackgerritPete Zaitcev proposed openstack/swift master: py3: port dlo func tests  https://review.opendev.org/64292001:12
*** altlogbot_1 has quit IRC01:15
*** gyee has quit IRC01:22
*** altlogbot_1 has joined #openstack-swift02:19
*** irclogbot_1 has joined #openstack-swift02:19
*** altlogbot_1 has quit IRC02:25
*** irclogbot_1 has quit IRC02:26
*** tkajinam has quit IRC02:29
*** tkajinam has joined #openstack-swift02:29
*** psachin has joined #openstack-swift03:03
openstackgerritMerged openstack/swift master: py3: Specify an encoding when loading db.pending pickles  https://review.opendev.org/66548603:37
*** mahatic has joined #openstack-swift03:49
*** ChanServ sets mode: +v mahatic03:49
kota_good morning mattoliverau03:51
mattoliveraukota_: o/03:51
*** irclogbot_0 has joined #openstack-swift04:07
*** irclogbot_0 has quit IRC04:12
*** altlogbot_3 has joined #openstack-swift04:13
*** altlogbot_3 has quit IRC04:17
openstackgerritMerged openstack/swift master: Increase some middleware test coverage  https://review.opendev.org/65218504:39
*** altlogbot_3 has joined #openstack-swift05:03
*** irclogbot_2 has joined #openstack-swift05:07
*** altlogbot_3 has quit IRC05:21
*** irclogbot_2 has quit IRC05:22
*** pcaruana has joined #openstack-swift05:37
*** rcernin has quit IRC06:10
*** rcernin has joined #openstack-swift06:11
*** pcaruana has quit IRC06:20
*** new_student1411 has joined #openstack-swift06:35
new_student1411Hi, can anyone help me with how to set `X-Account-Sysmeta-Global-Write-Ratelimit` for account ratelimit.06:36
openstackgerritHCLTech-SSW proposed openstack/swift master: Add ability to undelete an account.  https://review.opendev.org/50780806:56
*** altlogbot_1 has joined #openstack-swift07:03
*** altlogbot_1 has quit IRC07:08
*** new_student1411 has quit IRC07:25
*** irclogbot_1 has joined #openstack-swift07:40
*** irclogbot_1 has quit IRC07:44
openstackgerritzengjia proposed openstack/swift master: Update auth_url in install docs  https://review.opendev.org/67000507:53
*** pcaruana has joined #openstack-swift07:54
*** gkadam has joined #openstack-swift08:13
*** tkajinam has quit IRC08:14
*** gkadam has quit IRC08:22
*** rdejoux has joined #openstack-swift08:23
*** Fidde has joined #openstack-swift08:31
*** zaitcev__ has joined #openstack-swift08:48
*** ChanServ sets mode: +v zaitcev__08:48
*** zaitcev_ has quit IRC08:52
*** irclogbot_3 has joined #openstack-swift08:58
*** irclogbot_3 has quit IRC09:02
*** ccamacho has joined #openstack-swift09:03
*** baojg has joined #openstack-swift09:09
*** rcernin has quit IRC09:17
*** altlogbot_2 has joined #openstack-swift09:26
*** altlogbot_2 has quit IRC09:28
*** altlogbot_2 has joined #openstack-swift09:30
*** new_student1411 has joined #openstack-swift09:33
*** altlogbot_2 has quit IRC09:34
openstackgerritMerged openstack/swift master: py3: Be able to read and write non-ASCII headers  https://review.opendev.org/66254609:35
*** altlogbot_3 has joined #openstack-swift09:46
*** altlogbot_3 has quit IRC09:50
*** zaitcev_ has joined #openstack-swift09:56
*** ChanServ sets mode: +v zaitcev_09:56
*** new_student1411 has quit IRC09:59
*** zaitcev__ has quit IRC09:59
*** irclogbot_2 has joined #openstack-swift10:24
*** irclogbot_2 has quit IRC10:26
*** new_student1411 has joined #openstack-swift10:56
*** tesseract has joined #openstack-swift11:08
*** zaitcev__ has joined #openstack-swift11:36
*** ChanServ sets mode: +v zaitcev__11:36
*** zaitcev_ has quit IRC11:39
*** tomha has joined #openstack-swift11:51
*** tomha has quit IRC11:57
openstackgerritAlexandre Lécuyer proposed openstack/swift feature/losf: Add tests for vfile.py  https://review.opendev.org/66637812:02
*** henriqueof has joined #openstack-swift12:51
*** zaitcev__ has quit IRC12:52
*** zaitcev__ has joined #openstack-swift13:04
*** ChanServ sets mode: +v zaitcev__13:04
*** altlogbot_3 has joined #openstack-swift13:12
*** zaitcev_ has joined #openstack-swift13:12
*** ChanServ sets mode: +v zaitcev_13:12
*** zaitcev__ has quit IRC13:15
*** altlogbot_3 has quit IRC13:16
*** irclogbot_2 has joined #openstack-swift13:18
*** irclogbot_2 has quit IRC13:22
*** BjoernT has joined #openstack-swift13:56
*** Fidde has quit IRC14:52
timburke\o/ one step closer to the release!14:55
timburkeon an unrelated note.... now that we can UPDATE container DBs... i wonder if we should revisit how the replicator enqueues reconciler work...14:56
*** tdasilva has joined #openstack-swift15:05
*** ChanServ sets mode: +v tdasilva15:05
*** altlogbot_0 has joined #openstack-swift15:09
*** zaitcev__ has joined #openstack-swift15:11
*** ChanServ sets mode: +v zaitcev__15:11
*** altlogbot_0 has quit IRC15:12
*** zaitcev_ has quit IRC15:15
*** henriqueof has quit IRC15:29
*** BjoernT_ has joined #openstack-swift15:33
*** BjoernT has quit IRC15:36
*** BjoernT has joined #openstack-swift15:36
*** BjoernT_ has quit IRC15:38
*** henriqueof has joined #openstack-swift15:43
*** henriqueof has quit IRC15:47
*** viks___ has quit IRC15:55
*** altlogbot_3 has joined #openstack-swift15:57
*** altlogbot_3 has quit IRC15:58
openstackgerritTim Burke proposed openstack/swift master: functests: make container creation less flakey in test_object  https://review.opendev.org/67011116:13
*** gyee has joined #openstack-swift16:16
DHEso, I'm considering making a custom diskfile scheme, mainly because I will have a lot of sorta small (100k to 4M) files and the scheme of "1 object" per directory sounds like it's gonna hurt. but at the same time swift-on-file is described as being unsuitable for swift general use since it sounds like replication doesn't work. is that right?16:18
timburkenew_student1411, you won't be able to do it through the proxy-server, but you can issue a curl request straight to the account server (assuming you're inside the cluster's network)16:20
tdasilvaDHE: if you are concerned about lots of small files, you should checkout the losf branch, that's a project that rledisez and alecuyer are leading16:21
*** henriqueof has joined #openstack-swift16:21
timburketo figure out *which* account server to POST to, run something like `swift-get-nodes <path to account ring> <account name>`16:21
tdasilvaDHE: I'm not sure how that concern has anything to do with the swift-on-file project. The project had another goal and it's actually pretty dead16:21
*** psachin has quit IRC16:26
*** henriqueof has quit IRC16:29
DHEtdasilva: it seems to be the go-to alternative diskfile implementation16:32
DHEI was under the impression losf was intended for really small files, like 10k or smaller16:33
*** henriqueof has joined #openstack-swift16:37
clayg I went ahead and marked lp bug #1836082 as "high" because I don't understand exactly how bad the failure mode is.  Obviously if you have a split brain and a sharded container you could have object data that's inaccesible in the wrong policy until you manually re-enqueue the rows to move.16:48
openstackLaunchpad bug 1836082 in OpenStack Object Storage (swift) "Reconciler-enqueuing needs to be shard-aware" [High,Confirmed] https://launchpad.net/bugs/183608216:48
claygBut in the meantime the reconciler could be off it's rocker trying to do GETs for objects that don't exist up to a reclaim age only to eventually drop the records on the floor - at which point ... would the sharded container re-enqueue them?16:49
claygMaybe after an upgrade that fixes the problem you could just reset the row_id pointer and all things would sort themselves out 🤷‍♂️16:49
openstackgerritTim Burke proposed openstack/swift master: py3: port SLO func tests  https://review.opendev.org/65967316:50
*** altlogbot_2 has joined #openstack-swift16:50
openstackgerritTim Burke proposed openstack/swift master: py3: port staticweb and domain_remap func tests  https://review.opendev.org/64792316:51
openstackgerritTim Burke proposed openstack/swift master: py3: Cover account/container func tests  https://review.opendev.org/64538816:53
*** altlogbot_2 has quit IRC16:54
openstackgerritTim Burke proposed openstack/swift master: py3: Bring functional/test_object.py under test; add func-ec-py37 job  https://review.opendev.org/64589516:55
timburkeaha! that's what i get for just looking at master's requirements list: https://github.com/openstack/swift/commit/9d980e2#diff-b4ef698db8ca845e5845c4618278f29a16:59
*** henriqueof has quit IRC17:03
*** henriqueof has joined #openstack-swift17:03
openstackgerritTim Burke proposed openstack/swift feature/losf: Back out urllib3 requirement  https://review.opendev.org/67013917:13
*** henriqueof has quit IRC17:34
*** henriqueof has joined #openstack-swift17:35
*** BjoernT has quit IRC17:41
*** Fidde has joined #openstack-swift17:41
*** new_student1411 has quit IRC17:47
*** rdejoux has quit IRC18:04
*** irclogbot_3 has joined #openstack-swift18:06
*** irclogbot_3 has quit IRC18:08
*** zaitcev__ has quit IRC18:18
*** zaitcev__ has joined #openstack-swift18:30
*** ChanServ sets mode: +v zaitcev__18:30
timburkeclayg, yeah, resetting the high-water mark should certainly help... but i'm a little nervous about deleted rows -- they'll only hang around so long, and after that we're out of luck :-/18:54
openstackgerritMerged openstack/swift master: container: Unify storage-policy error paths  https://review.opendev.org/66052518:54
openstackgerritMerged openstack/python-swiftclient master: Optionally display listings in raw json  https://review.opendev.org/66870518:54
*** altlogbot_2 has joined #openstack-swift19:03
*** altlogbot_2 has quit IRC19:04
*** Fidde has quit IRC19:09
*** BjoernT has joined #openstack-swift19:11
*** tesseract has quit IRC19:16
*** irclogbot_3 has joined #openstack-swift19:20
*** irclogbot_3 has quit IRC19:22
*** zaitcev__ has quit IRC19:29
claygi feel like there's some ambiguity with a PUT hardlink 404 - it could mean the container doesn't exist - or it could mean the target doesn't exist... we have the HEAD resp, instead of returning it directly we could spin up a 409 like we do for etag doesn't match?  🤷‍♂️19:35
claygI'm only worried about it because of versioned writes wanting to do a stack mode delete when the top of the queue has expired... you can't make the hardlink to an expired object19:36
*** zaitcev__ has joined #openstack-swift19:41
*** ChanServ sets mode: +v zaitcev__19:41
timburkethere's another thing we oughta think hard about... how can/should s3-style versioning / history mode versioning interact with object expiration?19:43
claygyou mean if someone is using both api's on the same objects?  or you're talking about bucket policies?19:45
claygor do you just mean swift versioning + swift expiring features?  cause yeah that's an existing mess of itself 😁19:47
*** openstackgerrit has quit IRC19:49
timburkethat last one, basically20:26
timburkes3 is impacted insofar as s3 has its own notion of how expiration works that we ought to think about as we decide how *swift* should work20:27
*** altlogbot_2 has joined #openstack-swift20:28
*** altlogbot_2 has quit IRC20:32
*** zaitcev_ has joined #openstack-swift20:36
*** ChanServ sets mode: +v zaitcev_20:36
*** zaitcev__ has quit IRC20:40
*** pcaruana has quit IRC20:48
kota_morning20:58
mattoliverauMorning20:59
kota_timburke: meeting21:01
kota_?21:01
timburkeyep! sorry21:01
timburkezaitcev_, clayg ^^^21:02
claygalready!  where does the day go :'(21:02
*** zaitcev_ is now known as zaitcev21:02
*** altlogbot_3 has joined #openstack-swift21:04
*** altlogbot_3 has quit IRC21:08
*** altlogbot_2 has joined #openstack-swift21:18
*** altlogbot_2 has quit IRC21:22
*** openstackgerrit has joined #openstack-swift21:26
openstackgerritMerged openstack/swift master: functests: make container creation less flakey in test_object  https://review.opendev.org/67011121:26
*** irclogbot_1 has joined #openstack-swift21:49
*** irclogbot_1 has quit IRC21:52
claygqueue all the tasks21:59
claygrledisez: we're gunna queue reconstructor rebuilds for sure 👍21:59
rledisezclayg: i'm so glad you say that! i dreamt of it for few month now :D21:59
rledisezi gotta go, but i'll follow up on that topic22:00
claygwell apparently we have to fix the reconciler first22:00
claygkthxbai!22:00
claygi don't think we need to write down the epoch - as long as the task has the obj name in it we could always rehash and be like "this part isn't right anymore"22:01
claygthen we can either re-enqueue it where it goes or just deal with it22:02
*** henriqueof has quit IRC22:06
DHEso the default diskfile implementation makes a directory per object, and the reason seems to be so that rsync et al can handle multiple versions of an object nicely. right? I'm contemplating making a variant that avoids it and instead has 1 file per object in a small number of hash directories (squid (?) style)22:12
openstackgerritTim Burke proposed openstack/swift master: functests: Make test_PUT_metadata less flakey  https://review.opendev.org/67020922:37
timburkeok, so now that we've got https://review.opendev.org/#/c/668705/ ... should the next swiftclient still be 3.7.1, or 3.8.0?22:44
patchbotpatch 668705 - python-swiftclient - Optionally display listings in raw json (MERGED) - 9 patch sets22:44
timburkei kinda really want a release with https://review.opendev.org/#/c/651666/ in it22:45
patchbotpatch 651666 - python-swiftclient - Fix SLO re-upload (MERGED) - 3 patch sets22:45
timburkeplus it's been like 4 months22:45
*** rcernin has joined #openstack-swift22:48
*** altlogbot_3 has joined #openstack-swift23:04
*** tkajinam has joined #openstack-swift23:06
*** altlogbot_3 has quit IRC23:08
*** altlogbot_2 has joined #openstack-swift23:14
*** altlogbot_2 has quit IRC23:18
*** altlogbot_2 has joined #openstack-swift23:20
*** altlogbot_2 has quit IRC23:24
*** altlogbot_3 has joined #openstack-swift23:26
openstackgerritMerged openstack/python-swiftclient master: Support pdb in tests better  https://review.opendev.org/47392523:27
openstackgerritMerged openstack/swift feature/losf: Back out urllib3 requirement  https://review.opendev.org/67013923:27
lifeless /win goto ##flyingcircus23:28
*** altlogbot_3 has quit IRC23:30
*** zaitcev has quit IRC23:33
*** hoonetorg has quit IRC23:38
*** hoonetorg has joined #openstack-swift23:40
*** zaitcev has joined #openstack-swift23:45
*** ChanServ sets mode: +v zaitcev23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!