| *** d34dh0r53 has quit IRC | 00:16 | |
| *** pvradu has quit IRC | 00:18 | |
| *** d34dh0r53 has joined #openstack-swift | 00:25 | |
| *** d34dh0r53 has quit IRC | 00:25 | |
| *** d34dh0r53 has joined #openstack-swift | 00:28 | |
| *** d34dh0r53 has quit IRC | 00:30 | |
| *** d34dh0r53 has joined #openstack-swift | 00:35 | |
| *** d34dh0r53 has quit IRC | 00:36 | |
| *** d34dh0r53 has joined #openstack-swift | 00:39 | |
| clayg | Pep8 š | 00:40 |
|---|---|---|
| tdasilva | clayg: i'm working on container-sync review feedback | 00:41 |
| timburke | clayg, i even tried to warn you about it ;-) | 00:41 |
| clayg | timburke: sorry man, Iām trying to keep a lot of balls in the air atm | 00:42 |
| clayg | Iāll fix it next time Iām at a computer. š¤ | 00:42 |
| *** d34dh0r53 has joined #openstack-swift | 00:43 | |
| tdasilva | clayg: i'll check it out | 00:44 |
| *** d34dh0r53 has quit IRC | 00:44 | |
| *** hoonetorg has quit IRC | 00:45 | |
| *** d34dh0r53 has joined #openstack-swift | 00:52 | |
| *** d34dh0r53 has quit IRC | 00:53 | |
| *** d34dh0r53 has joined #openstack-swift | 00:55 | |
| *** d34dh0r53 has quit IRC | 00:55 | |
| *** hoonetorg has joined #openstack-swift | 00:57 | |
| *** d34dh0r53 has joined #openstack-swift | 00:59 | |
| *** d34dh0r53 has quit IRC | 00:59 | |
| *** d34dh0r53 has joined #openstack-swift | 01:01 | |
| *** d34dh0r53 has quit IRC | 01:04 | |
| *** d34dh0r53 has joined #openstack-swift | 01:14 | |
| *** d34dh0r53 has quit IRC | 01:14 | |
| *** d34dh0r53 has joined #openstack-swift | 01:28 | |
| *** d34dh0r53 has quit IRC | 01:28 | |
| *** d34dh0r53 has joined #openstack-swift | 01:33 | |
| *** d34dh0r53 has quit IRC | 01:34 | |
| *** d34dh0r53 has joined #openstack-swift | 01:37 | |
| *** d34dh0r53 has quit IRC | 01:38 | |
| *** d34dh0r53 has joined #openstack-swift | 01:41 | |
| *** d34dh0r53 has quit IRC | 01:42 | |
| *** d34dh0r53 has joined #openstack-swift | 01:52 | |
| *** d34dh0r53 has quit IRC | 01:52 | |
| *** d34dh0r53 has joined #openstack-swift | 01:56 | |
| *** d34dh0r53 has quit IRC | 01:57 | |
| *** d34dh0r53 has joined #openstack-swift | 02:02 | |
| *** d34dh0r53 has quit IRC | 02:03 | |
| *** d34dh0r53 has joined #openstack-swift | 02:05 | |
| *** d34dh0r53 has quit IRC | 02:05 | |
| *** d34dh0r53 has joined #openstack-swift | 02:09 | |
| *** d34dh0r53 has quit IRC | 02:10 | |
| *** d34dh0r53 has joined #openstack-swift | 02:15 | |
| *** d34dh0r53 has quit IRC | 02:15 | |
| *** pvradu has joined #openstack-swift | 02:16 | |
| *** d34dh0r53 has joined #openstack-swift | 02:19 | |
| *** d34dh0r53 has joined #openstack-swift | 02:21 | |
| *** d34dh0r53 has quit IRC | 02:22 | |
| *** d34dh0r53 has joined #openstack-swift | 02:38 | |
| *** d34dh0r53 has quit IRC | 02:39 | |
| *** d34dh0r53 has joined #openstack-swift | 02:45 | |
| *** d34dh0r53 has quit IRC | 02:45 | |
| *** d34dh0r53 has joined #openstack-swift | 02:47 | |
| *** d34dh0r53 has quit IRC | 02:47 | |
| *** pvradu has quit IRC | 02:47 | |
| *** d34dh0r53 has joined #openstack-swift | 02:54 | |
| *** d34dh0r53 has quit IRC | 02:55 | |
| *** d34dh0r53 has joined #openstack-swift | 02:57 | |
| openstackgerrit | Thiago da Silva proposed openstack/swift master: Skip container-sync when versioning enabled https://review.opendev.org/698139 | 02:59 |
| *** d34dh0r53 has joined #openstack-swift | 03:00 | |
| *** d34dh0r53 has quit IRC | 03:01 | |
| clayg | tdasilva: s'ok - I'll get it now | 03:08 |
| *** d34dh0r53 has joined #openstack-swift | 03:09 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift master: s3api: Implement object versioning API https://review.opendev.org/673682 | 03:16 |
| openstackgerrit | Clay Gerrard proposed openstack/swift master: WIP: s3api: Make multi-deletes async https://review.opendev.org/648263 | 03:17 |
| *** d34dh0r53 has joined #openstack-swift | 03:19 | |
| *** d34dh0r53 has quit IRC | 03:19 | |
| *** d34dh0r53 has joined #openstack-swift | 03:28 | |
| *** d34dh0r53 has quit IRC | 03:28 | |
| *** psachin has joined #openstack-swift | 03:33 | |
| *** d34dh0r53 has joined #openstack-swift | 03:41 | |
| *** d34dh0r53 has quit IRC | 03:41 | |
| *** d34dh0r53 has joined #openstack-swift | 03:48 | |
| *** d34dh0r53 has quit IRC | 04:40 | |
| *** pvradu has joined #openstack-swift | 04:44 | |
| *** d34dh0r53 has joined #openstack-swift | 04:45 | |
| *** d34dh0r53 has quit IRC | 04:45 | |
| viks___ | hi, just wanted to know if i can test s3api versioning? If yes, which is the stable commit i can use to test? | 04:48 |
| viks___ | or is it stable yet? | 04:49 |
| tdasilva | viks___: https://review.opendev.org/#/c/673682/ | 04:52 |
| patchbot | patch 673682 - swift - s3api: Implement object versioning API - 44 patch sets | 04:52 |
| tdasilva | viks___: it hasn't landed on master yet, but should be soon | 04:52 |
| tdasilva | "famous last words" | 04:53 |
| *** d34dh0r53 has joined #openstack-swift | 04:54 | |
| mattoliverau | lol | 04:56 |
| *** d34dh0r53 has quit IRC | 04:56 | |
| *** gyee has quit IRC | 04:57 | |
| *** spsurya has joined #openstack-swift | 05:05 | |
| viks___ | tdasilva: Thanks... But is it testable to some extent if i checkout any code? | 05:08 |
| *** pvradu has quit IRC | 05:17 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: py3: Fix formpost unicode filename issues https://review.opendev.org/701497 | 05:21 |
| openstackgerrit | Tim Burke proposed openstack/swift master: form-signature: Print form to stdout, other info to stderr https://review.opendev.org/701498 | 05:21 |
| timburke | viks___, yes, should definitely be testable. you'll probably want to look through some of the docs around https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f56/682382/68/check/openstack-tox-docs/f56e7ad/docs/middleware.html#module-swift.common.middleware.versioned_writes.object_versioning -- S3 versioning uses and builds upon a new, better way of doing swift versioning | 05:23 |
| *** manuvakery has joined #openstack-swift | 05:24 | |
| timburke | fwiw, shortly after we can get it on master, i'd like to get a release out. it's been a bit | 05:25 |
| viks___ | timburke: as i see in https://review.opendev.org/#/c/682382/, new object versioning is not backward compatible.. so if i migrate to the newer version of swift, does it mean that i can not get my older versioned objects? | 05:31 |
| patchbot | patch 682382 - swift - New Object Versioning mode - 69 patch sets | 05:31 |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-swift | 05:33 | |
| viks___ | timburke: ok... i got it.. going through the above doc in the link given by you | 05:35 |
| openstackgerrit | Thiago da Silva proposed openstack/swift master: Skip container-sync when versioning enabled https://review.opendev.org/698139 | 05:37 |
| viks___ | timburke: can you please suggest the commit id/branch which i can checkout and test the new versioning scheme? I'm not sure about the your(openstack swift's) overall development workflow | 05:45 |
| tdasilva | viks___: if you haven't yet, you first need to setup a SAIO: https://docs.openstack.org/swift/latest/development_saio.html | 06:21 |
| tdasilva | or a simpler way is to use something like: https://github.com/swiftstack/vagrant-swift-all-in-one | 06:22 |
| tdasilva | then checkout the change: https://github.com/openstack/swift/blob/master/REVIEW_GUIDELINES.rst | 06:22 |
| viks___ | tdasilva: Ok thanks.. Will start looking in to it.. | 06:23 |
| *** pvradu has joined #openstack-swift | 07:00 | |
| *** pcaruana has joined #openstack-swift | 07:38 | |
| *** pvradu has quit IRC | 08:02 | |
| *** pvradu has joined #openstack-swift | 08:03 | |
| *** tesseract has joined #openstack-swift | 08:06 | |
| *** mahatic has quit IRC | 08:09 | |
| *** mkrai has joined #openstack-swift | 08:11 | |
| mkrai | Hi, I am trying to install Swift with devstack and I see this error http://paste.openstack.org/show/788166/ | 08:13 |
| mkrai | I checked swift status, it shows running. The logs shows error http://paste.openstack.org/show/788167/ | 08:14 |
| mkrai | Can someone please help? | 08:14 |
| mkrai | I am running stein swift and devstack is master. | 08:14 |
| *** rdejoux has joined #openstack-swift | 08:21 | |
| *** tkajinam has quit IRC | 08:29 | |
| *** pvradu has quit IRC | 08:41 | |
| tdasilva | mkrai: i think that was fixed in train: https://github.com/openstack/swift/commit/39a54fecdc5d7f9a09f34fcd9e81ec60948b51d7#diff-a834622717b96e4c16de8b6d093eb0dc | 08:52 |
| *** diablo_rojo has joined #openstack-swift | 09:07 | |
| *** rpittau|afk is now known as rpittau | 09:25 | |
| openstackgerrit | Thiago da Silva proposed openstack/swift master: New Object Versioning mode https://review.opendev.org/682382 | 10:03 |
| *** mkrai has quit IRC | 11:04 | |
| *** diablo_rojo has quit IRC | 11:38 | |
| *** mkrai has joined #openstack-swift | 11:55 | |
| manuvakery | hi guys.. i have a simple python script, minimal version of swift object-server, which runs as wsgi sever. All it does is read the file from wsgi.iput and persist to a given directory and return the checksum . Like in swift the core operations are os.write and os.fsync . i have uploaded 200mb file to swift object server and the python script and noticed that the swift os.fync takes almost double the time | 12:07 |
| manuvakery | compared to the script. the data is written on same disk (/srv/node/disk5) . | 12:07 |
| manuvakery | https://www.irccloud.com/pastebin/Kl4Qy0Di/curl-test-results | 12:08 |
| manuvakery | the time taken for os.fsync call is double . I have tested it with 50 curl calls but results are almost same .. By the way the disks are idle when tested | 12:16 |
| manuvakery | is this expected due to the additional processing of swift object-server ? | 12:19 |
| clayg | Post the script and we can play spot the difference! š | 12:26 |
| *** mkrai has quit IRC | 12:31 | |
| *** mkrai has joined #openstack-swift | 12:53 | |
| manuvakery | clayg: http://paste.openstack.org/show/788176/ | 12:55 |
| clayg | So itās probably the directory fayncs maybe? Itās not really expected that āthis thing that does the same thing is fasterā but it is expected āthis different thing is differentā | 13:02 |
| manuvakery | hmm.. you mean the fsync_dir function? | 13:18 |
| manuvakery | https://github.com/openstack/swift/blob/f73a1908378ecb667f152c3d58f14ac986af9b52/swift/obj/diskfile.py#L1790 added a timer here and spotted the difference | 13:23 |
| *** mkrai has quit IRC | 13:49 | |
| clayg | manuvakery: ok, well - i guess the next step would be to try and reproduce, it's not obvious to me what's different there | 14:54 |
| clayg | manuvakery: do you know if your swift object server is getting into this block -> https://github.com/openstack/swift/blob/f73a1908378ecb667f152c3d58f14ac986af9b52/swift/obj/diskfile.py#L1771 | 14:54 |
| *** rcernin has quit IRC | 15:01 | |
| clayg | manuvakery: so far my swift-object-server and your server.py seem to perform very similarlly https://gist.github.com/clayg/27c6a7929518b5a9949b1bf916703534 | 15:04 |
| clayg | I haven't instrumeted my object server the same as you - in fact my object-server required me to send the x-timestamp header and a different path than yours | 15:05 |
| clayg | ... perhaps there's more differences in your environment? | 15:06 |
| manuvakery | For me bytes_per_sync is set to 512.. so it doesn't go to the fdatasync block | 15:07 |
| manuvakery | Object server require x-timestamp for me as well | 15:08 |
| manuvakery | Ohh it's a copy paste error when I put the curl | 15:08 |
| manuvakery | clayg: in your it's test response is very similar.. let me look into more | 15:11 |
| clayg | manuvakery: be sure to keep us posted | 15:12 |
| *** mkrai has joined #openstack-swift | 15:34 | |
| manuvakery | clayg: sure I will | 15:49 |
| openstackgerrit | Tim Burke proposed openstack/swift master: py3: Fix formpost unicode filename issues https://review.opendev.org/701497 | 16:05 |
| openstackgerrit | Tim Burke proposed openstack/swift master: form-signature: Print form to stdout, other info to stderr https://review.opendev.org/701498 | 16:05 |
| timburke | mkrai, also, are you trying to run stein swift under py3? unfortunately, we didn't get py3 support until train | 16:07 |
| *** hoonetorg has quit IRC | 16:07 | |
| *** pawan-gupta has joined #openstack-swift | 16:17 | |
| *** pawan-gupta has quit IRC | 16:19 | |
| *** pawan-gupta has joined #openstack-swift | 16:19 | |
| *** hoonetorg has joined #openstack-swift | 16:20 | |
| *** pawan-gupta has quit IRC | 16:23 | |
| *** openstackgerrit has quit IRC | 16:30 | |
| *** pawan-gupta has joined #openstack-swift | 16:43 | |
| *** gyee has joined #openstack-swift | 16:45 | |
| *** psachin has quit IRC | 17:12 | |
| *** mkrai has quit IRC | 17:15 | |
| *** cschwede has joined #openstack-swift | 17:15 | |
| *** ChanServ sets mode: +v cschwede | 17:15 | |
| *** mkrai has joined #openstack-swift | 17:29 | |
| *** rdejoux has quit IRC | 17:30 | |
| *** evrardjp has quit IRC | 17:33 | |
| *** evrardjp has joined #openstack-swift | 17:34 | |
| *** mkrai has quit IRC | 17:42 | |
| *** renich has joined #openstack-swift | 17:45 | |
| *** rpittau is now known as rpittau|afk | 17:51 | |
| *** tesseract has quit IRC | 18:15 | |
| *** pcaruana has quit IRC | 18:27 | |
| *** pawan-gupta has quit IRC | 18:47 | |
| timburke | almost meeting time! | 20:55 |
| mattoliverau | Morning | 20:56 |
| seongsoocho | yay ~ morning | 20:56 |
| timburke | seongsoocho, o/ | 20:57 |
| timburke | i think i've got a good fix for your formpost issue! | 20:57 |
| seongsoocho | yes! I just check your patch. I will test it in my dev env today. I really thank you | 20:58 |
| timburke | thanks for planning to test so quickly! looking forward to the review :-) | 20:59 |
| kota_ | morning | 21:00 |
| seongsoocho | :-) | 21:00 |
| seongsoocho | kota_: morning o/ | 21:00 |
| kota_ | seongsoocho: o/ | 21:00 |
| timburke | clayg, tdasilva, zaitcev, alecuyer meeting ping | 21:01 |
| clayg | thanks! | 21:01 |
| clayg | š„³ | 21:06 |
| clayg | happy new year everybody! | 21:06 |
| *** spsurya has quit IRC | 21:32 | |
| zaitcev | well, that was timely | 22:01 |
| zaitcev | BTW, I ran the dark data detection on my cluster and found nothing. | 22:01 |
| timburke | zaitcev, \o/ | 22:02 |
| zaitcev | But I didn't have any traumatic effects like bothched backup restorations, lost swift.conf, and such. | 22:02 |
| timburke | i need to give that sample audit watcher a spin :-) | 22:02 |
| mattoliverau | I wrote this over engineered pipeline auditor about 2 years ago (accoring to the patch). it's probably crap and proably much better ways now but: https://review.opendev.org/#/c/233922/ | 22:06 |
| patchbot | patch 233922 - swift - Possible pipeline auditor - WIP - 1 patch set | 22:06 |
| timburke | clayg, lol i told you i was going back and forth on naming for p 700056! | 22:06 |
| patchbot | https://review.opendev.org/#/c/700056/ - swift - Middleware that allows a user to have quoted Etags - 5 patch sets | 22:06 |
| timburke | mattoliverau, nice! | 22:06 |
| *** cschwede has quit IRC | 22:42 | |
| *** tkajinam has joined #openstack-swift | 22:56 | |
| *** tkajinam has quit IRC | 22:58 | |
| *** tkajinam has joined #openstack-swift | 23:00 | |
| *** rcernin has joined #openstack-swift | 23:13 | |
| timburke | lol oh wow! i guess i hadn't tried running unit tests with the non-default system account prefix -- FAILED (errors=1, failures=39) | 23:50 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!