| *** zhengyin has joined #openstack-swift | 01:00 | |
| *** tovin07_ has joined #openstack-swift | 01:02 | |
| *** chlong has quit IRC | 01:04 | |
| kota_ | good morning | 01:12 |
|---|---|---|
| *** chlong has joined #openstack-swift | 01:19 | |
| *** zhurong has joined #openstack-swift | 01:57 | |
| *** mingyu_ has joined #openstack-swift | 02:21 | |
| *** itlinux has joined #openstack-swift | 02:25 | |
| *** itlinux has quit IRC | 02:37 | |
| *** mingyu has joined #openstack-swift | 02:50 | |
| *** mingyu_ has quit IRC | 02:51 | |
| *** tonanhngo has joined #openstack-swift | 03:05 | |
| *** tonanhngo has quit IRC | 03:06 | |
| charz | Hey guys, just a question for `X-delete-at`/`X-delete-after` on Swift versioning. Do you think that'll work? If not, do we have a doc to tell user for that? | 03:21 |
| *** klrmn1 has quit IRC | 03:26 | |
| *** klrmn has joined #openstack-swift | 03:47 | |
| *** psachin has joined #openstack-swift | 03:52 | |
| *** gkadam has joined #openstack-swift | 04:00 | |
| *** gkadam has quit IRC | 04:01 | |
| *** gkadam has joined #openstack-swift | 04:03 | |
| *** Dinesh_Bhor has joined #openstack-swift | 04:10 | |
| *** mingyu has quit IRC | 04:20 | |
| *** Dinesh_Bhor has quit IRC | 04:24 | |
| *** Dinesh_Bhor has joined #openstack-swift | 04:25 | |
| *** zhurong has quit IRC | 04:26 | |
| *** zhurong has joined #openstack-swift | 04:35 | |
| *** catintheroof has joined #openstack-swift | 04:36 | |
| *** catintheroof has quit IRC | 04:42 | |
| *** bkopilov has joined #openstack-swift | 04:45 | |
| *** zhengyin has quit IRC | 05:04 | |
| *** zhurong has quit IRC | 05:06 | |
| *** zhurong has joined #openstack-swift | 05:07 | |
| *** chsc has joined #openstack-swift | 05:08 | |
| *** chsc has joined #openstack-swift | 05:08 | |
| *** zhengyin has joined #openstack-swift | 05:11 | |
| *** chsc has quit IRC | 05:15 | |
| *** mingyu has joined #openstack-swift | 05:23 | |
| *** mingyu_ has joined #openstack-swift | 05:32 | |
| *** mingyu has quit IRC | 05:33 | |
| *** ChubYann has quit IRC | 05:36 | |
| *** mingyu_ has quit IRC | 05:38 | |
| *** cshastri has joined #openstack-swift | 05:46 | |
| *** mingyu has joined #openstack-swift | 05:47 | |
| *** mingyu has quit IRC | 05:58 | |
| *** mingyu has joined #openstack-swift | 06:08 | |
| *** mingyu has quit IRC | 06:17 | |
| *** mingyu has joined #openstack-swift | 06:19 | |
| *** rcernin has joined #openstack-swift | 06:19 | |
| *** rcernin has quit IRC | 06:36 | |
| *** rcernin has joined #openstack-swift | 06:40 | |
| *** hseipp has joined #openstack-swift | 06:41 | |
| *** mingyu has quit IRC | 06:42 | |
| *** mingyu has joined #openstack-swift | 06:47 | |
| *** pcaruana has joined #openstack-swift | 06:52 | |
| *** klrmn has quit IRC | 06:52 | |
| openstackgerrit | Christian Schwede proposed openstack/swift master: Add commands to ring-builder to change region / zone https://review.openstack.org/291990 | 07:03 |
| *** mingyu has quit IRC | 07:06 | |
| *** zhengyin has quit IRC | 07:08 | |
| *** mingyu has joined #openstack-swift | 07:12 | |
| *** tesseract has joined #openstack-swift | 07:19 | |
| *** mingyu has quit IRC | 07:29 | |
| *** mingyu has joined #openstack-swift | 07:40 | |
| *** cbartz has joined #openstack-swift | 07:53 | |
| *** zhengyin has joined #openstack-swift | 07:56 | |
| *** jaosorior has joined #openstack-swift | 08:16 | |
| acoles | good morning | 08:46 |
| acoles | rledisez: re patch 472659, I have it starred, thanks for that | 08:49 |
| patchbot | https://review.openstack.org/#/c/472659/ - swift - Allow to rebuild a fragment of an expired object | 08:49 |
| *** oshritf has joined #openstack-swift | 09:01 | |
| kota_ | acoles: good morning | 09:15 |
| acoles | kota_: o/ | 09:15 |
| *** winggundamth has joined #openstack-swift | 09:38 | |
| *** skudlik has joined #openstack-swift | 09:51 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift master: Follow up for affinity config per policy https://review.openstack.org/467920 | 09:55 |
| kota_ | acoles: ^^ | 09:56 |
| kota_ | sorry, late for pushing it | 09:56 |
| acoles | kota_: ok thanks, I'll take a look | 09:58 |
| *** geaaru has joined #openstack-swift | 10:03 | |
| *** mvk has quit IRC | 10:11 | |
| *** zhurong has quit IRC | 10:12 | |
| *** mariusv has joined #openstack-swift | 10:17 | |
| *** tovin07_ has quit IRC | 10:20 | |
| openstackgerrit | Tovin Seven proposed openstack/swift master: OSprofiler in OpenStack Swift https://review.openstack.org/468316 | 10:24 |
| *** kei_yama has quit IRC | 10:36 | |
| *** mvk has joined #openstack-swift | 10:39 | |
| *** zhurong has joined #openstack-swift | 10:39 | |
| *** zhengyin has quit IRC | 10:43 | |
| *** sanchitmalhotra has quit IRC | 10:59 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 10:59 | |
| *** sanchitmalhotra1 is now known as sanchitmalhotra | 11:01 | |
| *** PavelK has joined #openstack-swift | 11:03 | |
| *** PavelK has quit IRC | 11:07 | |
| *** mingyu has quit IRC | 11:14 | |
| *** hseipp has quit IRC | 11:15 | |
| *** mingyu has joined #openstack-swift | 11:15 | |
| *** oshritf has quit IRC | 12:02 | |
| *** oshritf has joined #openstack-swift | 12:03 | |
| *** winggundamth has quit IRC | 12:07 | |
| *** oshritf has quit IRC | 12:13 | |
| *** zhurong has quit IRC | 12:16 | |
| *** oshritf has joined #openstack-swift | 12:18 | |
| *** winggundamth has joined #openstack-swift | 12:23 | |
| *** oshritf has quit IRC | 12:25 | |
| *** catintheroof has joined #openstack-swift | 12:27 | |
| *** catintheroof has quit IRC | 12:28 | |
| *** oshritf has joined #openstack-swift | 12:36 | |
| *** oshritf has quit IRC | 12:50 | |
| *** oshritf has joined #openstack-swift | 13:05 | |
| *** oshritf has quit IRC | 13:14 | |
| *** oshritf has joined #openstack-swift | 13:15 | |
| *** lucasxu has joined #openstack-swift | 13:29 | |
| *** oshritf has quit IRC | 13:33 | |
| *** klamath has joined #openstack-swift | 13:34 | |
| *** klamath has quit IRC | 13:37 | |
| *** klamath has joined #openstack-swift | 13:38 | |
| *** oshritf has joined #openstack-swift | 13:38 | |
| *** oshritf has quit IRC | 13:48 | |
| *** oshritf has joined #openstack-swift | 13:52 | |
| *** SkyRocknRoll has joined #openstack-swift | 13:52 | |
| *** catintheroof has joined #openstack-swift | 13:52 | |
| *** bob_cheesey has joined #openstack-swift | 14:00 | |
| *** psachin has quit IRC | 14:14 | |
| *** cshastri has quit IRC | 14:30 | |
| *** silor has joined #openstack-swift | 14:31 | |
| *** gkadam has quit IRC | 14:35 | |
| *** jlvacation is now known as jlvillal | 14:41 | |
| *** winggundamth has quit IRC | 14:42 | |
| *** chsc has joined #openstack-swift | 15:05 | |
| *** chsc has joined #openstack-swift | 15:05 | |
| *** klrmn has joined #openstack-swift | 15:08 | |
| *** oshritf has quit IRC | 15:10 | |
| *** aselius has joined #openstack-swift | 15:11 | |
| *** thurloat has quit IRC | 15:14 | |
| *** thurloat has joined #openstack-swift | 15:14 | |
| *** thurloat has quit IRC | 15:15 | |
| *** thurloat has joined #openstack-swift | 15:17 | |
| rledisez | clayg: good morning. what do you think of setting do_listdir to False most of the time in https://github.com/openstack/swift/blob/master/swift/obj/reconstructor.py#L776-L777 like in object-replicator. right now, at every passes, everything is listed, it burns so much IO. if there is a difference between nodes, it would get recalculated later in _get_suffixes_to_sync(). i'm not sure if there could be side effect i don't think of | 15:27 |
| clayg | *so* much i/o! comment on patchset 5 on patch 428408 | 15:30 |
| patchbot | https://review.openstack.org/#/c/428408/ - swift - Don't rehash primaries in reconstructor handoffs_o... | 15:30 |
| *** pcaruana has quit IRC | 15:31 | |
| rledisez | clayg: not the same thing. i'm in SYNC mode. before comparing the hashes, the reconstructor list all suffixes in each partitions. I tested setting to False for one run, it really makes a difference | 15:35 |
| clayg | in the comment (not the patch), the inline diff is the same line # - do_listdir=False - anyway - yes good idea | 15:36 |
| clayg | yes, doubled rate for me | 15:36 |
| clayg | it's a good idea | 15:36 |
| clayg | you should do more reviews - we leave this low hanging fruit stuff around all the time | 15:37 |
| clayg | let me know when you have the patch up - i'll totally +2 it | 15:37 |
| *** SkyRocknRoll has quit IRC | 15:45 | |
| *** rcernin has quit IRC | 15:45 | |
| *** honga has joined #openstack-swift | 15:48 | |
| *** itlinux_ has joined #openstack-swift | 15:49 | |
| *** skudlik has quit IRC | 15:52 | |
| openstackgerrit | Gábor Antal proposed openstack/swift master: Use more specific asserts in test/unit/common/middleware https://review.openstack.org/342770 | 15:52 |
| honga | Hi all, I've been investigating DLO and am really confused about the Etags. I have verified that the md5s do match on the original file and, after uploading, the downloaded file as well. When I stat the manifest file, the etag is different. Where is the original MD5 stored and Why is this the case? | 15:55 |
| *** SkyRocknRoll has joined #openstack-swift | 15:58 | |
| zaitcev | What manifest file? DLO doesn't have one, does it now? | 16:02 |
| *** gyee has joined #openstack-swift | 16:04 | |
| zaitcev | In any case, segmented objects do not store the Etag of the whole object. They store an Etag of a catenation of segment Etags. It's basically impossible to calculate the summary Etag. Firstly you have to do it in sequence (to maintain MD5 state), and uploads can be parallel. And you don't want to re-read a large object that was just uploaded. | 16:05 |
| honga | zaitcev: the manifest file containing all the individual segment info? segment sizes, hashes, etc. or am I even more confused | 16:05 |
| zaitcev | honga: SLO has a manifest file and DLO just fakes it from container listings, doesn't it? I may be misremembering. | 16:05 |
| *** cbartz has left #openstack-swift | 16:07 | |
| *** itlinux_ has quit IRC | 16:07 | |
| *** klrmn has quit IRC | 16:07 | |
| *** itlinux_ has joined #openstack-swift | 16:08 | |
| honga | ah, you're right, DLO does not use a manifest file, the information is stored in the headers | 16:09 |
| rledisez | clayg: i didn't see that comment. thx for pointing it. i'll propose a patch for that, definitively | 16:10 |
| honga | thank you for the explanation zaitcev, makes more sense now | 16:10 |
| zaitcev | So, in order to have some kind of end-to-end integrity, we put the Etags together, then bracket it with its own Etag. This is something that can be verified, although auditors only verify etags of segments, I think. | 16:11 |
| zaitcev | For a long time, both DLO and SLO supplied a Etag of an empty file, d41d8cd98f00b204e9800998ecf8427e. | 16:12 |
| zaitcev | Then, someone came up with this idea of a summary Etag | 16:12 |
| honga | i see | 16:14 |
| honga | so to be clear, theres not a way to see the original md5 unless the user downloads back the file? or do the possibly lengthy compute | 16:15 |
| honga | we wanted a way for users to upload their files then verify md5s matched easily | 16:17 |
| *** mingyu has quit IRC | 16:20 | |
| zaitcev | They have to calculate MD5 of segments, concatenate the digest (as text, I think), then compute MD5 of that and compare it with what PUT returns, at least in case of SLO. For the DLO, I think, the only thing you can do is to compare the returned Etags of segments with ones computed locally. | 16:25 |
| honga | perfect, thanks zaitcev | 16:31 |
| *** charz has quit IRC | 16:34 | |
| *** charz has joined #openstack-swift | 16:36 | |
| notmyname | good morning | 16:48 |
| *** SkyRocknRoll_ has joined #openstack-swift | 16:49 | |
| *** SkyRocknRoll has quit IRC | 16:51 | |
| *** ^andrea^ has quit IRC | 16:58 | |
| *** FarmerJoe has joined #openstack-swift | 16:58 | |
| *** mingyu has joined #openstack-swift | 17:06 | |
| *** dja has quit IRC | 17:08 | |
| *** klrmn has joined #openstack-swift | 17:08 | |
| *** mvk has quit IRC | 17:09 | |
| *** dja has joined #openstack-swift | 17:10 | |
| *** ChubYann has joined #openstack-swift | 17:14 | |
| *** ^andrea^ has joined #openstack-swift | 17:15 | |
| *** hseipp has joined #openstack-swift | 17:16 | |
| *** honga has quit IRC | 17:18 | |
| *** honga has joined #openstack-swift | 17:18 | |
| *** FarmerJoe has quit IRC | 17:22 | |
| *** lucasxu has quit IRC | 17:24 | |
| *** honga has quit IRC | 17:25 | |
| *** oshritf has joined #openstack-swift | 17:27 | |
| *** hseipp has quit IRC | 17:29 | |
| *** itlinux_ has quit IRC | 17:33 | |
| *** honga has joined #openstack-swift | 17:34 | |
| *** chsc has quit IRC | 17:36 | |
| *** itlinux_ has joined #openstack-swift | 17:38 | |
| *** jaosorior is now known as jaosorior_away | 17:41 | |
| *** tesseract has quit IRC | 17:54 | |
| *** thurloat has quit IRC | 17:56 | |
| *** tonanhngo has joined #openstack-swift | 18:05 | |
| *** thurloat has joined #openstack-swift | 18:05 | |
| *** tonanhngo has joined #openstack-swift | 18:06 | |
| *** lucasxu has joined #openstack-swift | 18:08 | |
| *** oshritf has quit IRC | 18:16 | |
| *** geaaru has quit IRC | 18:20 | |
| *** thurloat has quit IRC | 18:21 | |
| *** chsc has joined #openstack-swift | 18:22 | |
| *** chsc has joined #openstack-swift | 18:22 | |
| notmyname | http://lists.openstack.org/pipermail/openstack-dev/2017-June/118242.html <-- email to -dev and -ops about the EC bad configuration change | 18:28 |
| *** catinthe_ has joined #openstack-swift | 18:31 | |
| *** catintheroof has quit IRC | 18:33 | |
| redbo | Are we still doing the monday meetings? I don't remember what happened. | 18:42 |
| zaitcev | Swift community meeting is on Wednesday, IIRC 4 p.m. your time. | 18:44 |
| zaitcev | Er | 18:44 |
| zaitcev | No, you're in Texas. 2 p.m. then | 18:44 |
| redbo | oh wrong channel. | 18:44 |
| redbo | haha | 18:44 |
| *** thurloat has joined #openstack-swift | 18:47 | |
| tdasilva | redbo: hi! just last week I started reading a bit about golang webservices and read about routers. seems like there are a few options. using the native one or what's seems to be most commonly used is gorilla/mux | 18:48 |
| tdasilva | redbo: it seems like hummingbird is using the native one, do you remember what made you guys go that direction? do you have any suggestion/tips on one over the ohter? | 18:48 |
| redbo | tdasilva: We actually have our own little router implementation, though that might be a bit of an over-optimization. It originally used gorilla mux - it's good but a little slow because it uses regexes for everything. There are a ton of router implementations, but most of them can't disambiguate all of our routes. | 18:54 |
| redbo | The standard library router is of very limited use because it can't do variable paths. | 18:55 |
| redbo | Like you can route to "/hello", but not "/:arbitrary" | 18:56 |
| tdasilva | redbo: ah got it, https://github.com/troubling/hummingbird/blob/master/proxyserver/main.go#L44 | 18:59 |
| *** mingyu has quit IRC | 19:06 | |
| *** mingyu has joined #openstack-swift | 19:08 | |
| *** itlinux_ has quit IRC | 19:09 | |
| *** mingyu has quit IRC | 19:12 | |
| openstackgerrit | Merged openstack/swift master: remove remote qualifier from release notes branch scanning https://review.openstack.org/469880 | 19:18 |
| *** itlinux has joined #openstack-swift | 19:21 | |
| *** itlinux has quit IRC | 19:22 | |
| openstackgerrit | Merged openstack/swift master: Fix unit test failing when swift.conf has default policy index >10 https://review.openstack.org/461062 | 19:22 |
| openstackgerrit | Merged openstack/python-swiftclient master: Fix MockHttpResponse to be more like the Real https://review.openstack.org/442881 | 19:25 |
| *** itlinux_ has joined #openstack-swift | 19:37 | |
| *** catintheroof has joined #openstack-swift | 19:39 | |
| *** catinthe_ has quit IRC | 19:42 | |
| openstackgerrit | Merged openstack/swift master: Allow to configure the nameservers in cname_lookup https://review.openstack.org/435768 | 19:48 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements https://review.openstack.org/89250 | 19:50 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 19:51 |
| *** silor has quit IRC | 19:52 | |
| *** thurloat has quit IRC | 19:58 | |
| *** itlinux_ has quit IRC | 21:08 | |
| *** lucasxu has quit IRC | 21:12 | |
| openstackgerrit | Merged openstack/swift master: Cleanup db replicator probetest https://review.openstack.org/471957 | 21:13 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 21:20 |
| *** itlinux has joined #openstack-swift | 21:44 | |
| kong | hi, guys, could you please review https://review.openstack.org/#/c/470158/ which could get rid of our customers' confusion when deleting objects in multi-region swift deployment. | 21:50 |
| patchbot | patch 470158 - swift - Write-affinity aware object deletion | 21:50 |
| notmyname | kong: yeah, you're not the only one :-) | 21:53 |
| kong | notmyname: heh, our customers just keep asking why they met with 404 when deleting an existing object, which leads to their own job/script failing | 21:55 |
| notmyname | kong: thanks for reminding us, though. I too would like to see it land soon! | 21:55 |
| kong | notmyname: cheers | 21:55 |
| *** mingyu has joined #openstack-swift | 22:13 | |
| *** mingyu has quit IRC | 22:17 | |
| *** thurloat has joined #openstack-swift | 22:30 | |
| *** klamath has quit IRC | 22:42 | |
| *** thurloat has quit IRC | 22:43 | |
| *** catintheroof has quit IRC | 22:47 | |
| *** thurloat has joined #openstack-swift | 22:49 | |
| *** itlinux has quit IRC | 22:50 | |
| *** kei_yama has joined #openstack-swift | 23:28 | |
| *** chsc has quit IRC | 23:40 | |
| *** catintheroof has joined #openstack-swift | 23:45 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Update Global EC docs with reference to composite rings https://review.openstack.org/468011 | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!