| clayg | redbo: with a listdir? i mean it's not like we told them to name the files like that... it seems like it could be internally aware of it's own temporary file naming conventions | 00:00 |
|---|---|---|
| *** haomaiwang has quit IRC | 00:01 | |
| redbo | Like --exclude .* ? or something, we'd have to test it. | 00:01 |
| *** haomaiwang has joined #openstack-swift | 00:01 | |
| clayg | OTOH, isn't there some native locking that gets employed somewhere? vague memories of LD_PRELOAD or a patch to older versions of rsync... | 00:01 |
| clayg | redbo: yeah that was my first thought - just tell it to skip 'em | 00:01 |
| clayg | i guess the /var/lock stuff is for limiting connections probably | 00:02 |
| *** asettle has joined #openstack-swift | 00:03 | |
| openstackgerrit | Matthew Oliver proposed openstack/swift: Close open socket connection before function return in PUT https://review.openstack.org/289571 | 00:13 |
| *** haomaiwang has quit IRC | 00:28 | |
| *** asettle has quit IRC | 00:29 | |
| *** asettle has joined #openstack-swift | 00:31 | |
| *** asettle has quit IRC | 00:40 | |
| *** wanghua has joined #openstack-swift | 00:50 | |
| *** Jeffrey4l has joined #openstack-swift | 00:52 | |
| *** kei_yama has quit IRC | 01:00 | |
| *** kei_yama has joined #openstack-swift | 01:02 | |
| *** gyee has quit IRC | 01:11 | |
| *** haomaiwang has joined #openstack-swift | 01:12 | |
| kota_ | good morning | 01:20 |
| *** zhill has quit IRC | 01:33 | |
| clayg | so I was able to duplicate both by brutally killing the rsync client or rsync daemon - nothing is cleaning anything up (i.e. auditor doesn't give a shit => Mar 8 01:18:35 saio object-6016: Unexpected file /srv/node1/sdb1/objects/645/35a/a161102fba1710ef912af194b8d4635a/.1457397409.69518.data.ZlhK2z: Invalid Timestamp value in filename '.1457397409.69518.data.ZlhK2z') | 01:35 |
| *** zhill has joined #openstack-swift | 01:35 | |
| clayg | lp bug #1553995 | 01:35 |
| openstack | Launchpad bug 1553995 in OpenStack Object Storage (swift) "rsync incomplete object cross disks for a partition " [Undecided,New] https://launchpad.net/bugs/1553995 | 01:35 |
| clayg | general concensus over here is "how have we not gotten burned by errant disk space consumption by this before" | 01:35 |
| *** zhill has quit IRC | 01:36 | |
| clayg | does everyone else already have monitoring tooling that trolls for this junk when some random disk is off the margin for usage? | 01:36 |
| *** mmuffinman has quit IRC | 01:41 | |
| MooingLemur | clayg: if a single drive has a pct free that is more than 3 standard deviations from the mean, I have a non-paging warning in nagios. | 01:50 |
| MooingLemur | on a per-server basis | 01:51 |
| MooingLemur | so newly replaced drives usually trigger it for a while | 01:52 |
| MooingLemur | but *shrug* it's just there for when I bring up nagios, which I do most days | 01:53 |
| clayg | MooingLemur: sure - that's how we found this crap :P | 01:53 |
| MooingLemur | we haven't had a lot of hard crashes so I assume the rsync dotfiles are few and far between | 01:53 |
| clayg | MooingLemur: well they're tere everytime your rysnc a partition - which may happen more in clusters that are doing capacity adjustmnets on regualar basis | 01:54 |
| clayg | MooingLemur: anyway not sure about the failure rate - but as redbo pointed out - if you do an outbound rsync while an inbound is running it seems that these files will get shipped about and then they're sorta "just there" | 01:55 |
| MooingLemur | oh, gotcha | 01:55 |
| clayg | I'm mainly bummed because I can't find anyhting that cleans them up after they get old enough | 01:55 |
| *** lyrrad has quit IRC | 01:56 | |
| MooingLemur | clayg: yeah, I don't know how much they've built up, but I'm sure there's going to be some colliding inbound+outbound every once in a while. Probably somewhat rare on our part power 22 cluster | 01:57 |
| *** baojg has joined #openstack-swift | 01:58 | |
| *** haomaiwang has quit IRC | 02:01 | |
| *** haomaiwang has joined #openstack-swift | 02:01 | |
| MooingLemur | clayg: but yeah, we have been doing a lot of capacity adjustments recently. Perhaps it'd be fruitful to sample some of the drives for stale rsync dotfiles. | 02:02 |
| clayg | MooingLemur: sure - throw some deets on lp bug #1554005 or lp bug #1553995 if you can! | 02:03 |
| openstack | Launchpad bug 1554005 in OpenStack Object Storage (swift) "Multiple replicators rsync data to same partition, there're two copies with different suffix name at same time" [Undecided,New] https://launchpad.net/bugs/1554005 | 02:03 |
| openstack | Launchpad bug 1553995 in OpenStack Object Storage (swift) "rsync incomplete object cross disks for a partition " [Undecided,New] https://launchpad.net/bugs/1553995 | 02:03 |
| clayg | MooingLemur: thanks! | 02:03 |
| *** delatte has joined #openstack-swift | 02:14 | |
| *** delattec has quit IRC | 02:17 | |
| *** klrmn has quit IRC | 02:17 | |
| *** asettle has joined #openstack-swift | 02:23 | |
| *** kei_yama has quit IRC | 02:25 | |
| *** kei_yama has joined #openstack-swift | 02:28 | |
| *** klrmn has joined #openstack-swift | 02:32 | |
| openstackgerrit | Daisuke Morita proposed openstack/swift: Missing comments for storage policy parameter https://review.openstack.org/289663 | 02:35 |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Make eventlet.tpool's thread count configurable in object server https://review.openstack.org/289664 | 02:37 |
| *** mmuffinman has joined #openstack-swift | 02:45 | |
| *** jamielennox is now known as jamielennox|away | 02:56 | |
| *** haomaiwang has quit IRC | 03:01 | |
| *** klrmn has quit IRC | 03:01 | |
| *** haomaiwang has joined #openstack-swift | 03:01 | |
| *** jamielennox|away is now known as jamielennox | 03:01 | |
| *** mtreinish has quit IRC | 03:04 | |
| mahatic | good morning | 03:04 |
| *** mtreinish has joined #openstack-swift | 03:04 | |
| *** jamielennox is now known as jamielennox|away | 03:05 | |
| mattoliverau | mahatic: morning | 03:05 |
| *** dmorita has quit IRC | 03:06 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:10 | |
| *** jamielennox|away is now known as jamielennox | 03:15 | |
| *** furlongm has joined #openstack-swift | 03:18 | |
| *** treaki_ has quit IRC | 03:21 | |
| *** treaki_ has joined #openstack-swift | 03:23 | |
| *** haomaiwang has quit IRC | 03:31 | |
| *** haomaiwang has joined #openstack-swift | 03:31 | |
| *** haomaiwang has quit IRC | 03:32 | |
| *** haomaiwang has joined #openstack-swift | 03:32 | |
| *** haomaiwang has quit IRC | 03:33 | |
| *** 7JTAADXKP has joined #openstack-swift | 03:33 | |
| *** baojg has quit IRC | 03:33 | |
| *** 7JTAADXKP has quit IRC | 03:34 | |
| *** haomaiwa_ has joined #openstack-swift | 03:34 | |
| *** haomaiwa_ has quit IRC | 03:35 | |
| *** haomaiwang has joined #openstack-swift | 03:35 | |
| *** haomaiwang has quit IRC | 03:36 | |
| *** haomaiwa_ has joined #openstack-swift | 03:36 | |
| *** haomaiwa_ has quit IRC | 03:37 | |
| *** haomaiwa_ has joined #openstack-swift | 03:37 | |
| *** haomaiwa_ has quit IRC | 03:38 | |
| *** haomaiwang has joined #openstack-swift | 03:38 | |
| *** haomaiwang has quit IRC | 03:39 | |
| *** haomaiwang has joined #openstack-swift | 03:39 | |
| *** haomaiwang has quit IRC | 03:40 | |
| *** haomaiwang has joined #openstack-swift | 03:40 | |
| *** haomaiwang has quit IRC | 03:41 | |
| *** haomaiwang has joined #openstack-swift | 03:41 | |
| *** haomaiwang has quit IRC | 03:42 | |
| *** haomaiwa_ has joined #openstack-swift | 03:42 | |
| *** haomaiwa_ has quit IRC | 03:43 | |
| *** haomaiwang has joined #openstack-swift | 03:43 | |
| *** haomaiwang has quit IRC | 03:44 | |
| *** arch-nemesis has quit IRC | 03:44 | |
| *** haomaiwa_ has joined #openstack-swift | 03:44 | |
| *** haomaiwa_ has quit IRC | 03:45 | |
| *** haomaiwang has joined #openstack-swift | 03:45 | |
| *** haomaiwang has quit IRC | 03:46 | |
| *** haomaiwa_ has joined #openstack-swift | 03:46 | |
| *** haomaiwa_ has quit IRC | 03:47 | |
| *** haomaiwang has joined #openstack-swift | 03:47 | |
| *** haomaiwang has quit IRC | 03:48 | |
| *** haomaiwang has joined #openstack-swift | 03:48 | |
| *** haomaiwang has quit IRC | 03:49 | |
| *** haomaiwa_ has joined #openstack-swift | 03:49 | |
| *** haomaiwa_ has quit IRC | 03:50 | |
| *** haomaiwang has joined #openstack-swift | 03:50 | |
| *** haomaiwang has quit IRC | 03:51 | |
| *** haomaiwa_ has joined #openstack-swift | 03:51 | |
| *** haomaiwa_ has quit IRC | 03:52 | |
| *** haomaiwa_ has joined #openstack-swift | 03:52 | |
| *** haomaiwa_ has quit IRC | 03:53 | |
| *** haomaiwang has joined #openstack-swift | 03:53 | |
| *** haomaiwang has quit IRC | 03:54 | |
| *** haomaiwa_ has joined #openstack-swift | 03:54 | |
| *** haomaiwa_ has quit IRC | 03:55 | |
| *** haomaiwa_ has joined #openstack-swift | 03:55 | |
| *** haomaiwa_ has quit IRC | 03:56 | |
| *** haomaiwa_ has joined #openstack-swift | 03:56 | |
| *** haomaiwa_ has quit IRC | 03:57 | |
| *** haomaiwang has joined #openstack-swift | 03:57 | |
| *** haomaiwang has quit IRC | 03:58 | |
| *** haomaiwa_ has joined #openstack-swift | 03:58 | |
| *** trifon has joined #openstack-swift | 03:58 | |
| *** haomaiwa_ has quit IRC | 03:59 | |
| *** haomaiwa_ has joined #openstack-swift | 03:59 | |
| *** treaki_ has quit IRC | 03:59 | |
| *** haomaiwa_ has quit IRC | 04:00 | |
| *** klrmn has joined #openstack-swift | 04:00 | |
| *** baojg has joined #openstack-swift | 04:00 | |
| *** arch-nemesis has joined #openstack-swift | 04:00 | |
| *** haomaiwang has joined #openstack-swift | 04:00 | |
| *** haomaiwang has quit IRC | 04:01 | |
| *** haomaiwa_ has joined #openstack-swift | 04:01 | |
| *** haomaiwa_ has quit IRC | 04:02 | |
| *** treaki_ has joined #openstack-swift | 04:02 | |
| *** haomaiwa_ has joined #openstack-swift | 04:02 | |
| *** ho_ has joined #openstack-swift | 04:02 | |
| *** haomaiwa_ has quit IRC | 04:03 | |
| *** haomaiwa_ has joined #openstack-swift | 04:03 | |
| ho_ | hello | 04:03 |
| *** haomaiwa_ has quit IRC | 04:04 | |
| mattoliverau | ho_: morning | 04:04 |
| *** haomaiwa_ has joined #openstack-swift | 04:04 | |
| *** haomaiwa_ has quit IRC | 04:05 | |
| ho_ | mattoliverau: morning. you know we are 1:00 pm now :-) | 04:05 |
| *** haomaiwang has joined #openstack-swift | 04:05 | |
| *** haomaiwang has quit IRC | 04:06 | |
| *** haomaiwang has joined #openstack-swift | 04:06 | |
| *** haomaiwang has quit IRC | 04:07 | |
| *** haomaiwang has joined #openstack-swift | 04:07 | |
| *** haomaiwang has quit IRC | 04:08 | |
| openstackgerrit | Merged openstack/swift: Missing comments for storage policy parameter https://review.openstack.org/289663 | 04:08 |
| *** haomaiwang has joined #openstack-swift | 04:08 | |
| *** haomaiwang has quit IRC | 04:09 | |
| *** 64MAAI2AF has joined #openstack-swift | 04:09 | |
| *** 64MAAI2AF has quit IRC | 04:10 | |
| *** haomaiwa_ has joined #openstack-swift | 04:10 | |
| *** haomaiwa_ has quit IRC | 04:11 | |
| *** haomaiwa_ has joined #openstack-swift | 04:11 | |
| *** haomaiwa_ has quit IRC | 04:12 | |
| *** haomaiwa_ has joined #openstack-swift | 04:12 | |
| *** haomaiwa_ has quit IRC | 04:13 | |
| *** bapalm has quit IRC | 04:13 | |
| *** haomaiwang has joined #openstack-swift | 04:13 | |
| *** haomaiwang has quit IRC | 04:14 | |
| *** haomaiwang has joined #openstack-swift | 04:14 | |
| *** haomaiwang has quit IRC | 04:15 | |
| *** haomaiwa_ has joined #openstack-swift | 04:15 | |
| *** haomaiwa_ has quit IRC | 04:16 | |
| *** haomaiwang has joined #openstack-swift | 04:16 | |
| *** haomaiwang has quit IRC | 04:17 | |
| *** haomaiwang has joined #openstack-swift | 04:17 | |
| *** haomaiwang has quit IRC | 04:18 | |
| *** haomaiwang has joined #openstack-swift | 04:18 | |
| *** haomaiwang has quit IRC | 04:19 | |
| *** haomaiwa_ has joined #openstack-swift | 04:19 | |
| *** haomaiwa_ has quit IRC | 04:20 | |
| *** haomaiwang has joined #openstack-swift | 04:20 | |
| *** haomaiwang has quit IRC | 04:21 | |
| *** haomaiwa_ has joined #openstack-swift | 04:21 | |
| openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift: WIP: Swift Automated Tiering https://review.openstack.org/287057 | 04:21 |
| *** haomaiwa_ has quit IRC | 04:22 | |
| *** haomaiwa_ has joined #openstack-swift | 04:22 | |
| *** haomaiwa_ has quit IRC | 04:23 | |
| *** haomaiwang has joined #openstack-swift | 04:23 | |
| *** haomaiwang has quit IRC | 04:24 | |
| *** haomaiwang has joined #openstack-swift | 04:24 | |
| *** haomaiwang has quit IRC | 04:25 | |
| *** 7GHAAG6JK has joined #openstack-swift | 04:25 | |
| *** 7GHAAG6JK has quit IRC | 04:26 | |
| *** haomaiwang has joined #openstack-swift | 04:26 | |
| *** haomaiwang has quit IRC | 04:27 | |
| *** haomaiwang has joined #openstack-swift | 04:27 | |
| *** haomaiwang has quit IRC | 04:28 | |
| *** haomaiwang has joined #openstack-swift | 04:28 | |
| *** haomaiwang has quit IRC | 04:29 | |
| *** haomaiwang has joined #openstack-swift | 04:29 | |
| *** haomaiwang has quit IRC | 04:30 | |
| *** bapalm has joined #openstack-swift | 04:30 | |
| *** haomaiwa_ has joined #openstack-swift | 04:30 | |
| *** haomaiwa_ has quit IRC | 04:31 | |
| *** haomaiwang has joined #openstack-swift | 04:31 | |
| *** haomaiwang has quit IRC | 04:32 | |
| *** haomaiwa_ has joined #openstack-swift | 04:32 | |
| *** haomaiwa_ has quit IRC | 04:33 | |
| *** haomaiwang has joined #openstack-swift | 04:33 | |
| *** links has joined #openstack-swift | 04:33 | |
| *** haomaiwang has quit IRC | 04:34 | |
| *** haomaiwa_ has joined #openstack-swift | 04:34 | |
| *** haomaiwa_ has quit IRC | 04:35 | |
| *** trifon has quit IRC | 04:35 | |
| *** haomaiwang has joined #openstack-swift | 04:35 | |
| *** haomaiwang has quit IRC | 04:36 | |
| *** haomaiwang has joined #openstack-swift | 04:36 | |
| *** haomaiwang has quit IRC | 04:37 | |
| *** haomaiwang has joined #openstack-swift | 04:37 | |
| *** haomaiwang has quit IRC | 04:38 | |
| *** haomaiwa_ has joined #openstack-swift | 04:38 | |
| *** haomaiwa_ has quit IRC | 04:39 | |
| *** treaki__ has joined #openstack-swift | 04:39 | |
| *** haomaiwang has joined #openstack-swift | 04:39 | |
| *** haomaiwang has quit IRC | 04:40 | |
| *** haomaiwang has joined #openstack-swift | 04:40 | |
| *** haomaiwang has quit IRC | 04:41 | |
| *** 16WAAC23P has joined #openstack-swift | 04:41 | |
| *** 16WAAC23P has quit IRC | 04:42 | |
| *** haomaiwa_ has joined #openstack-swift | 04:42 | |
| *** haomaiwa_ has quit IRC | 04:43 | |
| *** haomaiwa_ has joined #openstack-swift | 04:43 | |
| *** treaki_ has quit IRC | 04:43 | |
| *** haomaiwa_ has quit IRC | 04:44 | |
| *** haomaiwa_ has joined #openstack-swift | 04:44 | |
| *** haomaiwa_ has quit IRC | 04:45 | |
| *** haomaiwa_ has joined #openstack-swift | 04:45 | |
| *** haomaiwa_ has quit IRC | 04:46 | |
| *** haomaiwa_ has joined #openstack-swift | 04:46 | |
| *** haomaiwa_ has quit IRC | 04:47 | |
| *** haomaiwa_ has joined #openstack-swift | 04:47 | |
| *** haomaiwa_ has quit IRC | 04:48 | |
| *** haomaiwa_ has joined #openstack-swift | 04:48 | |
| *** haomaiwa_ has quit IRC | 04:49 | |
| *** haomaiwa_ has joined #openstack-swift | 04:49 | |
| *** haomaiwa_ has quit IRC | 04:50 | |
| *** haomaiwa_ has joined #openstack-swift | 04:50 | |
| *** haomaiwa_ has quit IRC | 04:51 | |
| *** haomaiwa_ has joined #openstack-swift | 04:51 | |
| *** haomaiwa_ has quit IRC | 04:52 | |
| *** haomaiwa_ has joined #openstack-swift | 04:52 | |
| *** haomaiwa_ has quit IRC | 04:53 | |
| *** haomaiwa_ has joined #openstack-swift | 04:53 | |
| *** haomaiwa_ has quit IRC | 04:54 | |
| *** haomaiwang has joined #openstack-swift | 04:54 | |
| *** haomaiwang has quit IRC | 04:55 | |
| *** haomaiwa_ has joined #openstack-swift | 04:55 | |
| *** sanchitmalhotra has quit IRC | 04:56 | |
| *** haomaiwa_ has quit IRC | 04:56 | |
| *** haomaiwang has joined #openstack-swift | 04:56 | |
| *** haomaiwang has quit IRC | 04:57 | |
| *** haomaiwang has joined #openstack-swift | 04:57 | |
| *** haomaiwang has quit IRC | 04:58 | |
| *** haomaiwang has joined #openstack-swift | 04:58 | |
| *** haomaiwang has quit IRC | 04:59 | |
| *** haomaiwang has joined #openstack-swift | 04:59 | |
| *** haomaiwang has quit IRC | 05:00 | |
| *** haomaiwang has joined #openstack-swift | 05:00 | |
| *** haomaiwang has quit IRC | 05:01 | |
| *** haomaiwang has joined #openstack-swift | 05:01 | |
| *** haomaiwang has quit IRC | 05:02 | |
| *** haomaiwa_ has joined #openstack-swift | 05:02 | |
| *** haomaiwa_ has quit IRC | 05:03 | |
| *** haomaiwang has joined #openstack-swift | 05:03 | |
| *** haomaiwang has quit IRC | 05:04 | |
| *** haomaiwang has joined #openstack-swift | 05:04 | |
| *** haomaiwang has quit IRC | 05:05 | |
| *** haomaiwa_ has joined #openstack-swift | 05:05 | |
| *** haomaiwa_ has quit IRC | 05:06 | |
| *** arch-nemesis has quit IRC | 05:06 | |
| *** haomaiwa_ has joined #openstack-swift | 05:06 | |
| *** ppai has joined #openstack-swift | 05:06 | |
| *** dmorita has joined #openstack-swift | 05:07 | |
| *** haomaiwa_ has quit IRC | 05:07 | |
| *** haomaiwa_ has joined #openstack-swift | 05:07 | |
| *** haomaiwa_ has quit IRC | 05:08 | |
| *** sanchitmalhotra has joined #openstack-swift | 05:08 | |
| *** haomaiwa_ has joined #openstack-swift | 05:08 | |
| *** haomaiwa_ has quit IRC | 05:09 | |
| *** haomaiwang has joined #openstack-swift | 05:09 | |
| *** haomaiwang has quit IRC | 05:10 | |
| *** haomaiwa_ has joined #openstack-swift | 05:10 | |
| *** haomaiwa_ has quit IRC | 05:11 | |
| *** 18WAADIIG has joined #openstack-swift | 05:11 | |
| *** 18WAADIIG has quit IRC | 05:12 | |
| *** dmorita has quit IRC | 05:12 | |
| *** haomaiwang has joined #openstack-swift | 05:12 | |
| *** haomaiwang has quit IRC | 05:13 | |
| *** 18WAADIIS has joined #openstack-swift | 05:13 | |
| *** 18WAADIIS has quit IRC | 05:14 | |
| *** haomaiwa_ has joined #openstack-swift | 05:14 | |
| *** haomaiwa_ has quit IRC | 05:15 | |
| *** haomaiwa_ has joined #openstack-swift | 05:15 | |
| *** haomaiwa_ has quit IRC | 05:16 | |
| *** haomaiwa_ has joined #openstack-swift | 05:16 | |
| *** haomaiwa_ has quit IRC | 05:17 | |
| *** haomaiwang has joined #openstack-swift | 05:17 | |
| *** haomaiwang has quit IRC | 05:18 | |
| *** haomaiwa_ has joined #openstack-swift | 05:18 | |
| *** haomaiwa_ has quit IRC | 05:19 | |
| *** haomaiwa_ has joined #openstack-swift | 05:19 | |
| *** haomaiwa_ has quit IRC | 05:20 | |
| *** haomaiwang has joined #openstack-swift | 05:20 | |
| *** haomaiwang has quit IRC | 05:21 | |
| *** haomaiwa_ has joined #openstack-swift | 05:21 | |
| *** haomaiwa_ has quit IRC | 05:22 | |
| *** haomaiwa_ has joined #openstack-swift | 05:22 | |
| *** haomaiwa_ has quit IRC | 05:23 | |
| *** haomaiwa_ has joined #openstack-swift | 05:23 | |
| *** zul has quit IRC | 05:23 | |
| *** haomaiwa_ has quit IRC | 05:24 | |
| *** haomaiwa_ has joined #openstack-swift | 05:24 | |
| *** haomaiwa_ has quit IRC | 05:25 | |
| *** haomaiwang has joined #openstack-swift | 05:25 | |
| *** haomaiwang has quit IRC | 05:26 | |
| *** haomaiwa_ has joined #openstack-swift | 05:26 | |
| *** haomaiwa_ has quit IRC | 05:27 | |
| *** haomaiwa_ has joined #openstack-swift | 05:27 | |
| *** haomaiwa_ has quit IRC | 05:28 | |
| *** haomaiwang has joined #openstack-swift | 05:28 | |
| *** haomaiwang has quit IRC | 05:29 | |
| *** haomaiwa_ has joined #openstack-swift | 05:29 | |
| *** haomaiwa_ has quit IRC | 05:30 | |
| *** haomaiwa_ has joined #openstack-swift | 05:30 | |
| *** haomaiwa_ has quit IRC | 05:31 | |
| *** haomaiwang has joined #openstack-swift | 05:31 | |
| *** haomaiwang has quit IRC | 05:32 | |
| *** 7F1AAFI3P has joined #openstack-swift | 05:32 | |
| *** proteusguy has quit IRC | 05:32 | |
| *** 7F1AAFI3P has quit IRC | 05:33 | |
| *** haomaiwang has joined #openstack-swift | 05:33 | |
| *** haomaiwang has quit IRC | 05:34 | |
| *** haomaiwang has joined #openstack-swift | 05:34 | |
| *** haomaiwang has quit IRC | 05:35 | |
| *** haomaiwa_ has joined #openstack-swift | 05:35 | |
| *** haomaiwa_ has quit IRC | 05:36 | |
| *** haomaiwa_ has joined #openstack-swift | 05:36 | |
| *** haomaiwa_ has quit IRC | 05:37 | |
| *** haomaiwa_ has joined #openstack-swift | 05:37 | |
| *** haomaiwa_ has quit IRC | 05:38 | |
| *** haomaiwang has joined #openstack-swift | 05:38 | |
| *** haomaiwang has quit IRC | 05:39 | |
| *** haomaiwa_ has joined #openstack-swift | 05:39 | |
| *** haomaiwa_ has quit IRC | 05:40 | |
| *** haomaiwa_ has joined #openstack-swift | 05:40 | |
| *** haomaiwa_ has quit IRC | 05:41 | |
| *** haomaiwa_ has joined #openstack-swift | 05:41 | |
| *** haomaiwa_ has quit IRC | 05:42 | |
| *** haomaiwa_ has joined #openstack-swift | 05:42 | |
| *** haomaiwa_ has quit IRC | 05:43 | |
| *** trifon has joined #openstack-swift | 05:43 | |
| *** haomaiwang has joined #openstack-swift | 05:43 | |
| *** haomaiwang has quit IRC | 05:44 | |
| *** haomaiwang has joined #openstack-swift | 05:44 | |
| *** haomaiwang has quit IRC | 05:45 | |
| *** proteusguy has joined #openstack-swift | 05:45 | |
| *** tdasilva has quit IRC | 05:45 | |
| *** 16WAAC3F7 has joined #openstack-swift | 05:45 | |
| *** 16WAAC3F7 has quit IRC | 05:46 | |
| *** haomaiwa_ has joined #openstack-swift | 05:46 | |
| *** haomaiwa_ has quit IRC | 05:47 | |
| *** haomaiwa_ has joined #openstack-swift | 05:47 | |
| *** haomaiwa_ has quit IRC | 05:48 | |
| *** haomaiwang has joined #openstack-swift | 05:48 | |
| *** haomaiwang has quit IRC | 05:49 | |
| *** haomaiwang has joined #openstack-swift | 05:49 | |
| *** haomaiwang has quit IRC | 05:50 | |
| *** haomaiwang has joined #openstack-swift | 05:50 | |
| *** haomaiwang has quit IRC | 05:51 | |
| *** haomaiwa_ has joined #openstack-swift | 05:51 | |
| *** haomaiwa_ has quit IRC | 05:52 | |
| *** haomaiwa_ has joined #openstack-swift | 05:52 | |
| *** haomaiwa_ has quit IRC | 05:53 | |
| *** haomaiwa_ has joined #openstack-swift | 05:53 | |
| *** haomaiwa_ has quit IRC | 05:54 | |
| *** haomaiwang has joined #openstack-swift | 05:54 | |
| *** haomaiwang has quit IRC | 05:55 | |
| *** haomaiwang has joined #openstack-swift | 05:55 | |
| *** haomaiwang has quit IRC | 05:56 | |
| *** 14WAAEZSW has joined #openstack-swift | 05:56 | |
| *** 14WAAEZSW has quit IRC | 05:57 | |
| *** haomaiwa_ has joined #openstack-swift | 05:57 | |
| *** haomaiwa_ has quit IRC | 05:58 | |
| *** haomaiwa_ has joined #openstack-swift | 05:59 | |
| *** haomaiwa_ has quit IRC | 06:00 | |
| *** haomaiwang has joined #openstack-swift | 06:00 | |
| *** haomaiwang has quit IRC | 06:01 | |
| *** haomaiwang has joined #openstack-swift | 06:01 | |
| *** haomaiwang has quit IRC | 06:02 | |
| *** shakamunyi has quit IRC | 06:02 | |
| *** rcernin has joined #openstack-swift | 06:02 | |
| *** haomaiwang has joined #openstack-swift | 06:02 | |
| *** haomaiwang has quit IRC | 06:03 | |
| *** haomaiwang has joined #openstack-swift | 06:03 | |
| *** haomaiwang has quit IRC | 06:04 | |
| *** haomaiwang has joined #openstack-swift | 06:04 | |
| *** haomaiwang has quit IRC | 06:05 | |
| *** haomaiwang has joined #openstack-swift | 06:05 | |
| *** haomaiwang has quit IRC | 06:06 | |
| *** haomaiwang has joined #openstack-swift | 06:06 | |
| *** haomaiwang has quit IRC | 06:07 | |
| *** haomaiwang has joined #openstack-swift | 06:07 | |
| *** haomaiwang has quit IRC | 06:08 | |
| *** jamielennox is now known as jamielennox|away | 06:08 | |
| *** haomaiwang has joined #openstack-swift | 06:08 | |
| *** haomaiwang has quit IRC | 06:09 | |
| *** haomaiwa_ has joined #openstack-swift | 06:09 | |
| *** haomaiwa_ has quit IRC | 06:10 | |
| *** haomaiwa_ has joined #openstack-swift | 06:10 | |
| *** haomaiwa_ has quit IRC | 06:11 | |
| *** haomaiwa_ has joined #openstack-swift | 06:11 | |
| *** haomaiwa_ has quit IRC | 06:12 | |
| *** haomaiwa_ has joined #openstack-swift | 06:12 | |
| *** haomaiwa_ has quit IRC | 06:13 | |
| *** haomaiwa_ has joined #openstack-swift | 06:13 | |
| *** haomaiwa_ has quit IRC | 06:14 | |
| *** haomaiwa_ has joined #openstack-swift | 06:14 | |
| *** haomaiwa_ has quit IRC | 06:15 | |
| *** haomaiwa_ has joined #openstack-swift | 06:15 | |
| *** haomaiwa_ has quit IRC | 06:16 | |
| *** haomaiwa_ has joined #openstack-swift | 06:16 | |
| *** haomaiwa_ has quit IRC | 06:17 | |
| *** haomaiwang has joined #openstack-swift | 06:17 | |
| *** haomaiwang has quit IRC | 06:18 | |
| *** asettle has quit IRC | 06:18 | |
| *** haomaiwang has joined #openstack-swift | 06:18 | |
| *** haomaiwang has quit IRC | 06:19 | |
| *** tdasilva has joined #openstack-swift | 06:19 | |
| *** haomaiwa_ has joined #openstack-swift | 06:19 | |
| *** haomaiwa_ has quit IRC | 06:20 | |
| *** 7GHAAG632 has joined #openstack-swift | 06:20 | |
| *** 7GHAAG632 has quit IRC | 06:21 | |
| *** haomaiwa_ has joined #openstack-swift | 06:21 | |
| *** haomaiwa_ has quit IRC | 06:22 | |
| *** 7GHAAG64C has joined #openstack-swift | 06:22 | |
| *** 7GHAAG64C has quit IRC | 06:23 | |
| *** haomaiwang has joined #openstack-swift | 06:23 | |
| *** haomaiwang has quit IRC | 06:24 | |
| *** 7GHAAG64P has joined #openstack-swift | 06:24 | |
| *** 7GHAAG64P has quit IRC | 06:25 | |
| *** haomaiwang has joined #openstack-swift | 06:25 | |
| *** haomaiwang has quit IRC | 06:26 | |
| *** 7GHAAG641 has joined #openstack-swift | 06:26 | |
| *** 7GHAAG641 has quit IRC | 06:27 | |
| *** haomaiwang has joined #openstack-swift | 06:27 | |
| *** haomaiwang has quit IRC | 06:28 | |
| *** haomaiwang has joined #openstack-swift | 06:28 | |
| *** haomaiwang has quit IRC | 06:29 | |
| *** haomaiwang has joined #openstack-swift | 06:29 | |
| *** haomaiwang has quit IRC | 06:30 | |
| *** asettle has joined #openstack-swift | 06:30 | |
| *** haomaiwang has joined #openstack-swift | 06:30 | |
| *** haomaiwang has quit IRC | 06:31 | |
| *** 14WAAEZZT has joined #openstack-swift | 06:31 | |
| *** 14WAAEZZT has quit IRC | 06:32 | |
| *** haomaiwa_ has joined #openstack-swift | 06:32 | |
| *** haomaiwa_ has quit IRC | 06:33 | |
| *** haomaiwang has joined #openstack-swift | 06:33 | |
| *** haomaiwang has quit IRC | 06:34 | |
| *** haomaiwa_ has joined #openstack-swift | 06:34 | |
| *** haomaiwa_ has quit IRC | 06:35 | |
| *** asettle has quit IRC | 06:35 | |
| *** haomaiwa_ has joined #openstack-swift | 06:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Imported Translations from Zanata https://review.openstack.org/289737 | 06:35 |
| *** haomaiwa_ has quit IRC | 06:36 | |
| *** haomaiwa_ has joined #openstack-swift | 06:36 | |
| *** haomaiwa_ has quit IRC | 06:37 | |
| *** haomaiwa_ has joined #openstack-swift | 06:37 | |
| *** haomaiwa_ has quit IRC | 06:38 | |
| *** haomaiwang has joined #openstack-swift | 06:38 | |
| *** haomaiwang has quit IRC | 06:39 | |
| *** haomaiwang has joined #openstack-swift | 06:39 | |
| *** haomaiwang has quit IRC | 06:40 | |
| *** haomaiwang has joined #openstack-swift | 06:40 | |
| *** haomaiwang has quit IRC | 06:41 | |
| *** haomaiwang has joined #openstack-swift | 06:41 | |
| *** haomaiwang has quit IRC | 06:42 | |
| *** asettle has joined #openstack-swift | 06:42 | |
| *** haomaiwa_ has joined #openstack-swift | 06:42 | |
| *** haomaiwa_ has quit IRC | 06:42 | |
| *** haomaiwang has joined #openstack-swift | 06:43 | |
| *** david-lyle has quit IRC | 06:44 | |
| *** david-lyle_ has joined #openstack-swift | 06:44 | |
| openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift: WIP: Swift Automated Tiering https://review.openstack.org/287057 | 06:47 |
| *** pcaruana has quit IRC | 06:57 | |
| *** haomaiwang has quit IRC | 07:01 | |
| *** haomaiwang has joined #openstack-swift | 07:01 | |
| *** asettle has quit IRC | 07:01 | |
| *** asettle has joined #openstack-swift | 07:09 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix reclaimable PUT racing .durable/.data cleanup https://review.openstack.org/289756 | 07:12 |
| *** sanchitmalhotra1 has joined #openstack-swift | 07:36 | |
| *** sanchitmalhotra has quit IRC | 07:37 | |
| openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift: WIP: Swift Automated Tiering https://review.openstack.org/287057 | 07:40 |
| *** silor has joined #openstack-swift | 07:51 | |
| *** mmcardle has joined #openstack-swift | 07:55 | |
| *** jmccarthy has joined #openstack-swift | 07:59 | |
| *** haomaiwang has quit IRC | 08:01 | |
| *** haomaiwa_ has joined #openstack-swift | 08:01 | |
| *** baojg has quit IRC | 08:02 | |
| *** baojg has joined #openstack-swift | 08:03 | |
| *** asettle has quit IRC | 08:08 | |
| *** ppai is now known as ppai|afk | 08:09 | |
| *** silor1 has joined #openstack-swift | 08:11 | |
| *** silor has quit IRC | 08:12 | |
| *** silor1 is now known as silor | 08:12 | |
| *** permalac has joined #openstack-swift | 08:15 | |
| *** asettle has joined #openstack-swift | 08:18 | |
| *** asettle has quit IRC | 08:23 | |
| *** rledisez has joined #openstack-swift | 08:23 | |
| *** klrmn has quit IRC | 08:29 | |
| *** asettle has joined #openstack-swift | 08:40 | |
| *** mvk has joined #openstack-swift | 08:41 | |
| *** geaaru has joined #openstack-swift | 08:43 | |
| *** ppai|afk is now known as ppai | 08:49 | |
| *** jordanP has joined #openstack-swift | 08:50 | |
| *** asettle has quit IRC | 08:53 | |
| *** haomaiwa_ has quit IRC | 09:01 | |
| *** haomaiwang has joined #openstack-swift | 09:01 | |
| *** kei_yama has quit IRC | 09:07 | |
| *** jistr has joined #openstack-swift | 09:11 | |
| *** zaitcev has quit IRC | 09:12 | |
| *** silor has quit IRC | 09:26 | |
| *** Jeffrey4l has quit IRC | 09:33 | |
| *** jsuchome has joined #openstack-swift | 09:34 | |
| *** baojg has quit IRC | 09:49 | |
| *** silor has joined #openstack-swift | 09:58 | |
| *** asettle has joined #openstack-swift | 10:00 | |
| *** haomaiwang has quit IRC | 10:01 | |
| *** haomaiwang has joined #openstack-swift | 10:01 | |
| openstackgerrit | Andy McCrae proposed openstack/swift: Allow fallocate_reserve to be a percentage https://review.openstack.org/288011 | 10:02 |
| *** stantonnet has quit IRC | 10:03 | |
| openstackgerrit | Andy McCrae proposed openstack/swift: Allow fallocate_reserve to be a percentage https://review.openstack.org/288011 | 10:04 |
| *** stantonnet has joined #openstack-swift | 10:06 | |
| *** takashi has quit IRC | 10:07 | |
| *** silor1 has joined #openstack-swift | 10:07 | |
| *** zul has joined #openstack-swift | 10:07 | |
| *** silor has quit IRC | 10:11 | |
| *** silor1 is now known as silor | 10:11 | |
| *** mvk has quit IRC | 10:14 | |
| *** mvk has joined #openstack-swift | 10:15 | |
| openstackgerrit | oshritf proposed openstack/swift: Per container stat. report https://review.openstack.org/281814 | 10:21 |
| *** acoles_ is now known as acoles | 10:26 | |
| *** ChubYann has quit IRC | 10:29 | |
| *** openstackgerrit has quit IRC | 10:33 | |
| *** openstackgerrit has joined #openstack-swift | 10:33 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix reclaimable PUT racing .durable/.data cleanup https://review.openstack.org/289756 | 10:33 |
| *** ppai has quit IRC | 10:36 | |
| acoles | hi kota_ | 10:40 |
| kota_ | acoles: hi, acoles | 10:40 |
| acoles | I was thinking about this bug you are working on in patch 289756 | 10:40 |
| patchbot | acoles: https://review.openstack.org/#/c/289756/ - swift - Fix reclaimable PUT racing .durable/.data cleanup | 10:40 |
| kota_ | acoles: oh, thanks so quickly | 10:41 |
| acoles | well, i thought a *little* about it ;) | 10:41 |
| kota_ | acoles: I thought acoles save me :/ | 10:41 |
| acoles | I wondered if we could somehow reverse the order of .durable and .data file creation when reconstructing since we know 'a priori' that the object being reconstructed is durable. | 10:43 |
| *** ho_ has quit IRC | 10:43 | |
| *** ChubYann has joined #openstack-swift | 10:43 | |
| acoles | I haven't stared at the code to see how feasible that would be. | 10:44 |
| acoles | kota_: I'm just throwing out the idea, I'll look at your patch too. | 10:45 |
| kota_ | well.. | 10:45 |
| kota_ | alright, can i make sure your idea? | 10:45 |
| kota_ | so which method needs the reverse order? | 10:46 |
| kota_ | cleanup-ish/ | 10:46 |
| kota_ | ? | 10:46 |
| acoles | kota_: looking... | 10:46 |
| *** ChubYann has quit IRC | 10:50 | |
| kota_ | so for now, diskfile will search the .durable files from the newest to the oldest. | 10:53 |
| kota_ | current problem comes from the newest (i.e. exts['.durable'][0]) may not have .data files for the durable timestamp. | 10:55 |
| kota_ | that's what (to be honest) I'm not sure because maybe .durable only in the device situation will happen. | 10:55 |
| kota_ | (not sure) | 10:55 |
| kota_ | (to be honest, not sure) | 10:56 |
| *** asettle has quit IRC | 10:58 | |
| kota_ | basic (>reclaim_age) path (e.g. PUT) doesn't make the situation because .durable should be written after .data | 10:58 |
| acoles | kota_: maybe my idea wasn't so great - there's a risk that writing the durable file before the data file then causes some older durable data to be removed, but then the newer data file write fails :/ | 10:59 |
| kota_ | or hash_cleanup_listdir keep older .data untill reclame_age. | 10:59 |
| kota_ | acoles: :/ | 11:00 |
| *** haomaiwang has quit IRC | 11:01 | |
| *** haomaiwang has joined #openstack-swift | 11:01 | |
| kota_ | so, please careful to look at, I scrached and built some idea for smarter way but... | 11:03 |
| *** ChubYann has joined #openstack-swift | 11:03 | |
| kota_ | currently, this one seems better for me *BUT* welecome better idea abosolutely :) | 11:04 |
| kota_ | acoles: sorry, it's time heading for my home. | 11:06 |
| kota_ | will be back online, later | 11:07 |
| acoles | kota_: so the result of your patch is to at least keep the older t0.durable/t0.data? | 11:07 |
| acoles | kota_: sure, I'll think some more and chat later or tomorrow | 11:07 |
| *** acoles is now known as acoles_ | 11:21 | |
| openstackgerrit | Merged openstack/swift: Imported Translations from Zanata https://review.openstack.org/289737 | 11:32 |
| *** mmuffinman has quit IRC | 11:42 | |
| *** haomaiwang has quit IRC | 11:46 | |
| *** km has quit IRC | 11:55 | |
| *** permalac has quit IRC | 11:55 | |
| *** ChanServ sets mode: +v tdasilva | 12:10 | |
| tdasilva | good morning | 12:11 |
| *** acoles_ is now known as acoles | 12:18 | |
| *** kjz has joined #openstack-swift | 12:24 | |
| acoles | tdasilva: good morning | 12:25 |
| acoles | timburke: notmyname I gave the backport of client token redaction a unique changeID, which means it is now here - patch 289890 | 12:26 |
| patchbot | acoles: https://review.openstack.org/#/c/289890/ - python-swiftclient (stable/liberty) - Do not reveal auth token in swiftclient log messag... | 12:26 |
| tdasilva | acoles: quick question on patch 237393. Is this the patch that someone mentioned last week that needs work from torgomatic? or maybe just his review? | 12:27 |
| patchbot | tdasilva: https://review.openstack.org/#/c/237393/ - swift (feature/crypto) - Support for http footers - Replication and EC | 12:27 |
| tdasilva | acoles: just wondering if it still needs a big rewrite or if it's ready for review... | 12:28 |
| acoles | tdasilva: yes. afaik its ready for review, the comment last week was that torgomatic might be a good reviewer since he wrote the EC version. torgomatic may have been out of the room when we said that :) | 12:30 |
| acoles | tdasilva: its in merge conflict - i just merged master into feature/crypto, let me see if the rebase is trivial | 12:30 |
| * acoles crosses fingers | 12:30 | |
| tdasilva | acoles: hehe...ok | 12:30 |
| *** NM has joined #openstack-swift | 12:45 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: Support for http footers - Replication and EC https://review.openstack.org/237393 | 12:46 |
| acoles | tdasilva: ok, not so bad ^^ | 12:46 |
| tdasilva | acoles: neat! i will check it out | 12:46 |
| acoles | jrichli: i rebase your patch but needed to change some log levels to pass unit tests ^^ hopefully thats ok with you ;) | 12:47 |
| acoles | tdasilva: back later | 12:47 |
| *** mmcardle1 has joined #openstack-swift | 12:55 | |
| *** mmcardle has quit IRC | 12:55 | |
| openstackgerrit | oshritf proposed openstack/swift: Container-Sync to perform HEAD before PUT object on remote https://review.openstack.org/270961 | 12:55 |
| *** trifon has quit IRC | 12:56 | |
| *** baojg has joined #openstack-swift | 12:57 | |
| *** mmcardle1 has quit IRC | 13:10 | |
| openstackgerrit | oshritf proposed openstack/swift: Per container stat. report https://review.openstack.org/281814 | 13:14 |
| *** dmellado has joined #openstack-swift | 13:19 | |
| kota_ | back shortly | 13:24 |
| kota_ | acoles: exactly, my idea is to keep older t0.data t0.durable at t1 cleanup. | 13:26 |
| kota_ | i think t1 putter is only guy who know if the t1.data/.durable is missing (or partial written) | 13:26 |
| kota_ | anyways, i will continue to consider where state I may be missing tomorrow-ish. | 13:27 |
| *** mmcardle has joined #openstack-swift | 13:29 | |
| *** baojg has quit IRC | 13:31 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: remove hash_cleanup_listdir legacy translation method https://review.openstack.org/289916 | 13:32 |
| *** fthiagogv has quit IRC | 13:35 | |
| *** haomaiwang has joined #openstack-swift | 13:38 | |
| *** haomaiwang has quit IRC | 13:42 | |
| pdardeau | good morning | 13:47 |
| openstackgerrit | Marek Kaleta proposed openstack/python-swiftclient: Add copy object method https://review.openstack.org/280200 | 13:47 |
| acoles | pdardeau: good morning | 13:59 |
| *** jistr is now known as jistr|call | 13:59 | |
| pdardeau | acoles: good morning sir! | 14:00 |
| acoles | pdardeau: good journey home? | 14:00 |
| pdardeau | acoles: it was. thank goodness by nc headphones held out! :) | 14:01 |
| *** haomaiwang has joined #openstack-swift | 14:01 | |
| *** nadeem has joined #openstack-swift | 14:06 | |
| *** petertr7_away is now known as petertr7 | 14:08 | |
| *** _JZ_ has joined #openstack-swift | 14:11 | |
| *** links has quit IRC | 14:27 | |
| *** jistr|call is now known as jistr | 14:40 | |
| jrichli | acoles: np. much appreciated :-) | 14:44 |
| *** delattec has joined #openstack-swift | 14:49 | |
| *** delatte has quit IRC | 14:51 | |
| *** delattec has quit IRC | 14:51 | |
| *** delattec has joined #openstack-swift | 14:52 | |
| *** dmsimard has joined #openstack-swift | 14:56 | |
| *** haomaiwang has quit IRC | 15:01 | |
| *** haomaiwang has joined #openstack-swift | 15:01 | |
| *** tsg has joined #openstack-swift | 15:09 | |
| *** fthiagogv has joined #openstack-swift | 15:11 | |
| *** fthiagogv has quit IRC | 15:12 | |
| *** fthiagogv has joined #openstack-swift | 15:12 | |
| *** fthiagogv has quit IRC | 15:13 | |
| *** fthiagogv has joined #openstack-swift | 15:13 | |
| *** mingyu has joined #openstack-swift | 15:14 | |
| *** fthiagogv has quit IRC | 15:15 | |
| *** fthiagogv has joined #openstack-swift | 15:16 | |
| acoles | is Olga Saprycheva here? | 15:18 |
| sgundur | good morning | 15:20 |
| *** nadeem has quit IRC | 15:21 | |
| jrichli | acoles: I can ping her for you | 15:27 |
| *** zul has quit IRC | 15:28 | |
| acoles | jrichli: there's a simple follow up Olga might like to do on patch 288748 | 15:28 |
| patchbot | acoles: https://review.openstack.org/#/c/288748/ - swift - Fixed pep8 and flake8 errors in doc/source/conf.py... | 15:28 |
| acoles | jrichli: thanks | 15:28 |
| *** zul has joined #openstack-swift | 15:29 | |
| jrichli | acoles: she just got to work and is in a meeting. her nick is osapryc. she'll be on soon | 15:30 |
| *** ff has joined #openstack-swift | 15:40 | |
| sarafraj | morning | 15:45 |
| *** mingyu has quit IRC | 15:45 | |
| *** permalac has joined #openstack-swift | 15:46 | |
| *** arch-nemesis has joined #openstack-swift | 15:47 | |
| siva_krishnan | Good Morning! | 15:51 |
| *** links has joined #openstack-swift | 15:52 | |
| *** esker has joined #openstack-swift | 15:53 | |
| *** permalac_ has joined #openstack-swift | 15:56 | |
| *** daemontool_ has joined #openstack-swift | 15:59 | |
| *** permalac has quit IRC | 16:00 | |
| *** haomaiwang has quit IRC | 16:01 | |
| *** daemontool has quit IRC | 16:01 | |
| *** haomaiwa_ has joined #openstack-swift | 16:01 | |
| *** zul has quit IRC | 16:05 | |
| *** zul has joined #openstack-swift | 16:06 | |
| *** mmuffinman has joined #openstack-swift | 16:12 | |
| *** esker has quit IRC | 16:15 | |
| *** klrmn has joined #openstack-swift | 16:16 | |
| *** esker has joined #openstack-swift | 16:19 | |
| *** osapryc has joined #openstack-swift | 16:19 | |
| *** geaaru has quit IRC | 16:19 | |
| *** petertr7 is now known as petertr7_away | 16:24 | |
| *** nadeem has joined #openstack-swift | 16:25 | |
| *** david-lyle_ is now known as david-lyle | 16:28 | |
| openstackgerrit | Merged openstack/swift: Fixed pep8 and flake8 errors in doc/source/conf.py and updated flake8 commands in tox.ini to test it. https://review.openstack.org/288748 | 16:28 |
| openstackgerrit | Merged openstack/swift: go: O_TMPFILE https://review.openstack.org/216375 | 16:28 |
| *** dmsimard has quit IRC | 16:31 | |
| *** gyee has joined #openstack-swift | 16:34 | |
| osapryc | @acoles as I'm making the changes that was asked for in my vm, I noticed that the code got merged by Jenkins. Should I still amend the change to my branch? | 16:34 |
| *** chsc has joined #openstack-swift | 16:34 | |
| osapryc | I'm talking about https://review.openstack.org/#/c/288748/ | 16:35 |
| patchbot | osapryc: patch 288748 - swift - Fixed pep8 and flake8 errors in doc/source/conf.py... (MERGED) | 16:35 |
| acoles | osapryc: if you make the change on your branch but make a new commit (rather than amend the current commit) then you should get a new changeid, then when you push to gerrit it will be a new review | 16:36 |
| osapryc | acoles: okay, thank you | 16:37 |
| acoles | osapryc: or you can pull master and start a new local branch, either works | 16:37 |
| acoles | osapryc: i merged the first patch because it had +2, nothing was broken, and I did no know you would be this responsive :) | 16:38 |
| *** petertr7_away is now known as petertr7 | 16:41 | |
| *** pgbridge has joined #openstack-swift | 16:43 | |
| *** zaitcev has joined #openstack-swift | 16:43 | |
| *** ChanServ sets mode: +v zaitcev | 16:43 | |
| *** ff has quit IRC | 16:55 | |
| *** ff has joined #openstack-swift | 16:57 | |
| *** ff has quit IRC | 16:58 | |
| *** Jeffrey4l has joined #openstack-swift | 17:01 | |
| *** haomaiwa_ has quit IRC | 17:01 | |
| openstackgerrit | Olga Saprycheva proposed openstack/swift: Removed redundant file for flake8 check https://review.openstack.org/290018 | 17:01 |
| *** haomaiwang has joined #openstack-swift | 17:01 | |
| *** delatte has joined #openstack-swift | 17:03 | |
| *** delattec has quit IRC | 17:05 | |
| *** delattec has joined #openstack-swift | 17:05 | |
| *** shakamunyi has joined #openstack-swift | 17:06 | |
| *** delatte has quit IRC | 17:08 | |
| *** chsc has quit IRC | 17:16 | |
| *** daemontool_ has quit IRC | 17:16 | |
| *** lyrrad has joined #openstack-swift | 17:21 | |
| *** daemontool has joined #openstack-swift | 17:21 | |
| *** permalac_ has quit IRC | 17:22 | |
| *** shakamunyi has quit IRC | 17:23 | |
| *** d0ugal has quit IRC | 17:26 | |
| *** barker has joined #openstack-swift | 17:28 | |
| *** nadeem has quit IRC | 17:30 | |
| *** dmorita has joined #openstack-swift | 17:31 | |
| *** nadeem has joined #openstack-swift | 17:31 | |
| *** rcernin has quit IRC | 17:34 | |
| *** shakamunyi has joined #openstack-swift | 17:37 | |
| acoles | tdasilva: ^^ fixes what you spotted | 17:40 |
| *** esker has quit IRC | 17:40 | |
| tdasilva | acoles: osapryc: awesome, thanks! I didn't want to block that patch for a little thing, but thanks anyway | 17:41 |
| *** jistr has quit IRC | 17:43 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: Object POST update gets distinct async pending file https://review.openstack.org/289522 | 17:45 |
| *** barker has quit IRC | 17:45 | |
| acoles | torgomatic: it's not so straightforward ^^ , thanks clayg for the headsup re updater behaviour | 17:46 |
| notmyname | good morning | 17:48 |
| acoles | notmyname: good morning. i think consensus on patch 279256 is to merge as is, unless your thoughts led to a different view? | 17:50 |
| patchbot | acoles: https://review.openstack.org/#/c/279256/ - swift - By default, disallow inbound X-Timestamp headers | 17:50 |
| *** chsc has joined #openstack-swift | 17:51 | |
| notmyname | acoles: I agree. turn it on by default, so the next time someone upgrades, x-timestamp will be disallowed | 17:51 |
| *** dmorita has quit IRC | 17:52 | |
| notmyname | acoles: I can land it, unless youv'e already clicked the button | 17:52 |
| acoles | notmyname: go for it, i was just waiting for you to not disagree ;) | 17:52 |
| *** dmorita has joined #openstack-swift | 17:53 | |
| notmyname | done | 17:53 |
| notmyname | looks like my bouncer lost some messages last night. reviewing eavesdrop logs now | 17:53 |
| *** dmorita has quit IRC | 17:54 | |
| notmyname | osapryc: patch 288906 has been included in other patches, right? can it be abandoned? | 17:54 |
| patchbot | notmyname: https://review.openstack.org/#/c/288906/ - swift - Fixed flake8 errors in doc/source/conf.py and upda... | 17:54 |
| *** dmorita has joined #openstack-swift | 17:55 | |
| *** rledisez has quit IRC | 17:55 | |
| *** dmorita has quit IRC | 17:55 | |
| notmyname | looks like summit talk accept/reject notices went out | 17:55 |
| tdasilva | yeah, the schedule is out | 17:56 |
| *** zhill has joined #openstack-swift | 17:56 | |
| osapryc | notmyname: yes, it's included in https://review.openstack.org/#/c/288748/ | 17:59 |
| patchbot | osapryc: patch 288748 - swift - Fixed pep8 and flake8 errors in doc/source/conf.py... (MERGED) | 17:59 |
| notmyname | so the downside of going home and going to bed early yesterday is that now I have 225 emails to go through | 17:59 |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Update SAIO setup for Ubuntu 14.04 https://review.openstack.org/207790 | 17:59 |
| notmyname | osapryc: ok, great. would you like to abandon it, or shall I? | 17:59 |
| *** jordanP has quit IRC | 17:59 | |
| *** mvk has quit IRC | 18:00 | |
| *** zul has quit IRC | 18:00 | |
| *** dmorita has joined #openstack-swift | 18:00 | |
| *** zul has joined #openstack-swift | 18:01 | |
| *** haomaiwang has quit IRC | 18:01 | |
| *** zul_ has joined #openstack-swift | 18:01 | |
| *** zul has quit IRC | 18:01 | |
| *** haomaiwa_ has joined #openstack-swift | 18:01 | |
| *** zul_ is now known as zul | 18:01 | |
| osapryc | notmyname: I can do it | 18:01 |
| notmyname | osapryc: ok, thanks | 18:02 |
| *** jmccarthy1 has joined #openstack-swift | 18:04 | |
| *** petertr7 is now known as petertr7_away | 18:06 | |
| *** Guest40848 has quit IRC | 18:09 | |
| *** mmcardle has quit IRC | 18:14 | |
| CaioBrentano | hi all... does anyone have a billing case on swift usage? Any project/article to start studying about it ? | 18:16 |
| notmyname | CaioBrentano: like how do people do chargeback/billing with a swift cluster? | 18:17 |
| *** thumpba has joined #openstack-swift | 18:17 | |
| CaioBrentano | notmyname yes! exactly what I need | 18:18 |
| notmyname | CaioBrentano: there's a few ways to do it | 18:18 |
| notmyname | CaioBrentano: first, the "openstack answer" is to use ceilometer. I'm not a fan of that method because it polls the cluster and relies on real-time messages on a rabbitmq bus. | 18:19 |
| notmyname | CaioBrentano: in general, the best method (IMO) is to do it via log parsing (proxy logs) | 18:19 |
| notmyname | CaioBrentano: https://github.com/notmyname/slogging has been used for that by several public clouds | 18:20 |
| notmyname | CaioBrentano: and eg at swiftstack we have our own that's similar but tied into our management stuff | 18:20 |
| CaioBrentano | notmyname nice! thanks! | 18:21 |
| *** osapryc has quit IRC | 18:21 | |
| notmyname | CaioBrentano: so I think your realistic choices are, in no particular order, (1) use slogging (2) write your own (3) use a commercial product like swiftstack | 18:21 |
| CaioBrentano | notmyname I was reading about AWS S3 to understand what kind of metric they use to charge... traffic, number of objects, requests, etc | 18:22 |
| *** links has quit IRC | 18:23 | |
| CaioBrentano | notmyname I think I have to understand this before start digging in any kind of data | 18:25 |
| notmyname | CaioBrentano: slogging can track bytes and counts on containers, network in/out counts, and bytes used | 18:25 |
| *** petertr7_away is now known as petertr7 | 18:26 | |
| CaioBrentano | notmyname: I'll try it! thanks again | 18:30 |
| *** acoles is now known as acoles_ | 18:38 | |
| *** dmorita has quit IRC | 18:43 | |
| *** dmorita has joined #openstack-swift | 18:44 | |
| *** dmsimard has joined #openstack-swift | 18:50 | |
| *** petertr7 is now known as petertr7_away | 18:53 | |
| *** petertr7_away is now known as petertr7 | 18:54 | |
| *** haomaiwa_ has quit IRC | 19:01 | |
| *** haomaiwa_ has joined #openstack-swift | 19:01 | |
| *** bapalm has quit IRC | 19:02 | |
| clayg | heyoh! | 19:04 |
| *** dmorita has quit IRC | 19:10 | |
| *** jsuchome has left #openstack-swift | 19:12 | |
| *** esker has joined #openstack-swift | 19:12 | |
| *** esker has joined #openstack-swift | 19:12 | |
| openstackgerrit | Merged openstack/swift: go: replication prioritizer https://review.openstack.org/285844 | 19:17 |
| *** bapalm has joined #openstack-swift | 19:19 | |
| openstackgerrit | Merged openstack/swift: Removed redundant file for flake8 check https://review.openstack.org/290018 | 19:20 |
| *** zul has quit IRC | 19:20 | |
| notmyname | redbo: might want to look at another merge from master for hummingbird. the (currently non-voting) gate job that does fast-post tests isn't a known tox environment on your branch. last merge from master was early january | 19:22 |
| redbo | Okay I'll do that in a bit, thanks. | 19:23 |
| notmyname | ok, great | 19:23 |
| notmyname | let me know if you need any help on it | 19:23 |
| notmyname | redbo: also, on that topic, right now the general plan is to make that job voting and then drop support for post-as-copy. (note: no set timeframe yet as to when that process will start) | 19:24 |
| notmyname | redbo: I don't want you to be blindsided by it | 19:24 |
| *** dmorita has joined #openstack-swift | 19:26 | |
| notmyname | timburke: patch 279256 failed the gate on functests (both versions, with the same errors) but passed the check jobs. | 19:30 |
| patchbot | notmyname: https://review.openstack.org/#/c/279256/ - swift - By default, disallow inbound X-Timestamp headers | 19:30 |
| notmyname | timburke: http://logs.openstack.org/56/279256/4/gate/gate-swift-tox-func/ca05a11/console.html#_2016-03-08_17_59_54_522 | 19:30 |
| redbo | Yeah, it should be easy. Though I'm not a huge fan of it. Multiple meta files, multiple timestamps in filenames, multipe values in created_at. And later a whole new metadata namespace that seems to only be useful for crypto. | 19:33 |
| *** mmcardle has joined #openstack-swift | 19:35 | |
| *** zul has joined #openstack-swift | 19:36 | |
| *** mmcardle has quit IRC | 19:48 | |
| kjz | Is there a command that will let me know the replication status of an object? I found swift-recon, but the information if not at an object level. I'm trying to get an idea of how long a file is taking to replicate between regions in different data centers. | 19:49 |
| *** daemontool has quit IRC | 19:51 | |
| glange | kjz: you probably want to look into the swift-dispersion-report | 19:51 |
| glange | it places small objects in a bunch of paritions and then you can run it to see if they are in the right places after ring changes | 19:51 |
| glange | kjz: or if you really want to check on one object, you can run swift-get-nodes to see where the object should be and check to see if it's in place | 19:52 |
| kjz | perfect, thanks glange | 19:53 |
| kjz | The first looks good to get overall health of the systems | 19:53 |
| kjz | appreciate it | 19:53 |
| glange | cool | 19:53 |
| *** zul has quit IRC | 19:58 | |
| *** nadeem has quit IRC | 19:59 | |
| *** haomaiwa_ has quit IRC | 20:01 | |
| *** haomaiwa_ has joined #openstack-swift | 20:01 | |
| *** nadeem has joined #openstack-swift | 20:01 | |
| *** zul has joined #openstack-swift | 20:02 | |
| *** petertr7 is now known as petertr7_away | 20:03 | |
| *** petertr7_away is now known as petertr7 | 20:05 | |
| *** gyee has quit IRC | 20:10 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift: Spot check more hashes for increase_part_power https://review.openstack.org/290116 | 20:33 |
| openstackgerrit | Clay Gerrard proposed openstack/swift: Spot check more hashes for increase_part_power https://review.openstack.org/290116 | 20:34 |
| *** zul has quit IRC | 20:42 | |
| *** thumpba has quit IRC | 20:50 | |
| MooingLemur | clayg: I've been running finds on one disk for each of 20 storage nodes since early this morning to look for rsync dotfiles older than 1 day. Haven't seen any yet, and they're still going :) | 20:53 |
| MooingLemur | oh, I lied.. one has a zero byte one | 20:54 |
| *** zul has joined #openstack-swift | 20:55 | |
| *** delattec has quit IRC | 20:58 | |
| *** asettle has joined #openstack-swift | 20:58 | |
| *** bapalm has quit IRC | 20:58 | |
| *** haomaiwa_ has quit IRC | 21:01 | |
| *** haomaiwa_ has joined #openstack-swift | 21:01 | |
| *** silor has quit IRC | 21:09 | |
| *** esker has quit IRC | 21:11 | |
| *** esker has joined #openstack-swift | 21:12 | |
| *** bapalm has joined #openstack-swift | 21:14 | |
| *** cdelatte has joined #openstack-swift | 21:22 | |
| *** NM has quit IRC | 21:24 | |
| *** zul has quit IRC | 21:25 | |
| mattoliverau | morning | 21:27 |
| *** baojg has joined #openstack-swift | 21:30 | |
| notmyname | hello mattoliverau | 21:30 |
| mattoliverau | notmyname: how you feeling? any better? | 21:30 |
| notmyname | yes, thanks. my wife brought home some meds, and I'm feeling much better today | 21:31 |
| notmyname | mattoliverau: I know you sent me an email about a backport. and it's on my todo list to reply to today, but IIRC, the answer is "yes" | 21:31 |
| notmyname | mattoliverau: no vegimite required this time ;-) | 21:31 |
| pdardeau | hello mattoliverau | 21:32 |
| mattoliverau | notmyname: you'd have felt better yesterday if you vegemited when you got home.. just saying :P | 21:32 |
| notmyname | hey pdardeau! | 21:32 |
| notmyname | mattoliverau: yup, probably | 21:32 |
| mattoliverau | notmyname: cool ta, I wont add it to the meeting adjenda then | 21:33 |
| notmyname | there are several things that need to be backported, I think | 21:33 |
| mattoliverau | pdardeau: hey man! welcome back to your non-uk timezone, enjoy the jetlag? | 21:33 |
| mattoliverau | notmyname: yeah, I agree, but RPC ops are on my back about this bug. :) | 21:34 |
| pdardeau | mattoliverau: yes, it's delightful ;) | 21:34 |
| *** zul has joined #openstack-swift | 21:39 | |
| openstackgerrit | Michael Barton proposed openstack/swift: Merge master into feature/hummingbird https://review.openstack.org/290148 | 21:39 |
| notmyname | that should set off a big storm of emails :-) | 21:41 |
| mattoliverau | The fallocate_reserve change has raised a problem in Devstack, so trying to push through a patch there, so devstack gate can pass when we merge it. Also trying to help horizon who are rewriting the swift interface, so have a patch up with a contains parameter up, allowing there interface deal with large amounts of containers and objects (requrement from a large OP [apparently]).. so been a busy week even though y'all | 21:43 |
| mattoliverau | were enjoying Tea and Scones last week :) | 21:43 |
| mattoliverau | But still no baby :( | 21:44 |
| notmyname | what was the problems with fallocate percentage? | 21:44 |
| mattoliverau | notmyname: devstack uses the default max file size, but only a swift loopback drive of 1 or 2 GB (depending on if you have glance setup). With the fallocate_reserve patch, the reserve is defaulted to 5% (which is great) but it used to be zero. This opens up a new code path were we check to see if we have space. (so far so good). This now means our tests for testing max file size now fails in Devstack. and so devstack | 21:47 |
| mattoliverau | gate. | 21:47 |
| mattoliverau | I have a patch up in Devstack to set the max_file_size to something sane depending on the size of the loopback drive. | 21:48 |
| notmyname | good | 21:48 |
| notmyname | I'm getting pulled into a customer meeting. be back in a bit | 21:49 |
| mattoliverau | o/ | 21:49 |
| *** trifon has joined #openstack-swift | 21:50 | |
| *** haomaiwa_ has quit IRC | 22:01 | |
| clayg | mattoliverau: have you ran and sqlite explain on the contains patch? I'm pretty nervous this request can beat up containers. | 22:01 |
| *** zhill has quit IRC | 22:01 | |
| clayg | mattoliverau: it feels like a search use-case which we haven't tried to cover in the container server api to this point. | 22:01 |
| *** haomaiwang has joined #openstack-swift | 22:01 | |
| clayg | mattoliverau: I think the prefix delim queries allow the container backend to "skip over" pages of object rows in a way that won't be possible with the contains query as I understand it? | 22:02 |
| clayg | mattoliverau: it might be moot - I think it all depends on how the indexes can be used - honestly I normally ask redbo to sanity check me on these things - but some experimentating in the sqlite shell should be able to get at most of what I could imagine might go wrong | 22:03 |
| clayg | mattoliverau: also I lost that patch number (container contains query) | 22:03 |
| mattoliverau | clayg: I'll take a closer look. I think we are indexing the name so thought that should help | 22:04 |
| mattoliverau | clayg: I'm trying to help out the horizon guys, cause web interfaces don't work well with large numbers of objects/containers without some kind of search/contains | 22:05 |
| openstackgerrit | Merged openstack/swift: Add internal method to increase ring partition power https://review.openstack.org/155107 | 22:07 |
| *** petertr7 is now known as petertr7_away | 22:12 | |
| *** kjz has quit IRC | 22:23 | |
| *** dmorita has quit IRC | 22:23 | |
| *** jamielennox|away is now known as jamielennox | 22:29 | |
| *** delattec has joined #openstack-swift | 22:38 | |
| *** baojg has quit IRC | 22:38 | |
| clayg | mattoliverau: are they already doing prefix delim queries for browsing? If they really want to do "type in a name and we'll search for it" it seems like they could support making "dozens" of api requests async server side as easily as "a couple". | 22:39 |
| clayg | mattoliverau: I'm not really sure what say say if someone wants to do a pattern match on the name of object for a container with 4M rows - right know I guess it's a few hundred requests - but individually each request generates a load that's well understood. Maybe the contains query is fine too... | 22:40 |
| clayg | i agree the index might make it fine - explain would know tho | 22:40 |
| *** cdelatte has quit IRC | 22:41 | |
| mattoliverau | clayg: yeah, I know. They said auto searching would be slow (searching as you type), but from a usability side they want somethng. Searchlight will be the asnwer to there woes too but that involves the notification middleware :) | 22:43 |
| clayg | mattoliverau: yeah we talked about searchlight at the hack-a-thon - maybe that's why i'm thiking about it. | 22:45 |
| mattoliverau | clayg: yeah, my manager is a horizon core, which is why I hear about it ;) | 22:46 |
| *** dmorita has joined #openstack-swift | 22:48 | |
| *** delatte has joined #openstack-swift | 22:51 | |
| *** delattec has quit IRC | 22:51 | |
| *** dmorita has quit IRC | 22:54 | |
| *** dmorita has joined #openstack-swift | 22:56 | |
| torgomatic | yeah, the contains query scares the snot out of me | 22:58 |
| clayg | torgomatic: but it could be neat! | 22:59 |
| torgomatic | clayg: yeah, if it doesn't blow up the cluster when it's used on a giant container! | 22:59 |
| *** haomaiwang has quit IRC | 23:01 | |
| *** haomaiwang has joined #openstack-swift | 23:01 | |
| mattoliverau | torgomatic: I'll test it some more today... I have some very large containers I've been sharding.. I can try and contains-ing | 23:02 |
| *** garthb has joined #openstack-swift | 23:22 | |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Fix misleading comment https://review.openstack.org/290179 | 23:24 |
| clayg | torgomatic: quite right ^ | 23:27 |
| openstackgerrit | Merged openstack/swift: Merge master into feature/hummingbird https://review.openstack.org/290148 | 23:30 |
| *** chsc has quit IRC | 23:35 | |
| *** kei_yama has joined #openstack-swift | 23:35 | |
| *** km has joined #openstack-swift | 23:38 | |
| *** trifon has quit IRC | 23:39 | |
| openstackgerrit | Merged openstack/swift: Object POST update gets distinct async pending file https://review.openstack.org/289522 | 23:39 |
| zaitcev | already merged? | 23:48 |
| zaitcev | ugh... there goes my chance for greatness | 23:48 |
| *** _JZ_ has quit IRC | 23:50 | |
| *** Jeffrey4l has quit IRC | 23:52 | |
| clayg | torgomatic: ugh, it's frustating that all of the ssync subreq handling is very much wsgi like but it just doesn't use the pipeline that's configured for the obj server | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!