| *** early has quit IRC | 00:00 | |
| *** early has joined #openstack-swift | 00:03 | |
| *** PavelK has quit IRC | 00:21 | |
| *** jamielennox is now known as jamielennox|away | 00:27 | |
| *** jamielennox|away is now known as jamielennox | 00:41 | |
| *** Sukhdev has joined #openstack-swift | 00:43 | |
| clayg | PavelK: sorry didn't get to patch 448480 today - i'll add it to my todo list | 00:45 |
|---|---|---|
| patchbot | https://review.openstack.org/#/c/448480/ - swift - DB replicator cleanup | 00:45 |
| *** NM has quit IRC | 00:46 | |
| notmyname | clayg: thanks for responding to Bruno's email :-) | 00:55 |
| *** klrmn has quit IRC | 01:05 | |
| *** Sukhdev has quit IRC | 01:06 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Increase name-length limits for internal accounts https://review.openstack.org/465776 | 01:27 |
| timburke | mattoliverau: ^^ | 01:28 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Add read and write affinity options to deployment guide https://review.openstack.org/462619 | 01:28 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Enable per policy proxy config options https://review.openstack.org/448240 | 01:28 |
| timburke | object name length limit was a little more interesting to try to increase -- besides, seemed out of scope for what i wanted to do right now | 01:29 |
| *** vint_bra has quit IRC | 01:42 | |
| *** lan has joined #openstack-swift | 01:44 | |
| *** alenavolk has joined #openstack-swift | 01:47 | |
| mattoliverau | timburke: nice, I'll take a look | 01:50 |
| *** psachin has joined #openstack-swift | 01:51 | |
| *** jeff1 has joined #openstack-swift | 01:58 | |
| *** jeff1 has quit IRC | 01:58 | |
| *** NM has joined #openstack-swift | 01:58 | |
| *** alenavolk has quit IRC | 02:05 | |
| *** NM has quit IRC | 02:07 | |
| *** jeffli has joined #openstack-swift | 02:10 | |
| *** klrmn has joined #openstack-swift | 02:24 | |
| *** jamielennox is now known as jamielennox|away | 02:40 | |
| *** winggundamth has joined #openstack-swift | 02:45 | |
| *** alenavolk has joined #openstack-swift | 03:05 | |
| *** links has joined #openstack-swift | 03:14 | |
| *** alenavolk has quit IRC | 03:15 | |
| *** jamielennox|away is now known as jamielennox | 03:33 | |
| *** chsc has joined #openstack-swift | 03:36 | |
| *** chsc has joined #openstack-swift | 03:36 | |
| *** chsc has quit IRC | 03:44 | |
| mahatic | good morning | 04:07 |
| *** Sukhdev has joined #openstack-swift | 04:13 | |
| *** links has quit IRC | 04:20 | |
| *** chsc has joined #openstack-swift | 04:22 | |
| *** lan1 has joined #openstack-swift | 04:44 | |
| *** lan has quit IRC | 04:47 | |
| *** bkopilov has joined #openstack-swift | 04:51 | |
| *** links has joined #openstack-swift | 04:58 | |
| *** jaosorior_away is now known as jaosorior | 05:00 | |
| *** chsc has quit IRC | 05:05 | |
| *** ChubYann has quit IRC | 05:11 | |
| *** skudlik has joined #openstack-swift | 05:20 | |
| *** Sukhdev has quit IRC | 05:28 | |
| *** psachin has quit IRC | 05:35 | |
| clayg | Morning! | 05:39 |
| skudlik | gm! :) | 05:42 |
| skudlik | btw. for folks I've met in Boston .. I'm Jan :) | 05:42 |
| *** cshastri has joined #openstack-swift | 05:44 | |
| *** jeffli has quit IRC | 05:44 | |
| *** rcernin has joined #openstack-swift | 05:46 | |
| *** jeffli has joined #openstack-swift | 05:46 | |
| *** gyee_ has quit IRC | 05:52 | |
| *** chsc has joined #openstack-swift | 06:02 | |
| *** chsc has joined #openstack-swift | 06:02 | |
| mattoliverau | skudlik: o/ | 06:03 |
| *** ankkumar has joined #openstack-swift | 06:07 | |
| *** links has quit IRC | 06:08 | |
| *** chsc has quit IRC | 06:20 | |
| *** oshritf has joined #openstack-swift | 06:23 | |
| *** links has joined #openstack-swift | 06:23 | |
| *** pcaruana has joined #openstack-swift | 06:24 | |
| *** oshritf has quit IRC | 06:32 | |
| *** _JZ_ has quit IRC | 06:55 | |
| *** _JZ_ has joined #openstack-swift | 06:56 | |
| *** jeffli has quit IRC | 06:57 | |
| *** _JZ_ has quit IRC | 07:00 | |
| *** klrmn has quit IRC | 07:12 | |
| *** links has quit IRC | 07:16 | |
| *** links has joined #openstack-swift | 07:29 | |
| *** oshritf has joined #openstack-swift | 07:37 | |
| *** tovin07_ has joined #openstack-swift | 07:46 | |
| *** cbartz has joined #openstack-swift | 07:59 | |
| cbartz | cschwede_: Could you pls take a look at patch 423377 ? Thx | 08:10 |
| patchbot | https://review.openstack.org/#/c/423377/ - python-swiftclient - ISO 8601 timestamps for tempurl | 08:10 |
| cschwede_ | cbartz: sure, will do | 08:13 |
| cbartz | cschwede_: Thx . ;-) | 08:13 |
| *** geaaru has joined #openstack-swift | 08:21 | |
| *** skudlik has quit IRC | 08:23 | |
| *** zhurong has joined #openstack-swift | 08:41 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift master: Small minor fixes for composite ring functionality https://review.openstack.org/465878 | 08:50 |
| *** jaosorior is now known as jaosorior_lunch | 08:57 | |
| kota_ | I added my +2 +A to patch 441921 | 08:57 |
| patchbot | https://review.openstack.org/#/c/441921/ - swift - Add Composite Ring Functionality | 08:57 |
| kota_ | done | 08:57 |
| kota_ | much appreciated acoles, clayg, and all swift contributors | 08:57 |
| * kota_ is hoping that it lands successfully | 08:58 | |
| *** zhurong has quit IRC | 09:05 | |
| *** ljjjustin has joined #openstack-swift | 09:12 | |
| *** skudlik has joined #openstack-swift | 09:14 | |
| *** tovin07_ has quit IRC | 09:53 | |
| *** ljjjustin has quit IRC | 10:00 | |
| *** jamielennox is now known as jamielennox|away | 10:04 | |
| *** kei_yama has quit IRC | 10:15 | |
| openstackgerrit | Merged openstack/swift master: Add Composite Ring Functionality https://review.openstack.org/441921 | 10:18 |
| kota_ | Yey! | 10:32 |
| *** openstackgerrit has quit IRC | 10:48 | |
| *** alenavolk has joined #openstack-swift | 10:49 | |
| *** NM has joined #openstack-swift | 11:00 | |
| ankkumar | Hey, Is anyone working on python3.5 support for swift? | 11:08 |
| *** vint_bra has joined #openstack-swift | 11:08 | |
| ankkumar | I have raised a bug https://bugs.launchpad.net/swift/+bug/1691090. I faced this issue when i was working on python3.5 enablement for ironic. | 11:09 |
| openstack | Launchpad bug 1691075 in OpenStack Object Storage (swift) "duplicate for #1691090 swift-object-server fails to start in python 3.5 environment with devstack" [Undecided,New] | 11:09 |
| ankkumar | Hi, Ignore that link. This is actual link https://bugs.launchpad.net/swift/+bug/1691075 | 11:11 |
| openstack | Launchpad bug 1691075 in OpenStack Object Storage (swift) "swift-object-server fails to start in python 3.5 environment with devstack" [Undecided,New] | 11:11 |
| *** jaosorior_lunch is now known as jaosorior | 11:29 | |
| *** geaaru has quit IRC | 11:29 | |
| *** geaaru has joined #openstack-swift | 11:41 | |
| *** silor has joined #openstack-swift | 11:44 | |
| *** chlong has joined #openstack-swift | 11:48 | |
| *** alenavolk has quit IRC | 11:48 | |
| *** silor has quit IRC | 11:53 | |
| *** silor has joined #openstack-swift | 11:53 | |
| *** MVenesio has joined #openstack-swift | 12:01 | |
| *** catintheroof has joined #openstack-swift | 12:09 | |
| *** ankkumar has quit IRC | 12:25 | |
| *** vint_bra has quit IRC | 12:32 | |
| *** vint_bra has joined #openstack-swift | 12:44 | |
| *** links has quit IRC | 12:45 | |
| *** catintheroof has quit IRC | 12:50 | |
| *** openstackgerrit has joined #openstack-swift | 12:56 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 12:56 |
| *** lan1 has quit IRC | 13:16 | |
| *** klamath has joined #openstack-swift | 13:17 | |
| *** klamath has quit IRC | 13:17 | |
| *** klamath has joined #openstack-swift | 13:18 | |
| *** vint_bra has quit IRC | 13:23 | |
| *** vint_bra has joined #openstack-swift | 13:24 | |
| *** jamielennox|away is now known as jamielennox | 13:49 | |
| *** _JZ_ has joined #openstack-swift | 13:56 | |
| *** psachin has joined #openstack-swift | 13:56 | |
| *** chlong has quit IRC | 14:04 | |
| *** gyee has joined #openstack-swift | 14:23 | |
| *** klrmn has joined #openstack-swift | 14:25 | |
| openstackgerrit | Merged openstack/python-swiftclient master: ISO 8601 timestamps for tempurl https://review.openstack.org/423377 | 14:37 |
| *** two_tired has joined #openstack-swift | 14:50 | |
| two_tired | Does swift do anything similar to copy on write after a COPY operation, or does COPY always require data duplication? | 14:51 |
| notmyname | kota_: yay composite rings! | 14:57 |
| notmyname | skudlik: oh hi! | 14:57 |
| *** jaosorior is now known as jaosorior_away | 15:00 | |
| *** psachin has quit IRC | 15:01 | |
| tdasilva | two_tired: data duplication | 15:01 |
| mwheckmann | good morning all. I come to you with a strange problem this morning. I have a container in a globally replicated ring which is showing odd behaviour: An object is deleted. The container listing shows no object and it's been effectively deleted on all primary partitions in the sense that all that is left is tombstone files. However it remains on a single handoff partition and therefore is still | 15:04 |
| mwheckmann | retrievable with a GET. | 15:04 |
| mwheckmann | I understand the eventually consistent nature of Swift, but it's been > 24h | 15:04 |
| notmyname | mwheckmann: that sounds... well, not "normal" because it's based on failures in the cluster, but expected | 15:05 |
| notmyname | mwheckmann: check your replication cycle time on that handoff node | 15:05 |
| notmyname | or on the primary nodes | 15:05 |
| mwheckmann | what do you mean by replication cycle time? replicator interval? | 15:06 |
| mwheckmann | We've had to restart stuck replicators before.. but this feels a little different. | 15:07 |
| kota_ | notmyname: thx! | 15:07 |
| notmyname | mwheckmann: look for "Object replication complete" in the logs. it will have some timing info there. also, you can query it with swift-recon IIRC | 15:08 |
| mwheckmann | notmyname: got the stats w/ swift-recon, what metrics should I look at exactly? | 15:10 |
| notmyname | mwheckmann: --replication | 15:15 |
| notmyname | mwheckmann: basically, what you're looking for is that a replication cycle has finished since the delete | 15:15 |
| mwheckmann | So the "Most recent completion" stat? | 15:16 |
| notmyname | also, that your replication cycle is reasonable (although "reasonable" doesn't have a hard adn fast definition) | 15:16 |
| mwheckmann | notmyname: last completion was 55 minutes ago and oldest was 58 minutes ago | 15:16 |
| notmyname | ok | 15:17 |
| mwheckmann | So the replication cycle is on the order of what magnitude? | 15:17 |
| mwheckmann | hours or minutes? I suppose it has nothing to do with the "interval" setting in config right? | 15:18 |
| two_tired | tdasilva: Thanks. I had assumed this must have been optimized, but I guess not. | 15:19 |
| notmyname | two_tired: in the general case with a copy, the destination is on completely different servers/drives in the cluster, so a copy-on-write isn't possible | 15:19 |
| mwheckmann | notmyname: digging into the logs, I'm seeing my avg cycle time as ~240 minutes. | 15:19 |
| notmyname | two_tired: or alternatively, there *isn't* an indirection mapping between the logical object name and it's on-disk location in the cluster. the object name is directly used for placement | 15:20 |
| notmyname | mwheckmann: yeah, that sounds "reasonable" (barring any other info) | 15:21 |
| mwheckmann | BTW, what's the definition of the replication cycle time? I mean what defines the start and end? | 15:22 |
| notmyname | `start = time.time(); do_work(); duration = time.time() - start` | 15:23 |
| notmyname | nothing fancy | 15:23 |
| mwheckmann | ok, I guess what I mean is what defines the work it needs to do? | 15:23 |
| notmyname | oh | 15:24 |
| mwheckmann | I expect that it has a list of partitions that it needs to replicate, but where does that come from? | 15:24 |
| notmyname | https://docs.openstack.org/developer/swift/overview_replication.html | 15:25 |
| mwheckmann | was already on that page :) I'll give it a read later on | 15:26 |
| *** two_tired has quit IRC | 15:27 | |
| mwheckmann | Any idea why that handoff partition wouldn't get cleaned up though? We're running 2.5.0. There was a bug related to the handoff cleanup, but we patched for that a long time ago | 15:28 |
| notmyname | mwheckmann: hard to say without more info. you could run the replicator on the handoff node in once+verbose mode to see exactly what it's doing. or explicitly give it the partitions to replicate | 15:31 |
| notmyname | mwheckmann: and, as always, let me take the opportunity to encourage you to upgrade. we've made a lot of improvements to replication since 2.5.0 | 15:31 |
| notmyname | :-) | 15:32 |
| *** chsc has joined #openstack-swift | 15:32 | |
| *** chsc has joined #openstack-swift | 15:32 | |
| mwheckmann | I know :) problem is dependencies on the proxy nodes. We really should split them off. | 15:32 |
| mwheckmann | notmyname: bug that we patched for was bug # 1503152 | 15:32 |
| notmyname | bug #1503152 | 15:33 |
| openstack | bug 1503152 in OpenStack Object Storage (swift) "Error syncing handoff partition : no attribute 'intersection" [Undecided,Fix committed] https://launchpad.net/bugs/1503152 - Assigned to Charles Hsu (charles0126) | 15:33 |
| mwheckmann | I'm double checking to make sure that patch made it to this node. | 15:33 |
| *** alenavolk has joined #openstack-swift | 15:37 | |
| notmyname | mwheckmann: I just finished up a morning meeting, and now I need to do the commute. so I'll be offline for a bit. perhaps someone else can jump in as they get online today :-) | 15:39 |
| mwheckmann | notmyname: Thanks for the heads up. I'm going to continue digging and try to figure out if this is reproduceable on other objects/containers. User says it is. | 15:40 |
| mwheckmann | I'll let you all know what I find. | 15:40 |
| *** chlong has joined #openstack-swift | 15:42 | |
| *** cshastri has quit IRC | 15:46 | |
| *** rcernin has quit IRC | 15:47 | |
| *** skudlik has quit IRC | 15:54 | |
| *** oshritf has quit IRC | 15:54 | |
| *** geaaru has quit IRC | 15:58 | |
| *** _JZ_ has quit IRC | 16:02 | |
| *** _JZ_ has joined #openstack-swift | 16:07 | |
| *** catintheroof has joined #openstack-swift | 16:19 | |
| *** winggundamth has quit IRC | 16:21 | |
| *** chsc has quit IRC | 16:23 | |
| *** cbartz has quit IRC | 16:26 | |
| *** pcaruana has quit IRC | 16:40 | |
| acoles | kota_: great work on composite rings - thanks! | 16:42 |
| acoles | kota_: thanks for the follow up too | 16:50 |
| timburke | good morning | 16:51 |
| openstackgerrit | Tim Burke proposed openstack/swift master: Increase name-length limits for internal accounts https://review.openstack.org/465776 | 17:03 |
| *** psachin has joined #openstack-swift | 17:06 | |
| *** alenavolk has quit IRC | 17:13 | |
| *** alenavolk has joined #openstack-swift | 17:14 | |
| *** alenavolk has quit IRC | 17:14 | |
| *** skudlik has joined #openstack-swift | 17:15 | |
| *** alenavolk has joined #openstack-swift | 17:15 | |
| *** alenavolk has quit IRC | 17:15 | |
| *** alenavolk has joined #openstack-swift | 17:16 | |
| notmyname | http://lists.openstack.org/pipermail/openstack-dev/2017-May/116971.html and http://lists.openstack.org/pipermail/openstack-dev/2017-May/116974.html are two ML messages from ttx about PTG scheduling. some new ideas on how to schedule and communicate the schedule for the week | 17:18 |
| notmyname | IMO the ptgbot seems like a reasonable idea | 17:19 |
| mwheckmann | Not necessarily related to the problem I reported earlier, but can anyone recommend a good value of "rsync_timeout" for a globally replicated cluster? I'm seeing a lot from "killing long running rsync.." of procs doing sync between NCSA and APAC. | 17:23 |
| mwheckmann | I was thinking of doubling it to 30 minutes | 17:23 |
| jrichli | notmyname: I like the sound of the ptgbot! and Mon-Fri on swift team stuff is great | 17:35 |
| notmyname | I don't think we'd get all of mon-fri (+ I'm not sure that's even the best plan), but yeah...the 2 days "general/ad-hoc" followed by three days of project-specific stuff sounds good | 17:36 |
| *** chsc has joined #openstack-swift | 17:37 | |
| *** chsc has joined #openstack-swift | 17:37 | |
| *** skudlik has quit IRC | 17:37 | |
| *** gyee_ has joined #openstack-swift | 17:41 | |
| mwheckmann | I also think I'm being seriously bitten by bug #1553995 | 17:41 |
| openstack | bug 1553995 in OpenStack Object Storage (swift) "rsync incomplete object cross disks for a partition " [Undecided,Fix released] https://launchpad.net/bugs/1553995 | 17:41 |
| *** gyee has quit IRC | 17:43 | |
| *** gyee_ has quit IRC | 17:43 | |
| *** gyee has joined #openstack-swift | 17:43 | |
| jrichli | acoles: good idea in https://bugs.launchpad.net/bugs/1691807 | 17:44 |
| openstack | Launchpad bug 1691807 in OpenStack Object Storage (swift) "object decryption should be able to validate that correct key is being used" [Wishlist,New] | 17:44 |
| notmyname | anyone know how to do a try/except thing in ansible? | 17:47 |
| notmyname | oh andymccr will know! ;-) | 17:47 |
| notmyname | I've got a "command" in ansible that might fail (likely actually). I'd like to simply ignore or log the error and move on | 17:48 |
| mwheckmann | ignore_errors: true ? | 17:49 |
| mwheckmann | notmyname: see above | 17:49 |
| notmyname | looking. /me is new to ansible, so has to google everything | 17:49 |
| notmyname | oh http://docs.ansible.com/ansible/playbooks_error_handling.html looks very helpful | 17:50 |
| notmyname | mwheckmann: thanks :-) | 17:50 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Add read and write affinity options to deployment guide https://review.openstack.org/462619 | 17:52 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Enable per policy proxy config options https://review.openstack.org/448240 | 17:52 |
| notmyname | mwheckmann: it worked! thanks :-) | 18:03 |
| notmyname | 'failed_when: install_cmd.rc != 2' | 18:03 |
| *** skudlik has joined #openstack-swift | 18:15 | |
| *** alenavolk has joined #openstack-swift | 18:16 | |
| *** MVenesio has quit IRC | 18:27 | |
| *** Sukhdev has joined #openstack-swift | 18:30 | |
| *** gyee has quit IRC | 18:38 | |
| *** tonanhngo has joined #openstack-swift | 18:40 | |
| *** ChubYann has joined #openstack-swift | 18:51 | |
| briancline | grep -i killing replicator.log | 19:17 |
| briancline | ack | 19:17 |
| *** MVenesio has joined #openstack-swift | 19:19 | |
| *** MVenesio has quit IRC | 19:19 | |
| *** MVenesio has joined #openstack-swift | 19:22 | |
| *** MVenesio has quit IRC | 19:30 | |
| *** alenavolk has quit IRC | 19:34 | |
| *** Sukhdev has quit IRC | 19:35 | |
| *** alenavolk has joined #openstack-swift | 19:43 | |
| *** itlinux has joined #openstack-swift | 19:51 | |
| *** silor has quit IRC | 20:03 | |
| *** itlinux has quit IRC | 20:12 | |
| timur | jrichli: I was looking over the DLO code and didn't see support for multipart-manifest=delete. This is in reference to https://bugs.launchpad.net/swift/+bug/1682116 | 20:34 |
| openstack | Launchpad bug 1682116 in OpenStack Object Storage (swift) "DLO Delete of object" [Undecided,New] | 20:34 |
| jrichli | timur: :-( so, does a normal DLO delete remove segments too? if not, is there a way to do that? | 20:36 |
| timur | I was talking with timburke about adding it though! | 20:36 |
| timur | jrichli: as far as I can tell, the consumer has to do a LIST and DELETE themselves. I didn't see anything that supports the operation for them | 20:36 |
| timur | normal DELETE will remove the manifest object itself | 20:36 |
| jrichli | interesting | 20:36 |
| timburke | one of the downsides to us always pushing complexity to the client... clients tend to need to make a lot of requests :-( | 20:37 |
| timur | Sam is of the opinion that we shouldn't make DLO interfaces better so that people will stop using them :p | 20:37 |
| jrichli | thanks for letting me know! If you add a patch for some delete segment functionality on DLO, I'll review it :-) | 20:37 |
| timur | 👍 | 20:38 |
| jrichli | timur, torgomatic: I understand that. I do also get pinged from time to time by some people in IBM using DLO and I think they may have been involved in writing those bugs. | 20:39 |
| *** itlinux has joined #openstack-swift | 20:39 | |
| timur | womp, womp. I think we should make the support for it to be closer to SLO, if only because so many applications and libraries use DLO by default (cough, cough, python-swiftclient) | 20:40 |
| timburke | :-/ silly py3, changing rounding methods http://paste.openstack.org/show/609965/ | 20:41 |
| *** oshritf has joined #openstack-swift | 20:43 | |
| *** jidar has quit IRC | 20:48 | |
| notmyname | timburke: add it to the gist? | 20:50 |
| *** jidar has joined #openstack-swift | 20:50 | |
| *** Sukhdev has joined #openstack-swift | 20:50 | |
| timburke | notmyname: already done | 20:51 |
| *** tonanhngo has quit IRC | 20:56 | |
| *** jidar has quit IRC | 20:57 | |
| *** jidar has joined #openstack-swift | 20:59 | |
| *** tonanhngo has joined #openstack-swift | 20:59 | |
| mattoliverau | notmyname: re ansible. 'ignore_errors: yes' or look into blocks. | 21:13 |
| notmyname | mattoliverau: yeah, I got it (the failed_when directive). thanks :) | 21:13 |
| mattoliverau | Cool | 21:14 |
| *** alenavolk has quit IRC | 21:22 | |
| *** alenavolk has joined #openstack-swift | 21:35 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements https://review.openstack.org/89250 | 21:39 |
| *** alenavolk has quit IRC | 21:43 | |
| *** catintheroof has quit IRC | 21:47 | |
| *** NM has quit IRC | 22:01 | |
| *** itlinux has quit IRC | 22:03 | |
| *** itlinux has joined #openstack-swift | 22:04 | |
| *** Jeffrey4l_ has quit IRC | 22:08 | |
| *** vint_bra has quit IRC | 22:13 | |
| *** Jeffrey4l has joined #openstack-swift | 22:13 | |
| *** Sukhdev has quit IRC | 22:20 | |
| *** gyee has joined #openstack-swift | 22:22 | |
| *** skudlik has quit IRC | 22:27 | |
| *** Sukhdev has joined #openstack-swift | 22:36 | |
| *** itlinux has quit IRC | 22:44 | |
| *** chlong has quit IRC | 22:45 | |
| *** oshritf has quit IRC | 23:02 | |
| *** klamath has quit IRC | 23:13 | |
| *** kei_yama has joined #openstack-swift | 23:30 | |
| *** chsc has quit IRC | 23:35 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!