| *** NM has joined #openstack-swift | 00:09 | |
| *** m_kazuhiro has quit IRC | 00:23 | |
| *** NM has quit IRC | 00:23 | |
| *** m_kazuhiro has joined #openstack-swift | 00:24 | |
| *** m_kazuhiro has quit IRC | 00:24 | |
| *** m_kazuhiro has joined #openstack-swift | 00:25 | |
| *** m_kazuhiro has quit IRC | 00:29 | |
| rledisez | m_kazuhiro: I should be able to join | 00:40 |
|---|---|---|
| rledisez | is there any specific topics/questions you want to discuss about general task queue? | 00:41 |
| *** cshastri has joined #openstack-swift | 01:09 | |
| *** m_kazuhiro has joined #openstack-swift | 01:12 | |
| *** m_kazuhiro has quit IRC | 01:17 | |
| *** m_kazuhiro has joined #openstack-swift | 01:17 | |
| *** m_kazuhiro has quit IRC | 01:22 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements https://review.openstack.org/89250 | 02:02 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements https://review.openstack.org/88736 | 02:04 |
| *** tone_zrt has joined #openstack-swift | 02:06 | |
| *** d0ugal has quit IRC | 03:14 | |
| openstackgerrit | Merged openstack/swift feature/s3api: Merge remote-tracking branch 'remotes/origin/master' into merge-master https://review.openstack.org/517838 | 03:15 |
| *** kei_yama has quit IRC | 03:41 | |
| *** m_kazuhiro has joined #openstack-swift | 03:49 | |
| *** kei_yama has joined #openstack-swift | 04:00 | |
| *** OrionX has joined #openstack-swift | 04:28 | |
| *** kei_yama has quit IRC | 04:33 | |
| *** OrionX has quit IRC | 04:33 | |
| *** derekjhyang has joined #openstack-swift | 04:50 | |
| *** m_kazuhiro has quit IRC | 04:53 | |
| *** psachin has joined #openstack-swift | 04:54 | |
| *** m_kazuhiro has joined #openstack-swift | 05:14 | |
| *** kei_yama has joined #openstack-swift | 05:48 | |
| *** armaan has joined #openstack-swift | 06:12 | |
| *** armaan has quit IRC | 06:19 | |
| *** BoJin has joined #openstack-swift | 06:27 | |
| *** armaan has joined #openstack-swift | 06:29 | |
| *** psachin has quit IRC | 06:31 | |
| *** tone_zrt has quit IRC | 06:31 | |
| *** bob_cheesey has quit IRC | 06:31 | |
| *** openstackgerrit has quit IRC | 06:31 | |
| *** tanee has quit IRC | 06:31 | |
| *** shaner has quit IRC | 06:33 | |
| *** shaner has joined #openstack-swift | 06:35 | |
| *** d0ugal has joined #openstack-swift | 06:38 | |
| *** shaner_ has joined #openstack-swift | 06:40 | |
| *** shaner has quit IRC | 06:40 | |
| *** armaan has quit IRC | 06:52 | |
| *** m_kazuhiro has quit IRC | 06:56 | |
| *** BoJin has quit IRC | 07:05 | |
| *** spectr has joined #openstack-swift | 07:09 | |
| *** ChubYann has quit IRC | 07:11 | |
| *** psachin has joined #openstack-swift | 07:12 | |
| *** tone_zrt has joined #openstack-swift | 07:12 | |
| *** bob_cheesey has joined #openstack-swift | 07:12 | |
| *** openstackgerrit has joined #openstack-swift | 07:12 | |
| *** tanee has joined #openstack-swift | 07:12 | |
| *** derekjhyang has quit IRC | 07:15 | |
| *** csmart has quit IRC | 07:22 | |
| *** armaan has joined #openstack-swift | 07:24 | |
| *** geaaru__ has joined #openstack-swift | 07:45 | |
| *** geaaru_ has quit IRC | 07:46 | |
| *** pcaruana has joined #openstack-swift | 07:47 | |
| *** armaan has quit IRC | 08:05 | |
| onovy | hi guys. unit tests of 2.15.1 sometimes fails with this https://buildd.debian.org/status/fetch.php?pkg=swift&arch=all&ver=2.15.1-2&stamp=1509919557&raw=0 any idea? | 08:16 |
| *** tesseract has joined #openstack-swift | 08:17 | |
| *** armaan has joined #openstack-swift | 08:21 | |
| *** OrionX has joined #openstack-swift | 08:29 | |
| *** m_kazuhiro has joined #openstack-swift | 08:33 | |
| *** OrionX has quit IRC | 08:33 | |
| *** sheel has joined #openstack-swift | 08:37 | |
| *** m_kazuhiro has quit IRC | 08:39 | |
| acoles | good morning | 08:46 |
| *** armaan has quit IRC | 08:48 | |
| *** geaaru__ has quit IRC | 09:01 | |
| *** geaaru has joined #openstack-swift | 09:01 | |
| *** oshritf has joined #openstack-swift | 09:10 | |
| *** cbartz has joined #openstack-swift | 09:12 | |
| *** csmart has joined #openstack-swift | 09:16 | |
| acoles | onovy: looks like test harness is sleeping long enough to trigger a timeout, I'm just lookign at it | 09:17 |
| acoles | onovy: did you file a launchpad bug? | 09:17 |
| *** openstackgerrit has quit IRC | 09:18 | |
| *** SkyRocknRoll has joined #openstack-swift | 09:20 | |
| *** armaan has joined #openstack-swift | 09:23 | |
| *** csmart has quit IRC | 09:37 | |
| *** admin6 has joined #openstack-swift | 09:41 | |
| *** csmart has joined #openstack-swift | 09:45 | |
| *** armaan_ has joined #openstack-swift | 09:48 | |
| *** armaan has quit IRC | 09:50 | |
| *** armaan_ has quit IRC | 09:50 | |
| acoles | onovy: I can only reproduce that by adding sleep to the test mock connection. can you file a bug to report what you see in your CI then I can reference that to give reason for a patch | 09:50 |
| *** armaan has joined #openstack-swift | 09:51 | |
| *** armaan has quit IRC | 09:56 | |
| *** cshastri has quit IRC | 10:00 | |
| *** kei_yama has quit IRC | 10:23 | |
| *** oshritf has quit IRC | 10:24 | |
| *** oshritf has joined #openstack-swift | 10:26 | |
| *** OrionX has joined #openstack-swift | 10:29 | |
| *** OrionX has quit IRC | 10:33 | |
| *** oshritf has quit IRC | 10:42 | |
| *** sheel has quit IRC | 10:46 | |
| *** oshritf has joined #openstack-swift | 10:54 | |
| *** armaan has joined #openstack-swift | 11:01 | |
| *** hoonetorg has quit IRC | 11:32 | |
| *** oshritf has quit IRC | 11:35 | |
| *** m_kazuhiro has joined #openstack-swift | 11:37 | |
| *** hoonetorg has joined #openstack-swift | 11:48 | |
| onovy | acoles: thanks i will fill bugreport | 11:49 |
| onovy | acoles: debian/2.15.1-3 | 11:53 |
| onovy | uaa | 11:54 |
| onovy | my ctrl+c/v is broken | 11:54 |
| onovy | bug 1730371 | 11:54 |
| openstack | bug 1730371 in KiCad "Place a 'Grid Origin' will not trigger a change in the pcb" [Undecided,New] https://launchpad.net/bugs/1730371 | 11:54 |
| onovy | bug 1730373 | 11:54 |
| openstack | bug 1730373 in OpenStack Object Storage (swift) "test.unit.proxy.controllers.test_obj.TestECObjController sometimes fails" [Undecided,New] https://launchpad.net/bugs/1730373 | 11:54 |
| onovy | better :) | 11:54 |
| acoles | onovy: thanks | 11:55 |
| *** openstackgerrit has joined #openstack-swift | 12:05 | |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Increase connection timeout for object controller tests https://review.openstack.org/517933 | 12:05 |
| acoles | onovy: ^^ | 12:06 |
| acoles | onovy: depending on how often you see the failure are you able to verify if that helps? | 12:06 |
| acoles | wait, let me removal my sleep :/ | 12:07 |
| acoles | remove* | 12:07 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Increase connection timeout for object controller tests https://review.openstack.org/517933 | 12:09 |
| *** oshritf has joined #openstack-swift | 12:16 | |
| *** oshritf has quit IRC | 12:22 | |
| onovy | acoles: i don't see them too much often :) | 12:23 |
| onovy | but this is correct workaround i think | 12:23 |
| acoles | onovy: that's good! | 12:24 |
| onovy | maybe we should set this connection timeout in other test cases too | 12:24 |
| *** oshritf has joined #openstack-swift | 12:25 | |
| *** abhitechie has joined #openstack-swift | 12:33 | |
| *** abhitechie has quit IRC | 12:35 | |
| *** abhitechie has joined #openstack-swift | 12:35 | |
| *** abhinavtechie has joined #openstack-swift | 12:55 | |
| *** abhitechie has quit IRC | 12:59 | |
| *** catintheroof has joined #openstack-swift | 13:06 | |
| *** pcaruana has quit IRC | 13:08 | |
| *** catintheroof has quit IRC | 13:12 | |
| *** catintheroof has joined #openstack-swift | 13:14 | |
| *** pcaruana has joined #openstack-swift | 13:20 | |
| *** samueldmq has quit IRC | 13:23 | |
| *** AndyWojo has quit IRC | 13:23 | |
| *** hogepodge has quit IRC | 13:23 | |
| *** AndyWojo has joined #openstack-swift | 13:24 | |
| *** hogepodge has joined #openstack-swift | 13:24 | |
| *** samueldmq has joined #openstack-swift | 13:24 | |
| *** NM has joined #openstack-swift | 13:33 | |
| *** armaan has quit IRC | 13:34 | |
| *** armaan has joined #openstack-swift | 13:35 | |
| *** NM has quit IRC | 13:38 | |
| *** NM has joined #openstack-swift | 13:38 | |
| *** NM has quit IRC | 13:39 | |
| *** NM has joined #openstack-swift | 13:40 | |
| *** armaan has quit IRC | 13:54 | |
| *** SkyRocknRoll has quit IRC | 13:57 | |
| *** janonymous has joined #openstack-swift | 13:59 | |
| *** pcaruana has quit IRC | 14:05 | |
| *** cshastri has joined #openstack-swift | 14:08 | |
| *** SkyRocknRoll has joined #openstack-swift | 14:17 | |
| *** pcaruana has joined #openstack-swift | 14:17 | |
| *** admin6_ has joined #openstack-swift | 14:20 | |
| *** admin6 has quit IRC | 14:23 | |
| *** admin6_ is now known as admin6 | 14:23 | |
| *** spectr has quit IRC | 14:29 | |
| *** spectr has joined #openstack-swift | 14:31 | |
| *** m_kazuhiro has quit IRC | 14:32 | |
| *** oshritf has quit IRC | 14:49 | |
| *** mat128 has joined #openstack-swift | 14:57 | |
| *** oshritf has joined #openstack-swift | 14:57 | |
| *** MeltedLux_ is now known as MeltedLux | 15:05 | |
| *** d0ugal has quit IRC | 15:08 | |
| *** cshastri has quit IRC | 15:10 | |
| *** mat128 has quit IRC | 15:14 | |
| *** mat128 has joined #openstack-swift | 15:18 | |
| *** SkyRocknRoll has quit IRC | 15:19 | |
| *** SkyRocknRoll has joined #openstack-swift | 15:21 | |
| *** silor has joined #openstack-swift | 15:25 | |
| *** armaan has joined #openstack-swift | 15:25 | |
| *** d0ugal has joined #openstack-swift | 15:33 | |
| *** d0ugal has quit IRC | 15:34 | |
| *** d0ugal has joined #openstack-swift | 15:34 | |
| timburke | good morning | 15:42 |
| *** psachin has quit IRC | 15:53 | |
| tdasilva | timburke: o/ | 15:58 |
| *** mvk has quit IRC | 16:01 | |
| admin6 | Hi team, I’m running Swift on 4 ACO servers (installed with Ubuntu 16.04.2 LTS) and swift v2.7.1-0ubuntu1. I’ve recently added a fifth server, which is running with the latest updated version of ubuntu : Ubuntu 16.04.3 LTS and swift 2.7.1-0ubuntu2 (I know it’s an old swift version but it’s the official long term support ubuntu version of swift :-/ ) | 16:19 |
| *** catintheroof has quit IRC | 16:19 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 16:19 | |
| admin6 | On this new server, I got lot of errors logs that seems to be linked to EC reconstruction : | 16:19 |
| *** SkyRocknRoll_ has quit IRC | 16:19 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 16:19 | |
| *** oshritf has quit IRC | 16:19 | |
| admin6 | Nov 6 16:30:47 STACO5 object-server: ERROR __call__ error with PUT /s05z5ecd01/196166/AUTH_Xaverz/20170509_O1/74343/137849925/original.jpg : #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/obj/server.py", line 1032, in __call__#012 res = method(req)#012 File "/usr/lib/python2.7/dist-packages/swift/common/utils.py", line 1450, in _timing_stats#012 resp = func(ctrl, *args, | 16:20 |
| admin6 | **kwargs)#012 File "/usr/lib/python2.7/dist-packages/swift/obj/server.py", line 704, in PUT#012 for chunk in iter(timeout_reader, ''):#012 File "/usr/lib/python2.7/dist-packages/swift/obj/server.py", line 399, in timeout_reader#012 return file_like.read(self.network_chunk_size)#012 File "/usr/lib/python2.7/dist-packages/swift/common/utils.py", line 504, in read#012 chunk = next(self.iterator)#012 File | 16:20 |
| admin6 | "/usr/lib/python2.7/dist-packages/swift/obj/ssync_receiver.py", line 467, in subreq_iter#012 min(left, self.app.network_chunk_size))#012 File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 194, in read#012 return self._chunked_read(self.rfile, length)#012 File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 165, in _chunked_read#012 raise IOError("unexpected end of file while parsing | 16:20 |
| admin6 | chunked data")#012IOError: unexpected end of file while parsing chunked data | 16:20 |
| admin6 | The (need to be reconstructed) fragment is actually missing on the related disk. Have you already seen this type of error ? | 16:21 |
| *** OrionX has joined #openstack-swift | 16:23 | |
| timburke | admin6: so that's one side of the connection -- are there errors being logged on the other side? probably something involving swift/obj/ssync_sender.py | 16:24 |
| timburke | it rather sounds like the sender just hung up without sending everything. the receiver won't write anything down unless it's fairly certain that it has a complete, correct fragment | 16:25 |
| admin6 | timburke: yes, I have that sort of logs : Nov 6 12:00:08 STACO4 object-server: 10.10.2.51/s04z4ecd18/102282 EXCEPTION in ssync.Receiver: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/obj/ssync_receiver.py", line 164, in __call__#012 for data in self.missing_check():#012 File "/usr/lib/python2.7/dist-packages/swift/obj/ssync_receiver.py", line 353, in missing_check#012 | 16:26 |
| admin6 | 'Looking for :MISSING_CHECK: START got %r' % line[:1024])#012Exception: Looking for :MISSING_CHECK: START got '' | 16:26 |
| *** geaaru_ has joined #openstack-swift | 16:27 | |
| *** geaaru has quit IRC | 16:29 | |
| timburke | that's still in the receiver... maybe try looking for "object-reconstructor:" in your log files? | 16:31 |
| timburke | (it should be about where we see "object-server:" in the log lines above -- toward the start, just after hostname) | 16:31 |
| admin6 | I got a few error messages concerning ssync_sender like this : | 16:34 |
| admin6 | Nov 6 04:31:57 STACO4 object-reconstructor: 10.10.2.55:7000/s05z5ecd05/154759 EXCEPTION in ssync.Sender: #012Traceback (most recent call last):#012 File "/usr/lib/python2.7/dist-packages/swift/obj/ssync_sender.py", line 126, in __call__#012 self.updates()#012 File "/usr/lib/python2.7/dist-packages/swift/obj/ssync_sender.py", line 346, in updates#012 self.send_put(url_path, df_alt)#012 File | 16:34 |
| admin6 | "/usr/lib/python2.7/dist-packages/swift/obj/ssync_sender.py", line 417, in send_put#012 self.connection.send('%x\r\n%s\r\n' % (len(chunk), chunk))#012 File "/usr/lib/python2.7/httplib.py", line 873, in send#012 self.sock.sendall(data)#012 File "/usr/lib/python2.7/dist-packages/eventlet/greenio/base.py", line 385, in sendall#012 tail = self.send(data, flags)#012 File | 16:34 |
| admin6 | "/usr/lib/python2.7/dist-packages/eventlet/greenio/base.py", line 379, in send#012 return self._send_loop(self.fd.send, data, flags)#012 File "/usr/lib/python2.7/dist-packages/eventlet/greenio/base.py", line 366, in _send_loop#012 return send_method(data, *args)#012error: [Errno 32] Broken pipe | 16:34 |
| timburke | huh. seems like network troubles? or something? it kinda reads like both sides think the other side hung up :-/ | 16:36 |
| *** saint_ has joined #openstack-swift | 16:37 | |
| admin6 | Hmmm, I’ll check my network… maybe something related to jumbo frames? | 16:38 |
| *** armaan has quit IRC | 16:41 | |
| *** armaan has joined #openstack-swift | 16:42 | |
| *** itlinux has joined #openstack-swift | 16:42 | |
| *** gyee has joined #openstack-swift | 16:45 | |
| *** janonymous has quit IRC | 16:49 | |
| *** SkyRocknRoll_ has quit IRC | 16:49 | |
| *** newmember has quit IRC | 16:58 | |
| *** newmember has joined #openstack-swift | 16:58 | |
| *** pcaruana has quit IRC | 17:01 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 17:09 | |
| *** tesseract has quit IRC | 17:10 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift master: Increase connection timeout for object controller tests https://review.openstack.org/517933 | 17:11 |
| *** catintheroof has joined #openstack-swift | 17:12 | |
| *** saint_ has quit IRC | 17:14 | |
| *** cbartz has quit IRC | 17:15 | |
| *** catintheroof has quit IRC | 17:17 | |
| *** catintheroof has joined #openstack-swift | 17:37 | |
| *** catintheroof has quit IRC | 17:41 | |
| *** mat128 has quit IRC | 17:54 | |
| *** catintheroof has joined #openstack-swift | 17:56 | |
| *** abhinavtechie has quit IRC | 18:02 | |
| *** SkyRocknRoll_ has quit IRC | 18:16 | |
| *** armaan has quit IRC | 18:19 | |
| *** armaan has joined #openstack-swift | 18:19 | |
| *** itlinux has quit IRC | 18:24 | |
| *** armaan has quit IRC | 18:24 | |
| *** armaan has joined #openstack-swift | 18:25 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 18:27 | |
| *** SkyRocknRoll has quit IRC | 18:38 | |
| *** SkyRocknRoll_ has quit IRC | 18:38 | |
| *** itlinux has joined #openstack-swift | 18:50 | |
| *** klrmn has joined #openstack-swift | 18:53 | |
| openstackgerrit | Merged openstack/swift master: Add checksum to object extended attributes https://review.openstack.org/336323 | 19:06 |
| openstackgerrit | Merged openstack/swift master: Increase connection timeout for object controller tests https://review.openstack.org/517933 | 19:06 |
| timburke | whooo! | 19:08 |
| *** ChubYann has joined #openstack-swift | 19:46 | |
| *** d0ugal has quit IRC | 19:52 | |
| *** pcaruana has joined #openstack-swift | 19:57 | |
| *** geaaru__ has joined #openstack-swift | 19:58 | |
| *** geaaru_ has quit IRC | 20:00 | |
| *** pcaruana has quit IRC | 20:03 | |
| openstackgerrit | Tim Burke proposed openstack/swift master: Add support for data segments to SLO and SegmentedIterable https://review.openstack.org/365371 | 20:10 |
| *** silor has quit IRC | 20:15 | |
| *** csmart has quit IRC | 20:15 | |
| *** d0ugal has joined #openstack-swift | 20:16 | |
| *** NM has quit IRC | 20:37 | |
| *** itlinux has quit IRC | 20:39 | |
| *** SkyRocknRoll has joined #openstack-swift | 20:43 | |
| kota_ | good morning openstack summit day2 | 20:46 |
| acoles | kota_: o/ | 20:55 |
| kota_ | acoles: morning o/ | 20:55 |
| acoles | good night ;) | 20:55 |
| kota_ | acoles: have a good sleep ;) | 20:57 |
| *** ukaynar has joined #openstack-swift | 21:33 | |
| *** ukaynar has quit IRC | 21:33 | |
| *** ukaynar has joined #openstack-swift | 21:34 | |
| mattoliverau | Morning | 21:45 |
| *** hseipp has joined #openstack-swift | 21:50 | |
| *** catintheroof has quit IRC | 21:51 | |
| *** mvk has joined #openstack-swift | 21:53 | |
| *** csmart has joined #openstack-swift | 22:00 | |
| *** hseipp has quit IRC | 22:11 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 22:19 | |
| *** SkyRocknRoll has quit IRC | 22:21 | |
| *** shaner_ has quit IRC | 22:36 | |
| *** shaner has joined #openstack-swift | 22:40 | |
| *** SkyRocknRoll_ has quit IRC | 22:43 | |
| *** m_kazuhiro has joined #openstack-swift | 22:45 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 22:46 | |
| m_kazuhiro | good morning | 22:49 |
| *** geaaru__ has quit IRC | 22:51 | |
| m_kazuhiro | Sydney Summit attendees (notmyname, mattoliverau, kota_, cschwede, rledisez): I made etherpad page for today's general task queue discussion. If you have time, please read it. https://etherpad.openstack.org/p/swift_general_task_queue | 22:51 |
| kota_ | m_kazuhiro: ack | 22:53 |
| m_kazuhiro | The discussion will start from 13:00 at hack room https://www.openstack.org/summit/sydney-2017/summit-schedule/events/20608/hack-room (Sydney Convention and Exhibition Centre - Level 4 - C4.8) | 22:54 |
| m_kazuhiro | cschwede: Will you come to the discussion? I want to get your opinion about general task queue. | 22:59 |
| *** csmart has quit IRC | 23:00 | |
| *** csmart has joined #openstack-swift | 23:14 | |
| *** SkyRocknRoll__ has joined #openstack-swift | 23:16 | |
| *** SkyRocknRoll_ has quit IRC | 23:17 | |
| *** kei_yama has joined #openstack-swift | 23:23 | |
| *** OrionX has quit IRC | 23:26 | |
| *** OrionX has joined #openstack-swift | 23:28 | |
| clayg | i can't figure out the correct status for lp bug #1730511 | 23:29 |
| openstack | Launchpad bug 1730511 in OpenStack Object Storage (swift) "SWIFT API: Cannot pull container information across all accounts in one call" [Wishlist,New] https://launchpad.net/bugs/1730511 | 23:29 |
| clayg | afaict next step would be an ideas write up | 23:29 |
| clayg | ... we've at somepoint realized that a given what we know about our largest swift deployments one *could* have a single sqlite database with "all" the account names listed in it... and we could probably get away with a process like the the container-updater (account-updater?) to keep it up-to-date? | 23:30 |
| clayg | ... but you know ... we could also just keep doing our thing with slogging clones or using the auth system for account enumeration or whatever we've already solved this need with... | 23:31 |
| clayg | but ... new people keep having to solve it ... oh well! | 23:31 |
| *** OrionX has quit IRC | 23:33 | |
| *** csmart has quit IRC | 23:35 | |
| *** csmart has joined #openstack-swift | 23:56 | |
| notmyname | hello world | 23:59 |
| timburke | notmyname: o/ | 23:59 |
| timburke | priority reviews are looking pretty good | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!