| *** psachin has joined #openstack-swift | 01:40 | |
| kota_ | morning day after the Christmas | 01:47 |
|---|---|---|
| *** cshastri_ has joined #openstack-swift | 01:49 | |
| kota_ | hugokuo: is that really from proxy-server? the possibility is from internal client via proxy app. object-expirer is able to cause 412 response via x-if-delete-at header. | 01:49 |
| kota_ | 412 response from object-server. | 01:49 |
| kota_ | IIRC, it may happen when two different x-delete-at timestamp requests called. | 01:51 |
| kota_ | though, I don't think it's EC specific but replication as well. | 01:52 |
| *** ^andrea^ has quit IRC | 03:29 | |
| *** ^andrea^ has joined #openstack-swift | 03:42 | |
| *** links has joined #openstack-swift | 03:52 | |
| *** SkyRocknRoll has joined #openstack-swift | 04:17 | |
| *** ^andrea^ has quit IRC | 04:35 | |
| *** ^andrea^ has joined #openstack-swift | 04:36 | |
| *** ^andrea^ has quit IRC | 04:43 | |
| hugokuo | kota_: `swift: - - 24/Dec/2017/05/59/33 DELETE /v1/AUTH_abc/abc-retrieval-mnl2/411532108/XX/XXxxx.xx HTTP/1.0 499 - Swift%20Object%20Expirer - - 43 - txbdcbd052190f49ed94af9-005a3f4240 - 5.0295 - - 1514095168.785039902 1514095173.814532995 0 (txn: txe288cf7703614f0a9737c-005a3f4245) ` | 07:00 |
| hugokuo | Something like this. So,it's issued by object-expirer | 07:00 |
| kota_ | hugokuo: hi, hmm... it's 499 though. | 07:01 |
| hugokuo | hold on | 07:01 |
| hugokuo | kota_: https://pastebin.com/GTZuFUEY | 07:08 |
| hugokuo | It's a multiple log lines transaction for deleting an exipred object by object-expirer | 07:08 |
| hugokuo | some fragments are 404 and several 412. The object-expirer seems got 499 in the nd. | 07:09 |
| kota_ | hugokuo: curious, let me look at later, sorry, just another meeting has started since 5 min ago. | 07:09 |
| hugokuo | I'm confused about the workflow while deleting an EC object. | 07:10 |
| hugokuo | kota_: no rush. thx man and merry christmas | 07:10 |
| kota_ | hugokuo: you too | 07:10 |
| *** neonpastor has quit IRC | 08:00 | |
| *** neonpastor has joined #openstack-swift | 08:02 | |
| *** gkadam_ has joined #openstack-swift | 08:11 | |
| *** kei_yama has quit IRC | 08:17 | |
| openstackgerrit | yanwei proposed openstack/swift master: fix the swift-ring-builder's default command raises exception in command line environment https://review.openstack.org/529791 | 08:21 |
| *** kei_yama has joined #openstack-swift | 08:24 | |
| *** bkopilov has joined #openstack-swift | 09:12 | |
| hugokuo | how `X-If-Delete-At` been added to an object? | 09:23 |
| *** zhongjun has quit IRC | 09:31 | |
| *** zhongjun has joined #openstack-swift | 09:32 | |
| *** gkadam_ has quit IRC | 09:33 | |
| kota_ | hugokuo: https://gist.github.com/bloodeagle40234/055732e0495633b61f00a791a182b9ee may mitigate your frastration | 09:50 |
| kota_ | hugokuo: i think it's a solution for https://bugs.launchpad.net/swift/+bug/1675650 as well. | 09:50 |
| openstack | Launchpad bug 1675650 in OpenStack Object Storage (swift) "HTTP 499 status code from expirer" [Undecided,New] | 09:50 |
| kota_ | hugokuo: I didn't reach whole thing on 412 from object-server but part of your issue could be at the patch above. | 09:51 |
| kota_ | imo 412 can happen if many requests for updating same object with x-delete-at is incoming so... need to know what's exactly problem for us... | 09:52 |
| kota_ | anyway, it's good time to go dinner. let me take a time more with your log message. | 09:54 |
| kota_ | maybe i could have time to circle back again tommorow. | 09:54 |
| *** SkyRocknRoll has quit IRC | 09:56 | |
| *** kei_yama has quit IRC | 10:08 | |
| *** cshastri_ has quit IRC | 10:09 | |
| *** pcaruana has joined #openstack-swift | 10:15 | |
| *** saltsa has quit IRC | 10:39 | |
| *** SkyRocknRoll has joined #openstack-swift | 10:54 | |
| *** silor has joined #openstack-swift | 11:21 | |
| *** bkopilov has quit IRC | 11:27 | |
| *** links has quit IRC | 12:45 | |
| *** bkopilov has joined #openstack-swift | 12:46 | |
| *** SkyRocknRoll_ has joined #openstack-swift | 12:56 | |
| *** silor has quit IRC | 14:51 | |
| *** silor has joined #openstack-swift | 14:54 | |
| *** silor has quit IRC | 15:27 | |
| *** silor has joined #openstack-swift | 15:31 | |
| *** pcaruana has quit IRC | 15:36 | |
| *** psachin has quit IRC | 15:44 | |
| *** pcaruana has joined #openstack-swift | 16:03 | |
| hugokuo | sounds good. I'm still trying to understand the exact cause of those 412 in our case. | 16:05 |
| *** itlinux has joined #openstack-swift | 16:53 | |
| *** two_tired has joined #openstack-swift | 17:21 | |
| *** pcaruana has quit IRC | 17:58 | |
| *** silor has quit IRC | 18:27 | |
| *** itlinux has quit IRC | 19:35 | |
| *** itlinux has joined #openstack-swift | 19:40 | |
| *** itlinux has quit IRC | 19:44 | |
| *** pcaruana has joined #openstack-swift | 20:51 | |
| *** pcaruana has quit IRC | 20:53 | |
| *** SkyRocknRoll_ has quit IRC | 21:01 | |
| *** itlinux has joined #openstack-swift | 22:31 | |
| *** itlinux has quit IRC | 22:53 | |
| *** two_tired has quit IRC | 23:22 | |
| *** kei_yama has joined #openstack-swift | 23:22 | |
| *** itlinux has joined #openstack-swift | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!