| *** Guest7982 has quit IRC | 00:01 | |
| *** david-ly_ has joined #openstack-swift | 00:04 | |
| *** david-lyle has quit IRC | 00:05 | |
| *** morgan is now known as mordgan | 00:16 | |
| *** mordgan is now known as morgan | 00:16 | |
| *** morgan is now known as mordan | 00:16 | |
| *** mordan is now known as mordgan | 00:16 | |
| *** zhill has quit IRC | 00:25 | |
| *** kei_yama has quit IRC | 00:29 | |
| *** vinsh has quit IRC | 00:29 | |
| *** DericHorn-HP has joined #openstack-swift | 00:38 | |
| *** gyee has quit IRC | 00:41 | |
| *** DericHorn-HP has quit IRC | 00:42 | |
| *** m_kazuhiro has joined #openstack-swift | 00:42 | |
| kota_ | good morning | 00:43 |
|---|---|---|
| *** ho has joined #openstack-swift | 00:44 | |
| *** DericHorn-HP has joined #openstack-swift | 00:45 | |
| *** DericHorn-HP has quit IRC | 00:48 | |
| *** bkeller has joined #openstack-swift | 00:52 | |
| *** CR7 has quit IRC | 00:54 | |
| *** wbhuber has quit IRC | 01:01 | |
| *** setmason has joined #openstack-swift | 01:07 | |
| *** david-ly_ has quit IRC | 01:14 | |
| *** diogogmt has joined #openstack-swift | 01:19 | |
| *** david-lyle has joined #openstack-swift | 01:22 | |
| mattoliverau | kota_: morning | 01:29 |
| *** david-lyle has quit IRC | 01:29 | |
| *** jrichli has joined #openstack-swift | 01:42 | |
| *** eariasn has joined #openstack-swift | 01:43 | |
| *** jamielennox is now known as jamielennox|away | 01:46 | |
| *** hrou has joined #openstack-swift | 01:47 | |
| *** setmason has quit IRC | 01:51 | |
| openstackgerrit | Merged openstack/python-swiftclient: Miscellaneous (mostly test) cleanup https://review.openstack.org/222009 | 01:52 |
| *** haomaiwang has joined #openstack-swift | 01:56 | |
| *** haomaiwang has quit IRC | 02:01 | |
| *** haomaiwa_ has joined #openstack-swift | 02:04 | |
| *** kei_yama has joined #openstack-swift | 02:06 | |
| *** Guest563 has quit IRC | 02:07 | |
| *** km has joined #openstack-swift | 02:07 | |
| *** km is now known as Guest48057 | 02:08 | |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add --decode-content option https://review.openstack.org/184957 | 02:10 |
| *** setmason has joined #openstack-swift | 02:31 | |
| *** mac_ified has joined #openstack-swift | 02:34 | |
| *** hezhiqiang has joined #openstack-swift | 02:41 | |
| *** klrmn1 has quit IRC | 02:41 | |
| *** klrmn1 has joined #openstack-swift | 02:41 | |
| openstackgerrit | Carlos Cavanna proposed openstack/swift: bug/1270114. Missing documentation for Bulk Middleware. https://review.openstack.org/232688 | 02:46 |
| *** hezhiqiang has quit IRC | 02:46 | |
| openstackgerrit | Azhagu Selvan SP proposed openstack/swift: Fixes a typo in slo doc https://review.openstack.org/232850 | 02:50 |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Use bulk-delete middleware when available https://review.openstack.org/190887 | 02:54 |
| *** trifon has joined #openstack-swift | 03:00 | |
| *** kei_yama has quit IRC | 03:00 | |
| *** haomaiwa_ has quit IRC | 03:01 | |
| *** haomaiwang has joined #openstack-swift | 03:01 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:09 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 03:13 | |
| *** hezhiqiang has joined #openstack-swift | 03:14 | |
| *** silor has joined #openstack-swift | 03:15 | |
| *** sanchitmalhotra has quit IRC | 03:15 | |
| *** DericHorn-HP has joined #openstack-swift | 03:21 | |
| *** diogogmt has quit IRC | 03:23 | |
| *** DericHorn-HP has quit IRC | 03:25 | |
| *** setmason has quit IRC | 03:29 | |
| *** eariasn has quit IRC | 03:30 | |
| *** eariasn has joined #openstack-swift | 03:31 | |
| *** eariasn has quit IRC | 03:35 | |
| *** sanchitmalhotra1 has quit IRC | 03:35 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:37 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 03:40 | |
| *** bkeller has quit IRC | 03:41 | |
| *** sanchitmalhotra has quit IRC | 03:42 | |
| *** Kennan has quit IRC | 03:43 | |
| *** Kennan has joined #openstack-swift | 03:43 | |
| *** trifon has quit IRC | 03:47 | |
| *** david-lyle has joined #openstack-swift | 03:47 | |
| *** klrmn1 has quit IRC | 03:48 | |
| *** kei_yama has joined #openstack-swift | 03:52 | |
| *** hezhiqiang has quit IRC | 03:52 | |
| *** links has joined #openstack-swift | 03:53 | |
| *** jmccarthy has joined #openstack-swift | 03:53 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 03:54 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 03:55 |
| jmccarthy | Hello, anyone got a sec for question about: | 03:59 |
| jmccarthy | Object POST failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/test2/file2 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 03:59 |
| jmccarthy | and on the proxy server: | 03:59 |
| jmccarthy | proxy-server: Invalid user token - rejecting request | 03:59 |
| jmccarthy | swift upload seems to work fine, but swift post runs into this ? | 03:59 |
| *** chlong has joined #openstack-swift | 04:00 | |
| *** haomaiwang has quit IRC | 04:01 | |
| *** haomaiwang has joined #openstack-swift | 04:02 | |
| *** kei_yama has quit IRC | 04:04 | |
| *** kei_yama has joined #openstack-swift | 04:04 | |
| *** chlong has quit IRC | 04:05 | |
| *** csd_ has joined #openstack-swift | 04:05 | |
| mattoliverau | jmccarthy: well it seems to be saying that the token is wrong. | 04:14 |
| *** chlong has joined #openstack-swift | 04:18 | |
| jmccarthy | Yea not sure how I can 'swift upload' new files/containers and those succeed, is there a reason why 'post' would be different I'm missing ? | 04:18 |
| timburke | jmccarthy: if you exported your token as well as the rest of your credentials, swiftclient will reauth on 401s (which i would expect is what's happening on upload; you could test this with `swift --debug upload ...`) | 04:22 |
| timburke | if swift responds with a 404, though, it won't (since the server didn't say "i don't know who you are", it said "that's not a thing") | 04:23 |
| jmccarthy | Interesting ! Ok It does give 404 with upload, but then success | 04:25 |
| jmccarthy | ... | 04:25 |
| jmccarthy | INFO:swiftclient:REQ: curl -i http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 -I -H "X-Auth-Token: 8020fe06d4a6481e8e91600e9320a0f3" | 04:25 |
| jmccarthy | INFO:swiftclient:RESP STATUS: 404 Not Found | 04:25 |
| jmccarthy | INFO:swiftclient:RESP HEADERS: [('date', 'Fri, 09 Oct 2015 04:25:17 GMT'), ('content-length', '0'), ('content-type', 'text/html; charset=UTF-8'), ('x-trans-id', 'txebc8b0d2403d42d5acb46-00561741ad')] | 04:25 |
| jmccarthy | ERROR:swiftclient:Object HEAD failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 404 Not Found | 04:25 |
| jmccarthy | Traceback (most recent call last): | 04:25 |
| jmccarthy | File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1390, in _retry | 04:25 |
| jmccarthy | service_token=self.service_token, **kwargs) | 04:25 |
| jmccarthy | File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 994, in head_object | 04:25 |
| jmccarthy | http_response_content=body) | 04:25 |
| jmccarthy | ClientException: Object HEAD failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 404 Not Found | 04:25 |
| jmccarthy | DEBUG:requests.packages.urllib3.connectionpool:"PUT /v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 HTTP/1.1" 201 0 | 04:25 |
| jmccarthy | DEBUG:swiftclient:REQ: curl -i http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 -X PUT -H "X-Auth-Token: 8020fe06d4a6481e8e91600e9320a0f3" | 04:25 |
| *** csd_ has quit IRC | 04:26 | |
| timburke | jmccarthy: what's it do when you post to that same file? or try to download? | 04:27 |
| jmccarthy | Hmm ok same file again seems to go without the 404: | 04:29 |
| jmccarthy | INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 172.28.128.51 | 04:29 |
| jmccarthy | DEBUG:requests.packages.urllib3.connectionpool:"HEAD /v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 HTTP/1.1" 200 0 | 04:29 |
| jmccarthy | DEBUG:swiftclient:REQ: curl -i http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 -I -H "X-Auth-Token: f53eede450f249efa74e349b4c898931" | 04:29 |
| jmccarthy | DEBUG:swiftclient:RESP STATUS: 200 OK | 04:29 |
| jmccarthy | DEBUG:swiftclient:RESP HEADERS: [('content-length', '10485760'), ('x-object-meta-mtime', '1444291489.981214'), ('accept-ranges', 'bytes'), ('last-modified', 'Fri, 09 Oct 2015 04:25:18 GMT'), ('etag', 'f1c9645dbc14efddc7d8a322685f26eb'), ('x-timestamp', '1444364717.97251'), ('x-trans-id', 'txd0338eba5f864566a6c32-0056174282'), ('date', 'Fri, 09 Oct 2015 04:28:50 GMT'), ('content-type', 'application/octet-stream')] | 04:29 |
| jmccarthy | DEBUG:requests.packages.urllib3.connectionpool:"PUT /v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 HTTP/1.1" 201 0 | 04:29 |
| jmccarthy | DEBUG:swiftclient:REQ: curl -i http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file1 -X PUT -H "X-Auth-Token: f53eede450f249efa74e349b4c898931" | 04:29 |
| jmccarthy | DEBUG:swiftclient:RESP STATUS: 201 Created | 04:29 |
| jmccarthy | DEBUG:swiftclient:RESP HEADERS: [('content-length', '0'), ('last-modified', 'Fri, 09 Oct 2015 04:28:51 GMT'), ('etag', 'f1c9645dbc14efddc7d8a322685f26eb'), ('x-trans-id', 'tx37d7c9294e1b4135bf0d6-0056174282'), ('date', 'Fri, 09 Oct 2015 04:28:51 GMT'), ('content-type', 'text/html; charset=UTF-8')] | 04:29 |
| jmccarthy | file1 | 04:29 |
| timburke | (fwiw, the attempted HEAD is to check for SLOs and DLOs; it's assumed that if you overwrite a large object, you'll want to clean up the segment files as well. this can be overridden with --leave-segments) | 04:29 |
| jmccarthy | The download fails =/ | 04:29 |
| jmccarthy | re SLOs DLOs check: Ok so it's not so unusual for that to 404 then is it ? | 04:30 |
| timburke | ...so GET 404s but HEAD 200s? that's...odd... | 04:30 |
| timburke | correct. | 04:30 |
| timburke | mind doing a --debug on download? | 04:31 |
| jmccarthy | Oh sure one sec | 04:31 |
| jmccarthy | INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 172.28.128.51 | 04:32 |
| jmccarthy | DEBUG:requests.packages.urllib3.connectionpool:"GET /v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqq/file1 HTTP/1.1" 404 70 | 04:32 |
| jmccarthy | INFO:swiftclient:REQ: curl -i http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqq/file1 -X GET -H "X-Auth-Token: 92368447c05e4c94bf8930a274ed0784" | 04:32 |
| jmccarthy | INFO:swiftclient:RESP STATUS: 404 Not Found | 04:32 |
| jmccarthy | INFO:swiftclient:RESP HEADERS: [('date', 'Fri, 09 Oct 2015 04:32:32 GMT'), ('content-length', '70'), ('content-type', 'text/html; charset=UTF-8'), ('x-trans-id', 'tx4e9b54f94d8547ddb8195-0056174360')] | 04:32 |
| jmccarthy | INFO:swiftclient:RESP BODY: <html><h1>Not Found</h1><p>The resource could not be found.</p></html> | 04:32 |
| jmccarthy | ERROR:swiftclient:Object GET failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqq/file1 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 04:32 |
| jmccarthy | Traceback (most recent call last): | 04:32 |
| jmccarthy | File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1390, in _retry | 04:32 |
| jmccarthy | service_token=self.service_token, **kwargs) | 04:32 |
| jmccarthy | File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 949, in get_object | 04:32 |
| jmccarthy | http_response_content=body) | 04:32 |
| jmccarthy | ClientException: Object GET failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqq/file1 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 04:32 |
| jmccarthy | ERROR:swiftclient.service:Object GET failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqq/file1 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 04:32 |
| timburke | i count only 3 q's instead of 4... | 04:32 |
| jmccarthy | =( yea that works | 04:33 |
| jmccarthy | DEBUG:swiftclient:RESP STATUS: 200 OK | 04:33 |
| jmccarthy | DEBUG:swiftclient:RESP HEADERS: [('content-length', '10485760'), ('x-object-meta-mtime', '1444291489.981214'), ('accept-ranges', 'bytes'), ('last-modified', 'Fri, 09 Oct 2015 04:28:51 GMT'), ('etag', 'f1c9645dbc14efddc7d8a322685f26eb'), ('x-timestamp', '1444364930.84297'), ('x-trans-id', 'tx18771a5f29a44f17b9e89-00561743b9'), ('date', 'Fri, 09 Oct 2015 04:34:01 GMT'), ('content-type', 'application/octet-stream')] | 04:33 |
| jmccarthy | file1 [auth 0.164s, headers 0.269s, total 0.385s, 47.557 MB/s] | 04:33 |
| timburke | glad to help :) | 04:33 |
| jmccarthy | Hehe well I'm still not so sure about why the post fails tho ? | 04:33 |
| timburke | --debug? and you probably ought to be redacting that auth token... (sorry, should have mentioned earlier) | 04:34 |
| *** flwang has quit IRC | 04:35 | |
| jmccarthy | INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): 172.28.128.51 | 04:35 |
| jmccarthy | DEBUG:requests.packages.urllib3.connectionpool:"POST /v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file5 HTTP/1.1" 404 70 | 04:35 |
| jmccarthy | INFO:swiftclient:REQ: curl -i http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file5 -X POST -H "X-Auth-Token: 413408c49549425b92b754cc7086e5f4" | 04:35 |
| jmccarthy | INFO:swiftclient:RESP STATUS: 404 Not Found | 04:35 |
| jmccarthy | INFO:swiftclient:RESP HEADERS: [('date', 'Fri, 09 Oct 2015 04:36:22 GMT'), ('content-length', '70'), ('content-type', 'text/html; charset=UTF-8'), ('x-trans-id', 'tx0dcc708008794550a5dd3-0056174446')] | 04:35 |
| jmccarthy | INFO:swiftclient:RESP BODY: <html><h1>Not Found</h1><p>The resource could not be found.</p></html> | 04:35 |
| jmccarthy | ERROR:swiftclient:Object POST failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file5 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 04:35 |
| jmccarthy | Traceback (most recent call last): | 04:35 |
| jmccarthy | File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1390, in _retry | 04:35 |
| jmccarthy | service_token=self.service_token, **kwargs) | 04:35 |
| jmccarthy | File "/usr/lib/python2.7/site-packages/swiftclient/client.py", line 1147, in post_object | 04:35 |
| jmccarthy | http_response_content=body) | 04:35 |
| jmccarthy | ClientException: Object POST failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file5 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 04:35 |
| jmccarthy | ERROR:swiftclient.service:Object POST failed: http://172.28.128.51:8080/v1/AUTH_385bd95a576d43428ce97efb5a95ae2d/testqqqq/file5 404 Not Found [first 60 chars of response] <html><h1>Not Found</h1><p>The resource could not be found.< | 04:35 |
| jmccarthy | Oh - "and you probably ought to be redacting that auth token" is this what is giving me trouble ? How would I do that ? | 04:36 |
| timburke | no, i mean that an auth token ought to be guarded as closely as username/password | 04:37 |
| jmccarthy | timburke: Thank you by the way for your help ! =) | 04:37 |
| timburke | but we can definitely download file5? | 04:37 |
| timburke | sure! happy to. | 04:37 |
| jmccarthy | Oh ah it's a scratch setup, one sec | 04:37 |
| timburke | no worries. just realized that it doesn't look like a private range :P | 04:38 |
| *** kei_yama has quit IRC | 04:39 | |
| jmccarthy | Ah .. no file 5 isn't there sorry .. so post will only work on a file that is already there ? | 04:39 |
| timburke | yes. otherwise, what would the metadata mean? if it doesn't have a backing object (even a zero-byte object), it doesn't quite make sense | 04:41 |
| *** kei_yama has joined #openstack-swift | 04:41 | |
| jmccarthy | Maybe I have been mixing up my commands, I was sure I had done for files that are present tho I mean - let me give it another go | 04:42 |
| *** mfalatic has joined #openstack-swift | 04:43 | |
| *** proteusguy__ has quit IRC | 04:44 | |
| *** jrichli has quit IRC | 04:52 | |
| jmccarthy | timburke: It seems to be a mixup - thanks again ! | 04:52 |
| *** hezhiqiang has joined #openstack-swift | 04:52 | |
| timburke | happy to help! | 04:53 |
| *** sanchitmalhotra has joined #openstack-swift | 04:54 | |
| *** hrou has quit IRC | 04:55 | |
| *** ppai has joined #openstack-swift | 04:55 | |
| *** trifon has joined #openstack-swift | 04:55 | |
| *** sanchitmalhotra1 has quit IRC | 04:56 | |
| *** mac_ified has quit IRC | 04:57 | |
| *** proteusguy__ has joined #openstack-swift | 04:57 | |
| *** haomaiwang has quit IRC | 05:01 | |
| *** m_kazuhiro has quit IRC | 05:01 | |
| *** haomaiwang has joined #openstack-swift | 05:02 | |
| jmccarthy | timeburke, you still there ? ;) | 05:02 |
| jmccarthy | How about this: Why does the account server seem to insist on using localhost in this ? | 05:03 |
| jmccarthy | account-server: 172.28.128.30 - - [07/Oct/2015:10:47:39 +0000] "HEAD | 05:03 |
| jmccarthy | /sdb1/149/.expiring_objects" 404 - "HEAD | 05:03 |
| jmccarthy | "tx606598a3294245f9a12d0-005614f84b" | 05:03 |
| jmccarthy | "proxy-server 1" 0.0003 "-" 23 - | 05:03 |
| jmccarthy | account-server: 172.28.128.30 - - [07/Oct/2015:10:47:39 +0000] "GET | 05:03 |
| jmccarthy | /sdb1/149/.expiring_objects" 404 - "GET | 05:03 |
| jmccarthy | 05:03 | |
| jmccarthy | "txa3531c97d8484aeaa279c-005614f84b" "proxy-server 1" 0.0003 "-" 23 - | 05:03 |
| jmccarthy | Oh it's been stripped out | 05:04 |
| jmccarthy | ptth://localhost/v1/.expiring_objects?format=json&marker=&end_marker=" | 05:05 |
| *** Venkatesh has joined #openstack-swift | 05:12 | |
| *** zhill has joined #openstack-swift | 05:13 | |
| *** hezhiqiang has quit IRC | 05:16 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 05:22 | |
| *** sanchitmalhotra has quit IRC | 05:24 | |
| *** haomaiwang has quit IRC | 05:31 | |
| *** chlong has quit IRC | 05:31 | |
| *** haomaiwa_ has joined #openstack-swift | 05:33 | |
| mattoliverau | jmccarthy: you should paste in something like paste.openstack.org, makes it easier to read :) | 05:34 |
| jmccarthy | Sorry yes your right ! | 05:35 |
| jmccarthy | I blame Zzzz | 05:36 |
| mattoliverau | jmccarthy: lol | 05:36 |
| mattoliverau | jmccarthy: the localhost could be coming from something using an internal client internally. Which pops up as localhost (cause it uses a small proxy server) or depending on the IPs you've used when building your rings. | 05:37 |
| jmccarthy | http://paste.openstack.org/show/475815/ | 05:37 |
| jmccarthy | Yea I was thinking something like that, but it's not in rings and all configs seem to be bound to ips that are not localhost | 05:38 |
| mattoliverau | jmccarthy: that would be the object expirer and yes it would be using the internal swift client to talk to the cluster to find objects that are expiring | 05:39 |
| jmccarthy | I'm not sure what it is that the account server wants to expire or check for expiry | 05:39 |
| jmccarthy | Hmm but it seems to be coming from the account server ? | 05:39 |
| mattoliverau | jmccarthy: it isn't coming from the account server, its the internal client asking the account server for the list of containers used to store expiring objects. | 05:42 |
| mattoliverau | so it's the account server logging the request it recieved. | 05:42 |
| jmccarthy | mattoliverau: Ok ! Ah ok that fits, there seems to be a lot of them tho ? And they are 404 hrm | 05:43 |
| mattoliverau | jmccarthy: you probably don't have any expiring objects so the expirty object account hasn't been created | 05:44 |
| jmccarthy | mattoliverau: Ok good idea, so if I stick in something that should expire at some stage - I'll try that ! | 05:44 |
| *** m_kazuhiro has joined #openstack-swift | 05:46 | |
| *** hezhiqiang has joined #openstack-swift | 05:48 | |
| *** SkyRocknRoll has joined #openstack-swift | 05:49 | |
| jmccarthy | mattoliverau: Thanks ! That seems to be it alright =) | 05:57 |
| *** itlinux has joined #openstack-swift | 05:58 | |
| *** haomaiwa_ has quit IRC | 06:01 | |
| *** peterlisak has joined #openstack-swift | 06:01 | |
| *** haomaiwang has joined #openstack-swift | 06:02 | |
| *** Venkatesh_ has joined #openstack-swift | 06:04 | |
| *** Venkatesh has quit IRC | 06:06 | |
| *** itlinux has quit IRC | 06:11 | |
| *** hezhiqiang has quit IRC | 06:26 | |
| *** geaaru has joined #openstack-swift | 06:30 | |
| *** fbo has quit IRC | 06:35 | |
| *** fbo has joined #openstack-swift | 06:37 | |
| openstackgerrit | Matthew Oliver proposed openstack/swift: Make db_replicator usync smaller containers https://review.openstack.org/232931 | 06:37 |
| jmccarthy | Is there a good spot to find more information about the swift internal client ? | 06:38 |
| *** chlong has joined #openstack-swift | 06:38 | |
| mattoliverau | jmccarthy: not really, I mean there are doc strings defined for using it. but it's used internally by swift daemons/tools. There is API documentation: http://docs.openstack.org/developer/swift/misc.html#module-swift.common.internal_client | 06:46 |
| jmccarthy | mattoliverau: Ok cool, I'll check that out - thanks again ! =) | 06:47 |
| *** sanchitmalhotra has joined #openstack-swift | 06:56 | |
| *** hezhiqiang has joined #openstack-swift | 06:57 | |
| *** sanchitmalhotra1 has quit IRC | 06:58 | |
| *** haomaiwang has quit IRC | 07:01 | |
| *** haomaiwang has joined #openstack-swift | 07:02 | |
| *** dmorita has joined #openstack-swift | 07:05 | |
| *** hezhiqiang has quit IRC | 07:06 | |
| *** rledisez has joined #openstack-swift | 07:12 | |
| *** haomaiwang has quit IRC | 07:19 | |
| *** haomaiwa_ has joined #openstack-swift | 07:22 | |
| *** itlinux has joined #openstack-swift | 07:23 | |
| *** subscope has quit IRC | 07:29 | |
| *** marzif has joined #openstack-swift | 07:45 | |
| *** zhill has quit IRC | 07:50 | |
| *** delattec has quit IRC | 07:58 | |
| *** haomaiwa_ has quit IRC | 08:01 | |
| *** haomaiwang has joined #openstack-swift | 08:01 | |
| *** haomaiwang has quit IRC | 08:02 | |
| *** openstackstatus has quit IRC | 08:02 | |
| *** haomaiwang has joined #openstack-swift | 08:03 | |
| *** openstackstatus has joined #openstack-swift | 08:04 | |
| *** ChanServ sets mode: +v openstackstatus | 08:04 | |
| *** chlong has quit IRC | 08:09 | |
| *** ozialien has joined #openstack-swift | 08:13 | |
| *** ozialien has quit IRC | 08:19 | |
| *** ozialien has joined #openstack-swift | 08:20 | |
| *** ozialien has quit IRC | 08:27 | |
| *** ozialien has joined #openstack-swift | 08:28 | |
| *** cdelatte has quit IRC | 08:36 | |
| *** cdelatte has joined #openstack-swift | 08:37 | |
| *** ozialien has quit IRC | 08:37 | |
| *** ozialien has joined #openstack-swift | 08:37 | |
| *** jistr has joined #openstack-swift | 08:41 | |
| *** joeljwright has joined #openstack-swift | 08:47 | |
| *** ChanServ sets mode: +v joeljwright | 08:47 | |
| *** ozialien has quit IRC | 08:48 | |
| *** ozialien has joined #openstack-swift | 08:48 | |
| *** aswadr has joined #openstack-swift | 08:55 | |
| *** jordanP has joined #openstack-swift | 08:59 | |
| *** haomaiwang has quit IRC | 09:01 | |
| *** haomaiwang has joined #openstack-swift | 09:01 | |
| *** hezhiqiang has joined #openstack-swift | 09:06 | |
| *** marzif has quit IRC | 09:10 | |
| *** aix has joined #openstack-swift | 09:13 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 09:26 | |
| *** sanchitmalhotra has quit IRC | 09:28 | |
| *** zhiyan has quit IRC | 09:34 | |
| *** serverascode has quit IRC | 09:34 | |
| *** nottrobin has quit IRC | 09:34 | |
| *** dmorita has quit IRC | 09:36 | |
| *** briancurtin has quit IRC | 09:36 | |
| *** ozialien has quit IRC | 09:40 | |
| *** mahatic has joined #openstack-swift | 09:43 | |
| *** haomaiwang has quit IRC | 09:55 | |
| *** zhiyan has joined #openstack-swift | 09:56 | |
| *** zhiyan has quit IRC | 09:57 | |
| *** haomaiwa_ has joined #openstack-swift | 09:57 | |
| openstackgerrit | Merged openstack/swift: swift-ring-builder can't select id=0 https://review.openstack.org/232518 | 09:58 |
| *** marzif has joined #openstack-swift | 10:00 | |
| *** haomaiwa_ has quit IRC | 10:01 | |
| *** haomaiwa_ has joined #openstack-swift | 10:01 | |
| *** nottrobin has joined #openstack-swift | 10:10 | |
| *** serverascode has joined #openstack-swift | 10:16 | |
| *** zhiyan has joined #openstack-swift | 10:18 | |
| *** breitz has quit IRC | 10:22 | |
| *** breitz has joined #openstack-swift | 10:23 | |
| *** chlong has joined #openstack-swift | 10:25 | |
| *** briancurtin has joined #openstack-swift | 10:29 | |
| *** sanchitmalhotra has joined #openstack-swift | 10:29 | |
| *** sanchitmalhotra1 has quit IRC | 10:31 | |
| *** haomaiwa_ has quit IRC | 10:37 | |
| *** 18VAATL7C has joined #openstack-swift | 10:38 | |
| *** mahatic has quit IRC | 10:42 | |
| *** mahatic has joined #openstack-swift | 10:45 | |
| *** ho has quit IRC | 10:50 | |
| *** Guest48057 has quit IRC | 10:55 | |
| *** 18VAATL7C has quit IRC | 11:01 | |
| *** haomaiwang has joined #openstack-swift | 11:01 | |
| *** chlong has quit IRC | 11:15 | |
| *** sanchitmalhotra has quit IRC | 11:25 | |
| *** kei_yama has quit IRC | 11:31 | |
| *** alejandrito has joined #openstack-swift | 11:32 | |
| *** gustavo_ has quit IRC | 11:36 | |
| *** gustavo has joined #openstack-swift | 11:40 | |
| *** mac_ified has joined #openstack-swift | 11:42 | |
| *** weihan has joined #openstack-swift | 11:48 | |
| *** mac_ified has quit IRC | 12:00 | |
| *** haomaiwang has quit IRC | 12:01 | |
| *** haomaiwang has joined #openstack-swift | 12:01 | |
| *** m_kazuhiro has quit IRC | 12:03 | |
| *** jordanP has quit IRC | 12:07 | |
| *** cdelatte has quit IRC | 12:08 | |
| *** weihan has quit IRC | 12:15 | |
| *** weihan has joined #openstack-swift | 12:15 | |
| *** lpabon has joined #openstack-swift | 12:17 | |
| *** weihan_ has joined #openstack-swift | 12:21 | |
| *** mahatic has quit IRC | 12:22 | |
| *** cdelatte has joined #openstack-swift | 12:23 | |
| *** delattec has joined #openstack-swift | 12:23 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 12:24 |
| *** weihan has quit IRC | 12:24 | |
| *** chlong has joined #openstack-swift | 12:26 | |
| haypo | notmyname: oh, you blocked all requirements update: https://review.openstack.org/88736 | 12:26 |
| haypo | notmyname: why not updating them? | 12:26 |
| haypo | notmyname: (hi ;-)) | 12:26 |
| haypo | notmyname: if it's because ";python_version<'3.0'" which requires a recent pbr version, you should see my change https://review.openstack.org/#/c/217423/ which upgrades pbr and adds support for environment markers ("; python_version ..." in requirements) | 12:28 |
| *** haomaiwang has quit IRC | 12:31 | |
| *** aix has quit IRC | 12:31 | |
| *** SkyRocknRoll has quit IRC | 12:33 | |
| *** diogogmt has joined #openstack-swift | 12:45 | |
| *** eariasn has joined #openstack-swift | 12:45 | |
| *** weihan_ has quit IRC | 12:50 | |
| *** weihan has joined #openstack-swift | 12:50 | |
| openstackgerrit | Robert Francis proposed openstack/swift: WIP: Symlink implementation. (work in progress) https://review.openstack.org/232162 | 12:50 |
| *** setmason has joined #openstack-swift | 12:52 | |
| *** marzif has quit IRC | 12:52 | |
| *** marzif has joined #openstack-swift | 12:53 | |
| *** aix has joined #openstack-swift | 13:02 | |
| *** janonymous_ has joined #openstack-swift | 13:05 | |
| *** silor has quit IRC | 13:07 | |
| openstackgerrit | janonymous proposed openstack/swift: Use six.moves.map/filter/zip inplace of itertools.izip/imap/ifilter https://review.openstack.org/203414 | 13:10 |
| *** hrou has joined #openstack-swift | 13:11 | |
| *** links has quit IRC | 13:19 | |
| *** diogogmt has quit IRC | 13:21 | |
| openstackgerrit | janonymous proposed openstack/swift: Python 3 deprecated the logger.warn method in favor of warning https://review.openstack.org/208222 | 13:25 |
| *** Venkatesh_ has quit IRC | 13:28 | |
| *** setmason_ has joined #openstack-swift | 13:30 | |
| *** diogogmt has joined #openstack-swift | 13:32 | |
| *** setmason has quit IRC | 13:33 | |
| *** setmason_ is now known as setmason | 13:33 | |
| petertr7 | Hello! I was wondering if users who have read and write access to a container (via container ACLs) are able to complete "swift upload"? I'm able to complete PUTs with curl but not with python-swiftclient. I'm getting an "Account not found" error. Strangely I'm still able to do a "swift list <container>" successfully | 13:34 |
| *** geaaru has quit IRC | 13:35 | |
| petertr7 | Also, I'm able to successfully delete files in the container as well "swift delete <container> <file>" | 13:37 |
| *** janonymous_ has quit IRC | 13:43 | |
| *** geaaru has joined #openstack-swift | 13:48 | |
| *** marekkaleta has joined #openstack-swift | 13:48 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: Guess content-type on PUT https://review.openstack.org/232572 | 13:53 |
| *** dustins has joined #openstack-swift | 13:55 | |
| *** haomaiwang has joined #openstack-swift | 13:58 | |
| *** haomaiwang has quit IRC | 14:01 | |
| *** haomaiwa_ has joined #openstack-swift | 14:01 | |
| *** wbhuber has joined #openstack-swift | 14:12 | |
| *** mahatic has joined #openstack-swift | 14:14 | |
| *** mahatic has quit IRC | 14:14 | |
| *** baojg has joined #openstack-swift | 14:17 | |
| *** mahatic has joined #openstack-swift | 14:21 | |
| *** setmason has quit IRC | 14:23 | |
| *** thumpba has joined #openstack-swift | 14:30 | |
| *** itlinux has quit IRC | 14:31 | |
| openstackgerrit | Peter Lisák proposed openstack/swift: swift-ring-builder can't remove a device with zero weight https://review.openstack.org/233096 | 14:37 |
| *** peterlisak has quit IRC | 14:38 | |
| *** mahatic has quit IRC | 14:39 | |
| *** mahatic has joined #openstack-swift | 14:40 | |
| *** ppai has quit IRC | 14:40 | |
| *** jrichli has joined #openstack-swift | 14:42 | |
| *** haypo has left #openstack-swift | 14:47 | |
| *** tongli has joined #openstack-swift | 14:47 | |
| *** petertr7 is now known as petertr7_away | 14:50 | |
| *** petertr7_away is now known as petertr7 | 14:52 | |
| *** Fin1te has joined #openstack-swift | 14:56 | |
| *** wbhuber has quit IRC | 14:58 | |
| *** jmccarthy has quit IRC | 14:58 | |
| openstackgerrit | Victor Stinner proposed openstack/swift: py3: Replace basestring with six.string_types https://review.openstack.org/232540 | 14:59 |
| openstackgerrit | Victor Stinner proposed openstack/swift: Replace itertools.ifilter with six.moves.filter https://review.openstack.org/232539 | 14:59 |
| *** SkyRocknRoll has joined #openstack-swift | 15:00 | |
| *** haomaiwa_ has quit IRC | 15:01 | |
| *** haomaiwang has joined #openstack-swift | 15:01 | |
| *** marekkaleta has quit IRC | 15:03 | |
| *** amoturi1 has joined #openstack-swift | 15:07 | |
| *** mordgan is now known as morgan | 15:14 | |
| *** esker has joined #openstack-swift | 15:15 | |
| amoturi1 | Hi all, i am trying to use the common.utils.get_logger function. but it only works with syslog meaning the syslog has to have log_from_remote set to TRUE. Is there another utility function that doesnt use syslog and logs to a file instead? | 15:16 |
| *** lastops has joined #openstack-swift | 15:17 | |
| *** jmccarthy has joined #openstack-swift | 15:17 | |
| *** ozialien has joined #openstack-swift | 15:18 | |
| *** jmccarthy has quit IRC | 15:18 | |
| *** jmccarthy has joined #openstack-swift | 15:19 | |
| *** haomaiwang has quit IRC | 15:22 | |
| *** haomaiwang has joined #openstack-swift | 15:22 | |
| *** lcurtis has joined #openstack-swift | 15:23 | |
| glange | amoturi1: do you want to do this in a production cluster or when you are doing dev work or what? | 15:25 |
| amoturi1 | glange: in a production setup. | 15:27 |
| glange | I don't understand why you don't want to use syslog | 15:28 |
| *** minwoob has joined #openstack-swift | 15:29 | |
| *** trifon has quit IRC | 15:31 | |
| amoturi1 | in our case entire swift setup runs on a single machine. It would be more secure just to log to a local file instead of allowing syslog to accept remote logging. | 15:31 |
| glange | can you configure syslog to handle logging for that machine alone? | 15:32 |
| *** BAKfr has quit IRC | 15:32 | |
| *** BAKfr has joined #openstack-swift | 15:33 | |
| *** wbhuber has joined #openstack-swift | 15:34 | |
| *** marzif has quit IRC | 15:35 | |
| *** dmartls1 has joined #openstack-swift | 15:35 | |
| *** thumpba has quit IRC | 15:36 | |
| amoturi1 | glange: yes i believe i can setup syslog to handle logging for that machine alone. But that would be my second preference. | 15:36 |
| *** marzif has joined #openstack-swift | 15:36 | |
| *** SkyRocknRoll has quit IRC | 15:36 | |
| glange | ok, swift doesn't currently support your first choice, that will take a code change and testing and stuff, sorry | 15:37 |
| *** ozialien has quit IRC | 15:37 | |
| amoturi1 | glange: ok thanks for letting me know! That helps narrow my options. | 15:39 |
| glange | no problem | 15:40 |
| dmartls1 | If I intend to remove an entire region from my swift cluster, will setting all devices to a weight of 0 work correctly? Or am I better off just removing the that regions devices from the ring? | 15:41 |
| *** Fin1te has quit IRC | 15:43 | |
| *** thumpba has joined #openstack-swift | 15:47 | |
| glange | you might want to drain your devices slowly over time by adjusting the weight towards 0 gradually | 15:49 |
| glange | if you just make them 0 or remove them from the ring, you'll cause a large number of objects to immediately only have 2 copies in the right place | 15:49 |
| glange | for durability reasons, I think it's better to reduce the weight either gradually or to 0 immediately than removing them from the ring | 15:51 |
| glange | it can cause your cluster to have performace problems if a bunch of objects are out of place all at once | 15:51 |
| dmartls1 | i guess my big question then would be | 15:52 |
| glange | all the above also depends upon your cluster, traffic, how long it takes to do replication passes, what kind of data is stored, etc :) | 15:52 |
| dmartls1 | if i have 3 regions, 3 replicas, it tries to write 1 replica to each region, does weight have an effect on that? | 15:52 |
| *** Fin1te has joined #openstack-swift | 15:53 | |
| glange | the ring will try to put partitions on different "failure domains" when the ring is built | 15:53 |
| glange | this happens all the way down to the device level | 15:54 |
| glange | so, it won't result in two partions (object copies) on the same drive for example | 15:54 |
| glange | even if you only have one machine in your cluster with a bunch of drives | 15:54 |
| glange | make sense? | 15:55 |
| dmartls1 | yes | 15:56 |
| glange | we slowly drain our devices by adjusting the weight down when removing systems from our clusters | 15:56 |
| glange | each time a replication pass happens you can lower the weight | 15:57 |
| dmartls1 | so technically if i wanted to i could run 2 regions of different sizes by adjusting the weights properly? (currently our regions are symmetric) | 15:58 |
| openstackgerrit | Victor Stinner proposed openstack/swift: py3: Use the six module in the xprofile middleware https://review.openstack.org/233145 | 15:58 |
| *** nadeem has joined #openstack-swift | 15:59 | |
| glange | I think maybe you'd want to have the weight correspond to the size of each device and let the ring builder figure out "optimal" placement of the partitions | 16:00 |
| glange | and pass in sensible values to the ring builder for region/zone/ip etc | 16:00 |
| *** haomaiwang has quit IRC | 16:01 | |
| *** haomaiwang has joined #openstack-swift | 16:01 | |
| glange | if your cluster is too small to have multiple regions, you'll just have to live with being a little less redudent/fault tolerant | 16:02 |
| dmartls1 | just a little background, currently have 3 datacenters, 1 region per. we are removing 1 of the datacenters completely. Looks like lowering the weights in that region is a good start. | 16:06 |
| dmartls1 | thanks for your help | 16:06 |
| glange | sure | 16:06 |
| *** jistr has quit IRC | 16:08 | |
| *** ozialien has joined #openstack-swift | 16:08 | |
| *** thumpba has quit IRC | 16:12 | |
| *** gyee has joined #openstack-swift | 16:12 | |
| clayg | ohai | 16:15 |
| *** thumpba has joined #openstack-swift | 16:19 | |
| *** tongli has quit IRC | 16:19 | |
| *** CR7 has joined #openstack-swift | 16:23 | |
| *** itlinux has joined #openstack-swift | 16:25 | |
| peluse | acoles_: here or away? | 16:27 |
| *** rledisez has quit IRC | 16:31 | |
| *** cdelatte has quit IRC | 16:33 | |
| *** delattec has quit IRC | 16:33 | |
| *** chsc has joined #openstack-swift | 16:36 | |
| notmyname | good morning | 16:38 |
| notmyname | peluse: he said he was out until monday | 16:38 |
| clayg | good for him | 16:42 |
| clayg | isn't monday a holiday in the us? | 16:42 |
| clayg | pshffhfhfh no | 16:43 |
| MooingLemur | $employer doesn't believe in giving us the minor holidays :) | 16:46 |
| *** garthb has joined #openstack-swift | 16:48 | |
| *** haomaiwang has quit IRC | 16:48 | |
| *** haomaiwang has joined #openstack-swift | 16:49 | |
| *** thumpba has quit IRC | 16:50 | |
| *** haomaiwang has quit IRC | 16:50 | |
| peluse | I decalre monday to be "swift day"! | 16:51 |
| *** haomaiwa_ has joined #openstack-swift | 16:51 | |
| *** thumpba has joined #openstack-swift | 16:53 | |
| *** BAKfr has quit IRC | 16:53 | |
| petertr7 | Monday is a Canadian holiday (thanksgiving) | 16:53 |
| *** BAKfr has joined #openstack-swift | 16:55 | |
| MooingLemur | Yeah, I remember that Columbus day and Canada's Thanksgiving are always the same day | 16:58 |
| *** weihan has quit IRC | 16:59 | |
| *** Fin1te has quit IRC | 17:00 | |
| clayg | MooingLemur: "Indigenous Peoples' Day" | 17:00 |
| *** haomaiwa_ has quit IRC | 17:01 | |
| clayg | sorry ;) | 17:01 |
| MooingLemur | That too. :) | 17:01 |
| *** klrmn1 has joined #openstack-swift | 17:01 | |
| *** haomaiwang has joined #openstack-swift | 17:01 | |
| *** aix has quit IRC | 17:02 | |
| *** mahatic has quit IRC | 17:05 | |
| *** esker has quit IRC | 17:09 | |
| *** trifon has joined #openstack-swift | 17:09 | |
| *** wbhuber has quit IRC | 17:09 | |
| *** vinsh has joined #openstack-swift | 17:16 | |
| *** cdelatte has joined #openstack-swift | 17:18 | |
| *** trifon has quit IRC | 17:19 | |
| notmyname | This is interesting http://lists.openstack.org/pipermail/openstack-dev/2015-October/076552.html | 17:20 |
| *** janonymous_ has joined #openstack-swift | 17:25 | |
| jrichli | notmyname: seems my browser is having issues loading that page. | 17:27 |
| jrichli | I guess there are so many hits now that you posted that the site cannot keep up ;-) | 17:28 |
| jrichli | cool! | 17:29 |
| MooingLemur | :) | 17:30 |
| clayg | that wasn't that interesting | 17:30 |
| jrichli | I will certainly use that when/if I ever get the footers stuff working :-) | 17:30 |
| clayg | jrichli: lol | 17:30 |
| *** esker has joined #openstack-swift | 17:31 | |
| *** itlinux has quit IRC | 17:31 | |
| *** itlinux has joined #openstack-swift | 17:33 | |
| *** trifon has joined #openstack-swift | 17:33 | |
| *** marzif has quit IRC | 17:37 | |
| *** geaaru has quit IRC | 17:38 | |
| *** thumpba has quit IRC | 17:40 | |
| *** thumpba has joined #openstack-swift | 17:40 | |
| *** wbhuber has joined #openstack-swift | 17:45 | |
| *** wbhuber_ has joined #openstack-swift | 17:50 | |
| *** haomaiwang has quit IRC | 17:50 | |
| *** hezhiqiang has quit IRC | 17:50 | |
| *** wbhuber has quit IRC | 17:52 | |
| glange | I have an overwhelming urge to use that success hash tag thing in the wrong way :) | 17:54 |
| notmyname | clayg: https://i.imgflip.com/sapo8.jpg | 17:56 |
| *** vinsh has quit IRC | 17:57 | |
| jrichli | lol | 17:57 |
| *** joeljwright has quit IRC | 17:59 | |
| *** vinsh has joined #openstack-swift | 18:01 | |
| *** lastops has quit IRC | 18:03 | |
| *** jmccarthy has quit IRC | 18:07 | |
| *** esker has quit IRC | 18:08 | |
| *** esker has joined #openstack-swift | 18:09 | |
| *** vinsh has quit IRC | 18:10 | |
| *** CR7 has quit IRC | 18:11 | |
| openstackgerrit | janonymous proposed openstack/swift: pep8 fix: assertEquals -> assertEqual https://review.openstack.org/209645 | 18:16 |
| *** itlinux has quit IRC | 18:22 | |
| *** itlinux has joined #openstack-swift | 18:23 | |
| *** jmccarthy has joined #openstack-swift | 18:24 | |
| *** CR7 has joined #openstack-swift | 18:33 | |
| *** jistr has joined #openstack-swift | 18:40 | |
| *** cdelatte has quit IRC | 18:41 | |
| *** itlinux has quit IRC | 18:43 | |
| *** cdelatte has joined #openstack-swift | 18:50 | |
| *** jistr is now known as jistr|afk | 18:50 | |
| *** eranrom has joined #openstack-swift | 18:50 | |
| *** petertr7 is now known as petertr7_away | 18:52 | |
| *** eranrom has quit IRC | 18:56 | |
| *** cdelatte has quit IRC | 18:57 | |
| *** minwoob has quit IRC | 19:00 | |
| *** petertr7_away is now known as petertr7 | 19:00 | |
| *** minwoob has joined #openstack-swift | 19:00 | |
| *** jistr|afk has quit IRC | 19:05 | |
| *** delattec has joined #openstack-swift | 19:06 | |
| *** cdelatte has joined #openstack-swift | 19:06 | |
| *** CR7_ has joined #openstack-swift | 19:11 | |
| *** hezhiqiang has joined #openstack-swift | 19:12 | |
| *** CR7 has quit IRC | 19:15 | |
| *** itlinux has joined #openstack-swift | 19:19 | |
| petertr7 | Hey, I have a python-swiftclient potential bug/user issue. Currently if a user has read access to a container, using the swift command line tool he/she is able to upload files (via 'swift upload <container> <object>') however gets a "failed to create container" error. As per python-swiftclient/service.py:1341 (https://github.com/openstack/python-swiftclient/blob/master/swiftclient/service.py#L1341-L1344). It seems as if during an u | 19:20 |
| petertr7 | pload of a file the container is created just in case. The issue is that some users may have access to write to a container but unable to create containers. They'll succeed in the upload but always get this error. | 19:20 |
| petertr7 | *correction: I meant to open with, "if a user has read and write access to a container" (via ACLs) | 19:21 |
| *** itlinux has quit IRC | 19:26 | |
| notmyname | petertr7: that sounds familiar | 19:30 |
| notmyname | as in, yeah, I see exactly how that's a problem, and I think I've heard someone else talk about it | 19:30 |
| notmyname | I don't know if there was anything written to make it work better | 19:30 |
| notmyname | petertr7: what version of swiftclient are you using | 19:30 |
| notmyname | petertr7: you can get it with `swift --version` | 19:30 |
| petertr7 | thanks notmyname, I'm using 2.6.0 | 19:31 |
| timburke | https://bugs.launchpad.net/python-swiftclient/+bug/1204558 ? | 19:31 |
| openstack | Launchpad bug 1204558 in python-swiftclient "Upload on container with write ACL reports errors" [Undecided,Triaged] - Assigned to Fabien Boucher (fabien-boucher) | 19:31 |
| notmyname | timburke: yeah. that bug's only 2 years old. you'd think we might have done something on it ;-) | 19:31 |
| petertr7 | Aha! I knew someone must have encountered this before. Thank you timburke | 19:31 |
| notmyname | it seems the status is all off | 19:32 |
| petertr7 | So just out of curiosity, since python-swiftclient is being deprecated, will this bug be a "won't fix"? | 19:33 |
| notmyname | where did you hear that? | 19:33 |
| notmyname | that swiftclient is being deprecated | 19:33 |
| clayg | "they" said so | 19:33 |
| petertr7 | the alternative is to use openstack cli. "openstack object create <container> <object>" achieves the same result | 19:33 |
| clayg | petertr7: and it *works* !? | 19:34 |
| clayg | petertr7: also what auth system are you using that supports account-acls? | 19:34 |
| petertr7 | sorry, when I said achieves the same result, I mean it successfully uploads without the warning | 19:34 |
| notmyname | petertr7: you can expect to have swiftclient around for a while (even if there is equiv functionality in openstack cli/sdk) | 19:34 |
| petertr7 | I'm using keystone using container acls, not account level | 19:34 |
| petertr7 | Ahh I see. I'm trying to replicate it now, but I swear I kept getting warnings when I used python-swiftclient | 19:35 |
| petertr7 | saying it's being deprecated in favour of openstackcli | 19:35 |
| notmyname | yeah, it makes sense. if swiftclient does a PUT to the container "just in case" then someone with write access to the container (but not full access to the account) will get a failure | 19:35 |
| *** hrou has quit IRC | 19:36 | |
| notmyname | oh, warnings in python-swiftclient saying it will be deprectated? that doesn't sound right | 19:36 |
| petertr7 | I upgraded my swiftclient to 2.6.0 before, I think I was on 2.3.0 earlier | 19:36 |
| notmyname | yeah, 2.6.0 is the current verison | 19:37 |
| petertr7 | Ahh I see | 19:38 |
| clayg | so... the latest version *does* upload or not? | 19:38 |
| petertr7 | So if I were to submit a patch for this bug, any guidance on how to do so? | 19:38 |
| clayg | is the bug just that it makes the warning? | 19:38 |
| petertr7 | clayg, is it does work and yes it's just the warning | 19:38 |
| petertr7 | *yes it does work | 19:38 |
| notmyname | to summarize, openstack cli works. and gives a warning about python-swiftclient being deprecated. and python-swiftclient breaks and has no warning | 19:39 |
| notmyname | is that correct? | 19:39 |
| petertr7 | openstack cli works, python-swiftclient works but gives a warning | 19:40 |
| clayg | notmyname: that sounds pretty messed up - I think petertr7 sa... ^ that | 19:40 |
| petertr7 | regarding the deprecation warning, I can't remember how I go those atm | 19:41 |
| clayg | hrmm... | 19:41 |
| *** itlinux has joined #openstack-swift | 19:42 | |
| notmyname | hmmm | 19:43 |
| petertr7 | Sorry, I don't think I provided any new information. But I am happy to work on this bug | 19:44 |
| *** hezhiqiang has quit IRC | 19:44 | |
| *** lpabon has quit IRC | 19:45 | |
| notmyname | the new info is some warning with swiftclien. I'd like to know more about that | 19:46 |
| petertr7 | Okay | 19:46 |
| petertr7 | I'll try to replicate it, brb | 19:46 |
| petertr7 | I believe it was with an older version | 19:46 |
| peluse | notmyname: FYI perf tests kicked off again running liberty (candidate?) | 19:48 |
| notmyname | yay | 19:48 |
| notmyname | peluse: thanks | 19:48 |
| peluse | for sure! | 19:48 |
| *** itlinux has quit IRC | 19:48 | |
| *** vinsh has joined #openstack-swift | 19:49 | |
| *** eariasn has quit IRC | 19:55 | |
| *** zhill has joined #openstack-swift | 20:00 | |
| petertr7 | Hey notmyname, sorry for the confusion. I just tried out each python-swiftclient release for the last year and did not get the warning | 20:01 |
| notmyname | ok. thanks for checking | 20:01 |
| petertr7 | I must have imagined it | 20:02 |
| *** janonymous_ has quit IRC | 20:03 | |
| notmyname | ah, so the warning you were talking about is warning that the container couldn't be created? | 20:03 |
| notmyname | but the operation still succeeds | 20:04 |
| MooingLemur | What are the semantics for container updates if your container replica count is greater than your object replica count? Do some object servers get double duty for updates? | 20:04 |
| petertr7 | that's right, that the contained creation failed yet the upload succeed | 20:04 |
| notmyname | MooingLemur: yes | 20:04 |
| petertr7 | *container creation failed yet the upload succeeded | 20:04 |
| notmyname | petertr7: ah ok | 20:04 |
| MooingLemur | notmyname: cool, thanks | 20:04 |
| petertr7 | notmyname, thanks for your help! and thanks for finding that bug on launchpad timburke! | 20:05 |
| notmyname | petertr7: if you'd like to tackle that bug to give a better (or no) warning in that situation, I'd be happy to review it | 20:10 |
| petertr7 | notmyname, thank you! Do you have any suggestions on how to tackle it on the top of your head? | 20:11 |
| *** DericHorn-HP has joined #openstack-swift | 20:11 | |
| *** aswadr has quit IRC | 20:12 | |
| notmyname | petertr7: nothing that would be helpful ;-) | 20:12 |
| *** amoturi1 has quit IRC | 20:12 | |
| petertr7 | Alright, thanks for your help | 20:12 |
| notmyname | petertr7: mostly I'd start with "go find the error message and tell it to do something different" | 20:12 |
| notmyname | but, like I said, that's not very helpful ;-) | 20:12 |
| petertr7 | Haha okay | 20:12 |
| notmyname | "so fix this bug by removing the bug from the code. and you're done!" | 20:12 |
| *** amoturi has joined #openstack-swift | 20:13 | |
| notmyname | petertr7: have you submitted code to an openstack project before? swift or otherwise | 20:13 |
| petertr7 | Yeah. I landed a patch for the docs team once. I also attended the upstream training in vancouver | 20:13 |
| notmyname | oh, cool | 20:14 |
| notmyname | so that means you've got the basics for swiftclient, too. | 20:14 |
| petertr7 | great | 20:14 |
| notmyname | once you have a patch as a single commit locally, you'll use `git review` to submit it to the code review tool. people will look at it, and when it's good we'll merge it | 20:15 |
| petertr7 | perfect, thanks! do you guys review it on gerrit? | 20:16 |
| notmyname | yes | 20:16 |
| petertr7 | Great. It's quite a nifty tool | 20:16 |
| *** zhill has quit IRC | 20:18 | |
| *** baojg has quit IRC | 20:19 | |
| *** zhill has joined #openstack-swift | 20:20 | |
| *** hezhiqiang has joined #openstack-swift | 20:21 | |
| openstackgerrit | Victor Stinner proposed openstack/swift: py3: Replace basestring with six.string_types https://review.openstack.org/232540 | 20:21 |
| openstackgerrit | Victor Stinner proposed openstack/swift: Replace itertools.ifilter with six.moves.filter https://review.openstack.org/232539 | 20:21 |
| *** jrichli has quit IRC | 20:26 | |
| *** CR7_ has quit IRC | 20:30 | |
| *** CR7 has joined #openstack-swift | 20:30 | |
| *** trifon has quit IRC | 20:34 | |
| *** hrou has joined #openstack-swift | 20:36 | |
| clayg | I thought we alreay did that -> py3: Replace basestring with six.string_types | 20:39 |
| *** joeljwright has joined #openstack-swift | 20:41 | |
| *** ChanServ sets mode: +v joeljwright | 20:41 | |
| *** Fin1te has joined #openstack-swift | 20:41 | |
| *** cdelatte has quit IRC | 20:44 | |
| *** delattec has quit IRC | 20:44 | |
| *** dmartls1 has quit IRC | 20:48 | |
| *** willsama has joined #openstack-swift | 20:51 | |
| *** dustins has quit IRC | 20:53 | |
| *** hezhiqiang has quit IRC | 20:55 | |
| torgomatic | could be that more basestrings showed up from pending patches? | 20:58 |
| *** petertr7 is now known as petertr7_away | 21:00 | |
| *** Fin1te has quit IRC | 21:02 | |
| *** marzif has joined #openstack-swift | 21:02 | |
| *** lyrrad has quit IRC | 21:05 | |
| notmyname | mailing list message: "feedback about Swift API - especially about large objects" http://lists.openstack.org/pipermail/openstack-dev/2015-October/076652.html | 21:12 |
| *** zhill has quit IRC | 21:13 | |
| clayg | what's wrong with swift.openstack.org | 21:15 |
| clayg | notmyname: he's using DLO's :\ there's not really anything we can do. | 21:16 |
| notmyname | yeah, SLOs would be an improvement for some of his issues | 21:17 |
| notmyname | and I'm not sure how much can be changed without breaking the API | 21:17 |
| clayg | notmyname: there may be a line of questioning about "how long ago did you add support for large objects" - if SLO wasn't avaialble maybe it's understandable - if it's more recent than that - then maybe there's some deficiency in our docs that's not pushing people to the right tool for their use-case | 21:17 |
| *** amoturi has left #openstack-swift | 21:19 | |
| *** chsc has quit IRC | 21:19 | |
| clayg | notmyname: might be as simple as swapping the order on https://github.com/openstack/swift/blob/master/doc/source/overview_large_objects.rst | 21:19 |
| *** zhill has joined #openstack-swift | 21:20 | |
| notmyname | clayg: yeah, I think that would be a good idea | 21:20 |
| clayg | notmyname: wasn't acorwin complaining that SLO/DLO docs were split between a few different pages? | 21:20 |
| notmyname | clayg: especially after https://review.openstack.org/#/c/219991/ lands | 21:20 |
| notmyname | yeah, that patch fixes it | 21:20 |
| clayg | oic, it inlines - nice | 21:22 |
| notmyname | eavesdrop logs don't seem to be up to date, but I asked about swift.openstack.org in -infra | 21:27 |
| notmyname | it seems it was turned off. ie intentionally deleted | 21:27 |
| clayg | did anyone play around with implementing the CRC continuation thing? like if you have the CRC's of the segments you can compute what the running CRC of the entire entity would be (so we could write it down with the manifest row in the continer) | 21:28 |
| *** hezhiqiang has joined #openstack-swift | 21:28 | |
| clayg | i'm sorta thinking the CRC only allows continuation from an initial vector - so there may not really be a way to "combine" a set of CRC's - but maybe some other checksum algorithm would have that property - maybe there's just too many layers of compression in there to make the checksum include all of the continuation context :\ | 21:30 |
| *** zhill has quit IRC | 21:32 | |
| *** zhill has joined #openstack-swift | 21:32 | |
| *** hrou has quit IRC | 21:38 | |
| ahale | in the large objects docs, its not really clear when skimming that there is a whole new section for SLO, the header text is the same size as the DLO api bit above, maybe that doesnt help | 21:39 |
| notmyname | ahale: yeah. I think clayg's idea of swapping the order is a really good one | 21:42 |
| ahale | yeah it is | 21:42 |
| *** zhill has quit IRC | 21:44 | |
| *** diogogmt has quit IRC | 21:46 | |
| *** nadeem has quit IRC | 21:50 | |
| clayg | what are these flippin' Phd's doing - why don't we have this already? it's not just remote storage... like if I want the md5 of a 3TB dataset I'm going to want to get more than a single reader/stream involved | 21:50 |
| *** DericHorn-HP has quit IRC | 21:52 | |
| clayg | fucking HDFS get's it -> https://issues.apache.org/jira/browse/HADOOP-3981 | 21:52 |
| *** mac_ified has joined #openstack-swift | 21:54 | |
| clayg | slry? https://github.com/rdsr/hdfs-checksum | 21:54 |
| clayg | sigh | 21:54 |
| *** willsama has quit IRC | 22:01 | |
| *** thumpba has quit IRC | 22:02 | |
| *** hezhiqiang has quit IRC | 22:06 | |
| *** thumpba has joined #openstack-swift | 22:14 | |
| *** thumpba has quit IRC | 22:17 | |
| *** thumpba has joined #openstack-swift | 22:17 | |
| *** thumpba has quit IRC | 22:19 | |
| *** thumpba has joined #openstack-swift | 22:19 | |
| *** thumpba has quit IRC | 22:20 | |
| *** joeljwright has quit IRC | 22:21 | |
| *** thumpba has joined #openstack-swift | 22:22 | |
| *** vinsh has quit IRC | 22:23 | |
| *** lcurtis has quit IRC | 22:23 | |
| *** vinsh has joined #openstack-swift | 22:26 | |
| *** alejandrito has quit IRC | 22:34 | |
| *** hezhiqiang has joined #openstack-swift | 22:39 | |
| *** DericHorn-HP has joined #openstack-swift | 22:44 | |
| *** thumpba has quit IRC | 22:45 | |
| *** vinsh has quit IRC | 22:48 | |
| *** marzif has quit IRC | 22:51 | |
| openstackgerrit | Pete Zaitcev proposed openstack/swift: Interpolate the explanation string not whole HTML body https://review.openstack.org/233300 | 22:51 |
| clayg | whoa! zaitcev doing swift work!? | 23:06 |
| clayg | yeah, nm, i have no idea what that patch is for ;) | 23:08 |
| peluse | I love this: "The only reason this exists is that I promised to do it." | 23:14 |
| *** hezhiqiang has quit IRC | 23:14 | |
| *** minwoob has quit IRC | 23:38 | |
| *** proteusguy__ has quit IRC | 23:39 | |
| *** hezhiqiang has joined #openstack-swift | 23:46 | |
| *** proteusguy__ has joined #openstack-swift | 23:52 | |
| *** hrou has joined #openstack-swift | 23:54 | |
| *** garthb has quit IRC | 23:58 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
