| *** Edward-Zhang has joined #openstack-swift | 00:12 | |
| *** matsuhashi has quit IRC | 00:13 | |
| *** zhiyan_ is now known as zhiyan | 00:16 | |
| *** Edward-Zhang has quit IRC | 00:17 | |
| *** dmorita has joined #openstack-swift | 00:37 | |
| *** nosnos has joined #openstack-swift | 01:09 | |
| *** Edward-Zhang has joined #openstack-swift | 01:52 | |
| *** nsquare has quit IRC | 02:14 | |
| clayg | torgomatic: I would *not* have imagined that the container_stat_view change would have required to force the container_sync and metadata migrations before creating the view - how did you catch that!? | 02:20 |
|---|---|---|
| torgomatic | clayg: many failing test runs :) | 02:21 |
| clayg | torgomatic: I geuss I see that without them old code is going to try and alter table on the view and blow up | 02:21 |
| torgomatic | yeah, you call CREATE VIEW and it's like "wtf is metadata?" | 02:21 |
| clayg | torgomatic: oh yeah the schema migration tests probably exercised all of those code paths... | 02:21 |
| clayg | oh oh oh.... that makes more sense | 02:22 |
| torgomatic | the TestContainerBroker class without the old schemas was passing all tests in like... an hour of work? | 02:22 |
| torgomatic | the rest of the time went into figuring out the migrations | 02:22 |
| clayg | probably didn't even take you that long you emacs rockstar | 02:22 |
| torgomatic | it's all just keyboard macros anyway | 02:24 |
| *** shakamunyi has quit IRC | 02:31 | |
| clayg | torgomatic: dude, you must have not had the latest checkout - i'm getting conflicts on code that's been in since at least friday | 02:35 |
| clayg | torgomatic: maybe even longer... | 02:35 |
| clayg | torgomatic: when you append the CONTAINER_STAT_VIEW_SCRIPT script to the create_container_info_table script - why do %s""" % SCRIPT instead of just """ + SCRIPT? | 02:43 |
| torgomatic | clayg: absolutely no reason; just how it turned out | 02:48 |
| *** zhiyan is now known as zhiyan_ | 02:50 | |
| creiht | portante: https://pypi.python.org/pypi/ijson/ | 02:54 |
| *** mattoliverau has quit IRC | 02:56 | |
| *** zhiyan_ is now known as zhiyan | 03:03 | |
| portante | creiht: that looks pretty nice, thanks, great for iterating over large json documents | 03:05 |
| creiht | cool | 03:05 |
| *** nosnos has quit IRC | 03:20 | |
| *** mattoliverau has joined #openstack-swift | 03:28 | |
| *** Edward-Zhang has quit IRC | 03:47 | |
| portante | https://github.com/giampaolo/pysendfile | 03:50 |
| portante | torgomatic, redbo, creiht, zaitcev, clayg: ^ | 03:50 |
| *** Midnightmyth has joined #openstack-swift | 03:50 | |
| *** fifieldt is now known as fifieldt-afk | 03:53 | |
| *** nosnos has joined #openstack-swift | 04:00 | |
| *** nsquare has joined #openstack-swift | 04:01 | |
| *** nsquare has quit IRC | 04:02 | |
| *** nsquare has joined #openstack-swift | 04:03 | |
| *** Midnightmyth has quit IRC | 04:04 | |
| *** Edward-Zhang has joined #openstack-swift | 04:15 | |
| *** kenhui has joined #openstack-swift | 04:20 | |
| *** psharma has joined #openstack-swift | 04:32 | |
| *** ppai has joined #openstack-swift | 04:33 | |
| *** ozialien has quit IRC | 04:36 | |
| *** zhiyan is now known as zhiyan_ | 05:01 | |
| *** kashyapk has joined #openstack-swift | 05:01 | |
| openstackgerrit | A change was merged to openstack/swift: Add --quoted option to swift-temp-url https://review.openstack.org/91938 | 05:10 |
| *** kashyapk has quit IRC | 05:11 | |
| *** kashyapk has joined #openstack-swift | 05:12 | |
| *** kashyapk has quit IRC | 05:16 | |
| openstackgerrit | Christian Berendt proposed a change to openstack/python-swiftclient: replace string format arguments with function parameters https://review.openstack.org/94241 | 05:17 |
| *** haomaiwang has joined #openstack-swift | 05:17 | |
| *** JoshNang has quit IRC | 05:19 | |
| *** haomaiwang has quit IRC | 05:31 | |
| *** haomaiwang has joined #openstack-swift | 05:32 | |
| *** kashyapk has joined #openstack-swift | 05:37 | |
| *** kashyapk has quit IRC | 05:37 | |
| *** kashyapk has joined #openstack-swift | 05:38 | |
| *** kashyapk has quit IRC | 06:02 | |
| *** kashyapk has joined #openstack-swift | 06:02 | |
| *** kashyapk has quit IRC | 06:10 | |
| *** kashyapk has joined #openstack-swift | 06:10 | |
| *** kenhui has quit IRC | 06:17 | |
| *** ppai has quit IRC | 06:56 | |
| *** nshaikh has joined #openstack-swift | 07:03 | |
| *** gyee has quit IRC | 07:10 | |
| *** ppai has joined #openstack-swift | 07:14 | |
| *** kashyapk has quit IRC | 07:15 | |
| *** haomaiw__ has joined #openstack-swift | 07:15 | |
| *** kashyapk has joined #openstack-swift | 07:15 | |
| *** haomaiwang has quit IRC | 07:18 | |
| *** ppai has quit IRC | 07:19 | |
| *** kashyapk has quit IRC | 07:20 | |
| *** JoshNang has joined #openstack-swift | 07:26 | |
| *** ppai has joined #openstack-swift | 07:33 | |
| *** nacim has quit IRC | 07:43 | |
| *** nacim has joined #openstack-swift | 07:43 | |
| *** kashyapk has joined #openstack-swift | 08:08 | |
| *** ppai has quit IRC | 08:11 | |
| *** fbo_away is now known as fbo | 08:25 | |
| *** ppai has joined #openstack-swift | 08:28 | |
| *** ppai has quit IRC | 08:32 | |
| *** kashyapk has quit IRC | 08:39 | |
| *** kashyapk has joined #openstack-swift | 08:42 | |
| *** pconstantine__ has joined #openstack-swift | 08:46 | |
| *** kashyapk has quit IRC | 08:53 | |
| *** kashyapk has joined #openstack-swift | 08:57 | |
| *** kashyapk has quit IRC | 09:00 | |
| *** kashyapk has joined #openstack-swift | 09:01 | |
| *** kashyapk has quit IRC | 09:14 | |
| *** kashyapk has joined #openstack-swift | 09:14 | |
| *** kashyapk has quit IRC | 09:18 | |
| *** mlipchuk has joined #openstack-swift | 09:24 | |
| *** nshaikh has quit IRC | 09:28 | |
| *** Edward-Zhang has quit IRC | 09:40 | |
| *** kashyapk has joined #openstack-swift | 09:44 | |
| *** kashyapk_ has joined #openstack-swift | 10:00 | |
| *** kashyapk has quit IRC | 10:04 | |
| openstackgerrit | Brian Cline proposed a change to openstack/swift: Updates the prehistoric multi-node install guide. https://review.openstack.org/97445 | 10:07 |
| *** samuelmz has quit IRC | 10:07 | |
| *** samuelmz has joined #openstack-swift | 10:09 | |
| *** NM1 has joined #openstack-swift | 10:23 | |
| *** Longgeek_ has joined #openstack-swift | 10:27 | |
| *** nsquare has quit IRC | 10:27 | |
| *** Edward-Zhang has joined #openstack-swift | 10:51 | |
| *** mkollaro has joined #openstack-swift | 11:09 | |
| *** MooingLemur has quit IRC | 11:10 | |
| *** mkollaro has quit IRC | 11:10 | |
| *** mkollaro has joined #openstack-swift | 11:11 | |
| *** MooingLemur has joined #openstack-swift | 11:12 | |
| *** nshaikh has joined #openstack-swift | 11:12 | |
| *** dmorita has quit IRC | 11:21 | |
| *** kashyapk_ has quit IRC | 11:26 | |
| *** marcusvrn has joined #openstack-swift | 11:32 | |
| *** NM1 has quit IRC | 11:34 | |
| *** matsuhashi has joined #openstack-swift | 11:34 | |
| *** nacim has quit IRC | 11:36 | |
| *** miqui has quit IRC | 11:38 | |
| *** diegows has joined #openstack-swift | 11:39 | |
| *** nacim has joined #openstack-swift | 11:46 | |
| *** kashyapk has joined #openstack-swift | 12:00 | |
| *** kashyapk has quit IRC | 12:02 | |
| *** mkollaro has quit IRC | 12:02 | |
| *** kashyapk has joined #openstack-swift | 12:02 | |
| *** mkollaro has joined #openstack-swift | 12:03 | |
| *** jamie_h has joined #openstack-swift | 12:04 | |
| *** CaioBrentano has joined #openstack-swift | 12:15 | |
| *** CaioBrentano has left #openstack-swift | 12:19 | |
| *** zhiyan_ is now known as zhiyan | 12:21 | |
| *** sagar_ has joined #openstack-swift | 12:24 | |
| *** psharma has quit IRC | 12:30 | |
| sagar_ | Hello, is there a way to request an object to a particular proxy node from the swift-client? | 12:30 |
| *** spredzy_ has left #openstack-swift | 12:31 | |
| *** zhiyan is now known as zhiyan_ | 12:31 | |
| *** Edward-Zhang has quit IRC | 12:39 | |
| *** mkollaro has quit IRC | 12:41 | |
| *** mkollaro1 has joined #openstack-swift | 12:41 | |
| *** bvandenh has joined #openstack-swift | 12:47 | |
| *** Longgeek_ has quit IRC | 12:48 | |
| *** sagar_ has quit IRC | 12:49 | |
| *** tdasilva has joined #openstack-swift | 12:51 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 12:51 |
| *** mlipchuk has quit IRC | 12:52 | |
| *** kashyapk has quit IRC | 12:56 | |
| *** kashyapk has joined #openstack-swift | 12:57 | |
| *** kashyapk_ has joined #openstack-swift | 13:00 | |
| *** kashyapk has quit IRC | 13:00 | |
| *** nacim has quit IRC | 13:02 | |
| *** miqui has joined #openstack-swift | 13:04 | |
| *** kashyapk_ has quit IRC | 13:04 | |
| *** kashyapk has joined #openstack-swift | 13:05 | |
| *** openstackgerrit has quit IRC | 13:06 | |
| *** openstackgerrit has joined #openstack-swift | 13:06 | |
| *** kashyapk has quit IRC | 13:09 | |
| *** matsuhashi has quit IRC | 13:12 | |
| *** nosnos has quit IRC | 13:12 | |
| *** nacim has joined #openstack-swift | 13:27 | |
| *** kashyapk has joined #openstack-swift | 13:27 | |
| *** kashyapk has quit IRC | 13:27 | |
| *** kashyapk has joined #openstack-swift | 13:28 | |
| *** kashyapk has quit IRC | 13:32 | |
| *** NM has joined #openstack-swift | 13:42 | |
| *** shakamunyi has joined #openstack-swift | 13:51 | |
| *** foexle has joined #openstack-swift | 13:58 | |
| *** tdasilva has quit IRC | 14:03 | |
| *** CaioBrentano1 has joined #openstack-swift | 14:06 | |
| *** kashyapk has joined #openstack-swift | 14:13 | |
| *** haomaiw__ has quit IRC | 14:23 | |
| *** haomaiwang has joined #openstack-swift | 14:23 | |
| *** kashyapk has quit IRC | 14:25 | |
| *** kashyapk has joined #openstack-swift | 14:25 | |
| *** haomai___ has joined #openstack-swift | 14:39 | |
| *** haomaiwang has quit IRC | 14:41 | |
| *** kashyapk has quit IRC | 14:41 | |
| *** occupant has quit IRC | 14:47 | |
| *** wasmum has joined #openstack-swift | 14:58 | |
| wasmum | anyone, playing with swift3 and keystone. admitting I have no idea what the format or credentials i need to supply to use a connection, say unsecure cyberduck | 14:59 |
| wasmum | SAIO, downloaded the unsercure s3 profile for cyberduck | 15:00 |
| wasmum | swift3 and s3token configured and added to pipeline | 15:00 |
| wasmum | so, now I need to test. Using the existing creds on the cluster I usedcurl to get an suth token | 15:01 |
| wasmum | then i used that user:tenant as my user for s3 and the auth token as my key | 15:01 |
| wasmum | am i doing that correct? | 15:01 |
| wasmum | sorry about the spelling there, dang! | 15:02 |
| zaitcev | I only got it working once and forgot completely how I did it. | 15:04 |
| wasmum | HA! | 15:04 |
| wasmum | priceless | 15:04 |
| creiht | hehe | 15:04 |
| zaitcev | I recall that the client must allow semicolon in user name | 15:05 |
| zaitcev | Not every S3 client does. | 15:05 |
| creiht | wasmum: you have to use your password as your key | 15:06 |
| *** byeager has joined #openstack-swift | 15:07 | |
| *** fin1te has joined #openstack-swift | 15:11 | |
| *** kashyapk has joined #openstack-swift | 15:12 | |
| *** fin1te has quit IRC | 15:15 | |
| *** pberis has joined #openstack-swift | 15:16 | |
| *** kashyapk has quit IRC | 15:16 | |
| *** fin1te has joined #openstack-swift | 15:17 | |
| *** fin1te has quit IRC | 15:18 | |
| *** fifieldt has joined #openstack-swift | 15:27 | |
| *** wasmum_ has joined #openstack-swift | 15:31 | |
| *** wasmum_ has left #openstack-swift | 15:32 | |
| *** wasmum_ has joined #openstack-swift | 15:32 | |
| *** wasmum_ has left #openstack-swift | 15:32 | |
| *** wasmum_ has joined #openstack-swift | 15:33 | |
| wasmum_ | damn you irc bouncer. | 15:33 |
| *** wasmum has quit IRC | 15:33 | |
| *** wasmum_ is now known as wasmum | 15:33 | |
| zaitcev | It sure bounced you good. | 15:34 |
| wasmum | HA | 15:34 |
| *** gyee has joined #openstack-swift | 15:34 | |
| wasmum | why oh why can't we all just use irc..... | 15:34 |
| wasmum | dang I hate hacking to get work done | 15:34 |
| wasmum | k now that I got a vmc bouncer account up, back to the swift3, ks, creds | 15:37 |
| creiht | wasmum: did you see my comment that you have to use your password as your key? | 15:38 |
| wasmum | tried the user/pass combo in the insecure cyberduck profile | 15:38 |
| wasmum | yes sir, thanks | 15:38 |
| creiht | cool | 15:38 |
| wasmum | I am going to retry that again for sanity now | 15:38 |
| wasmum | SAIO, non ssl with ks vanilla - using user/pass (same creeds sourced and used for python swift client) 2014-06-03 10:39:12.950 1896 WARNING keystone.common.wsgi [-] Could not find credential, 8c6976e5b5410415bde908bd4dee15dfb167a9c873fc4bb8a81f6f2ab448a918. | 15:40 |
| creiht | wasmum: I would try to get it working with tempauth first (as that is usually a bit easier) | 15:41 |
| wasmum | creiht: can do | 15:42 |
| creiht | and once you have that verified add keystone in | 15:42 |
| *** bvandenh has quit IRC | 15:43 | |
| *** tdasilva has joined #openstack-swift | 15:43 | |
| *** JelleB is now known as a1|away | 15:46 | |
| *** fifieldt has quit IRC | 15:53 | |
| wasmum | creiht: using tempauth, do I use account:user returned Auth token or account:user/pass? | 15:57 |
| creiht | you will use account:user for the user and pass for the key | 15:58 |
| wasmum | thanks sir. | 15:58 |
| creiht | wasmum: https://github.com/stackforge/swift3/blob/master/swift3/middleware.py#L45 | 15:59 |
| creiht | there is an example of using the python boto library | 16:00 |
| creiht | if that helps | 16:00 |
| wasmum | dang - using fujita. | 16:00 |
| *** haomai___ has quit IRC | 16:00 | |
| wasmum | lemme clone this repo and try | 16:01 |
| wasmum | thanks creiht | 16:01 |
| creiht | ahh yeah they moved over to that recently | 16:02 |
| wasmum | cool, i'll pound on this fora while. thanks. | 16:04 |
| *** occupant has joined #openstack-swift | 16:07 | |
| *** byeager has quit IRC | 16:08 | |
| *** byeager has joined #openstack-swift | 16:09 | |
| *** haomaiwa_ has joined #openstack-swift | 16:10 | |
| wasmum | creiht: the docs on the README.md for the [filter:s3token] should the paste.filter_factory syntax be keystone.middleware.s3_token:filter_factory or keystoneclient.middleware.s3_token:filter_factory | 16:12 |
| *** sandywalsh has quit IRC | 16:12 | |
| *** mkollaro1 has quit IRC | 16:13 | |
| *** byeager_ has joined #openstack-swift | 16:13 | |
| *** byeager has quit IRC | 16:13 | |
| creiht | wasmum: it has been a while since I have messed with it, but my guess is that it should be from keystoneclient | 16:13 |
| wasmum | thanks | 16:13 |
| zaitcev | in fact keystone one will blow up in case of error because it uses something in webob which we no longer have | 16:14 |
| zaitcev | also everything it sends to LOG disappears | 16:14 |
| *** sandywalsh has joined #openstack-swift | 16:15 | |
| zaitcev | I ended debugging all that by adding fp=open("/tmp/dump","a"); fp.write("foo");fp.close() all over. | 16:16 |
| *** nshaikh has left #openstack-swift | 16:20 | |
| *** haomaiwa_ has quit IRC | 16:24 | |
| *** haomaiwang has joined #openstack-swift | 16:33 | |
| *** _bluev has joined #openstack-swift | 16:39 | |
| notmyname | zaitcev: do you know about q? | 16:43 |
| *** haomaiw__ has joined #openstack-swift | 16:44 | |
| notmyname | zaitcev: https://pypi.python.org/pypi/q | 16:45 |
| wasmum | creiht: tempauth a ok. forgot to pull s3token out of the pipeline, but when i did all is good. now to get s3token and ks working with swift3 | 16:45 |
| *** haomaiwang has quit IRC | 16:45 | |
| notmyname | zaitcev: it lets you use "q.q(foo)" and makes it really easy to do printf debugging | 16:45 |
| wasmum | that'll wait till after lunch. thanks for the help | 16:45 |
| *** CaioBrentano1 has quit IRC | 16:49 | |
| creiht | wasmum: cool | 16:50 |
| zaitcev | notmyname: You told me to use q before and I wrote it for future reference but every time I have to decide to let pip touch my sytem it becomes "naah, too dangerous, I'll just open-code it today in mv /usr/lib/python2*foo.py /usr/lib/python2*foo.py.fcs && cp /usr/lib/python2*foo.py.fcs /usr/lib/python2*foo.py" | 16:51 |
| zaitcev | notmyname: on second thought, forget what I just wrote becaue http://koji.fedoraproject.org/koji/packageinfo?packageID=15752 | 16:55 |
| *** shri has joined #openstack-swift | 16:56 | |
| *** haomaiw__ has quit IRC | 16:58 | |
| *** CaioBrentano has joined #openstack-swift | 17:01 | |
| *** fbo is now known as fbo_away | 17:02 | |
| acoles | dfg: are you happy for me to push a keystoneauth patch onto https://review.openstack.org/#/c/92165 to get the func tests passing? | 17:08 |
| openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Make quarantine and tmp dirs in DiskFile Storage Policy Aware https://review.openstack.org/96313 | 17:13 |
| dfg | acoles: ya sure- i didn't realize they were failing | 17:19 |
| dfg | acoles: i can do it. it just got lost with all the storage policy reviews i guess | 17:19 |
| *** shakamunyi has quit IRC | 17:24 | |
| *** CaioBrentano1 has joined #openstack-swift | 17:34 | |
| *** CaioBrentano has quit IRC | 17:35 | |
| *** CaioBrentano1 has quit IRC | 17:40 | |
| dfg | acoles: i'm just going have the make_subrequest copy over the whole env and make_pre_auth use the specific keys. | 17:41 |
| *** nsquare has joined #openstack-swift | 17:50 | |
| creiht | notmyname: https://review.openstack.org/#/c/96039/7/test/probe/test_container_merge_policy_index.py | 17:50 |
| *** CaioBrentano has joined #openstack-swift | 17:53 | |
| *** _bluev has quit IRC | 17:57 | |
| acoles | dfg: i guess they're failing cos devstack uses the pipeline from proxy-server.conf-sample | 17:57 |
| *** gyee_ has joined #openstack-swift | 17:58 | |
| acoles | dfg: i was discussing with clayg and torgomatic here and we came up with http://paste.openstack.org/show/82652/ | 17:59 |
| acoles | dfg: but what you said should cope with any other auth middleware so i'll back off :) | 18:00 |
| dfg | acoles: ok | 18:13 |
| *** shakamunyi has joined #openstack-swift | 18:20 | |
| *** byeager_ has quit IRC | 18:23 | |
| clayg | dfg: you can't copy range headers (sam says so) | 18:23 |
| *** byeager has joined #openstack-swift | 18:23 | |
| *** shakamunyi has quit IRC | 18:24 | |
| dfg | clayg: i'll just look up the commit when sam had it copy the env (before me and gholt talked him out of it) and do what he did | 18:25 |
| *** shakamunyi has joined #openstack-swift | 18:25 | |
| *** byeager_ has joined #openstack-swift | 18:26 | |
| dfg | clayg: unless you'd rather me just do what acoles pasted. which I'd almost rather just do than mess with this... | 18:26 |
| *** byeager has quit IRC | 18:27 | |
| *** byeager_ has quit IRC | 18:31 | |
| *** wasmum is now known as zz_wasmum | 18:32 | |
| *** byeager has joined #openstack-swift | 18:32 | |
| *** Trixboxer has joined #openstack-swift | 18:32 | |
| *** judd7 has joined #openstack-swift | 18:39 | |
| *** byeager has quit IRC | 18:39 | |
| *** byeager_ has joined #openstack-swift | 18:39 | |
| *** swat30 has quit IRC | 18:44 | |
| *** swat30 has joined #openstack-swift | 18:46 | |
| *** byeager_ has quit IRC | 18:53 | |
| *** byeager has joined #openstack-swift | 18:53 | |
| *** judd7 has quit IRC | 18:54 | |
| *** byeager has quit IRC | 18:58 | |
| *** physcx has quit IRC | 18:59 | |
| *** CaioBrentano has quit IRC | 18:59 | |
| *** CaioBrentano has joined #openstack-swift | 19:03 | |
| *** NM has quit IRC | 19:03 | |
| *** CaioBrentano has quit IRC | 19:04 | |
| *** CaioBrentano has joined #openstack-swift | 19:10 | |
| *** tdasilva has quit IRC | 19:12 | |
| *** byeager has joined #openstack-swift | 19:13 | |
| *** NM has joined #openstack-swift | 19:13 | |
| *** gyee_ has quit IRC | 19:14 | |
| *** shakamunyi has quit IRC | 19:21 | |
| *** shakamunyi has joined #openstack-swift | 19:24 | |
| *** byeager has quit IRC | 19:43 | |
| *** byeager has joined #openstack-swift | 19:44 | |
| *** byeager_ has joined #openstack-swift | 19:45 | |
| *** byeager has quit IRC | 19:46 | |
| *** shakamunyi has quit IRC | 20:14 | |
| *** shakamunyi has joined #openstack-swift | 20:15 | |
| *** sandywalsh has quit IRC | 20:18 | |
| *** byeager_ has quit IRC | 20:19 | |
| *** byeager has joined #openstack-swift | 20:19 | |
| *** sandywalsh has joined #openstack-swift | 20:21 | |
| openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Small cleanup to ring serialization https://review.openstack.org/97615 | 20:21 |
| *** byeager has quit IRC | 20:24 | |
| *** mlipchuk has joined #openstack-swift | 20:29 | |
| *** CaioBrentano has quit IRC | 20:33 | |
| *** mlipchuk has quit IRC | 20:34 | |
| *** miqui has quit IRC | 20:34 | |
| *** miqui has joined #openstack-swift | 20:36 | |
| *** miqui has quit IRC | 20:38 | |
| *** byeager has joined #openstack-swift | 20:41 | |
| *** byeager has quit IRC | 20:42 | |
| *** byeager has joined #openstack-swift | 20:43 | |
| *** Trixboxer has quit IRC | 20:47 | |
| *** CaioBrentano has joined #openstack-swift | 20:50 | |
| *** byeager_ has joined #openstack-swift | 20:51 | |
| *** CaioBrentano has quit IRC | 20:55 | |
| *** byeager has quit IRC | 20:55 | |
| *** NM has quit IRC | 21:03 | |
| *** NM has joined #openstack-swift | 21:07 | |
| *** mlipchuk has joined #openstack-swift | 21:07 | |
| *** NM has quit IRC | 21:10 | |
| *** mlipchuk has quit IRC | 21:13 | |
| *** tdasilva has joined #openstack-swift | 21:14 | |
| *** zonkrat has joined #openstack-swift | 21:15 | |
| *** NM has joined #openstack-swift | 21:15 | |
| zonkrat | Hi there swift folks. Anybody have any idea why the curl command shown below would fail to return the bytes requested when a range is specified? | 21:17 |
| zonkrat | curl -X GET -i -H "X-Auth-Token: 833495f56c8642e29178f29b0a0f8d3a" -r 10-2000 | 21:17 |
| *** CaioBrentano has joined #openstack-swift | 21:17 | |
| notmyname | zonkrat: tell me more about the object you are requesting. can you paste the response of a head request for that object? | 21:17 |
| zonkrat | It always ends up pulling down the entire object which in this case is quite large.... +300MB | 21:17 |
| zonkrat | notmyname: OK | 21:18 |
| notmyname | zonkrat: or better yet, paste the response of `curl -I -H "X-Auth-Token: 833495f56c8642e29178f29b0a0f8d3a" -r 10-2000 <your object here>` | 21:18 |
| zonkrat | notmyname: Here it comes.... | 21:20 |
| zonkrat | HTTP/1.1 200 OK Content-Length: 0 Accept-Ranges: bytes X-Object-Manifest: data_Analysis_3003/parts/e55f4c24-9a19-438a-90f7-9a726c368ddb Last-Modified: Thu, 29 May 2014 11:51:42 GMT Etag: d41d8cd98f00b204e9800998ecf8427e X-Timestamp: 1401364302.25994 X-Object-Meta-Pin: e55f4c24-9a19-438a-90f7-9a726c368ddb Content-Type: application/octet-stream Date: Tue, 03 Jun 2014 21:19:32 GMT | 21:20 |
| zonkrat | notmyname: sorry about the direct paste..... | 21:21 |
| notmyname | zonkrat: FWIW, paste.openstack.org would be bette r:-) | 21:21 |
| notmyname | zonkrat: ah! it's a manifest file | 21:21 |
| zonkrat | notmyname: Understood.... couldn't resist temporary urge.... | 21:21 |
| zaitcev | so, ranges with manifested obj are busted? | 21:21 |
| notmyname | :-) | 21:21 |
| notmyname | well they shouldn't be. at least with a single range (it's known that multi-range requests don't yet work for manifests) | 21:22 |
| zonkrat | zaitcev: could be..... this is swift 1.10.0-2 RDO Havana | 21:22 |
| notmyname | zonkrat: ah. that was my next question: what version of swift | 21:22 |
| zaitcev | yeah... Still, I thought ranges were fixed by then | 21:23 |
| notmyname | ya, me too. | 21:23 |
| zonkrat | notmyname: We're runnign a base software release Opoenstack Grizzly with JUST swift code upgraded so we can get byte range GETs to work. | 21:23 |
| notmyname | https://bugs.launchpad.net/swift/+bug/1237023 says it was in 1.10.0 | 21:24 |
| notmyname | zonkrat: what do you mean by "just swift code upgraded"? what version of swift are you running | 21:24 |
| torgomatic | DLO with more than $CONTAINER_LISTING_LIMIT segments? | 21:24 |
| torgomatic | that'll not support range requests | 21:25 |
| *** foexle has quit IRC | 21:25 | |
| *** jamie_h has quit IRC | 21:25 | |
| zonkrat | notmyname: The output I pasted earlier was from swift 1.10.0-2 RDO running within an Openstack grizzly environment...... | 21:25 |
| *** shakamunyi has quit IRC | 21:26 | |
| *** byeager_ has quit IRC | 21:26 | |
| zaitcev | RDO doesn't do anything bad to swift, IIRC. It's essentially stock 1.10.0. | 21:26 |
| *** byeager has joined #openstack-swift | 21:26 | |
| zonkrat | notmyname: so only the openstack-swift-* RDO rpm packages were upgraded to the "Havana" release of swift. All the all openstack packages (i.e. nova, glance, keystone) are grizzly. | 21:27 |
| zaitcev | All RDO does is "remove dependency on pbr", "fix sphinx 1.1", "support parallel install for EL6". We can consider your 1.10.0 equivalent to mainstream. | 21:27 |
| notmyname | zonkrat: oh ok | 21:27 |
| zaitcev | I just verified | 21:28 |
| notmyname | zonkrat: let me see if I can duplicate that | 21:28 |
| *** tdasilva has quit IRC | 21:28 | |
| zonkrat | zaitcev: Understood.... | 21:29 |
| zonkrat | notmyname: thanks for checking. This is a LARGE object. Could that be causing this? | 21:29 |
| *** byeager has quit IRC | 21:31 | |
| notmyname | zonkrat: sortof | 21:32 |
| notmyname | zonkrat: I confirmed that it works for me with a dynamic large object that has only 2 segments | 21:32 |
| notmyname | zonkrat: so I suspect your issue is what torgomatic said. you have more than 10000 segments in the dynamic large object | 21:33 |
| notmyname | where 10000 is the default container listing limit | 21:33 |
| torgomatic | "for your local value of 10000" :) | 21:34 |
| zonkrat | notmyname: Hmmmmm..... Should ranges on manifests also work in swift RDO 1.8.0-2? Any way to increases default container listing limit? | 21:34 |
| notmyname | zonkrat: actually, a better solution would probably be to use static large objects instead of dynamic large objects | 21:35 |
| zonkrat | notmyname: torgomatic: zaitcev: Any swift config parameters that will address this? | 21:35 |
| notmyname | zonkrat: yes, you can increase the limit. /me is trying to remember when that was moved from a static constant to a config parameter | 21:36 |
| notmyname | zonkrat: ah yes. that was changed in sept of 2012. so you should be able to change it in your /etc/swift/swift.conf file | 21:37 |
| zonkrat | notmyname: Thanks. If the param is available and you can find out what it is, that may save us :) | 21:38 |
| *** byeager has joined #openstack-swift | 21:38 | |
| zonkrat | notmyname: And the actual config parameter name in /etc/swift/swift.conf? | 21:39 |
| notmyname | zonkrat: the sample config file is very well commented https://github.com/openstack/swift/blob/master/etc/swift.conf-sample | 21:39 |
| notmyname | zonkrat: see container_listing_limit in that file | 21:39 |
| zaitcev | that's modern one | 21:39 |
| zonkrat | notmyname: Thanks. Forgot about the sample templates.......will check now....... thank you all!!! | 21:39 |
| zaitcev | he needs Havana | 21:39 |
| zaitcev | It's still in /usr/share/doc/openstack-swift* somewhere in RDO though | 21:40 |
| notmyname | zonkrat: as zaitcev mentioned, that's the newest one. but it hasn't changed in a while. safest is to look at the sample that was included with your distro | 21:40 |
| notmyname | zaitcev: FWIW, git blame says it hasn't changed much | 21:40 |
| zaitcev | oh, good then | 21:41 |
| zonkrat | notmyname: zaitcev: Will check local docs in RDO disto. Thanks again.... | 21:41 |
| *** CaioBrentano has quit IRC | 21:46 | |
| *** CaioBrentano has joined #openstack-swift | 21:53 | |
| *** miqui has joined #openstack-swift | 21:54 | |
| *** NM has quit IRC | 21:54 | |
| openstackgerrit | Peter Portante proposed a change to openstack/swift: replaced e.message with a bare "e" object ref https://review.openstack.org/93570 | 21:55 |
| *** byeager has quit IRC | 21:58 | |
| *** byeager has joined #openstack-swift | 21:58 | |
| *** byeager has quit IRC | 22:03 | |
| *** byeager has joined #openstack-swift | 22:08 | |
| mattoliverau | Morning all | 22:17 |
| *** zaitcev is now known as zaitcev_afk | 22:19 | |
| *** marcusvrn has quit IRC | 22:21 | |
| *** byeager has quit IRC | 22:28 | |
| *** byeager has joined #openstack-swift | 22:29 | |
| *** byeager has quit IRC | 22:34 | |
| *** byeager has joined #openstack-swift | 22:39 | |
| *** erlon has quit IRC | 22:39 | |
| *** zonkrat has quit IRC | 22:57 | |
| *** CaioBrentano has quit IRC | 22:59 | |
| *** byeager has quit IRC | 23:17 | |
| *** zhiyan_ is now known as zhiyan | 23:17 | |
| *** byeager has joined #openstack-swift | 23:17 | |
| *** zhiyan is now known as zhiyan_ | 23:18 | |
| *** EmilienM_ has joined #openstack-swift | 23:20 | |
| *** mhu1 has joined #openstack-swift | 23:20 | |
| *** mhu has quit IRC | 23:20 | |
| *** mhu1 is now known as mhu | 23:20 | |
| *** EmilienM has quit IRC | 23:20 | |
| *** EmilienM_ is now known as EmilienM | 23:20 | |
| *** byeager has quit IRC | 23:21 | |
| *** spredzy has joined #openstack-swift | 23:23 | |
| *** diegows has quit IRC | 23:47 | |
| *** pconstantine__ has quit IRC | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!