| *** aswadr has joined #openstack-swift | 00:10 | |
| *** tkay has quit IRC | 00:13 | |
| *** kyles_ne has joined #openstack-swift | 00:16 | |
| *** kyles_ne has quit IRC | 00:17 | |
| *** gyee is now known as zuul | 00:18 | |
| *** zuul is now known as gyee | 00:18 | |
| *** dmorita has joined #openstack-swift | 00:29 | |
| *** yuan has joined #openstack-swift | 00:33 | |
| *** shri has quit IRC | 00:51 | |
| *** gyee has quit IRC | 00:55 | |
| *** dabbler has joined #openstack-swift | 01:04 | |
| *** IgnacioCorderi has quit IRC | 01:04 | |
| dabbler | hello people.. I am a noob at swift.. | 01:04 |
|---|---|---|
| *** mwstorer has quit IRC | 01:05 | |
| dabbler | we are writing a library that uses curl commands to upload segmented objects to swift.. | 01:05 |
| dabbler | is there a way to track the progress | 01:05 |
| dabbler | of upload.. | 01:05 |
| *** echevemaster has quit IRC | 01:06 | |
| dabbler | I have seen this https://bugs.launchpad.net/python-swiftclient/+bug/1231509 but that does seem to be appropriate for what we would want.. | 01:07 |
| dabbler | *does not | 01:10 |
| openstackgerrit | A change was merged to openstack/swift: Too many if clauses in the _clean_incoming_headers and the _clean_outgoing_headers routines of the tempurl module https://review.openstack.org/119782 | 01:18 |
| *** thurloat has quit IRC | 01:23 | |
| zaitcev | If you use _curl commands_, then this question hardly has anything to do with swift. You just need to use curl's progress counter or -# for progress bar. If you want a summary, then your master script could do something like counting the segments. | 01:27 |
| openstackgerrit | Matthew Oliver proposed a change to openstack/swift: Treat 404s as 204 on object delete in proxy https://review.openstack.org/114120 | 01:27 |
| zaitcev | But I have a feeling that I do not understand what the difficulty is here. | 01:27 |
| *** kota_ has joined #openstack-swift | 01:32 | |
| *** cpen has quit IRC | 01:32 | |
| *** dmsimard_away is now known as dmsimard | 01:33 | |
| *** zaitcev has quit IRC | 01:34 | |
| dabbler | @zaitcev the upload job is kicked off and some other routines/jobs are invoked and the upload job continues in the background.. | 01:34 |
| dabbler | is there a way to get query the object storage and get the amt of bytes copied? | 01:35 |
| dabbler | I can get the total container bytes from the manifest (if it is written before assembly of chunks) but that would be contentious if two or more objects are being written to the same container | 01:36 |
| *** dmsimard is now known as dmsimard_away | 01:39 | |
| *** thurloat has joined #openstack-swift | 01:42 | |
| *** kota_ has quit IRC | 01:44 | |
| *** IgnacioCorderi has joined #openstack-swift | 01:46 | |
| *** rmcall has quit IRC | 01:47 | |
| *** mattoliverau has quit IRC | 01:49 | |
| *** mattoliverau has joined #openstack-swift | 01:50 | |
| openstackgerrit | Matthew Oliver proposed a change to openstack/swift: Treat 404s as 204 on object delete in proxy https://review.openstack.org/114120 | 01:53 |
| *** nosnos has joined #openstack-swift | 01:54 | |
| *** IgnacioCorderi has quit IRC | 01:55 | |
| *** fifieldt_ is now known as fifieldt | 02:03 | |
| *** haomaiw__ has quit IRC | 02:14 | |
| *** haomaiwang has joined #openstack-swift | 02:15 | |
| *** NM has joined #openstack-swift | 02:19 | |
| *** NM has quit IRC | 02:29 | |
| *** haomaiwang has quit IRC | 02:30 | |
| *** haomaiw__ has joined #openstack-swift | 02:30 | |
| *** haomaiwa_ has joined #openstack-swift | 02:35 | |
| *** haomaiwa_ has quit IRC | 02:35 | |
| *** haomaiw__ has quit IRC | 02:36 | |
| *** haomaiwang has joined #openstack-swift | 02:36 | |
| *** NM has joined #openstack-swift | 02:37 | |
| *** haomai___ has joined #openstack-swift | 02:42 | |
| *** dabbler has quit IRC | 02:42 | |
| *** NM has quit IRC | 02:43 | |
| *** haomaiwang has quit IRC | 02:45 | |
| *** dabbler has joined #openstack-swift | 03:07 | |
| *** IgnacioCorderi has joined #openstack-swift | 03:11 | |
| *** IgnacioCorderi has quit IRC | 03:14 | |
| *** judd7 has quit IRC | 03:15 | |
| *** dabbler has left #openstack-swift | 03:28 | |
| *** haomai___ has quit IRC | 03:35 | |
| *** haomaiwang has joined #openstack-swift | 03:35 | |
| *** haomaiw__ has joined #openstack-swift | 03:47 | |
| *** haomaiwang has quit IRC | 03:50 | |
| *** ppai has joined #openstack-swift | 04:27 | |
| notmyname | I just reread over http://www.hds.com/assets/pdf/distributed-object-store-principles-of-operation.pdf. Such a great overview of object storage | 04:30 |
| *** rmcall has joined #openstack-swift | 04:31 | |
| *** IgnacioCorderi has joined #openstack-swift | 04:36 | |
| *** IgnacioCorderi has quit IRC | 04:40 | |
| *** mahatic has quit IRC | 05:19 | |
| *** Yorkfly has quit IRC | 05:19 | |
| mattoliverau | I'll add it to my reading list then :) | 05:20 |
| notmyname | mattoliverau: that paper is more than 4 years old, but still is a fantastic description of challenges and principles of distributed object storage | 05:39 |
| mattoliverau | notmyname: more background is always useful :) Now no more procrastinating and go to bed :P | 05:41 |
| notmyname | heh. I'm looking over some reporter's questions about file vs object storage trying to come up with both correct but succinct answers | 05:42 |
| *** Anju has joined #openstack-swift | 05:45 | |
| *** k4n0 has joined #openstack-swift | 05:45 | |
| *** nshaikh has joined #openstack-swift | 05:45 | |
| *** kopparam has joined #openstack-swift | 06:00 | |
| *** kopparam has quit IRC | 06:00 | |
| *** kopparam has joined #openstack-swift | 06:01 | |
| *** kopparam has quit IRC | 06:06 | |
| *** kopparam has joined #openstack-swift | 06:09 | |
| *** bkopilov has quit IRC | 06:14 | |
| *** bkopilov has joined #openstack-swift | 06:15 | |
| *** bkopilov_wfh has joined #openstack-swift | 06:15 | |
| *** gius has joined #openstack-swift | 06:34 | |
| *** Anju has quit IRC | 06:37 | |
| *** IgnacioCorderi has joined #openstack-swift | 06:37 | |
| *** bkopilov has joined #openstack-swift | 06:38 | |
| gius | acoles: Hi! Are you there? | 06:44 |
| *** rmcall has quit IRC | 06:45 | |
| *** gius has left #openstack-swift | 06:46 | |
| *** pino has joined #openstack-swift | 06:47 | |
| *** AnjuT has joined #openstack-swift | 06:51 | |
| pino | Dear all, Alice and Bob are two users of the same tenant (called TENANT). I would like that each of them see only the Container that she/he will create. How can I do it? | 06:51 |
| pino | I know that it is necessary to use the headers X-Container-Read and X-Container-Write, but I don't know how to use these headers. | 06:53 |
| pino | In other words, what is the cURL command should I use? | 06:54 |
| *** AnjuT has quit IRC | 06:58 | |
| *** k4n0 has quit IRC | 07:07 | |
| mattoliverau | k, I'm calling it a night, see you all on the morrow. | 07:11 |
| notmyname | mattoliverau: you're not allowed to call it a night before me! ;-) | 07:19 |
| *** k4n0 has joined #openstack-swift | 07:21 | |
| mattoliverau | notmyname: You still up! | 07:22 |
| notmyname | :-) | 07:22 |
| notmyname | this isn't good for the 7:30 phone call I have tomorrow morning | 07:22 |
| notmyname | but on the other hand, I think this has been a pretty productive evening | 07:22 |
| *** geaaru has joined #openstack-swift | 07:22 | |
| mattoliverau | Lol that's good.. Tho if we have a grumpy tired ptl tomorrow we'll know why :p | 07:23 |
| mattoliverau | I'm taking my parents out for dinner (its 530pm, so the stereotype of early dinners for oldies is universal) :p | 07:25 |
| openstackgerrit | Christian Schwede proposed a change to openstack/swift: Fix Keystone middleware example in the docs https://review.openstack.org/120327 | 07:26 |
| *** IgnacioCorderi has quit IRC | 07:27 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 07:32 |
| *** vr1 has joined #openstack-swift | 07:34 | |
| *** bvandenh has joined #openstack-swift | 07:57 | |
| openstackgerrit | Lin Yang proposed a change to openstack/swift: Remove unnecessary comma https://review.openstack.org/120337 | 08:15 |
| *** vr1 has quit IRC | 08:24 | |
| *** vr1 has joined #openstack-swift | 08:25 | |
| *** vr2 has joined #openstack-swift | 08:54 | |
| *** vr1 has quit IRC | 08:54 | |
| *** pino has quit IRC | 08:59 | |
| *** nosnos has quit IRC | 09:41 | |
| *** nosnos has joined #openstack-swift | 09:42 | |
| *** aix has quit IRC | 09:47 | |
| *** nosnos has quit IRC | 09:47 | |
| *** mahatic has joined #openstack-swift | 09:54 | |
| *** vr2 has quit IRC | 09:55 | |
| *** vr1 has joined #openstack-swift | 09:55 | |
| *** fbo has joined #openstack-swift | 09:56 | |
| *** bvandenh has quit IRC | 10:07 | |
| *** aix has joined #openstack-swift | 10:21 | |
| *** mkollaro has joined #openstack-swift | 10:24 | |
| *** homegrown has joined #openstack-swift | 10:29 | |
| *** haomaiw__ has quit IRC | 10:34 | |
| *** 18VAAWTEG has joined #openstack-swift | 10:34 | |
| *** NM has joined #openstack-swift | 10:35 | |
| *** NM has quit IRC | 10:37 | |
| *** kopparam has quit IRC | 10:40 | |
| *** kopparam has joined #openstack-swift | 10:40 | |
| *** pino has joined #openstack-swift | 10:41 | |
| *** 18VAAWTEG has quit IRC | 10:53 | |
| *** haomaiwang has joined #openstack-swift | 10:53 | |
| *** bvandenh has joined #openstack-swift | 10:58 | |
| *** miqui has quit IRC | 11:00 | |
| *** dmorita has quit IRC | 11:00 | |
| *** mahatic has quit IRC | 11:04 | |
| *** Manifesto has quit IRC | 11:05 | |
| *** ppai has quit IRC | 11:05 | |
| *** mahatic has joined #openstack-swift | 11:06 | |
| *** jamiehannaford has joined #openstack-swift | 11:17 | |
| *** ppai has joined #openstack-swift | 11:19 | |
| *** anticw has quit IRC | 11:31 | |
| *** dmsimard_away is now known as dmsimard | 11:32 | |
| *** Manifesto has joined #openstack-swift | 11:32 | |
| *** Manifesto has quit IRC | 11:35 | |
| *** ekarlso- has quit IRC | 11:37 | |
| *** ekarlso- has joined #openstack-swift | 11:37 | |
| *** kopparam has quit IRC | 11:39 | |
| *** kopparam has joined #openstack-swift | 11:40 | |
| *** kopparam has quit IRC | 11:44 | |
| *** mahatic has quit IRC | 11:47 | |
| *** marcusvrn has joined #openstack-swift | 11:53 | |
| *** mahatic has joined #openstack-swift | 12:03 | |
| *** vr1 has quit IRC | 12:04 | |
| *** vr1 has joined #openstack-swift | 12:04 | |
| pino | Dear all. I have a tenant (CONCEPT) with three users named "orch","user1","user2". Only user "orch" has an operator_roles in the proxy-server.conf. I would like that "user1" and "user2" can create own container and thyy can only read a specific container created by "orch". Is it possible? | 12:08 |
| pino | *they | 12:08 |
| pino | I rewrite in a better fashion: I have a tenant (CONCEPT) with three users named "orch","user1","user2". Only user "orch" has an operator_roles in the proxy-server.conf. | 12:10 |
| pino | I would like that "user1" and "user2" can create/read own container and they can only read a specific container created by "orch". Is it possible? | 12:10 |
| *** kopparam has joined #openstack-swift | 12:10 | |
| *** kopparam has quit IRC | 12:17 | |
| *** anticw has joined #openstack-swift | 12:20 | |
| acoles | pino: assuming you are using keystone auth, only a user with an operator_role can create a container. | 12:22 |
| acoles | so in your example only orch can create containers. | 12:22 |
| acoles | orch can grant read access to a specific container to other users using X-Container-Read header | 12:23 |
| *** miqui has joined #openstack-swift | 12:29 | |
| pino | acoles: I am using Keystone | 12:30 |
| pino | So, I suppose that if "user1" and "user2" have operator_role, they can read and write all the Containers into the Account | 12:31 |
| acoles | pino: yes | 12:34 |
| pino | Well. In this scenario can "orch" restrict the access to own Container? I would like that "user1" and "user2" can only read a specific container created by "orch" | 12:37 |
| *** tab_ has joined #openstack-swift | 12:38 | |
| acoles | pino: if user1 and user2 do NOT have operator_role on tenant, then orch can create container c1 and c2, and give read access for c1 to user1, and read access to c2 to user2. | 12:40 |
| acoles | pino: orch can always read c1 and c2. is that what you would like to achieve? | 12:40 |
| pino | acoles: I would like that "user1" and "user2" can create/read own container and they can only read a specific container created by "orch". | 12:41 |
| pino | So, I think that the scenario I would achive is impossible | 12:42 |
| acoles | pino: I don't think that is possible - is user1 is able to create a container then user1 must have operator_role and therefore can read any container. | 12:45 |
| acoles | for non operator_role users the access control list can only grant read or write access to objects. | 12:46 |
| acoles | s/is user1/if user1/ | 12:46 |
| *** nshaikh has quit IRC | 12:55 | |
| *** aix has quit IRC | 13:02 | |
| *** aix has joined #openstack-swift | 13:04 | |
| pino | acoles: Thank you very much! | 13:08 |
| *** ppai has quit IRC | 13:09 | |
| *** tdasilva has joined #openstack-swift | 13:09 | |
| *** NM has joined #openstack-swift | 13:11 | |
| *** kopparam has joined #openstack-swift | 13:13 | |
| *** kopparam has quit IRC | 13:17 | |
| *** Trixboxer has joined #openstack-swift | 13:39 | |
| openstackgerrit | Alistair Coles proposed a change to openstack/swift: Add description option to policy config https://review.openstack.org/120424 | 13:55 |
| acoles | notmyname: ^^ i'm not sure about the max length limit - there is no max length for a policy name | 13:56 |
| *** kopparam has joined #openstack-swift | 13:57 | |
| *** zaitcev has joined #openstack-swift | 14:05 | |
| *** ChanServ sets mode: +v zaitcev | 14:05 | |
| *** judd7 has joined #openstack-swift | 14:11 | |
| *** achhabr has joined #openstack-swift | 14:17 | |
| notmyname | good morning | 14:17 |
| notmyname | acoles: good point. commented in gerrit | 14:17 |
| *** sandywalsh has quit IRC | 14:18 | |
| *** dabbler has joined #openstack-swift | 14:20 | |
| *** Manifesto has joined #openstack-swift | 14:40 | |
| *** pino has quit IRC | 14:42 | |
| acoles | notmyname: thx, yup it could be a lot bigger, lets see what anyone else thinks. i haven't yet thought of a similar case. | 14:42 |
| *** mahatic has quit IRC | 14:42 | |
| *** kopparam has quit IRC | 14:43 | |
| *** kopparam has joined #openstack-swift | 14:44 | |
| *** kopparam has quit IRC | 14:48 | |
| *** annegentle has joined #openstack-swift | 14:52 | |
| *** rmcall has joined #openstack-swift | 14:59 | |
| *** annegentle has quit IRC | 15:03 | |
| *** dabbler has quit IRC | 15:08 | |
| *** morganfainberg is now known as morgan | 15:12 | |
| *** morgan is now known as Morgan | 15:13 | |
| *** Morgan is now known as morgan | 15:15 | |
| *** aix has quit IRC | 15:17 | |
| *** judd7 has quit IRC | 15:18 | |
| *** judd7 has joined #openstack-swift | 15:20 | |
| *** jasondotstar has joined #openstack-swift | 15:22 | |
| *** mwstorer has joined #openstack-swift | 15:26 | |
| *** aix has joined #openstack-swift | 15:30 | |
| *** gyee has joined #openstack-swift | 15:32 | |
| *** k4n0 has quit IRC | 15:34 | |
| *** pberis has quit IRC | 15:46 | |
| *** kenhui has joined #openstack-swift | 16:04 | |
| *** mahatic has joined #openstack-swift | 16:06 | |
| *** kyles_ne has joined #openstack-swift | 16:06 | |
| *** bvandenh has quit IRC | 16:09 | |
| *** jamiehannaford has quit IRC | 16:15 | |
| notmyname | I was just told today, via the public mailing list, that there is now a deadline for python-*client releases of September 18 | 16:22 |
| notmyname | so it would seem that I'll need to tag a release at or right before then | 16:22 |
| *** vr1 has quit IRC | 16:41 | |
| zaitcev | yay | 16:45 |
| notmyname | mattoliverau: looks like fungi just started a new ML thread about resurrecting the auto-abandon bot in gerrit. subject is "[openstack-dev] [all] Bringing back auto-abandon (was: Review metrics - what do we want to measure?)" | 16:46 |
| *** rmcall has quit IRC | 16:48 | |
| *** mkollaro has quit IRC | 16:49 | |
| *** tkay has joined #openstack-swift | 16:50 | |
| *** rmcall has joined #openstack-swift | 16:50 | |
| *** kenhui has quit IRC | 16:53 | |
| *** kenhui has joined #openstack-swift | 16:54 | |
| *** rmcall has quit IRC | 16:56 | |
| *** rmcall has joined #openstack-swift | 16:57 | |
| *** aix has quit IRC | 16:58 | |
| *** echevemaster has joined #openstack-swift | 17:07 | |
| *** Manifesto has quit IRC | 17:13 | |
| notmyname | so I think this is pretty cool. you can now sign up for an unlimited 45-day free trial of swiftstack. so like the vagrant-swift-all-in-one is a great way to easily get started with a dev environment, the swiftstack trial is an easy way to get started with a real deployment | 17:18 |
| *** rmcall has quit IRC | 17:18 | |
| notmyname | I know it's kinda weird to talk about a company's product in here, so apologies if you find that in bad taste | 17:19 |
| *** rmcall has joined #openstack-swift | 17:20 | |
| *** mahatic has quit IRC | 17:24 | |
| *** mahatic has joined #openstack-swift | 17:29 | |
| Trixboxer | Hi, what can be the reason of | 17:39 |
| Trixboxer | GET /v1/AUTH_77443a36-22ed-473b-a0bd-053afdddbc25?format=json HTTP/1.1 - HTTP/1.1 200 OK | 17:39 |
| Trixboxer | GET /v1/AUTH_77443a36-22ed-473b-a0bd-053afdddbc25?format=xml HTTP/1.1 - HTTP/1.1 403 Forbidden | 17:39 |
| *** mahatic has quit IRC | 17:46 | |
| *** mahatic has joined #openstack-swift | 17:51 | |
| zaitcev | Trixboxer: nothing obvious comes to mind. Try json again, in case account was deleted. | 17:53 |
| Trixboxer | surprisingly after updating the client software it works :( | 17:54 |
| Trixboxer | GET /v1/AUTH_77443a36-22ed-473b-a0bd-053afdddbc25?format=xml HTTP/1.1 - HTTP/1.1 200 OK | 17:54 |
| Trixboxer | the account stood same and no changes to swift | 17:54 |
| portante | are you sure you have all the memcached configurations the same across all proxy nodes? | 17:57 |
| *** gordc has joined #openstack-swift | 17:57 | |
| portante | Trixboxer: ^ | 17:57 |
| gordc | just curious but did something change with how swift handles 'set log_level' in middleware filters? | 17:57 |
| Trixboxer | portante: yes | 17:58 |
| notmyname | gordc: not that I'm aware | 17:58 |
| gordc | notmyname: hmm... ok i'll dig into it... for some reason it seems like it's displaying ceilometer logs in swift again. | 17:58 |
| *** rmcall has quit IRC | 17:59 | |
| *** rmcall has joined #openstack-swift | 18:01 | |
| notmyname | Trixboxer: downgrading to recreate the error, then eg doing a tcpdump to see what's actually getting sent to swift could be useful in tracking it down | 18:01 |
| Trixboxer | aah difficult :( | 18:02 |
| *** kyles_ne has quit IRC | 18:02 | |
| *** dabbler has joined #openstack-swift | 18:04 | |
| *** IgnacioCorderi has joined #openstack-swift | 18:05 | |
| notmyname | Trixboxer: what client is it? | 18:05 |
| *** dabbler has quit IRC | 18:05 | |
| *** IgnacioCorderi has quit IRC | 18:06 | |
| *** geaaru has quit IRC | 18:07 | |
| Trixboxer | notmyname: cloudberry | 18:13 |
| notmyname | reminder that there is a swift team meeting in about 45 minutes https://wiki.openstack.org/wiki/Meetings/Swift | 18:13 |
| notmyname | Trixboxer: ah. not one that I have to do any local tests with | 18:13 |
| notmyname | Trixboxer: so far, it would seem that the ?format=xml request in the older version of cloudberry wasn't doing what you expected. that's why I suggested looking at what it was actually sending on the wire | 18:14 |
| notmyname | Trixboxer: alternatively, downgrade cloudberry and ensure that it still breaks and that you can successfully do ?format=xml with a different client (eg curl). then you pretty much know that the issue must be in the client | 18:15 |
| notmyname | Trixboxer: or you can use the new version of cloudberry that works and not worry about bugs in the old version anymore :-) | 18:16 |
| Trixboxer | :-) | 18:16 |
| Trixboxer | new version is good | 18:16 |
| *** morgan is now known as morganfainberg | 18:23 | |
| *** morganfainberg is now known as morgan | 18:24 | |
| *** kyles_ne has joined #openstack-swift | 18:37 | |
| *** cutforth has joined #openstack-swift | 18:44 | |
| *** gvernik has joined #openstack-swift | 18:47 | |
| *** kota_ has joined #openstack-swift | 18:56 | |
| *** gordc has left #openstack-swift | 18:57 | |
| *** thurloat has quit IRC | 18:58 | |
| notmyname | meeting time in #openstack-meeting | 18:59 |
| *** rmcall has quit IRC | 18:59 | |
| zaitcev | http://www.theregister.co.uk/2014/08/26/seagates_eight_terabyte_spinner/ -- might we know someone other than Clover who tests these ^_^ | 19:00 |
| *** mjseger has joined #openstack-swift | 19:03 | |
| *** mjseger has quit IRC | 19:05 | |
| *** thurloat has joined #openstack-swift | 19:06 | |
| openstackgerrit | Doug Hellmann proposed a change to openstack/swift-specs: Add RSS feed https://review.openstack.org/120544 | 19:15 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/swift-specs: Remove templates from toctrees https://review.openstack.org/120545 | 19:15 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/swift-specs: Use the current date for the copyright statement https://review.openstack.org/120546 | 19:15 |
| *** kenhui1 has joined #openstack-swift | 19:16 | |
| *** kenhui has quit IRC | 19:18 | |
| *** DisneyRicky has quit IRC | 19:19 | |
| *** DisneyRicky has joined #openstack-swift | 19:21 | |
| TaiSHi | This might sound stupid, but is there any way to mount a swift container as a filesystem? | 19:23 |
| TaiSHi | (I mean, to access it as a fs) | 19:24 |
| tdasilva | TaiSHi: take a look at this project: https://github.com/swiftonfile/swiftonfile, it might help you... | 19:25 |
| notmyname | that's not mounting swift as a filesystem :-) | 19:25 |
| torgomatic | TaiSHi: there's also some swift fuse filesystem thing out there somewhere | 19:26 |
| TaiSHi | Yeah I found cloudfuse | 19:26 |
| notmyname | TaiSHi: but natively in swift, no | 19:26 |
| *** AnjuT has joined #openstack-swift | 19:26 | |
| TaiSHi | Just wanted a more professional opinion :P | 19:26 |
| TaiSHi | Because the client wont modify the entire application just yet | 19:27 |
| tdasilva | correct, swiftonfile is not for mounting swift as a filesystem, but depending on what you are trying to achieve, it could help... | 19:29 |
| TaiSHi | Well currently the app works under nginx+php and access the files on disk | 19:29 |
| TaiSHi | I know nginx can access files directly from swift, but php cant, that aside, the application will try to write uploaded files on disk | 19:30 |
| *** echevemaster has quit IRC | 19:30 | |
| TaiSHi | Perhaps I didn't choose my weapon wisely | 19:32 |
| notmyname | dfg: swifterdarrell | 19:38 |
| *** rmcall has joined #openstack-swift | 19:43 | |
| *** kota_ has quit IRC | 19:45 | |
| *** gvernik has quit IRC | 19:45 | |
| mattoliverau | Yay, back to bed, be back in a few hours. | 19:48 |
| TaiSHi | I'm sad, I was convinced that swift was my holy grial :P | 19:48 |
| *** ZBhatti has joined #openstack-swift | 19:48 | |
| *** cutforth has quit IRC | 19:49 | |
| notmyname | TaiSHi: I was just about to get started on that cook_me_breakfast middleware | 19:50 |
| TaiSHi | notmyname, interestingly enough, we don't cook our breakfast here :P | 19:51 |
| notmyname | TaiSHi: yet again, swift let's you down ;-) | 19:51 |
| notmyname | s/'// | 19:51 |
| TaiSHi | I might be missing some joke due to language barrier | 19:52 |
| TaiSHi | So I'll just sob and laugh at the same time | 19:52 |
| notmyname | lol | 19:52 |
| TaiSHi | cloudfuse is not stable enough I think | 19:52 |
| *** aswadr has quit IRC | 19:53 | |
| notmyname | TaiSHi: in all seriousness, I'm a pretty big believer in the right tool for the job. and that you don't want one tool to do everything for you. | 19:53 |
| TaiSHi | I agree with you | 19:53 |
| *** infotection has quit IRC | 19:53 | |
| TaiSHi | But I didn't see (or didn't want to see) that Swift, even if great at its job, wont do me no good since I can't update the entire app to work with it | 19:54 |
| TaiSHi | Meh, I was even watching videos to understand how node failure was handled | 19:54 |
| notmyname | TaiSHi: yes, I agree with you. that is a big barrier to entry for existing apps. there are thins like cloudfuse, and there are also some commercial gateways that do what you want (disclosure: my employer sells one) | 19:56 |
| TaiSHi | The app isn't big enough (translation: my client is a cheap bastard) to buy a commercial solution | 19:57 |
| TaiSHi | I'm a bit scared of cloudfuse, also it's limited to 10k files in some dirs | 19:57 |
| notmyname | but it is big enough to take advantage of swift's distributed storage and scaling facilities? | 19:58 |
| notmyname | I think the cloudfuse limit comes from the fact that the first page of results on a listing in swift (eg a container listing to show what objects are in it) is by default limited to 10000 items | 19:58 |
| TaiSHi | heh, I admit I might be overkilling it... | 19:58 |
| TaiSHi | Currently 286552 files in the web's folder | 19:59 |
| TaiSHi | (that's just the main site) | 19:59 |
| *** akshya11235 has joined #openstack-swift | 20:00 | |
| akshya11235 | Hi All, I want to run benchmarking on swift single node setup. Has anyone tried it before with COSbench? | 20:01 |
| TaiSHi | Also, I'm prisoner of how the site is coded, it pretty much works as a wordpress (a big bad wordpress) | 20:01 |
| notmyname | akshya11235: oh. you're asking in every channel :-) | 20:02 |
| akshya11235 | no jus the swift and the openstack channel. sometimes people are in different IRC :) | 20:02 |
| *** infotection has joined #openstack-swift | 20:02 | |
| notmyname | akshya11235: and -101 ;-) | 20:02 |
| notmyname | akshya11235: no worries | 20:03 |
| notmyname | TaiSHi: so maybe the first thing to do it look at similar things that you can do with wordpress. eg take all the media files and recreate a swift URL for them. but of course if you can't write a wordpress-style pluging or do any coding updates at all, then you're going to be hard-pressed | 20:03 |
| notmyname | akshya11235: yea, cosbench is built by the intel folks, so they've run it a lot. do you have specific questions about it? | 20:04 |
| TaiSHi | notmyname, that's the issue, the app hits on a PHP file to process images (even though I cache them after to reduce load) | 20:04 |
| TaiSHi | Yes, perhaps the app itself could hit the swift proxy to retrieve the image and do whatever it does with it. I might check with the coder | 20:05 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/swift-specs: Use the current date for the copyright statement https://review.openstack.org/120546 | 20:06 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/swift-specs: Remove templates from toctrees https://review.openstack.org/120545 | 20:06 |
| openstackgerrit | Doug Hellmann proposed a change to openstack/swift-specs: Add RSS feed https://review.openstack.org/120544 | 20:06 |
| AnjuT | notmyname : a question Hope I am not disturbing you :) | 20:07 |
| TaiSHi | notmyname, actually, it might be possible to reuse current app... it's all scrambled in my head | 20:08 |
| goodes | what is the current state of EC - can we just check out the branch in install/test it - or are there other libraries that need to be installed? | 20:08 |
| torgomatic | goodes: well, if you check out the branch, you'll have to write the remaining 90% of the code, and then it'll work for you | 20:09 |
| torgomatic | oh right... ":)" | 20:09 |
| goodes | sorry, I'm only qualified to write 20% that has 80% of the functionality | 20:10 |
| torgomatic | more seriously, it's under active development, and isn't feature-complete yet | 20:11 |
| torgomatic | or even close, really | 20:11 |
| torgomatic | there's pending patches for stuff, but what's on feature/ec isn't ready for use | 20:11 |
| goodes | so, pre-alpha? | 20:11 |
| notmyname | goodes: sure, if you want a name for it :-) | 20:11 |
| goodes | context was - is it worth checking out to play with to learn more, or is it too soon? | 20:12 |
| notmyname | goodes: too soon to use, but not too soon to get involved in the development of it :-) | 20:12 |
| goodes | I hear you | 20:12 |
| goodes | if that will be the focus of the hackathon and then I'll start preping now | 20:13 |
| *** annegentle has joined #openstack-swift | 20:13 | |
| *** akshya11235 has quit IRC | 20:14 | |
| goodes | how will the dependency on external EC libs be resolved - will they be wrapped in python packages or installed as system libraries? | 20:15 |
| torgomatic | goodes: pyeclib is a python wrapper for one or two underlying C libraries, and that's what we're using | 20:16 |
| mahatic | torgomatic, Regarding the document patch, if in real deployments, someone chooses to use UUID, then what does the ring use? | 20:19 |
| goodes | I'm just finishing a project so I will dive in early next week. Is it all contained in the EC branch or are there any external dependencies (such as pyeclib)? | 20:19 |
| torgomatic | mahatic: the ring contains mount points; if the device in the ring is XYZ, then the filesystem in question is mounted at /srv/node/XYZ | 20:20 |
| torgomatic | it's easier for humans if that mount point matches the UUID or label, but it's not a technical requirement | 20:21 |
| notmyname | goodes: the external stuff is pretty much settled AFAIK in pyeclib. the remaining work is inside of swift. look at the bottom of the priority reviews page (link in topic) for the EC project tracking stuff | 20:21 |
| torgomatic | goodes: just pyeclib + feature/ec branch, IIRC... also the transitive dependencies of pyeclib if you really want to get into it | 20:21 |
| goodes | notmyname: torgomatic: thanks - I'll try a quick install tomorrow :-) | 20:24 |
| mahatic | torgomatic, okay | 20:24 |
| *** akshya11235 has joined #openstack-swift | 20:27 | |
| *** ZBhatti has quit IRC | 20:28 | |
| akshya11235 | I was trying to run the COSbench on SAIO. Had 2 Hypervisors, 1 had the SAIO VM and other was runing the COSbench | 20:29 |
| *** ZBhatti has joined #openstack-swift | 20:29 | |
| akshya11235 | the install and benchmarking process itslef are fine | 20:29 |
| akshya11235 | but I am getting a super low ops per second. and they max out pretty fast at ~250 ops per sec | 20:29 |
| notmyname | akshya11235: on a SAIO I'm not surprised | 20:30 |
| akshya11235 | Is there some limitation of SAIO i m overlooking? or something like missing the caching of objects? | 20:30 |
| notmyname | akshya11235: the SAIO runs 4 of each storage node to simulate a cluster. and if you also have more than one worker process, well, it adds upquickly | 20:31 |
| notmyname | akshya11235: and then you get to the fact that if you're using loopback, all SAIO processes are sharing the same storage media (ie IO bus). | 20:31 |
| notmyname | akshya11235: all that means this: wow, I'm impressed you got 250 ops/sec on a SAIO! | 20:31 |
| akshya11235 | notmyname: I see. would it make any difference with a separate partition for all the storage nodes? | 20:32 |
| TaiSHi | separate disk ^ | 20:33 |
| akshya11235 | I understand that having a separate disk would definitely have an improvement | 20:33 |
| akshya11235 | Just wanted to know if it was tried before and people were seeing something similar | 20:34 |
| akshya11235 | becuase for the swift saio VM , i cranked up the vcpus it had and the Ram | 20:34 |
| notmyname | yeah, but you're still using the same physical resources | 20:37 |
| *** kenhui1 has quit IRC | 20:39 | |
| *** zacksh has quit IRC | 20:40 | |
| *** zacksh has joined #openstack-swift | 20:41 | |
| akshya11235 | hmm | 20:52 |
| akshya11235 | well thats true | 20:52 |
| akshya11235 | the resource is still the same | 20:52 |
| akshya11235 | everything gets stuck on the harddrive | 20:52 |
| akshya11235 | so here to increase performace I will need separate storage nodes | 20:53 |
| TaiSHi | ^ | 20:53 |
| notmyname | akshya11235: yeah, pretty much | 20:54 |
| notmyname | akshya11235: but that's actually swift's design: scale out by adding servers or drives. and since it's a modular system you can add more where you need it | 20:54 |
| AnjuT | notmyname: can I handle the RSEP body in swift client | 20:55 |
| notmyname | AnjuT: I'm not sure what you mean | 20:55 |
| TaiSHi | notmyname, I'm seriously considering cloudfuse but I'm scared :P | 20:56 |
| notmyname | TaiSHi: not sure how I can help you with that :-) | 20:56 |
| TaiSHi | read that some people maxed the IO (due to cloudfuse storing in tmp) | 20:56 |
| TaiSHi | I should actually stop being a whiny little girl and test it in production | 20:57 |
| notmyname | lol | 20:57 |
| notmyname | and on that note... | 20:57 |
| torgomatic | I love the name "FUSE". It's like... stuff's on fire, might explode soon, but go ahead and put your data in it | 20:57 |
| notmyname | I've got to drive to a meeting, so I'll be offline for the rest of the day. | 20:57 |
| notmyname | good luck! | 20:58 |
| AnjuT | notmyname: when I am listing containers using --limit and --prefix ..I am getting an extra output of RESP Body in limit | 20:58 |
| AnjuT | notmyname: ohh okk | 20:58 |
| TaiSHi | notmyname, If I'm not here tomorrow, erhm, well, maybe I ran to colombia | 20:59 |
| TaiSHi | torgomatic, *grin* | 20:59 |
| *** annegentle has quit IRC | 21:06 | |
| tdasilva | torgomatic: thanks for the +2 on 115995 | 21:10 |
| torgomatic | tdasilva: sure thing | 21:10 |
| *** miqui has quit IRC | 21:12 | |
| *** mahatic has quit IRC | 21:13 | |
| *** IgnacioCorderi has joined #openstack-swift | 21:17 | |
| *** AnjuT has quit IRC | 21:19 | |
| *** annegentle has joined #openstack-swift | 21:29 | |
| *** annegentle has quit IRC | 21:35 | |
| *** kyles_ne has quit IRC | 21:47 | |
| *** kyles_ne has joined #openstack-swift | 21:47 | |
| *** kyles_ne has quit IRC | 21:47 | |
| *** kyles_ne has joined #openstack-swift | 21:52 | |
| *** akshya11235 has quit IRC | 22:08 | |
| *** IgnacioCorderi has quit IRC | 22:10 | |
| *** NM has quit IRC | 22:14 | |
| *** dmsimard is now known as dmsimard_away | 22:20 | |
| *** IgnacioCorderi has joined #openstack-swift | 22:23 | |
| *** morgan is now known as morganfainberg | 22:27 | |
| mattoliverau | Morning | 22:31 |
| *** Trixboxer has quit IRC | 22:31 | |
| *** ZBhatti has quit IRC | 22:35 | |
| *** NM has joined #openstack-swift | 22:51 | |
| *** NM has left #openstack-swift | 22:52 | |
| *** achhabr has quit IRC | 22:58 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 23:09 |
| *** echevemaster has joined #openstack-swift | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!