| *** jergerber has quit IRC | 00:17 | |
| *** matsuhashi has joined #openstack-swift | 00:20 | |
| *** shri has left #openstack-swift | 00:41 | |
| *** tusharg has left #openstack-swift | 00:46 | |
| *** tusharg has joined #openstack-swift | 00:46 | |
| *** nosnos has joined #openstack-swift | 00:51 | |
| *** nosnos_ has joined #openstack-swift | 00:53 | |
| *** nosnos has quit IRC | 00:57 | |
| *** d89 has joined #openstack-swift | 01:06 | |
| *** mkollaro has quit IRC | 01:14 | |
| *** csd has quit IRC | 01:18 | |
| *** bada has quit IRC | 01:25 | |
| *** bada has joined #openstack-swift | 01:26 | |
| *** tusharg is now known as tgohad | 02:11 | |
| *** shakamunyi has joined #openstack-swift | 02:28 | |
| *** chandan_kumar has joined #openstack-swift | 02:37 | |
| *** gyee has quit IRC | 02:59 | |
| *** matsuhashi has quit IRC | 03:13 | |
| *** zanc_ has quit IRC | 03:16 | |
| *** changbl has joined #openstack-swift | 03:17 | |
| *** matsuhashi has joined #openstack-swift | 03:20 | |
| *** matsuhashi has quit IRC | 03:25 | |
| *** nosnos_ has quit IRC | 03:41 | |
| *** chandan_kumar has quit IRC | 03:41 | |
| openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add containeralias middleware https://review.openstack.org/62494 | 03:41 |
|---|---|---|
| clayg | why do i have to re-brew install everything after that stupid mac ssl upgrade thing | 04:18 |
| swifterdarrell | clayg: gah! wat wat? | 04:18 |
| swifterdarrell | clayg: i think i'm all ssl'ed up but didn't have to re-brew-install anything? | 04:19 |
| h6w | Sounds interesting... | 04:20 |
| *** matsuhashi has joined #openstack-swift | 04:23 | |
| *** h6w has quit IRC | 04:33 | |
| *** nosnos has joined #openstack-swift | 04:35 | |
| *** h6w has joined #openstack-swift | 04:38 | |
| madhuri_ | clayg: there? | 05:03 |
| *** nshaikh has joined #openstack-swift | 05:24 | |
| *** zaitcev has quit IRC | 05:30 | |
| *** psharma has joined #openstack-swift | 05:58 | |
| *** saju_m has joined #openstack-swift | 05:58 | |
| *** matsuhashi has quit IRC | 05:59 | |
| *** matsuhashi has joined #openstack-swift | 06:01 | |
| *** h6w has left #openstack-swift | 06:05 | |
| *** matsuhashi has quit IRC | 06:47 | |
| *** matsuhashi has joined #openstack-swift | 06:50 | |
| *** bada has quit IRC | 07:25 | |
| *** bada has joined #openstack-swift | 07:26 | |
| *** matsuhashi has quit IRC | 07:30 | |
| *** matsuhashi has joined #openstack-swift | 07:31 | |
| *** shakamunyi has quit IRC | 08:07 | |
| openstackgerrit | Christian Schwede proposed a change to openstack/swift: Add containeralias middleware https://review.openstack.org/62494 | 08:19 |
| *** jokke_ has joined #openstack-swift | 08:33 | |
| *** shakamunyi has joined #openstack-swift | 08:33 | |
| *** mlipchuk has joined #openstack-swift | 08:37 | |
| *** chandankumar_ has quit IRC | 08:37 | |
| *** shakamunyi has quit IRC | 08:38 | |
| openstackgerrit | Chmouel Boudjnah proposed a change to openstack/python-swiftclient: Fix temporary pypy gate issue with setuptools https://review.openstack.org/81479 | 08:38 |
| *** chandan_kumar has joined #openstack-swift | 08:39 | |
| *** nshaikh has quit IRC | 08:41 | |
| *** nacim has joined #openstack-swift | 08:50 | |
| *** nacim has quit IRC | 08:54 | |
| *** nacim has joined #openstack-swift | 08:55 | |
| *** tanee-away has quit IRC | 09:17 | |
| *** saschpe_ has joined #openstack-swift | 09:19 | |
| *** mmcardle has joined #openstack-swift | 09:22 | |
| *** sileht has quit IRC | 09:33 | |
| *** shakamunyi has joined #openstack-swift | 09:34 | |
| *** shakamunyi has quit IRC | 09:38 | |
| *** tanee has joined #openstack-swift | 09:41 | |
| *** akscram has quit IRC | 09:43 | |
| *** tanee is now known as tanee-away | 09:46 | |
| *** d89 has quit IRC | 09:50 | |
| *** sileht has joined #openstack-swift | 09:50 | |
| *** mmcardle has quit IRC | 09:59 | |
| *** mmcardle has joined #openstack-swift | 10:02 | |
| *** tanee-away has quit IRC | 10:03 | |
| *** jamieh has joined #openstack-swift | 10:05 | |
| *** jamieh is now known as Guest72786 | 10:05 | |
| *** d89 has joined #openstack-swift | 10:06 | |
| *** mkollaro has joined #openstack-swift | 10:19 | |
| *** tanee has joined #openstack-swift | 10:20 | |
| openstackgerrit | Christian Schwede proposed a change to openstack/python-swiftclient: Make bin/swift testable part 1 https://review.openstack.org/76487 | 10:27 |
| openstackgerrit | Christian Schwede proposed a change to openstack/python-swiftclient: Fix temporary pypy gate issue with setuptools https://review.openstack.org/81479 | 10:27 |
| *** shakamunyi has joined #openstack-swift | 10:35 | |
| *** shakamunyi has quit IRC | 10:39 | |
| openstackgerrit | A change was merged to openstack/swift: remove debugging print https://review.openstack.org/81343 | 10:49 |
| *** d89 has quit IRC | 10:52 | |
| *** bada_ has joined #openstack-swift | 10:58 | |
| *** bada has quit IRC | 11:00 | |
| *** dvas has joined #openstack-swift | 11:03 | |
| *** tdasilva has left #openstack-swift | 11:04 | |
| *** otoolee has joined #openstack-swift | 11:07 | |
| *** d89 has joined #openstack-swift | 11:09 | |
| *** dvas has quit IRC | 11:10 | |
| *** dvas has joined #openstack-swift | 11:11 | |
| *** mkollaro has quit IRC | 11:16 | |
| *** matsuhashi has quit IRC | 11:22 | |
| *** matsuhashi has joined #openstack-swift | 11:24 | |
| *** mmcardle has quit IRC | 11:26 | |
| *** shakamunyi has joined #openstack-swift | 11:36 | |
| *** matsuhashi has quit IRC | 11:37 | |
| *** akscram has joined #openstack-swift | 11:39 | |
| *** shakamunyi has quit IRC | 11:40 | |
| *** Trixboxer has joined #openstack-swift | 11:56 | |
| *** mmcardle has joined #openstack-swift | 12:00 | |
| *** mmcardle has joined #openstack-swift | 12:03 | |
| *** chandan_kumar has quit IRC | 12:23 | |
| *** piyush1 has joined #openstack-swift | 12:28 | |
| *** d89 has quit IRC | 12:32 | |
| *** shakamunyi has joined #openstack-swift | 12:36 | |
| *** shakamunyi has quit IRC | 12:41 | |
| *** mkollaro has joined #openstack-swift | 12:48 | |
| *** JuanManuelOlle has joined #openstack-swift | 12:53 | |
| *** chandan_kumar has joined #openstack-swift | 12:56 | |
| *** psharma has quit IRC | 13:03 | |
| *** mmcardle has quit IRC | 13:11 | |
| *** tdasilva has joined #openstack-swift | 13:19 | |
| *** nosnos has quit IRC | 13:24 | |
| *** piyush1 has quit IRC | 13:32 | |
| *** shakamunyi has joined #openstack-swift | 13:37 | |
| *** shakamunyi has quit IRC | 13:41 | |
| *** Guest72786 is now known as jamie_h | 13:44 | |
| *** saschpe__ has joined #openstack-swift | 13:49 | |
| *** bsdkurt has quit IRC | 13:52 | |
| *** bsdkurt has joined #openstack-swift | 13:54 | |
| openstackgerrit | A change was merged to openstack/swift: Remove some debugging prints from tests https://review.openstack.org/81353 | 13:58 |
| *** byeager has joined #openstack-swift | 14:03 | |
| *** mmcardle has joined #openstack-swift | 14:04 | |
| *** saschpe__ has quit IRC | 14:06 | |
| *** saschpe__ has joined #openstack-swift | 14:06 | |
| *** saschpe__ has quit IRC | 14:07 | |
| *** saschpe_ has quit IRC | 14:07 | |
| *** dmsimard has joined #openstack-swift | 14:12 | |
| *** chandan_kumar has quit IRC | 14:13 | |
| *** judd7 has joined #openstack-swift | 14:15 | |
| *** nshaikh has joined #openstack-swift | 14:16 | |
| *** chandan_kumar has joined #openstack-swift | 14:17 | |
| *** piyush1 has joined #openstack-swift | 14:17 | |
| *** shakamunyi has joined #openstack-swift | 14:18 | |
| *** saschpe- has joined #openstack-swift | 14:36 | |
| *** pconstantine_ has quit IRC | 14:39 | |
| *** pconstantine_ has joined #openstack-swift | 14:40 | |
| *** saschpe- has quit IRC | 14:42 | |
| *** saschpe- has joined #openstack-swift | 14:42 | |
| *** saschpe- is now known as saschpe_ | 14:43 | |
| *** saschpe_ is now known as saschpe__ | 14:43 | |
| *** shakamunyi has quit IRC | 14:52 | |
| *** shakamunyi has joined #openstack-swift | 14:52 | |
| *** byeager has quit IRC | 15:01 | |
| *** byeager has joined #openstack-swift | 15:01 | |
| *** piyush1 has quit IRC | 15:06 | |
| *** dvas has quit IRC | 15:14 | |
| *** nshaikh has quit IRC | 15:18 | |
| *** saschpe__ is now known as saschpe | 15:24 | |
| *** dvas has joined #openstack-swift | 15:32 | |
| *** lpabon has joined #openstack-swift | 15:37 | |
| portante | notmyname: have you heard of these guys: http://www.ddn.com/products/object-storage-web-object-scaler-wos/ | 15:37 |
| openstackgerrit | Christian Schwede proposed a change to openstack/swift: Add containeralias middleware https://review.openstack.org/62494 | 15:40 |
| *** zaitcev has joined #openstack-swift | 15:42 | |
| *** ChanServ sets mode: +v zaitcev | 15:42 | |
| zaitcev | portante: Not sure if you realize that I merged my tip that has PBE with your in-process functional tests, and ran the result. It looked fine, bring 66108 out of WIP, I'll retest and +2. | 15:44 |
| *** dvas has quit IRC | 15:46 | |
| cschwede | portante: i was testing that a while ago - it's blazingly fast. it works a little bit different than other object storages, for example you can't set the object name, but get an uuid for each uploaded object. and no object listing | 15:46 |
| *** dvas has joined #openstack-swift | 15:47 | |
| portante | cschwede: you are referring to the container alias? | 15:47 |
| cschwede | portante: sorry, no, to the DDN WOS | 15:48 |
| portante | ah, thanks | 15:48 |
| portante | cschwede: yes, I worked on a system like that for tabblo.com | 15:48 |
| creiht | cschwede: heh, swift would be super fast if we didn't have to do object listings either :) | 15:49 |
| cschwede | portante: page 9 on the whitepaper lists some functionalities: http://www.ddn.com/download/resource_library/whitepapers/ddn_whitepapers/wos360_whitepaper.pdf | 15:49 |
| cschwede | creiht: haha, true :) | 15:49 |
| creiht | facebook's haystack was kinda like that | 15:51 |
| cschwede | creiht: but they are also extremely fast for getting / storing data, for example if you put a 5GB blob onto it there should be no significant delay due to DB updates | 15:51 |
| creiht | true | 15:51 |
| *** dvas has quit IRC | 15:51 | |
| otoolee | creiht, Sorry to pester, but could you please have a quick look at https://review.openstack.org/#/c/75881/2 and let me know if I'm on the right track? | 15:51 |
| creiht | otoolee: sorry also been sick | 15:51 |
| *** dvas has joined #openstack-swift | 15:52 | |
| cschwede | creiht: they don't use a filesystem on their disks, and it's more like a black box | 15:52 |
| otoolee | creiht, Oh, sorry to hear that. | 15:52 |
| creiht | I'm trying to finish up a patch now, then will get back to reviews | 15:52 |
| creiht | no worries | 15:52 |
| creiht | cschwede: yeah, I've been thinking about a non-file system backend for swift | 15:52 |
| creiht | the problem is that a filesystem is terribly convenient | 15:52 |
| *** chandankumar_ has joined #openstack-swift | 15:54 | |
| *** chandan_kumar has quit IRC | 15:56 | |
| notmyname | portante: ya, I've come across them from time to time | 16:01 |
| *** dvas has quit IRC | 16:01 | |
| creiht | also just a thought | 16:03 |
| creiht | if people are interested in talking about stuff at the summit, it would probably be a good idea to get things in sooner rather than later | 16:04 |
| creiht | to make sure we get a decent number of slots | 16:04 |
| creiht | http://summit.openstack.org/ | 16:04 |
| notmyname | creiht: yes, exactly! | 16:05 |
| notmyname | :-) | 16:05 |
| creiht | also | 16:05 |
| creiht | I don't want to be the only one suggesting topics for the summit | 16:05 |
| creiht | correction: you probably don't want me being the only one suggestion topics for the summit ;) | 16:06 |
| creiht | suggesting | 16:06 |
| *** judd7 has quit IRC | 16:09 | |
| *** jamie_h has quit IRC | 16:11 | |
| *** saschpe has quit IRC | 16:11 | |
| *** saschpe has joined #openstack-swift | 16:12 | |
| *** jamieh has joined #openstack-swift | 16:13 | |
| *** jamieh is now known as jamie_h | 16:14 | |
| *** saschpe has quit IRC | 16:14 | |
| *** saschpe has joined #openstack-swift | 16:15 | |
| *** dvas has joined #openstack-swift | 16:15 | |
| *** bada_ has quit IRC | 16:21 | |
| *** bada_ has joined #openstack-swift | 16:21 | |
| notmyname | good morning everyone! (just got into the office and marked all the emails as read) | 16:25 |
| notmyname | reminder that we have a swift team meeting in #openstack-meeting in 2.5 hours | 16:26 |
| *** mkollaro has quit IRC | 16:26 | |
| notmyname | https://wiki.openstack.org/wiki/Meetings/Swift | 16:26 |
| torgomatic | cat /dev/null > /var/spool/mail/$USER.mbox # Inbox Zero! | 16:27 |
| torgomatic | notmyname: something like that? ;) | 16:27 |
| * hugokuo laughing | 16:29 | |
| *** byeager has quit IRC | 16:32 | |
| *** byeager has joined #openstack-swift | 16:32 | |
| *** byeager has quit IRC | 16:36 | |
| *** byeager has joined #openstack-swift | 16:38 | |
| notmyname | creiht: portante: if you want swift to be faster on writes and not do DB updates, https://review.openstack.org/#/c/60074/ may be something to check out :-) | 16:39 |
| *** shakamunyi has quit IRC | 16:40 | |
| *** gyee has joined #openstack-swift | 16:43 | |
| portante | notmyname: hmm, two unanswered questions ... ;) | 16:49 |
| notmyname | portante: well, I've looked at it about as much as anyone else recently (ie not at all ;-)) | 16:49 |
| notmyname | IIRC it was some random idea combined with a few minutes of downtime ;-) | 16:50 |
| portante | ;) | 16:50 |
| *** mmcardle has quit IRC | 16:52 | |
| *** gvernik has joined #openstack-swift | 16:52 | |
| *** d89 has joined #openstack-swift | 16:54 | |
| portante | creiht, notmyname, zaitcev: add two, PBEs and DiskFile | 16:56 |
| notmyname | portante: ? | 16:56 |
| portante | design summit topics? | 16:57 |
| notmyname | ah, cool | 16:57 |
| portante | otoolee: perhaps it would be worth proposing a summit design session on object auditors | 16:57 |
| portante | creiht | 16:58 |
| notmyname | portante: I'd like to see some discussion around making FS traversal better. we've got several processes that do it (at different speeds), and os.walk() isn't too efficient | 17:01 |
| *** chandan_kumar has joined #openstack-swift | 17:05 | |
| *** d89 has quit IRC | 17:09 | |
| creiht | notmyname: hrm, not sure I like that idea | 17:11 |
| *** shri has joined #openstack-swift | 17:11 | |
| notmyname | creiht: you don't like making FS traversal better? ;-) | 17:14 |
| creiht | lol | 17:15 |
| creiht | the patch you pointed me at | 17:15 |
| notmyname | or you don't want just one walker (I'm not sure I want that either) | 17:15 |
| notmyname | creiht: ah ok :-) | 17:15 |
| creiht | you move to a definate consistency window | 17:15 |
| notmyname | creiht: ya, I'm not sure that's a good idea either ("here's a loaded gun pointed at your foot. have fun") | 17:15 |
| notmyname | creiht: but in some cases, it's interesting to consider | 17:15 |
| creiht | you also move what was an error case to a normal case | 17:15 |
| notmyname | right | 17:15 |
| creiht | where as before, it was easy to track, and if your pendings start shooting up, you know you have some sort of issue | 17:16 |
| notmyname | oh, I completely get that :-) | 17:16 |
| creiht | I don't think it would be right for our use case | 17:16 |
| notmyname | eg I've seen several people interested in swift but completely don't need listings or container metadata or rolled up stats. | 17:16 |
| notmyname | creiht: I agree it would be horrible for cloud files | 17:17 |
| *** chandan_kumar has quit IRC | 17:17 | |
| creiht | but I can see in the case where you don't really care about listings, it might be alright | 17:17 |
| creiht | but in the case if you really don't care about listings, you could drop container services all-together | 17:18 |
| *** mlipchuk has quit IRC | 17:18 | |
| notmyname | not without a lot more changes, since that would affect the proxies and auth a lot | 17:19 |
| creiht | oh sure | 17:19 |
| creiht | I struggle with, how many use cases should swift cover? | 17:20 |
| creiht | or what should be consider out-of-bounds | 17:21 |
| * torgomatic is working on RFC2324 support for Swift | 17:28 | |
| creiht | heh | 17:29 |
| *** JuanManuelOlle has quit IRC | 17:30 | |
| *** JuanManuelOlle1 has joined #openstack-swift | 17:30 | |
| luisbg | torgomatic, "Coffee brewing is an art, but the distributed intelligence of the web-connected world transcends art. Thus, there is a strong, dark, rich requirement for a protocol designed espressoly for the brewing of coffee." | 17:43 |
| luisbg | hahahahaa | 17:43 |
| torgomatic | all I'm saying is I want a coffee replicator | 17:47 |
| luisbg | +1, or even +2 | 17:48 |
| *** bada_ has quit IRC | 17:51 | |
| *** gvernik has quit IRC | 17:51 | |
| *** [1]gvernik has joined #openstack-swift | 17:51 | |
| swifterdarrell | torgomatic: luisbg: new OpenStack project, STAT! | 17:52 |
| *** bada_ has joined #openstack-swift | 17:52 | |
| *** mmcardle has joined #openstack-swift | 17:52 | |
| luisbg | swifterdarrell, url? | 17:52 |
| swifterdarrell | luisbg: i'm just sayin' we need one for the coffee thing | 17:53 |
| luisbg | oooh START :) | 17:53 |
| *** tanee is now known as tanee-away | 17:53 | |
| wer | what's all this coffee talk? I'm in! | 17:53 |
| portante | notmyname: yes, I have a patch I am in the process of testing which I think is going to significantly help the directory traversal | 17:54 |
| notmyname | yay | 17:55 |
| portante | trying to get some numbers generated using a big workload to make sure it is good | 17:55 |
| portante | we used the same technique at another customer to reduce head seeks on the disk | 17:55 |
| portante | basically, if you sort the inodes for the lowest level hash directories, and access those directories in ascending inode number order, you'll access the files in the order they are written on disk, avoiding the head seeks. | 17:59 |
| portante | notmyname: | 17:59 |
| *** nacim has quit IRC | 18:01 | |
| torgomatic | portante: is that an XFS-ism? | 18:01 |
| torgomatic | I mean, I guess it doesn't matter too much, as it'll be no worse on other filesystems | 18:01 |
| portante | I don't think so | 18:02 |
| portante | but maybe | 18:02 |
| portante | it worked well for xfs | 18:02 |
| torgomatic | :shipit: | 18:03 |
| portante | I'll post the patch as work-in-progress | 18:03 |
| portante | until we finish our numbers gathering | 18:03 |
| torgomatic | sounds good; I'm always up for perf gains, especially when they don't involve huge code restructurings :) | 18:04 |
| *** mmcardle has quit IRC | 18:06 | |
| creiht | oh man | 18:08 |
| openstackgerrit | Peter Portante proposed a change to openstack/swift: WIP: Speed up obj aud. sorting hsh dirs by inode # https://review.openstack.org/81590 | 18:08 |
| creiht | we have very little unit testing in our proxy code :/ | 18:09 |
| portante | torgomatic: ^^^ | 18:09 |
| portante | creiht: yes | 18:09 |
| * creiht rolls up his sleeves | 18:11 | |
| portante | yes! | 18:11 |
| creiht | heh | 18:11 |
| portante | go, I'm right behind ya | 18:11 |
| creiht | well I'm not guaranteeing 100% coverage :) | 18:12 |
| portante | 98%? | 18:12 |
| creiht | also I'm just looking at the object controller right now for this patch | 18:12 |
| portante | but we get coverage numbers by controller, right? | 18:12 |
| creiht | yes | 18:12 |
| creiht | right now it is 88% for object controller | 18:13 |
| creiht | and most of that is incidental | 18:13 |
| creiht | mean it gets coverage just because it happens to run the code, not because it is actully tested :) | 18:13 |
| portante | yes, it seems that if you only run the tests that target a given module we have very low coverage | 18:13 |
| *** byeager has quit IRC | 18:17 | |
| *** byeager has joined #openstack-swift | 18:17 | |
| *** byeager_ has joined #openstack-swift | 18:20 | |
| *** mmcardle has joined #openstack-swift | 18:21 | |
| *** bada_ has quit IRC | 18:21 | |
| *** bada_ has joined #openstack-swift | 18:21 | |
| *** byeager has quit IRC | 18:22 | |
| *** mmcardle has quit IRC | 18:25 | |
| *** dvas has quit IRC | 18:31 | |
| portante | notmyname: are you going to suggest a session on disk walking? | 18:34 |
| notmyname | portante: hmm..should I? I don't have anything to say on it right now other than "let's make it better" | 18:35 |
| portante | maybe we can come up with a program that shakes an entire rack off its moarings using a GET pattern on swift ... | 18:35 |
| notmyname | heh | 18:35 |
| portante | notmyname: sounds like a good basis for a design summit session | 18:35 |
| notmyname | portante: done | 18:38 |
| portante | nice! | 18:40 |
| notmyname | meeting in 15 minutes | 18:45 |
| *** jamie_h has quit IRC | 18:49 | |
| *** gvernik has joined #openstack-swift | 18:52 | |
| *** [1]gvernik has quit IRC | 18:52 | |
| *** jamieh has joined #openstack-swift | 18:56 | |
| *** jamieh is now known as Guest719 | 18:57 | |
| *** bada_ has quit IRC | 18:57 | |
| *** bada_ has joined #openstack-swift | 18:58 | |
| *** Guest719 has quit IRC | 18:58 | |
| notmyname | meeting time in #openstack-meeting | 18:59 |
| *** saju_m has quit IRC | 19:21 | |
| *** saju_m has joined #openstack-swift | 19:22 | |
| *** bada_ has quit IRC | 19:25 | |
| *** bada_ has joined #openstack-swift | 19:26 | |
| *** tgohad has left #openstack-swift | 19:37 | |
| *** tgohad has joined #openstack-swift | 19:37 | |
| *** tgohad is now known as tusharsg | 19:37 | |
| *** keving1 has joined #openstack-swift | 19:44 | |
| *** dvas has joined #openstack-swift | 19:46 | |
| *** jairo has joined #openstack-swift | 19:46 | |
| *** tusharsg has left #openstack-swift | 19:46 | |
| *** tusharsg has joined #openstack-swift | 19:46 | |
| *** tusharsg has left #openstack-swift | 19:46 | |
| *** tusharsg has joined #openstack-swift | 19:47 | |
| jairo | hey guys I was wondering if you guys could guide me on how to run this script https://gist.github.com/gholt/7777637 I just try to run it and it just stays there doing nothing, thx | 19:48 |
| gholt | jairo: Hi, it could be that it hasn't found anything to do yet. | 19:49 |
| gholt | I assume you're running that with the DELETE line commented out still? | 19:50 |
| *** gvernik has quit IRC | 19:51 | |
| gholt | In case I'm not here when you respond: I would add some extra print statements here and there so you can check on just what the script is doing. | 19:51 |
| *** gvernik has joined #openstack-swift | 19:51 | |
| jairo | yeah still commented out | 19:52 |
| *** tusharsg_ has joined #openstack-swift | 19:52 | |
| notmyname | thanks for coming to the meeting. /me is going to get lunch now | 19:59 |
| creiht | https://review.openstack.org/#/c/53270/ | 20:00 |
| creiht | if someone would like to take a look :) | 20:00 |
| glange | that has html in it | 20:01 |
| portante | creiht: pulling ... | 20:02 |
| portante | gonna see how it fares on Fedora 19 SAIO | 20:02 |
| creiht | cool | 20:02 |
| creiht | portante: thanks | 20:02 |
| zaitcev | portante: what did you want to discuss about PBE? you mentioned doing something after meeting | 20:02 |
| peluse | portante: just looking over the beginning of the meeting minutes (I missed the start)... | 20:03 |
| *** tusharsg_ has quit IRC | 20:03 | |
| peluse | portante: unit test coverage on SP is solid | 20:03 |
| peluse | portante: however functional and probe testing is lacking | 20:03 |
| portante | peluse: getting coverage there will help | 20:03 |
| zaitcev | portante: how about I'll prepare the old and new flows like you did in wide text files and then we'll look at those? In 25 mintes I'll need to start cooking here | 20:03 |
| *** gvernik has quit IRC | 20:03 | |
| portante | but as clayg said, the code paths might be easily covered by a config change to the default policy | 20:03 |
| portante | zaitcev: sure | 20:04 |
| portante | sounds like a plan | 20:04 |
| cschwede | creiht: will have a look at that patch tomorrow morning | 20:04 |
| portante | I have a hard stop at 5:30 PM EDT | 20:04 |
| peluse | portante: yup, totally agree. brought that up a while back and we have a TODO item on trellow that still, well, TODO :) | 20:04 |
| portante | creiht: would like to see the 62% coverage of xprofile a bit higher. :) | 20:05 |
| creiht | it isn't my code, I would just like to see the functionality :) | 20:06 |
| portante | ;) | 20:06 |
| portante | I thought since you were jumping in on the proxy server unit tests you could just get the remaining 38% for that patch as well | 20:06 |
| portante | ;) | 20:06 |
| portante | a unit test is a unit test, right? | 20:07 |
| creiht | lol | 20:07 |
| *** saju_m has quit IRC | 20:08 | |
| portante | folks, get object versioning not enabled in my functional tests runs | 20:08 |
| portante | is that normal? | 20:08 |
| portante | do I have a bad config? | 20:08 |
| portante | in my SAIO? | 20:08 |
| *** saju_m has joined #openstack-swift | 20:08 | |
| *** tongli has joined #openstack-swift | 20:09 | |
| torgomatic | portante: you mean the functional tests pass with object versioning turned off? | 20:10 |
| portante | test_overwriting is SKIPPED | 20:10 |
| portante | TestObjectVersioning | 20:10 |
| portante | and UTF8 version | 20:10 |
| torgomatic | seems reasonable; if you haven't turned on object versioning, the tests are skipped | 20:11 |
| *** Trixboxer has quit IRC | 20:11 | |
| portante | hmm, thought I had that ... | 20:12 |
| torgomatic | that guy's weird; it's in the container-server config | 20:12 |
| portante | yeah | 20:12 |
| portante | hmm | 20:12 |
| portante | should we have that on by default in a SAIO? | 20:12 |
| torgomatic | probably, IMO; if you're doing development, all the stuff should be on so your functional tests test everything | 20:13 |
| torgomatic | (at least by default) | 20:13 |
| portante | torgomatic: I would think so as well | 20:13 |
| zaitcev | makes sense | 20:13 |
| zaitcev | except perhaps it's okay to skip when packages are missing | 20:13 |
| bsdkurt | hi. checking in to see if there's any comment on that direct io patch. :-) | 20:14 |
| creiht | bsdkurt: I want to look at it, but haven't had a chance yet | 20:14 |
| portante | bsdkurt: same here | 20:14 |
| bsdkurt | ok. thanks. | 20:15 |
| bsdkurt | I know it isn't commit worthy as it stands, but it should serve as a good starting point for discussion | 20:15 |
| portante | bsdkurt: did you mark it work-in-progress? | 20:16 |
| portante | and do you have some numbers comparing some swift API benchmarks? | 20:16 |
| creiht | bsdkurt: absolutely | 20:16 |
| bsdkurt | how do you mark it WIP? | 20:16 |
| portante | torgomatic: nice rendition of sinatra | 20:16 |
| torgomatic | portante: oh, the branch name in my Swift fork? :) | 20:17 |
| portante | ;) | 20:17 |
| jairo | gholt: even if it doesn't find anything, I should see activity on the syslog, going through it, or shouldn't I? | 20:17 |
| notmyname | bsdkurt: there's a button in gerrit http://d.not.mn/WIP.png | 20:18 |
| bsdkurt | notmyname: ahh. how did I miss that? thanks! | 20:19 |
| * portante has missed many a tricky button press | 20:19 | |
| openstackgerrit | Peter Portante proposed a change to openstack/swift: Enable object servers for SAIO by default https://review.openstack.org/81615 | 20:20 |
| creiht | hah | 20:20 |
| creiht | gerrit doesn't exactly help you in that respect | 20:20 |
| openstackgerrit | Peter Portante proposed a change to openstack/swift: Enable object versions for SAIO by default https://review.openstack.org/81615 | 20:20 |
| bsdkurt | portante: the testing I did was all somewhat custom and focused on retrieving large objects. is there a standard way to do perf tests for changes like this? | 20:23 |
| portante | ssbench, swiftbench, which others are more versed in | 20:24 |
| notmyname | portante: for https://review.openstack.org/#/c/81590/ anticw would be a good person to get comments from | 20:24 |
| portante | swifterdarrell might be able to offer you some guidance | 20:24 |
| notmyname | portante: but, he's also a very busy guy :-) | 20:24 |
| portante | k thanks | 20:25 |
| bsdkurt | portante: okay. I'll take a look at ssbench and swiftbench | 20:25 |
| jeblair | "swift --debug list" against rackspace dfw region is hanging for me | 20:31 |
| jeblair | it's stuck at "INFO:requests.packages.urllib3.connectionpool:Starting new HTTPS connection (1): storage101.dfw1.clouddrive.com" | 20:31 |
| jeblair | ord works | 20:31 |
| jeblair | pandemicsyn, ahale, notmyname: ^ | 20:32 |
| *** dvas has quit IRC | 20:32 | |
| jeblair | i'm using git master, with latest python-keystoneclient release and the OS_ env variables | 20:33 |
| jeblair | oh, interesting... | 20:33 |
| jeblair | i am unable to upload files in the web ui to dfw, but ord works there | 20:34 |
| jeblair | gholt, creiht: ^ | 20:35 |
| *** shri has quit IRC | 20:37 | |
| ahale | that sounds messed up jeblair , have you got your swift account handy i can look and see whats going on, or if i need to get someone in our identity to look ? | 20:38 |
| jeblair | ahale: the rs cloud account username is 'openstackci'; if there's a separate swift account i'm not familiar with it | 20:39 |
| ahale | ah cool, thats enough | 20:39 |
| ahale | i'll dig around, let you know when i get somewhere | 20:41 |
| jeblair | ahale: cool. i'm not blocked since ord is working; let me know if you need anything else | 20:41 |
| ahale | ok cool | 20:41 |
| *** shri has joined #openstack-swift | 20:44 | |
| *** lpabon has quit IRC | 20:52 | |
| ahale | jeblair: thats weird, it all looks good and im showing 2xx codes, both direct and through the control panel.. i'm going to check with the identity people see if they have anything going on | 20:54 |
| ahale | are you doing this from ord? i see there its hitting us on ipv6, i wonder if theres something weird with ip6 to dfw.. but then not if control panel is doing the same I guess | 20:55 |
| clayg | what channel am I in? | 20:57 |
| *** dvas has joined #openstack-swift | 20:58 | |
| ahale | if i wasn't so terrified of reviewers, and better at writing code theres an idea I had… but alas, this is the only way I can help openstack at the moment sorry | 21:00 |
| *** JuanManuelOlle1 has quit IRC | 21:00 | |
| clayg | ahale: sorry - my default mode is "not helpful" - I think most people just ignore me and then try throwing things | 21:02 |
| *** gvernik has joined #openstack-swift | 21:05 | |
| wer | hrm, I am getting things truncated when curl PUT'ing things into swift :/ Even though I supply the Content-Type the Created response tells me it is Content-Type: text/html; charset=UTF-8... then when I go head the request again it has my supplied content type Content-Type: image/jpeg but the file got truncated. | 21:05 |
| wer | I don't know what I am going wrong as I don't remember this happening in the past. | 21:06 |
| clayg | wer: can you duplicate the issue with the swift cli? Otherwise it's probably time to paste your curl command. | 21:06 |
| wer | curl -i -H 'Content-Type: image/jpeg' -X PUT --data "@./dd1b9400-548c-44f2-ab79-3819cc52eb83.jpg" http://swifthost:8080/v1/AUTH_user/asset/00000000-0000-0000-0000-000000000010.jpg | 21:07 |
| wer | no the swift client behaves correctly. | 21:07 |
| clayg | --data-binary ? | 21:08 |
| clayg | if you run that with -v can you see the transmitted headers and verb? | 21:08 |
| wer | clayg: I'm an idiot. --data-binary | 21:09 |
| clayg | i feel like when I'm doing PUT's with curl I mostly just use -T | 21:09 |
| wer | So it escaped a null or something. | 21:09 |
| clayg | curl's crazy | 21:09 |
| creiht | haha | 21:09 |
| wer | agreed :) | 21:09 |
| wer | ty so much | 21:09 |
| * clayg tries to gain back some karma for being a nob to poor ahale | 21:10 | |
| ahale | i feel bad for making you feel bad now clay :( | 21:10 |
| *** gvernik has quit IRC | 21:10 | |
| clayg | ahale: you'd be better off trying to throw something than spending any time worrying about me - i get what I deserve | 21:11 |
| * clayg ducks | 21:11 | |
| ahale | hah | 21:11 |
| *** mmcardle has joined #openstack-swift | 21:19 | |
| portante | zaitcev: let's meet up tomorrow then, i'll post something on your calendar | 21:25 |
| jogo | Bug 1262906 | 21:26 |
| jogo | notmyname: ^ is the new #2 gate failure http://status.openstack.org/elastic-recheck/gate.html | 21:26 |
| zaitcev | portante: okay, but please not too early (I had some errands in the morning -- nothing too important, honestly, but already set..) | 21:26 |
| zaitcev | portante: 2 p.m. E? | 21:26 |
| portante | 2pm it is | 21:26 |
| *** bvandenh has quit IRC | 21:27 | |
| portante | jogo: does that recheck page offer a link to that bug somewhere? | 21:27 |
| jogo | portante: it does click launchpad at the bottom | 21:28 |
| jogo | portante: we are discussing it in #openstack-qa | 21:28 |
| *** saju_m has quit IRC | 21:28 | |
| portante | ah | 21:28 |
| portante | jogo: I have a 5:30 PM EDT hard stop, so I gotta run, but will be on later if you need anything | 21:29 |
| jogo | thanks | 21:31 |
| *** mmcardle has quit IRC | 21:32 | |
| *** mmcardle has joined #openstack-swift | 21:33 | |
| notmyname | jogo: I just got back from lunch and read the scrollback | 21:38 |
| jogo | notmyname: it looks like a devstack issue, we are only seeing this in hp and not rax | 21:38 |
| notmyname | jogo: ok, thanks for taking a look | 21:38 |
| notmyname | jogo: also "jogo" not "jog0" anymore? | 21:39 |
| notmyname | or was it j0go? | 21:39 |
| jogo | notmyname: haha it was jog0 | 21:39 |
| jogo | but someone else had that name for a while, but it just expireed | 21:39 |
| *** krtaylor has quit IRC | 21:46 | |
| *** dvas has quit IRC | 21:49 | |
| *** tdasilva has left #openstack-swift | 21:51 | |
| *** mmcardle has quit IRC | 21:51 | |
| *** krtaylor has joined #openstack-swift | 21:52 | |
| *** dvas_ has joined #openstack-swift | 21:53 | |
| *** wer is now known as wer_mocha | 21:54 | |
| zaitcev | I also happen to review patches in other projects and apparently "recheck no bug" is more common elsewhere. We are more dilligent about helping infrastructure people in Swift. | 21:58 |
| zaitcev | Change subject: Add http(s) protocol support to fetch_review and list_reviews | 21:58 |
| zaitcev | Patch Set 7: recheck no bug | 21:58 |
| openstackgerrit | Chuck Thier proposed a change to openstack/swift: Add "If-None-Match: *" support to PUT https://review.openstack.org/81646 | 21:59 |
| *** keving1 has left #openstack-swift | 21:59 | |
| creiht | portante: ^- there's some extra tests | 22:00 |
| creiht | I just added some of the basic requests, but it is a start | 22:00 |
| *** fifieldt has joined #openstack-swift | 22:02 | |
| openstackgerrit | Chuck Thier proposed a change to openstack/swift: Add "If-None-Match: *" support to PUT https://review.openstack.org/81646 | 22:02 |
| creiht | hehe.. silly print statement :) | 22:02 |
| clayg | creiht: is the goal there mainly to save wasted effort if the file is already there or acctually *prevent* uploading if the file already exists? I worry that it looks like stronger consistency than it really is in the face of failures + rebalance | 22:03 |
| anticw | portante: does that auditor speedup work? | 22:03 |
| anticw | i ask because the write patterns for PUT cause badly skewed block allocation and it might not be that effective | 22:04 |
| creiht | clayg: well the goal is to have similar semantics to a HEAD before | 22:04 |
| notmyname | anticw: I think he had to step out for a bit, but he should be able to read buffer playback later | 22:04 |
| creiht | I don't think it is possible to absolutely *prevent* if the file is *supposed* to already exist | 22:05 |
| clayg | where similar doesn't include handoffs ;) | 22:05 |
| creiht | sure | 22:05 |
| creiht | well | 22:05 |
| creiht | it would if the cannonical locations were not available | 22:05 |
| clayg | true, first three servers that are up | 22:06 |
| creiht | right | 22:06 |
| clayg | it's probably fine - i'll try to poke at it - thanks! | 22:06 |
| creiht | yeah feel free to shoot holes in it | 22:06 |
| creiht | I don't want to open up some weird use cases | 22:06 |
| creiht | that try to abuse something like that | 22:06 |
| clayg | i think the best I'll be able to get is upload with 2 primaries up, take out a device and rebalance, then fail one of the primaries, and watch it still upload 50% of the time until replication kicks in | 22:07 |
| creiht | one of the reasons I didn't include etag support initially is that there were so many weird edge cases | 22:07 |
| creiht | yeah this is for a pretty specific use case | 22:07 |
| clayg | creiht: yeah I like that bit | 22:07 |
| creiht | and will help out one of our customers greatly | 22:08 |
| clayg | sweet! | 22:09 |
| clayg | oh, doh! debug print in object controller line 590 | 22:09 |
| creiht | clayg: reload | 22:09 |
| clayg | :) | 22:09 |
| creiht | I should have gotten rid of that | 22:09 |
| openstackgerrit | Jenkins proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/81207 | 22:11 |
| *** mlipchuk has joined #openstack-swift | 22:16 | |
| *** dmsimard has quit IRC | 22:29 | |
| *** byeager_ has quit IRC | 22:49 | |
| *** byeager has joined #openstack-swift | 22:49 | |
| *** byeager has quit IRC | 22:53 | |
| *** tusharsg has quit IRC | 22:58 | |
| *** shri1 has joined #openstack-swift | 23:11 | |
| *** shri has quit IRC | 23:13 | |
| *** tongli has quit IRC | 23:13 | |
| *** mlipchuk has quit IRC | 23:19 | |
| *** shri1 has quit IRC | 23:29 | |
| clayg | zaitcev: does the PBE branch fix/address the stupid/useless/broken status/status_changed_at fields on the account and container databases? (I call it stupid/useless - it's possible the account-reaper acctually cares about those fields, but it gets on my nerves that recreated containers still say they're DELETED) | 23:47 |
| zaitcev | clayg: No, sorry. I didn't dare mixing it in. | 23:47 |
| zaitcev | clayg: However, my experiments show that it's possible to have Swift that sits on top of something that is deleted when it's deleted. E.g. container is a directory and GlusterFS just does rmdir. | 23:49 |
| zaitcev | clayg: This may interest you because I think it demonstrates that if you can adjust internal users such as account-reaper, you should be safe about nothing leaking up to user API. | 23:50 |
| clayg | zaitcev: not entirely sure I follow - acctually pretty sure I don't - but that's ok ;) | 23:56 |
| zaitcev | clayg: Okay! So in short, no, I didn't do any cleanups of the deleted state. Only made sure it's not in the API of backends and contained fully inside legacy backend. | 23:57 |
| clayg | ah, I think I see then - yeah that's great! | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
