| *** peluse has quit IRC | 00:03 | |
| *** mfalatic has quit IRC | 00:09 | |
| *** ccavanna has joined #openstack-swift | 00:10 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift: Add search filter examples to swift-ring-builder dispersion help https://review.openstack.org/227058 | 00:15 |
|---|---|---|
| *** zhill has quit IRC | 00:27 | |
| *** gyee has quit IRC | 00:27 | |
| *** amandap has quit IRC | 00:32 | |
| *** swifterdarrell has quit IRC | 00:33 | |
| *** _fortis has quit IRC | 00:33 | |
| *** ccavanna_ has joined #openstack-swift | 00:33 | |
| *** amandap has joined #openstack-swift | 00:35 | |
| *** swifterdarrell has joined #openstack-swift | 00:35 | |
| *** ChanServ sets mode: +v swifterdarrell | 00:35 | |
| *** ccavanna has quit IRC | 00:36 | |
| *** agomez has quit IRC | 00:43 | |
| *** hrou has joined #openstack-swift | 00:46 | |
| *** _fortis has joined #openstack-swift | 00:46 | |
| *** _hrou_ has quit IRC | 00:48 | |
| *** agomez has joined #openstack-swift | 00:53 | |
| *** annegentle has joined #openstack-swift | 00:54 | |
| *** agomez has quit IRC | 00:54 | |
| *** haomaiwang has joined #openstack-swift | 00:57 | |
| *** annegentle has quit IRC | 00:59 | |
| *** haomaiwang has quit IRC | 01:00 | |
| *** haomaiwa_ has joined #openstack-swift | 01:00 | |
| *** haomaiwa_ has quit IRC | 01:01 | |
| *** peluse has joined #openstack-swift | 01:01 | |
| *** haomaiwang has joined #openstack-swift | 01:01 | |
| *** peluse has quit IRC | 01:09 | |
| *** haomaiwang has quit IRC | 01:12 | |
| layzee | a newbie here. :-) how does swift handle millions of objects in a container when there are some limits on number of files in a directory ? (I'm assuming ofcourse that the objects are files in some fast filesystem in a -NIX operating system) | 01:13 |
| * layzee is thinking about some sort of stretched directory .. but not sure | 01:14 | |
| glange | the object list is contained in a database -- the object themselves are stored on disk on the object servers | 01:14 |
| clayg | glange: it's late in texas bro | 01:14 |
| glange | clayg: not that late :) | 01:15 |
| *** klrmn1 has quit IRC | 01:15 | |
| clayg | glange: but you're old? | 01:15 |
| clayg | ;) | 01:15 |
| glange | haha | 01:15 |
| layzee | glange: hmm ... is that what that sqlite dependency was for ? | 01:15 |
| layzee | i just installed it | 01:15 |
| glange | yeah, every swift cluster has tons of sqlite dbs | 01:15 |
| layzee | thx btw | 01:15 |
| glange | they store account and container information | 01:15 |
| layzee | ahha .. so it doesn't matter how the underlying fs is storing the actual file (i mean the hierarchy) as long as the info about where exactly it is -- is available via a sqlite query ? | 01:16 |
| glange | yeah, kind of -- the actual location of the objects can be determined from their url path and an datastructure called a ring | 01:17 |
| glange | swift clusters have 3 rings | 01:17 |
| clayg | ahem | 01:17 |
| layzee | i sense a storm of info | 01:18 |
| glange | and those determine which systems in the clusters handle a request and where the objects and various dbs are | 01:18 |
| * layzee gets ready | 01:18 | |
| glange | clayg: what did I get wrong? :) | 01:18 |
| clayg | *at least* 3 rings :P | 01:18 |
| glange | haha | 01:18 |
| glange | oh yeah, storage polices can add more rings, I guess? | 01:18 |
| clayg | glange notes all the *good* swift clusters have 3 rings :P | 01:18 |
| glange | when you are talking to somebody new, you don't have to say everything at once :p | 01:18 |
| clayg | lol | 01:19 |
| layzee | yes pls | 01:19 |
| layzee | I really don't mind .. I can understand little by little | 01:19 |
| clayg | layzee: sorry - ignore me glange is doing great! | 01:19 |
| glange | layzee: did you understand what I said so far? any more questions? | 01:19 |
| glange | (I'm taking a break from working on something) | 01:19 |
| layzee | i understood what you said so far .. about some sort of hash rings determining the location of an object | 01:20 |
| glange | location of an object and the account and continer dbs and which servers handle which requests | 01:20 |
| glange | are you setting up a swift all in one? | 01:20 |
| layzee | all in one - meaning ? | 01:21 |
| glange | http://docs.openstack.org/developer/swift/development_saio.html | 01:21 |
| glange | it's a complete swift cluster on a single VM or server or whatever | 01:21 |
| glange | it's what you need to do dev work | 01:21 |
| glange | plus it's fun to play with and learn on | 01:21 |
| layzee | thx - I should try that and get back here. | 01:21 |
| glange | yeah, that would be a great thing to do first (depending on your goals) | 01:22 |
| glange | and good luck, setting up one doesn't always go right the first try :) | 01:22 |
| glange | it's gotten a little harder recently | 01:22 |
| layzee | hmm I'll sit on it over a weekend and collect my observations and come armed with more doubts here .. | 01:23 |
| glange | everybody here on channel is friendly (except clayg) -- so come back with questions and if people have time and interest you'll probably get answer | 01:23 |
| glange | answers | 01:23 |
| clayg | rofl | 01:24 |
| layzee | :-) thanks glange and clayg | 01:24 |
| *** peluse has joined #openstack-swift | 01:25 | |
| *** bill_az has quit IRC | 01:25 | |
| *** layzee is now known as layzee__ | 01:25 | |
| *** esker has joined #openstack-swift | 01:36 | |
| *** wbhuber has joined #openstack-swift | 01:43 | |
| *** peluse has quit IRC | 01:43 | |
| *** peluse has joined #openstack-swift | 01:44 | |
| *** peluse has quit IRC | 01:53 | |
| *** peluse has joined #openstack-swift | 01:54 | |
| *** haomaiwang has joined #openstack-swift | 01:57 | |
| *** haomaiwang has quit IRC | 02:01 | |
| *** haomaiwa_ has joined #openstack-swift | 02:01 | |
| *** DericHorn-HP has joined #openstack-swift | 02:03 | |
| *** DericHorn-HP has quit IRC | 02:16 | |
| *** DericHorn-HP has joined #openstack-swift | 02:18 | |
| *** esker has quit IRC | 02:27 | |
| *** esker has joined #openstack-swift | 02:28 | |
| *** itlinux_ has joined #openstack-swift | 02:31 | |
| *** itlinux has quit IRC | 02:31 | |
| *** DericHorn-HP has quit IRC | 02:33 | |
| *** itlinux has joined #openstack-swift | 02:37 | |
| *** itlinux_ has quit IRC | 02:37 | |
| *** DericHorn-HP has joined #openstack-swift | 02:38 | |
| *** wbhuber has quit IRC | 02:41 | |
| *** annegentle has joined #openstack-swift | 02:43 | |
| *** annegentle has quit IRC | 02:48 | |
| *** DericHorn-HP has quit IRC | 02:52 | |
| *** DericHorn-HP has joined #openstack-swift | 03:00 | |
| *** haomaiwa_ has quit IRC | 03:01 | |
| *** haomaiwang has joined #openstack-swift | 03:01 | |
| *** itlinux_ has joined #openstack-swift | 03:04 | |
| *** itlinux has quit IRC | 03:04 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:08 | |
| *** peluse has quit IRC | 03:09 | |
| *** peluse has joined #openstack-swift | 03:09 | |
| *** hezhiqiang has joined #openstack-swift | 03:10 | |
| *** DericHorn-HP has quit IRC | 03:10 | |
| *** itlinux_ has quit IRC | 03:14 | |
| *** itlinux has joined #openstack-swift | 03:14 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 03:18 | |
| *** peluse has quit IRC | 03:18 | |
| *** peluse has joined #openstack-swift | 03:19 | |
| *** sanchitmalhotra has quit IRC | 03:19 | |
| *** DericHorn-HP has joined #openstack-swift | 03:26 | |
| openstackgerrit | Merged openstack/swift: Add the ability to specify ranges for SLO segments https://review.openstack.org/211726 | 03:35 |
| notmyname | timburke: yay! ^ | 03:38 |
| *** peluse has quit IRC | 03:43 | |
| *** peluse has joined #openstack-swift | 03:44 | |
| *** hezhiqiang has quit IRC | 03:46 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:46 | |
| mattoliverau | I was disappointed the commit message didn't use the word sloranges at all :p | 03:48 |
| *** sanchitmalhotra1 has quit IRC | 03:49 | |
| *** hezhiqiang has joined #openstack-swift | 03:51 | |
| *** peluse has quit IRC | 03:52 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 03:54 | |
| notmyname | that is a glaring oversight | 03:57 |
| *** sanchitmalhotra has quit IRC | 03:57 | |
| *** hezhiqiang has quit IRC | 03:57 | |
| *** haomaiwang has quit IRC | 04:01 | |
| *** haomaiwang has joined #openstack-swift | 04:01 | |
| *** hrou has quit IRC | 04:04 | |
| *** hezhiqiang has joined #openstack-swift | 04:13 | |
| *** trifon has joined #openstack-swift | 04:17 | |
| *** peluse has joined #openstack-swift | 04:25 | |
| *** mahatic has joined #openstack-swift | 04:27 | |
| *** annegentle has joined #openstack-swift | 04:32 | |
| *** annegentle has quit IRC | 04:36 | |
| *** garthb has joined #openstack-swift | 04:39 | |
| *** peluse has quit IRC | 04:44 | |
| *** trifon has quit IRC | 04:47 | |
| *** ppai has joined #openstack-swift | 04:47 | |
| *** fifieldt has joined #openstack-swift | 04:52 | |
| *** itlinux has quit IRC | 04:59 | |
| *** haomaiwang has quit IRC | 05:01 | |
| *** haomaiwang has joined #openstack-swift | 05:01 | |
| *** zhill has joined #openstack-swift | 05:12 | |
| *** garthb has quit IRC | 05:13 | |
| *** trifon has joined #openstack-swift | 05:24 | |
| *** zhill has quit IRC | 05:31 | |
| *** proteusguy__ has quit IRC | 05:32 | |
| cschwede | Good Morning! | 05:42 |
| *** peluse has joined #openstack-swift | 05:44 | |
| *** proteusguy__ has joined #openstack-swift | 05:44 | |
| *** SkyRocknRoll has joined #openstack-swift | 05:48 | |
| *** peluse has quit IRC | 05:53 | |
| *** haomaiwang has quit IRC | 06:01 | |
| *** haomaiwang has joined #openstack-swift | 06:01 | |
| *** DericHorn-HP has quit IRC | 06:02 | |
| *** esker has quit IRC | 06:04 | |
| *** esker has joined #openstack-swift | 06:04 | |
| mahatic | cschwede: good morning! | 06:07 |
| *** trifon has quit IRC | 06:08 | |
| openstackgerrit | Christian Schwede proposed openstack/swift: Enforce require_group validation https://review.openstack.org/227133 | 06:15 |
| *** bkopilov has quit IRC | 06:17 | |
| *** bkopilov has joined #openstack-swift | 06:20 | |
| *** annegentle has joined #openstack-swift | 06:20 | |
| *** annegentle has quit IRC | 06:25 | |
| *** janonymous has joined #openstack-swift | 06:35 | |
| *** bkopilov has quit IRC | 06:39 | |
| *** peluse has joined #openstack-swift | 06:50 | |
| *** bkopilov has joined #openstack-swift | 06:54 | |
| *** peluse has quit IRC | 06:57 | |
| *** silor has joined #openstack-swift | 06:58 | |
| *** ppai has quit IRC | 07:00 | |
| *** haomaiwang has quit IRC | 07:01 | |
| *** haomaiwa_ has joined #openstack-swift | 07:01 | |
| *** mahatic has quit IRC | 07:01 | |
| *** mahatic has joined #openstack-swift | 07:01 | |
| *** rledisez has joined #openstack-swift | 07:07 | |
| *** acoles_ is now known as acoles | 07:08 | |
| *** sc68cal has quit IRC | 07:08 | |
| *** sc68cal has joined #openstack-swift | 07:10 | |
| *** ppai has joined #openstack-swift | 07:12 | |
| *** geaaru has joined #openstack-swift | 07:39 | |
| *** SkyRocknRoll has quit IRC | 07:41 | |
| *** ppai has quit IRC | 07:42 | |
| *** jamielennox is now known as jamielennox|away | 07:53 | |
| *** ppai has joined #openstack-swift | 07:53 | |
| *** peluse has joined #openstack-swift | 07:55 | |
| openstackgerrit | Christian Schwede proposed openstack/swift: Enforce service role validation https://review.openstack.org/227133 | 07:55 |
| *** jordanP has joined #openstack-swift | 07:56 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift: Validate against duplicate device part replica assignment https://review.openstack.org/222799 | 07:59 |
| openstackgerrit | Clay Gerrard proposed openstack/swift: WIP: Unduplicate device part replica assignment https://review.openstack.org/226645 | 07:59 |
| cschwede | acoles: donagh: mattoliverau: please have a look at patch 227133 if you find some time for it - i think this fixes the issue both in tempauth and in keystoneauth | 07:59 |
| patchbot | cschwede: https://review.openstack.org/#/c/227133/ | 07:59 |
| *** SkyRocknRoll has joined #openstack-swift | 07:59 | |
| acoles | cschwede: thanks! i'm away for a few hours today but will try to look | 08:00 |
| *** haomaiwa_ has quit IRC | 08:01 | |
| *** haomaiwang has joined #openstack-swift | 08:01 | |
| *** peluse has quit IRC | 08:04 | |
| *** annegentle has joined #openstack-swift | 08:09 | |
| *** annegentle has quit IRC | 08:14 | |
| *** StevenK has quit IRC | 08:14 | |
| *** classicsnail has quit IRC | 08:14 | |
| *** classicsnail has joined #openstack-swift | 08:15 | |
| *** classicsnail has quit IRC | 08:15 | |
| *** classicsnail has joined #openstack-swift | 08:15 | |
| *** StevenK has joined #openstack-swift | 08:21 | |
| mattoliverau | cschwede: I'll look first thing in the morning, about to jump on a plane :) | 08:21 |
| cschwede | mattoliverau: thx, have a good flight then! | 08:22 |
| *** trifon has joined #openstack-swift | 08:40 | |
| openstackgerrit | Christian Schwede proposed openstack/swift: Enforce service role validation https://review.openstack.org/227133 | 08:44 |
| *** ppai has quit IRC | 08:46 | |
| *** lifeless has quit IRC | 08:49 | |
| *** ppai has joined #openstack-swift | 09:00 | |
| *** peluse has joined #openstack-swift | 09:00 | |
| *** haomaiwang has quit IRC | 09:01 | |
| *** haomaiwang has joined #openstack-swift | 09:01 | |
| *** lifeless has joined #openstack-swift | 09:03 | |
| *** kei_yama has quit IRC | 09:03 | |
| *** km has quit IRC | 09:03 | |
| *** acoles is now known as acoles_ | 09:04 | |
| *** esker has quit IRC | 09:06 | |
| *** esker has joined #openstack-swift | 09:07 | |
| *** peluse has quit IRC | 09:08 | |
| *** aix has quit IRC | 09:29 | |
| *** silor has quit IRC | 09:37 | |
| *** donagh_ has joined #openstack-swift | 09:40 | |
| donagh_ | cschwede: thanks for looking at the service token issue | 09:41 |
| *** esker has quit IRC | 09:44 | |
| *** kei_yama has joined #openstack-swift | 09:46 | |
| *** ppai has quit IRC | 09:54 | |
| *** annegentle has joined #openstack-swift | 09:58 | |
| *** SkyRocknRoll has quit IRC | 10:00 | |
| *** haomaiwang has quit IRC | 10:01 | |
| *** SkyRocknRoll has joined #openstack-swift | 10:01 | |
| *** haomaiwang has joined #openstack-swift | 10:01 | |
| *** aix has joined #openstack-swift | 10:02 | |
| *** annegentle has quit IRC | 10:03 | |
| openstackgerrit | Christian Schwede proposed openstack/swift: Enforce service role validation https://review.openstack.org/227133 | 10:04 |
| *** peluse has joined #openstack-swift | 10:05 | |
| *** ppai has joined #openstack-swift | 10:06 | |
| *** hezhiqiang has quit IRC | 10:07 | |
| openstackgerrit | Christian Schwede proposed openstack/swift: Do not use pre-authenticated requests in staticweb https://review.openstack.org/227204 | 10:10 |
| *** peluse has quit IRC | 10:13 | |
| *** ppai has quit IRC | 10:20 | |
| *** ppai has joined #openstack-swift | 10:35 | |
| *** silor has joined #openstack-swift | 10:36 | |
| *** silor1 has joined #openstack-swift | 10:40 | |
| *** silor has quit IRC | 10:41 | |
| *** silor1 is now known as silor | 10:41 | |
| *** haomaiwang has quit IRC | 10:47 | |
| *** haomaiwang has joined #openstack-swift | 10:48 | |
| *** haomaiwa_ has joined #openstack-swift | 10:48 | |
| *** haomaiwang has quit IRC | 10:48 | |
| *** ntt has joined #openstack-swift | 10:54 | |
| ntt | Hi, someone can help me with swict acl? I'm trying to deny read permission on a container with swift post -r ".r:-.thief.com,demo" container1 but it doesn't work. | 10:55 |
| ntt | I would like deny read permission for all users of demo tenant. | 10:55 |
| *** silor has quit IRC | 10:56 | |
| *** haomaiwa_ has quit IRC | 11:01 | |
| *** haomaiwa_ has joined #openstack-swift | 11:01 | |
| *** peluse has joined #openstack-swift | 11:10 | |
| *** peluse has quit IRC | 11:18 | |
| *** ccavanna_ has quit IRC | 11:27 | |
| *** cdelatte has joined #openstack-swift | 11:28 | |
| *** ppai has quit IRC | 11:42 | |
| *** SkyRocknRoll has quit IRC | 11:43 | |
| *** ndk has quit IRC | 11:46 | |
| *** portante has quit IRC | 11:46 | |
| *** annegentle has joined #openstack-swift | 11:47 | |
| *** hezhiqiang has joined #openstack-swift | 11:49 | |
| *** annegentle has quit IRC | 11:52 | |
| *** ppai has joined #openstack-swift | 11:54 | |
| *** SkyRocknRoll has joined #openstack-swift | 11:56 | |
| *** haomaiwa_ has quit IRC | 12:01 | |
| *** haomaiwang has joined #openstack-swift | 12:01 | |
| *** bkopilov has quit IRC | 12:03 | |
| cschwede | ntt: that doesn’t work - you can only allow access with acls, but not deny specific users | 12:05 |
| openstackgerrit | Christian Schwede proposed openstack/swift: Do not use pre-authenticated requests in staticweb https://review.openstack.org/227204 | 12:05 |
| *** ppai has quit IRC | 12:06 | |
| cschwede | ntt: your rule ".r:-.thief.com,demo“ basically allows reading based on referrers for anyone coming from the domain „thief.com“ | 12:06 |
| *** portante has joined #openstack-swift | 12:09 | |
| *** haomaiwang has quit IRC | 12:09 | |
| *** portante has quit IRC | 12:14 | |
| *** portante has joined #openstack-swift | 12:15 | |
| *** peluse has joined #openstack-swift | 12:15 | |
| *** sayali has quit IRC | 12:17 | |
| *** ppai has joined #openstack-swift | 12:17 | |
| *** sayali has joined #openstack-swift | 12:20 | |
| *** annegentle has joined #openstack-swift | 12:22 | |
| *** ccavanna has joined #openstack-swift | 12:23 | |
| *** peluse has quit IRC | 12:26 | |
| *** cdelatte has quit IRC | 12:31 | |
| *** kei_yama has quit IRC | 12:32 | |
| *** annegentle has quit IRC | 12:34 | |
| *** jamielennox|away is now known as jamielennox | 12:37 | |
| *** esker has joined #openstack-swift | 12:38 | |
| *** esker has quit IRC | 12:38 | |
| *** esker has joined #openstack-swift | 12:39 | |
| *** ppai has quit IRC | 12:41 | |
| *** peluse has joined #openstack-swift | 12:48 | |
| *** ppai has joined #openstack-swift | 12:57 | |
| *** tongli has joined #openstack-swift | 13:00 | |
| *** pberis has joined #openstack-swift | 13:00 | |
| *** NM has joined #openstack-swift | 13:02 | |
| *** cdelatte has joined #openstack-swift | 13:03 | |
| *** mac_ified has joined #openstack-swift | 13:04 | |
| *** acoles_ is now known as acoles | 13:07 | |
| *** sayali has quit IRC | 13:10 | |
| *** bill_az has joined #openstack-swift | 13:10 | |
| *** thumpba has joined #openstack-swift | 13:11 | |
| *** hrou has joined #openstack-swift | 13:12 | |
| *** sayali has joined #openstack-swift | 13:13 | |
| *** alejandrito has joined #openstack-swift | 13:14 | |
| *** peluse has quit IRC | 13:16 | |
| hrou | anyone else finding *review.openstack* really slow today ? | 13:29 |
| *** dustins has joined #openstack-swift | 13:36 | |
| *** thumpba has quit IRC | 13:39 | |
| *** jkugel has joined #openstack-swift | 13:40 | |
| *** thumpba has joined #openstack-swift | 13:40 | |
| *** peluse has joined #openstack-swift | 13:41 | |
| *** esker has quit IRC | 13:41 | |
| *** haomaiwang has joined #openstack-swift | 13:43 | |
| *** thumpba has quit IRC | 13:52 | |
| *** cdelatte has quit IRC | 13:54 | |
| mahatic | hrou: not me | 13:54 |
| hrou | mahatic, thanks its much better now, I asked a couple other folks at the time and they were experiencing similar issues, so it wasn't just me (at least an hour or so back : - ) | 13:55 |
| mahatic | hrou: ah okay :) | 13:55 |
| *** peluse has quit IRC | 13:56 | |
| *** peluse has joined #openstack-swift | 13:57 | |
| *** haomaiwang has quit IRC | 14:01 | |
| *** peluse has quit IRC | 14:01 | |
| *** haomaiwang has joined #openstack-swift | 14:01 | |
| *** breitz has quit IRC | 14:10 | |
| *** breitz has joined #openstack-swift | 14:11 | |
| *** j_king has quit IRC | 14:12 | |
| *** SkyRocknRoll has quit IRC | 14:12 | |
| *** anncorrao has joined #openstack-swift | 14:12 | |
| *** wbhuber has joined #openstack-swift | 14:17 | |
| *** ccavanna has quit IRC | 14:19 | |
| *** jrichli has quit IRC | 14:23 | |
| *** ccavanna has joined #openstack-swift | 14:24 | |
| *** marzif has joined #openstack-swift | 14:26 | |
| *** jamielennox is now known as jamielennox|away | 14:26 | |
| *** cdelatte has joined #openstack-swift | 14:29 | |
| *** NM has quit IRC | 14:31 | |
| *** NM has joined #openstack-swift | 14:31 | |
| *** marzif_ has joined #openstack-swift | 14:34 | |
| *** marzif has quit IRC | 14:37 | |
| *** jlhinson has joined #openstack-swift | 14:38 | |
| *** garthb has joined #openstack-swift | 14:40 | |
| *** trifon has quit IRC | 14:42 | |
| *** ppai has quit IRC | 14:49 | |
| *** ndk has joined #openstack-swift | 14:50 | |
| *** cdelatte has quit IRC | 14:51 | |
| *** jrichli has joined #openstack-swift | 14:52 | |
| *** thumpba has joined #openstack-swift | 14:52 | |
| *** cdelatte has joined #openstack-swift | 14:56 | |
| *** minwoob has joined #openstack-swift | 14:56 | |
| *** hrou has left #openstack-swift | 14:58 | |
| *** hrou has joined #openstack-swift | 14:58 | |
| *** haomaiwang has quit IRC | 15:01 | |
| *** haomaiwang has joined #openstack-swift | 15:01 | |
| *** annegentle has joined #openstack-swift | 15:01 | |
| *** haomaiwang has quit IRC | 15:03 | |
| *** lpabon has joined #openstack-swift | 15:03 | |
| *** marzif_ has quit IRC | 15:03 | |
| *** fifieldt has quit IRC | 15:05 | |
| *** NM has quit IRC | 15:05 | |
| *** marzif_ has joined #openstack-swift | 15:07 | |
| *** annegentle has quit IRC | 15:09 | |
| *** annegentle has joined #openstack-swift | 15:09 | |
| *** cdelatte has quit IRC | 15:11 | |
| *** jordan_ has joined #openstack-swift | 15:16 | |
| *** jordanP has quit IRC | 15:16 | |
| *** marzif_ has quit IRC | 15:18 | |
| *** clarissa has joined #openstack-swift | 15:23 | |
| clarissa | How can I get a list of filenames in a Swift directory? e.g. something like mydata = sc.textFile("swift://myswifturi/*") | 15:24 |
| janonymous | os.listdir | 15:27 |
| clarissa | janonymous, will that be appropriate for a swift:// uri? | 15:27 |
| clarissa | janonymous, also, is it ok if there are 30 million files in the directory? | 15:28 |
| *** ccavanna has quit IRC | 15:28 | |
| janonymous | clarissa: i am not sure of that, it's a python command.are you talking about cli ? | 15:29 |
| clarissa | janonymous, no that is correct, I use python and spark | 15:29 |
| *** NM has joined #openstack-swift | 15:29 | |
| janonymous | results would be stored in a list. list size depends on your system | 15:30 |
| clarissa | janonymous, cool, I'll try it now | 15:30 |
| *** esker has joined #openstack-swift | 15:34 | |
| clarissa | janonymous: no I keep getting "No such file or directory" for os.listdir("swift://myswifturi/*") and os.listdir("swift://myswifturi/") and os.listdir("swift://myswifturi") | 15:39 |
| clarissa | I know that directory definitely has working accessible files | 15:40 |
| *** esker has quit IRC | 15:40 | |
| *** lpabon has quit IRC | 15:40 | |
| *** esker has joined #openstack-swift | 15:41 | |
| clarissa | Oh, but you know what, os.listdir does not have the Auth details, so the Swift URI is meaningless | 15:43 |
| janonymous | yes, you might be needing a cli i guess | 15:48 |
| janonymous | python command won't work simply i think | 15:48 |
| janonymous | Could you tell, what are you trying to access | 15:49 |
| *** esker has quit IRC | 15:53 | |
| janonymous | clarissa_ : are you using some type of api like amazon.. | 15:58 |
| *** sanchitmalhotra1 has quit IRC | 16:01 | |
| *** marzif has joined #openstack-swift | 16:03 | |
| glange | clarissa: do you want a list of containers or object stored in a swift account or swift container? | 16:04 |
| notmyname | good morning | 16:04 |
| *** cdelatte has joined #openstack-swift | 16:08 | |
| *** mfalatic has joined #openstack-swift | 16:09 | |
| clarissa | janonymous, glange, I'm using SparkContext to handle Swift objects, but it seems I can't just use swift:// URI's, I have to manipulate request headers and get/head/put etc. | 16:11 |
| hrou | clarissa, for spark that should work the format looks like: "swift://cfg.SparkTest/smallTest") < this is pointing to container CFG, assuming you have something like <name>fs.swift.service.SparkTest.auth.url</name> in core-site.xml | 16:14 |
| *** cdelatte has quit IRC | 16:17 | |
| *** esker has joined #openstack-swift | 16:17 | |
| *** rledisez has quit IRC | 16:19 | |
| hrou | jrichli, mahatic, I'd like to rebase 194191 so we can start reviewing it, do you mind if I do that ? | 16:20 |
| hrou | patch 194191 | 16:20 |
| patchbot | hrou: https://review.openstack.org/#/c/194191/ | 16:20 |
| jrichli | hrou: it doesn't look like it needs rebasing | 16:23 |
| jrichli | but, maybe i am wrong | 16:23 |
| *** cdelatte has joined #openstack-swift | 16:23 | |
| *** joearnold has quit IRC | 16:24 | |
| *** eikke has quit IRC | 16:24 | |
| *** wolsen has quit IRC | 16:24 | |
| *** ndk has quit IRC | 16:24 | |
| *** ctennis has quit IRC | 16:24 | |
| *** wolsen has joined #openstack-swift | 16:24 | |
| hrou | jrichli, hmm, no more likely me : ) But when I look at proxy-server.conf-sample for example, I can see the keymaster segment in the pipeline conf doesn't match what I see on crypto latest | 16:25 |
| *** eikke has joined #openstack-swift | 16:25 | |
| hrou | jrichli, its missing the '.' after the "This option is part of enabling encryption for testing purposes", which was the major blunder I caught from acoles initial patch set ; ) | 16:25 |
| *** ctennis has joined #openstack-swift | 16:25 | |
| *** joearnold has joined #openstack-swift | 16:26 | |
| jrichli | ok sure | 16:26 |
| *** lyrrad has joined #openstack-swift | 16:26 | |
| *** dustins is now known as dustins|afk | 16:26 | |
| *** ndk has joined #openstack-swift | 16:27 | |
| mahatic | hrou: if the 'major blunder' is the only diff, we could do away w/o a rebase maybe? :) | 16:28 |
| hrou | mahatic, : ) I'm not sure if there are other diffs, no worries let me give rebasing a go quickly on my branch and see. | 16:29 |
| mahatic | sure | 16:29 |
| *** ccavanna has joined #openstack-swift | 16:29 | |
| notmyname | cschwede: I've updated https://wiki.openstack.org/wiki/Swift/PriorityReviews with your patch for the copy/service token thing | 16:29 |
| notmyname | which seems to be more than copy now | 16:29 |
| *** hezhiqiang has quit IRC | 16:33 | |
| *** lpabon has joined #openstack-swift | 16:34 | |
| *** jordan_ has quit IRC | 16:37 | |
| *** rohit_ has joined #openstack-swift | 16:38 | |
| *** chsc has joined #openstack-swift | 16:42 | |
| openstackgerrit | Donagh McCabe proposed openstack/swift: Add func tests for COPY and service tokens https://review.openstack.org/227421 | 16:42 |
| *** esker has quit IRC | 16:50 | |
| *** jordanP has joined #openstack-swift | 16:56 | |
| *** trifon has joined #openstack-swift | 17:00 | |
| *** anncorrao has quit IRC | 17:00 | |
| *** marzif has quit IRC | 17:05 | |
| *** geaaru has quit IRC | 17:05 | |
| *** marzif has joined #openstack-swift | 17:05 | |
| *** ccavanna has quit IRC | 17:07 | |
| *** ccavanna has joined #openstack-swift | 17:08 | |
| *** pberis has quit IRC | 17:10 | |
| clarissa | hrou, thanks all, I just use python request and authenticate as prescribed and get container file listings as prescribed in http://developer.openstack.org/api-ref-objectstorage-v1.html | 17:22 |
| *** janonymous_ has joined #openstack-swift | 17:25 | |
| *** cdelatte has quit IRC | 17:25 | |
| *** clarissa has quit IRC | 17:29 | |
| openstackgerrit | Hamdi Roumani proposed openstack/swift: Encrypter and Decrypter middleware - object body only https://review.openstack.org/194191 | 17:32 |
| *** hezhiqiang has joined #openstack-swift | 17:34 | |
| *** tongli has quit IRC | 17:34 | |
| *** tongli has joined #openstack-swift | 17:35 | |
| hrou | mahatic, jrichli, so I rebased (given all its dependencies landed), but I think it still confused about that line in the proxy-server.conf-sample, it thinks we intentionally changed that (and maybe one of the patch sets did?) even though really we just wanted it to be pulled from the dependent patch that now landed (i.e. trival_keymaster).. | 17:35 |
| hrou | mahatic, jrichli, I'll push a change to fix that, given the rest looks Ok actually (as they're all new files that weren't involved in any of the other landed dependent patches).). | 17:36 |
| *** hezhiqiang has quit IRC | 17:38 | |
| *** tongli has quit IRC | 17:39 | |
| *** cdelatte has joined #openstack-swift | 17:40 | |
| *** delattec has joined #openstack-swift | 17:40 | |
| *** tongli has joined #openstack-swift | 17:46 | |
| *** tongli has quit IRC | 17:49 | |
| openstackgerrit | Hamdi Roumani proposed openstack/swift: Encrypter and Decrypter middleware - object body only https://review.openstack.org/194191 | 17:49 |
| *** aix has quit IRC | 17:52 | |
| mahatic | hrou: yes, it must be an intentional (rather accidental) change. the dot. but if you wanted merged changes, you could have probably updated your feature branch instead of rebase I suppose? | 17:53 |
| hrou | mahatic, yea no worries (I realized we acutally intentionally changed the comment slightly to refer to putting it after decrypter), I cleaned it up above, feel free to comment on that in the review. | 17:54 |
| *** dustins|afk is now known as dustins | 17:56 | |
| *** annegentle has quit IRC | 17:57 | |
| *** eranrom has joined #openstack-swift | 18:00 | |
| *** NM has quit IRC | 18:01 | |
| *** NM has joined #openstack-swift | 18:01 | |
| *** janonymous_ has quit IRC | 18:07 | |
| *** cdelatte has quit IRC | 18:11 | |
| *** delattec has quit IRC | 18:11 | |
| *** delattec has joined #openstack-swift | 18:14 | |
| *** cdelatte has joined #openstack-swift | 18:14 | |
| *** zhill has joined #openstack-swift | 18:28 | |
| *** mahatic has quit IRC | 18:37 | |
| *** agomez has joined #openstack-swift | 18:39 | |
| *** jordanP has quit IRC | 18:41 | |
| *** delattec has quit IRC | 18:48 | |
| *** cdelatte has quit IRC | 18:48 | |
| *** esker has joined #openstack-swift | 18:51 | |
| *** esker has quit IRC | 18:52 | |
| *** esker has joined #openstack-swift | 18:52 | |
| minwoob | Is the .durable really necessary? | 18:52 |
| *** NM has quit IRC | 18:53 | |
| *** thumpba has quit IRC | 18:57 | |
| *** lcurtis has joined #openstack-swift | 18:58 | |
| *** aix has joined #openstack-swift | 19:01 | |
| *** pberis has joined #openstack-swift | 19:02 | |
| *** lpabon has quit IRC | 19:03 | |
| *** agomez has quit IRC | 19:12 | |
| *** sloslo has joined #openstack-swift | 19:17 | |
| sloslo | does any one have any experiences deploying swift through using mirantis fuel? is it possible to make some pre-configuration within some file before deployment of the swift node through Mirantis fuel GUI? | 19:18 |
| notmyname | sloslo: I don't know, but hugokuo might. he's worked a little with fuel recently. however, it's 3am for him right now | 19:22 |
| sloslo | notmyname: ok. thx for info. i will talk to hime later .. | 19:23 |
| *** agomez has joined #openstack-swift | 19:24 | |
| *** evilrob has left #openstack-swift | 19:30 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: Enable object server to return non-durable data https://review.openstack.org/215276 | 19:30 |
| *** agomez has quit IRC | 19:31 | |
| acoles | clayg: i started implementing your proxy->backend frag preferences idea today. its gonna be great but its *not* in this update ^^, had to take some time out today. | 19:34 |
| *** earlephilhower has joined #openstack-swift | 19:36 | |
| minwoob | clayg: acoles: For patch 215276 | 19:40 |
| patchbot | minwoob: https://review.openstack.org/#/c/215276/ | 19:40 |
| minwoob | I can go ahead and make the {503,416} -> 404 changes if that helps. | 19:41 |
| minwoob | Also, based on what I've gathered so far, I'm wondering whether we really the .durable markers. | 19:44 |
| minwoob | need* the | 19:44 |
| *** agomez has joined #openstack-swift | 19:45 | |
| minwoob | whether we really need the .durable markers* | 19:45 |
| acoles | minwoob: thanks. re 503/404/416s: sure but could you do so in a dependent patch, and i can't promise the bucket class is not going to change somewhat. | 19:46 |
| *** agomez has quit IRC | 19:47 | |
| acoles | minwoob: what would really help would be some test infrastructure e.g. a utility method to copy a .data file between dirs - i do not believe the copy() or copy2() methods copy xattrs. | 19:47 |
| acoles | minwoob: OR to think of some other way to generate the same frag in multiple dirs in unit/proxy/test_server.py tests | 19:48 |
| acoles | predictably | 19:49 |
| acoles | minwoob: those few tests added in proy/test_server could do with beefing up. What would be really nice is to describe what is on each node in a simple data struct and have a helper method to go setup the object server dirs ready for the test + assertions | 19:51 |
| *** agomez has joined #openstack-swift | 19:51 | |
| minwoob | acoles: peluse: Yeah, I remember that being an issue in patch 213147 as well (regarding the xattrs). | 19:51 |
| patchbot | minwoob: https://review.openstack.org/#/c/213147/ | 19:51 |
| acoles | minwoob: exactly | 19:52 |
| *** alejandrito has quit IRC | 19:53 | |
| *** hezhiqiang has joined #openstack-swift | 19:54 | |
| notmyname | anyone else seeing runtime errors when running unit tests? but no test failures | 19:55 |
| notmyname | https://gist.githubusercontent.com/notmyname/d1a28b5ad459d151c17d/raw/8048926f1656377548b2e2cf6dbead8e00f3ca6d/gistfile1.txt | 19:57 |
| *** agomez has quit IRC | 19:58 | |
| *** hezhiqiang has quit IRC | 19:59 | |
| acoles | minwoob: i'm curious why this test passes test.unit.proxy.controllers.test_obj.TestECObjController#test_GET_with_missing_and_range_unsatisifiable - i wonder if there is something funny with the quorum when handling the bad gets case? | 20:01 |
| acoles | notmyname: not me | 20:02 |
| *** agomez has joined #openstack-swift | 20:02 | |
| notmyname | hmm | 20:02 |
| *** acoles is now known as acoles_ | 20:06 | |
| *** breitz has quit IRC | 20:10 | |
| *** breitz has joined #openstack-swift | 20:11 | |
| *** eranrom has quit IRC | 20:14 | |
| minwoob | acoles_: Thanks for the roadmap. I'll keep you posted. | 20:15 |
| *** ccavanna has quit IRC | 20:22 | |
| *** patchbot has quit IRC | 20:24 | |
| *** agomez has quit IRC | 20:28 | |
| *** NM has joined #openstack-swift | 20:31 | |
| *** gyee has joined #openstack-swift | 20:34 | |
| notmyname | patch 227133 | 20:34 |
| *** patchbot has joined #openstack-swift | 20:34 | |
| notmyname | patch 227133 | 20:34 |
| patchbot | notmyname: https://review.openstack.org/#/c/227133/ - Enforce service role validation | 20:34 |
| notmyname | thanks timburke for the patch to add the subject line to patchbot | 20:35 |
| *** patchbot has quit IRC | 20:35 | |
| *** patchbot has joined #openstack-swift | 20:35 | |
| jlhinson | notmyname: I am | 20:42 |
| jlhinson | notmyname: the exact same error | 20:42 |
| *** agomez has joined #openstack-swift | 20:48 | |
| notmyname | jlhinson: any hints yet on solving it? ;-) | 20:53 |
| jlhinson | I was hoping you would have it figured out by now... :) | 20:54 |
| notmyname | heh | 20:54 |
| notmyname | I do know that upgrading everything doesn't fix it | 20:54 |
| timburke | i think it may have to do with my slorange patch...although i'm unclear about what's outputting it | 20:58 |
| *** trifon has quit IRC | 20:58 | |
| hrou | Yep I'm seeing it too, though if you use tox you probably won't notice it ; ) Given all the scroll down. | 20:59 |
| notmyname | timburke: tests running. look likely | 20:59 |
| *** rohit_ has quit IRC | 21:00 | |
| notmyname | timburke: no more generator errors. but I still get the ChunkWriteTimeout | 21:01 |
| notmyname | with patch a7837c785a18d3dffa8ba3e948e8bcc9a676d2fe | 21:01 |
| timburke | i see it now. when i'm coalescing requests, i keep one in the works (in case the next request i encounter is to the same object), and if i hit an error, i still process that one pending request | 21:02 |
| timburke | notmyname: this bit https://github.com/openstack/swift/blob/master/swift/common/request_helpers.py#L345-L346 | 21:03 |
| *** NM has quit IRC | 21:06 | |
| *** hrou has quit IRC | 21:07 | |
| *** jrichli has quit IRC | 21:27 | |
| *** agomez has quit IRC | 21:27 | |
| *** dustins has quit IRC | 21:31 | |
| *** eikke has quit IRC | 21:40 | |
| *** marzif has quit IRC | 21:40 | |
| *** eikke has joined #openstack-swift | 21:41 | |
| *** alejandrito has joined #openstack-swift | 21:41 | |
| *** hezhiqiang has joined #openstack-swift | 21:45 | |
| cschwede | notmyname: alright, i will have a look at the priority reviews tomorrow morning again | 21:47 |
| notmyname | cschwede: thanks | 21:47 |
| *** wbhuber has quit IRC | 21:47 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Only yield the pending segment on error if it's a SegmentListingError https://review.openstack.org/227569 | 21:51 |
| timburke | notmyname: ^^^ | 21:51 |
| timburke | got nothing on the ChunkWriteTimeout error, but if we can fix it, it'll probably make .unittests go faster | 21:52 |
| *** peluse has joined #openstack-swift | 22:00 | |
| *** thumpba has joined #openstack-swift | 22:06 | |
| *** jlhinson has quit IRC | 22:11 | |
| *** jkugel has quit IRC | 22:13 | |
| *** garthb has quit IRC | 22:15 | |
| *** thumpba_ has joined #openstack-swift | 22:17 | |
| *** hezhiqiang has quit IRC | 22:18 | |
| *** hrou has joined #openstack-swift | 22:19 | |
| *** thumpba has quit IRC | 22:20 | |
| *** NM has joined #openstack-swift | 22:29 | |
| *** NM has quit IRC | 22:30 | |
| notmyname | peluse: around? | 22:33 |
| mattoliverau | Morning | 22:35 |
| notmyname | hi mattoliverau | 22:35 |
| mattoliverau | notmyname: o/ cafe hacking from Canberra today, I expect to drink too much coffee, but hopefully means more code reviews :p | 22:38 |
| notmyname | :-) | 22:39 |
| *** wbhuber has joined #openstack-swift | 22:41 | |
| *** lcurtis has quit IRC | 22:44 | |
| notmyname | I'm trying to figure out a volkswagen error. everything passes when I run the whole test suite, but if I run one test specifically, it fails | 22:45 |
| MooingLemur | :) | 22:45 |
| mattoliverau | Lol | 22:46 |
| *** thumpba_ has quit IRC | 22:48 | |
| *** thumpba has joined #openstack-swift | 22:48 | |
| clayg | notmyname: i don't get it | 22:50 |
| notmyname | clayg: things seem to be fine, but if you look closely, nothing is working like it should | 22:50 |
| *** pberis has quit IRC | 22:51 | |
| notmyname | on patch 186735 the added tests pass if the whole test class is run. but running the specific test by itself makes it fail. | 22:53 |
| patchbot | notmyname: https://review.openstack.org/#/c/186735/ - Fix missing container update | 22:53 |
| notmyname | TestReplicatedObjController.test_container_update_backend_requests | 22:54 |
| notmyname | TestReplicatedObjControllerVariousReplicas.test_container_update_backend_requests_replicated_more_objects | 22:54 |
| notmyname | those fail if running specifically by themselves. they pass if the entire TestReplicatedObjController is run | 22:54 |
| notmyname | or TestReplicatedObjControllerVariousReplicas | 22:54 |
| notmyname | so what I'm trying to figure out is why, when the whole class is run, is the 1 replica ring set as 4 replicas | 22:57 |
| *** km has joined #openstack-swift | 23:02 | |
| *** alejandrito has quit IRC | 23:03 | |
| *** thumpba has quit IRC | 23:06 | |
| *** jrichli has joined #openstack-swift | 23:08 | |
| minwoob | Hey is anyone having issues connecting with gerrit? | 23:11 |
| minwoob | Basically, any sort of 'git review' command. | 23:11 |
| *** zhill has quit IRC | 23:13 | |
| *** chsc has quit IRC | 23:20 | |
| *** thumpba has joined #openstack-swift | 23:25 | |
| jrichli | minwoob: hrou said gerrit commands were slow for him early this morning. As for me, I have had off and on issues with connecting to gerrit starting this weekend. | 23:36 |
| *** kei_yama has joined #openstack-swift | 23:37 | |
| hrou | jrichli, minwoob - yep but its been fine ever since, though haven't tried anything in the last hour or so | 23:37 |
| jrichli | minwoob hrou: you can try a VM reboot. At one point, even though my VM could connect to the internet, it couldn't connect to gerrit. A reboot fixed that for some reason. | 23:38 |
| hrou | thanks jrichli ! I'll keep that in mind. In the mroning fairly sure it was a server issue as even viewing reviews was painful | 23:41 |
| jrichli | hrou : yea, it sounds like its gerrit that might have been a little unstable lately. I am sure my reboot fix was just luck of timing :-) | 23:42 |
| hrou | jrichli, haha : ) Nah I've had some funky vm issues in the past where a reboot did the trick. | 23:42 |
| minwoob | jrichli: hrou: Thanks. And good luck! :) | 23:46 |
| *** wbhuber_ has joined #openstack-swift | 23:54 | |
| *** thumpba_ has joined #openstack-swift | 23:54 | |
| *** jamielennox|away is now known as jamielennox | 23:56 | |
| *** thumpba has quit IRC | 23:56 | |
| *** wbhuber has quit IRC | 23:56 | |
| *** sayali has quit IRC | 23:56 | |
| *** darrenc has quit IRC | 23:57 | |
| *** briancline has quit IRC | 23:57 | |
| *** darrenc_ has joined #openstack-swift | 23:57 | |
| *** darrenc_ is now known as darrenc | 23:58 | |
| *** briancline has joined #openstack-swift | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!