Friday, 2015-10-16

*** BAKfr has joined #openstack-swift00:05
*** dmsimard has joined #openstack-swift00:05
*** Guest62185 has joined #openstack-swift00:05
*** pchng has joined #openstack-swift00:05
*** aix has joined #openstack-swift00:05
*** wshao has joined #openstack-swift00:05
*** baffle has joined #openstack-swift00:05
*** jbonjean has joined #openstack-swift00:05
*** remix_tj has joined #openstack-swift00:05
*** ajiang has joined #openstack-swift00:05
*** dkleute has joined #openstack-swift00:07
*** hogepodge has joined #openstack-swift00:07
*** ho has joined #openstack-swift00:07
*** petertr7 has joined #openstack-swift00:07
*** clayg has joined #openstack-swift00:07
*** Guest43684 has joined #openstack-swift00:07
*** eikke has joined #openstack-swift00:07
*** klrmn1 has joined #openstack-swift00:07
*** eariasn has joined #openstack-swift00:07
*** yuan has joined #openstack-swift00:07
*** pberis has joined #openstack-swift00:07
*** bhakta has joined #openstack-swift00:07
*** alpha_ori has joined #openstack-swift00:07
*** pgbridge has joined #openstack-swift00:07
*** ndk has joined #openstack-swift00:07
*** early has joined #openstack-swift00:07
*** ekarlso has joined #openstack-swift00:07
*** Anticimex has joined #openstack-swift00:07
*** tanee has joined #openstack-swift00:07
*** anderstj has joined #openstack-swift00:07
*** bobby2 has joined #openstack-swift00:07
*** wer has joined #openstack-swift00:07
*** joearnold has joined #openstack-swift00:07
*** ejat has joined #openstack-swift00:07
*** goodygum has joined #openstack-swift00:07
*** cschwede has joined #openstack-swift00:07
*** raginbajin has joined #openstack-swift00:07
*** cameron.freenode.net sets mode: +vv clayg cschwede00:07
*** mtreinish has joined #openstack-swift00:07
*** daemontool_ has joined #openstack-swift00:07
*** onovy has joined #openstack-swift00:07
*** HenryG has joined #openstack-swift00:07
*** elmo has joined #openstack-swift00:07
*** hurricanerix has joined #openstack-swift00:07
*** charz has joined #openstack-swift00:07
*** cebruns has joined #openstack-swift00:07
*** bwall has joined #openstack-swift00:07
*** tamizh_geek has joined #openstack-swift00:07
*** blmartin_ has joined #openstack-swift00:08
*** hrou has joined #openstack-swift00:08
*** ujjain has joined #openstack-swift00:08
*** zackmdavis has joined #openstack-swift00:08
*** timburke has joined #openstack-swift00:08
*** blmartin_w has joined #openstack-swift00:08
*** bkeller has joined #openstack-swift00:08
*** rminmin has joined #openstack-swift00:08
*** earlephilhower has joined #openstack-swift00:08
*** janonymous__ has joined #openstack-swift00:08
*** janonymous has joined #openstack-swift00:08
*** mac_ified has joined #openstack-swift00:08
*** sileht has joined #openstack-swift00:08
*** mplex has joined #openstack-swift00:08
*** wolsen has joined #openstack-swift00:08
*** kragniz has joined #openstack-swift00:08
*** sc68cal has joined #openstack-swift00:08
*** _fortis has joined #openstack-swift00:08
*** ondergetekende has joined #openstack-swift00:08
*** glange has joined #openstack-swift00:08
*** cameron.freenode.net sets mode: +v glange00:08
*** dkleute has quit IRC00:08
*** elligottmc has joined #openstack-swift00:09
*** dkleute has joined #openstack-swift00:09
*** rminmin has quit IRC00:09
*** rminmin has joined #openstack-swift00:09
*** bkeller has quit IRC00:09
*** bkeller has joined #openstack-swift00:09
*** blmartin_w has quit IRC00:09
*** blmartin_w has joined #openstack-swift00:09
*** mlanner has joined #openstack-swift00:10
*** patchbot has joined #openstack-swift00:10
*** mfalatic has joined #openstack-swift00:10
*** zul has joined #openstack-swift00:10
*** torgomatic has joined #openstack-swift00:10
*** hugokuo has joined #openstack-swift00:10
*** cameron.freenode.net sets mode: +v torgomatic00:10
eariasnhello00:10
dkleutehi00:10
*** aix has quit IRC00:11
*** elligottmc has quit IRC00:12
*** elligottmc has joined #openstack-swift00:12
*** hubing has joined #openstack-swift00:12
*** hubing has quit IRC00:13
*** hubing has joined #openstack-swift00:13
*** proteusguy__ has joined #openstack-swift00:13
*** gyee has joined #openstack-swift00:13
*** marcusvrn_ has joined #openstack-swift00:13
*** briancurtin has joined #openstack-swift00:13
*** StevenK has joined #openstack-swift00:13
*** chmouel has joined #openstack-swift00:13
*** amandap has joined #openstack-swift00:13
*** minwoob has joined #openstack-swift00:13
*** MooingLemur has joined #openstack-swift00:13
*** david-lyle has joined #openstack-swift00:13
*** wasmum- has joined #openstack-swift00:13
*** guitarzan has joined #openstack-swift00:13
*** acorwin_ has joined #openstack-swift00:13
*** then3rd has joined #openstack-swift00:13
*** zhiyan has joined #openstack-swift00:13
*** acoles_ has joined #openstack-swift00:13
*** swat30 has joined #openstack-swift00:13
*** logan2 has joined #openstack-swift00:13
*** morgan has joined #openstack-swift00:13
*** dfg_ has joined #openstack-swift00:13
*** tdasilva has joined #openstack-swift00:13
*** swifterdarrell has joined #openstack-swift00:13
*** kota_ has joined #openstack-swift00:13
*** thurloat_isgone has joined #openstack-swift00:13
*** klrmn has joined #openstack-swift00:13
*** cameron.freenode.net sets mode: +vvv acoles_ tdasilva swifterdarrell00:13
*** lpabon has joined #openstack-swift00:14
*** Guest40120 has joined #openstack-swift00:14
*** kei_yama has joined #openstack-swift00:14
*** alejandrito has joined #openstack-swift00:14
*** openstackgerrit has joined #openstack-swift00:14
*** vinsh has joined #openstack-swift00:14
*** treyd_ has joined #openstack-swift00:14
*** okdas has joined #openstack-swift00:14
*** amit213 has joined #openstack-swift00:14
*** blair has joined #openstack-swift00:14
*** hugespoon has joined #openstack-swift00:14
*** dhellmann has joined #openstack-swift00:14
*** saltsa has joined #openstack-swift00:14
*** aerwin3_ has joined #openstack-swift00:14
*** jeblair has joined #openstack-swift00:14
*** EmilienM has joined #openstack-swift00:14
*** notmyname has joined #openstack-swift00:14
*** cameron.freenode.net sets mode: +v notmyname00:14
blmartin_wwas anyone else having strange issues with the channel looking like it only had maybe 5 people it it?00:14
*** diogogmt has joined #openstack-swift00:14
*** dosaboy has joined #openstack-swift00:14
*** nottrobin has joined #openstack-swift00:14
*** balajir has joined #openstack-swift00:14
*** shakamunyi has joined #openstack-swift00:14
*** ahale has joined #openstack-swift00:14
*** bapalm has joined #openstack-swift00:14
*** zhill has joined #openstack-swift00:14
*** jmccarthy has joined #openstack-swift00:14
*** j_king has joined #openstack-swift00:14
*** dabukalam has joined #openstack-swift00:14
*** timur has joined #openstack-swift00:14
*** mandarine has joined #openstack-swift00:14
*** tristanC has joined #openstack-swift00:14
*** csmart has joined #openstack-swift00:14
*** anteaya has joined #openstack-swift00:14
*** wasmum- has quit IRC00:14
*** david-lyle has quit IRC00:14
*** alejandrito has quit IRC00:15
*** hubing has quit IRC00:16
*** diogogmt has quit IRC00:17
*** wasmum has joined #openstack-swift00:17
*** wasmum has quit IRC00:17
*** wasmum has joined #openstack-swift00:17
*** gmmaha has joined #openstack-swift00:17
*** hubing has joined #openstack-swift00:17
*** dkleute is now known as 5EXAAAOHG00:17
rminminno, I cloud see many people in this channel00:18
*** garthb_ has quit IRC00:18
*** khoah64 has joined #openstack-swift00:19
*** darrenc has joined #openstack-swift00:19
*** jodah has joined #openstack-swift00:19
*** chrisnelson has joined #openstack-swift00:19
*** CaioBren_ has joined #openstack-swift00:19
*** portante has joined #openstack-swift00:19
*** fbo has joined #openstack-swift00:19
*** serverascode has joined #openstack-swift00:19
*** philipw has joined #openstack-swift00:19
*** jamielennox has joined #openstack-swift00:19
*** peluse has joined #openstack-swift00:19
*** mitz_ has joined #openstack-swift00:19
*** ctennis has joined #openstack-swift00:19
*** cppforlife_ has joined #openstack-swift00:19
*** zigo has joined #openstack-swift00:19
*** tonyb has joined #openstack-swift00:19
*** sayali has joined #openstack-swift00:19
*** zacksh has joined #openstack-swift00:19
*** clyps_ has joined #openstack-swift00:19
*** jroll has joined #openstack-swift00:19
*** mattoliverau has joined #openstack-swift00:19
*** sudorandom has joined #openstack-swift00:19
*** CrackerJackMack has joined #openstack-swift00:19
*** donagh has joined #openstack-swift00:19
*** cameron.freenode.net sets mode: +v mattoliverau00:19
hubingHi All00:19
blmartin_wGood morning hubing00:20
minwoobHi everybody00:20
bkellerHello00:20
khoah64mattoliverau: hi - my team is also on here - we want to ask you about the sharding trie code status and how we can help00:20
mattoliveraukhoah64: sure, sorry, I think we're in the middle of a netsplit. Go IRC.00:20
rminminhi all :)00:20
mattoliverauthere we go, un netsplit, go IRC!00:20
mattoliveraukhoah64: so there has a been a few sharding POCs. The first was one that used the built in swift hashing. That worked but left object listings in a non-consistant order.. POC 2 was distrubuted prefix trees (trie), that kept order and could shard, but was a little over designed and requred quite a few extra requests.00:20
mattoliveraukhoah64: POC #3 is similar to POC #2, but simply splits the tree on the pivot point and all objects leave in the leaves.00:20
khoah64mattoliverau: so POC #3 is in the sharding_split?00:20
khoah64hi all00:20
mattoliverauPOC #3 is  what I'm currently working on now. And will talk about in Japan00:20
mattoliveraukhoah64: yup sharding_split.. I kinda want to rename it to sharding_pivot.. now that's I've gone further down the path with it.00:20
mattoliverauhubing, minwoob, bkeller, rminmin: o/00:21
blmartin_wmattoliverau: o/00:21
minwoobmattoliverau: o/00:22
bkellermattolivarau: o/00:22
hubingo/00:22
rminminmattolivarau: o/00:22
*** wshao has quit IRC00:23
khoah64mattoliverau: ok, we will see you in Japan :)00:23
mattoliverauwill you all be there?00:24
khoah64mattoliverau: so is POC #3 code complete and ready for some testing?  or is it not ready for testing?00:24
eariasnDo you have any specific area that would like to get us to look more into, including that possible testing ?00:25
khoah64mattoliverau: eraiasn and I will be there (from my team)00:25
mattoliveraukhoah64: its "ready". It works but there is still debugging to do. Just yesterday I pushed up a patch to improve it.00:26
mattoliverauso it's still in development, but kinda works00:26
mattoliverauit shards etc..00:26
mattoliverauhave you all read the current (old) spec I have up there?)00:27
eariasnyes, we did as patch set 400:27
khoah64mattoliverau: yes00:27
mattoliveraugreat00:27
elligottmcnotice comments in the spec from Erlan mentioning database sharding suggestion00:28
minwoobmattoliverau: Yes.00:28
elligottmcis that still being kicked around00:28
elligottmcor pivot tree all the way00:28
mattoliverauelligottmc: still being kicked around, thats the why it's in POC. Once we have a promising approach it'll become a feature branch, then we can geting it properly merged into swift.00:29
*** pchng has left #openstack-swift00:29
*** pchng has joined #openstack-swift00:29
elligottmcmattoliverau: k thanks00:29
*** ChanServ has joined #openstack-swift00:30
*** cameron.freenode.net sets mode: +o ChanServ00:30
*** jbonjean has quit IRC00:30
*** jbonjean has joined #openstack-swift00:30
mattoliverauok, so brain dumping might be hard in IRC, to explain where it's up to. but I can give it a go :)00:30
khoah64mattoliverau: so if we want to test/experiment, we should do POC #3 and not the other POCs?00:30
mattoliveraukhoah64: yeah, please test and play with sharding_split for now. Lets see if it's a vialable option :)00:31
mattoliverauSome notable changes since the SPEC (NOTE: I'll update the spec pre-Japan in more detail)00:31
eariasnwe have a bare metal cluster for this, do you recommend us to test drive it there ? to stress the containers and force to shard ?00:33
mattoliverauFirstly to keep the pivot tree (for the root) in the correct order when built, the pivot_points table now has a level.00:33
mattoliverauthe sharded container names have changed from '<-' and '->' to '.le.', '.gt.' (less than or equal, greater than), because the arrows don't get url encoded in logs, and we want to keep it readable.00:33
mattoliverauAtm the the sharding code is in the container-sharder and mostly in the container-server. There are pro's and cons about having it here or in the proxy.. so that could change00:35
mattoliverauthe sharder is the one sharding00:35
mattoliverauthe sharder iterates over all sharded containers on the drive, audits them (makes sure the root container nows about them, etc).00:36
mattoliverauthe sharder then looks for misplaced objects (keeps eventual consistancy happy).00:37
mattoliverauonce that is done the acutal sharding is 2 phase.00:37
mattoliverauOn a first pass, if no X-Container-Sysmeta-Pivot-Point exists, then it will ask all primary nodes what the best pivot point is (one with most object (or first one on tie, after the nodes are randomised) wins). It then sets this metadata on all primary nodes. Then moves on the the next container.00:39
mattoliverauon the second pass (phase 2). If this meta data exists, it will then talk to the other primary nodes again to get a qurom of whether this is the correct pivot. If so will shard.00:40
mattoliverauThis may or may not be the best way.. but I had to do something to get the POC moving forward.00:40
mattoliverauThere were talks about getting the nodes to tell each other over container-replication, and maybe that still is the best idea.00:41
mattoliverauBut I feel step 1 is, lets test this method.. no doubts there are plenty of places to improve but I have to get it sharding to start finding them.00:41
openstackgerritRobert Francis proposed openstack/swift: WIP: Symlink implementation. (work in progress)  https://review.openstack.org/23216200:42
mattoliverau(like my patch the other day to the POC, releating the container-info).00:42
mattoliverauAt the moment container DELETE on the sharded container isn't working (cause I haven't written it).00:42
mattoliveraubut object put/delete etc does00:43
*** chlong has joined #openstack-swift00:43
mattoliverauI've been testing with only 1 sharder running. Because I'm not 100% sure how well the eventual consistency'ness is working.. in theory it is ;)00:44
mattoliverauwhat would be nice is if we could set it up (I'm setting it up in the cloud to benchmark) and yes a bare metal cluster would be best00:45
mattoliverauand maybe set up statsd/graphite and see if we are message storming (my words, but I mean generating too much backend requests)00:46
mattoliverauI might try any do that in the cloud today if I get time.00:46
mattoliverauAt the moment, I'm reading through ssbench code and hacking it so I can actually test it on already sharded containers at different sizes cause I want: a) get some numbers and b) find all the bottle necks that is slowing it down (ie find places to tweak)00:47
mattoliverauso there is alot of work for all to do, and I'd love an appeciate your help :)00:48
mattoliverauwel need testing, reviewing, etc.00:48
eariasnwe can get that code into the bare metal cluster tomorrow :)00:49
mattoliverauIf people want to get there hands dirty then we could look at other options in regards to doing sharding or even make the proxy shard aware rather than the container-server.00:49
mattoliveraueariasn: awesome00:49
mattoliverauThe object server when updating the container (and the object-updater) now follow a 301 redirect when it's trying to update the wrong container, I think there is a possible request storm in that code.. but again I wanted to get to a state of working for testing the POC and see if it's a good apprach to use inside swift.00:51
*** hubing has quit IRC00:52
mattoliverauThus some metric gathering would be good, not just bench marks00:52
*** m_kazuhiro has joined #openstack-swift00:52
khoah64mattoliverau: do you think using Cosbench to test the code would be ok at this point?00:53
mattoliverauLong story short, it's still being developed, once we like the apprach we can clean it up in a swift feature branch. There is lots of work to do. And I can give you a better introduction in Tokyo00:53
mattoliveraukhoah64: yeah, it can't hurt, and if you find bugs then great, lets get em fixed ;)00:54
mattoliverauI've been generating large containers, sharding them, then benchmarking, cause I'm trying to find the point sharding makes sense. But please more eyes, and cosbenching from the start would help tackling issues and bottlenecks from both ends :)00:55
*** wasmum has quit IRC00:56
*** hubing has joined #openstack-swift00:56
mattoliverauI'll try and get a new updated spec up early next week, please look at the code, have play. Hopefully post summit we can all be up to speed and power along :)00:56
minwoobmattoliverau: Were you able to look into how the different database systems already out there (e.g., MySQL) have approached this problem?00:56
mattoliverauits been great having blmartin_w to bounce idea of, but more people would be better.00:57
blmartin_windeed, always happy for new ideas and approaches00:59
mattoliverauminwoob: db sharding is a little differnt, they tend to split up the data, not so much in batches. Then have alot of readonly nodes and a fewe write nodes. So a little. If anyone smarter then me sees something we've missed, or better ideas, speak up, cause you don't have to worry about my ego, I just want whats best for swift :)00:59
mattoliverauFinding the pivot point in this POC is mush cleaner then last, cause we can do it all in SQL, then it appears in the container info.01:01
kota_good morning guys.01:01
mattoliveraukota_: morning01:01
kota_mattoliverau: :)01:01
mattoliverauI'm probably left a bunch out, and if I have, sorry :) Just dumping a stream of thought :P01:02
khoah64mattoliverau: this is really helpful!01:02
khoah64mattoliverau: any estimate on when you will have the container delete stuff?01:03
mattoliverauDeleting an unsharded shard container (one that hasn't actually been split) is easy cause it's the same. Deleting a sharded container is a little difficult. I suspect we need to pass the delete request to all leaf nodes. then delete up the branches and finally the root. But what happens when there is an object in the leaf? So we auto create missing shard (leaf) containers.01:05
mattoliverauI need to spend some cycles thinking about how it'll work.01:06
kota_clayg, tdasilva: it might be good to start from reviewing patch 209315 for versioned_writes.01:06
patchbotkota_: https://review.openstack.org/#/c/209315/ - Refactor versioned_writes middleware01:06
mattoliveraualso the POC doesn't shrink.. that will probably be something we need to do. It keeps growing (spliting) but doesn't shrink back in.01:07
mattoliveraus/cycles/brain cycles/01:07
mattoliveraunot openstack cycles :P01:07
mattoliveraure: shrinking, when do we do it? or do we just never shrink.01:07
kota_clayg, tdasilva: the patch will change the code more clean which state we enable/disable old/new versioning.01:08
khoah64mattoliverau: ok thanks... that's something we will need to keep in mind during our upcoming experimentation/testing/playing01:08
mattoliverauAnyway, I think I've proably given you too much info you need to absorb. When you see the blindly obvious flaws I'm missed please speak up :)01:09
mattoliverauor even better, patch it01:09
eariasn+101:10
khoah64mattoliverau: +101:11
minwoob+101:12
khoah64mattoliverau: look forward to seeing you in Tokyo01:13
mattoliveraukhoah64: you too! It's not to far away now :)01:14
*** pdardeau has joined #openstack-swift01:14
mattoliverauAnd finally an Openstack conference that is in _almost_ my timezone :)01:14
*** haomaiwa_ has joined #openstack-swift01:17
*** hezhiqiang has joined #openstack-swift01:18
mattoliverauThanks all for listing to my brain dump, and sorry swift channel (or kota_) for spamming the channel so your message are probably harder to read/find.01:18
*** jlhinson has joined #openstack-swift01:18
mattoliverauoh and thanks minwoob and blmartin_w (and anytone else in Austin) who stayed up late to listen :)01:19
khoah64mattoliverau: thanks for all the info!01:19
kota_mattoliverau: np01:19
bkellermattoliverau: Thanks for the info01:20
mattoliverauand the rest of you who got up early.. go have some breakfast01:20
khoah64mattoliverau: I'm in Austin and been eating my dinner while listening to you :)01:21
*** david-lyle has joined #openstack-swift01:21
mattoliveraukhoah64: lol, nice bit of multi tasking there ;)01:21
*** elligottmc has quit IRC01:22
minwoobmattoliverau: Thank you!01:23
mattoliverauWelcome to the exciting adventures of container sharding :)01:25
*** wbhuber has joined #openstack-swift01:26
*** pauldardeau has joined #openstack-swift01:27
*** pdardeau has quit IRC01:28
*** rminmin has quit IRC01:29
*** eariasn has quit IRC01:31
*** eariasn has joined #openstack-swift01:31
*** eariasn has quit IRC01:35
*** zhill has quit IRC01:39
*** 5EXAAAOHG has quit IRC01:43
*** zhill has joined #openstack-swift01:44
*** marzif has joined #openstack-swift01:47
*** pauldardeau has quit IRC01:52
*** pauldardeau has joined #openstack-swift01:53
* mattoliverau goes to find some lunch01:53
*** diogogmt has joined #openstack-swift01:54
*** blmartin_ has quit IRC01:56
*** blmartin_w has quit IRC01:58
*** minwoob has quit IRC01:58
*** khoah64 has quit IRC02:01
*** bengalpaul has joined #openstack-swift02:02
*** pauldardeau has quit IRC02:04
*** bengalpaul has quit IRC02:06
*** janonymous__ has quit IRC02:13
*** bkeller has quit IRC02:19
*** zhill has quit IRC02:21
*** hubing has quit IRC02:26
*** zhill has joined #openstack-swift02:26
*** rminmin has joined #openstack-swift02:32
openstackgerritKota Tsuyuzaki proposed openstack/swift: Add unit tests for utils.validate_hash_path  https://review.openstack.org/23190502:47
*** sanchitmalhotra has joined #openstack-swift02:47
*** lifeless has joined #openstack-swift02:51
openstackgerritKota Tsuyuzaki proposed openstack/swift: Add unit tests for utils.validate_hash_path  https://review.openstack.org/23190502:51
*** lpabon has quit IRC02:53
*** sanchitmalhotra1 has joined #openstack-swift03:11
*** sanchitmalhotra has quit IRC03:13
*** trifon has joined #openstack-swift03:13
*** gyee has quit IRC03:15
*** wbhuber has quit IRC03:17
*** Venkatesh has joined #openstack-swift03:17
*** garthb has joined #openstack-swift03:18
*** jkugel has joined #openstack-swift03:18
*** zhill has quit IRC03:23
*** zhill has joined #openstack-swift03:32
*** haomaiwa_ has quit IRC03:33
*** haomaiwang has joined #openstack-swift03:34
*** sanchitmalhotra has joined #openstack-swift03:39
*** sanchitmalhotra1 has quit IRC03:41
*** fbo has quit IRC03:50
*** donagh has quit IRC03:50
*** fbo has joined #openstack-swift03:51
*** donagh has joined #openstack-swift03:51
*** jamielennox has quit IRC03:51
*** jamielennox has joined #openstack-swift03:52
*** trifon has quit IRC03:58
*** sanchitmalhotra1 has joined #openstack-swift03:59
*** haomaiwang has quit IRC04:01
*** 18WAAXA4N has joined #openstack-swift04:01
*** sanchitmalhotra has quit IRC04:01
*** hezhiqiang has quit IRC04:02
*** Venkatesh has quit IRC04:02
*** ppai has joined #openstack-swift04:06
*** Venkatesh has joined #openstack-swift04:13
*** sanchitmalhotra has joined #openstack-swift04:18
*** sanchitmalhotra1 has quit IRC04:20
*** haomaiwang has joined #openstack-swift04:22
*** zhill_ has joined #openstack-swift04:24
*** zhill has quit IRC04:24
*** 18WAAXA4N has quit IRC04:24
*** zhill_ has quit IRC04:28
*** haomaiwang has quit IRC04:28
*** zhill has joined #openstack-swift04:31
*** sanchitmalhotra1 has joined #openstack-swift04:32
*** hezhiqiang has joined #openstack-swift04:34
*** sanchitmalhotra has quit IRC04:35
*** peterlisak has joined #openstack-swift04:35
*** marzif has quit IRC04:36
*** mac_ified has quit IRC04:50
*** sanchitmalhotra has joined #openstack-swift04:52
*** jlhinson has quit IRC04:53
*** sanchitmalhotra1 has quit IRC04:54
*** trifon has joined #openstack-swift04:56
*** m_kazuhiro has quit IRC04:58
*** klrmn1 has quit IRC05:12
*** haomaiwang has joined #openstack-swift05:27
*** jamielennox is now known as jamielennox|away05:30
*** rminmin has quit IRC05:32
*** setmason has joined #openstack-swift05:33
*** garthb has quit IRC05:42
*** haomaiwang has quit IRC05:48
*** haomaiwa_ has joined #openstack-swift05:49
*** m_kazuhiro has joined #openstack-swift05:53
*** haomaiwa_ has quit IRC06:00
*** Venkatesh has quit IRC06:01
*** Venkatesh has joined #openstack-swift06:02
*** haomaiwa_ has joined #openstack-swift06:09
openstackgerritKota Tsuyuzaki proposed openstack/swift: Add func test to verify last modified at container  https://review.openstack.org/23574306:11
*** chlong has quit IRC06:15
claygkota_: bah - that versioned writes fixups are great!  You have all the best patches I never notice...06:18
claygkota_: what time is the weekly swift meeting for you?06:18
kota_clayg: hello, so sorry what does it mean "what time is the weekly swift meeting"?06:21
kota_clayg: do you plan to move the time to another date?06:21
*** setmason has quit IRC06:21
claygkota_: no i don't think so, everytime we try it's bad for someone - i just didn't know what time (local) it lands for you06:23
kota_oh yeah, that's 6:00 am in JST06:23
kota_that's my local time.06:24
*** DericHorn-HP has joined #openstack-swift06:24
kota_I might have to say, clayg for pinging him :\06:26
*** setmason has joined #openstack-swift06:27
*** DericHorn-HP has quit IRC06:30
*** sanchitmalhotra1 has joined #openstack-swift06:34
*** haomaiwa_ has quit IRC06:36
*** sanchitmalhotra has quit IRC06:37
*** haomaiwa_ has joined #openstack-swift06:38
*** sanchitmalhotra has joined #openstack-swift06:44
*** sanchitmalhotra1 has quit IRC06:47
*** siva_krishnan has joined #openstack-swift06:47
*** haomaiwa_ has quit IRC06:51
*** haomaiwa_ has joined #openstack-swift06:53
*** haomaiwa_ has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:05
*** rledisez has joined #openstack-swift07:06
*** setmason has quit IRC07:15
*** geaaru has joined #openstack-swift07:20
*** jmccarthy has quit IRC07:30
*** jmccarthy has joined #openstack-swift07:30
*** DericHorn-HP has joined #openstack-swift07:37
*** haomaiwang has quit IRC07:49
*** haomaiwang has joined #openstack-swift07:53
*** Guest43684 has quit IRC07:53
*** km has joined #openstack-swift07:54
*** km is now known as Guest9903407:54
*** haomai___ has joined #openstack-swift07:56
*** haomaiwang has quit IRC07:58
*** siva_krishnan has quit IRC08:03
*** sanchitmalhotra1 has joined #openstack-swift08:06
*** sanchitmalhotra has quit IRC08:08
*** zhill has quit IRC08:11
*** jistr has joined #openstack-swift08:24
*** jordanP has joined #openstack-swift08:28
*** Venkatesh has quit IRC09:03
*** Guest99034 has quit IRC09:27
*** kei_yama has quit IRC09:29
*** hezhiqiang has quit IRC09:38
*** haomai___ has quit IRC09:40
*** aix has joined #openstack-swift09:42
*** sanchitmalhotra has joined #openstack-swift09:47
*** joeljwright has joined #openstack-swift09:48
*** ChanServ sets mode: +v joeljwright09:48
*** sanchitmalhotra1 has quit IRC09:50
openstackgerritMerged openstack/swift: Interpolate the explanation string not whole HTML body  https://review.openstack.org/23330009:58
openstackgerritvenkatesh proposed openstack/swift: remove unused parameters  https://review.openstack.org/23134710:46
openstackgerritvenkatesh proposed openstack/swift: remove unused parameters  https://review.openstack.org/23134710:46
*** sanchitmalhotra1 has joined #openstack-swift11:07
*** sanchitmalhotra has quit IRC11:09
*** hezhiqiang has joined #openstack-swift11:28
*** sanchitmalhotra1 has quit IRC11:40
*** eariasn has joined #openstack-swift11:42
*** ho has quit IRC11:50
*** eariasn has quit IRC12:06
*** eariasn has joined #openstack-swift12:07
*** eariasn has quit IRC12:11
openstackgerritKota Tsuyuzaki proposed openstack/swift: Support last modified on listing containers  https://review.openstack.org/19863412:11
openstackgerritKota Tsuyuzaki proposed openstack/swift: Last-Modified header support on HEAD/GET container  https://review.openstack.org/19863312:11
*** alejandrito has joined #openstack-swift12:13
openstackgerritKota Tsuyuzaki proposed openstack/swift: Add func test to verify last modified at container  https://review.openstack.org/23574312:14
*** m_kazuhiro has quit IRC12:15
*** jkugel has quit IRC12:16
*** ppai has quit IRC12:16
*** eariasn has joined #openstack-swift12:23
*** ppai has joined #openstack-swift12:30
*** chlong has joined #openstack-swift12:48
openstackgerritMahati Chamarthy proposed openstack/swift: Hyperlink fix to first contribution doc  https://review.openstack.org/23589512:49
*** mahatic has joined #openstack-swift12:50
openstackgerritRobert Francis proposed openstack/swift: WIP: Symlink implementation. (work in progress)  https://review.openstack.org/23216212:51
mahaticnotmyname: ^ +A on 235895?12:51
pchngmahatic: Added a small comment for 23589513:07
*** haomaiwang has joined #openstack-swift13:10
*** setmason has joined #openstack-swift13:11
*** jkugel has joined #openstack-swift13:12
mahaticcschwede: kota: thanks13:14
mahaticpchng: I don't see a comment?13:15
cschwedemahatic: you’re welcome :)13:15
pchngmahatic: sorry, forgot to publish :O13:18
pchngmy bad13:18
*** wbhuber has joined #openstack-swift13:20
*** peterlisak has quit IRC13:20
*** lpabon has joined #openstack-swift13:22
*** mahatic has quit IRC13:34
*** mahatic has joined #openstack-swift13:36
*** lcurtis has joined #openstack-swift13:45
*** eariasn has quit IRC13:46
*** jrichli has joined #openstack-swift13:47
*** dustins has joined #openstack-swift13:48
pchngmahatic: not sure if you saw my comment on 235895, I forgot to publish it before, my bad13:50
mahaticpchng: np, looking13:51
*** pdardeau has joined #openstack-swift13:53
openstackgerritKota Tsuyuzaki proposed openstack/swift: Last-Modified header support on HEAD/GET container  https://review.openstack.org/19863313:54
openstackgerritKota Tsuyuzaki proposed openstack/swift: Add func test to verify last modified at container  https://review.openstack.org/23574313:57
*** ppai has quit IRC13:59
*** peterlisak has joined #openstack-swift14:00
openstackgerritKota Tsuyuzaki proposed openstack/swift: Last-Modified header support on HEAD/GET container  https://review.openstack.org/19863314:03
openstackgerritKota Tsuyuzaki proposed openstack/swift: Last-Modified header support on HEAD/GET container  https://review.openstack.org/19863314:05
*** ppai has joined #openstack-swift14:07
openstackgerritMahati Chamarthy proposed openstack/swift: Hyperlink fix to first contribution doc  https://review.openstack.org/23589514:07
openstackgerritJordan Pittier proposed openstack/swift: Fix testing issues  https://review.openstack.org/23593314:08
*** peterlisak has quit IRC14:08
*** mahatic_ has joined #openstack-swift14:08
*** ppai has quit IRC14:08
mahatic_pchng: done. that makes sense14:08
mahatic_cschwede: kota: sorry, i changed it14:09
openstackgerritKota Tsuyuzaki proposed openstack/swift: Support last modified on listing containers  https://review.openstack.org/19863414:09
*** mahatic has quit IRC14:09
*** Ailus has joined #openstack-swift14:12
*** Ailus has quit IRC14:12
*** setmason has quit IRC14:13
*** Ailus has joined #openstack-swift14:15
*** mfalatic has quit IRC14:18
*** mfalatic has joined #openstack-swift14:19
*** petertr7 is now known as petertr7_away14:21
*** pchng64 has joined #openstack-swift14:21
*** pchng64 is now known as pchng_14:21
*** pchng has quit IRC14:25
*** haomaiwang has quit IRC14:25
*** pchng_ is now known as pchng14:26
*** haomaiwang has joined #openstack-swift14:26
*** petertr7_away is now known as petertr714:27
openstackgerritFerenc Horváth proposed openstack/swift: Replace string slicing with proper string methods.  https://review.openstack.org/23595014:28
*** setmason has joined #openstack-swift14:31
*** diogogmt has quit IRC14:32
*** diogogmt_ has joined #openstack-swift14:32
*** khoah64 has joined #openstack-swift14:36
*** mahatic_ has quit IRC14:37
*** jistr has quit IRC14:37
notmynamegood morning14:39
*** diogogmt_ has quit IRC14:39
*** earlephilhower has quit IRC14:40
*** setmason has quit IRC14:40
*** diogogmt has joined #openstack-swift14:41
*** jistr has joined #openstack-swift14:41
*** haomaiwang has quit IRC14:48
kota_notmyname: hello14:50
onovynotmyname, morning, can you look to https://review.openstack.org/#/c/231354/ please?14:50
*** haomaiwa_ has joined #openstack-swift14:51
notmynameI'll be traveling today (leaving within the hour). I hope to be back online later this afternoon14:53
onovyok, np14:53
notmynameonovy: oh! yeah that looks like a good patch (from the commit meesage)14:53
onovy:)14:53
notmynameonovy: yeah, if it hasn't landed by the time I get back online, I'll look at it soon14:55
onovyperfect, thank you14:56
*** haomaiwa_ has quit IRC14:56
*** jlhinson has joined #openstack-swift14:56
*** haomaiwang has joined #openstack-swift14:57
*** haomaiwang has quit IRC14:59
*** pdardeau has quit IRC15:00
*** pdardeau has joined #openstack-swift15:01
*** trifon has quit IRC15:01
*** haomaiwang has joined #openstack-swift15:03
*** setmason has joined #openstack-swift15:03
*** chlong has quit IRC15:09
*** weihan has joined #openstack-swift15:09
*** siva_krishnan has joined #openstack-swift15:11
*** david-ly_ has joined #openstack-swift15:11
*** david-lyle has quit IRC15:11
*** klrmn1 has joined #openstack-swift15:18
*** jistr is now known as jistr|mtg15:18
openstackgerritKota Tsuyuzaki proposed openstack/swift: Support last modified on listing containers  https://review.openstack.org/19863415:22
*** peterlisak has joined #openstack-swift15:23
*** minwoob has joined #openstack-swift15:25
jordanPguys I think the job gate-swift-dsvm-functionall is broken on stable/kilo15:25
jordanPsee https://review.openstack.org/#/c/217750/15:26
*** klrmn1 has quit IRC15:26
jordanPwithout this patch, no functionnal tests are actually run by tox -e func on stable/kilo15:26
jordanPfor instance here https://review.openstack.org/#/c/232696/ this was merged 2 days ago15:27
jordanPbut "gate-swift-dsvm-functional" is all green but if you look into more details15:27
jordanP" Ran 0 tests in 0.002s"  http://logs.openstack.org/96/232696/3/check/gate-swift-dsvm-functional/f9c182d/console.html.gz#_2015-10-08_20_35_15_22615:27
siva_krishnanHi All, I am quite new to Swift, yet to start my contribution. I thought of reaching out to you guys if you could suggest me low-hanging-fruit/triaged bugs  or any long pending documentation bugs related to Swift which would help me get started with contribution.  I am super excited to start working on Swift.15:28
jordanPcschwede, ping (sorry to bother)15:28
cschwedejordanP: no worries, i’m already looking at it :)15:29
jordanPgreat. So I wanted to backport your patch "Fix testing issues" but this fails for other reason15:30
jordanPthe func tests "test_project_domain_id_header" fails with Keystone v3 and are skipped with keystone v215:31
peterlisakHi everyone, I have a question.15:31
peterlisakI want to prioritize some swift daemons/servers to others. For example: object-server to object-reaper, beacause I need all users' request to be served in peak hours and deletion could wait.15:31
peterlisakCurrently I use nice/ionice command to manage this behaviour. It would be great to have native support in swift. Adding optional config param to set daemon/server io scheduling class and priority by nice/ionice.15:31
peterlisakOr is there already any existing feature in swift for that?15:31
peterlisakI would like to know your opinion before try implementing it.15:31
peterlisakThx!15:31
cschwedejordanP: i’m looking into a backport of the „Fix testing issues“, and a fix for the "test_project_domain_id_header“. Local tests are running atm on stable/kilo15:34
jordanPcschwede, great15:34
jordanPcschwede, what I noticed is that you need keystone v3 (auth_version, auth_prefix) in your test.conf to reproduce the failures15:35
tdasilvasiva_krishnan: Hi, welcome to Swift. I'd start by taking a look here: http://docs.openstack.org/developer/swift/first_contribution_swift.html and here https://wiki.openstack.org/wiki/Swift/ideas15:36
tdasilvasiva_krishnan: Another great way to get involved is to look at open reviews: https://review.openstack.org/#/q/status:open+project:openstack/swift,n,z15:38
*** jistr|mtg has quit IRC15:39
*** jistr has joined #openstack-swift15:40
siva_krishnantdaSilva Thanks for the info. Can you please shed some light on code debug process followed in Swift/Openstack as I am from Java background ?15:52
cschwedejordanP: wow, this is a little bit more tricky than i thought. wondering about the errors in http://logs.openstack.org/33/235933/1/check/gate-swift-dsvm-functional/03cb07a/console.html15:54
cschwedei have to take a break now, but will check again later why patch 235933 fails in Jenkins15:55
patchbotcschwede: https://review.openstack.org/#/c/235933/ - Fix testing issues15:55
jordanPcschwede, yeah it's not obvious, I spent a couple of hours on it already before reaching to you15:57
*** geaaru has quit IRC15:58
*** joeljwright has quit IRC16:00
*** haomaiwang has quit IRC16:01
*** haomaiwang has joined #openstack-swift16:01
*** gyee has joined #openstack-swift16:03
*** rledisez has quit IRC16:17
*** jistr has quit IRC16:33
openstackgerritJonathan Hinson proposed openstack/swift: Automatic refresh of memcache config settings  https://review.openstack.org/21849016:35
*** hezhiqiang has quit IRC16:37
*** weihan has quit IRC16:39
openstackgerritBill Huber proposed openstack/swift: ObjectControllers return application errors as 499 on bad read  https://review.openstack.org/23600716:41
*** weihan has joined #openstack-swift16:43
*** weihan has quit IRC16:48
*** weihan has joined #openstack-swift16:48
*** siva_krishnan has quit IRC16:48
wbhuberclayg: ^^16:49
*** jkugel has quit IRC16:55
openstackgerritJonathan Hinson proposed openstack/swift: Automatic refresh of memcache config settings  https://review.openstack.org/21849016:56
*** weihan has quit IRC16:56
*** trifon has joined #openstack-swift16:57
*** haomaiwang has quit IRC16:59
*** klrmn1 has joined #openstack-swift17:01
*** zhill has joined #openstack-swift17:01
*** haomaiwang has joined #openstack-swift17:03
*** jkugel has joined #openstack-swift17:03
clayggholt's blog is gone :'(17:16
clayglike the internet lost it or something17:16
*** petertr7 is now known as petertr7_away17:21
*** zhill has quit IRC17:24
*** jordanP has quit IRC17:25
openstackgerritMerged openstack/swift: Hyperlink fix to first contribution doc  https://review.openstack.org/23589517:30
*** zhill has joined #openstack-swift17:31
*** zaitcev has joined #openstack-swift17:37
*** ChanServ sets mode: +v zaitcev17:37
*** eranrom has joined #openstack-swift17:43
*** pdardeau has quit IRC17:46
*** jlhinson has quit IRC17:48
*** wbhuber has quit IRC17:53
*** jlhinson has joined #openstack-swift17:53
*** wbhuber has joined #openstack-swift17:54
*** pdardeau has joined #openstack-swift17:55
*** wbhuber has quit IRC17:58
*** haomaiwang has quit IRC18:01
*** haomaiwang has joined #openstack-swift18:01
*** jkugel has quit IRC18:27
*** wbhuber has joined #openstack-swift18:38
*** wbhuber_ has joined #openstack-swift18:41
*** wbhuber has quit IRC18:44
*** setmason has quit IRC18:47
*** peterlisak has quit IRC18:48
*** setmason has joined #openstack-swift18:49
*** zhill_ has joined #openstack-swift18:49
*** zhill_ has quit IRC18:49
*** zhill has quit IRC18:50
*** siva_krishnan has joined #openstack-swift18:52
*** zhill has joined #openstack-swift18:52
openstackgerritJonathan Hinson proposed openstack/swift: Automatic refresh of memcache config settings  https://review.openstack.org/21849018:57
*** CaioBrentano has joined #openstack-swift18:59
*** haomaiwang has quit IRC19:01
*** haomaiwang has joined #openstack-swift19:01
*** CaioBren_ has quit IRC19:02
*** david-ly_ has quit IRC19:04
*** david-lyle has joined #openstack-swift19:05
*** CaioBrentano has quit IRC19:06
*** CaioBrentano has joined #openstack-swift19:06
*** jkugel has joined #openstack-swift19:14
*** jkugel has quit IRC19:19
*** setmason has quit IRC19:26
*** wbhuber_ is now known as wbhuber19:28
*** peterlisak has joined #openstack-swift19:29
*** weihan has joined #openstack-swift19:30
*** setmason has joined #openstack-swift19:30
*** peterlisak has quit IRC19:33
*** eranrom has quit IRC19:39
*** Fin1te has joined #openstack-swift19:41
*** mac_ified has joined #openstack-swift19:41
*** jrichli has quit IRC19:43
*** siva_krishnan has quit IRC19:57
*** siva_krishnan has joined #openstack-swift19:57
*** haomaiwang has quit IRC20:01
*** haomaiwang has joined #openstack-swift20:01
*** siva_krishnan has quit IRC20:07
*** siva_krishnan has joined #openstack-swift20:07
*** CaioBrentano has quit IRC20:20
*** peterlisak has joined #openstack-swift20:23
*** siva_krishnan has quit IRC20:27
*** lpabon has quit IRC20:27
*** peterlisak has quit IRC20:27
*** siva_krishnan has joined #openstack-swift20:28
*** zhill has quit IRC20:28
*** zhill has joined #openstack-swift20:30
*** dustins has quit IRC20:37
*** siva_krishnan has quit IRC20:38
*** Fin1te has quit IRC20:41
*** siva_krishnan has joined #openstack-swift20:43
*** pdardeau has quit IRC20:49
*** pdardeau has joined #openstack-swift20:51
*** zaitcev has quit IRC20:55
*** haomaiwang has quit IRC21:01
*** haomaiwang has joined #openstack-swift21:01
*** zhill has quit IRC21:02
*** zhill has joined #openstack-swift21:09
openstackgerritMichael Barton proposed openstack/swift: go: pass vars to container update  https://review.openstack.org/23611321:14
*** peterlisak has joined #openstack-swift21:16
*** jordanP has joined #openstack-swift21:20
*** peterlisak has quit IRC21:21
*** trifon has quit IRC21:31
*** jordanP has quit IRC21:35
openstackgerritBill Huber proposed openstack/swift: ObjectControllers return application errors as 499 on bad read  https://review.openstack.org/23600721:43
*** setmason has quit IRC21:44
*** david-ly_ has joined #openstack-swift21:50
*** david-lyle has quit IRC21:50
*** zhill has quit IRC21:56
*** alejandrito has quit IRC21:59
*** haomaiwang has quit IRC22:01
*** 7JTAAVLJ1 has joined #openstack-swift22:01
jlhinsonnotmyname: clayg: In patch 218490, I load a value "conf_reload_time" that specifies how often we should attempt to reload memcache.conf22:02
patchbotjlhinson: https://review.openstack.org/#/c/218490/ - Automatic refresh of memcache config settings22:02
jlhinsonHow thoroughly should we check that the provided value is valid (an int, non-neg, etc.)?22:02
*** zhill has joined #openstack-swift22:03
*** lyrrad has quit IRC22:06
*** joeljwright has joined #openstack-swift22:08
*** ChanServ sets mode: +v joeljwright22:08
*** peterlisak has joined #openstack-swift22:11
*** Ailus has quit IRC22:11
*** lyrrad has joined #openstack-swift22:11
*** proteusguy__ has quit IRC22:11
*** peterlisak has quit IRC22:15
*** peterlisak has joined #openstack-swift22:16
*** peterlisak has quit IRC22:20
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873622:26
*** joeljwright has quit IRC22:26
redbo_notmyname: when you get a chance, can you merge master into feature/hummingbird?  I think something changed that made all the gate tests break.22:28
*** proteusguy__ has joined #openstack-swift22:28
*** jlhinson_ has joined #openstack-swift22:30
*** jlhinson has quit IRC22:34
*** pdardeau has quit IRC22:34
*** jlhinson_ has quit IRC22:35
*** wbhuber has quit IRC22:49
notmynamegood afternoon22:54
*** siva_krishnan has quit IRC22:54
notmynameredbo_: sure22:55
*** lcurtis has quit IRC22:55
*** minwoob has quit IRC22:58
*** 7JTAAVLJ1 has quit IRC23:01
*** haomaiwa_ has joined #openstack-swift23:01
openstackgerritJohn Dickinson proposed openstack/swift: Merge branch 'master' into hummingbird  https://review.openstack.org/23616223:05
notmynameredbo_: ^23:05
*** pgbridge has quit IRC23:07
*** marzif has joined #openstack-swift23:08
redbo_thanks!23:10
*** redbo_ is now known as redbo23:10
*** ChanServ sets mode: +v redbo23:10
notmynameredbo_: I'm not sure what gate tests are breaking. was there another merge patch?23:10
redboI don't really know, it's spitting out some error about .coveragerc.23:14
redbooh, ignore-errors=True changed to ignore_errors=True last month23:17
claygredbo: so much better23:17
redboI can see how that would drive someone crazy23:18
*** zhill has quit IRC23:21
*** zhill has joined #openstack-swift23:22
notmynameoh. heh. seems that merge patch caused a lot of emails to be generated23:23
*** marzif has quit IRC23:24
*** wbhuber_ has joined #openstack-swift23:30
*** wbhuber has joined #openstack-swift23:34
*** wbhuber_ has quit IRC23:37
*** mfalatic has quit IRC23:38
*** zhill has quit IRC23:57
*** zhill has joined #openstack-swift23:58
*** wbhuber_ has joined #openstack-swift23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!