Monday, 2015-09-21

*** itlinux has quit IRC00:03
*** chlong has joined #openstack-swift00:41
*** thurloat is now known as thurloat_isgone00:46
*** baojg has joined #openstack-swift01:02
*** garthb has joined #openstack-swift01:34
*** tsimp06 has quit IRC01:34
*** hezhiqiang has joined #openstack-swift01:38
*** haomaiwa_ has joined #openstack-swift02:07
*** itlinux has joined #openstack-swift02:14
*** DericHorn-HP has joined #openstack-swift02:18
*** haomaiwa_ has quit IRC02:18
*** DericHorn-HP has quit IRC02:20
*** hezhiqia_ has joined #openstack-swift02:26
*** esker has quit IRC02:26
*** hezhiqia_ has quit IRC02:30
*** hezhiqiang has quit IRC02:30
*** DericHorn-HP has joined #openstack-swift02:32
*** mragupat has joined #openstack-swift02:34
*** mragupat_ has joined #openstack-swift02:35
*** DericHorn-HP has quit IRC02:36
notmynamegood evening02:36
*** mragupat has quit IRC02:39
*** haomaiwa_ has joined #openstack-swift02:48
*** baojg has quit IRC02:52
*** sanchitmalhotra has joined #openstack-swift02:53
*** mragupat_ has quit IRC02:56
*** silor has joined #openstack-swift02:56
*** baojg has joined #openstack-swift02:59
*** baojg has quit IRC02:59
*** haomaiwa_ has quit IRC03:01
*** haomaiwang has joined #openstack-swift03:01
*** silor has joined #openstack-swift03:05
*** sanchitmalhotra1 has joined #openstack-swift03:20
mattoliveraunotmyname: o/03:20
notmynamehi03:20
mattoliverauWas lunching when you came online :)03:20
notmynameI'm trying to figure out what's going on after being out a week03:20
mattoliverauBack at home with the fam this weekend?03:20
notmynameyeah, we went to the beach today03:20
jrichlimattoliverau, notmyname: hello03:21
notmynamehttps://twitter.com/notmyname/status/64566194528300236803:21
jrichlibeach!  I am so jealous03:21
mattoliverau\o/ beach!03:21
mattoliveraujrichli: o/03:21
jrichliI am gonna work from Dallas next week ... I get to see some friends and go to some fav places to eat03:22
jrichlithis week03:22
*** sanchitmalhotra has quit IRC03:22
mattoliverauCool!03:22
notmynamecool. I hope yiou have a good time03:22
jrichlinotmyname: it may have been just a glitch this weekend, but I uploaded a couple patches to feature/crypto, and there was no IRC notification.03:23
notmynamejrichli: if gerrit was offline or the bot was offline, no notice would have been given03:25
notmynamehappens from time to time03:25
notmynameas long as you see it in gerrit, everything is ok (from our perspective)03:25
*** baojg has joined #openstack-swift03:26
jrichliok, I figured it might be something like that.  Just thought I'd mention it.03:26
notmynamemattoliverau: what are you working on these days? and how is that work going?03:27
* notmyname is not a fan of specs these days. we should talk about it in tokyo03:28
*** itlinux has quit IRC03:29
notmynamejrichli: we should do the merge master to encryption branch thing03:29
notmynamejrichli: have you done that before?03:29
jrichliacoles usually does that.  the last one was a couple weeks ago.03:30
notmynameI was hoping to spread the knowledge around ;-)03:31
jrichlioh, ok.  Do I need any special permissions?03:31
jrichliit seems like I recall a discussion about this, and I thought it was said that you had to be core03:32
jrichlibut maybe that was something else about what was being done03:32
notmynameI don't remember (and it seems the docs I had saved are now a stale link)03:34
notmynamebut yeah, the basic idea is to submit a merge commit for review instead of a "normal" commit03:34
jrichliok.  I can give it a shot :-)  Not tonight, though.  I am just doing a little Japanese and then going to bed.  Then tomorrow, I wont be working until night time.03:36
openstackgerritJohn Dickinson proposed openstack/swift: Merge branch 'master' into feature/crypto  https://review.openstack.org/22554003:37
notmynamewell, there :-)03:37
notmynamejust makign sure I remembered how.03:37
jrichliwow, that was fast.  i guess there were no complicated merges to resolve?03:37
notmynamenone03:37
notmynamethis time ;-)03:37
jrichligreat.  thx!03:38
notmynameI can abandon and let you do it to learn03:38
notmynameyour call03:38
jrichliabandon.  I would like to try.  good time, since there are no conflicts :-)03:39
notmynamedone03:39
notmynamewant me to walk you through it?03:39
*** hezhiqiang has joined #openstack-swift03:40
jrichliok.  I guess Rosetta Stone can stay paused ;-)03:40
notmynameheh03:40
notmynamejrichli: step one is to make sure master and feature/crypto (or origin/feature/crypto) are up to date03:40
notmynamebasicall `git fetch --all` and then eg `git merge origin master` as necessary03:41
notmyname(let me know when you're ready for the next step)03:42
*** garthb has quit IRC03:44
*** sanchitmalhotra has joined #openstack-swift03:45
*** hezhiqiang has quit IRC03:45
*** sanchitmalhotra1 has quit IRC03:47
jrichliif I do the merge command you have above while on crypto branch, then it will be the direction I want?03:47
notmynameyeah, but don't do that yet ;-)03:48
notmynameor there's a safer way than to do it directly03:49
jrichli52 files changed, 2450 insertions(+), 395 deletions(-)03:49
jrichlialready done: 52 files changed, 2450 insertions(+), 395 deletions(-)03:49
jrichliis that what you had?03:49
notmynameyeah. exactly the same03:49
jrichliwhat's the safer way?03:49
notmynameso I had done it on a separate branch off of feature/crypto03:50
jrichliah, right.  i usually would have thought of that03:50
notmynameok, so now the last step03:50
notmynamewell, 2 steps03:50
notmynameyou need to get a change-id on the commit03:50
jrichliit ok i didn't make a branch for the review?03:50
notmynameyeah03:51
notmynameso `git commit --amend)03:51
notmynameso `git commit --amend`03:51
notmynamethen save what's give with no changes (if you're ok with the commit message)03:51
*** hezhiqiang has joined #openstack-swift03:51
notmynamethat will run the hook to add the commit id03:52
jrichlisure.  i guess it is like rebasing, mostly.  except for the merge command :-)03:52
notmynameyeah03:52
mattoliveraunotmyname: sharding Poc take 3 or is it 4. Debugging in one of my larger test clusters now.. Hope to start some initial benchmarking this week. (Also need to update spec, I know you'd love that)03:52
notmynameok, so the last part is the one that has to be done right. otherwise you make a lot of work for yourself, potentially03:53
jrichlik03:53
notmynamejrichli: `git review -R`03:53
jrichliwhat does the -R mean?03:53
notmynamethe -R tells git-review to not do a rebase of the commit on what's already there03:53
notmynameie you get the merge commit itself instead of all the commits that you just merged in individually03:53
jrichlioic03:54
notmynamemattoliverau: great :-)03:54
mattoliverauOther then that just getting over being sick.. Again.. Now that brain is working i need to give reviews some love. But once I'm at the benchmarking stage I'll have a lot more time to review and bug fix :)03:54
notmynamemattoliverau: over the next couple of weeks, anything you can do to help move patches along for the liberty release would be appreciated. EC patches especially03:54
jrichliI got : (you are not allowed to upload merges)03:55
notmynamejrichli: ah03:55
notmynameok then03:55
notmyname:-(03:55
notmynamewell, now we know03:55
jrichlibut its good to know how its done03:55
jrichlithx!03:55
mattoliveraunotmyname: will do03:55
notmynamejrichli: thanks for trying03:56
jrichlisure!  thanks for walking me through.  BTW, can we see the t-shirts yet?03:56
notmynameno ;-)03:57
jrichlidarn.  do we have to wait until Tokyo?03:57
notmynameI'll order them in the morning (or that's the plan). we'll see how they turn out03:58
jrichliok.  I am sure they will be great!03:59
*** haomaiwang has quit IRC04:01
*** haomaiwang has joined #openstack-swift04:01
*** hezhiqiang has quit IRC04:05
*** hezhiqiang has joined #openstack-swift04:08
notmynametorgomatic: I love the topic message on https://review.openstack.org/#/c/212824/04:08
*** wer_ has quit IRC04:19
*** hezhiqiang has quit IRC04:22
*** sanchitmalhotra1 has joined #openstack-swift04:25
*** sanchitmalhotra has quit IRC04:27
*** ppai has joined #openstack-swift04:28
*** ppai has quit IRC04:40
*** DericHorn-HP has joined #openstack-swift04:40
*** sanchitmalhotra has joined #openstack-swift04:45
*** sanchitmalhotra1 has quit IRC04:47
*** DericHorn-HP has quit IRC04:48
*** baojg has quit IRC04:50
*** garthb has joined #openstack-swift04:54
*** sanchitmalhotra1 has joined #openstack-swift04:58
*** nadeem has joined #openstack-swift04:59
*** hezhiqiang has joined #openstack-swift04:59
*** sanchitmalhotra has quit IRC04:59
*** haomaiwang has quit IRC05:01
*** haomaiwang has joined #openstack-swift05:01
*** itlinux has joined #openstack-swift05:03
*** patchbot has quit IRC05:06
*** baojg has joined #openstack-swift05:15
*** sanchitmalhotra has joined #openstack-swift05:19
*** sanchitmalhotra1 has quit IRC05:21
*** nadeem has quit IRC05:27
*** nadeem has joined #openstack-swift05:28
*** patchbot has joined #openstack-swift05:28
notmynamepatchbot has been upgraded05:30
notmynamenow you can reference patch 1234 and patch 89573 in the same line and you'll get a link to both05:30
patchbotnotmyname: https://review.openstack.org/#/c/1234/05:30
patchbotnotmyname: https://review.openstack.org/#/c/89573/05:30
notmynamelike that ;-)05:30
*** garthb has quit IRC05:33
tamizh_geeknotmyname: clayg: hello, do you guys remember a patch trying to fix the error response content types? I have a new patch regarding that. This one could be much bigger, touching things all over the code base. Would like to have some early feedback on that.05:33
tamizh_geekwhether I'm doing it right? That, this is needed at all? etc etc..05:34
tamizh_geekplease help!05:34
notmynametamizh_geek: yeah, I saw that you had submitted a few. thank you05:34
tamizh_geekpatch is 22549905:34
notmynametake out the "is" in that line, and patchbot will make it linky for you ;-)05:34
tamizh_geekhttps://review.openstack.org/#/c/225499/05:34
*** jrichli has quit IRC05:34
tamizh_geekah! thats what I was wondering :-)05:35
tamizh_geekthanks for the hint!05:35
notmynamefresh on my mind since I just added some functionality to that bot05:35
notmynametamizh_geek: I'm interested in it, and I'd like to look, but let me be honest with what's going on05:35
notmynametamizh_geek: we've pretty much got 2 weeks to get the Liberty release banged into shape. that will take priority05:36
*** itlinux has quit IRC05:36
*** mahatic has joined #openstack-swift05:36
tamizh_geeknotmyname: I understand. But also, I don't want to proceed on this without knowing what I'm doing is right. Probably, I will keep waiting on further development till I receive some feedback from you guys.05:38
notmynametamizh_geek: ack. from a quick glance, getting the pep8 would be pretty simple to go ahead and work on05:41
*** hezhiqia_ has joined #openstack-swift05:41
notmynametamizh_geek: and what you'd need to pay attention to most is the functional tests (and you'd need new ones)05:41
notmynametamizh_geek: those will show what works and doesn't from a client perspective05:41
notmynameIIRC we've changed responses in the patch to be more in line with the request (eg the Accept header). so I think this kind of change will likely be ok05:42
tamizh_geeknotmyname: Thanks! That's the path I'm taking. I'm going through each func test, and passing the JSON header to it and see if it respects it. If not, tweak the code to add necessary changes. In the process, I'm also making sure the old ones still pass.05:43
mahaticgood morning05:44
tamizh_geeknotmyname: Yeah right! That without breaking backward compatibility. Thanks. This gives some confidence :)05:44
notmynametamizh_geek: at first glance, it seems like a good idea that you should pursue. however, other cores have been know to (correctly, more often than not) disagree with me ;-)05:44
notmynamemahatic: hello05:44
*** hezhiqiang has quit IRC05:44
mahaticnotmyname: hi! how are you?05:45
* mahatic was reading scrollback05:45
notmynamemahatic: pretty good for the most part. it's hot at home today, and I don't have AC, so I'm not looking forward to trying to sleep ;-)05:45
tamizh_geeknotmyname: hmmm., clayg had some interest in this patch earlier. I'll probably wait for his feedback as well.05:46
mahaticnotmyname: ow. SFO can be that hot?05:46
notmynamemahatic: mostly it's the lack of AC ;-)05:46
notmynamemahatic: but yeah, it was in the upper 80s to low 90s (depending on the weather station you checked) today05:47
notmynameand if there isn't a cross breeze, then the house gets hot. it's 80.41F/26.89C in my office right now05:47
mahaticI see. 26 isn't that bad for us over here ;) but why no AC? all nighter then? ;)05:48
notmynamemahatic: very few houses have AC here. normally it's much cooler year-round. it's been very hot this year05:49
notmynametamizh_geek: is https://review.openstack.org/#/c/204196/ ready for review? should it be rolled into your other one?05:50
mahaticnotmyname: oh okay. yeah, that's right about cross breeze. makes a lot of difference (talking from expereince)05:50
notmynamemahatic: yeah, and I understand eye-rolling I get when I complain about it being 80. I lived most of my life where it is *much* hotter. but I had AC there05:51
tamizh_geeknotmyname: I actually made 225499 dependent on 204196. Is that the correct way to roll in related patches ?05:52
mahaticnotmyname: well, looks like this year weather should get you used to this and no more complaining ;)05:52
tamizh_geekJust saying.. Chennai/India is at 34C right now ;-)05:53
mahaticnotmyname: we're talking about weather, we're doing a british thing :D05:54
notmyname:-)05:54
mahatictamizh_geek: ah, chennai is super hot!05:55
notmynameI did go to the beach today. water temperature looks like it was about 16C (61F)05:55
notmynamethat was really cold!05:56
tamizh_geekmahatic: hehe. this is semi-summer for us. The summer temperature goes up to 42/43C05:56
mahaticI first learned it was a  british trait from P.G. wodehouse05:56
*** nadeem has quit IRC05:57
mahaticnotmyname: extremes huh. but nice!05:58
*** eranrom has joined #openstack-swift05:59
notmynametamizh_geek: yeah, you did the dependencies right (the logistics in git/gerrit). but i'm wondering if you need that. does the first patch provide something on its own that is good without the second patch?05:59
notmynametamizh_geek: if not, then including it in the 2nd patch (and just having one patch instead of a dependency chain) is a better way to go06:00
*** haomaiwang has quit IRC06:01
tamizh_geeknotmyname: yes it actually fixes the bug 1182155 - but for the bigger picture it brings in a inconsistency in JSON error responses. Right now, no endpoint respects Accept:application/json. After that patch some will, and some will not.06:01
openstackbug 1182155 in OpenStack Object Storage (swift) "Error responses ignore accept header" [Undecided,In progress] https://launchpad.net/bugs/1182155 - Assigned to Azhagu Selvan SP (tamizhgeek)06:01
*** haomaiwang has joined #openstack-swift06:01
tamizh_geekok then, I will squash them into a single patch and submit again.06:02
tamizh_geekI was thinking, since its too big let me split them to multiple patches for easy review.06:02
notmynametamizh_geek: it's up to you06:03
notmynameok, I'm off to bed. good night06:03
tamizh_geekthanks notmyname, good night :)06:03
mahaticnotmyname: good night!06:08
*** haomaiwang has quit IRC06:12
*** SkyRocknRoll has joined #openstack-swift06:41
mattoliverauSomeone to remind me to never go down the python unicode investigation.. that's an hour of my life I'm never getting back and still undercided how I feel about a patchset :P06:52
mahaticmattoliverau: lol, which patchset is that? I'm actually debugging something to do with unicode (in encryption). thanks for the encouragement :P06:54
mattoliveraumahatic: lol, sorry :P06:55
*** geaaru has joined #openstack-swift06:55
*** sanchitmalhotra1 has joined #openstack-swift07:04
*** SkyRocknRoll has quit IRC07:04
mattoliveraumahatic: just one about a change in replacing how we parse MIME headers, patch 203304. I started down trying/testing unicode (wrong rabbit hole, and the problem). Ended up reading more of the RFC which says the headers will be in ASCII (great) but can be encoded a different way which can be done with email.header.Header, but email.parser (what the patch is using) doesn't decode it. I don't think we support this07:05
mattoliverauencoding so probably isn't a big deal.. but I guess I should go confirm that the old library doen't also.07:05
patchbotmattoliverau: https://review.openstack.org/#/c/203304/07:05
*** sanchitmalhotra has quit IRC07:06
*** rledisez has joined #openstack-swift07:07
*** SkyRocknRoll has joined #openstack-swift07:09
*** haomaiwang has joined #openstack-swift07:09
*** jamielennox is now known as jamielennox|away07:09
*** trifon has joined #openstack-swift07:10
*** chlong has quit IRC07:17
mahaticmattoliverau: I see. Looking deeper into that patch, this looks informative07:17
*** mac_ified has quit IRC07:49
*** hrou has quit IRC07:55
*** haomaiwang has quit IRC08:01
*** haomaiwang has joined #openstack-swift08:01
*** T0m_ has joined #openstack-swift08:12
*** T0m_ has left #openstack-swift08:12
*** kei_yama has quit IRC08:14
*** kei_yama has joined #openstack-swift08:15
*** janonymous has joined #openstack-swift08:16
*** kei_yama has quit IRC08:18
*** haomaiwang has quit IRC08:21
*** kei_yama has joined #openstack-swift08:23
*** acoles_ is now known as acoles08:35
*** chlong has joined #openstack-swift08:43
*** aix has quit IRC08:54
*** nadeem has joined #openstack-swift09:06
*** kei_yama has quit IRC09:08
*** kei_yama has joined #openstack-swift09:09
openstackgerritAlistair Coles proposed openstack/swift: Fix .coveragrc to prevent nose tests error  https://review.openstack.org/22559109:12
acolescschwede: i think the gate is broken without this fix ^^, please review if you have time.09:13
acolesmattoliverau: kota if you are still around ^^09:13
cschwedeacoles: good morning! alright, going to have a look right now09:13
acolescschwede: thanks!09:13
cschwedewow, that’s a long patch. will require quite some time ;)09:13
acolescschwede: saw it here btw: https://review.openstack.org/#/c/225540/09:14
cschwedeouch09:14
acolesheh. yes its long, that horizontal line has to travel all the way from - to _ :)09:15
cschwedeok, i +2 and +A’ed the patch to unblock the gate - i think this is safe in this case09:16
acolescschwede: cool. thank you09:17
cschwedeacoles: you’re welcome! now we just have to wait for jenkins to pass too09:17
*** haomaiwang has joined #openstack-swift09:20
*** haomaiwang has quit IRC09:21
*** haomaiwa_ has joined #openstack-swift09:21
*** kei_yama has quit IRC09:22
*** kei_yama has joined #openstack-swift09:22
acolescschwede: jenkins has passed py27 job so at least we didn't break anything ;)09:23
*** haomaiwa_ has quit IRC09:23
*** haomaiwa_ has joined #openstack-swift09:23
*** aix has joined #openstack-swift09:25
cschwedeacoles: yep, saw that. according to http://coverage.readthedocs.org/en/latest/config.html#report it also makes more sense to use an underscore than a hyphen09:28
*** baojg has quit IRC09:35
*** eranrom has quit IRC09:35
*** nadeem has quit IRC09:38
*** silor has quit IRC09:52
*** mahatic has quit IRC09:57
*** haomaiwa_ has quit IRC10:01
*** haomaiwa_ has joined #openstack-swift10:01
*** kei_yama has quit IRC10:03
*** baojg has joined #openstack-swift10:06
*** baojg has quit IRC10:07
*** hezhiqia_ has quit IRC10:20
*** km has quit IRC10:24
openstackgerritMerged openstack/swift: Fix .coveragrc to prevent nose tests error  https://review.openstack.org/22559110:42
*** haomaiwa_ has quit IRC11:01
*** 6JTAB24P4 has joined #openstack-swift11:01
*** eranrom has joined #openstack-swift11:04
*** sanchitmalhotra has joined #openstack-swift11:21
*** sanchitmalhotra1 has quit IRC11:22
*** silor has joined #openstack-swift11:25
*** 6JTAB24P4 has quit IRC11:41
*** hezhiqiang has joined #openstack-swift11:44
*** jordanP has joined #openstack-swift11:52
*** hezhiqiang has quit IRC11:57
*** sanchitmalhotra1 has joined #openstack-swift12:00
*** sanchitmalhotra has quit IRC12:01
*** sanchitmalhotra has joined #openstack-swift12:06
*** sanchitmalhotra1 has quit IRC12:08
*** sanchitmalhotra1 has joined #openstack-swift12:16
*** thurloat_isgone is now known as thurloat12:17
*** sanchitmalhotra has quit IRC12:18
*** mahatic has joined #openstack-swift12:40
*** nadeem has joined #openstack-swift12:40
*** nadeem has quit IRC12:56
*** nadeem has joined #openstack-swift12:56
*** dustins has joined #openstack-swift13:05
*** kairo has joined #openstack-swift13:10
*** breitz has joined #openstack-swift13:16
*** amoturi has joined #openstack-swift13:21
*** haomaiwang has joined #openstack-swift13:23
*** hrou has joined #openstack-swift13:26
*** SkyRocknRoll has quit IRC13:28
*** barker has joined #openstack-swift13:36
*** jordanP has quit IRC13:50
*** vinsh has quit IRC13:51
*** pberis has joined #openstack-swift13:54
*** mc_nair has joined #openstack-swift13:56
*** haomaiwang has quit IRC14:01
*** david-ly_ is now known as david-lyle14:01
*** haomaiwang has joined #openstack-swift14:01
*** cazino has joined #openstack-swift14:02
*** wbhuber has joined #openstack-swift14:07
*** jordanP has joined #openstack-swift14:10
*** sanchitmalhotra1 has quit IRC14:10
*** pberis has quit IRC14:13
*** jordanP has quit IRC14:18
*** jordanP has joined #openstack-swift14:19
*** david-lyle has quit IRC14:22
*** david-lyle has joined #openstack-swift14:26
*** barker has quit IRC14:29
*** barker has joined #openstack-swift14:31
*** mahatic has quit IRC14:35
*** mahatic has joined #openstack-swift14:36
*** jlhinson has joined #openstack-swift14:39
*** clyps_ has quit IRC14:44
*** clyps_ has joined #openstack-swift14:44
*** ejat has joined #openstack-swift14:45
ejathi ..14:45
ejati tried to run rsync rsync://pub@localhost/14:45
ejatbut no output14:45
ejatappreciate if someone can help me14:45
*** wshao has joined #openstack-swift14:51
*** torgomatic has quit IRC14:55
*** torgomatic has joined #openstack-swift14:55
*** ChanServ sets mode: +v torgomatic14:55
*** Fin1te has joined #openstack-swift14:57
*** mahatic_ has joined #openstack-swift14:58
*** peluse_ has joined #openstack-swift14:58
*** peluse has quit IRC14:59
*** albertom has quit IRC14:59
*** minwoob has joined #openstack-swift14:59
*** mahatic has quit IRC15:00
*** haomaiwang has quit IRC15:01
*** haomaiwang has joined #openstack-swift15:01
*** devlaps has joined #openstack-swift15:02
*** barker has quit IRC15:03
*** albertom has joined #openstack-swift15:05
*** barker has joined #openstack-swift15:08
*** annegentle has joined #openstack-swift15:08
*** jkugel has joined #openstack-swift15:10
*** barker has quit IRC15:12
mahatic_clayg: this was the patch 223489 I was referring to the other day, for yoru review15:13
patchbotmahatic_: https://review.openstack.org/#/c/223489/15:13
mahatic_your*15:13
*** silor1 has joined #openstack-swift15:19
*** devlaps has quit IRC15:19
*** dustins is now known as dustins|away15:23
*** silor has quit IRC15:23
*** silor1 is now known as silor15:23
*** silor has quit IRC15:25
*** silor has joined #openstack-swift15:25
*** devlaps has joined #openstack-swift15:28
claygmahatic_: thanks!15:30
acolesnotmyname: i just updated patch https://review.openstack.org/#/c/225540/ with the coveragrc fix that broke gate, i forgot that before rechecking earlier15:32
claygpoor gate15:33
*** pberis has joined #openstack-swift15:35
*** pberis1 has joined #openstack-swift15:36
*** itlinux has joined #openstack-swift15:39
*** pberis has quit IRC15:40
*** pberis1 is now known as pberis15:40
*** garthb has joined #openstack-swift15:47
*** nadeem has quit IRC15:51
*** mc_nair has quit IRC15:52
*** haomaiwang has quit IRC15:54
*** haomaiwang has joined #openstack-swift15:55
*** cazino has left #openstack-swift15:59
*** haomaiwang has quit IRC16:01
*** haomaiwang has joined #openstack-swift16:01
*** wshao has quit IRC16:01
*** gyee has joined #openstack-swift16:02
*** proteusguy_ has quit IRC16:02
*** alejandrito has joined #openstack-swift16:03
*** nadeem has joined #openstack-swift16:03
notmynameacoles: thanks16:05
*** breitz has quit IRC16:06
*** breitz has joined #openstack-swift16:09
*** proteusguy_ has joined #openstack-swift16:15
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix missing container update  https://review.openstack.org/18673516:18
*** zhill has joined #openstack-swift16:21
*** patchbot has quit IRC16:27
*** patchbot has joined #openstack-swift16:27
*** rledisez has quit IRC16:29
openstackgerritMerged openstack/swift-specs: Change ignore-errors to ignore_errors  https://review.openstack.org/22583516:33
*** annegentle has quit IRC16:38
*** annegentle has joined #openstack-swift16:39
*** lyrrad has joined #openstack-swift16:39
*** dustins|away is now known as dustins16:45
*** chlong has quit IRC16:50
*** tongli has joined #openstack-swift16:55
*** haomaiwang has quit IRC16:58
*** haomaiwang has joined #openstack-swift16:59
*** thurloat is now known as thurloat_isgone17:00
*** haomaiwang has quit IRC17:01
*** haomaiwang has joined #openstack-swift17:01
*** haomaiwang has quit IRC17:01
*** chlong has joined #openstack-swift17:02
*** haomaiwang has joined #openstack-swift17:02
*** haomaiwang has quit IRC17:03
*** haomaiwang has joined #openstack-swift17:03
*** Fin1te has quit IRC17:06
*** haomaiwang has quit IRC17:11
*** devlaps has quit IRC17:12
*** itlinux has quit IRC17:13
*** jordanP has quit IRC17:15
claygacoles: hey - patch 181407 - seems reasonable in principle17:15
patchbotclayg: https://review.openstack.org/#/c/181407/17:15
claygacoles: I'm not sure if it totally jives with the multi-frag on primary behavior?17:15
claygacoles: patch 174875 too17:16
patchbotclayg: https://review.openstack.org/#/c/174875/17:16
acolesclayg: hi. wow those are old. i think there is stuff in them that would be good to do. idk if its a priority for liberty.17:19
acoles181407 - would need a bit or rework to allow multi frags on primaries17:20
acolesthe goodness in it is not trying to send frags to handoffs that will conflict17:20
claygacoles: right!  seems totally reasonable!17:21
acolesiirc 174875 tries to be nicer when that ^^ does happen, so the whole ssync transaction is not aborted due to one frag conflict17:21
claygacoles: right - per object sync error reporting or something - it was genius!17:22
acolesclayg: right now i'm in down huge rabbit hole with optimistic gets - i can see the light and it'll be great but its taking me hours17:22
acoleswell, days :)17:22
claygacoles: k, be sure to push what you have before you sign off17:23
claygacoles: thanks for working on it17:23
acolesclayg: k17:23
claygacoles: I think the diskfile stuff is done - i need to look at the object server stuff - are you up in the proxy in the next change now?17:23
acolesclayg: oh its "fun" it that mind-bending way we seem to be attracted to17:24
claygnom nom nom17:25
acolesclayg: i'm working on 215276. yes in proxy obj.py. but i have had to rework the diskfile gather-er stuff so that i can report alternative 'durable' stuff to the proxy for it be smarter about where to go try again.17:27
acolesclayg: actually i think i may have ended up implementing something you commented wrt to sorting all the disk files etc etc17:27
acolesso patch 215276 on gerrit sorta works but is horribly inefficient and has some corner case where it wont find an object.17:28
patchbotacoles: https://review.openstack.org/#/c/215276/17:28
acolesclayg: where i am heading will be much smarter in proxy and will probably end up doing peluse's alt frags thing as a side effect17:29
*** aix has quit IRC17:29
*** mac_ified has joined #openstack-swift17:30
acolesnotmyname: what's our deadline for release? as in what used to be RC17:32
*** subscope has joined #openstack-swift17:37
notmynamethe end of next week is the goal17:39
notmynameAAAAAAAAAAAAAHHHHH!17:39
claygnice17:39
*** silor has quit IRC17:40
*** klrmn1 has joined #openstack-swift17:41
*** amoturi has left #openstack-swift17:50
claygacoles: so everything obj/proxy is going to go into patch 215276?17:52
patchbotclayg: https://review.openstack.org/#/c/215276/17:52
acolesnotmyname: 10/2 right?17:53
notmynameacoles: yeah. the secret is that there isn't a hard date. but we need something around then17:54
acolesclayg: at the moment that was my plan because the proxy and diskfile changes are coupled. like i said i have had to change the diskfile stuff i had in 215276. but i'm open to change that plan.17:55
*** geaaru has quit IRC17:56
acolesnotmyname: so 10/2ish :)17:56
*** mc_nair has joined #openstack-swift17:56
acolesnotmyname: i feared end this week so thats cool17:56
notmynameacoles: good news! ;-)17:57
acolesi can kick back spend more time pressing make-everything-ok.com now. i'm sure its gonna work.17:57
*** Fin1te has joined #openstack-swift18:02
*** chsc has joined #openstack-swift18:03
dhellmannnotmyname: I'm planning to use swiftclient 2.6.0 as the basis for your stable/liberty branch, does that work for you?18:04
notmynamedhellmann: yes18:05
*** mahatic_ has quit IRC18:17
*** jrichli has joined #openstack-swift18:24
acolesclayg: your comment on patch 215276 version 5 about sorting listdir etc. i think thats what i have ended up doing ;)18:30
patchbotacoles: https://review.openstack.org/#/c/215276/18:30
claygacoles: you're just trying to spread the blame again - but if you wrote it i'm sure it's good18:30
claygacoles: ah yeah - i'm looking at that patch - so far I like what I see in diskfile - so KUDOS!18:31
acolesclayg: heh.18:31
acolesclayg: wait. i didn't push that yet!18:31
acolesdid i ?18:31
acolesclayg: i am so confused by myself!18:32
claygWAT?18:33
peluse_FYI ran 4 variations of EC parms (segment size, chunk sizes) for perf tests and will have powerpoint available here in a few hrs, will email to those I know are interested unless someone knows where to post a powerpoint18:33
claygOH VERSION 518:33
acolesclayg: no patch set 7 i just did the cleanups you suggested. next patchset (not yet there ) will be different.18:33
claygoh... well shit - maybe I should work on something else18:34
claygHOW COULD IT POSSIBLY GET ANY BETTER!?18:34
* peluse_ has to go look now, this can't be real!18:34
claygpeluse_: I normally just throw it in google drive and make it public18:34
peluse_clayg, oh yeha, I guess I'll do that and post a thingy here when its up there18:35
claygpeluse_: no don't do it - acoles says it spoil your dinner18:35
peluse_i haven't even had lunch yet??18:35
acolesclayg: yeah well my concern is i'm making it worse but we'll see. trying to get something coherent to push tonight.18:35
*** peluse_ is now known as peluse18:35
*** ChanServ sets mode: +v peluse18:35
*** eranrom has quit IRC18:46
*** cdelatte has joined #openstack-swift18:50
*** nadeem has quit IRC18:56
*** annegentle has quit IRC19:03
*** jrichli has quit IRC19:04
*** nadeem has joined #openstack-swift19:07
*** jrichli has joined #openstack-swift19:10
*** potato_farmer has joined #openstack-swift19:12
*** potato_farmer has left #openstack-swift19:19
*** mc_nair has quit IRC19:25
*** itlinux has joined #openstack-swift19:26
*** jrichli_ has joined #openstack-swift19:27
*** jrichli has quit IRC19:27
*** breitz has quit IRC19:35
*** breitz has joined #openstack-swift19:37
openstackgerritAlistair Coles proposed openstack/swift: diskfile: make get_ondisk_files return a dict  https://review.openstack.org/22270619:40
openstackgerritAlistair Coles proposed openstack/swift: Enable object server to return non-durable data  https://review.openstack.org/21527619:40
*** nadeem has quit IRC19:41
openstackgerritJanie Richling proposed openstack/swift: Encrypting/Decrypting object metadata  https://review.openstack.org/20331019:45
claygacoles: oh my goodness i'm so excited!19:46
acolesclayg: peluse just pushed my latest on patch 215276 before i leave, but it does need more work. this version uses less requests when the optimistic get doesn't produce the goods.19:47
patchbotacoles: https://review.openstack.org/#/c/215276/19:47
acolesclayg: if you do have chance to review could you tell me a better to do the NodeIter alt nodes injection thing?19:48
acolesclayg: oh, and i know there are tests missing. WIP really means WIP.19:48
*** DericHorn-HP has joined #openstack-swift19:48
claygacoles: yup - got it - get outta there19:49
peluseacoles, oh yeah, blame it on me :)19:49
peluseso now I'm curious.  on patch 222706 acoles added set 3 after set 2 was approved but set 2 didn't get merged because of an unrelated bug recheck.  I assume changes from set 3 need to manually broken out as a new patch?  or, once the tests are completed I wonder if it will be smart enough to drop the +A and leav e set 3 there to be reviewed??19:52
patchbotpeluse: https://review.openstack.org/#/c/222706/19:52
*** amoturi has joined #openstack-swift19:53
acolespeluse: yeah i blew it out of zuul i think19:53
peluseacoles, hope that's what happens19:54
acolespeluse: i just re-added +A - i rebased my dependent on master so it got the gate fix (coverargc thing) and 222706 got rebased too, but there is no material change to it.19:54
peluseahhh19:54
pelusewhat fun!19:54
peluse+619:55
acolesgood night19:56
peluselater19:57
*** acoles is now known as acoles_19:58
claygman, so i was going to start rebasing all the patches - but now paul send out pretty pictures!20:01
peluselooks like google drive on my mac wants me to go home to post the perf stuff (doesnt like proxy) so darn in, guess I will do that and post from there20:04
*** tongli has quit IRC20:09
*** annegentle has joined #openstack-swift20:10
claygpeluse: looks super interesting at first glance it seems like we've gotten validation on the increased througput on large writes - and sort of validated the small op req/s trade off - nice work!20:11
*** amoturi has left #openstack-swift20:12
notmynameon the other hand, it's interesting to me that you aren't seeing better performance with larger objects (since less data is being written to disks in EC than in repl). maybe I'm reading it wrong, though20:17
claygnotmyname: you can see it on the op/s graphs down at the bottom 32M and 64M writes20:17
*** itlinux has quit IRC20:22
*** jrichli_ has quit IRC20:30
*** jrichli has joined #openstack-swift20:35
openstackgerritJanie Richling proposed openstack/swift: Change fake_footers to replace response headers instead of append  https://review.openstack.org/22295320:36
*** trifon has quit IRC20:37
*** acoles_ has quit IRC20:39
*** jrichli has quit IRC20:44
*** Fin1te has quit IRC20:46
*** acoles_ has joined #openstack-swift20:48
*** ChanServ sets mode: +v acoles_20:48
*** acoles_ is now known as acoles20:48
*** aix has joined #openstack-swift20:57
*** dustins has quit IRC21:01
*** itlinux has joined #openstack-swift21:02
*** Fin1te has joined #openstack-swift21:04
*** agomez has joined #openstack-swift21:07
agomezAny reason why a cluster with 3x replica would show only 2 primary replicas in get nodes ?21:11
agomezfor some partitions21:12
clayg:'(21:12
claygagomez: https://bugs.launchpad.net/swift/+bug/1452431 maybe :\21:12
openstackLaunchpad bug 1452431 in OpenStack Object Storage (swift) "some parts replicas assigned to duplicate devices in the ring" [Critical,Confirmed] - Assigned to Samuel Merritt (torgomatic)21:12
agomezthough my repica count is less than devices21:14
agomezroot@ctl-bfy-1:~/test-ring# swift-ring-builder container.builder | head21:14
agomezcontainer.builder, build version 53221:14
agomez32768 partitions, 3.000000 replicas, 1 regions, 1 zones, 82 devices, 1.47 balance21:14
agomezThe minimum number of hours before a partition can be reassigned is 021:14
agomez swift-get-nodes container.ring.gz  -p 525221:14
agomezAccount  None21:14
agomezContainerNone21:14
agomezObject   None21:14
agomezPartition525221:14
agomezHash     None21:14
agomezServer:Port Device10.40.140.15:6001 disk-021:14
agomezServer:Port Device10.40.140.17:6001 disk-121:14
agomezServer:Port Device10.40.140.16:6001 disk-1 [Handoff]21:14
agomezServer:Port Device10.40.140.9:6001 disk-7 [Handoff]21:14
agomezcurl -I -XHEAD "http://10.40.140.15:6001/disk-0/5252/None"21:14
agomezcurl -I -XHEAD "http://10.40.140.17:6001/disk-1/5252/None"21:14
claygoh my :'(21:14
agomezcurl -I -XHEAD "http://10.40.140.16:6001/disk-1/5252/None" # [Handoff]21:14
agomezcurl -I -XHEAD "http://10.40.140.9:6001/disk-7/5252/None" # [Handoff]21:14
clayg82 devices and 1.47 balance - seems odd - are the devices lots of different sizes?21:15
agomezI just weight to a new device21:15
agomezadded weight*21:15
agomezthe weight on the new device is greater than the others21:16
agomezit is a bit bigger21:16
*** Fin1te has quit IRC21:18
claygok, well those no good for reason for it to do that - so it's probably a bug21:21
agomezdo you think if I rebalance again it will correct itself ?21:21
claygyou could know for sure if it's that bug i referenced by running the validate script that's attached to it against your ring21:21
claygagomez: depends - you could make a backup/copy and run rebalance with --debug and post the output21:22
agomezok21:22
claygif the validate script on lp bug #1452431 fails on your ring - the --debug output would be useful to have on that bug21:22
openstackLaunchpad bug 1452431 in OpenStack Object Storage (swift) "some parts replicas assigned to duplicate devices in the ring" [Critical,Confirmed] https://launchpad.net/bugs/1452431 - Assigned to Samuel Merritt (torgomatic)21:22
agomezam working on backup copy now to test just waiting on min part hours21:22
claygthere's a command you can give ring-builder called pretend_min_part_hours_passed21:23
claygdon't ever use it on a real builder21:23
agomezroot@ctl-bfy-1:~/test-ring# ./validate.py container.builder21:24
agomezset([2, 3]) 3.021:24
agomezERROR: some parts have different numbers of device ids for their replicas!21:24
claygi hate that stupid bug :'(21:25
agomezso I am being affected by this bug?21:26
agomezwhat does this even mean ?21:26
claygyes21:26
claygit means you have bad rings - bad is pretty subjective tho - there's some set of inputs to ring-builder that produce this crappy behavior - but we don't really understand the constraints on the input or the cause of the beavhior - but we know it's bad21:27
claygi say "we" - i mean "me" - torgomatic and cschwede & maybe timburke could explain the problem better than I could21:27
agomezdo I simply need many more devices ?21:29
claygagomez: i'm not entirely sure - most of the time it seems to have more to do with the relative weights of the failure domains - like you have one server that's got 2x more that some otherone or something21:30
agomezhmm21:30
claygbbiab21:31
MooingLemurJust updated from 2.2.0 to 2.4.0 on my QA cluster, and suddenly account-replicator and container-replicator are not seeing any containers to check.21:32
MooingLemurthe rings havent actually changed in a couple of years... was there a drop of the old ring format?21:33
MooingLemur(or perhaps a regression)21:33
*** hrou has quit IRC21:41
minwoobpeluse: How did you decide that object_size < segment_size is the appropriate threshold for preferring replication over EC?21:42
agomezroot@ctl-bfy-1:~/test-ring# swift-ring-builder container.builder set_weight 10.40.140.15 30021:43
agomezd81r1z1-10.40.140.15:6001R10.40.140.15:6001/disk-0_"" weight set to 300.021:43
agomezroot@ctl-bfy-1:~/test-ring# swift-ring-builder container.builder rebalance21:43
agomezReassigned 370 (1.13%) partitions. Balance is now 0.05.21:43
agomezroot@ctl-bfy-1:~/test-ring# ./validate.py container.builder21:43
agomezSUCCESS: all parts have 3 device ids!21:43
minwoobpeluse: And have you had a chance to consider how the particular (n_data + n_parity) scheme changes the threshold?21:44
claygMooingLemur: I can't think of anyhting that would have changed to cause that21:47
claygoh poppy is CDNaaS - get it "pop" - too funny21:50
* briancline has always wondered about that21:54
*** jlhinson has quit IRC22:00
*** alejandrito has quit IRC22:05
peluseminwoob, did you see the .ppt?22:07
*** breitz has quit IRC22:08
*** breitz has joined #openstack-swift22:08
peluseminwoob, but to answer the question (both actually) we just went with matching the size of a fragment to that of the network/disk chunk defaults.  For a 10:14 that's 64K * 10 so we used 640K segment22:09
minwoobpeluse: Could you send me the ppt?22:09
peluseminwoob, haven't changed anything other than what's in the deck yet which I can't seem to post because google drive isn't working for me but one would assume that if you take the proxy chunk size * n_data you'd probably have a good match22:10
peluseminwoob, sure send me your email22:10
minwoobpeluse: minwoob@us.ibm.com22:10
peluseso any other mac os people, I installed google drive and it says its running but I don't see anything, anywhere...22:10
peluseminwoob, just sent it you you and huber both22:11
minwoobpeluse: Also including wbhuber@us.ibm.com would be good.22:11
minwoobpeluse: Thanks.22:11
peluseheh, beat you to it!22:11
minwoobYou read my mind.22:12
wbhuberpeluse: minwoob: thank you both!22:12
brianclinesummit related question... anyone know if Honolulu is a decent place to re-enter the country? i.e. customs lines not taking 4 hours22:13
pelusebriancline, I've done it many times, not recently, and it sucked22:14
*** jkugel has quit IRC22:14
briancline:|22:15
*** otoolee has quit IRC22:15
peluseso there's some info that I didn't put in the perf preso yet Im sure, feel free to ask questions.  I was using cosbnech w/4 workload driving machines for a total of 512 worker threads for one thing22:15
brianclinetrying to avoid what happened from paris -> chicago last year. customs was awful, which you wouldn't think it'd be at o'hare22:15
brianclineprobably inevitable though22:17
*** itlinux has quit IRC22:19
*** itlinux has joined #openstack-swift22:33
*** pberis has quit IRC22:36
*** pberis has joined #openstack-swift22:37
*** peluse_ has joined #openstack-swift22:37
peluse_initial EC perf data: https://drive.google.com/a/asu.edu/file/d/0Bw_XIyQ62S1vSWs4QWJ5d19aLWM/view?usp=sharing22:38
*** annegentle has quit IRC22:39
*** peluse__ has joined #openstack-swift22:42
peluseif someone can tell me if that link works or not that would be great :)22:42
*** pberis has quit IRC22:42
*** peluse_ has quit IRC22:44
*** peluse is now known as peluse222:45
*** peluse__ is now known as peluse22:45
*** ChanServ sets mode: +v peluse22:46
mattoliverauMorning22:48
pelusemorning22:48
mattoliveraupeluse: need to request access22:48
mattoliverauSo not quite working22:49
pelusemattoliverau: hmmm... OK not sure what I need to do but I'll look again22:49
*** cdelatte has quit IRC22:49
peluse2mattoliverau, oh I see.  I shared with only people at ASU :)  One min22:50
peluseOK, please try this real quick (and thanks) https://drive.google.com/file/d/0Bw_XIyQ62S1vSWs4QWJ5d19aLWM/view?usp=sharing22:51
*** proteusguy__ has joined #openstack-swift22:53
wbhuberpeluse: that works!22:54
*** proteusguy_ has quit IRC22:55
pelusewbhuber: cool, thanks22:58
*** aix has quit IRC23:02
*** agomez has quit IRC23:07
openstackgerritMerged openstack/swift: Merge branch 'master' into feature/crypto  https://review.openstack.org/22554023:08
*** DericHorn-HP has quit IRC23:09
*** itlinux has quit IRC23:14
*** itlinux has joined #openstack-swift23:17
*** chsc has quit IRC23:19
*** jamielennox|away is now known as jamielennox23:23
*** km has joined #openstack-swift23:25
openstackgerritMerged openstack/python-swiftclient: Change ignore-errors to ignore_errors  https://review.openstack.org/22582623:28
*** peluse has quit IRC23:37
*** zhill has quit IRC23:39
*** itlinux has quit IRC23:43
*** minwoob has quit IRC23:57
*** kei_yama has joined #openstack-swift23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!