Tuesday, 2015-09-29

*** minwoob has quit IRC00:05
*** kota_ has joined #openstack-swift00:25
*** ChanServ sets mode: +v kota_00:25
* notmyname admits defeat for now on patch 21527600:27
patchbotnotmyname: https://review.openstack.org/#/c/215276/ - Enable object server to return non-durable data00:27
*** zhill has quit IRC00:29
kota_good morning00:30
*** DericHorn-HP has joined #openstack-swift00:34
timburkegood morning kota_!00:34
*** dmorita has joined #openstack-swift00:34
kota_timburke: hi tim :D00:35
*** lyrrad has quit IRC00:36
*** aix has quit IRC00:39
*** aix has joined #openstack-swift00:40
*** m_kazuhiro has joined #openstack-swift00:41
*** amit213 has quit IRC00:45
*** klrmn has quit IRC00:45
*** thurloat_isgone has quit IRC00:47
*** _hrou_ has joined #openstack-swift00:47
*** zhill has joined #openstack-swift00:47
*** DericHorn-HP has quit IRC00:49
*** hrou has quit IRC00:51
*** zhill has quit IRC00:52
*** aix has quit IRC00:52
*** DericHorn-HP has joined #openstack-swift00:52
*** klrmn has joined #openstack-swift00:53
*** thurloat has joined #openstack-swift00:53
*** shakamunyi has joined #openstack-swift00:55
*** aix has joined #openstack-swift00:55
*** marzif has joined #openstack-swift00:56
*** klrmn1 has quit IRC01:08
mattoliveraukota_: morning01:17
mattoliverautimburke: o/01:17
*** DericHorn-HP has quit IRC01:20
timburkehi mattoliverau!01:28
*** jkugel has joined #openstack-swift01:35
EmilienMI'm doing puppet integration CI and have issues with tempest tests for Swift01:42
EmilienM"Access was denied to this resource"01:42
EmilienMall logs can be found here: http://logs.openstack.org/50/228450/16/check/gate-puppet-openstack-integration-dsvm-centos7/a8bb16d/01:43
EmilienMthe failure is here: http://logs.openstack.org/50/228450/16/check/gate-puppet-openstack-integration-dsvm-centos7/a8bb16d/console.html#_2015-09-29_01_16_19_39701:46
*** dustins has joined #openstack-swift01:47
*** DericHorn-HP has joined #openstack-swift01:48
*** zhill has joined #openstack-swift01:52
*** DericHorn-HP has quit IRC01:56
*** zhill has quit IRC01:57
*** duobei has joined #openstack-swift01:59
*** DericHorn-HP has joined #openstack-swift02:02
*** DericHorn-HP has quit IRC02:11
*** klrmn1 has joined #openstack-swift02:12
*** zhill has joined #openstack-swift02:28
*** zhill has quit IRC02:32
*** jkugel has quit IRC02:33
*** dmorita has quit IRC02:34
*** garthb has joined #openstack-swift02:44
*** haomaiwang has joined #openstack-swift02:51
*** zhill has joined #openstack-swift02:52
*** silor has joined #openstack-swift02:56
*** zhill has quit IRC02:56
*** haomaiwang has quit IRC03:01
*** haomaiwang has joined #openstack-swift03:01
*** zhill has joined #openstack-swift03:05
janonymousmorning03:06
*** DericHorn-HP has joined #openstack-swift03:14
*** _hrou_ has quit IRC03:19
*** DericHorn-HP has quit IRC03:32
*** dustins has quit IRC03:33
*** links has joined #openstack-swift03:36
*** sanchitmalhotra has joined #openstack-swift03:40
*** bill_az has quit IRC03:44
*** Kennan2 is now known as Kennnan03:45
*** DericHorn-HP has joined #openstack-swift03:46
*** DericHorn-HP has quit IRC03:49
*** sanchitmalhotra1 has joined #openstack-swift03:54
*** sanchitmalhotra has quit IRC03:56
*** sanchitmalhotra has joined #openstack-swift03:59
*** haomaiwang has quit IRC04:01
*** sanchitmalhotra1 has quit IRC04:01
*** haomaiwang has joined #openstack-swift04:01
*** mahatic has joined #openstack-swift04:03
*** sanchitmalhotra1 has joined #openstack-swift04:08
*** sanchitmalhotra has quit IRC04:10
*** proteusguy has quit IRC04:14
*** proteusguy has joined #openstack-swift04:26
mattoliveraujanonymous: morning (sorry for slow reply been at lunch)04:29
*** DericHorn-HP has joined #openstack-swift04:31
*** DericHorn-HP has quit IRC04:34
mahaticmattoliverau: hello, is it noon for you? where do you stay again? :D I know it's Australia04:40
*** chsc has joined #openstack-swift04:41
*** DericHorn-HP has joined #openstack-swift04:48
*** chsc has quit IRC04:54
*** DericHorn-HP has quit IRC04:56
*** haomaiwang has quit IRC05:01
*** haomaiwang has joined #openstack-swift05:01
*** klrmn1 has quit IRC05:06
mattoliveraumahatic: well now its 3pm, when you asked it was 2:40pm, I just had a late lunch :) I'm in Melbourne Australia :)05:20
mattoliveraumahatic: oh and o/05:20
mahaticmattoliverau: ah :)05:22
mahaticmattoliverau: yes o/ :D05:22
*** garthb has quit IRC05:32
openstackgerritMatthew Oliver proposed openstack/swift: Don't send commits for quorum *BAD* requests on EC  https://review.openstack.org/22005905:33
*** sileht has quit IRC05:33
kota_mattoliverau: no worries05:37
*** ppai has joined #openstack-swift05:39
mattoliveraukota_: first time using the gerrit edit commit message feature, you'd think it'll be smart enough to not nuke votes now that it's editable.05:42
*** mahatic has quit IRC05:44
kota_mattoliverau: yup, it's easy to understand what changed but hopefully i wish it would keep the votes :/05:46
*** haomaiwang has quit IRC06:01
*** haomaiwang has joined #openstack-swift06:01
*** jamielennox is now known as jamielennox|away06:12
*** openstackgerrit has quit IRC06:16
*** openstackgerrit has joined #openstack-swift06:16
*** jst_ has quit IRC06:21
janonymousmattoliverau: :) it's morning here :)06:21
*** SkyRocknRoll has joined #openstack-swift06:24
*** km has quit IRC06:30
*** km_ has joined #openstack-swift06:30
*** trifon has quit IRC06:36
*** trifon has joined #openstack-swift06:49
*** haomaiwang has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:01
*** zhill has quit IRC07:17
*** rledisez has joined #openstack-swift07:24
*** mac_ified has quit IRC07:27
*** SkyRocknRoll has quit IRC07:45
*** geaaru has joined #openstack-swift07:48
*** jordanP has joined #openstack-swift07:49
*** eranrom has joined #openstack-swift07:57
*** haomaiwang has quit IRC08:01
*** haomaiwang has joined #openstack-swift08:01
*** jistr has joined #openstack-swift08:16
*** marzif has quit IRC08:18
*** acoles_ is now known as acoles08:42
acolesnotmyname: its *possible* ;) however, i'd need to tinker with object server dirs to delete .durable files, like clayg says, and i think its just as effective to do that in the unit tests in proxy/test_server.py08:48
acolesnotmyname: my main focus this week is to work on the tests on patch 215276, and of course address review comments.08:49
patchbotacoles: https://review.openstack.org/#/c/215276/ - Enable object server to return non-durable data08:49
*** Kennnan2 has joined #openstack-swift08:54
*** Kennnan has quit IRC08:54
acoleskota_: you still around?08:55
kota_yup09:00
*** haomaiwang has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:01
kota_acoles: ack, I'm working in progress for reviewing 215276. that's awesome but it still needs more time to look at deeply, I'll add comments in today.09:05
acoleskota_: fantastic, thank you, its a big review :/ did you see my question on your patch 220059?09:06
patchbotacoles: https://review.openstack.org/#/c/220059/ - Don't send commits for quorum *BAD* requests on EC09:06
kota_sorry, I am going to be offline in 30mins or 1 hour for meeting.09:06
kota_not yet, sorry.09:06
acoleskota_: ok np09:06
kota_acoles: I hope I will do that asap.09:06
*** kota_ has quit IRC09:06
acoleskota_: i think there is no problem but I just wanted to be sure what you thought before voting.09:07
*** silor has quit IRC09:07
*** geaaru has quit IRC09:12
*** nakagawamsa has joined #openstack-swift09:18
*** geaaru has joined #openstack-swift09:26
*** mahatic has joined #openstack-swift09:29
*** kota_ has joined #openstack-swift09:48
*** ChanServ sets mode: +v kota_09:48
*** nakagawamsa has quit IRC09:49
kota_I'm back.09:49
*** haomaiwang has quit IRC10:01
acoleshi kota_ : so my query with patch 220059 was about the change to have_adequate_successes10:01
patchbotacoles: https://review.openstack.org/#/c/220059/ - Don't send commits for quorum *BAD* requests on EC10:01
*** haomaiwa_ has joined #openstack-swift10:01
acoleswhich you change to include 1xx responses as 'successes'10:01
acoleson master the proxy is waiting for all nodes to respond with 1xx (or timeout) - which may not be what we wanted to happen - and with your change the proxy waits for just 'adequate' 1xx before proceeding with the confirmation phase.10:03
acoleskota_: but it sends the confirmation to *all* nodes.10:04
acoleskota_: i think that's ok?? a node that was not counted in 'adequate successes' may timeout or may return 422 but in either case will ignore the confirmation phase, correct?10:05
kota_yup10:05
acoleskota_: good!10:06
*** haomaiwa_ has quit IRC10:07
*** m_kazuhiro has quit IRC10:08
acoleskota_: another thing, when i ran test_PUT_ec_fragment_quorum_bad_request i noticed that the proxy tries to send chunks to a node that has responded 400 :/ that's not an issue with your patch but seems odd.10:08
kota_sorry, got phone call10:09
acoleskota_: heh. busy evening for you!10:09
kota_so sorry10:10
kota_back, again.10:15
kota_I had a crasy busy begining of this week :/10:16
kota_so...10:16
*** T0m_ has joined #openstack-swift10:18
*** T0m_ has left #openstack-swift10:18
kota_oh, yeah, you're right. if we change the 1xx in  _have_adequate_successes, get_put_response waits just quorum 1xx.10:24
kota_but that's out side of my intention, i have to reconsider the effect, now.10:25
kota_In my intention, just reusing existing method for my purpose.10:25
kota_acoles: very nice catch for that.10:29
acoleskota_: i'm not sure it is a problem: once we have ec_ndata+1 1xx responses then go ahead with the confirmation phase.10:35
*** km_ has quit IRC10:36
acoleskota_: maybe the method name is a little unclear - "have_adequate_successes" == have adequate success or informational10:36
acoleskota_: but you have though about this more than I have so I'll wait for your conclusion10:37
kota_acoles: thanks for notify me that, exactly, have_adequate_success should do about "success" responses not "informational" imo.10:39
kota_currently I'm thinking another idea to get apply functions like partial, but not sure, now making sure for the feasibility.10:40
kota_we might be able to send commit with quourum 1xx but i'm not sure too.10:45
kota_thinking bad cases.10:45
acoleskota_: k. its getting late for you, if you make another version i can review tomorrow.10:45
*** duobei has quit IRC10:47
kota_acoles: thanks, maybe I have to lean more the HTTP sequence because if we don't pull the 1xx response from the rest of putters, can we handle the final responses?10:47
kota_i'm not sure.10:47
kota_after sending commits.10:47
*** jamielennox|away is now known as jamielennox10:49
*** silor has joined #openstack-swift10:50
*** SkyRocknRoll has joined #openstack-swift10:51
kota_acoles: anyways, thanks a lot! :D10:53
acoleskota_: hmmm, good question. yeah, if the proxy does not wait to read the 1xx response from a node then does it get the 2xx response after the commit? idk, sorry! it *might* be ok because if you look at conn.await_response it does a different thing for final_phase.10:53
acoleskota_: np. good luck!10:53
*** silor has quit IRC10:54
*** silor has joined #openstack-swift10:54
*** 18VAARFFB has joined #openstack-swift10:56
*** silor has quit IRC10:59
*** silor1 has joined #openstack-swift10:59
*** 18VAARFFB has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
*** silor1 is now known as silor11:02
*** ppai has quit IRC11:04
*** haomaiwang has quit IRC11:11
*** ppai has joined #openstack-swift11:14
*** duobei has joined #openstack-swift11:20
*** delattec has quit IRC11:21
*** marzif has joined #openstack-swift11:28
*** ccavanna has quit IRC11:30
*** vinsh has joined #openstack-swift11:31
*** satyadevSVN has joined #openstack-swift11:35
*** satyadevSVN has quit IRC11:41
*** delattec has joined #openstack-swift11:43
*** delattec has quit IRC11:50
*** cdelatte has joined #openstack-swift11:53
*** delattec has joined #openstack-swift11:53
*** kei_yama has quit IRC12:09
*** mandarine has joined #openstack-swift12:19
mandarinehello hello hello, it's been a while :)12:20
mandarineIt appear I run once again into a delicate problem of swift generating "useless" load on deleted containers db files.12:20
*** janonymous_ has joined #openstack-swift12:21
mandarineIn order to explain more: when my containers are deleted, the .db file on the disk stays and doesn't seem to be deleted any time soon by the container-replicator or by the container-reconciler. That would be all but some container related processes are touching those silly files and make my poor server use CPU on potentially useless operations.12:23
*** delatte has joined #openstack-swift12:24
mandarineDo any of you have an idea on what might happen or any pointer on what I ought to do ?12:24
*** cdelatte has quit IRC12:27
*** delattec has quit IRC12:27
eranrommandarine,How mush time passed since you deleted the container via REST?12:28
mandarineeranrom: months12:28
eranrommandarine, ok, I did not expect that much time...12:29
mandarine:|12:30
eranrommandarine: So I assme you are aware of the reclaim_age12:30
mandarineYup12:30
mandarineIt does not seem to work12:30
eranrommandarine: I am afraid then that best wuold be to open a bug, esp. if you can reproduce. Did you go over any ring changes?12:32
mandarineno ring change, nope :)12:32
*** kairo has joined #openstack-swift12:32
mandarineI higly doubt it's a bug. It looks more like something in my configuration or something I may have missed12:32
eranrommandarine: Is that a production env?12:33
mandarineYes it is12:33
*** NM has joined #openstack-swift12:34
eranromSwift version?12:35
mandarine2.2.0-112:36
*** ppai has quit IRC12:36
*** amoturi has joined #openstack-swift12:36
*** aix has quit IRC12:37
*** mahatic has quit IRC12:38
*** mahatic has joined #openstack-swift12:40
eranrompardon the question, but I guess that heading the container returns 404 - right?12:44
mandarineprobably. let me check12:47
mandarineYes it does12:47
mandarineThe file is still there and I can do a "swift-container-info" on it to see an amazing "Delete Timestamp" field in the past.12:50
eranromright. Can you paste the other container info you see?12:51
*** alejandrito has joined #openstack-swift12:52
eranromesp. do you have a "'put_timestamp" there?12:53
mandarineOn my dev platform, I put the reclaim_age to 30.12:53
mandarineI do12:53
*** SkyRocknRoll has quit IRC12:53
eranromis it also in the past?12:53
mandarineYes12:53
eranromwhich one is greater?12:54
mandarineThe Delete Timestamp12:54
*** breitz has quit IRC12:54
*** breitz has joined #openstack-swift12:54
mandarinePut at 1443528214.63302 and Delete at 1443528345.3284712:54
mandarine(again, on my dev tests)12:55
eranromwhere the container does not get deleted (that is on your dev tests machine)12:56
openstackgerritKota Tsuyuzaki proposed openstack/swift: Don't send commits for quorum *BAD* requests on EC  https://review.openstack.org/22005912:57
mandarinein the filesystem : /srv/node/2/containers/58/388/01d0c60670da13e694796ad6fc108388/01d0c60670da13e694796ad6fc108388.db12:57
mandarineThat file should be deleted12:57
mandarineAnd is not12:57
kota_acoles: I updated patch set but I'm tired so I'll continue to review yours ;)12:57
*** kota_ has quit IRC12:57
*** jrichli has joined #openstack-swift13:02
eranromok, trying another direction: Do you see a .lock file in the directory? (/srv/node/2/containers/58/388/01d0c60670da13e694796ad6fc108388/)13:02
*** jkugel has joined #openstack-swift13:03
acoleskota: have a good night13:05
*** hrou has joined #openstack-swift13:07
*** daemontool_ has joined #openstack-swift13:10
*** amoturi has quit IRC13:10
*** DericHorn-HP has joined #openstack-swift13:12
*** delatte has quit IRC13:13
*** CR7 has joined #openstack-swift13:13
*** eranrom has quit IRC13:15
mandarineDamn13:17
mandarineYes, there is a .lock file13:17
mandarine(I'll wait for the ping to untimeout :p)13:18
*** satyadevSVN has joined #openstack-swift13:20
*** satyadevSVN has quit IRC13:20
*** dustins has joined #openstack-swift13:21
*** amoturi has joined #openstack-swift13:21
*** links has quit IRC13:22
openstackgerritAlistair Coles proposed openstack/swift: Enable object server to return non-durable data  https://review.openstack.org/21527613:25
*** bill_az has joined #openstack-swift13:25
*** alejandrito has quit IRC13:28
*** ctrath has joined #openstack-swift13:31
*** trifon has quit IRC13:35
*** haomaiwang has joined #openstack-swift13:36
*** alejandrito has joined #openstack-swift13:40
*** haomaiwang has quit IRC13:40
*** aix has joined #openstack-swift13:40
*** haomaiwa_ has joined #openstack-swift13:40
*** CR7 has quit IRC13:41
*** cdelatte has joined #openstack-swift13:46
*** delattec has joined #openstack-swift13:46
*** marzif has quit IRC13:49
*** wbhuber has joined #openstack-swift13:50
*** ccavanna has joined #openstack-swift13:50
*** DericHorn-HP has quit IRC13:50
*** DericHorn-HP has joined #openstack-swift13:52
*** pberis has joined #openstack-swift13:53
*** haomaiwa_ has quit IRC14:01
*** haomaiwa_ has joined #openstack-swift14:01
*** lcurtis has joined #openstack-swift14:02
*** SkyRocknRoll has joined #openstack-swift14:02
*** chsc has joined #openstack-swift14:03
*** slo_ has joined #openstack-swift14:09
*** DericHorn-HP has quit IRC14:10
openstackgerritAlistair Coles proposed openstack/swift: Enable object server to return non-durable data  https://review.openstack.org/21527614:20
*** jlhinson has joined #openstack-swift14:24
*** minwoob has joined #openstack-swift14:28
*** juzuluag has joined #openstack-swift14:37
*** MVenesio has joined #openstack-swift14:38
*** duobei has quit IRC14:51
*** zaitcev has joined #openstack-swift14:56
*** ChanServ sets mode: +v zaitcev14:56
*** seandrummond has joined #openstack-swift15:00
*** oddsam91 has joined #openstack-swift15:00
*** haomaiwa_ has quit IRC15:01
*** seandrummond has left #openstack-swift15:01
*** haomaiwang has joined #openstack-swift15:01
*** oddsam91 has left #openstack-swift15:07
*** kairo has left #openstack-swift15:14
*** haomai___ has joined #openstack-swift15:16
*** haomaiwang has quit IRC15:18
*** DericHorn-HP has joined #openstack-swift15:31
*** haomai___ has quit IRC15:35
*** Fin1te has joined #openstack-swift15:39
*** marzif has joined #openstack-swift15:54
*** lyrrad has joined #openstack-swift16:01
*** sanchitmalhotra1 has quit IRC16:03
*** gyee has joined #openstack-swift16:04
*** marzif has quit IRC16:05
*** trifon has joined #openstack-swift16:14
*** fthiagogv has joined #openstack-swift16:14
*** fthiagogv_ has joined #openstack-swift16:14
*** Fin1te has quit IRC16:15
*** fthiagogv has quit IRC16:16
*** gyee has quit IRC16:19
*** jistr has quit IRC16:26
*** gyee has joined #openstack-swift16:29
*** pberis1 has joined #openstack-swift16:35
*** pberis has quit IRC16:36
*** pberis1 is now known as pberis16:36
*** rledisez has quit IRC16:36
*** pberis1 has joined #openstack-swift16:40
*** pberis has quit IRC16:40
*** pberis1 is now known as pberis16:40
*** klrmn1 has joined #openstack-swift16:44
*** blmartin has joined #openstack-swift16:51
*** zhill has joined #openstack-swift16:52
*** jordanP has quit IRC16:55
*** ctrath has quit IRC16:59
*** garthb has joined #openstack-swift17:00
*** cazino has joined #openstack-swift17:03
*** pgbridge has quit IRC17:09
*** janonymous_ has quit IRC17:11
openstackgerritDavid Goetz proposed openstack/swift: Add concurrent reads option to proxy  https://review.openstack.org/11771017:14
*** ctrath has joined #openstack-swift17:17
*** marzif has joined #openstack-swift17:19
notmynamegood morning17:21
*** Fin1te has joined #openstack-swift17:23
*** garthb has quit IRC17:27
*** garthb has joined #openstack-swift17:28
openstackgerritMerged openstack/swift: Fix inlines for test/unit/obj/test_server.py  https://review.openstack.org/22844217:29
*** trifon has quit IRC17:38
*** sileht_ has joined #openstack-swift17:44
*** sileht_ is now known as sileht17:45
*** sileht has quit IRC17:45
*** sileht has joined #openstack-swift17:45
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873617:57
*** ctrath has quit IRC18:01
acolestimburke: thanks for reviewing that crypto patch18:02
acolesnotmyname: good morning18:02
hroutimburke, +1  You made a lot of interesting points (particularly about the encoding), thanks!18:03
*** ctrath has joined #openstack-swift18:04
timburkeacoles: happy to help! i'd starred it a while ago but hadn't gotten around to reviewing it. then the StopIteration stuff made me think of patch 227569, and by the time i was convinced that we *weren't* going to run into similar issues, i felt like i ought to just actually leave a review :)18:05
patchbottimburke: https://review.openstack.org/#/c/227569/ - Only yield the pending segment on error if it's a ...18:05
*** ctrath has left #openstack-swift18:06
acolestimburke: yeah i want to go _understand_ that patch ^^ looks like a really interesting catch18:07
* acoles thinks unit tests run slower when he's hungry :(18:08
*** marzif has quit IRC18:09
openstackgerritAlistair Coles proposed openstack/swift: Enable object server to return non-durable data  https://review.openstack.org/21527618:09
*** delatte has joined #openstack-swift18:09
*** delattec has quit IRC18:09
*** cdelatte has quit IRC18:09
*** acoles is now known as acoles_18:11
*** mahatic has quit IRC18:12
timburkeacoles: it was weird. i'm not event entirely convinced that there was an issue that could affect a client. but my takeaway was "never yield from inside a finally"18:12
claygweeee18:14
hroutimburke, at some point I didn't even think you can use a yield in a try/catch/finally (never mind yielding inside a finally)?  Maybe that was changed in 2.6 ?18:14
*** SkyRocknRoll has quit IRC18:16
notmynameI wonder if we can get patch 220059 landed today18:19
patchbotnotmyname: https://review.openstack.org/#/c/220059/ - Don't send commits for quorum *BAD* requests on EC18:19
notmynamehrou: https://gist.github.com/notmyname/bed03c9796bc9dcada1b18:22
hrounotmyname, yep I noticed when you pasted that and tried it my self : ) And it indeed throws the generator error on the break.18:22
*** geaaru has quit IRC18:23
hrounotmyname, there's some backstory https://www.python.org/dev/peps/pep-0342/ and https://bugs.python.org/issue2298818:25
*** delatte has quit IRC18:26
*** delatte has joined #openstack-swift18:29
*** delatte has quit IRC18:30
*** SkyRocknRoll has joined #openstack-swift18:31
*** SkyRocknRoll has quit IRC18:34
*** SkyRocknRoll has joined #openstack-swift18:34
*** trifon has joined #openstack-swift18:35
*** 32NAAGPES has joined #openstack-swift18:35
*** cdelatte has joined #openstack-swift18:35
*** haypo has joined #openstack-swift18:37
*** aix has quit IRC18:38
*** flwang has quit IRC18:38
notmynameand it seems there's some follow-up needed for https://review.openstack.org/#/c/227133/ by cschwede18:38
notmynamemattoliverau: ^ in the gerrit comment, you said you were working on testing it with keystone. any results there yet?18:38
*** flwang has joined #openstack-swift18:38
haypohi. what is the status of EC in swift? does it work now? :)18:40
notmynamehaypo: we're working on some known edge cases now. I'd certainly recommend it for testing right now. I wouldn't yet recommend it for prod data18:41
notmynamewe'll see what gets done by friday18:41
notmynameand of course it "works" now. it's "worked" for a long time. it's the last edge cases to properly handle certain failure scenarios that we're finishing up18:42
hayponotmyname: hum, so it will require one more version to be fully stable?18:44
notmynamehaypo: I'm not sure what you're asking18:48
hayponotmyname: is EC announced as experimental/not ready for the production, in the doc?18:49
notmynamehttp://docs.openstack.org/developer/swift/overview_erasure_code.html18:49
hayponotmyname: so the "Beta: Not production ready" warning is kept, ok18:49
notmynamehaypo: note that we haven't yet done our liberty release18:49
*** eranrom has joined #openstack-swift18:52
*** SkyRocknRoll has quit IRC18:55
*** slo_ has quit IRC18:57
*** slo_ has joined #openstack-swift18:58
minwoobacoles_: I noticed that you were able to get around the xattr copy issue by avoiding the copy in the first place ... I haven't found a copy solution that works, but I found some sources stating that the copy methods in shutil incorporate xattrs in going forward in py3.19:01
*** DericHorn-HP has quit IRC19:01
*** DericHorn-HP has joined #openstack-swift19:02
*** ccavanna has quit IRC19:07
notmynametorgomatic: did probe tests for https://review.openstack.org/#/c/220059/6 work for you?19:11
torgomaticnotmyname: I didn't run them for 6; let me do that now19:12
notmynameI'm running them against master now to compare19:12
zaitcevI spent whole day today building a package after package for CVE-2015-5223 openstack-swift: Information leak via Swift tempurls19:13
zaitcevFeel like Charlie Chaplin in the factory. So many identical packages. F22, OSP5 RHEL6, OSP5 RHEL7, OSP619:14
notmynamezaitcev: thanks19:14
notmynameI'm surprised mitre still hasn't been updated http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2015-522319:14
*** juzuluag has quit IRC19:15
zaitcevBTW, it backports to Icehouse trivially19:15
zaitcevBut the upstream somehow got rid of that branch, it appears.19:16
notmynamezaitcev: yeah, after a branch isn't supported any more (ie after 2 releases) -infra deletes those old stable releases19:16
zaitcevmeeeh19:17
zaitcevOh well. I guess this is what I get for cheating death again today.19:17
zaitcevhere's a screencap from FlightAware https://twitter.com/ani_nouto/status/64892367863013376019:18
notmynamezaitcev: you do packaging, so you get to cheat death fairly often. or, alternatively, you've already sold your soul to do packaging, so Death isn't too interested ;-)19:18
notmynamezaitcev: wow19:19
notmynamealso, you're up in NY now?19:19
zaitcevIn hotel in Rochester19:19
zaitcevLanded aroudn 9 a.m. and have a meeting with a guy around 5 p.m., so thought I could do somethiing for Swift for a change. It was all Ceph all the time for weeks now.19:20
zaitcevIt's a nightmare. So many classes and redundant variables each set in mysterious ways and interacting with each other. I've seen more mantainable code in assembly.19:21
notmynameyikes19:21
notmynamezaitcev: in the swift world, if you haven't caught up yet, we're looking at these patches this week: https://wiki.openstack.org/wiki/Swift/PriorityReviews19:22
*** silor has quit IRC19:26
vinshSo... when configuring erasure coding.. are the account/container rings still a standard replication type?  Do I need to assign a storage policy to them? or does the storage policy only apply to an object ring?19:26
notmynamevinsh: storage policies are only of object rings19:26
vinshOk cool. So swift will treat the account/container rings as they are built to be.19:26
*** silor has joined #openstack-swift19:27
notmynameright19:27
zaitcevRings, yes19:27
vinshnotmyname: Got the erasure code trial hardware in finally.  Starting the build.19:27
notmynamegreat19:27
vinshkeeping account/container on the proxy nodes.19:28
vinshon NVMe drives :D19:28
notmynamecool19:28
vinshAre zones treated specially with EC?19:30
notmynameno19:30
vinshHuhm. I wonder how to decide on zones then.19:32
zaitcevIt's orthogonal in a sense that zones are taken into account by the builder when it scatters partitions. It walks whone address space and for each #, asks, where is the best place? Is this zone good? This nore? etc.19:32
vinshah ok. good.. was thinking something like that.19:32
notmynameright. often times a zone == a rack19:32
zaitcevBut EC is all in proxy and reconstructors. They load the map the builder has done and don't even care how it came up with the layout.19:32
*** silor1 has joined #openstack-swift19:33
*** silor has quit IRC19:33
*** silor1 is now known as silor19:33
vinshmaybe some choice of ec of 10:3.. given x nodes, split to y zones.19:34
vinshsomething to further enforce a spread of chunks.19:34
* vinsh will trust the builder.19:35
zaitcevBuilder can't know what racks are where in what datacenters, what busses they share. That's why you specify zones by hand.19:36
vinshWhich makes sense to me with replicas19:36
vinshJust grocking what it means with ec19:37
zaitcevI think... it's like having 13 replicas19:37
zaitcevplacement-wise19:37
notmynameyup19:37
vinshwhere some number is needed to reconstruct a whole19:37
zaitcevno, it's the total m. you only need 10 to  reconstruct19:38
zaitcevbut you (the builder) have to place all 1319:38
*** gyee has quit IRC19:38
*** sileht has quit IRC19:39
*** pgbridge has joined #openstack-swift19:40
*** pberis has quit IRC19:40
zaitcevI have 40 minutes... Feel like can't give Kota justice in 220059 but I can post some senseless comments19:42
*** sileht has joined #openstack-swift19:45
*** sileht has quit IRC19:47
*** sileht has joined #openstack-swift19:48
*** pberis has joined #openstack-swift19:50
*** earlephilhower has quit IRC20:01
*** csmart has quit IRC20:32
*** csmart has joined #openstack-swift20:34
*** DericHorn-HP has quit IRC20:35
openstackgerritMichael Barton proposed openstack/swift: go: CopyN that re-uses buffers  https://review.openstack.org/22914120:36
*** cdelatte has quit IRC20:40
*** 32NAAGPES has quit IRC20:40
*** zaitcev has quit IRC20:44
*** pberis has quit IRC20:52
*** pberis has joined #openstack-swift20:53
*** blmartin has quit IRC21:01
*** amoturi has left #openstack-swift21:03
*** silor has quit IRC21:04
brianclineare there any known issues that could cause questionable functest failures for test_object.TestObject when it creates its containers in setUp?21:11
brianclinei ask because i'm seeing test failures when it gets a 202 rather than a 201.. seems to be issuing two successive puts, but it's only expecting a 20121:12
layzee__how does one run ssbench targetted against a specific swift node ?21:14
*** layzee__ is now known as layzee21:14
layzeei was looking for an option like --- ssbench-master run-scenario --targetserver=x.y.z.u21:15
vinshtarget a specific proxy you mean?21:15
layzeeyes21:15
layzeeor do you run this locally only on the proxy node ?21:15
vinshah, there is a flag... lemme find my notes21:16
vinshI run it from a powerful benchmark host21:16
layzeenice21:16
vinshI target a proxy, or many proxies or a load balancer21:16
layzeeok21:16
*** MVenesio has quit IRC21:17
vinshlayzee: the -S flag21:18
vinshfor example -S http://69.134.198.60:8080/v1/KEY_83796bbb39734fe18e8e975aedfe639a21:19
layzeeha ! thanks.21:19
vinshI wish you well.  Benchmarking with that tool is fun but far from easy(when it comes to interpreting exactly what you are doing)21:20
layzeevinsh: thx21:22
*** haypo has left #openstack-swift21:23
eranrombriancline: I just updated master and got all func tests working.21:28
eranrombriancline: can you point pls to the 2 successive PUTs you mention?21:30
eranrombriancline: if these are the 2 create containers in setUP then it seems they are done for different accounts21:35
*** Zyric2 has joined #openstack-swift21:35
brianclineeranrom: yeah, I think I did something terrifically dumb in my test config :X21:36
*** jrichli has quit IRC21:38
brianclineeranrom: well, config was right, but the steps i did to set up the accounts had a typo. ack21:38
brianclineyep, that was it. i need some sleep, it's been a long week already :P21:41
eranrombriancline: me too. :-)21:42
*** garthb has quit IRC21:45
*** garthb has joined #openstack-swift21:46
*** eranrom has quit IRC21:47
*** slo_ has quit IRC21:50
*** devlaps has joined #openstack-swift21:52
*** fthiagogv_ has quit IRC21:54
*** ccavanna has joined #openstack-swift21:57
*** gyee has joined #openstack-swift21:59
*** hrou has quit IRC22:00
*** jkugel has quit IRC22:01
openstackgerritJohn Dickinson proposed openstack/swift: fix docstring: s/2xx/1xx/  https://review.openstack.org/22916322:04
notmynameeasiest review ever? ^22:04
torgomaticyes22:05
notmynameif for whatever reason kota's patch doesn't merge cleanly, I'll squash that into his22:06
*** NM has quit IRC22:09
*** marcusvrn_ has quit IRC22:15
*** wbhuber has quit IRC22:17
*** pberis has quit IRC22:17
*** CaioBrentano has quit IRC22:24
*** CaioBrentano has joined #openstack-swift22:24
*** CaioBrentano has quit IRC22:29
mattoliveraumorning22:40
*** lcurtis has quit IRC22:41
notmynamehello22:42
*** proteusguy_ has joined #openstack-swift22:43
*** jlhinson has quit IRC22:43
*** proteusguy has quit IRC22:45
openstackgerritMerged openstack/swift: Don't send commits for quorum *BAD* requests on EC  https://review.openstack.org/22005922:46
mattoliveraunotmyname: still mucking around with keystone. It wasn't working (keystone server) so got a little sidetracked with other reviews. Got it working last night while starting to look at bulk middleware placement.. then wife got home. Will look at the service token thing this morn :)22:46
notmynamemattoliverau: thanks22:46
*** NM has joined #openstack-swift22:53
*** alejandrito has quit IRC22:56
*** trifon has quit IRC22:56
*** km has joined #openstack-swift23:02
*** cdelatte has joined #openstack-swift23:15
*** trifon has joined #openstack-swift23:23
*** kei_yama has joined #openstack-swift23:25
*** ccavanna_ has joined #openstack-swift23:27
*** hrou has joined #openstack-swift23:29
*** ccavanna has quit IRC23:30
*** xnox has quit IRC23:32
*** charz has quit IRC23:32
*** onovy has quit IRC23:32
*** amandap has quit IRC23:32
*** tristanC has quit IRC23:32
*** tristanC has joined #openstack-swift23:33
*** albertom has quit IRC23:33
*** charz has joined #openstack-swift23:34
*** albertom has joined #openstack-swift23:34
*** onovy has joined #openstack-swift23:34
*** xnox has joined #openstack-swift23:34
*** trifon has quit IRC23:35
*** amandap has joined #openstack-swift23:35
*** mac_ified has joined #openstack-swift23:44
*** garthb has quit IRC23:44
*** jrichli has joined #openstack-swift23:45
openstackgerritMerged openstack/swift: fix docstring: s/2xx/1xx/  https://review.openstack.org/22916323:54
openstackgerritSamuel Merritt proposed openstack/swift: Improve SLO PUT error checking  https://review.openstack.org/22809923:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!