Monday, 2015-12-07

*** chlong has quit IRC00:13
*** jerrygb has quit IRC00:15
*** asettle is now known as asettle-afk00:26
*** chlong has joined #openstack-swift00:26
*** ho has joined #openstack-swift00:38
hogood morning!00:39
*** dmorita has joined #openstack-swift00:42
*** badari has quit IRC00:42
*** dmorita has quit IRC00:43
*** dmorita has joined #openstack-swift00:45
*** dmorita has quit IRC00:47
mattoliverauho: morning00:49
homattoliverau: morning!00:50
*** asettle-afk is now known as asettle00:51
*** blmartin has joined #openstack-swift00:58
*** chlong has quit IRC01:01
*** dmorita has joined #openstack-swift01:06
kota_ho, mattolivearu: morning01:07
*** dmorita has quit IRC01:17
*** haomaiwang has joined #openstack-swift01:32
*** haomaiwang has quit IRC01:37
hokota_: morning!01:37
*** badari has joined #openstack-swift01:39
openstackgerritMatthew Oliver proposed openstack/swift: Modify functional tests to use testr  https://review.openstack.org/21420601:51
openstackgerritShu Muto proposed openstack/python-swiftclient: Delete python bytecode before every test run  https://review.openstack.org/25221001:59
*** haomaiwang has joined #openstack-swift02:03
*** haomaiwang has quit IRC02:09
mattoliveraukota_: morning02:14
*** 7JTABCRUQ has joined #openstack-swift02:22
*** asettle has quit IRC02:33
*** asettle has joined #openstack-swift02:33
*** chlong has joined #openstack-swift02:36
openstackgerritMerged openstack/swift: Add functional test for repeated SLO segments  https://review.openstack.org/25190902:38
*** links has joined #openstack-swift02:45
*** 7JTABCRUQ has quit IRC03:01
*** haomaiwang has joined #openstack-swift03:01
*** badari has quit IRC03:05
*** sanchitmalhotra has joined #openstack-swift03:06
openstackgerritJanie Richling proposed openstack/swift: WIP - Support for http footers - Replication and EC  https://review.openstack.org/23739303:14
openstackgerritpei ran wu proposed openstack/swift: Fix POST-as-COPY mess up the DLO manifest  https://review.openstack.org/25279103:18
*** barker has joined #openstack-swift03:29
*** klrmn1 has quit IRC03:35
*** blmartin has quit IRC03:37
*** barker has quit IRC03:56
*** ianbrown has joined #openstack-swift04:00
*** haomaiwang has quit IRC04:01
*** haomaiwa_ has joined #openstack-swift04:01
*** ianbrown has quit IRC04:15
*** ianbrown_ has joined #openstack-swift04:15
*** trifon has joined #openstack-swift04:18
*** eranrom has joined #openstack-swift04:18
*** eranrom has quit IRC04:25
*** ianbrown_ is now known as ianbrown04:28
*** ianbrown has quit IRC04:42
*** ianbrown has joined #openstack-swift04:42
*** proteusguy_ has quit IRC04:43
*** badari has joined #openstack-swift04:44
*** wupeiran has joined #openstack-swift04:46
*** ppai has joined #openstack-swift04:51
*** trifon has quit IRC04:52
*** proteusguy_ has joined #openstack-swift04:56
*** haomaiwa_ has quit IRC05:01
*** haomaiwang has joined #openstack-swift05:01
*** chlong has quit IRC05:05
*** chlong has joined #openstack-swift05:22
*** ianbrown has quit IRC05:29
*** ianbrown has joined #openstack-swift05:29
*** silor has joined #openstack-swift05:37
*** SkyRocknRoll has joined #openstack-swift05:49
*** trifon has joined #openstack-swift05:55
*** haomaiwang has quit IRC06:01
*** haomaiwa_ has joined #openstack-swift06:01
*** badari has quit IRC06:03
*** ChubYann has quit IRC06:11
*** alexandra_ has joined #openstack-swift06:17
*** ianbrown has quit IRC06:26
*** ianbrown has joined #openstack-swift06:26
*** SkyRocknRoll has quit IRC06:29
openstackgerritKota Tsuyuzaki proposed openstack/swift: Support last modified on listing containers  https://review.openstack.org/19863406:30
*** ianbrown has quit IRC06:30
*** ianbrown has joined #openstack-swift06:30
*** eranrom has joined #openstack-swift06:30
*** ianbrown has quit IRC06:31
*** ianbrown has joined #openstack-swift06:32
*** SkyRocknRoll has joined #openstack-swift06:41
*** openstackgerrit_ has joined #openstack-swift06:51
*** SkyRocknRoll has quit IRC06:58
*** haomaiwa_ has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:01
*** SkyRocknRoll has joined #openstack-swift07:14
*** trifon has quit IRC07:24
*** chlong has quit IRC07:29
*** trifon has joined #openstack-swift07:40
*** ntt has joined #openstack-swift07:42
*** hferenc has joined #openstack-swift07:43
nttHi, I need to measure the space occupied by users for billing.... should I use ceilometer for this?07:43
hferenchi all07:44
hferenccould someone be so kind to check this patch out https://review.openstack.org/#/c/235950/ ?07:45
hferencit already has a +2 and a +107:45
hferencit is also verified by mr. jenkins07:46
hferenchowever it needs a final review07:47
*** ianbrown_ has joined #openstack-swift07:55
*** ianbrown has quit IRC07:58
*** haomaiwang has quit IRC08:01
*** haomaiwang has joined #openstack-swift08:01
*** arnox has joined #openstack-swift08:02
*** haomaiwang has quit IRC08:05
*** haomaiwa_ has joined #openstack-swift08:05
*** rledisez has joined #openstack-swift08:12
*** shakamunyi has quit IRC08:14
*** ianbrown_ has quit IRC08:19
*** ianbrown_ has joined #openstack-swift08:23
*** rledisez has quit IRC08:29
*** rledisez has joined #openstack-swift08:30
*** asettle has quit IRC08:47
*** ianbrown_ has quit IRC08:51
kota_ho: just looking at same patch08:51
kota_ho: patch 23595008:52
patchbotkota_: https://review.openstack.org/#/c/235950/ - Replace string slicing with proper string methods08:52
*** jordanP has joined #openstack-swift08:53
*** ianbrown has joined #openstack-swift08:56
hokota_: it's tough one for me. i sometimes prefer to use indexes for string but looks logically correct :P08:56
*** ho has quit IRC08:57
*** haomaiwa_ has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:02
hferencthx guys for your time in advance09:04
kota_hferenc: no worries09:05
kota_hferenc: how do you think about Clay's comments, he added +2 tho?09:05
hferencregarding the status message checking thing he is absolutely right09:08
hferenci am planning to fix that issues as well09:09
kota_ok, good09:10
kota_i'll add +2, +A expecting you are going to work for that :-)09:10
kota_thanks09:10
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873609:15
hferenccan i reference a review comment in a bug report somehow?09:20
kota_yup09:28
kota_ah, might be we can make just a link for gerrit address09:29
kota_in commit message.09:29
hferenchttps://bugs.launchpad.net/swift/+bug/152340109:30
openstackLaunchpad bug 1523401 in OpenStack Object Storage (swift) "FormPost should use WSGIContext" [Undecided,New] - Assigned to Ferenc Horváth (hferenc)09:30
*** sayali has joined #openstack-swift09:32
*** jistr has joined #openstack-swift09:36
*** ianbrown has quit IRC09:40
*** ianbrown has joined #openstack-swift09:45
*** haomaiwang has quit IRC10:01
*** haomaiwang has joined #openstack-swift10:01
*** arnox has quit IRC10:02
*** arnox has joined #openstack-swift10:05
*** silor has quit IRC10:11
*** ianbrown has quit IRC10:13
*** ianbrown has joined #openstack-swift10:13
*** aix has joined #openstack-swift10:19
*** openstackgerrit_ has quit IRC10:23
*** jistr has quit IRC10:29
*** jistr has joined #openstack-swift10:30
*** sudorandom has quit IRC10:31
*** hseipp has joined #openstack-swift10:31
*** hseipp has quit IRC10:31
*** hseipp has joined #openstack-swift10:31
*** jmccarthy has quit IRC10:32
*** jmccarthy has joined #openstack-swift10:33
*** CrackerJackMack has quit IRC10:34
openstackgerritMerged openstack/swift: Replace string slicing with proper string methods  https://review.openstack.org/23595010:37
*** asettle has joined #openstack-swift10:37
*** CrackerJackMack has joined #openstack-swift10:38
*** yatin has joined #openstack-swift10:39
*** sudorandom has joined #openstack-swift10:41
*** CrackerJackMack has quit IRC10:43
*** sudorandom has quit IRC10:46
*** haomaiwang has quit IRC10:47
*** haomaiwang has joined #openstack-swift10:50
*** sudorandom has joined #openstack-swift10:50
*** mandarine has left #openstack-swift10:51
*** CrackerJackMack has joined #openstack-swift10:52
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873610:53
*** yatin has quit IRC10:53
*** yatin has joined #openstack-swift10:54
*** yatin has quit IRC10:55
*** wupeiran has quit IRC10:56
*** haypo has joined #openstack-swift11:07
haypohi. the python34 check job now pass thanks to the last change on PyEClib (use PyEClib >= 1.0.7)11:08
haypoit's time to make python34 check job voting! https://review.openstack.org/#/c/253445/11:08
haypoa voting job would avoid to reintroduce Python 3 regressions, see the global plan: http://lists.openstack.org/pipermail/openstack-dev/2015-October/078058.html11:09
*** SkyRocknRoll has quit IRC11:31
*** SkyRocknRoll has joined #openstack-swift11:33
*** Guest20179 has quit IRC11:34
*** eranrom has quit IRC11:36
*** yatin has joined #openstack-swift11:41
*** noqa_v_q1ovnie is now known as noqa_v_qoovnie11:48
*** yatin has quit IRC11:54
*** ppai has quit IRC12:05
*** links has quit IRC12:15
*** flaper87 has quit IRC12:17
*** flaper87 has joined #openstack-swift12:17
*** ppai has joined #openstack-swift12:17
*** kei_yama has quit IRC12:21
*** cdelatte has joined #openstack-swift12:22
*** chlong has joined #openstack-swift12:30
*** silor has joined #openstack-swift12:38
*** asettle has quit IRC12:44
*** SkyRocknRoll has quit IRC12:51
*** haomaiwang has quit IRC12:56
*** dustins has joined #openstack-swift13:02
openstackgerritpei ran wu proposed openstack/swift: Fix POST-as-COPY mess up the DLO manifest  https://review.openstack.org/25279113:20
hferencthanks guys for the reviews13:21
*** fthiagogv has joined #openstack-swift13:34
*** haomaiwang has joined #openstack-swift13:36
*** fthiagogv has quit IRC13:36
*** fthiagogv has joined #openstack-swift13:37
*** fthiagogv has quit IRC13:38
*** fthiagogv has joined #openstack-swift13:39
*** ppai has quit IRC13:51
*** jerrygb has joined #openstack-swift14:04
*** dustins has quit IRC14:07
*** sanchitmalhotra has quit IRC14:08
*** hogepodge has quit IRC14:17
*** breitz has joined #openstack-swift14:18
*** petertr7_away is now known as petertr714:28
*** barker has joined #openstack-swift14:37
*** raginbajin has quit IRC14:44
*** raginbajin has joined #openstack-swift14:46
*** sgundur has joined #openstack-swift14:52
*** badari has joined #openstack-swift14:54
*** blmartin has joined #openstack-swift14:58
*** CaioBrentano has joined #openstack-swift15:00
*** diazjf has joined #openstack-swift15:12
*** hogepodge has joined #openstack-swift15:14
*** dustins has joined #openstack-swift15:15
openstackgerritdharmendra kushwaha proposed openstack/swift: Doc string addition for some methods.  https://review.openstack.org/23999315:22
*** delattec has joined #openstack-swift15:23
*** cdelatte has quit IRC15:26
CaioBrentanohi all15:28
CaioBrentanois the "official" way of deleting a header making a POST request with "X-Remove-<header_name>" header ?15:29
*** tsg has joined #openstack-swift15:31
*** sayali has quit IRC15:32
*** sayali has joined #openstack-swift15:34
*** eranrom has joined #openstack-swift15:38
*** haomaiwang has quit IRC15:39
*** haomaiwang has joined #openstack-swift15:40
*** changbl has quit IRC15:42
*** changbl has joined #openstack-swift15:46
*** ntt has quit IRC15:49
*** pgbridge has joined #openstack-swift15:50
*** changbl has quit IRC15:53
*** petertr7 is now known as petertr7_away15:57
*** haomaiwang has quit IRC16:01
*** haomaiwang has joined #openstack-swift16:01
openstackgerritBéla Vancsics proposed openstack/swift: Reduce code duplication  https://review.openstack.org/25426616:03
*** barker has quit IRC16:05
*** changbl has joined #openstack-swift16:06
*** petertr7_away is now known as petertr716:08
*** barker has joined #openstack-swift16:08
*** bkmz has joined #openstack-swift16:14
*** cdelatte has joined #openstack-swift16:14
*** delattec has quit IRC16:15
*** bkmz_ has quit IRC16:17
openstackgerritjanonymous proposed openstack/swift: remove all pyc before starting unit test  https://review.openstack.org/25427616:17
*** janonymous_ has joined #openstack-swift16:17
*** dustins_ has joined #openstack-swift16:18
*** dustins has quit IRC16:19
*** sgundur has quit IRC16:19
*** sgundur has joined #openstack-swift16:22
openstackgerritdharmendra kushwaha proposed openstack/swift: Removing unused variables and clause  https://review.openstack.org/25427816:22
*** dustins_ is now known as dustins16:23
*** dustins has quit IRC16:25
*** dustins has joined #openstack-swift16:27
*** aix has quit IRC16:28
*** dustins has quit IRC16:31
*** dustins has joined #openstack-swift16:32
*** ndk has joined #openstack-swift16:39
notmynamegood morning16:40
*** Jeffrey4l has joined #openstack-swift16:41
notmynameCaioBrentano: are you wanting to remove a key for object metadata or for container metadata?16:41
*** Jeffrey4l has quit IRC16:42
*** Jeffrey4l has joined #openstack-swift16:42
CaioBrentanonotmyname both! :)16:42
notmynameCaioBrentano: ok :-)16:42
*** geaaru has joined #openstack-swift16:43
notmynamefor account and contianer metadata, use the form you mentioned. or POST with the header and an empty value. some clients (eg older curl versions) don't allow sending headers with empty values, thus the -remove- syntax version16:43
notmynamefor object metadata, the entirety of the metadata is set to what you POST to the object. so leave out the header you want to delete, and it will be effectively removed16:44
*** jordanP has quit IRC16:45
*** david-lyle has joined #openstack-swift16:49
CaioBrentanonotmyname but if I want to remove "Cache-Control" metadata from a object, I'll have to re-create the entire object ?16:50
*** Jeffrey4l has quit IRC16:50
janonymous_notmyname: hey16:51
*** haomaiwang has quit IRC16:51
notmynameCaioBrentano: so you've configured your object servers to allow setting cache-control?16:51
CaioBrentanonotmyname yes. anything bad about this?16:52
notmynameno, not at all16:53
*** links has joined #openstack-swift16:53
notmynameCaioBrentano: yeah, so either sending cache-control with an empty value or using something like "x-remove-cache-control: x" would do it16:55
notmynamejust remember that your metadata is set to whatever you're sending in the post16:58
CaioBrentanonotmyname I tried sending cache-control with an empty value, but I didn't work... I got the header empty when a did a GET with curl16:59
CaioBrentanonotmyname I just worked with x-remove... and btw, I just found this on a random blog post, not on the documentation17:00
*** nadeem has joined #openstack-swift17:00
*** barker has quit IRC17:05
notmynameCaioBrentano: ugh. yeah. the docs need a lot of love17:07
*** barker has joined #openstack-swift17:08
*** diazjf has quit IRC17:09
CaioBrentanonotmyname :)17:09
*** jistr has quit IRC17:11
CaioBrentanonotmyname my team and I are planing to create a blog about Swift... to help other teams in our company that are using our cluster, and to share with some knowledge about swift in portuguese ;)17:11
notmynamethat's great!17:11
*** links has quit IRC17:14
*** trifon has quit IRC17:14
*** Jeffrey4l has joined #openstack-swift17:15
*** rledisez has quit IRC17:16
*** petertr7 is now known as petertr7_away17:22
*** lyrrad has joined #openstack-swift17:25
*** sgundur1 has joined #openstack-swift17:26
*** sgundur has quit IRC17:26
*** petertr7_away is now known as petertr717:32
*** diazjf has joined #openstack-swift17:48
openstackgerritSivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py  https://review.openstack.org/24467817:49
claygkota_: did you see that the fix for lp bug #1452431 (patch 241571) had a dependent patch with a doc update that goes into the terms for replica plan?17:50
openstackLaunchpad bug 1452431 in OpenStack Object Storage (swift) "some parts replicas assigned to duplicate devices in the ring" [High,Confirmed] https://launchpad.net/bugs/1452431 - Assigned to Samuel Merritt (torgomatic)17:50
patchbotclayg: https://review.openstack.org/#/c/241571/ - Put part-replicas where they go17:50
claygdfg: did you have anything for me on patch 24157117:51
patchbotclayg: https://review.openstack.org/#/c/241571/ - Put part-replicas where they go17:51
*** petertr7 is now known as petertr7_away17:52
acolesclayg: i gather all got sorted out wrt Lorcan's tests17:53
*** diazjf has quit IRC17:54
*** arnox has quit IRC17:55
claygacoles: yup we're good!17:57
claygacoles: Lorcan did great, those tests were great, we learned something; but I at least decided it's an acceptable/desirable behavior change from master => patch17:58
acolesclayg: right. I am sat by him this week so I'll let him know17:59
*** jistr has joined #openstack-swift17:59
*** hseipp has quit IRC18:04
*** petertr7_away is now known as petertr718:07
*** barker has quit IRC18:08
*** lyrrad has quit IRC18:10
*** lyrrad_ has joined #openstack-swift18:10
*** barker has joined #openstack-swift18:14
*** zaitcev has joined #openstack-swift18:17
*** ChanServ sets mode: +v zaitcev18:17
*** vinsh_ is now known as Vinsh18:19
openstackgerritClay Gerrard proposed openstack/swift: fix mock and assert in test_direct_client  https://review.openstack.org/25434118:19
*** trifon has joined #openstack-swift18:30
*** papercup has joined #openstack-swift18:31
papercupdo functional test need to be run one one-go only ? or can we run them independent of each other ? (I know tox has the option to do ti  .. what I don't know is how the openstack-swift func tests are designed ..18:32
papercupideally tests are supposed to be independent of each other for being able to pick one out and run one test specifically .. but .. I don't know the case for swift tetss18:33
*** klrmn1 has joined #openstack-swift18:35
openstackgerritTim Burke proposed openstack/python-swiftclient: Move python-keystoneclient to "extras"  https://review.openstack.org/25434618:38
openstackgerritTim Burke proposed openstack/python-swiftclient: Stop passing attr to keystoneclient when there's no filter_value  https://review.openstack.org/24604018:44
*** geaaru has quit IRC18:46
*** chsc has joined #openstack-swift18:47
*** trifon has quit IRC18:55
*** blmartin has quit IRC19:01
jrichlipapercup: yes, you can run swift functests individually.  I use this type of format: nosetests test/functional/testFilename.py:TestClassname.test_method_name19:03
*** acoles is now known as acoles_19:12
*** garthb has joined #openstack-swift19:16
*** fthiagogv has quit IRC19:22
*** tsg has quit IRC19:24
*** jistr has quit IRC19:26
*** diazjf has joined #openstack-swift19:30
claygheyoh!19:32
*** ChubYann has joined #openstack-swift19:40
*** diazjf has quit IRC19:45
*** diazjf has joined #openstack-swift19:56
*** trifon has joined #openstack-swift19:58
*** Zyric has joined #openstack-swift20:00
ZyricGood morning :)20:04
*** petertr7 is now known as petertr7_away20:22
*** aerwin3 has joined #openstack-swift20:25
aerwin3hello all20:26
*** klrmn1 has quit IRC20:27
*** petertr7_away is now known as petertr720:29
*** changbl has quit IRC20:35
*** barker has quit IRC20:37
*** haypo has left #openstack-swift20:41
*** diazjf has quit IRC20:46
papercupjrichli: thanks20:48
*** trifon has quit IRC20:50
*** CaioBrentano has quit IRC21:05
*** blmartin has joined #openstack-swift21:05
*** eranrom has quit IRC21:13
*** petertr7 is now known as petertr7_away21:14
*** petertr7_away is now known as petertr721:16
*** pdardeau_ has quit IRC21:18
*** silor has quit IRC21:20
*** changbl has joined #openstack-swift21:21
*** pdardeau has joined #openstack-swift21:28
*** mariusv has joined #openstack-swift21:30
*** mariusv has quit IRC21:30
*** mariusv has joined #openstack-swift21:30
*** alejandrito has joined #openstack-swift21:36
*** klrmn1 has joined #openstack-swift21:36
mattoliverauMorning21:37
*** dustins is now known as dustins|gone21:38
*** ianbrown has quit IRC21:39
*** ianbrown has joined #openstack-swift21:39
*** chsc has quit IRC21:57
*** changbl has quit IRC21:59
*** tongli has joined #openstack-swift21:59
pelusemattoliverau: yo!22:00
*** tongli has quit IRC22:01
gmmahagood morning mattoliverau22:06
*** yarkot has joined #openstack-swift22:13
*** sgundur has joined #openstack-swift22:17
*** sgundur1 has quit IRC22:17
*** petertr7 is now known as petertr7_away22:23
*** yarkot has quit IRC22:28
*** mariusv_ has joined #openstack-swift22:29
*** diogogmt has joined #openstack-swift22:32
*** mariusv_ has quit IRC22:32
*** asettle has joined #openstack-swift22:32
*** asettle has quit IRC22:33
*** alexandra_ is now known as asettle22:33
*** changbl has joined #openstack-swift22:44
*** mariusv has quit IRC22:45
mattoliveraupeluse: good to hear your voice ;)22:46
*** sgundur has quit IRC22:47
mattoliveraugmmaha: o/, cool so your going to go look into the global clusters card, nice :)22:49
pelusemattoliverau: yeah, nice to finally make one of those meetings :)22:49
mattoliveraupeluse: mikal had to go poke me, cause people forget to send me meeting invites.22:50
pelusemattoliverau: I get the invites OK, I just tend to forget to go...22:51
mattoliveraulol22:51
peluse:)22:51
mattoliveraupeluse: did you get a chance to talk about part power increase, is that still a thing we want to try and push forward?22:53
mattoliverauSeeing as I'm spending time on sharding, and IBM have committed resources to it, I want to get that moved into doing to track that stuff is actually happening in the community. But baby steps I guess.22:54
openstackgerritJohn Dickinson proposed openstack/python-swiftclient: fix release version  https://review.openstack.org/25443022:55
notmynameso because this is the first swiftclient release of the mitaka cycle, and because swiftclient is now a release-managed project, the release number has to be 2.7.0 instead of 2.6.122:56
notmynamefortunately, nothing else landed yet, so it's just updating the changelog and the referenced commit sha for the release22:57
pdardeaumattoliverau: hey23:00
*** gyee has joined #openstack-swift23:01
*** km has joined #openstack-swift23:08
*** km is now known as Guest8410123:08
mattoliveraupdardeau: hey, nice to meet you face to face (well text to text) :)23:08
pdardeaumattoliverau: :) likewise!23:09
pdardeaumattoliverau: i'll be picking up part power increase23:09
mattoliveraupdardeau: sweet, cool!23:09
pdardeaumattoliverau: after increasing max number of devices23:09
notmynamepdardeau: oh, cool. I had heard somehting about increasing max devices. we're (swiftstack) also really interested in that23:10
mattoliveraupdardeau: just wanted to make sure I was on the same page :)23:10
mattoliveraupdardeau: awesome, with those changes in place, swift will be alot easier to operate :)23:11
pdardeaumattoliverau: notmyname: nice! it's nice to have my marathon training winding down and be able to do some work :)23:12
notmynamepdardeau: what is it you're working on for increasing the max number of devices? what's the use case behind it?23:12
*** ianbrown has quit IRC23:12
*** ianbrown has joined #openstack-swift23:12
pdardeaunotmyname: good question! i was wondering about that myself.23:12
pdardeaui don't know, just heard about it this morning23:13
pdardeauit looks like someone from rax requested it (haven't seen any background info yet)23:13
notmynameI'm not aware of any single storage policies that are getting close to 2**15 devices, much less 2**1623:14
pdardeaui too was quite surprised to see the request23:15
notmynamebut that being said, I know we've had some requests about that sort of thing. just nothing in prod yet23:15
notmynamepdardeau: instead of just raising the 16 bit number to 32 bits, I'd love it if you could investigate something like "write the right number of bits for however many devs are in the ring"23:16
notmynamethat way there isn't any particular limit23:16
notmynameand yeah if you have 2**128 devices in your ring, you better have a *lot* of ram in your machines ;-)23:17
mattoliveraulol23:18
pdardeaunotmyname: cool idea! might be tricky as the device count crosses thresholds?23:18
*** jamielennox is now known as jamielennox|away23:18
notmyname(wasn't my idea originally)23:19
notmynamebut it's only a matter of serialization, right?23:19
notmynameie it doesn't matter if one server has 2**16 bits and another has 2**17 bits, does it?23:19
notmynameit's just how it reads and writes it into memory?23:19
notmynamewhat are you thinking of in the cross threshold area?23:20
pdardeaui think you just addressed it23:20
pdardeaui was thinking of the servers all needing the same value23:21
pdardeauand timing of changes across the cluster23:21
pdardeausounds easy enough tho23:22
notmynameyeah. while it's something that's sortof annoyed me about a "limit" in swift, it's also somehting I always figured was no big deal to change when someone actually needed it23:22
notmynameonly "trick" is to make sure we version the ring. but that's with any data format change.23:23
notmynameI think we added a ring version with the last time we changed the on-disk format23:23
pdardeaucool. makes sense23:24
notmynameI mean, don't take my word for it. but yeah, I think it's already there. at least it should be :-)23:24
pdardeaugotcha!23:25
dfgclayg: ok- added a review.23:26
dfghope it makes any sense at all.23:28
notmynamereading it now. thanks :-)23:28
notmynamedfg: when you added the 2nd 90 drive node, did you do a pretend_min_part_hours_passed before that?23:31
notmynamefromt eh stuff at the bottom of the comment23:31
*** kei_yama has joined #openstack-swift23:34
dfgnotmyname: pretend? no- i didn't know you could do that23:35
dfgi didn't mess with min_part_hours at all for those results.23:36
mattoliveraudfg: it's not in the help output, but is a command in the code.. I always forget the name and have to go look it up :P23:37
dfgmattoliverau: i'm shocked we have undocumented features :p23:37
mattoliveraudfg: not undocumented... easter eggs ;P23:40
*** ianbrown has quit IRC23:41
*** ianbrown has joined #openstack-swift23:42
notmynameIIRC it's intentionally undocumented23:45
mattoliverauyeah, just teasing :) wouldn't want that to be documented23:46
claygi like easer egg23:46
clayg*easter*23:47
claygdoes it really matter which *number* partition moves?23:47
*** ho has joined #openstack-swift23:48
claygdfg: I think the bump is just showing you why the new code is more efficient - when it picks a point in the partition ring to start gathering from it pulls up enough parts that can/should move and then it's done with it - the old algo would just keep going over the ring again and again randomly picking up some parts here and there hoping it's able to do something useful23:49
claygdfg: the code could skip around the ring more... but why?23:49
claygwhat's the difference in picking up parts 1, 2, 3, 4 and 1, 3, 7, 1123:49
claygesp. when the replicas of parts 1, 2, 3, 4 are all on different nodes23:50
*** nadeem has quit IRC23:51
clayganyway, there's nothing I can do about the current's code crappy placement causing a bunch of drives to want to shed/gain one or two parts and the new code being good at doing it - rather than I "warning" I think the swift release should strongly encourage folks to "fix" their rings by running rebalance with the new algo asap (rather than waiting for your regularlly scheduled capacity adjustment)23:52
claygdfg: anyway, thanks for looking at it - I honestly hadn't even considered cutting at it from that direction23:54
claygdfg: I think the confirmation on doing a good job distributing the gathered parts from all nodes in the system when adding capacity is great to have verified externally - awesome work23:55
notmynamedfg: importantly, I didn't see you add a -1 or -2 to the patch with your review23:57
notmynamedfg: so either you want some more time to look at / understand some of the results you got, or you're fine with it landing (ie not blocking it)23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!