Tuesday, 2014-12-23

claygso a balance of 0.0 is perfect, the "your ring is not balanced you should keep balancing" only fires when balance > 500:04
claygok, so get_balance does an abs00:05
claygok, it also goes over all devices and just picks whichever device has the worse balance, so ok that makes sense i suppose00:06
claygbut that makes it seem like there is no upper bound, a device could have 200% more parts than it wants00:06
notmynamecan't it?00:07
*** nellysmitt has joined #openstack-swift00:09
claygyeah i mean we special case weight of zero to MAX_BALANCE (999.0), but if you just set the weight to a really small float you get a super huge balance, this device has 256 parts, and that's ONE MILLIONS % more than it wants)00:10
*** nellysmitt has quit IRC00:13
claygso, but I'm not really thinking of doing "dispersion" that way, I think the number that makes the most sense is the % of parts who have more replicas at a tier than that tier wants for replicas - so if you have an unsolveable graph (3 servers, 3:1:1, then you get about 60% of the parts with manage to get a replica on every node, then the last 40% end up having to stick everything in one basket00:14
notmynameya, dispersion is a cluster (or tier) basis. balance is a drive basis00:15
notmynameright? that's what you're thinking?00:15
claygacctually I think our greedy most hunry device placement is sort of naive in this fashion - if we know we're not going to solve it we could end up with less parts at risk if we were less optimistic when throwing out replicas for a part and conserved the underweight tiers better :\00:15
claygnotmyname: yeah, i guess i'm wondering if the "dispersion" should follow a similar pattern as balance and return the maximum of the worst dispersed tier or just the total % of fully dispersed parts in the cluster, maybe I'm not sure when there's a difference00:18
notmynametotal % fully dispersed makes the most intuitive sense to me. but I suppose that could be different for each tier00:19
notmynamemaybe a per tier number00:19
*** Masahiro has joined #openstack-swift00:20
notmynameX% at the region level, Y% across zones, Z% across servers, AA% across drives?00:20
notmynameAA should be 100. and X might often be 000:20
notmyname(eg 1 region)00:21
notmynameor 2 regions00:21
claygwell i'm using "max_replicas_at_tier" to decide when a replica is "fully dispersed" so if you have only one region which holds all replicas thats still <= max_replicas for that region - so it's considered 100% dispersed00:22
*** Masahiro has quit IRC00:24
notmynameah. maybe there's a subtle difference in how you're defining dispersion00:26
notmynameI was thinking "every replica is in a different failure domain at this tier"00:26
*** themadcanudist has left #openstack-swift00:27
claygnotmyname: I don't think that's terribly useful for a lot of topologies - most of the people having this problem are in situations are because they don't have enough failure domains (3 servers for 3 replicas, two regions for 3 replicas, etc)00:28
notmynameisn't that what we need to expose to them?00:28
notmynameor are you saying they already know that00:28
claygnotmyname: yeah I think there's a term problem here - trying to think of the english00:31
*** dmsimard is now known as dmsimard_away00:59
*** addnull has joined #openstack-swift01:10
*** fandi_ has quit IRC01:11
*** gyee has quit IRC01:12
*** masonhsiung has joined #openstack-swift01:42
*** mitz_ has quit IRC01:48
*** mitz_ has joined #openstack-swift01:49
openstackgerritYuan Zhou proposed openstack/swift: EC: HTTP PUT/HEAD changes for object size/etag reporting  https://review.openstack.org/13548802:05
*** Masahiro has joined #openstack-swift02:09
*** nellysmitt has joined #openstack-swift02:10
*** haomaiwang has joined #openstack-swift02:11
*** Masahiro has quit IRC02:13
*** nellysmitt has quit IRC02:14
*** aswadr has joined #openstack-swift02:22
*** aix has quit IRC02:56
*** bill_az has quit IRC03:17
*** Masahiro has joined #openstack-swift03:57
*** SkyRocknRoll has joined #openstack-swift03:58
*** SkyRocknRoll has joined #openstack-swift03:58
*** Masahiro has quit IRC04:01
*** nellysmitt has joined #openstack-swift04:11
*** nellysmitt has quit IRC04:15
*** ppai has joined #openstack-swift04:59
*** bkopilov has joined #openstack-swift05:05
*** erlon_ has quit IRC05:19
*** Masahiro has joined #openstack-swift05:46
*** Masahiro has quit IRC05:51
*** kopparam has joined #openstack-swift05:54
*** nshaikh has joined #openstack-swift06:11
*** nellysmitt has joined #openstack-swift06:11
*** nellysmitt has quit IRC06:16
*** wer_ has joined #openstack-swift06:33
*** ppai has quit IRC06:44
*** ppai has joined #openstack-swift06:57
*** Masahiro has joined #openstack-swift07:01
*** ppai has quit IRC07:02
*** ttrumm has joined #openstack-swift07:04
*** ttrumm_ has joined #openstack-swift07:06
*** k4n0 has joined #openstack-swift07:07
*** ttrumm has quit IRC07:09
*** ppai has joined #openstack-swift07:16
*** mitz has quit IRC07:22
*** addnull has quit IRC07:26
*** kopparam has quit IRC07:30
*** addnull has joined #openstack-swift07:43
*** nellysmitt has joined #openstack-swift07:49
*** nshaikh has quit IRC07:57
*** EmilienM|afk is now known as EmilienM08:02
*** kopparam has joined #openstack-swift08:04
*** rledisez has joined #openstack-swift08:11
*** Masahiro has quit IRC08:12
*** geaaru has joined #openstack-swift08:45
*** ppai has quit IRC08:57
*** abhirc has quit IRC08:57
*** jordanP has joined #openstack-swift09:03
*** nshaikh has joined #openstack-swift09:04
*** ppai has joined #openstack-swift09:09
*** Masahiro has joined #openstack-swift09:13
*** kopparam has quit IRC09:17
*** Masahiro has quit IRC09:17
*** kopparam has joined #openstack-swift09:20
*** kopparam has quit IRC09:53
*** kopparam has joined #openstack-swift09:57
*** Masahiro has joined #openstack-swift10:14
*** silor has joined #openstack-swift10:14
*** kopparam has quit IRC10:16
*** kopparam_ has joined #openstack-swift10:16
*** Masahiro has quit IRC10:18
*** EmilienM is now known as EmilienM|afk10:22
*** aix has joined #openstack-swift10:32
*** bkopilov has quit IRC10:34
*** masonhsi_ has joined #openstack-swift11:00
*** ttrumm_ has quit IRC11:03
*** masonhsiung has quit IRC11:04
*** addnull has quit IRC11:04
*** addnull has joined #openstack-swift11:05
*** masonhsi_ has quit IRC11:05
*** EmilienM|afk is now known as EmilienM11:07
*** addnull has quit IRC11:10
*** ttrumm has joined #openstack-swift11:25
*** bkopilov has joined #openstack-swift11:26
*** mahatic has joined #openstack-swift11:35
*** haomaiwang has quit IRC11:39
*** nshaikh has quit IRC11:40
*** silor has quit IRC11:44
*** silor has joined #openstack-swift11:45
*** Masahiro has joined #openstack-swift12:02
*** aswadr has quit IRC12:06
*** Masahiro has quit IRC12:07
*** kopparam_ has quit IRC12:11
*** ttrumm has quit IRC12:15
*** infotection has quit IRC12:24
*** annegentle has quit IRC12:24
*** peluse has quit IRC12:24
*** rledisez has quit IRC12:24
*** wer_ has quit IRC12:24
*** hurricanerix has quit IRC12:24
*** wer has quit IRC12:24
*** tacticus has quit IRC12:24
*** zhiyan has quit IRC12:24
*** nottrobin has quit IRC12:24
*** quack_quack_ has quit IRC12:24
*** StevenK has quit IRC12:24
*** vishy has quit IRC12:24
*** ipolyzos has quit IRC12:24
*** zigo has quit IRC12:24
*** CrackerJackMack has quit IRC12:24
*** briancline has quit IRC12:24
*** mattoliverau has quit IRC12:24
*** acoles_away has quit IRC12:24
*** bkopilov has quit IRC12:24
*** notmyname has quit IRC12:24
*** xianghui has quit IRC12:24
*** mlanner has quit IRC12:24
*** ahale_ has quit IRC12:24
*** zul has quit IRC12:24
*** anticw has quit IRC12:24
*** occupant has quit IRC12:24
*** CybergeekDK has quit IRC12:24
*** clds_ has quit IRC12:24
*** eikke has quit IRC12:24
*** jordanP has quit IRC12:24
*** SkyRocknRoll has quit IRC12:24
*** yuanzz has quit IRC12:24
*** JoshNang has quit IRC12:24
*** amandap has quit IRC12:24
*** cppforlife has quit IRC12:24
*** jokke_ has quit IRC12:24
*** infotection has joined #openstack-swift12:25
*** annegentle has joined #openstack-swift12:25
*** peluse has joined #openstack-swift12:25
*** sendak.freenode.net sets mode: +v peluse12:25
*** rledisez has joined #openstack-swift12:26
*** wer_ has joined #openstack-swift12:26
*** hurricanerix has joined #openstack-swift12:26
*** wer has joined #openstack-swift12:26
*** tacticus has joined #openstack-swift12:26
*** zhiyan has joined #openstack-swift12:26
*** nottrobin has joined #openstack-swift12:26
*** quack_quack_ has joined #openstack-swift12:26
*** StevenK has joined #openstack-swift12:26
*** vishy has joined #openstack-swift12:26
*** ipolyzos has joined #openstack-swift12:26
*** zigo has joined #openstack-swift12:26
*** CrackerJackMack has joined #openstack-swift12:26
*** briancline has joined #openstack-swift12:26
*** mattoliverau has joined #openstack-swift12:26
*** acoles_away has joined #openstack-swift12:26
*** sendak.freenode.net sets mode: +v acoles_away12:26
*** kopparam has joined #openstack-swift12:26
*** bkopilov has joined #openstack-swift12:26
*** notmyname has joined #openstack-swift12:26
*** xianghui has joined #openstack-swift12:26
*** sendak.freenode.net sets mode: +v notmyname12:26
*** mlanner has joined #openstack-swift12:26
*** occupant has joined #openstack-swift12:26
*** ahale_ has joined #openstack-swift12:26
*** zul has joined #openstack-swift12:26
*** anticw has joined #openstack-swift12:26
*** CybergeekDK has joined #openstack-swift12:26
*** clds_ has joined #openstack-swift12:26
*** eikke has joined #openstack-swift12:26
*** jordanP has joined #openstack-swift12:28
*** SkyRocknRoll has joined #openstack-swift12:28
*** yuanzz has joined #openstack-swift12:28
*** JoshNang has joined #openstack-swift12:28
*** amandap has joined #openstack-swift12:28
*** cppforlife has joined #openstack-swift12:28
*** jokke_ has joined #openstack-swift12:28
*** kopparam has quit IRC12:43
*** bill_az has joined #openstack-swift12:57
*** Masahiro has joined #openstack-swift13:03
*** fandi has joined #openstack-swift13:06
*** Masahiro has quit IRC13:07
*** ppai has quit IRC13:15
*** addnull has joined #openstack-swift13:15
*** addnull has quit IRC13:29
*** tab_ has joined #openstack-swift13:35
tab_is there any example/case scenario step-by step of setting multi zone and multiregion swift cluster?13:36
*** bkopilov has quit IRC13:43
*** tdasilva has joined #openstack-swift13:47
*** addnull has joined #openstack-swift13:49
*** addnull has quit IRC13:59
*** exploreshaifali has joined #openstack-swift14:15
*** addnull has joined #openstack-swift14:25
*** addnull has quit IRC14:26
mahatictorgomatic, good morning! around?14:31
mahatictorgomatic, too early I guess :)14:50
*** Masahiro has joined #openstack-swift14:52
*** Masahiro has quit IRC14:56
openstackgerritJiri Suchomel proposed openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046314:57
*** exploreshaifali has quit IRC14:59
*** dmsimard_away is now known as dmsimard15:04
*** jest has joined #openstack-swift15:07
*** k4n0 has quit IRC15:25
*** nellysmitt has quit IRC15:28
*** acoles_away is now known as acoles15:30
*** exploreshaifali has joined #openstack-swift15:39
*** tdasilva has quit IRC15:41
*** nellysmitt has joined #openstack-swift15:42
openstackgerritAlistair Coles proposed openstack/swift: Update container on fast-POST  https://review.openstack.org/13538015:53
openstackgerritAlistair Coles proposed openstack/swift: Make ssync compatible with fast-post meta files  https://review.openstack.org/13849815:53
*** exploreshaifali has quit IRC15:58
*** tdasilva has joined #openstack-swift16:01
openstackgerritMahati proposed openstack/swift: Implement OPTIONS verb for storage nodes.  https://review.openstack.org/14010316:04
openstackgerritAlistair Coles proposed openstack/swift: Update container on fast-POST  https://review.openstack.org/13538016:06
*** masonhsiung has joined #openstack-swift16:11
acolestdasilva: hi, you here?16:23
*** Masahiro has joined #openstack-swift16:41
*** rdaly2 has joined #openstack-swift16:42
*** Masahiro has quit IRC16:45
acolestdasilva: ok, sorry to miss you, i looked at https://review.openstack.org/#/c/123765/ and it only covers slo, but like you said it looks like it did cover dlo :S I'm not sure about the extra HEAD that it introduces.16:49
*** lpabon has joined #openstack-swift16:50
acolestdasilva: anyway thats as far as i got - have a great holiday! i'm ooo until the new year.16:50
*** nellysmitt has quit IRC16:54
*** geaaru has quit IRC16:55
*** exploreshaifali has joined #openstack-swift17:01
*** hugokuo has quit IRC17:08
*** ttrumm has joined #openstack-swift17:10
*** nellysmitt has joined #openstack-swift17:12
*** bkopilov has joined #openstack-swift17:14
jesthi there. is there any example reference configuration for multi-region, multi-zone cluster for Swift?17:14
*** acoles is now known as acoles_away17:15
*** hugokuo has joined #openstack-swift17:15
*** ttrumm has quit IRC17:17
*** nellysmitt has quit IRC17:25
*** lpabon has quit IRC17:28
*** rledisez has quit IRC17:31
*** openstackgerrit has quit IRC17:34
*** openstackgerrit has joined #openstack-swift17:35
*** fandi has quit IRC17:39
*** jordanP has quit IRC17:42
*** fandi has joined #openstack-swift17:49
notmynamegood morning17:56
*** masonhsiung has quit IRC18:06
*** masonhsiung has joined #openstack-swift18:06
*** silor has quit IRC18:07
*** masonhsiung has quit IRC18:10
*** Masahiro has joined #openstack-swift18:29
*** Masahiro has quit IRC18:34
mahaticnotmyname, good morning. Is the opw meeting on tomorrow?18:35
notmynamemahatic: no. not next week either. I'll be traveling. however, I will be on from time to time during the next 1.5 weeks18:39
*** exploreshaifali has quit IRC18:43
*** zaitcev has joined #openstack-swift19:21
*** ChanServ sets mode: +v zaitcev19:21
*** nellysmitt has joined #openstack-swift19:26
*** nellysmitt has quit IRC19:30
*** exploreshaifali has joined #openstack-swift19:32
tdasilvaacoles_away: hi, sorry to have missed you earlier. I saw your comments on the review and agree everthing. I'll look to implement the same changes in the obj. versioning middleware19:35
*** mahatic has quit IRC19:39
*** fifieldt has quit IRC20:03
notmynameremember that there is not a swift team meeting tomorrow or next week20:05
tdasilvanotmyname: thanks! enjoy the break :-)20:05
notmynameyou too20:05
*** fifieldt has joined #openstack-swift20:16
*** Masahiro has joined #openstack-swift20:18
*** abhirc has joined #openstack-swift20:21
*** Masahiro has quit IRC20:22
*** bill_az has quit IRC20:40
*** mahatic has joined #openstack-swift20:46
*** Nadeem_ has joined #openstack-swift20:59
*** EmilienM is now known as EmilienM|afk21:04
mattoliveraumorning all on this christmas eve day21:25
notmynamehi!21:25
notmynameanyone running stud as an ssl/tls terminator in front of swift?21:26
*** nellysmitt has joined #openstack-swift21:27
*** nellysmitt has quit IRC21:32
*** EmilienM|afk is now known as EmilienM21:48
*** Masahiro has joined #openstack-swift22:07
*** Masahiro has quit IRC22:11
*** esmute has quit IRC22:17
*** esmute has joined #openstack-swift22:46
*** jest has quit IRC22:54
*** dmsimard is now known as dmsimard_away23:20
*** nellysmitt has joined #openstack-swift23:28
*** nellysmitt has quit IRC23:32
*** exploreshaifali has quit IRC23:46
*** miqui_ has quit IRC23:46
*** Masahiro has joined #openstack-swift23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!