Thursday, 2014-12-11

*** lcurtis has quit IRC00:04
*** gyee has quit IRC00:05
*** annegent_ has joined #openstack-swift00:22
*** annegent_ has quit IRC00:28
*** ho has joined #openstack-swift00:28
*** annegent_ has joined #openstack-swift00:31
*** oomichi has joined #openstack-swift00:32
*** echevemaster has quit IRC00:35
*** annegent_ has quit IRC00:36
openstackgerritSamuel Merritt proposed openstack/swift: Only move too-close-together replicas when they can spread out.  https://review.openstack.org/14087900:37
torgomaticclayg: ^^00:37
torgomaticswifterdarrell: ctennis: ^^00:39
*** dmorita has joined #openstack-swift00:39
*** Masahiro has joined #openstack-swift00:40
*** Masahiro has quit IRC00:45
*** miurahr has joined #openstack-swift00:47
*** echevemaster has joined #openstack-swift00:50
ctennistorgomatic: I feel like I gained some type of object storage certification just having read the analysis00:54
torgomaticctennis: I certainly feel certifiable after figuring that one out00:55
*** miurahr has quit IRC01:03
*** miurahr has joined #openstack-swift01:06
*** ho__ has joined #openstack-swift01:19
*** miurahr has quit IRC01:21
*** miurahr has joined #openstack-swift01:22
*** Masahiro has joined #openstack-swift01:24
*** kopparam has joined #openstack-swift01:25
*** rmcall has joined #openstack-swift01:26
*** ahonda has quit IRC01:29
*** miurahr has quit IRC01:29
*** ahonda has joined #openstack-swift01:30
*** annegent_ has joined #openstack-swift01:36
*** annegent_ has quit IRC01:41
*** rmcall has quit IRC01:42
*** ho has quit IRC01:45
*** ho__ has quit IRC01:45
*** ho has joined #openstack-swift01:45
*** rmcall has joined #openstack-swift01:46
*** rmcall has quit IRC01:47
*** rmcall has joined #openstack-swift01:51
*** annegent_ has joined #openstack-swift01:52
*** kopparam has quit IRC01:57
*** tellesnobrega_ has joined #openstack-swift01:59
*** haomaiwang has joined #openstack-swift02:01
*** tellesnobrega_ has quit IRC02:17
*** david-lyle is now known as david-lyle_afk02:30
*** annegent_ has quit IRC02:31
*** shakamunyi_ has joined #openstack-swift02:37
*** Masahiro has quit IRC02:42
*** rmcall has quit IRC02:45
*** shakamunyi_ has quit IRC02:48
*** Masahiro has joined #openstack-swift02:49
*** tellesnobrega_ has joined #openstack-swift02:58
*** shakamunyi_ has joined #openstack-swift03:02
*** Masahiro has quit IRC03:08
*** shakamunyi_ has quit IRC03:12
*** Masahiro has joined #openstack-swift03:16
*** kopparam has joined #openstack-swift03:42
*** jyoti-ranjan has joined #openstack-swift03:46
*** tellesnobrega_ has quit IRC03:49
*** X019 has quit IRC04:08
*** Masahiro has quit IRC04:09
*** silor has joined #openstack-swift04:10
*** Masahiro has joined #openstack-swift04:12
*** kopparam has quit IRC04:15
*** silor has quit IRC04:17
*** silor has joined #openstack-swift04:18
*** annegent_ has joined #openstack-swift04:24
*** Masahiro has quit IRC04:25
*** annegent_ has quit IRC04:25
*** Masahiro has joined #openstack-swift04:33
*** echevemaster has quit IRC04:45
*** echevemaster has joined #openstack-swift04:55
*** addnull has joined #openstack-swift05:13
*** ppai has joined #openstack-swift05:17
*** rmcall has joined #openstack-swift05:33
*** jyoti-ranjan has quit IRC05:43
*** echevemaster has quit IRC05:57
*** kopparam has joined #openstack-swift06:00
*** Masahiro has quit IRC06:00
*** Masahiro has joined #openstack-swift06:03
mattoliverauI'm calling it a day you quiet old swift land you.. have a great night!06:06
*** nshaikh has joined #openstack-swift06:14
*** Masahiro has quit IRC06:34
*** rmcall has quit IRC06:43
*** SkyRocknRoll has joined #openstack-swift07:31
*** zaitcev has quit IRC07:31
*** jyoti-ranjan has joined #openstack-swift07:37
*** k4n0 has joined #openstack-swift07:44
*** Masahiro has joined #openstack-swift07:44
*** zul has quit IRC07:49
*** Masahiro has quit IRC07:51
*** bsdkurt has quit IRC07:52
*** bsdkurt has joined #openstack-swift07:54
*** Masahiro has joined #openstack-swift07:56
*** nellysmitt has joined #openstack-swift08:00
*** zul has joined #openstack-swift08:03
*** rledisez has joined #openstack-swift08:05
openstackgerritKeshava Bharadwaj proposed openstack/swift: Adds console logging to swift-drive-audit  https://review.openstack.org/14097208:19
*** nellysmitt has quit IRC08:20
*** haomaiwang has quit IRC08:21
*** haomaiwang has joined #openstack-swift08:21
*** addnull has quit IRC08:29
*** mkerrin has quit IRC08:29
*** haomaiwang has quit IRC08:31
*** haomaiwang has joined #openstack-swift08:33
*** acoles_away is now known as acoles08:40
*** geaaru has joined #openstack-swift08:54
*** jordanP has joined #openstack-swift08:57
*** kopparam has quit IRC09:01
*** jistr has joined #openstack-swift09:06
*** nellysmi_ has joined #openstack-swift09:23
*** mkerrin has joined #openstack-swift09:27
*** kopparam has joined #openstack-swift09:29
*** Masahiro has quit IRC09:29
*** Masahiro has joined #openstack-swift09:30
*** ppai has quit IRC09:39
*** silor has quit IRC09:42
*** silor has joined #openstack-swift09:43
*** Masahiro has quit IRC09:52
*** ppai has joined #openstack-swift09:53
*** nellysmi_ is now known as nellysmitt10:02
*** cschwede has quit IRC10:04
*** Masahiro has joined #openstack-swift10:08
*** tellesnobrega_ has joined #openstack-swift10:25
*** ppai has quit IRC10:25
*** haomaiwang has quit IRC10:27
*** Masahiro has quit IRC10:33
*** Masahiro has joined #openstack-swift10:34
*** tellesnobrega_ has quit IRC10:37
*** aix has joined #openstack-swift10:39
*** ppai has joined #openstack-swift10:39
*** tellesnobrega_ has joined #openstack-swift10:41
*** tellesnobrega_ has quit IRC10:51
*** tellesnobrega_ has joined #openstack-swift10:53
*** tellesnobrega_ has quit IRC10:54
*** Masahiro has quit IRC10:59
*** silor has quit IRC11:01
*** sandywalsh has quit IRC11:06
*** sandywalsh has joined #openstack-swift11:08
*** pberis has quit IRC11:19
*** pberis has joined #openstack-swift11:21
openstackgerritClay Gerrard proposed openstack/swift: Fix large out of sync out of date containers  https://review.openstack.org/14101911:23
*** ppai has quit IRC11:49
*** aix has quit IRC11:49
*** miurahr has joined #openstack-swift11:54
*** kopparam has quit IRC11:56
*** kopparam has joined #openstack-swift11:57
*** Masahiro has joined #openstack-swift12:00
*** kopparam has quit IRC12:02
*** aix has joined #openstack-swift12:02
*** ppai has joined #openstack-swift12:03
*** Masahiro has quit IRC12:04
*** silor has joined #openstack-swift12:06
*** miurahr has quit IRC12:06
*** ho has quit IRC12:07
*** dmsimard_away is now known as dmsimard12:09
*** dmorita has quit IRC12:09
*** X019 has joined #openstack-swift12:21
*** silor1 has joined #openstack-swift12:22
*** silor has quit IRC12:23
*** oomichi has quit IRC12:23
*** silor has joined #openstack-swift12:23
*** silor1 has quit IRC12:26
*** sluo_afk has joined #openstack-swift12:31
*** sluo_laptop has quit IRC12:34
*** sluo_laptop has joined #openstack-swift12:39
*** nshaikh has quit IRC12:41
*** sluo_afk has quit IRC12:43
*** nshaikh has joined #openstack-swift12:43
*** kopparam has joined #openstack-swift12:49
*** miurahr has joined #openstack-swift13:12
*** bill_az has joined #openstack-swift13:26
openstackgerritPrashanth Pai proposed openstack/swift: fsync() on directories  https://review.openstack.org/12692313:30
*** Masahiro has joined #openstack-swift13:48
*** rdaly2 has joined #openstack-swift13:50
*** Masahiro has quit IRC13:53
*** SkyRocknRoll has quit IRC13:57
*** mitz- has joined #openstack-swift13:58
*** miurahr has quit IRC14:00
*** mitz_ has quit IRC14:00
*** ppai has quit IRC14:10
*** jyoti-ranjan has quit IRC14:17
*** miqui_ has joined #openstack-swift14:21
*** miurahr has joined #openstack-swift14:26
*** nshaikh has left #openstack-swift14:35
*** kopparam has quit IRC14:37
*** miurahr has quit IRC14:43
*** rmcall has joined #openstack-swift14:50
*** nellysmitt has left #openstack-swift15:00
*** miurahr has joined #openstack-swift15:00
*** lpabon has joined #openstack-swift15:00
peluseFYI, brief we did w/SwiftStack to coincide with Juno release on storage policies:  https://www-ssl.intel.com/content/dam/www/public/us/en/documents/solution-briefs/openstack-swift-v2-solution-brief.pdf15:03
acolespeluse: nice15:05
pelusebetter late than never :)15:07
portantepeluse: nice15:10
portantelooks good, seems well written, if you take my 4th grade literacy for anything of worth15:10
*** rmcall has quit IRC15:11
*** lcurtis has joined #openstack-swift15:13
*** rdaly2 has quit IRC15:17
*** tdasilva has joined #openstack-swift15:18
*** miurahr has quit IRC15:19
peluseportante, heh, thanks.  Apparently our marketing folks are only skilled in powerpoint so we had help from a third party with actually putting it together...15:21
*** occupant has quit IRC15:25
*** SkyRocknRoll has joined #openstack-swift15:28
*** tellesnobrega has quit IRC15:35
*** Masahiro has joined #openstack-swift15:37
*** rdaly2 has joined #openstack-swift15:39
*** Masahiro has quit IRC15:41
*** rdaly2 has quit IRC15:44
*** silor has joined #openstack-swift15:46
*** MooingLemur has quit IRC15:49
*** exploreshaifali has joined #openstack-swift15:49
*** MooingLemur has joined #openstack-swift15:49
*** SkyRocknRoll has quit IRC15:50
*** mahatic has joined #openstack-swift15:54
*** rmcall has joined #openstack-swift15:57
*** rdaly2 has joined #openstack-swift16:01
*** SkyRocknRoll has joined #openstack-swift16:02
*** nshaikh has joined #openstack-swift16:09
*** flwang has quit IRC16:20
*** SkyRocknRoll has quit IRC16:23
*** rmcall has quit IRC16:36
*** kopparam has joined #openstack-swift16:42
*** linuxgeek_ has quit IRC16:43
*** david-lyle_afk is now known as david-lyle16:46
*** wer has quit IRC16:47
*** wer has joined #openstack-swift16:48
*** ppai has joined #openstack-swift16:50
*** kopparam has quit IRC16:55
*** Nadeem_ has joined #openstack-swift17:02
*** lcurtis has quit IRC17:02
*** nshaikh has quit IRC17:06
*** rledisez has quit IRC17:08
*** gyee has joined #openstack-swift17:11
*** aix has quit IRC17:12
*** kopparam has joined #openstack-swift17:20
*** Masahiro has joined #openstack-swift17:26
*** silor has quit IRC17:26
*** Masahiro has quit IRC17:31
*** jordanP has quit IRC17:32
*** rmcall has joined #openstack-swift17:39
*** tellesnobrega has joined #openstack-swift17:46
notmynamegood morning17:50
*** gyee has quit IRC17:55
*** lpabon has quit IRC17:56
openstackgerritMerged openstack/swift-specs: Workflow documentation is now in infra-manual  https://review.openstack.org/13939417:57
notmynameI'm abandoning the stuff on http://abandoner.oliver.net.au/abandoned_changes.html18:00
*** jistr has quit IRC18:00
*** ppai has quit IRC18:08
*** lcurtis has joined #openstack-swift18:12
*** mahatic has quit IRC18:18
*** geaaru has quit IRC18:20
*** gyee has joined #openstack-swift18:22
*** ppai has joined #openstack-swift18:22
claygheyck yeah - abandon all the things!18:25
claygabandon all hope!18:25
claygstormpocalypse is upon us!18:26
notmynameRain of Terror is my favorite18:27
*** exploreshaifali has quit IRC18:27
notmynamefor those of you playing along at home, it's raining in northern california and san francisco basically shut down today18:30
*** ppai has quit IRC18:32
openstackgerritChristian Schwede proposed openstack/swift: Warn if multiple replicas are stored within same region/zone/node  https://review.openstack.org/14047818:33
*** mahatic has joined #openstack-swift18:34
*** kopparam has quit IRC18:46
*** acoles is now known as acoles_away18:46
*** kopparam has joined #openstack-swift18:46
*** cschwede has joined #openstack-swift18:46
*** kopparam has quit IRC18:47
*** ChanServ sets mode: +v cschwede18:47
portantenotmyname: no sympathy from the NE. :P18:53
portante=)18:53
notmynameportante: in our defense, it hasn't rained here in like 2 years18:53
portantewell that makes it worse18:53
notmynamebut it does seem to have been somewhat blown out of proportion (eg all the schools closed today)18:53
portantenow all the red woods are going to grow faster, right?18:54
notmynameI have heard reports that there is some flooding and some power out18:54
portantebetter safe than sorry18:54
portantehopefully all this will be blown out of proporation any the worse that happens is everybody blames the weather people for not being good at their job18:57
portantes/any/and/18:57
portanteso how is everybody's storage redundancy in SF? :)18:58
*** lcurtis has quit IRC18:58
openstackgerritJiri Suchomel proposed openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046318:59
*** flwang has joined #openstack-swift18:59
ctennispower is still online on brannan st19:00
* peluse wonders what "rain" is19:01
notmynamebasically this https://twitter.com/artomatik/status/54309747151447244819:02
*** nellysmitt has joined #openstack-swift19:07
*** Masahiro has joined #openstack-swift19:15
*** Masahiro has quit IRC19:19
pelusenice pic!19:20
cschwedenotmyname: swifterdarrell let me know if i should change anything in https://review.openstack.org/#/c/140478/19:27
cschwedenotmyname: swifterdarrell: also, i’m at a customer site currently and travelling back tomorrow, so please feel free to modify the patch if you don’t get a response from my side within 12hrs19:28
notmynamecschwede: ya we were just talking about it with clayg too19:33
notmynameclayg: sounds like you want something a lot more than the warning to land in this patch. or are you ok with just the warning being printed19:34
claygnotmyname: no, i guess just the warning is fine since we're on the release schedule but yeah I have some diffs i'm hacking on around this19:38
claygnotmyname: when did you want to cut the release?19:38
notmynamebetween today and monday.19:39
notmynameclayg: of course if the current patch conflicts (or paints into a corner) what your and/or swifterdarrell are working on, let's not do that19:43
claygi'm not sure, i haven't looked at cschwede's patch that closely... none of this is terribly surprising to me i guess is the thing, everyone is like "we need to raise a warning when the ring is screwed" and I'm all like "yeah you can tell that by looking at the weights - you can either balance that or you can't unique-as-possible it's math"19:47
claygso what I'm working on is to bouble out the unique-as-possible-ness as a new kind of balance, so you can be dead to rights on the weight and be way out of whack on unique-as-possible and that just comes out like another balance except instead of "wait and rebalance and repush" it's "continue adding weight to the new tier reblance and repush"19:48
swifterdarrellclayg: if you auto-munge weights in a way that's divorced from actual TB of storage capacity, you're then opening yourself up to filling a subset of disks first/faster (i.e. having a problem in a different place)19:49
cschwedeswifterdarrell: which is similar to the original behaviour in Swift < 2.1, right? for example one region with a weight of 1000, another with 10? but both get the same amount of partitions19:51
swifterdarrellcschwede: ya, that was a possibility you could get yourself into pre Swift 2.1... severely imbalanced storage capacity could lead to smaller devices filling up faster than if partitions were spread "better" according to storage capacity19:53
notmynamecombined with the other problem cschwede was seeing which is adding a tier and having a huge number of parts move19:54
claygyes all of that - this is working as intended, instead of unbalanced rings that blasted parts all over your tiers you get to perflectly balance yourself right into availability risk (which was the whole point of the change)19:56
claygso I think - depending on what you're doing - you are going to want to have balance on one or the other - if you've finished a topology migration and you're unique-as-possible balance is still out of whack then you need to "artifically" change the weights on something in a tier somewhere - which I agree should be represented as "imbalance" in data capacity (just like pre 2.1)19:58
*** mvenesio has joined #openstack-swift20:01
cschwedei was even thinking of adding a switch, making pre 2.1 the default and only taking weights into account if a user enables this. from my point of view the prio is like this: 1. ensure everything is distributed across several failure domains 2. ensure adding new tiers doesn’t flood your new servers with data 3. ensure that devices are not over-commited20:05
cschwede2. + 3. will basically halt your cluster, but data is still distributed well20:06
claygidk I think 1 is almost kind of a footgun for gradual capacity changes, and also it's already doing the best it can given the capacity available - #3 isn't that dangerous unless you have a big cluster - which is exactly the case you want #1 not to be a big footgun20:12
*** tab____ has joined #openstack-swift20:17
*** rdaly2 has quit IRC20:20
*** exploreshaifali has joined #openstack-swift20:22
*** nellysmitt has quit IRC20:24
*** fifieldt_ has quit IRC20:32
*** mvenesio has quit IRC20:35
cschwedehmm, yes. so basically the operator needs to decide what he wants20:35
openstackgerritJiri Suchomel proposed openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046320:35
*** Nadeem_ has quit IRC20:37
*** mvenesio has joined #openstack-swift20:41
openstackgerritpaul luse proposed openstack/swift: New hashes.pkl format and several other reconstructor related changes  https://review.openstack.org/13187220:42
*** fifieldt_ has joined #openstack-swift20:49
swifterdarrellcschwede: clayg: re: "the operator needs to decide what he wants"; knowing what you want is the second hardest part; being happy with what you got instead is slightly harder21:02
swifterdarrellcschwede: clayg (that's a little lighthearted philosophical joke, not actually a comment about this builder stuff)21:03
*** Masahiro has joined #openstack-swift21:03
*** Masahiro has quit IRC21:08
* notmyname grumbles at super long gerrit links21:09
claygeh21:09
mattoliverauMorning all21:09
claygcschwede: i'm not entirely sure the operator needs to decide, I think I'd like to give it a shot where there's a slide that will imbalance capacity up to X % in order to solve unique as possible, and the default be like 10% or something, and then the warning is like you can either add weight *right here at this tier that's not properly provisioned* (may have been your plan already) or you can put that off and crank up the im21:12
claygwhere is "add weight" is a) increase actual capacity, or be continue to gradually increase the weights of the existing capacity21:14
*** ChanServ changes topic to "Swift 2.2.0 https://launchpad.net/swift/juno/2.2.0 | Priority Reviews: https://wiki.openstack.org/wiki/Swift/PriorityReviews | Ideas: https://wiki.openstack.org/wiki/Swift/ideas | Review Dashboard: http://goo.gl/r2mxbe"21:16
openstackgerritJiri Suchomel proposed openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046321:19
torgomaticclayg: you could implement such a thing as a fudge factor on the parts_wanted computation... if you're willing to let things get out of whack by 10%, multiply each drive's parts_wanted by 1.1 prior to rebalancing21:19
torgomaticthat way, any given disk will take up to 110% of what its normal share would be prior to being considered full, so you get better dispersion that way21:20
torgomaticmaybe21:20
* torgomatic is spitballing here21:20
claygtorgomatic: that's the ticket!21:23
swifterdarrelltorgomatic: clayg: +121:23
cschwedeclayg: torgomatic: yeah, sounds like a nice idea to allow imbalance by 10%. +1!21:24
*** tellesnobrega_ has joined #openstack-swift21:24
torgomaticgreat! now someone go code it ;)21:24
claygtorgomatic: i'm still trying to get my head around the partition dance patch21:25
notmynamehere's a newer review dashboard: http://goo.gl/r2mxbe. also here's a dashboard for "health of swift community" http://goo.gl/JL65l721:25
*** tkay has joined #openstack-swift21:32
*** EmilienM is now known as EmilienM|pto21:39
*** tkay has left #openstack-swift21:43
*** tab____ has quit IRC21:50
*** exploreshaifali has quit IRC21:58
*** exploreshaifali has joined #openstack-swift22:01
*** nellysmitt has joined #openstack-swift22:24
*** mvenesio has quit IRC22:25
*** tab has joined #openstack-swift22:26
*** tab is now known as Guest9722:26
*** nellysmitt has quit IRC22:30
notmynamemattoliverau: dfg: redbo: acoles_away: I'd love your input on a few of the trickier patches that have come up this week22:33
notmynamehttps://review.openstack.org/#/c/141019/ <- fix large out of sync containers22:33
notmynamehttps://review.openstack.org/#/c/140478/ <- warn if multiple replicas are stored in the same tier22:33
claygglange_: ^ he ment to include you too22:34
notmynamehttps://review.openstack.org/#/c/140879/ <- only move too-close-together replicas when they can spread out22:34
clayg^ ohhhh that one is tricky22:34
notmynameportante: we could probably use a pinch hitter on these too ;-)22:34
*** kopparam has joined #openstack-swift22:37
claygtorgomatic: I wonder if I should try running that db replicator test against the container backend code from 1fcd6096^22:38
mattoliveraunotmyname: I'll review them all today :)22:40
notmyname...he say's before diving in to them ;-)22:40
notmynamesays*22:40
mattoliverauok, I'll start reviewing them today, and see how far i get :P22:41
notmynameheh22:41
notmynamethanks!22:41
notmynamethe 2nd one (the warning one) is shortest. but has probably had the most debate (hello bikeshed.org?)22:41
mattoliveraulol, so I've noticed in scroll back :P22:42
torgomaticclayg: sounds like a good idea to me22:43
*** gyee has quit IRC22:45
*** dmsimard is now known as dmsimard_away22:49
*** Masahiro has joined #openstack-swift22:52
*** Guest97 has quit IRC22:55
*** Masahiro has quit IRC22:57
*** kopparam has quit IRC23:09
claygc23:09
clayghrm... this is not the pdb i was looking for23:10
notmynametorgomatic: parts_wanted is 0 if the weight for that drive is 0, right? eg if it's an initial ingest or a final step of a drain or just left in the cluster23:11
*** sungju has joined #openstack-swift23:28
*** tellesnobrega has quit IRC23:30
*** mahatic has quit IRC23:37
*** mahatic has joined #openstack-swift23:37
*** tellesnobrega has joined #openstack-swift23:42
torgomaticnotmyname: yes23:48
notmynametorgomatic: thanks23:48
*** ahonda has quit IRC23:55
*** tdasilva has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!