Friday, 2017-01-27

*** rcernin has joined #openstack-swift00:00
*** mingyu has quit IRC00:01
*** NM has joined #openstack-swift00:18
*** NM has quit IRC00:26
*** oshritf__ has quit IRC00:27
*** _JZ_ has quit IRC00:34
*** rcernin has quit IRC00:51
*** rcernin has joined #openstack-swift00:54
*** rcernin has quit IRC00:55
*** rcernin has joined #openstack-swift00:55
*** sams-gleb has joined #openstack-swift01:54
*** sams-gleb has quit IRC01:59
*** dims_ has joined #openstack-swift02:14
*** dims has quit IRC02:14
*** clu_ has quit IRC02:14
*** dims_ has quit IRC02:47
*** dims has joined #openstack-swift02:50
*** yarkot has joined #openstack-swift03:31
openstackgerritJoshua White proposed openstack/swift: WIP Swift multinode; Do not merge  https://review.openstack.org/42604303:47
openstackgerritJoshua White proposed openstack/swift: WIP Swift multinode; Do not merge  https://review.openstack.org/42604303:49
*** tqtran has quit IRC03:55
*** sams-gleb has joined #openstack-swift03:57
*** sams-gleb has quit IRC04:01
*** mmmucky has quit IRC04:04
*** mmmucky has joined #openstack-swift04:04
*** chosafine has joined #openstack-swift04:08
mahaticgood morning04:15
mattoliveraumahatic: morning04:15
mahaticmattoliverau: o/ it was a holiday in India too yesterday, republic day for us04:15
mattoliverau\o/ twins!04:16
mahatic:D04:16
*** klrmn has quit IRC04:18
*** chosafin_ has joined #openstack-swift04:20
*** mtreinish has quit IRC04:22
*** mtreinish has joined #openstack-swift04:23
*** chosafine has quit IRC04:23
*** psachin has joined #openstack-swift04:24
*** SkyRocknRoll has joined #openstack-swift04:26
*** ppai has joined #openstack-swift04:28
mahaticoh progress/new bug in patch 41978704:32
patchbothttps://review.openstack.org/#/c/419787/ - swift - Better optimistic lock in get_hashes04:32
*** ppai has quit IRC04:48
*** ppai has joined #openstack-swift05:01
*** ppai has quit IRC05:04
*** ppai has joined #openstack-swift05:05
*** ppai has quit IRC05:17
*** david-lyle has quit IRC05:46
*** winggundamth has joined #openstack-swift05:55
*** sams-gleb has joined #openstack-swift05:59
*** sams-gleb has quit IRC06:03
openstackgerritClay Gerrard proposed openstack/swift: Better optimistic lock in get_hashes  https://review.openstack.org/41978706:17
*** silor has joined #openstack-swift06:20
*** silor1 has joined #openstack-swift06:25
*** silor has quit IRC06:26
*** silor1 is now known as silor06:26
*** ukaynar has quit IRC06:33
*** JimCheung has joined #openstack-swift06:43
*** JimCheung has quit IRC06:48
*** philipw has quit IRC07:02
*** philipw has joined #openstack-swift07:02
*** sams-gleb has joined #openstack-swift07:22
*** rcernin has quit IRC07:24
*** clu_ has joined #openstack-swift07:30
*** tanee is now known as tanee_away08:13
*** geaaru has joined #openstack-swift08:18
*** clu_ has quit IRC08:18
*** rledisez has joined #openstack-swift08:25
*** hseipp has joined #openstack-swift08:26
openstackgerritMerged openstack/python-swiftclient: 3.3.0 authors/changelog update  https://review.openstack.org/42545408:46
*** kei_yama has quit IRC08:50
*** tanee_away is now known as tanee09:05
*** JimCheung has joined #openstack-swift09:15
*** JimCheung has quit IRC09:20
*** sams-gleb has quit IRC09:42
*** sams-gleb has joined #openstack-swift09:43
*** sams-gleb has quit IRC09:47
*** gabor_antal has joined #openstack-swift09:52
*** tqtran has joined #openstack-swift09:58
*** tqtran has quit IRC10:02
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925010:14
*** jordanP has joined #openstack-swift10:21
*** sams-gleb has joined #openstack-swift10:28
*** mvk has quit IRC11:06
*** vint_bra has joined #openstack-swift11:08
*** mkrai has quit IRC11:10
*** vint_bra has quit IRC11:12
*** mkrai has joined #openstack-swift11:18
*** chlong has joined #openstack-swift11:24
*** sanchitmalhotra has quit IRC11:29
*** sanchitmalhotra has joined #openstack-swift11:29
*** NM has joined #openstack-swift11:37
*** oshritf__ has joined #openstack-swift11:52
*** catintheroof has joined #openstack-swift12:04
*** mvk has joined #openstack-swift12:04
*** oshritf__ has quit IRC12:29
*** vint_bra has joined #openstack-swift12:30
*** McMurlock1 has joined #openstack-swift12:33
*** geaaru has quit IRC12:35
*** acoles_ is now known as acoles12:40
*** glb1 has joined #openstack-swift12:50
*** tqtran has joined #openstack-swift13:00
*** psachin has quit IRC13:02
*** tqtran has quit IRC13:04
*** catintheroof has quit IRC13:05
*** catintheroof has joined #openstack-swift13:16
*** winggundamth has quit IRC13:53
*** tqtran has joined #openstack-swift14:01
*** tqtran has quit IRC14:05
*** sams-gleb has quit IRC14:19
*** sams-gleb has joined #openstack-swift14:20
*** geaaru has joined #openstack-swift14:22
*** sams-gleb has quit IRC14:25
*** sams-gleb has joined #openstack-swift14:25
*** sams-gleb has quit IRC14:29
*** Renich has quit IRC15:08
*** sams-gleb has joined #openstack-swift15:12
*** _JZ_ has joined #openstack-swift15:39
*** chsc has joined #openstack-swift15:45
*** mvk has quit IRC15:58
*** chsc has quit IRC16:03
openstackgerritJanie Richling proposed openstack/swift: WIP: Symlink support in container-sync  https://review.openstack.org/42166916:06
claygacoles: how we looking bro?  we on fleek?16:07
*** oshritf has joined #openstack-swift16:07
acolesclayg: I think so. I've not had time to go over the tests, just posted to gerrit though16:09
claygi'm just reading cschwede's comment trying to understand why your test passed on master16:10
acolesclayg: I replied to that comment16:10
clayghe seems to be saying that the writeback in consolidate_hashes from the concurrent call is surprising - he expected modified to be False16:10
acolesclayg: oh, maybe that's sa different comment?16:10
* cschwede is looking at the patch again16:11
acolesclayg: I thought the test in my gist passed on master because mtime changed on the hashes.pkl even though content remained same16:11
*** JimCheung has joined #openstack-swift16:14
acolesI think that now if a suffix is invalidated then that is either (a) left in hashes.invalid journal or (b) committed to hashes.pkl in a way that any other process than the committer will notice (via 'updated') if it has read an older hashes.pkl16:15
* acoles afk16:16
claygit passes 7/10 times on master anyway16:17
cschwedewhat?!16:18
cschwedewhy is that?16:18
*** JimCheung has quit IRC16:18
claygcschwede: I'm printfing right now - i'm with you - how is this not failing?  modified should be false!  ;)16:23
claygI mean... i can see it's not but I don't understand16:23
claygi think it's just the performance regression16:30
claygmodified *is* false - the "other process" in non_local['called'] *is* eating the invalidation - but the outer caller of get_hashes does a second rehash anyway (we always do on master) so on the secon go round it picks up what it wrote last time in conslidate and rehashes to the correct state16:31
claygpretty wild16:32
*** donagh has joined #openstack-swift16:35
*** donagh has left #openstack-swift16:44
openstackgerritClay Gerrard proposed openstack/swift: Better optimistic lock in get_hashes  https://review.openstack.org/41978716:47
notmynameI woke up with a fever this morning, so I'm going to try to take it easy today. https://review.openstack.org/426301 has been proposed for the swiftclient release.16:48
patchbotpatch 426301 - releases - swiftclient 3.3.0 release16:48
notmynameping me if something else comes up, and I'll get back to you when I can16:48
*** SkyRocknRoll has quit IRC16:48
claygoh... setting base to 7 in gerrit seems to show what you'd expect despite the rebase <shrug>16:49
*** jordanP has quit IRC16:54
*** tqtran has joined #openstack-swift17:03
*** tqtran has quit IRC17:07
jrichlitdasilva: looks like the SwiftStack cluster that runs gate jobs still runs with post-as-copy, so symlinks patch fails to run there17:07
tdasilvajrichli: can't send a patch to swiftstack cluster ;)17:08
tdasilvacharz_: hello! we have recently changed the default for post-as-copy, but looks like swiftstack clusters have that value hardcoded, when you have a chance, can you change it?17:09
notmynameI'll follow up with charz_17:10
tdasilvanotmyname: thanks! and hope you get better soon17:11
notmynamethanks17:11
*** chsc has joined #openstack-swift17:16
*** chsc has joined #openstack-swift17:16
*** rledisez has quit IRC17:17
notmynameswiftclient 3.3.0 was tagged17:17
*** tqtran has joined #openstack-swift17:21
*** Jeffrey4l_ has quit IRC17:24
*** Jeffrey4l_ has joined #openstack-swift17:24
*** JimCheung has joined #openstack-swift17:29
jrichlinotmyname: fever - that's aweful.  I have had a cold the last couple days.  And of course you know about poor kota_ with the flu17:30
*** bikmak has quit IRC17:31
*** hseipp has quit IRC17:35
*** chlong has quit IRC18:03
*** klrmn has joined #openstack-swift18:08
*** mvk has joined #openstack-swift18:16
*** psachin has joined #openstack-swift18:19
openstackgerritAlistair Coles proposed openstack/swift: Fix race when consolidating new partition (WIP)  https://review.openstack.org/42633618:28
acolesclayg: don't give up! we will conquer hashing ;)18:44
acolesgoodnight18:44
*** geaaru has quit IRC18:47
*** ChubYann has joined #openstack-swift18:51
*** oshritf has quit IRC18:58
*** acoles is now known as acoles_19:02
*** arch-nemesis has joined #openstack-swift19:08
*** McMurlock1 has quit IRC19:13
*** tqtran has quit IRC19:20
claygwhooooo19:20
*** silor has quit IRC19:23
openstackgerritClay Gerrard proposed openstack/swift: Fix race when consolidating new partition (WIP)  https://review.openstack.org/42633619:33
*** psachin has quit IRC20:00
*** david-lyle has joined #openstack-swift20:01
*** oshritf has joined #openstack-swift20:02
*** varunsomani has joined #openstack-swift20:15
*** varunsomani has quit IRC20:16
*** ukaynar has joined #openstack-swift20:22
*** NM has quit IRC20:27
*** JimCheung has quit IRC20:44
*** caiobrentano has quit IRC20:45
claygtdasilva: so are you warming up on patch 425496 at all?20:53
patchbothttps://review.openstack.org/#/c/425496/ - swift - Warn about using EC with isa_l_rs_vand and nparity...20:53
claygI was thinking of kicking the tires - but to my understanding and notmyname's comments - it *seems* to faithfully reproduce what was agreeded to in the meeting20:54
clayg... so unless we agreed to the wrong thing - I'm probably happy as long as it does what's on the tin20:54
*** arch-nemesis has quit IRC21:01
*** Jeffrey4l_ has quit IRC21:35
*** Jeffrey4l_ has joined #openstack-swift21:41
MooingLemuris liberasurecode_rs_vand a compatible drop in for jerasure_rs_vand?21:43
MooingLemurfor an existing policy?21:43
*** catintheroof has quit IRC21:44
*** catintheroof has joined #openstack-swift21:45
claygMooingLemur: no definately not21:48
MooingLemurroger21:48
claygMooingLemur: maybe I should say "definately not intended to be; but to my knowledge no one has been crazy enough to try - because if it worked it'd be like breeding a dog with a cat and getting chicken"21:49
claygi.e. YOU SHOULD TOTALLY TRY IT AND LET US KNOW HOW IT GOES21:49
MooingLemurdelicious21:49
*** catintheroof has quit IRC21:49
MooingLemuryeah, I think it's quite unhappy with the attempt :)21:50
clayg;)21:50
MooingLemursince this is a personal cluster that I'm converting from gentoo to centos, I'll just migrate the data manually away from jerasure.21:52
MooingLemureasy to get in gentoo, not supplied with centos without extra work so *shrug*21:52
*** vint_bra has quit IRC21:54
*** _JZ_ has quit IRC21:55
zaitcevGuys, is there a chance for some to review https://review.openstack.org/337297 in like a couple of hours?22:04
patchbotpatch 337297 - swift - Add support to increase object ring partition power22:04
zaitcevI think it's fine, but acoles_ and mattoliverau caught things in it previously that I missed22:04
zaitcevEr22:05
zaitcevactually it was Clay22:05
zaitcevBut anyway, I'm irrationally uneasy about landing it.22:05
*** oshritf has quit IRC22:12
*** JimCheung has joined #openstack-swift22:12
claygi don't think i've ever even looked at it :'(22:23
MooingLemurclayg.clone()22:24
zaitcev"Patch Set 4: // (5 comments) // Still reading this over, I think it makes some tradeoffs over the epoch approach that are have some very promising merit - looking forward to talking with you more about it."22:24
claygzaitcev: it looks like you and cschwede are feeling pretty good out it?22:24
zaitcevclayg: yes22:24
claygsorry zaitcev, cschwede, mattoliverau - that's huge - that's 3 cores22:25
zaitcevwell, I was sceptical originally. It seems complex and I hate additing code22:25
claygIf you guys are feeling good about it the only advice I probably have to offer is checklist stuff22:25
zaitcevok22:25
claygdouble check probetests - double check docs22:25
claygyes code is the worst +222:26
claygbut... you can't make the impossible possible w/o code it seems :'(22:26
zaitcevI tested it exactly once. It was fine and I was able to add-remove devices and rebalance the ring afterwards without imposing too much of data movement, so at least that worked.22:27
claygzaitcev: mattoliverau: cschwede: I don't think anyone cares if it goes in this week or next?  If you want to stew on it go for it!  tdasilva timburke or myself I'm sure would all *love* to look into it more!22:27
claygbut we can look at it on master too ;)22:27
zaitcevToday is Ocata cutoff22:27
claygwhat!?22:27
claygno it's not22:27
claygzaitcev: I think notmyname is doing a python swiftclient thingy22:28
zaitcevWell, tdasilva told me so.22:28
claygbut we have some time for Octocat22:28
claygtdasilva: !!! you sure!?22:28
zaitcevHrm. Well, I needed to review it again anyway, so I don't I wasted any time today.22:28
zaitcevSorry for the noise if so...22:29
zaitcevYou know what's funny, I distinctly remember a talk about this in 2012. It was 5 years ago when some guy, I think his name was Luis, tried to adjust the partition power.22:30
zaitcevIt was back when gholt was active22:30
zaitcevHe was not smart enough to invent cschwede's relinker and realize that +1 is doable.22:31
claygzaitcev: I think lots have people have realized you can do the 2^+1 thing - but figuring out what to do on disk and the process to get all the bits in place w/o loosing any was cschwede's invention AFAIK22:32
claygcschwede is sort of a genius like that22:32
*** ukaynar has quit IRC22:33
openstackgerritClay Gerrard proposed openstack/swift: Better optimistic lock in get_hashes  https://review.openstack.org/41978722:51
openstackgerritClay Gerrard proposed openstack/swift: Fix race when consolidating new partition  https://review.openstack.org/42633622:51
*** tqtran has joined #openstack-swift23:28
*** chsc has quit IRC23:31
*** sams-gleb has quit IRC23:39
notmynametoday (actually yesterday, it turns out) was the ocata cutoff for library releases23:59
notmynamethe week of feb 13 is the cutoff for swift23:59
notmynamehttps://releases.openstack.org/ocata/schedule.html23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!