Wednesday, 2017-02-01

*** NM has joined #openstack-swift00:04
kota_clayg: oh, does it get conflicted!? 11  hours ago...00:08
kota_Ah... i aready closed my laptop :/00:09
* kota_ will rebase global ec patch00:10
*** dims_ has joined #openstack-swift00:10
*** dims has quit IRC00:11
*** dmorita_ has quit IRC00:16
*** dmorita has joined #openstack-swift00:17
*** dmorita has quit IRC00:22
openstackgerritTim Burke proposed openstack/swift: Remove per-device reconstruction stats  https://review.openstack.org/42747600:27
claygkota_: no worries - every day I feel like I'm getting closer to it tho!00:27
*** dmorita has joined #openstack-swift00:30
*** dmorita_ has joined #openstack-swift00:33
*** tdasilva has joined #openstack-swift00:33
*** dmorita_ has quit IRC00:34
*** dmorita has quit IRC00:34
*** dmorita_ has joined #openstack-swift00:34
*** esnyder has quit IRC00:36
*** dmorita_ has quit IRC00:38
*** dmorita has joined #openstack-swift00:40
claygtimburke: I think i ran into this last time I tried to review the timezone change patch - I can not find a bad behavior with the existing code?  I've got my damn saio running in EST trying to find *anything*00:43
claygfollowing along with the related changes00:43
clayg... i feel like somewhere in email.utils00:43
timburkeclayg: did you try backing out the swift change and running the new tests?00:43
claygthere is *some* method I could call in test_run_daemon_diff_tz that would be obviously incorrect00:44
claygthe only thing that seems to ail is time.timezone not being 0 - but that sort of makes sense?00:44
claygthe old code didn't try to force you to UTC - it just tried to record whatever you have set?00:44
timburkeand did it shittily. really, really shittily00:45
claygeither way - I still don't understand who get's confused if time.timezone is "wrong"00:45
timburkethe thing that bit me was https://docs.python.org/2/library/email.util.html#email.utils.parsedate_tz -- on older versions of python, having the time module is some crazy split-brain state was bad news bears00:45
claygyeah - you've said that before - and i like time.tzset - i don't see a good reason *not* to set it according to the docs00:45
claygbut I still feel like I should be able to find *something* that is is "oh this is obviously wrong" ?00:46
claygtimburke: ah, maybe that's what's tripping me up - i can't see it on Python 2.7.1200:46
timburkeclayg: go take a look at https://hg.python.org/cpython/rev/a283563c8cc400:47
timburkei'm not necessarily *opposed* to forcing the local TZ (although DST changes make me more than a little nervous), but i couldn't for the life of me figure out *how to do it* reliably00:49
timburkecoupled with the fact that we apparently *already were* setting everything to UTC, i'm inclined to just do it and do it right00:50
clayginteresting point on DST changes - i wonder how long running python processes normally behave there - obvs setting prod to UTC is the only thing that makes sense00:51
clayglet's not let you start processes if you have the wrong timezone set?00:51
claygok, patch 330888 had the tip on the effected python versions - thanks00:53
patchbothttps://review.openstack.org/#/c/330888/ - swift3 - Stop using email.utils.mktime_tz (MERGED)00:53
timburkeclayg: ...and have you thought about what happens when the tx_info file changes? not just like, "oh, before it was standard time, now it's DST" but "the DST info that we hardcoded into environ['TZ'] no longer reflects reality"00:54
timburkeno part of any of that seems like a good idea. UTC. that's it.00:55
claygrofl - srly00:58
timburkei seem to recall someone (torgomatic?) making the joke that the biggest impediment to interplanetary travel was re-writing the time libraries01:01
*** _JZ_ has quit IRC01:26
openstackgerritKota Tsuyuzaki proposed openstack/swift: Optimize ec duplication and its md5 hashing  https://review.openstack.org/42167301:36
openstackgerritKota Tsuyuzaki proposed openstack/swift: EC Fragment Duplication - Foundational Global EC Cluster Support  https://review.openstack.org/21916501:36
kota_rebased01:38
kota_clayg, timburke: it looks like reconstructor fix (not revert to handoff, actually its test) conflicted with mine.01:39
*** winggundamth_ has joined #openstack-swift01:41
*** winggundamth_ has quit IRC01:44
*** winggundamth_ has joined #openstack-swift01:46
*** dmorita has quit IRC01:46
*** dmorita has joined #openstack-swift01:47
*** tqtran has quit IRC01:51
claygkota_: ah, but you squared it!02:15
*** NM has quit IRC02:32
*** ukaynar has quit IRC02:35
*** JimCheung has quit IRC02:43
*** chsc has joined #openstack-swift02:55
*** chsc has joined #openstack-swift02:55
*** chsc has quit IRC03:01
*** JimCheung has joined #openstack-swift03:06
*** JimCheung has quit IRC03:11
*** JimCheung has joined #openstack-swift03:30
*** JimCheung has quit IRC03:35
*** psachin has joined #openstack-swift04:03
*** arch-nemesis has quit IRC04:24
*** dmorita has quit IRC04:50
*** klrmn has quit IRC05:10
*** klrmn has joined #openstack-swift05:11
*** SkyRocknRoll has joined #openstack-swift05:12
*** SkyRocknRoll has quit IRC05:17
*** SkyRocknRoll has joined #openstack-swift05:33
*** silor has joined #openstack-swift05:34
*** NM has joined #openstack-swift05:34
*** ppai has joined #openstack-swift05:35
*** silor has quit IRC05:39
*** NM has quit IRC05:59
*** klrmn has quit IRC06:00
*** NM has joined #openstack-swift06:00
*** NM has quit IRC06:00
*** yarkot has quit IRC06:06
*** chsc has joined #openstack-swift06:11
*** chsc has joined #openstack-swift06:11
*** rcernin has joined #openstack-swift06:29
*** yarkot has joined #openstack-swift06:31
*** dmorita has joined #openstack-swift06:50
*** chsc has quit IRC06:52
*** dmorita has quit IRC06:55
*** klrmn has joined #openstack-swift07:11
openstackgerritMerged openstack/swift: Shuffle disks and parts in reconstructor  https://review.openstack.org/42546807:15
*** tesseract has joined #openstack-swift07:18
*** pcaruana has joined #openstack-swift07:19
*** klrmn has quit IRC07:23
*** foexle has joined #openstack-swift07:26
*** oshritf has joined #openstack-swift07:36
*** sams-gleb has joined #openstack-swift07:38
*** ChubYann has quit IRC07:42
*** oshritf has quit IRC07:54
*** oshritf has joined #openstack-swift07:57
*** oshritf has quit IRC07:59
*** cschwede has quit IRC08:05
*** tmoreira_ has quit IRC08:07
*** rledisez has joined #openstack-swift08:11
*** bkopilov has quit IRC08:14
*** geaaru has joined #openstack-swift08:24
*** bkopilov has joined #openstack-swift08:24
*** tmoreira has joined #openstack-swift08:26
*** foexle has quit IRC08:29
*** oshritf has joined #openstack-swift08:31
*** oshritf has quit IRC08:33
*** kei_yama has quit IRC08:36
*** oshritf has joined #openstack-swift08:40
*** oshritf has quit IRC08:43
*** cbartz has joined #openstack-swift09:08
*** furlongm has quit IRC09:40
*** JimCheung has joined #openstack-swift09:44
*** jordanP has joined #openstack-swift09:46
*** JimCheung has quit IRC09:49
*** SkyRocknRoll has quit IRC09:49
*** SkyRocknRoll has joined #openstack-swift09:51
*** oshritf has joined #openstack-swift10:04
*** oshritf has quit IRC10:25
*** rledisez has quit IRC10:32
*** rledisez has joined #openstack-swift10:33
*** sams-gleb has quit IRC10:46
*** sams-gleb has joined #openstack-swift10:47
*** mvk has quit IRC10:49
*** sams-gleb has quit IRC10:51
*** oshritf has joined #openstack-swift10:51
*** furlongm has joined #openstack-swift10:55
mathiasbit doesn't seem like conditional post requests on account or container metadata work; is there any particular reason why, or is it just that it hasn't been required for anything so far?10:57
mathiasbat least with unsatisfied "if-modified-since" restrictions, the updates always succeed10:58
openstackgerritChristian Schwede proposed openstack/swift: Add support to increase object ring partition power  https://review.openstack.org/33729711:08
*** cschwede has joined #openstack-swift11:12
*** oshritf has quit IRC11:12
*** vint_bra has joined #openstack-swift11:14
*** oshritf has joined #openstack-swift11:18
*** mvk has joined #openstack-swift11:19
*** oshritf has quit IRC11:21
*** jamielennox is now known as jamielennox|away11:25
*** sams-gleb has joined #openstack-swift11:26
*** sams-gle_ has joined #openstack-swift11:28
*** sams-gleb has quit IRC11:28
*** vint_bra has quit IRC11:39
*** cdelatte has joined #openstack-swift12:11
*** NM has joined #openstack-swift12:27
*** catintheroof has joined #openstack-swift12:28
*** oshritf has joined #openstack-swift12:36
*** oshritf has quit IRC12:39
*** oshritf has joined #openstack-swift12:41
*** mvk has quit IRC12:47
*** oshritf has quit IRC12:56
*** mvk has joined #openstack-swift13:00
*** mmmucky has quit IRC13:04
*** mmmucky has joined #openstack-swift13:04
*** cdelatte has quit IRC13:05
*** vint_bra has joined #openstack-swift13:06
*** alpha_ori has quit IRC13:06
*** bapalm has quit IRC13:07
*** cdelatte has joined #openstack-swift13:07
*** alpha_ori has joined #openstack-swift13:08
*** sgundur1 has quit IRC13:08
*** sgundur1 has joined #openstack-swift13:08
*** vint_bra has quit IRC13:11
*** bapalm has joined #openstack-swift13:12
*** briancline has quit IRC13:15
*** briancline has joined #openstack-swift13:17
*** klamath has joined #openstack-swift13:20
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873613:20
*** bapalm has quit IRC13:24
*** jordanP has quit IRC13:27
*** jordanP has joined #openstack-swift13:28
*** ppai has quit IRC13:33
*** ppai has joined #openstack-swift13:42
*** NM has quit IRC13:43
*** JimCheung has joined #openstack-swift13:45
*** JimCheung has quit IRC13:45
*** winggundamth_ has quit IRC13:46
*** dmorita has joined #openstack-swift13:51
*** tongli has joined #openstack-swift13:55
*** dmorita has quit IRC13:56
*** SkyRocknRoll has quit IRC13:56
*** oshritf has joined #openstack-swift14:15
*** NM has joined #openstack-swift14:15
*** Shashikant86 has joined #openstack-swift14:20
*** cdelatte has quit IRC14:25
*** oshritf has quit IRC14:28
*** oshritf has joined #openstack-swift14:34
*** oshritf has quit IRC14:38
*** _JZ_ has joined #openstack-swift14:40
*** cdelatte has joined #openstack-swift14:53
*** sams-gle_ has quit IRC14:56
*** sams-gleb has joined #openstack-swift14:57
*** sams-gleb has quit IRC15:01
*** Shashikant86 has quit IRC15:02
*** tongli has quit IRC15:09
*** sams-gleb has joined #openstack-swift15:14
*** vint_bra has joined #openstack-swift15:21
*** rcernin has quit IRC15:51
*** silor has joined #openstack-swift15:55
*** Shashikant86 has joined #openstack-swift16:07
openstackgerritChristian Schwede proposed openstack/swift: Add support to increase object ring partition power  https://review.openstack.org/33729716:19
*** silor1 has joined #openstack-swift16:24
*** silor has quit IRC16:26
*** silor1 is now known as silor16:26
*** chsc has joined #openstack-swift16:36
*** chsc has joined #openstack-swift16:36
*** tongli has joined #openstack-swift16:38
cbartzcschwede: Good day! When writing a middleware for swift, is their a way to check in which order the wsgi pipeline has been constructed? E.g., it is required that a certain middleware like "copy" must before the actual middleware in the pipe. Can I check this at best already in the constructor (so that the proxy-server does not start if the check fails)?16:39
*** tesseract has quit IRC16:56
*** ppai has quit IRC16:58
*** Shashikant86 has quit IRC16:59
*** tongli has quit IRC17:00
*** psachin has quit IRC17:01
*** SkyRocknRoll has joined #openstack-swift17:02
*** jordanP has quit IRC17:08
notmynamegood morning17:23
*** cbartz has quit IRC17:34
timburkegood morning17:35
*** acoles_ is now known as acoles17:36
*** rledisez has quit IRC17:38
*** SkyRocknRoll has quit IRC17:42
*** JimCheung has joined #openstack-swift17:42
*** dmorita has joined #openstack-swift17:43
timburkemathiasb: to my knowledge, no one's asked for it before. might be a little hard to reliably do, at least for the if-unmodified case -- outstanding updates on handoffs and what not. i wonder how we handle that with object POSTs....17:44
*** acoles is now known as acoles_18:00
*** tdasilva has quit IRC18:04
*** tqtran has joined #openstack-swift18:13
*** klrmn has joined #openstack-swift18:23
*** pcaruana has quit IRC18:28
claygwooooo!18:28
*** tdasilva has joined #openstack-swift18:43
clayg"Later this year PyPy is expected to reach Python 3.5 conformance." !!! WAHHHHHhhhaaaa????!!18:53
notmynameyeah, they got a pile of money recently to have people get pypy to finish py3 support18:54
tdasilvaclayg: did you see this: https://medium.com/@squeaky_pl/million-requests-per-second-with-python-95c137af319#.shsr3lcmb18:56
*** mvk has quit IRC18:57
claygtdasilva: looking at japronto examples now19:04
claygoh it's based on uvloop!  (I'm having trouble getting it to build on my mac)19:12
claygbut it's not obvious from the examples or source how/if it supports a streaming/iterable response19:12
clayglike I think it wants you to Response(body=f.read())19:13
clayg"what kind of crazy mother would have a 2GB HTTP response!?" is a pretty common response19:13
notmynameclayg: better yet, a 2Gb *request*19:13
clayghaven't looked at the request handling yet - but all signs point to "that's not really our use-case; patches welcome"19:14
claygI like it that there all like "whatever wsgi"19:15
clayguvloop still hasn't moved of adding a support for the libuv filesystem calls :'(19:16
*** geaaru has quit IRC19:20
*** dmorita has quit IRC19:20
*** tonanhngo has joined #openstack-swift19:21
*** dmorita has joined #openstack-swift19:26
*** dmorita has quit IRC19:26
*** dmorita has joined #openstack-swift19:26
claygmahatic: acoles_: thinking of respinning patch 426336 with the fix for the comment to mention a clean read of of invalid hashes19:26
patchbothttps://review.openstack.org/#/c/426336/ - swift - Fix race when consolidating new partition19:26
claygnotmyname: I think patch 419787 is ready to go (and so does acoles_ and mahatic!)19:27
patchbothttps://review.openstack.org/#/c/419787/ - swift - Better optimistic lock in get_hashes19:27
notmynameclayg: cool. so why isnt' there a +A yet? :-)19:28
claygonovy: I'm so sorry - but can we beg PavelK for another review of patch 419787 ?19:29
patchbothttps://review.openstack.org/#/c/419787/ - swift - Better optimistic lock in get_hashes19:29
claygnotmyname: it's just like one of those things where it'd be nice for some other maintainers to understand the change before it lands - like especially the UpgradeImpact w.r.t. rollback19:30
notmynameclayg: ok. let's highlight it in the meeting today19:32
notmynameclayg: and then land it asap19:32
*** mvk has joined #openstack-swift19:34
*** dmorita has quit IRC19:36
*** dmorita has joined #openstack-swift19:37
*** dmorita has quit IRC19:38
*** dmorita has joined #openstack-swift19:38
*** ChubYann has joined #openstack-swift19:45
*** dmorita has quit IRC19:48
*** dmorita has joined #openstack-swift19:49
*** dmorita has quit IRC19:50
*** dmorita has joined #openstack-swift19:50
*** silor has quit IRC19:52
*** dmorita has quit IRC19:57
*** dmorita has joined #openstack-swift20:01
claygkota_: git review -d 219165 (it's happening!!!!!!)20:02
*** charz_ has quit IRC20:09
*** charz has joined #openstack-swift20:10
claygI'm merging patch 326967 after the meeting20:16
patchbothttps://review.openstack.org/#/c/326967/ - swift - Rebalance with min_part_seconds_left > 020:16
claygI hate that bug and I want this patch20:16
claygI'll say it again in the meeting but by then you missed your chance to review it20:16
*** jamielennox|away is now known as jamielennox20:30
zaitcevThe Meeting.20:38
*** JimCheung has quit IRC20:38
claygzaitcev: notmyname and I were discussing it just this morning - Wednesday is the best day of the week120:39
zaitcevI primed my wife to remind me20:40
zaitcevGonna make it this time20:40
openstackgerritPete Zaitcev proposed openstack/swift: WIP PUT+POST and its development test  https://review.openstack.org/42791120:42
*** NM has quit IRC20:52
*** JimCheung has joined #openstack-swift20:53
*** joeljwright has joined #openstack-swift20:55
*** ChanServ sets mode: +v joeljwright20:55
kota_morning20:57
timburkegood morning kota_!20:57
kota_good morning timburke20:57
*** JimCheung has quit IRC20:58
joeljwrightugh, timezones: morning kota_, afternoon timburke, evening acoles...20:58
notmyname:-)20:59
notmynamemeeting time in #openstack-meeting20:59
*** m_kazuhiro has joined #openstack-swift20:59
timburkejust go land https://review.openstack.org/#/c/331369/ -- then it'll be good evening regardless20:59
patchbotpatch 331369 - swift - Always set swift processes to use UTC20:59
kota_evening joeljwright ;-)20:59
joeljwrighttimburke: yes! a sensible time policy!21:00
*** gmmaha has quit IRC21:10
*** JimCheung has joined #openstack-swift21:11
*** oshritf has joined #openstack-swift21:34
*** Jeffrey4l_ has quit IRC21:35
*** Jeffrey4l_ has joined #openstack-swift21:36
*** catintheroof has quit IRC21:37
*** catintheroof has joined #openstack-swift21:37
*** oshritf has quit IRC21:38
*** gmmaha has joined #openstack-swift21:50
*** catintheroof has quit IRC21:57
*** catintheroof has joined #openstack-swift21:58
*** _JZ_ has quit IRC21:58
tdasilvaclayg: the issue is that's not ready for review yet, i guess it should be marked as WIP22:01
tdasilvait is missing the EC part22:01
tdasilvaunless we are ok with only a partial fix22:01
claygkota_: for doc changes that I'd like to see - do you want me to push over offer diffs in gists or follow up to squash?22:01
tdasilvaclayg: just to be clear, you are talking about this patch: https://review.openstack.org/#/c/371150/ right?22:02
patchbotpatch 371150 - swift - Return 404 on a GET if tombstone is newer22:02
timburketdasilva: yeah, 99% certain he is22:02
claygtdasilva: yeah that's the bug22:02
kota_clayg: either is fine if i can catch up the diff, thanks for caring the docs22:02
claygkota_: I'll probably go with follow patch then - I think it's the easist way to see everything makes comments possibly iterate and then get them all in22:04
*** vint_bra has quit IRC22:05
kota_clayg: ok22:05
claygcschwede: I think they just wanted to see if I'd do it - patch 32696722:05
patchbothttps://review.openstack.org/#/c/326967/ - swift - Rebalance with min_part_seconds_left > 022:05
claygtdasilva: have you been following along with patch 419787?22:06
patchbothttps://review.openstack.org/#/c/419787/ - swift - Better optimistic lock in get_hashes22:06
cschwedeclayg: hah, cool - thx for merging!22:07
claygcschwede: next time you're on the clock - I feel like you have half of patch 419787 loaded in your head might be good to refresh some of the updates22:07
patchbothttps://review.openstack.org/#/c/419787/ - swift - Better optimistic lock in get_hashes22:07
cschwedeclayg: yes, i have that on my plate for tomorrow morning (ie in a few hours)22:07
cschwedemeanwhile i'll have a look if i can keep Tim busy with a new partpower patchset tonight ;)22:08
*** joeljwright has quit IRC22:12
*** joeljwright has joined #openstack-swift22:14
*** ChanServ sets mode: +v joeljwright22:14
claygkota_: patch 425493 follows up on the disk shuffle reconstrcutor patch - since you may have some ec rebalace issues loaded in your head would you like to look at at it?22:23
patchbothttps://review.openstack.org/#/c/425493/ - swift - Make the reconstructor handoffs_first work (and us...22:23
claygkota_: timburke is +2 and I think torgomatic was mostly happy as well - if you want to look at it before merge try to let me know!22:23
*** catintheroof has quit IRC22:35
*** m_kazuhiro has quit IRC22:36
*** sams-gleb has quit IRC22:43
*** sams-gleb has joined #openstack-swift22:48
*** sams-gleb has quit IRC22:50
*** dmorita has quit IRC22:55
*** sams-gleb has joined #openstack-swift23:00
*** sams-gleb has quit IRC23:04
kota_clayg: sure, i added it to my task today.23:06
*** joeljwright has quit IRC23:07
*** dmorita has joined #openstack-swift23:09
*** dmorita has quit IRC23:12
*** NM has joined #openstack-swift23:14
*** dmorita has joined #openstack-swift23:14
openstackgerritChristian Schwede proposed openstack/swift: Add support to increase object ring partition power  https://review.openstack.org/33729723:20
timburkeyay!23:20
cschwedetimburke: thx for reviewing this! I didn't answer all comments from you in patchset 24 yet, will do that tomorrow morning - with a coffee on my desk23:22
cschwedegood progress so far, i think you catched quite a few important things23:23
*** furlongm has quit IRC23:24
*** furlongm has joined #openstack-swift23:25
*** codewrecks has joined #openstack-swift23:32
*** chsc has quit IRC23:34
*** kei_yama has joined #openstack-swift23:36
*** codewrecks has quit IRC23:37
*** klamath has quit IRC23:39
*** NM has quit IRC23:43
timburkecschwede: fwiw, i'm partial toward having the checks in the ring_builder proper, rather than just cli. i don't want anyone who's written tooling against it to get themselves into trouble -- if they *really want* to get themselves into trouble, they can just go poke at the internals themselves23:49
timburkedon't know that it'd be a blocker, though23:49
zaitcevI didn't think enough of the tooling. I insisted on having the current status displayed, so as to help an admin not to e.g. run rebalance in the middle, but that was about it.23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!