Tuesday, 2017-06-06

claygclarkb: was that run with the mod_deflate installed?  I think timburke only assumed that would effect the response of the request in testBadHeaders that did the transfer-encoding: gzip, chunked00:00
*** jistr has quit IRC00:01
clarkbclayg: yes I think that was with mod_deflate installed, I will double check though00:01
clarkb(the intent certainly was to have mod_deflate enabled000:01
clarkbhttp://logs.openstack.org/74/372374/32/check/gate-swift-dsvm-functional-ubuntu-xenial-nv/9289a40/logs/devstacklog.txt.gz#_2017-06-05_23_17_17_70300:01
clarkbso it is enabled00:01
*** jistr has joined #openstack-swift00:02
timburke...huh. i have no idea what to make of that then00:02
claygso i only got as far as adding debugging to eventlet.wsgi to prove to myself that the request wasn't making it's way from apache to swift, I also removed the timeout in the test and validated that apache *does* respond with a 400 looking response *eventually*00:18
claygthe tls-proxy logs say something about [Tue Jun 06 00:19:17.974536 2017] [proxy_http:error] [pid 6028:tid 140625710065408] (70007)The timeout specified has expired: [client 192.168.8.8:40790] [frontend 192.168.8.8:8080] AH02609: read request body failed to 192.168.8.8:8081 (192.168.8.8) from 192.168.8.8 ()00:19
claygwhich makes sense to me - the test is doing a PUT with a content-length of XXXXHUGEXXX then not sending any bytes and waiting on a response - which is sorta bs?00:20
claygbut it's expecting swift to read the headers and immediately respond with "GTFO"00:20
clayginstead apache waits (how long?  why?) then returns some 400 about - umm... look if you're not going to send anything *YOU* GTFO00:20
claygI found https://httpd.apache.org/docs/2.4/mod/mod_proxy.html and tried sending 9000K in data to like - idk... cause some sort of flush?00:21
claygbut it hasn't made a difference yet00:21
clayggotta sign off for now - that's how far I got00:22
clarkbinteresting, thanks for looking into that00:22
timburkei wonder if there's any way we could convince apache to send a 100-continue expectation even if the client didn't...00:22
*** lucasxu has joined #openstack-swift00:22
claygsorry , on the apache i was trying to link to ProxyIOBufferSize Directive00:23
claygeither way I don't know the answer and i'm quitting out00:23
clayggood luck - or i'll pick it up tomorrow00:24
claygg'night00:24
*** klamath has quit IRC00:44
*** lucasxu has quit IRC00:45
*** lucasxu has joined #openstack-swift00:46
*** zhengyin has joined #openstack-swift00:51
openstackgerritTim Burke proposed openstack/swift master: sharding: Test and refactor for _misplaced_objects  https://review.openstack.org/45189600:58
*** lucasxu has quit IRC00:58
*** lucasxu has joined #openstack-swift00:59
*** ukaynar has joined #openstack-swift00:59
*** lucasxu has quit IRC01:00
*** lucasxu has joined #openstack-swift01:01
*** tovin07_ has joined #openstack-swift01:07
*** klrmn has quit IRC01:08
*** catintheroof has quit IRC01:10
mattoliverautimburke: re: Apache. at first I thought maybe you can use mod_rewrite to add/modify headers, but looks like there is a mod_headers that does this thing... So it could be possible to add an expect 100. Don't know if a client would have issues but at least inserting is possible.01:12
mattoliverauAlso, cool another sharding patch.. will try and find some time to look at it.01:13
timburkeeh, just a rebase of a pre-existing one. not *so* exciting, i'm afraid...01:13
timburkere mod_headers: interesting... though really, i'd be more interested in controlling how apache behaves as a hop-by-hop client than just wanting to inject arbitrary headers01:15
*** jamielennox is now known as jamielennox|away01:17
kota_good morning01:18
mattoliveraukota_: morning01:18
kota_mattoliverau: o/01:18
* mattoliverau is great at drive by comments while taking the family out... Your welcome :p01:19
kota_:p01:20
*** neonpastor has joined #openstack-swift01:21
*** jamielennox|away is now known as jamielennox01:34
*** lucasxu has quit IRC01:34
* kota_ is scrolling back to the irc log that looks a lot of conversations01:39
*** mingyu has joined #openstack-swift01:45
*** zhengyin has quit IRC01:51
*** aselius has quit IRC01:56
*** klrmn has joined #openstack-swift02:11
*** bkopilov has quit IRC02:14
*** mdrabe has quit IRC02:15
*** mingyu has quit IRC02:15
*** mingyu has joined #openstack-swift02:18
*** links has joined #openstack-swift02:27
*** links has quit IRC02:30
*** links has joined #openstack-swift02:30
*** zhengyin has joined #openstack-swift02:36
*** mat128 has quit IRC02:56
*** winggundamth has joined #openstack-swift03:05
*** zhurong has joined #openstack-swift03:28
*** klrmn has quit IRC03:39
*** kei_yama has quit IRC03:41
*** ukaynar has quit IRC03:48
*** ukaynar has joined #openstack-swift03:48
*** klrmn has joined #openstack-swift03:50
*** ukaynar has quit IRC03:53
*** kei_yama has joined #openstack-swift04:01
*** psachin has joined #openstack-swift04:06
*** mingyu has quit IRC04:16
*** zhurong has quit IRC04:27
*** kei_yama has quit IRC04:37
*** mingyu has joined #openstack-swift04:39
zaitcevI just had to look it up, who approved peeking into df._ondisk_info ... https://review.openstack.org/29317704:43
patchbotpatch 293177 - swift - Auditor will clean up stale rsync tempfiles (MERGED)04:43
zaitcevThat underscore is supposed to tell you not to do this.04:43
*** mingyu has quit IRC04:46
*** zhurong has joined #openstack-swift04:54
*** zhengyin has quit IRC05:03
*** zhengyin has joined #openstack-swift05:06
*** kei_yama has joined #openstack-swift05:10
*** gyee has quit IRC05:12
*** mingyu has joined #openstack-swift05:26
*** mingyu has quit IRC05:34
*** mingyu has joined #openstack-swift05:35
*** mingyu has quit IRC05:40
*** mingyu has joined #openstack-swift05:41
openstackgerritMerged openstack/swift master: Remove deprecated vm_test_mode option  https://review.openstack.org/46809905:42
*** jaosorior_away is now known as jaosorior05:44
*** cshastri has joined #openstack-swift05:46
*** mingyu_ has joined #openstack-swift05:46
*** mingyu has quit IRC05:46
*** mingyu_ has quit IRC05:47
*** mingyu has joined #openstack-swift05:48
*** zhengyin has quit IRC05:48
*** zhengyin has joined #openstack-swift05:49
*** mingyu has quit IRC05:53
*** mingyu has joined #openstack-swift06:07
*** rcernin has joined #openstack-swift06:10
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873606:13
*** ChubYann has quit IRC06:15
*** bkopilov has joined #openstack-swift06:22
*** skudlik has joined #openstack-swift06:24
*** itlinux_ has joined #openstack-swift06:29
*** zhurong has quit IRC06:32
*** zhurong has joined #openstack-swift06:39
*** pcaruana has joined #openstack-swift06:39
*** jaosorior is now known as jaosorior_away06:41
*** adriant has quit IRC06:42
*** hseipp has joined #openstack-swift06:43
*** zhengyin has quit IRC06:46
*** zhengyin has joined #openstack-swift06:48
*** stradling has quit IRC06:49
*** itlinux_ has quit IRC06:51
*** stradling has joined #openstack-swift06:52
*** cbartz has joined #openstack-swift07:07
*** tesseract has joined #openstack-swift07:13
*** mingyu has quit IRC07:17
*** klrmn has quit IRC07:29
*** mingyu has joined #openstack-swift07:38
*** mwheckmann has quit IRC07:49
*** mwheckmann has joined #openstack-swift07:50
*** geaaru has joined #openstack-swift07:54
*** links has quit IRC08:02
acolesgood morning08:16
*** links has joined #openstack-swift08:18
*** mvk has quit IRC08:22
*** cshastri has quit IRC08:30
*** cshastri has joined #openstack-swift08:34
*** zhurong has quit IRC08:35
*** mwheckmann has quit IRC08:35
*** cshastri has quit IRC08:35
*** mwheckmann has joined #openstack-swift08:36
*** oshritf has joined #openstack-swift08:36
*** cshastri has joined #openstack-swift08:36
*** zhurong has joined #openstack-swift08:41
openstackgerritMerged openstack/pyeclib master: add six to test-requirements  https://review.openstack.org/46812508:47
*** mingyu has quit IRC08:48
*** hoonetorg has quit IRC08:51
*** mvk has joined #openstack-swift08:52
*** jaosorior_away is now known as jaosorior08:53
openstackgerritChristopher Bartz proposed openstack/swift master: Exclude containers for account quota  https://review.openstack.org/41423209:04
*** jaosorior has quit IRC09:04
*** hoonetorg has joined #openstack-swift09:08
*** mingyu has joined #openstack-swift09:13
*** links has quit IRC09:25
*** zhurong has quit IRC09:33
acolestimburke: thanks for rebasing patch 45189609:37
patchbothttps://review.openstack.org/#/c/451896/ - swift - sharding: Test and refactor for _misplaced_objects09:37
*** Dw_Sn has joined #openstack-swift09:37
acolestimburke: mattoliverau ^^ maybe that can be squashed into parent?09:37
Dw_SnI know I did ask this question before, with AWS/S3 signed URL there is something called in the URL AWSAccessID= , is that supported in swift/s3 ?09:40
Dw_Snany doc. where I can see all AWS / S3 translation ?09:41
*** links has joined #openstack-swift09:42
openstackgerritTovin Seven proposed openstack/swift master: OSprofiler in OpenStack Swift  https://review.openstack.org/46831609:45
*** mvk has quit IRC09:53
*** mvk has joined #openstack-swift09:58
*** jamielennox is now known as jamielennox|away10:10
*** tovin07_ has quit IRC10:11
*** jamielennox|away is now known as jamielennox10:16
*** zhengyin has quit IRC10:55
*** bkopilov has quit IRC11:01
*** mingyu has quit IRC11:13
*** zhurong has joined #openstack-swift11:31
*** mat128 has joined #openstack-swift11:36
*** mingyu has joined #openstack-swift11:48
*** rcernin has quit IRC11:52
*** pcaruana has quit IRC11:53
*** jaosorior has joined #openstack-swift11:56
*** mingyu has quit IRC11:56
*** rcernin has joined #openstack-swift12:07
*** oshritf has quit IRC12:09
*** pcaruana has joined #openstack-swift12:09
*** zhurong has quit IRC12:12
*** winggundamth has quit IRC12:21
*** MVenesio has joined #openstack-swift12:27
*** mingyu has joined #openstack-swift12:39
*** oshritf has joined #openstack-swift12:42
*** catintheroof has joined #openstack-swift12:42
*** kei_yama has quit IRC12:50
*** baffle_ is now known as baffle12:54
*** links has quit IRC12:56
*** mdrabe has joined #openstack-swift13:02
*** lucasxu has joined #openstack-swift13:05
*** silor has joined #openstack-swift13:09
*** klamath has joined #openstack-swift13:15
*** klamath has quit IRC13:15
*** klamath has joined #openstack-swift13:16
*** Dw_Sn has quit IRC13:19
*** Dw_Sn has joined #openstack-swift13:21
*** Dw_Sn is now known as Guest2668913:21
*** pcaruana has quit IRC13:34
*** rcernin has quit IRC13:36
*** vint_bra has joined #openstack-swift13:37
*** psachin has quit IRC13:41
*** Guest26689 is now known as Dw_Sn13:41
*** Dw_Sn has quit IRC13:42
*** Dw_Sn has joined #openstack-swift13:42
*** mingyu has quit IRC13:48
*** rcernin has joined #openstack-swift13:49
*** pcaruana has joined #openstack-swift13:51
*** itlinux_ has joined #openstack-swift13:53
*** mingyu has joined #openstack-swift13:54
*** psachin has joined #openstack-swift13:55
*** pcaruana has quit IRC13:59
*** pcaruana has joined #openstack-swift14:00
*** mat128 has quit IRC14:04
*** rcernin has quit IRC14:04
*** rcernin has joined #openstack-swift14:05
*** rcernin has quit IRC14:07
*** rcernin has joined #openstack-swift14:07
*** mdrabe has quit IRC14:11
*** mdrabe has joined #openstack-swift14:12
*** links has joined #openstack-swift14:12
*** mat128 has joined #openstack-swift14:17
*** links has quit IRC14:17
*** MVenesio has quit IRC14:25
*** mdrabe has quit IRC14:47
*** skudlik has quit IRC14:49
*** itlinux_ has quit IRC14:50
*** cshastri has quit IRC14:51
*** psachin has quit IRC14:54
*** rcernin has quit IRC14:54
*** mdrabe has joined #openstack-swift15:13
*** aselius has joined #openstack-swift15:15
notmynamegood morning15:29
*** chlong has joined #openstack-swift15:29
*** tovin07 has joined #openstack-swift15:39
*** cbartz has quit IRC15:41
zhongjunGood night:)15:45
*** jaosorior is now known as jaosorior_away15:47
*** gyee has joined #openstack-swift15:58
*** mvk has quit IRC15:58
*** Dw_Sn has quit IRC16:05
*** tovin07 has quit IRC16:06
*** Renich has joined #openstack-swift16:08
timburkegood morning16:14
*** hseipp has quit IRC16:14
notmynameFYI clarkb has been working on a change that affects swift func tests in the gate. the goal is to make them a *lot* faster (by removing all the setup for projects that aren't tested) https://review.openstack.org/#/c/470421/16:18
patchbotpatch 470421 - openstack-infra/project-config - Only run swift and keystone in swift func jobs16:18
clarkbso uh let me know if your functional job stops working today :)16:18
clarkb(I tested it so it should be fine)16:18
mahaticnotmyname: timburke good morning16:20
notmynamemahatic: oh hi!16:20
mahatichello16:22
* mahatic is lurking on irc before signing off16:22
*** jamielennox is now known as jamielennox|away16:26
*** tesseract has quit IRC16:32
*** pcaruana has quit IRC16:34
*** Renich has quit IRC16:42
*** itlinux_ has joined #openstack-swift16:43
*** Renich has joined #openstack-swift16:43
acolesclarkb: thanks! that's great16:49
zaitcevSurely someone in addition to Tim can review +6,-9 patchlet in C? https://review.openstack.org/46741816:51
patchbotpatch 467418 - liberasurecode - Stop using ceill() to compute padded data size16:51
timburkezaitcev: i tried to goad tdasilva into looking at it, but i'm tempted to just go ahead and +A. originally i thought it might be worth having someone else think about the removal of the math library, though16:54
*** hseipp has joined #openstack-swift16:59
*** oshritf has quit IRC17:04
*** jamielennox|away is now known as jamielennox17:05
notmynamerledisez: I haven't seen anything on the mailing list about LOSF memory usage or anything else. is there something I missed (totally possible)? or is there something I can help with?17:07
*** neonpastor has quit IRC17:08
notmynamealso to jeff, but he's not in IRC right now17:08
tdasilvaclarkb: sounds great, thanks!17:08
*** jlvillal is now known as jlvacation17:10
*** lucasxu has quit IRC17:11
*** hseipp has quit IRC17:12
tdasilvatimburke, zaitcev, looking17:13
*** Renich has quit IRC17:15
*** mingyu has quit IRC17:16
*** Renich has joined #openstack-swift17:20
*** mingyu has joined #openstack-swift17:22
*** mingyu has quit IRC17:27
*** mingyu has joined #openstack-swift17:30
*** itlinux_ has quit IRC17:36
*** itlinux_ has joined #openstack-swift17:37
*** skudlik has joined #openstack-swift17:40
*** mingyu has quit IRC17:41
*** mingyu has joined #openstack-swift17:42
*** mingyu has quit IRC17:46
*** klrmn has joined #openstack-swift17:49
notmynamedo we have any docs on setting up a replicated ec policy in the SAIO?17:57
*** lucasxu has joined #openstack-swift17:59
claygummm... duplicated?18:04
notmynameyeah :-)18:05
claygnot really - you need the ring zipper cli patch - it's not landed yet18:05
notmynameack18:05
*** tonanhngo has joined #openstack-swift18:08
*** itlinux_ has quit IRC18:16
*** itlinux has joined #openstack-swift18:22
notmynamekota_: will you have a chance to look at https://review.openstack.org/#/c/439572/ any time soon?18:23
patchbotpatch 439572 - swift - Limit number of revert tombstone SSYNC requests18:23
*** geaaru has quit IRC18:33
*** itlinux has quit IRC18:42
openstackgerritThiago da Silva proposed openstack/liberasurecode master: Stop using ceill() to compute padded data size  https://review.openstack.org/46741818:43
openstackgerritThiago da Silva proposed openstack/liberasurecode master: Stop using ceill() to compute padded data size  https://review.openstack.org/46741818:53
notmynameI just pushed a massive update to https://wiki.openstack.org/wiki/Meetings/Swift18:54
notmynameit is a slightly different layout now that we have 2 meetings18:54
notmynameand I noted a bunch of the priority stuff and high priority bugs18:54
notmynameseems unlikely we'll get through it all in tomorrow's meeting, so I think much of it will be moved to the priority reviews wiki page18:55
notmynameacoles: after tomorrow's meeting, let's start discussing what needs to go on the 0700 agenda for the jun 14 meeting18:56
*** pcaruana has joined #openstack-swift18:56
* notmyname steps away for lunch18:56
tdasilvatimburke, zaitcev maybe we can merge patch 467418 now and then the rel 1.5 patch ?18:57
patchbothttps://review.openstack.org/#/c/467418/ - liberasurecode - Stop using ceill() to compute padded data size18:57
timburketdasilva: any thoughts on the other patches i'd mentioned? i'd really kinda like to land https://review.openstack.org/#/c/459023/ to clear that particular landmine18:59
patchbotpatch 459023 - liberasurecode - Consistently use zlib for crc3218:59
timburke...but it's also a little dangerous. i really wish i *knew* whether anyone was actually negatively affected by bug 166632019:01
openstackbug 1666320 in liberasurecode "crc32 implementation is schizophrenic" [Undecided,New] https://launchpad.net/bugs/166632019:01
openstackgerritMerged openstack/liberasurecode master: Stop using ceill() to compute padded data size  https://review.openstack.org/46741819:17
*** pcaruana has quit IRC19:33
*** mdrabe has quit IRC19:46
*** silor has quit IRC19:48
tdasilvatimburke: honestly, i was more leaning towards moving ahead with the release before merging those other items19:50
claygso this trick about doing the fork before the daemon starts to avoid all the eventlet/tpool non-sense; is working surprisingly well20:03
*** thurloat has quit IRC20:08
*** thurloat has joined #openstack-swift20:09
claygrledisez: can you double check what you tune the 'concurrency' option to in the reconstructor's config for each individual devices reconstructor process?20:11
*** jamielennox has quit IRC20:34
*** jamielennox has joined #openstack-swift20:38
openstackgerritMerged openstack/pyeclib master: Simplify required-method check  https://review.openstack.org/46192820:53
openstackgerritMerged openstack/pyeclib master: Change the version reference  https://review.openstack.org/40592921:05
*** lucasxu has quit IRC21:11
*** Renich has quit IRC21:25
*** mat128 has quit IRC21:26
*** itlinux has joined #openstack-swift21:48
*** itlinux has quit IRC21:56
*** skudlik has quit IRC22:19
*** mat128 has joined #openstack-swift22:29
*** catintheroof has quit IRC22:41
*** klamath has quit IRC23:01
*** tonanhngo has quit IRC23:05
*** tonanhngo has joined #openstack-swift23:12
*** tonanhngo has quit IRC23:16
*** kei_yama has joined #openstack-swift23:26

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!