Tuesday, 2017-12-12

*** timburke_ has quit IRC00:00
*** JimCheung has joined #openstack-swift00:01
*** MeltedLux has joined #openstack-swift00:02
*** timburke has joined #openstack-swift00:02
*** ChanServ sets mode: +v timburke00:02
*** tdasilva has joined #openstack-swift00:05
*** DuncanT has joined #openstack-swift00:10
*** portdirect has joined #openstack-swift00:29
*** tovin07_ has joined #openstack-swift00:45
*** SkyRocknRoll has quit IRC00:50
*** gyee has quit IRC00:57
*** SkyRocknRoll has joined #openstack-swift01:03
*** SkyRocknRoll has joined #openstack-swift01:03
kota_good morning01:10
kota_oh, it looks like acoles has joined back to symlink reviews, very nice.01:12
kota_clayg: thanks for doing that checking symlink + vw behavior. if you find something buggy, please let me know anytime.01:13
kota_timburke: yeah, as you know, we have the chance that we can give initiated connection with allow_redirects=False so that I agree with you it's not hurry for now.01:16
*** SkyRocknRoll has quit IRC01:16
kota_that is another thing though, it may be worth to add new command when symlink land, that is like `swift ln` or `swift link` to make the symlink01:19
kota_with current swift-client, we should make an empty file in the local and then call `swift upload container link -H "container/obj"`. Even the local empty content object is just a garbage.01:21
*** cshastri has joined #openstack-swift01:30
*** MeltedLux has quit IRC01:37
*** m_kazuhiro has joined #openstack-swift01:37
*** MeltedLux has joined #openstack-swift01:37
m_kazuhirogood morning01:38
*** SkyRocknRoll has joined #openstack-swift01:42
*** two_tired has joined #openstack-swift01:49
kota_m_kazuhiro: morning01:54
kota_it looks like acoles is already back to England?01:55
*** JimCheung has quit IRC02:07
m_kazuhirokota_: morning02:22
kota_m_kazuhiro: how's going on symlink? I think, some reviewers have follow ups (me, clayg, and acoles).02:26
kota_m_kazuhiro: do you like those changes? if you have time to look at them and call me, I can work to squash and resolve merge conflicts in the main patch.02:31
m_kazuhirokota_: I will check the follow ups today. At my light reading them, the follow ups looks great. If you can work for symlink, it will be very helpful for me.02:32
kota_m_kazuhiro: ok, anytime let me know if you need my help02:33
m_kazuhirokota_: Thank you very much.02:34
*** JimCheung has joined #openstack-swift02:38
*** JimCheung has quit IRC02:42
*** JimCheung has joined #openstack-swift02:59
*** armaan has quit IRC03:02
*** armaan has joined #openstack-swift03:02
*** JimCheung has quit IRC03:03
*** ianychoi has joined #openstack-swift03:08
*** bkopilov has quit IRC03:10
*** JimCheung has joined #openstack-swift03:31
*** JimCheung has quit IRC03:35
*** kei_yama has quit IRC03:37
*** JimCheung has joined #openstack-swift03:45
*** JimCheung has quit IRC03:53
openstackgerritMatthew Oliver proposed openstack/swift master: Unlink Asyncs older then reclaim_age  https://review.openstack.org/52729603:57
*** JimCheung has joined #openstack-swift04:00
*** kei_yama has joined #openstack-swift04:01
*** JimCheung has quit IRC04:04
*** JimCheung has joined #openstack-swift04:19
*** JimCheung has quit IRC04:23
*** SkyRocknRoll has quit IRC04:29
*** bkopilov has joined #openstack-swift04:33
*** m_kazuhiro_ has joined #openstack-swift04:36
*** m_kazuhiro has quit IRC04:40
m_kazuhiro_kota_: I have finished checking details of symlink's following patches (https://review.openstack.org/#/c/526564 https://review.openstack.org/#/c/526615 https://review.openstack.org/#/c/526985 https://review.openstack.org/#/c/527126 ). I feel these patches are great and should be squashed into symlink's main implementation patch.05:14
patchbotpatch 526564 - swift - Do not leak symlinks to proxy & obj layer05:14
patchbotpatch 526615 - swift - Testing Implementation to divide symlink headers05:14
patchbotpatch 526985 - swift - SYMLINK: symlink path and account can be in separe...05:14
patchbotpatch 527126 - swift - Use symlink in container-sync internal client pipe...05:14
*** two_tired has quit IRC05:32
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Symlink implementation.  https://review.openstack.org/23216205:38
kota_m_kazuhiro: done to squash. I will work around rebase acoles follow up to clarify what's changed from the squashed patch.05:39
*** robcresswell has quit IRC05:39
*** fungi has quit IRC05:45
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Use symlink in container-sync internal client pipeline  https://review.openstack.org/52712605:46
*** fungi has joined #openstack-swift05:48
openstackgerritMatthew Oliver proposed openstack/swift master: Add a -L or --list to recon to list all results  https://review.openstack.org/52503905:56
m_kazuhiro_kota_: Thank you!06:08
*** SkyRocknRoll has joined #openstack-swift06:32
*** bkopilov has quit IRC07:09
*** rcernin has quit IRC07:21
*** bkopilov has joined #openstack-swift07:26
*** armaan has quit IRC07:33
*** armaan has joined #openstack-swift07:34
*** robcresswell has joined #openstack-swift07:39
*** m_kazuhiro_ has quit IRC07:39
*** hseipp has joined #openstack-swift07:41
*** m_kazuhiro has joined #openstack-swift07:47
*** d0ugal has quit IRC07:51
*** d0ugal has joined #openstack-swift07:57
*** neonpastor has quit IRC08:00
*** neonpastor has joined #openstack-swift08:02
*** armaan has quit IRC08:03
*** hoonetorg has quit IRC08:06
*** gkadam has joined #openstack-swift08:07
*** hoonetorg has joined #openstack-swift08:19
*** tesseract has joined #openstack-swift08:22
*** armaan has joined #openstack-swift08:23
*** armaan has quit IRC08:32
*** armaan has joined #openstack-swift08:32
*** rcernin has joined #openstack-swift08:36
-openstackstatus- NOTICE: Our CI system Zuul is currently not accessible. Wait with approving changes and rechecks until it's back online. Currently waiting for an admin to investigate.08:49
*** linkmark has joined #openstack-swift08:51
*** m_kazuhiro has quit IRC08:58
*** cbartz has joined #openstack-swift09:06
-openstackstatus- NOTICE: Zuul is back online, looks like a temporary network problem.09:09
*** jappleii__ has quit IRC09:10
*** hseipp has quit IRC09:22
*** armaan has quit IRC09:24
*** armaan has joined #openstack-swift09:25
*** mvk has quit IRC09:25
*** hseipp has joined #openstack-swift09:35
*** mvk has joined #openstack-swift09:51
*** kei_yama has quit IRC09:53
*** tovin07_ has quit IRC10:11
*** armaan has quit IRC10:29
*** armaan has joined #openstack-swift10:30
*** cshastri has quit IRC10:50
acoleskota_: yes I am back home11:20
acolesthanks for the rebasing11:20
acolesmattoliverau: thanks for exploring the test failure on patch 525192 - sounds like it is ok to recheck and try to merge it?11:24
patchbothttps://review.openstack.org/#/c/525192/ - swift - Ringbuilder: Forbid writing empty rings11:24
mattoliverauacoles: well I can confirm it happens on master.. though it seems less often. At least on my saio. But yeah, it didn't cause it. but might be an indication of where the problem lies.11:28
tdasilvammm..symlink gate jobs failed on func tests11:28
mattoliverauI haven't had enough time to look closey.. just noticed it, so ran it repeatily. I hope to take a closer look when I get a chance tomorrow.11:29
mattoliverauanyway, I'm off to bed now. night o/11:29
tdasilvamattoliverau: night11:32
acolesmattoliverau: ok. g'night11:32
tdasilvai'm going to try running now on my env11:32
*** mvk has quit IRC11:42
*** mvk has joined #openstack-swift11:55
acolestdasilva: func tests pass on my saio12:05
tdasilvatdasilva: yeah, mine too12:05
acolesand the zuul jobs, it is the community cluster jobs that failed12:05
tdasilvaacoles: maybe the problem is with third-party cluster12:05
tdasilvayeah12:06
kota_tdasilva: it seems just a zuul matter so i think we are able to recheck12:10
tdasilvakota_: yeah, i was waiting for the ci infra jobs to finish12:12
kota_I noticed zuul had a trouble in this evening12:12
kota_tdasilva: :)12:12
*** cshastri has joined #openstack-swift12:25
*** armaan has quit IRC12:59
*** zhurong has joined #openstack-swift12:59
*** SkyRocknRoll has quit IRC13:10
*** zhurong has quit IRC13:14
*** armaan has joined #openstack-swift13:15
*** cshastri has quit IRC13:32
*** hseipp has quit IRC13:45
*** hseipp has joined #openstack-swift13:55
openstackgerritThiago da Silva proposed openstack/swift master: environment variable to set swift_dir  https://review.openstack.org/52740513:57
*** tesseract has quit IRC14:26
-openstackstatus- NOTICE: We're currently seeing an elevated rate of timeouts in jobs and the zuulv3.openstack.org dashboard is intermittently unresponsive, please stand by while we troubleshoot the issues.14:40
*** bkopilov has quit IRC14:48
*** rcernin has quit IRC15:00
*** armaan has quit IRC15:01
*** armaan has joined #openstack-swift15:03
*** armaan_ has joined #openstack-swift15:10
*** armaan has quit IRC15:10
*** cshastri has joined #openstack-swift15:10
tdasilvahseipp: this reminded me of you: https://developer.ibm.com/code/events/jumpstart-your-iot-implementation/15:50
tdasilvahseipp: I thought you would be presenting :)15:50
*** armaan_ has quit IRC16:12
*** cshastri has quit IRC16:13
*** gkadam has quit IRC16:29
*** armaan has joined #openstack-swift16:37
*** gyee has joined #openstack-swift16:50
notmynamegood morning16:59
*** bkopilov has joined #openstack-swift17:09
*** cbartz has quit IRC17:12
*** JimCheung has joined #openstack-swift17:24
*** hseipp has quit IRC17:24
*** mvk has quit IRC17:27
openstackgerritAlistair Coles proposed openstack/swift master: Symlink doc clean up  https://review.openstack.org/52747517:32
timburkegit st17:35
timburkei mean, "good morning!"17:35
acolestimburke: you are on branch #openstack-swift17:35
notmynamenothing to commit, working tree clean17:35
timburkebut what are my ahead/behind counts??17:35
acolesyour are way ahead17:36
timburkeyeah, seems pretty likely that i'll need to rebase... could get ugly17:36
notmynameI'm looking at joel's data segment patch17:36
notmynamehow's the symlink patch looking? anyone think it will land by tomorrow?17:37
acolesnotmyname: I've not found any reason it shouldn't, except for some discussion of patch 52712617:39
patchbothttps://review.openstack.org/#/c/527126/ - swift - Use symlink in container-sync internal client pipe...17:39
notmynameok, great17:40
openstackgerritAlistair Coles proposed openstack/swift master: Assert X-Newest and X-Backend headers are propagated to symlink target  https://review.openstack.org/52747717:40
acoles^^ these are trivial follow-ons17:40
notmynamesymlink in the pipeline seems like a good idea17:40
notmynameexplicit over implicit, and all that17:41
acolesnotmyname: I think so, but it comes down to not bleeding implementation detail - use the API query param rather than importing a helper function17:41
acolesmaybe others could weigh in with an opinion on p 52712617:42
patchbothttps://review.openstack.org/#/c/527126/ - swift - Use symlink in container-sync internal client pipe...17:42
acolesThe doc changes for symlink are good IMHO - even the new swift.source SYM  has been documented! good work whoever kota_ tdasilva m_kazuhiro17:53
acolesm_kazuhiro needs a bouncer or will miss all the fireworks when symlinks lands :)17:53
*** shaner has quit IRC17:54
*** shaner has joined #openstack-swift17:55
acolestdasilva: zuul has been flakey today, I can't get the dashboard to load, and the symlinks patch currently has a bunch of failed tests - maybe you could do another recheck at end of your day and hopefully it will be all green when kota_ wakes up?18:00
*** shaner has quit IRC18:01
*** shaner has joined #openstack-swift18:01
notmynamehow do I get a detailed coverage report these days? the one that shows the lines that aren't covered (instead of just the count of uncovered lines)?18:59
*** armaan has quit IRC18:59
*** armaan has joined #openstack-swift19:00
*** shaner has quit IRC19:02
*** armaan has quit IRC19:03
*** armaan has joined #openstack-swift19:04
*** shaner has joined #openstack-swift19:04
*** tonyb_ has quit IRC19:52
*** oshritf has joined #openstack-swift19:52
*** tonyb has joined #openstack-swift19:52
*** chsc has joined #openstack-swift20:07
*** chsc has quit IRC20:07
*** chsc has joined #openstack-swift20:07
*** mvk has joined #openstack-swift20:10
-openstackstatus- NOTICE: The zuul scheduler has been restarted after lengthy troubleshooting for a memory consumption issue; earlier changes have been reenqueued but if you notice jobs not running for a new or approved change you may want to leave a recheck comment or a new approval vote20:16
clarkbnotmyname: locally? iirc there is a comman you can run to produce an html report from exieting coverage data20:21
clarkb`coverage html` says the docs20:22
*** oshritf has quit IRC20:30
*** cschwede has quit IRC20:34
*** openstackgerrit has quit IRC20:34
*** notmyname has quit IRC20:34
*** cschwede has joined #openstack-swift20:34
*** ndk- has quit IRC20:34
*** armaan has quit IRC20:35
*** timss has quit IRC20:35
*** armaan has joined #openstack-swift20:35
*** amrith has quit IRC20:35
*** nikivi has quit IRC20:35
*** csmart has quit IRC20:36
claygtimburke: yeah PUT/X-Copy-From is definitely following the symlink and ignoring ?symlink=get (unlike COPY where the qs does seem to effect the GET request)20:36
*** JimCheung has quit IRC20:36
*** StevenK has quit IRC20:36
*** JimCheung has joined #openstack-swift20:37
claygI mean generally speaking it'd be an artifact of the COPY middleware to take the qs from the PUT and add it to the GET request it makes up?  is that reasonable?20:37
claygmaybe... depends on how PUT/X-Copy-From works on SLO manifests I guess..20:37
timburkecopy needs to know to throw in the format=raw -- https://github.com/openstack/swift/blob/2.16.0/swift/common/middleware/copy.py#L354-L35820:38
clayghrm... looks like there's special handling20:38
timburkeand translate the multipart-manifest=get to a multipart-manifest=put -- https://github.com/openstack/swift/blob/2.16.0/swift/common/middleware/copy.py#L441-L44920:39
*** nikivi has joined #openstack-swift20:39
*** ndk_ has joined #openstack-swift20:39
claygyeah, that's what i was just reading20:39
timburkebut it's relying on the client to ever have the multipart-manifest=get20:39
claygok I'll write it up as a failing functest and see what we wanna do20:40
claygyeah, copy middleware maybe should have similar handling for symlink=get i 'spse20:40
timburkeand the COPY handling ultimately punts to the PUT handling -- https://github.com/openstack/swift/blob/2.16.0/swift/common/middleware/copy.py#L34420:40
timburkeit seems bizarre to me that COPY should work but PUT doesn't20:40
*** timss has joined #openstack-swift20:40
*** notmyname has joined #openstack-swift20:41
*** ChanServ sets mode: +v notmyname20:41
*** csmart has joined #openstack-swift20:41
claygrly?  re-write the existing request as a PUT instead of creating a new one20:41
timburkewere you including the query param in the PUT url? or the x-copy-from header?20:41
claygI think that's how my COPY requests qs is keeping around20:41
claygthe PUT url20:42
timburkegood...20:42
clayg(can i add it in the *header* !??)20:42
timburkedon't think so20:42
*** amrith has joined #openstack-swift20:43
*** StevenK has joined #openstack-swift20:44
*** clarkb has quit IRC20:45
*** andymccr has quit IRC20:45
*** jistr has quit IRC20:45
*** jistr has joined #openstack-swift20:45
*** andymccr has joined #openstack-swift20:45
*** clarkb has joined #openstack-swift20:45
*** JimCheung has quit IRC20:47
*** JimCheung has joined #openstack-swift20:48
*** JimCheung has quit IRC20:53
*** JimCheung has joined #openstack-swift20:54
*** JimCheung has quit IRC21:03
*** linkmark has quit IRC21:20
claygtimburke: thanks for the help - i think i have an idea how it can be fixed - hopefully kota_ and m_kazuhiro will know what to do21:22
*** JimCheung has joined #openstack-swift21:23
*** jappleii__ has joined #openstack-swift21:23
*** jappleii__ has quit IRC21:24
*** jappleii__ has joined #openstack-swift21:25
*** jappleii__ has quit IRC21:26
*** jappleii__ has joined #openstack-swift21:27
timburkeclayg: on https://gist.github.com/clayg/95cc8f0ecdbec1ee2c85afa0f134507a -- i don't think setting `source_req.params['symlink'] = 'get'` will do what you think... it's not a proxy into env['QUERY_STRING'] (a la req.headers) -- you gotta do an explicit `source_req.params = ...` to trigger the magic in https://github.com/openstack/swift/blob/2.16.0/swift/common/swob.py#L882-L89721:27
*** jappleii__ has quit IRC21:27
*** jappleii__ has joined #openstack-swift21:28
timburke(i'm not really happy with that interface... but to make it more like the headers proxy would give the impression that setting params is like setting a dict... which it just *won't be*. QUERY_STRING is a bit of a horrible interface...)21:28
*** JimCheung has quit IRC21:30
*** JimCheung has joined #openstack-swift21:46
*** JimCheung has quit IRC21:50
*** rcernin has joined #openstack-swift21:58
*** joeljwright has joined #openstack-swift21:59
*** ChanServ sets mode: +v joeljwright21:59
joeljwrighttimburke: you around?22:00
timburkeyup22:00
joeljwrightI just say notmyname's review of the data segments in SLO patch22:01
joeljwrightit looks nice, was just wondering about the current state of the nested SLOs with data segments22:01
timburkeshould be fine -- i added a func test to cover it in https://review.openstack.org/#/c/365371/37..39/test/functional/test_slo.py22:02
patchbotpatch 365371 - swift - Add support for data segments to SLO and Segmented...22:02
timburke(in previous patchsets, it'd 500)22:02
joeljwrightokay, cool, I saw the comments and wondered if it was worth testing it22:03
joeljwrightthanks so much for keeping this moving!22:03
timburkesure! it's a really cool feature -- i like the possibilities this opens up22:04
joeljwrightI'll get on with some more testing in the morning22:04
joeljwrightnice to see a +2 on it :)22:04
*** flwang has quit IRC22:06
mattoliveraumorning22:09
*** flwang has joined #openstack-swift22:19
*** JimCheung has joined #openstack-swift22:27
*** JimCheung has quit IRC22:31
*** JimCheung has joined #openstack-swift23:01
*** armaan has quit IRC23:03
*** armaan has joined #openstack-swift23:04
*** JimCheung has quit IRC23:05
*** JimCheung has joined #openstack-swift23:28
*** chsc has quit IRC23:29
*** kei_yama has joined #openstack-swift23:34
*** JimCheung has quit IRC23:34
*** JimCheung has joined #openstack-swift23:34
*** JimCheung has quit IRC23:35
*** JimCheung has joined #openstack-swift23:36
*** JimCheung has quit IRC23:40
*** edausq has quit IRC23:46
*** m_kazuhiro has joined #openstack-swift23:50
*** shaner has quit IRC23:52
*** shaner has joined #openstack-swift23:52
*** JimCheung has joined #openstack-swift23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!