Friday, 2016-02-19

*** rickyrem has joined #openstack-swift00:06
*** diogogmt has quit IRC00:21
*** jamielennox|away is now known as jamielennox00:33
*** zhill has joined #openstack-swift00:36
timburkeclayg: thanks for rebasing patch 264961! so is that essentially a +2?00:38
patchbottimburke: https://review.openstack.org/#/c/264961/ - swift - Make write-only container access consistent00:38
openstackgerritMichael Barton proposed openstack/swift: go: ObjectEngine abstraction layer  https://review.openstack.org/27893200:43
openstackgerritMichael Barton proposed openstack/swift: go: ObjectEngine abstraction layer  https://review.openstack.org/27893200:44
mattoliverauho_: morning00:54
ho_mattoliverau: morning!01:02
claygtimburke: oh did i not +2 it :\01:15
*** diogogmt has joined #openstack-swift01:18
*** jroll has quit IRC01:22
*** jroll has joined #openstack-swift01:24
*** zhill has quit IRC01:30
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix object-server to handle newer ts file  https://review.openstack.org/28163601:32
*** lyrrad has quit IRC01:35
*** trifon has quit IRC01:36
*** baojg has joined #openstack-swift01:48
*** chlong_ has joined #openstack-swift01:55
*** asettle has joined #openstack-swift01:59
*** forcebanana has quit IRC02:01
*** mingdang1 has joined #openstack-swift02:01
*** jamielennox is now known as jamielennox|away02:02
*** david-lyle_ has joined #openstack-swift02:04
*** david-lyle_ is now known as david-lyle02:05
*** asettle has quit IRC02:07
*** jamielennox|away is now known as jamielennox02:12
claygnotmyname: tsg and kota aren't in channel; I'm getting stupid log lines everywhere I install liberasurecode -> https://gist.github.com/clayg/af012b4793954461f86202:16
*** haomaiwang has joined #openstack-swift02:16
*** haomaiwang has quit IRC02:21
ho_clayg: any change i can get re-review for patch 271142 and patch 271160 ?02:21
patchbotho_: https://review.openstack.org/#/c/271142/ - swift - Add unit tests for checking responses in AccountCo...02:21
patchbotho_: https://review.openstack.org/#/c/271160/ - swift - Add unit tests for checking responses in Container...02:21
*** jamielennox is now known as jamielennox|away02:24
portantenotmyname, clayg, torgomatic, have you folks looked at http://pmem.io/nvml/libpmemobj/02:24
portantewould be fun, huh?02:24
*** jamielennox|away is now known as jamielennox02:25
*** jamielennox is now known as jamielennox|away02:26
*** forcebanana has joined #openstack-swift02:28
*** forcebanana has quit IRC02:30
*** forcebanana has joined #openstack-swift02:32
*** haomaiwang has joined #openstack-swift02:32
*** jamielennox|away is now known as jamielennox02:33
claygportante: only in relation to xpoint - general idea seems fine - not directly relevant to me today02:33
claygportante: but if we ever get away from those pesky filesystems - it's ON02:34
*** jamielennox is now known as jamielennox|away02:34
*** jamielennox|away is now known as jamielennox02:35
*** jamielennox is now known as jamielennox|away02:36
*** haomaiwang has quit IRC02:37
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925002:37
portanteI hear tell that Intel was to be shipping NVM hardware is systems by 201702:37
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873602:38
*** haomaiwa_ has joined #openstack-swift02:48
*** forcebanana has quit IRC02:50
*** jamielennox|away is now known as jamielennox02:51
ho_clayg: s/change/chance/02:56
*** StraubTW_ has quit IRC02:58
*** Zyric_ has quit IRC02:58
*** sanchitmalhotra has joined #openstack-swift03:00
*** haomaiwa_ has quit IRC03:01
*** haomaiwa_ has joined #openstack-swift03:01
*** asettle has joined #openstack-swift03:06
*** rickyrem has quit IRC03:10
*** Jeffrey4l__ has joined #openstack-swift03:11
*** asettle has quit IRC03:11
*** Zyric_ has joined #openstack-swift03:14
*** esker has joined #openstack-swift03:27
*** links has joined #openstack-swift03:30
*** asettle has joined #openstack-swift03:30
*** asettle has quit IRC03:34
*** david-lyle_ has joined #openstack-swift03:42
*** david-lyle has quit IRC03:45
*** baojg has quit IRC03:53
*** haomaiwa_ has quit IRC04:01
*** haomaiwang has joined #openstack-swift04:01
mahaticgood morning04:02
*** david-lyle_ has quit IRC04:03
*** david_lyle__ has joined #openstack-swift04:03
ho_mahatic: morning!04:05
*** mingyu has quit IRC04:06
*** mingyu has joined #openstack-swift04:06
*** gyee has quit IRC04:07
*** david_lyle__ has quit IRC04:08
claygho_: oh no - what did I do?04:22
claygoh - patches - right on04:22
notmynamegood evening04:24
notmynameclayg: are those liberasurecode things maybe related to ldconfig?04:26
claygi don't know?!04:26
claygi type ldconfig sometimes04:26
claygI don't know what it does04:26
claygit doesn't seem like ti does anything04:26
claygit prints stuff I can't understand on my terminal04:27
notmynamegoogle tells me that it's the shared library cache. and tsg always tells me to do that when i have problems ;-)04:27
clayglol - k we're totally on the same page then04:27
claygbut in this case anyway it doesn't make the errors go away04:28
notmynameit seems your errors have to do with all of the actual ec libraries that you might have installed, therefore it's obviously a caching problem, right? that's one of those "hard things"04:28
notmynameah.04:28
notmynameyeah, we're totally on the same page :-)04:28
claygnotmyname: check your syslog on your saio - do you have them messages too?04:28
claygnotmyname: I mean like my stuff is working - it's just being stupid noisy about stuff I dont't care about04:28
notmynameoh, interesting04:29
notmynamedo you have storage policies configured that reference all those libraries?04:29
notmynamein swift.conf04:29
claygnotmyname: NO WAY04:29
claygi just have the liberasure_vand thing04:29
claygrs_ in there somehwere04:29
claygidk04:29
claygthe default04:29
notmynameoh look. it's in my syslog too. we're TOTALLY on the same page04:30
claygnotmyname: then i have some other nodes with isa-l configured/installed - no warning about missing isa-l.so on those nodes04:30
notmynamewhy would it have references to those?04:30
claygi filed it upstream - tsg says its going to get better when we have bigger numbers04:30
claygbigger numbers are key04:30
notmynameyeah, I've got ISA-L on my saio, so no errors about that one04:31
clayg"I think what you are seeing is a result of VALID_EC_TYPES evaluation in pyeclib"04:31
clayg^ from tsg on https://bitbucket.org/tsg-/liberasurecode/issues/23/spurious-messages-in-syslog04:31
claygbut he says bigger numbers will make it better (upcoming release/version w/e - point is bigger)04:32
notmynamemy initial guess is that's a wrong guess04:33
notmynamebecause VALIE_EC_TYPES doesn't have anything about libshss in it, and that's one of the messages04:34
notmynameargh!04:34
notmynameor I can't read at all04:34
notmynameeither I need more of or less of this margarita I'm halfway through ;-)04:34
claygthat's the ticket!04:35
* notmyname finds it very weird that pyeclib has special casing for shss (or, really, any 3rd party library. but especially shss)04:35
*** nakagawamsa has joined #openstack-swift04:37
*** nakagawamsa has quit IRC04:38
*** ppai has joined #openstack-swift04:39
openstackgerritMingyu Li proposed openstack/swift: Order the devices by (region, zone, ip, device) in the output of swift-ring-builder  https://review.openstack.org/27795604:42
notmynameclayg: based on commit message subject, what's your gut reaction to that patch? ^04:44
notmynamefor reference, https://github.com/MicrowiseOnGitHub/tempfiles/blob/master/reorder_ring_output04:45
claygnotmyname: big of buckets of win!04:52
notmynameI guess I can see that. my first reaction is that it's ordering on something that's not the primary key (the dev_id) so things get "mixed up". but the gist example seems reasonable...04:53
claygnotmyname: idk - there's a linked bug right?04:53
notmynameoh so we have a bug filed and it's something that has to be done?04:54
notmynameah ha! of course you like it. you filed that bug! ;-)04:54
claygno the bug might be invalid - but the justifcation had something to do with devices no longer show up in "the time your added them" order04:55
claygwhich was... neat?  but now it doesn't make any sense... so... some order is better than... none?04:55
openstackgerritTim Burke proposed openstack/swift: Add Expires header for successful GETs using tempurls  https://review.openstack.org/27973704:56
notmynamethere's an order! and it's inscrutable. how else are we to keep our aura of mystery?!04:56
notmynameI haven't played much with updating rings in a post resuse dev_ids world04:56
clayglol - dunno - we've got bugs filed on swift-ring-builder help message grammer - so you know... brave new world04:56
notmynameyeah, I think my initial reaction was "you're changing what?! the order of devices in the ring? can you even do that?". but yeah. seems totally reasonable04:58
notmynamegood job, mingyu. thanks for working on it :-)04:58
claygho_: do you want to take a stab to DRY out that common test case setup in patch 271160 like acoles_ nit'd on?04:59
patchbotclayg: https://review.openstack.org/#/c/271160/ - swift - Add unit tests for checking responses in Container...04:59
claygho_: I have to agree, it seems gross to have that all duplicated?04:59
*** haomaiwang has quit IRC05:01
*** haomaiwang has joined #openstack-swift05:01
openstackgerritBing Hu proposed openstack/python-swiftclient: ecnode auth token in swiftclient log message  https://review.openstack.org/25927305:02
timburkehrm. it makes me sad that you can't just do `swift-ring-builder /etc/swift/object.ring.gz | sort -nk 1` to get the old order...05:02
claygho_: I'd probably just do it like this -> https://gist.github.com/clayg/0658a29a29090c14d54b05:04
notmynametimburke: but why would you want the old order? couldn't you also use `sort -R` to get something effectively similar? ;-)05:04
claygtimburke: --json05:05
ho_clayg: thanks! i will do it05:06
claygho_: too late!05:06
notmynametimburke: clayg: and after, --json, just use http://jsontoyaml.com05:07
openstackgerritClay Gerrard proposed openstack/swift: dry out container unittests  https://review.openstack.org/28217305:07
clayg^ ho_ could use some help with the commit message05:07
claygnotmyname: --json-to-yaml-to-humman-to-xml05:07
ho_clayg: oh, i understand "too late" means. i will update the commit message :-)05:08
timburkenotmyname: *shrug* you were the one that seemed to freak out over a change in order...05:10
timburkeclayg: don't tempt me :P05:10
notmynametimburke: but now I've seen the light05:10
timburkehehe05:11
claygnotmyname: IME timburke makes even *MOAR* sense when I've been drinking05:11
notmynametimburke: new plan. when you come over to my desk in the office, bring a bottle ;-)05:11
openstackgerritBing Hu proposed openstack/python-swiftclient: ecnode auth token in swiftclient log message  https://review.openstack.org/25927305:12
timburkeclayg: when you've been drinking, or me? maybe both? either way, seems like i've got a plan for Bristol!05:13
notmynamelol05:13
timburkenotmyname: why bring a bottle when the good tequila's practically already there?05:14
*** SkyRocknRoll has joined #openstack-swift05:14
claygtimburke: like I said, I'm taking my week in Bristol to merge fast-POST - everything else is lagniappe05:16
openstackgerritBing Hu proposed openstack/python-swiftclient: encode auth token in swiftclient log message  https://review.openstack.org/25927305:16
timburkeclayg: that's a good word. i'll have to try to remember that one. TIL05:17
mingyunotmyname: clayg: thank you for reviewing that! I was having my launch :-)05:19
notmynameclayg: wow. bringing out the cajun words ;-)05:19
mingyuI'm really happy that I can do something to contribute back to Swift :-) as I've earned some money building storage systems based-on Swift for my customers in the past three years.05:28
*** nadeem has joined #openstack-swift05:28
*** asettle has joined #openstack-swift05:31
*** asettle has quit IRC05:35
*** rcernin has joined #openstack-swift05:37
*** nakagawamsa has joined #openstack-swift05:42
notmyname:-)05:42
*** baojg has joined #openstack-swift05:45
*** nakagawamsa has quit IRC05:48
*** haomaiwang has quit IRC06:01
*** haomaiwa_ has joined #openstack-swift06:01
*** asettle has joined #openstack-swift06:06
* mattoliverau is having one of those days where he's failing at debugging tests. Screw it its Friday arvo, I'm rage quitting for the day!06:09
mattoliverauTl:Dr : I'm calling it a day, have a great weekend all06:09
notmynamemattoliverau: you too :-)06:09
openstackgerritTim Burke proposed openstack/swift: Add Vary: headers for CORS responses  https://review.openstack.org/27430306:10
*** asettle has quit IRC06:11
*** resker has joined #openstack-swift06:13
*** esker has quit IRC06:15
*** nadeem has quit IRC06:23
*** nadeem has joined #openstack-swift06:24
*** asettle has joined #openstack-swift06:29
*** resker has quit IRC06:30
*** asettle has quit IRC06:34
*** McMurlock has joined #openstack-swift06:35
peterlisakpeterli06:42
notmynamehello peterlisak06:43
notmynametimburke: I've got unreviewed swiftclient patches on the new dashboard now. and counted in the timings (although I think I've got a bug there). not yet on community reviews06:44
timburkehuzzah!06:45
notmynameand swiftclient unreviewed are listed after swift unreviewed patches. don't have the info plumbed through yet to do the more correct ordering06:45
*** McMurlock has quit IRC06:47
*** zaitcev has quit IRC06:47
*** trifon has joined #openstack-swift06:50
*** kei_yama has quit IRC06:52
timburkenotmyname: huh. i expected patch 184956 to be higher than it was. i guess it's ordered by time-since-last-update rather than time-since-creation06:53
patchbottimburke: https://review.openstack.org/#/c/184956/ - python-swiftclient - Accept gzip-encoded API responses06:53
*** esker has joined #openstack-swift06:53
notmynametimburke: note it's number 3rd oldest in the set of swiftclient patches06:54
notmynametimburke: but yeah, IIRC gerrit returns data in last-udated order06:55
timburke...did you see when it was created? :P06:55
notmynameno ;-)06:55
notmynametimburke: I'll raise you https://review.openstack.org/#/c/103779/06:56
patchbotnotmyname: patch 103779 - swift - Add support for multiple container-reconciler06:56
timburkealthough that's actually gotten reviews ;-)06:57
notmynameright06:57
*** haomaiwa_ has quit IRC07:01
*** 20WAABHNQ has joined #openstack-swift07:01
notmynametimburke: oldest open patch (actually, longest active for both open an closed patches) in swift is https://review.openstack.org/#/c/62494/07:10
patchbotnotmyname: patch 62494 - swift - Add containeralias middleware07:10
notmynamenearly 800 days :-(07:10
timburkemighty old07:10
notmynameyour https://review.openstack.org/#/c/184956/ patch is the oldest open patch for swiftclient (@ ~ 273 days07:12
patchbotnotmyname: patch 184956 - python-swiftclient - Accept gzip-encoded API responses07:12
timburkesince Vancouver!07:12
notmynamebed time for me. talk to everyone tomorrow07:15
*** silor has joined #openstack-swift07:18
openstackgerritMerged openstack/swift: Add unit tests for checking responses in AccountController  https://review.openstack.org/27114207:23
*** silor1 has joined #openstack-swift07:25
*** silor has quit IRC07:26
*** silor1 is now known as silor07:26
*** mingyu has quit IRC07:28
*** mingyu has joined #openstack-swift07:28
*** esker has quit IRC07:31
*** chlong_ has quit IRC07:41
*** pcaruana has joined #openstack-swift07:45
*** esker has joined #openstack-swift07:50
*** 20WAABHNQ has quit IRC08:01
*** haomaiwang has joined #openstack-swift08:01
*** nadeem has quit IRC08:14
*** klrmn has quit IRC08:21
*** ChanServ sets mode: +v cschwede08:22
*** asettle has joined #openstack-swift08:30
*** esker has quit IRC08:31
*** asettle has quit IRC08:35
*** esker has joined #openstack-swift08:41
*** jmccarthy has joined #openstack-swift08:43
*** acoles_ is now known as acoles08:51
*** davideagle_ has joined #openstack-swift08:52
*** haomaiwang has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:01
acolesgood morning09:05
*** mingyu has quit IRC09:20
*** mingyu has joined #openstack-swift09:20
*** jordanP has joined #openstack-swift09:20
mahaticgood morning09:29
*** d0ugal has quit IRC09:30
*** esker has quit IRC09:30
*** d0ugal has joined #openstack-swift09:31
*** d0ugal has quit IRC09:31
*** d0ugal has joined #openstack-swift09:31
*** d0ugal has quit IRC09:31
*** d0ugal has joined #openstack-swift09:32
*** d0ugal has quit IRC09:32
*** d0ugal has joined #openstack-swift09:32
*** esker has joined #openstack-swift09:34
*** baojg has quit IRC09:44
*** baojg has joined #openstack-swift09:45
*** haomaiwang has quit IRC10:01
*** asettle has joined #openstack-swift10:01
*** davideagle_ has quit IRC10:01
*** haomaiwang has joined #openstack-swift10:01
*** StraubTW_ has joined #openstack-swift10:02
*** stantonnet has quit IRC10:03
*** stantonnet has joined #openstack-swift10:05
*** StraubTW_ has quit IRC10:07
*** davideagle_ has joined #openstack-swift10:09
openstackgerritAlistair Coles proposed openstack/swift: Silence SkipTest noise in in-process test teardown  https://review.openstack.org/28226110:16
acolesclayg: notmyname ^^10:17
*** mingyu has quit IRC10:34
*** mingyu has joined #openstack-swift10:34
*** asettle has quit IRC10:40
*** ho_ has quit IRC10:40
*** asettle has joined #openstack-swift10:40
*** remix_tj has joined #openstack-swift10:41
*** haypo has joined #openstack-swift10:47
acolestdasilva: thanks for fixing that commit message10:53
*** mingyu has quit IRC10:54
*** mingyu has joined #openstack-swift10:54
haypocschwede: hi. i'm back for my hmac change/config parser issue. https://review.openstack.org/#/c/236998/ if i understood correctly, the main risk is that upgrading from py2 to py3 would break the world if py3 "reads" the hash prefix/suffix differently, right?10:55
patchbothaypo: patch 236998 - swift - Port get_hmac() and hash_path() to Python 310:55
haypocschwede: i suggest to implement a guard to prevent any mistake: raise a strong exception if the hash prefix/suffix may be interpreted differently on py2/py3, for example if it contains '%'10:56
haypocschwede: *and* add a new optional format for hash prefix/suffix to support arbitrary random bytes10:56
haypoi propose to add a base64 format, ex: "hash_prefix = base64:xxxx"10:57
haypowe can provide a tool or at least a recipe in swift doc to explain how to generate such base64-encoded config10:57
cschwedehaypo: yep, exactly. i brought it up on Wednesdays community meeting, asking for more reviews. and there is an idea for config validation from clayg: https://review.openstack.org/#/c/281547/10:57
patchbotcschwede: patch 281547 - swift - Better hash path config validation10:57
*** baojg has quit IRC10:58
haypoexample: >>> print("hash_prefix = %s" % base64.b64encode(os.urandom(32)).decode('ascii'))10:58
haypohash_prefix = p+2B2etSKYZJj7XCtZK+7MW+Q2Xu5m/Rwnqou4ekg5o=10:58
acolesppai: hi, tdasilva jrichli and I have been working on some patches to allow copy middleware to go to left of slo, dlo in pipeline, and now I am making changes to patch 156923 - do you mind if I push changes over your review?10:58
patchbotacoles: https://review.openstack.org/#/c/156923/ - swift - Refactor server side copy as middleware10:58
*** baojg has joined #openstack-swift10:58
haypocschwede: oh right, you had the same idea than me :)10:59
haypocschwede: https://review.openstack.org/#/c/281547/ is the first part, but it will break existing deployement using a config which is now considered as "bad" (invalid)10:59
patchbothaypo: patch 281547 - swift - Better hash path config validation10:59
haypocschwede: i suggest to also provide a way to keep the old config. otherwise, you cannot start your cluster anymore, right?10:59
haypoor is it possible to change a hash prefix/suffix? does it require expensive operations?11:00
*** haomaiwang has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
cschwedehaypo: you’re right, if the validation fails you won’t be able to start any swift service. changing the suffix/prefix is not possible; and making it changeable would require moving all data in the cluster…11:02
cschwedeso that’s a nogo.11:02
haypocschwede: ok. what do you think of my base64 format?11:02
ppaiacoles, not at all11:03
haypocschwede: it should be backward compatible. IMHO it's very unlikely that something used "base64:" prefix as a random hash prefix/suffix :)11:03
*** baojg has quit IRC11:03
*** mingdang1 has quit IRC11:05
cschwedehaypo: imo it should be enough if operators simply use printable chars. i added a tiny note on that: https://review.openstack.org/#/c/281492/11:05
patchbotcschwede: patch 281492 - swift - Add note on using printable chars for swift_hash_p... (MERGED)11:05
cschwedeor even restricting it to chars and digits11:06
cschwedethat should be enough; but it doesn’T solve the problem for possibly existing strange settings11:06
haypocschwede: i'm talking about existing settings11:07
haypocschwede: technically, does it matter that the hash prefix/suffix is "very" random?11:07
haypoi don't know the purpose of it11:07
acolesppai: thanks - that's a great patch you did btw.11:07
haypoi'm asking because a base64 format would allow to generate high quality entropy11:08
*** haomaiwang has quit IRC11:08
ppaiacoles: And sorry, I've been busy and couldn't give much attention to it.11:10
cschwedehaypo: the purpose is to make the object location unguessable, so „just“ random should be enough (even a hexadecimal string with like 15-20 chars should be more than enough)11:11
*** dabukalam has joined #openstack-swift11:12
acolesppai: np11:12
haypocschwede: a long prefix/suffix slows down all hash computations. base64 encoding allows to get more entropy with shorter strings. in practice, i have no idea of the cost of hash computations on an overall swift request :)11:13
haypocschwede: well, it's just a side note :) my concern is not to make swift faster, just to prevent users to have to change the hash suffix/prefix if swift starts to refuse to start because hash prefix/suffix is now seen as "invalid"11:15
haypofor my use case (porting swift to py3), clayg's change is enough to avoid bad surprises when upgrading from py2 to py3, since the behaviour will be the same11:16
haypocschwede: oh. your change on the doc asks to use 'printable chars', but '%' is in string.printable, and my problem is on the '%' char11:17
asettlenotmyname: sorry I missed your ping! Loving London :D11:18
*** mingyu_ has joined #openstack-swift11:19
cschwedehaypo: yep, but using the raw parser in py3 makes it possible to still use „%“, right?11:21
openstackgerritrenminmin proposed openstack/swift: Account/Container quotas should allow object re-upload  https://review.openstack.org/26322711:21
haypocschwede: i don't want swift to behave differently depending on the python version11:21
*** mingyu has quit IRC11:22
cschwedehaypo: iirc, % was usable on py2? i need to have a look at my tests again… but i agree with you, it should behave the same on py2 and py311:23
haypocschwede: Swift currently uses ConfigParser.ConfigParser, you *can* write hash_suffix = %(hash_prefix)s11:24
*** linkmark has joined #openstack-swift11:28
*** d0ugal has quit IRC11:31
*** esker has quit IRC11:31
*** d0ugal has joined #openstack-swift11:31
*** d0ugal has quit IRC11:31
*** d0ugal has joined #openstack-swift11:31
haypocschwede: i commented https://review.openstack.org/#/c/281547/ to explain '%' issue and suggest base64 format11:36
patchbothaypo: patch 281547 - swift - Better hash path config validation11:36
*** NM has joined #openstack-swift11:41
*** esker has joined #openstack-swift11:43
*** sanchitmalhotra has quit IRC11:43
*** mingdang1 has joined #openstack-swift11:55
*** davideagle_ has quit IRC11:59
*** mingyu_ has quit IRC12:00
*** mingyu has joined #openstack-swift12:01
*** chlong_ has joined #openstack-swift12:11
*** davideagle_ has joined #openstack-swift12:13
*** mingyu has quit IRC12:20
*** mingyu has joined #openstack-swift12:20
*** cdelatte has joined #openstack-swift12:22
openstackgerritChristian Schwede proposed openstack/swift: Add containeralias middleware  https://review.openstack.org/6249412:23
*** davideagle_ has quit IRC12:27
*** esker has quit IRC12:27
*** ppai has quit IRC12:30
*** davideagle_ has joined #openstack-swift12:34
*** esker has joined #openstack-swift12:36
*** kota_ has joined #openstack-swift12:40
*** ChanServ sets mode: +v kota_12:40
kota_yeah,I got resolved my bouncer issue finally.12:41
kota_kota_: Test from mobile12:43
kota_seems to work well12:43
*** asettle has quit IRC12:44
peterlisakclayg, notmyname , mattoliverau : Hi, could you review my ionice patch 238799? Thanks. I replaced psutil by own wrapper.12:47
patchbotpeterlisak: https://review.openstack.org/#/c/238799/ - swift - Change schedule priority of daemon/server in config12:47
*** kota_ has quit IRC12:51
*** kota_ has joined #openstack-swift12:51
*** ChanServ sets mode: +v kota_12:51
openstackgerritMerged openstack/swift: Make write-only container access consistent  https://review.openstack.org/26496112:56
*** asettle has joined #openstack-swift13:00
openstackgerritKota Tsuyuzaki proposed openstack/swift: PUT/GET path for global ec cluster  https://review.openstack.org/21916513:02
*** km has quit IRC13:09
*** fthiagogv__ has quit IRC13:12
*** SkyRocknRoll has quit IRC13:14
tdasilvagood morning13:14
tdasilvaacoles: np from me13:15
acolestdasilva: tests looking good with pipeline of copy middleware/dlo/slo/versioned_writes (all 3 patches applied) :)13:17
acoleskota_: :)13:18
tdasilvaacoles: awesome, I was trying to do that last night but ran into some problems. Regarding the copy manifest between accounts, I think we are ok with responding with an error if the segments are not already there, correct?13:19
acolestdasilva: yes. I changed the failing func test to verify that the slo manifest fails if the segments are not readable in the dest account, then create readable segments in dest, then assert the manifest copy succeeds13:21
acolestdasilva: and I think timburke and I (and you?) agreed that was reasonable behaviour13:21
tdasilvaacoles: yep, it makes sense to me...like timburke said, otherwise, if they do a get on the manifest, they would get an error anyway13:22
*** ho_away has joined #openstack-swift13:24
*** lpabon has joined #openstack-swift13:33
*** davideagle_ has quit IRC13:42
*** StraubTW_ has joined #openstack-swift13:45
*** ndk has quit IRC13:47
*** portante has quit IRC13:47
*** mingdang1 has quit IRC13:52
*** mingdang1 has joined #openstack-swift13:53
*** davideagle_ has joined #openstack-swift13:53
*** StraubTW_ has quit IRC13:55
*** diogogmt has quit IRC14:01
*** fthiagogv has joined #openstack-swift14:02
*** diogogmt has joined #openstack-swift14:02
*** baojg has joined #openstack-swift14:07
*** mingyu has quit IRC14:10
*** mingyu has joined #openstack-swift14:10
*** mingyu has quit IRC14:12
*** mingyu has joined #openstack-swift14:12
*** mingyu has quit IRC14:15
*** mingyu has joined #openstack-swift14:16
openstackgerritAlexandra Settle proposed openstack/swift: WIP: New operational procedures guide  https://review.openstack.org/27824514:16
*** mingdang1 has quit IRC14:18
*** SkyRocknRoll has joined #openstack-swift14:19
*** mingdang1 has joined #openstack-swift14:20
*** trifon has quit IRC14:21
*** mingdang1 has quit IRC14:25
*** esker has quit IRC14:26
*** ndk has joined #openstack-swift14:26
*** links has quit IRC14:27
*** StraubTW_ has joined #openstack-swift14:29
*** baojg has quit IRC14:34
mahatictdasilva: acoles yay, that's great to hear! looks like we're gonna have COPY middleware soon14:34
*** diogogmt has quit IRC14:37
*** petertr7_away is now known as petertr714:37
*** portante has joined #openstack-swift14:41
*** openstackgerrit_ has quit IRC14:43
*** diogogmt has joined #openstack-swift14:49
openstackgerritJoel Wright proposed openstack/python-swiftclient: Do not reveal auth token in swiftclient log messages by default  https://review.openstack.org/28236314:54
*** ho_away has quit IRC14:55
openstackgerritBéla Vancsics proposed openstack/swift: Reduce code duplication  https://review.openstack.org/26776714:57
openstackgerritJoel Wright proposed openstack/python-swiftclient: Do not reveal auth token in swiftclient log messages by default  https://review.openstack.org/28236314:59
*** openstackgerrit_ has joined #openstack-swift15:00
*** linkmark has quit IRC15:02
*** joeljwright has joined #openstack-swift15:06
*** ChanServ sets mode: +v joeljwright15:06
*** Jeffrey4l__ has quit IRC15:07
jrichliacoles: yay!  good to see movement on that one15:10
*** davideagle_ has quit IRC15:12
*** links has joined #openstack-swift15:13
*** davideagle_ has joined #openstack-swift15:14
*** davideagle_ has quit IRC15:15
*** dhellmann has quit IRC15:16
*** dhellmann has joined #openstack-swift15:19
*** esker has joined #openstack-swift15:20
*** esker has quit IRC15:25
notmynamegood morning15:34
joeljwrightnotmyname: good morning15:34
joeljwrightnotmyname: I tried to combine the 2 patches regarding logging auth tokens (https://review.openstack.org/#/c/282363)15:36
*** mvk has quit IRC15:36
notmynameasettle: I had a docs-related question for you.15:37
joeljwrightCLI —debug outputting complete curl commands is also maintained - would be nice if people could have a look15:37
notmynameasettle: why isn't https://github.com/openstack/python-swiftclient/commit/a3a78be87b88beca83a8cc0c96e209ab8e1a4189 reflected in http://docs.openstack.org/developer/python-swiftclient/15:37
notmynamejoeljwright: ah cool15:37
asettleThat's a good question15:37
joeljwrightdoes anyone know how I can contact someone on the ubuntu cloud archive team regarding swift packages?15:38
* asettle blinks15:38
asettleNo.15:38
notmynamejoeljwright: I don't remember who does that. zigo and onovy do swift in debian. zaitcev does swift in RDO. I don't remember who does swift in ubuntu15:39
*** bjkeller has joined #openstack-swift15:40
zigonotmyname: The changelog may be helpful: http://changelogs.ubuntu.com/changelogs/pool/main/s/swift/swift_2.5.0-0ubuntu1/changelog15:40
notmynamejoeljwright: there you go :-)15:41
joeljwrightzigo: thanks15:41
zigo(you get this by searching for http://packages.ubuntu.com/swift, then click on the latest release, then search for "changelog" in that page)15:41
notmynameheh. a good chunk of doing stuff in open source seems to be knowing who has what phrases highlighted in their IRC client ;-)15:42
zigonotmyname: BTW, any chance that the CVE for Swift in Jessie gets fixed? :)15:42
zigo(sorry, that's what you get when highlighting me... :P)15:42
notmynamezigo: that's the backport for juno, right?15:42
zigoYup.15:42
notmynamezigo: I wrote it down on my todo list. but TBH it's not at the top.15:43
* zigo clicks on the up arrow 10 times...15:44
asettleacoles: yeah I will have to get around to that. At the moment I am just formatting the RST, i'll go through after and do exactly that soon too. Thank you for pointing it out :)15:45
asettleThere's a lot of bonky crud in there, haha.15:45
*** _JZ_ has joined #openstack-swift15:46
acolesasettle: k15:46
acolesasettle: you are coming to Bristol right?15:46
asettleacoles: yep. Sitting in the London office currently.15:46
acolesoic15:46
asettleI'm trying to get this done before we get there.15:46
acolesasettle: the original authors of that hpe content will be here too for the hackathon15:46
asettle2500 to go.15:46
asettleacoles: amazing, point them to me?15:47
asettleThere's a lot of blanks which have understandably been redacted and would really appreciate them being filled in with *some* credible knowledge of what was tehre previously.15:47
acolesasettle: they don't hang out here, but i will make sure you get intro in bristol15:47
asettleacoles: thank you :) you coming?15:47
acolesasettle: i'm hosting :)15:48
asettle...15:48
asettleOf course you are :p15:48
asettleMerp.15:48
acoleshehe15:48
asettleI'd love to say it's jet lag or something but I've been here long enough now.15:48
acolesbristol is 13mins west of london so you'll get another dose of jet lag when you move here :)15:49
*** fthiagogv has quit IRC15:49
notmynameasettle: are you in london permanently yet? or do you have another return to oz planned?15:49
notmynameacoles: 13 minutes?15:49
asettleThat works for me! I'm actually hoping to come up the weekend beforehand and do my tourist thang.15:49
*** fthiagogv has joined #openstack-swift15:49
asettlenotmyname: Nope, back in April permanently15:49
asettleBut I have been here all this week, and will be obviously the next until the hackathon.15:49
asettleBut I get to set up some of my things while I'm here which has been good. UK phone number, etc etc15:50
acolesasettle: so are you relocating to UK?15:50
asettleacoles: you bet. I've come for the sun.15:51
acolesLOL!15:51
acolesis that to escape mattoliverau ? :P15:51
asettleNever! <315:51
asettleIt's because I'm so pale I just needed to find people to fit in with :p15:51
notmynameacoles: I think you logged off yesterday before I had a v1 of this. check out http://not.mn/swift/swift_community_dashboard.html15:52
acolesnotmyname: yeah i saw it in scrollback and I have been busying applying my stars15:53
notmynamelol15:53
acolescannot star own reviews tho :(15:53
asettleAlso notmyname did you get my email regarding your plans on passing the content?15:53
notmynameacoles: really?15:54
jrichliacoles: interesting.  I am able to star my own review15:54
acoleshuh.15:54
notmynameasettle: on getting stuff merged at the hackathon?15:54
* acoles will try again15:54
asettlenotmyname: yerp15:54
asettleCause I'll probably want/need this template-esque situation to be merged before we get there: https://review.openstack.org/#/c/278248/215:55
patchbotasettle: patch 278248 - python-swiftclient - New python swiftclient doc15:55
asettleOH thanks patchbot15:55
acolesnotmyname: jrichli ok must have been a gerrit or user error :)15:55
acolesthis could be interesting...starring in progress15:55
notmynameasettle: yes. I think that is a reasonable goal. especially if it's phrased as "some docs that aren't terrible are better than no docs, so let's land these now if possible"15:55
asettleBasically. It's much easier to have something up and through, and go back later and fix it up, than have a bout 20 merge conflicts and some really unhappy patches15:56
asettleDo we have enough cores to help out?15:56
*** fthiagogv has quit IRC15:56
acolesasettle: no15:56
asettleacoles: super.15:56
acolesasettle: help with what? :)15:56
acolesasettle: jk15:56
asettleHaha well, traditionally when I've done documentation based swarms, it's generally easiest to get the content up, reviewed by cores, and passed en masse.15:57
asettleFollowing that, we then have me/anyone else going back over the top and reviewing the content separately.15:57
notmynameasettle: I agree. and as terrible as it may sound, docs are easier to land since they generally don't break prod ;-)15:57
asettlePretty much, tbh15:58
asettleAnd as long as people are okay with following a few quick RST conventions I'll point them in the direction of... I'm good (with a few others?) going over hte top and checking for accuracy of content and spelling/grammar15:58
asettleThoughts on that funciton?15:58
joeljwrightI'll certainly be helping with the docs15:58
*** fthiagogv has joined #openstack-swift15:58
asettlejoeljwright: are you core? If not, we probs don't want you aye :P15:58
joeljwrightcore for python-swiftclient15:58
joeljwright:)15:59
joeljwrighthappy to wield a +2 hammer15:59
asettlejoeljwright: https://www.youtube.com/watch?v=7oKPYe53h7815:59
asettleSo relevant rn15:59
acolesnotmyname: asettle  i think when you have a large amount of new content you could get trapped in endless word-smithing, better to land something that is reasonable and then polish in follow-up patches15:59
notmynameacoles: right15:59
asettleTHat's the plan, Stan15:59
joeljwrightacoles: yup16:00
acolesasettle: and joeljwright is in UK too so you get great timezone overlap16:00
asettleI know, it's muchos exciting.16:00
asettleOh John Travolta16:00
joeljwrightacoles: but you know this means we'll be bugging you more for the remaining +2...16:00
asettleacoles: please. I'll give YOU a Grease song too if you say yes16:01
asettleI know how tempting that is16:01
acolesjoeljwright: i'm moving to mattoliverau-land16:01
acolescan't stand the sum16:01
acolessun*16:01
asettle... Melbourne?16:02
notmynameacoles: perth16:02
asettleWhere'd you get Perth from?!16:02
notmynameif we're all together at the hackathon, I'd imagine perfect spot to hide fromt he sun16:02
notmynamelol16:02
notmynameperth is a perfect spot to hide from the sun16:02
notmynamefunny how those 2 mistakenly joined phrases sorta worked16:03
*** cschwede has quit IRC16:04
*** cschwede has joined #openstack-swift16:05
acolesnotmyname: you lost me. but yeah perth isn't the sunniest place on the planet https://www.google.co.uk/maps/place/Perth16:05
notmynamebad joke badly delivered ;-)16:06
acolesthe good news today is that the hackathon snacks are safely stashed under my desk...16:06
notmynamehttps://goo.gl/maps/QfbBEjJJy992 is rather sunny ;-)16:06
acoles...the bad news is I have to go a week resisting easting them!16:06
notmynameacoles: do you have "topics"?16:07
acolesthat would be telling ;)16:07
acolesthey only get deployed if *my* topics are selected16:07
jrichlihehe16:07
acoles*other* people's topics get rice crackers16:08
*** pcaruana has quit IRC16:10
joeljwright:D16:12
asettleacoles: what kind of snacks?!16:12
asettleWill I like them16:12
asettleBeing Australian I naturally only eat things that can kill me.16:13
*** klrmn has joined #openstack-swift16:13
*** haypo has left #openstack-swift16:13
acolesasettle: i also have an hp z640 workstation under my desk, that would probably kill you16:13
*** arch-nemesis has joined #openstack-swift16:13
asettleacoles: cool. I'll just hide under your desk and feel right at home.16:14
acolesthey're mostly unhealthy16:14
tdasilvaare beers being served with snacks?16:15
notmynameacoles: that looks pretty nice as a desktop workstation ;-)16:16
acolesit is. stacked with 128GB too.16:16
notmynamenice16:16
acolesi use it for email16:16
acolesdev on my laptop16:16
acoles:P16:16
notmynamelol16:16
*** SkyRocknRoll has quit IRC16:17
asettleBeers... what about wine?16:20
notmynameacoles: I just got some of these at the office http://www.intel.com/content/www/us/en/solid-state-drives/solid-state-drives-dc-p3500-series.html16:21
*** diazjf has joined #openstack-swift16:26
*** nadeem has joined #openstack-swift16:28
*** nadeem has quit IRC16:28
*** nadeem has joined #openstack-swift16:29
acolesnotmyname: nice. i have a 1TB ssd, not sure of specs, doubt it matches those!16:33
* acoles regrets mentioning the snacks16:34
*** arch-nemesis has quit IRC16:35
*** diazjf has quit IRC16:39
*** bjkeller has quit IRC16:45
*** arch-nemesis has joined #openstack-swift16:47
*** gyee has joined #openstack-swift16:48
*** trifon has joined #openstack-swift16:50
*** links has quit IRC16:53
*** bjkeller has joined #openstack-swift16:55
*** diazjf has joined #openstack-swift16:55
*** rcernin has quit IRC16:58
openstackgerritJoel Wright proposed openstack/python-swiftclient: Do not reveal auth token in swiftclient log messages by default  https://review.openstack.org/28236317:01
Zyric_Good morning17:04
gmmahals17:04
*** chsc has joined #openstack-swift17:05
*** esker has joined #openstack-swift17:08
*** asettle has quit IRC17:12
*** lyrrad has joined #openstack-swift17:14
*** klrmn has quit IRC17:17
*** garthb has joined #openstack-swift17:17
claygOwners are winning!17:23
claygone thing I like there is that whenI am both a reviewer and an owner - I'M ALWAYS #WINNING17:24
*** esker has quit IRC17:29
joeljwrighttimburke: you around?17:29
*** rcernin has joined #openstack-swift17:30
acolesclayg: can I beg for a review? fast-post patch depends on patch 267788 which is not so huge, maybe we could progress that before the hackathon?17:34
patchbotacoles: https://review.openstack.org/#/c/267788/ - swift - Fix inconsistent suffix hashes after ssync of tomb...17:34
*** mingyu has quit IRC17:37
*** mingyu has joined #openstack-swift17:38
*** haomaiwang has joined #openstack-swift17:52
tdasilvanotmyname: re the dashboard, any plans to show the stats as a graph? like a trend..17:55
*** petertr7 is now known as petertr7_away17:55
*** jordanP has quit IRC17:56
*** haomaiwang has quit IRC17:56
openstackgerritAlistair Coles proposed openstack/swift: Refactor server side copy as middleware  https://review.openstack.org/15692317:57
openstackgerritAlistair Coles proposed openstack/swift: Re-format the SLO manifest file on new multipart-manifest GET call  https://review.openstack.org/26390217:57
openstackgerritAlistair Coles proposed openstack/swift: decouple versioned writes from COPY  https://review.openstack.org/26017917:57
acolestdasilva: jrichli ^^ the three patches are now in a chain (as listed above). server_side_copy to left of slo, dlo and versioned_writes, no more copy_hooks17:59
*** Zyric_ has quit IRC18:00
*** zhill has joined #openstack-swift18:00
tdasilvaacoles: sweeeet!18:01
notmynameclayg: you're always a winner in my book18:05
notmynametdasilva: I've thought about graphing it. but that brings in time-series stuff and a lot more complexity. right now it's running in a cron job on my laptop18:06
*** asettle has joined #openstack-swift18:07
tdasilvanotmyname: got it18:07
*** Gordoni has joined #openstack-swift18:08
joeljwrightclayg: new patch for redacting tokens in swiftclient logs here https://review.openstack.org/#/c/28236318:11
*** asettle has quit IRC18:12
joeljwrightclayg: CLI —debug can still give you the full tokens and it's a combination of the 2 previous patches18:12
notmynameacoles: is the only way in the new gerrit interface to see patch dependencies to look at the "same topic" section in the top right?18:13
notmynamejoeljwright: yeah, I want to review that one today18:13
joeljwrightnotmyname: I'll check in on it later tonight and tomorrow in case there are required fixes18:14
timburkejoeljwright: am now; was still catching up on scrollback18:14
acolesnotmyname: I also see a Related-Changes tab at top right when there is a dependency18:14
acolesnotmyname: but don't know any other way18:14
joeljwrighttimburke: cool, I combined the 2 auth token logging patches here - https://review.openstack.org/#/c/28236318:14
notmynameacoles: any idea how it determines "related"?18:15
timburkei saw that; was going to aim for a review after a meeting this morning18:15
notmynameI like the old way of explicitly showing the patch chain  /curmudgeon18:15
acolesnotmyname: in my experience that have always been dependencies18:15
*** klrmn has joined #openstack-swift18:16
acolesnotmyname: there's lots of old ways i preferred. like to change patch set now requires moving mouse to top right which is a long way on a big screen!18:16
*** chlong_ has quit IRC18:18
*** Gordoni has quit IRC18:20
*** bjkeller has quit IRC18:22
timburkeacoles: agreed! and conversely, it doesn't display very well windowed, either!18:22
*** remix_tj has quit IRC18:25
*** tonyb has quit IRC18:25
*** ejat has quit IRC18:25
*** balajir has quit IRC18:25
*** ctennis has quit IRC18:25
*** glange has quit IRC18:25
*** then3rd has quit IRC18:25
*** urth has quit IRC18:25
*** remix_tj has joined #openstack-swift18:25
*** then3rd has joined #openstack-swift18:26
*** glange has joined #openstack-swift18:26
*** ChanServ sets mode: +v glange18:26
*** ejat has joined #openstack-swift18:26
*** ejat has quit IRC18:26
*** ejat has joined #openstack-swift18:26
*** ctennis has joined #openstack-swift18:26
claygacoles: yeah I want to see the hash suffix stuff fixed - been on my list - but not doing a ton of reviews18:27
*** hrou has quit IRC18:27
*** ajiang has quit IRC18:27
*** raginbajin has quit IRC18:27
*** redbo has quit IRC18:27
*** hurricanerix has quit IRC18:27
*** a1|away has quit IRC18:27
*** number80 has quit IRC18:27
*** jrichli has quit IRC18:27
*** lifeless has quit IRC18:27
*** early has quit IRC18:27
*** balajir has joined #openstack-swift18:27
*** redbo has joined #openstack-swift18:27
*** ChanServ sets mode: +v redbo18:27
*** raginbaj- has joined #openstack-swift18:27
*** ajiang has joined #openstack-swift18:27
*** lifeless has joined #openstack-swift18:27
*** a1|away has joined #openstack-swift18:27
*** jrichli has joined #openstack-swift18:27
*** early has joined #openstack-swift18:27
*** david-lyle has joined #openstack-swift18:27
*** hurricanerix_ has joined #openstack-swift18:28
*** StraubT__ has joined #openstack-swift18:28
*** StraubTW_ has quit IRC18:28
*** hrou has joined #openstack-swift18:28
acolesclayg: yeah i hate to ask cos i know you're busy18:28
*** urth has joined #openstack-swift18:28
*** number80 has joined #openstack-swift18:28
*** raginbaj- is now known as raginbajin18:29
*** flaper87 has quit IRC18:29
*** flaper87 has joined #openstack-swift18:29
acolestimburke: the other one that bugs me is the distance from 'add reviewer' to 'add me'18:29
*** wanghua has quit IRC18:30
*** Zyric has joined #openstack-swift18:30
*** tonyb has joined #openstack-swift18:31
*** jrichli has quit IRC18:31
*** jrichli has joined #openstack-swift18:31
*** hrou has quit IRC18:31
*** hrou has joined #openstack-swift18:31
*** wanghua has joined #openstack-swift18:36
acoleshave a good weekend everyone18:36
joeljwrightacoles: you too!18:37
*** joeljwright has quit IRC18:38
*** Gordoni has joined #openstack-swift18:41
*** acoles is now known as acoles_18:42
*** petertr7_away is now known as petertr718:47
*** Gordoni has quit IRC18:47
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873618:48
*** Gordoni has joined #openstack-swift18:49
*** haomaiwang has joined #openstack-swift18:53
*** nadeem has quit IRC18:55
*** fthiagogv has quit IRC18:56
*** rcernin has quit IRC18:56
*** haomaiwang has quit IRC18:58
*** Gordoni has quit IRC18:58
jrichliacoles: yay! no more copy-hooks!  the entire COPY as mw patch chain is all ready for review in that case.  nice!18:58
*** petertr7 is now known as petertr7_away19:02
*** Gordoni has joined #openstack-swift19:05
claygacoles_: no no you have to ashk!19:12
claygjrichli: holy cow - awesome!19:12
*** StraubT__ has quit IRC19:13
jrichliclayg: I know!  Having all functests pass for crypto is near.  Now we just gotta pin you down at hackathon to chat about that whole timestamps / sysmeta /metadata thing again ;-)  it will be a fun chat.19:14
*** esker has joined #openstack-swift19:15
claygacoles_: well I'm worried about how using only the files that would construct a valid fileset might effect EC in a situation with multiple frag_archive's19:16
claygbut I'll thinkin through it and try to come up with a probe scenario by cribing from some of your stuff19:17
*** StraubTW_ has joined #openstack-swift19:19
*** StraubTW_ has quit IRC19:21
*** StraubTW_ has joined #openstack-swift19:21
*** rcernin has joined #openstack-swift19:23
*** diogogmt has quit IRC19:24
*** diogogmt has joined #openstack-swift19:25
*** Zyric has quit IRC19:26
*** petertr7_away is now known as petertr719:26
*** Zyric has joined #openstack-swift19:27
*** Zyric_ has joined #openstack-swift19:27
*** Zyric_ has quit IRC19:27
*** Zyric has quit IRC19:30
*** jmccarthy has quit IRC19:32
*** silor has quit IRC19:37
*** bjkeller has joined #openstack-swift19:39
*** Zyric has joined #openstack-swift19:39
*** diogogmt has quit IRC19:40
*** asettle has joined #openstack-swift19:44
claygjrichli: no moar types of metdata!19:44
*** rcernin has quit IRC19:45
*** diogogmt has joined #openstack-swift19:46
*** asettle has quit IRC19:48
*** asettle has joined #openstack-swift19:51
*** asettle has quit IRC19:51
*** ChubYann has joined #openstack-swift19:52
jrichliclayg: I know :-)  acoles_ has an idea.  maybe it will be more palatable than the other routes we have thought of thus far.19:54
*** trifon has quit IRC19:54
claygjrichli: acoles_ is so smart19:55
jrichli+119:55
jrichli+219:55
*** zhill has quit IRC19:57
*** zhill has joined #openstack-swift19:57
*** ChubYann has quit IRC19:58
*** ChubYann_ has joined #openstack-swift19:58
*** asettle has joined #openstack-swift19:59
bjkellerThe tempest gate checks keep failing for patch 274906 saying the etag header does not exist.  Does anyone know what the issue could be?20:05
patchbotbjkeller: https://review.openstack.org/#/c/274906/ - swift - Headers now use a case incensitive dictionary20:05
siva_krishnanJust had question about "swift-recon -u" command. when I was looking through recon code, I saw it was adding mounted drives to unmounted list as well. Can someone please confirm this ?20:08
*** jmccarthy1 has quit IRC20:11
*** diazjf has quit IRC20:11
*** jmccarthy has joined #openstack-swift20:11
*** zhill has quit IRC20:16
*** mwheckmann has joined #openstack-swift20:29
*** asettle has quit IRC20:32
*** NM has quit IRC20:34
*** _JZ_ has quit IRC20:34
mwheckmannHello. Anyone familiar with intermittent timeouts connecting to memcached? I keep seeing the following under load: "proxy-server: STDERR: ERROR:root:Timeout talking to memcached: 172.16.0.17:11211"20:39
mwheckmannI have 2 separate memcache servers setup (on the proxies) and two proxies.20:39
mwheckmannThis happens no matter what config value I set for "memcache_max_connections"20:40
mwheckmannmemcached's are configured for 4k connections max, but I don't get anywhere near that.20:40
*** haomaiwa_ has joined #openstack-swift20:41
claygsiva_krishnan: it looks like it wants to return only unmounted devices?  is using the utils.check_mount to set the boolean flag - and only the mounted is not True is appended to the mountlist that's retruend?20:41
*** diazjf has joined #openstack-swift20:42
claygmwheckmann: I've seen network issues cause memcache timeouts - and sometimes memory pressure on the nodes - but nothing systemic20:42
mwheckmannI'm actually suspecting CPU contention with the proxy processes20:43
claygmwheckmann: newer versions of swift allow some tuning via config for the very agressive timeout value to try and debug how slow the connections acctually are - but I've never since had an operational scearnio that required testing them20:43
clayghow many cores/procs do you have on the proxies?20:43
mwheckmann24 threads20:43
mwheckmann2x proc (6 core each)20:44
mwheckmann48 proxy processes20:44
mwheckmannclayg: those timeouts documented somewhere? I'm running 2.5.020:45
claygmwheckmann: oh like HT? and you have 48 workers on.... 12 physical cores?20:45
mwheckmannclayg: correct20:45
claygmemcache.conf-sample?20:45
mwheckmannmy benchmarking shows that 48 is the sweet spot.20:45
siva_krishnanclayg When I was trying to write unit test for check_mount and gave [{u'device': u'sdb4', u'mounted': False}, {u'device': u'sdb8', u'mounted': True}] as input . It added both sdb4 and sdb8 in the unmounted list20:45
mwheckmannmy stuff is in proxy-server.conf under the cache section. My understanding is that it's the same?20:46
*** haomaiwa_ has quit IRC20:46
claygmwheckmann: well maybe :\  I mean that seems like the kernel is going to be doing a lot of process juggling - I've seen proxies with a lot more physical cores than 12 run more workers than that tho - so maybe you're fine?20:46
mwheckmannmemcache_servers = 172.16.0.17:11211,172.16.0.18:1121120:46
mwheckmannmemcache_max_connections = 220:47
mwheckmannbut I've gone up to 8 or more for the latter setting with no diff20:47
claygsiva_krishnan: I probably don't follow - the get_unmouted code rolls over all the devices in the listdir and calls checkmount and builds the mpoint dict - but the inclusion into the returned mountlist (of dicts) is conditional on mounted is not True20:47
*** diazjf has quit IRC20:48
mwheckmannI'm going to try re-nicing the memcached processes as a quick 'n dirty test to see if that makes it go away. That should prove contention.20:48
claygmwheckmann: yeah I'm thinking [memcahce] connect_timeout might be worth playing with20:48
claygmwheckmann: ok, good luck20:49
*** proteusguy__ has quit IRC20:49
claygmwheckmann: oh sorry, yeah you should be able to set connect_timeout in the filter:cache section of the proxy-config just the same as the seperate memcache config20:49
mwheckmannclayg: cool. thanks20:50
*** nadeem has joined #openstack-swift20:51
*** nadeem has quit IRC20:51
*** nadeem has joined #openstack-swift20:52
*** diazjf has joined #openstack-swift20:54
siva_krishnanclayg sorry I coudn't confirm if we are checking for mounted is true or false in umount_check method in cli/recon.py. I was referring to this one http://paste.openstack.org/show/4876220:58
*** asettle has joined #openstack-swift20:58
*** asettle has quit IRC20:58
claygsiva_krishnan: no, that's the wrong paste20:59
siva_krishnanhttp://paste.openstack.org/show/487627/20:59
siva_krishnanclayg sorry for that20:59
*** mingdang1 has joined #openstack-swift21:00
claygsiva_krishnan: ok, so what's the question there?21:00
*** proteusguy__ has joined #openstack-swift21:02
mwheckmannclayg: so re-nice'ing memcached to -20 (including all of it's threads) makes the problem go away. So contention was the issue when the proxies are being pushed to the max.21:03
mwheckmannI'm just going to leave things as they are.21:03
siva_krishnanhttp://127.0.0.1:6010/recon/unmounted: [{u'device': u'sdb1', u'mounted': False}, {u'device': u'sdb5', u'mounted': True}]. If this is given as input. unmounted drives should be retruned as 1 (sdb1) right21:04
siva_krishnanbut it was including sdb5 in the list as well21:04
*** mingdang1 has quit IRC21:05
*** rickyrem has joined #openstack-swift21:05
*** _JZ_ has joined #openstack-swift21:07
claygsiva_krishnan: yeah I don't think that method expects the recon data you're stubbing in?21:14
claygsiva_krishnan: a real object server won't return the mounted true device in that call21:14
claygsiva_krishnan: it might return some sort of non-boolean error string, or False - basically it expects everything coming back from the response deserves some kind of output21:15
claygsiva_krishnan: i'm sure you could *change* that?  but I don't think your test is doing a good just creating a scearnio that cli tool is *actually* going to run into?21:16
*** Gordoni has quit IRC21:17
siva_krishnanah ok got you!  I was under the impression that it would return true if devices are mounted. thanks for that info. would remove that input as well21:19
*** mingyu has quit IRC21:21
*** trifon has joined #openstack-swift21:27
claygsiva_krishnan: i mean you can curl http://storage.node:port/recon/unmounted and see what's up if you want?21:30
siva_krishnanyup I already saw it21:30
*** garthb_ has joined #openstack-swift21:30
clayga'ight21:31
siva_krishnanevery drive was showing as unmounted.21:31
claygwas this on a dev/vm?21:32
siva_krishnanyup21:32
siva_krishnanon dev21:32
siva_krishnanSAIO setup21:32
claygsiva_krishnan: i was noticing that there's some mount_check option plumbing that's missing from recon - might be interesting useful to support the configuration option for dir-check vs mount-point-check in the mount_check utils command21:32
*** garthb has quit IRC21:33
claygsiva_krishnan: I'm not sure how all the plumbing would work out - but yeah I also noticed my dev was (correctly!) telling me that none of the "devices" I have in the ring were real physical mounted devices21:33
claygsiva_krishnan: i also have a notion that it would be useful to update vsaio to carve up the loopback device with lvm - so that I can have real mount-points and one less difference between dev and real deployments21:34
ahalerecon saying all drives unmounted sounds like a real deployment21:35
notmynameheh21:36
siva_krishnansure clayg. will look into SAIO docs once I am done with this21:36
notmynameI know this has been asked before, but has anyone looked at swift under pypy recently?21:38
* notmyname asked, because he has21:38
claygnotmyname: not recently21:38
pdardeausiva_krishnan: i think clayg was referring to vagrant setup scripts for saio21:39
claygpdardeau: well I mean we could document an lvm setup too - or maybe there's a way to do multiple loopback devices - or you could use virtualbox storage volumes21:40
siva_krishnanpdardeau noted :)21:42
notmynameinitial pypy results were pretty good in some tests I ran this week. just changing the proxy server to run under pypy, and I got 230% puts-per-second21:47
notmynamefurther tests are required, of course, but the initial results are pretty promising21:52
pdardeaunotmyname: interesting. any idea how it compares to some of the go stuff that rax has?21:53
notmyname(of course that's the first question) ;-)21:53
notmynamepdardeau: no. I haven't run any of the golang object server perf tests (but I also need a lot of the stuff that isn't implemented in hummingbird)21:54
openstackgerritSivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for cli/recon.py  https://review.openstack.org/28254722:01
notmynamepdardeau: do you have any relative perf numbers on that?22:03
*** asettle has joined #openstack-swift22:07
notmynamepdardeau: also, I went from 800+ms time to first byte with cpython to 500ms ttfb on pypy (for reads)22:08
pdardeaunotmyname: no idea on go implementation improvement numbers22:08
pdardeaunotmyname: but vaguely recall scotticus saying that it was significant for their workload22:09
pdardeaunotmyname: interesting on the pypy speedup22:09
portantenotmyname: what did it take to run the proxy under pypy?22:10
portantewhat it is a large change?22:10
*** csmart has quit IRC22:10
portanteeasy or hard to deploy?22:10
*** csmart has joined #openstack-swift22:11
*** rickyrem has quit IRC22:11
*** asettle has quit IRC22:11
*** changbl has quit IRC22:12
*** petertr7 is now known as petertr7_away22:13
notmynameportante: really pretty easy, actually.22:16
notmynameportante: basically, there are a couple of c modules that had to be recompiled (or relinked) for pypy. and then it's a matter of calling pypy instead of cpython and making sure the PATH elements are correct22:17
notmynameno code changes in swift22:18
notmynamehowever, there should be one small patch coming next week that would be required for any prod pypy use. pypy and cpython do GC differently, and there's one place we don't do quite the right thing with a socket and pypy catches it while it works fine in cpython22:19
notmynameportante: speaking of performance stuff, have you done much with cpu frequency locking? if so, have you had any problems with locking each core at max? eg with heat/reliability/etc22:21
openstackgerritMerged openstack/swift: Fixed log format in object auditor  https://review.openstack.org/28194722:21
*** garthb__ has joined #openstack-swift22:29
*** haomaiwang has joined #openstack-swift22:29
*** garthb_ has quit IRC22:32
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873622:32
*** haomaiwang has quit IRC22:35
*** diazjf1 has joined #openstack-swift22:36
*** diazjf has quit IRC22:38
*** changbl has joined #openstack-swift22:40
*** StraubTW_ has quit IRC22:50
*** david-lyle has quit IRC22:50
*** david-lyle has joined #openstack-swift22:51
*** bjkeller has left #openstack-swift22:51
*** david-lyle has quit IRC22:54
*** david-lyle has joined #openstack-swift22:54
*** haomaiwang has joined #openstack-swift23:09
*** haomaiwang has quit IRC23:14
mattoliverauacoles_: yeah you should move to mattoliverau-land :)23:25
claygmattoliverau: oh goodness - delusions of gradeur much?23:25
claygmattoliverau: oh - did I read you right you won't make it to bristol?!23:26
mattoliverauclayg: nope :( Baby's due around then, and remaining married is important to me.23:26
* clayg 's heart breaks23:26
claygwhat about *our* love matt!?23:27
mattoliverauclayg: wouldn't it be funny if you came to Oz and found out I had my own province. :P23:27
claygmattoliverau: lol, *yes*23:27
mattoliverauclayg: sorry man, our love is important, but you ain't pregnant with my child :P23:28
claygyeah I can't take this joke any further23:28
claygi'll miss you bro23:28
mattoliverauclayg: yeah, getting close to some HR line I'm sure :P23:28
*** nadeem has quit IRC23:29
*** david-lyle_ has joined #openstack-swift23:29
mattoliverauclayg: yeah annoyed I can't make it. My bro lives in the UK and was going to be the perfect chance to go meet up with him23:29
*** zaitcev has joined #openstack-swift23:30
*** ChanServ sets mode: +v zaitcev23:30
*** david-lyle has quit IRC23:30
*** lpabon has quit IRC23:32
*** mingdang1 has joined #openstack-swift23:36
*** mingdang1 has quit IRC23:40
openstackgerritMatthew Oliver proposed openstack/swift: Add concurrent reads option to proxy  https://review.openstack.org/11771023:50
mattoliverau^^ new concurrecnt gets patch23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!