Thursday, 2015-03-05

*** ho has joined #openstack-swift00:12
hogood morning guys00:19
*** annegentle has joined #openstack-swift00:24
*** tsg_ has quit IRC00:25
*** dmorita has joined #openstack-swift00:26
zaitcevoh yes00:27
zaitcevbeat mattoliverau by 5 seconds00:27
* clayg hugs zaitcev ???00:28
mattoliverauLol! Damn phone (am teathered ATM)00:28
zaitcevI was this > < close to -1 "change log message"00:28
mattoliverauLol00:29
*** annegentle has quit IRC00:36
*** devlaps has quit IRC00:41
notmynameclayg: back. looking00:52
zaitcevI have this ridiculous problem now00:56
zaitcevSomehow I got an account created that had 113 Meta headers. Some older cluster or other. It was fine until I decided to delete all that junk. BUT00:57
zaitcevI can't do it now00:57
zaitcevBecause the current code limits meta to 90. So, any attempt to POST, even to delete, ends with "400 too much meta, maxumum 90"00:58
*** kota_ has joined #openstack-swift00:58
notmynameheh. we closed that bug where subsequent requests don't allow stuff00:58
zaitcevThis is 2.2.2.00:59
notmynamehowever, I thought we left the ability to _delete_ stuff, no matter what00:59
zaitcevhmm.00:59
zaitcevI can delete the whole account, I suppose.00:59
notmynameor temporarily adjust swift.conf01:01
notmynameor track down why you can't delete metadata headers even if there are more than the limit stored01:02
notmynamezaitcev: actually, could you open a bug for that?01:02
*** Anticimex has quit IRC01:05
*** Anticimex has joined #openstack-swift01:05
*** annegentle has joined #openstack-swift01:15
*** annegentle has quit IRC01:16
*** annegentle has joined #openstack-swift01:16
homattoliverau: Is it possible have your re-review for #138342? I would like to escape a world 'merge conflicts' :)01:19
zaitcevbut, but, but... if I file a bug, I have to verify that it's resolved and someone may add a regression01:23
mattoliverauho: lol, sure, I'll get on that after lunch!01:26
homattoliverau: thanks!01:27
*** annegentle has quit IRC01:27
notmynamezaitcev: you gotta do that as a core reviewer anyway ;-)01:28
*** gyee has quit IRC01:36
charznotmyname: clayg I'm going to add py26 support to community cluster today. will ping you guys when I done.01:36
*** tsg has joined #openstack-swift01:47
*** zhill has quit IRC01:49
*** jamielennox is now known as jamielennox|lunc01:51
*** dmsimard_away is now known as dmsimard01:55
*** kota_ has quit IRC02:01
*** dmsimard is now known as dmsimard_away02:05
*** tsg_ has joined #openstack-swift02:18
*** lpabon_ has joined #openstack-swift02:19
*** tsg has quit IRC02:21
*** reed has quit IRC02:21
*** lpabon has quit IRC02:21
*** chmouel has quit IRC02:21
*** tsg_ has quit IRC02:21
*** tsg_ has joined #openstack-swift02:21
*** lpabon_ has quit IRC02:21
*** lpabon_ has joined #openstack-swift02:21
*** chmouel has joined #openstack-swift02:22
*** Fin1te has joined #openstack-swift02:22
*** Fin1te has quit IRC02:24
*** Fin1te has joined #openstack-swift02:24
*** Fin1te has quit IRC02:26
*** Fin1te has joined #openstack-swift02:27
*** Fin1te has quit IRC02:27
*** haomaiwa_ has joined #openstack-swift02:28
*** reed has joined #openstack-swift02:32
*** reed has quit IRC02:36
*** reed has joined #openstack-swift02:36
*** tsg_ has quit IRC02:46
*** tsg has joined #openstack-swift02:47
*** jamielennox|lunc is now known as jamielennox02:47
*** haomaiw__ has joined #openstack-swift03:15
*** haomaiwa_ has quit IRC03:15
*** jrichli has joined #openstack-swift03:21
*** swat30 has quit IRC03:37
*** swat30 has joined #openstack-swift03:38
*** thurloat has quit IRC03:42
*** tsg has quit IRC03:42
*** swat30 has quit IRC03:43
*** jamielennox is now known as jamielennox|away03:45
*** tsg has joined #openstack-swift03:45
*** thurloat has joined #openstack-swift03:46
*** swat30 has joined #openstack-swift03:46
*** kota_ has joined #openstack-swift03:50
*** ppai has joined #openstack-swift03:56
*** SkyRocknRoll has joined #openstack-swift04:01
*** SkyRocknRoll has joined #openstack-swift04:01
*** reed has quit IRC04:15
*** swat30 has quit IRC04:22
*** silor has joined #openstack-swift04:24
*** swat30 has joined #openstack-swift04:28
*** vishy has quit IRC04:47
*** jrichli has quit IRC05:22
*** tsg_ has joined #openstack-swift05:26
*** tsg has quit IRC05:29
*** zhill has joined #openstack-swift05:41
openstackgerritMerged openstack/swift: Fix EC chunking  https://review.openstack.org/16107005:47
*** tsg_ has quit IRC05:54
*** sluo_wfh has joined #openstack-swift05:56
*** sluo_wfh has quit IRC06:04
*** echevemaster has joined #openstack-swift06:07
*** sluo_wfh has joined #openstack-swift06:14
*** zhill has quit IRC06:18
*** nshaikh has joined #openstack-swift06:18
*** echevemaster has quit IRC06:35
*** Krast has joined #openstack-swift06:51
*** fifieldt_ has joined #openstack-swift07:02
*** ppai has quit IRC07:08
*** ppai has joined #openstack-swift07:30
*** openstackgerrit has quit IRC07:36
*** openstackgerrit has joined #openstack-swift07:36
*** fifieldt_ has quit IRC07:58
*** Bsony has joined #openstack-swift08:06
*** jordanP has joined #openstack-swift08:06
*** rledisez has joined #openstack-swift08:08
*** geaaru has joined #openstack-swift08:25
*** nikhil|afk has joined #openstack-swift08:29
*** nshaikh has quit IRC08:30
*** Krast has quit IRC08:33
*** Trixboxer has quit IRC08:38
*** mmcardle has joined #openstack-swift08:38
*** jistr has joined #openstack-swift08:49
*** acoles_away is now known as acoles08:58
*** Trixboxer has joined #openstack-swift09:00
*** nellysmitt has joined #openstack-swift09:03
*** silor has quit IRC09:04
*** akhivin has quit IRC09:32
*** khivin has quit IRC09:32
*** khivin has joined #openstack-swift09:32
*** cutforth has quit IRC10:08
*** haomaiw__ has quit IRC10:15
*** sluo_wfh has quit IRC10:22
*** jordanP has quit IRC10:29
*** jordanP has joined #openstack-swift10:50
*** aix has joined #openstack-swift10:55
openstackgerritHisashi Osanai proposed openstack/swift: Add some debug output to the ring builder  https://review.openstack.org/14694511:04
charznotmyname: clayg looks py26 is work. :)11:26
charznotmyname: clayg ^^^11:27
openstackgerritCharles Hsu proposed openstack/swift: Add DLO segments validation while PUT DLO manifest object.  https://review.openstack.org/16168311:36
*** silor has joined #openstack-swift11:38
*** kota_ has quit IRC11:43
mattoliveraucharz: why does the py27 swiftstack tests in #146945 fail EC tests when the change isn't apart of the EC branch? E.g it fails "test_PUT_ec" which doesn't exist in master branch11:57
mattoliverausorry I meant cluster-swift-python2611:58
openstackgerritMerged openstack/python-swiftclient: Add improvements to MD5 validation.  https://review.openstack.org/15667712:01
*** EmilienM|afk is now known as EmilienM12:04
*** Trixboxer has quit IRC12:09
*** ho has quit IRC12:11
*** km has quit IRC12:21
*** dmorita has quit IRC12:29
*** tsg has joined #openstack-swift12:58
*** mmcardle has quit IRC13:01
*** mmcardle has joined #openstack-swift13:14
*** mahatic has joined #openstack-swift13:23
*** Bsony_ has joined #openstack-swift13:24
*** Bsony has quit IRC13:26
*** aix has quit IRC13:34
openstackgerritPrashanth Pai proposed openstack/swift: Handle ENOSPC in mkstemp()  https://review.openstack.org/16171313:48
*** rdaly2 has joined #openstack-swift13:50
*** ppai has quit IRC13:54
*** bill_az has joined #openstack-swift13:57
*** aix has joined #openstack-swift14:02
openstackgerritThiago da Silva proposed openstack/swift: Use Container override header to update etag and size  https://review.openstack.org/16103014:06
*** annegentle has joined #openstack-swift14:39
*** lpabon has joined #openstack-swift14:40
*** SkyRocknRoll has quit IRC14:46
*** lpabon has quit IRC14:47
*** lpabon_ has quit IRC14:47
*** lpabon has joined #openstack-swift14:59
*** dmsimard_away is now known as dmsimard15:08
*** jrichli has joined #openstack-swift15:12
*** jordanP has quit IRC15:13
*** nellysmitt has quit IRC15:17
*** tsg has quit IRC15:20
eikkenotmyname: thanks for the heads-up. Wrt 2.6 compat, it's mostly for Swift 1.13 installs on RHEL6, which some of our customers seem to stick to... and we try to maintain a single codebase15:24
*** jordanP has joined #openstack-swift15:24
notmynameeikke: same here :-)15:42
*** sfineberg has joined #openstack-swift15:46
eikkenotmyname: luckily we now have a CI in place which htests all that stuff. I noticed I made some 2.6-incompatible changes in the splice patches as well (whwich were patched later on), guess if you want to stick with 2.6 support it'd be wise to add that to the gerrit ci checks?15:57
openstackgerritpaul luse proposed openstack/swift: Ssync fix for EC PUT path  https://review.openstack.org/16105715:57
*** Anticimex has quit IRC16:19
*** Anticimex has joined #openstack-swift16:20
*** tellesnobrega has quit IRC16:24
*** amrith has joined #openstack-swift16:26
*** tellesnobrega has joined #openstack-swift16:29
*** Bsony_ has quit IRC16:30
*** aerwin has joined #openstack-swift16:35
openstackgerritThiago da Silva proposed openstack/swift: fix small py26 compatibility issue  https://review.openstack.org/16177016:35
*** lcurtis has joined #openstack-swift16:40
*** rdaly2 has quit IRC16:46
*** tsg has joined #openstack-swift16:46
eikkeheh ^^16:47
*** bill_az has quit IRC16:50
notmynamegood morning16:59
jrichligood morning16:59
*** Bsony has joined #openstack-swift16:59
notmynameeikke: yup. there isn't any gating on py26 inside of openstack (because reasons, mostly around not supporting the older distros that have py26). but charz is working on getting py26 unit tests running on the community cluster17:00
eikkenotmyname: I could spend some time on getting the swift unit tests running on our CI as well17:00
eikkebrings ubuntu12/14 and centos6/717:00
notmynameheh. an just now I saw that the next TC meeting has on the agenda "remove py26 from guidelines" https://review.openstack.org/#/c/159936/1/reference/project-testing-interface.rst17:01
charzheh17:02
notmynameoh! looks like charz has already added py26! thansk17:03
*** Anticimex has quit IRC17:04
charznotmyname: You're welcome! Thanks for mattoliverau's help to correct the problem in py26 early. :)17:05
*** Anticimex has joined #openstack-swift17:06
*** jistr has quit IRC17:08
*** erlon has joined #openstack-swift17:16
*** jordanP has quit IRC17:17
*** silor has quit IRC17:19
openstackgerritStuart McLaren proposed openstack/python-swiftclient: Retry download of object body  https://review.openstack.org/15920817:24
*** rledisez has quit IRC17:28
*** annegentle has quit IRC17:29
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925017:38
*** jrichli has quit IRC18:02
*** nshaikh has joined #openstack-swift18:09
*** mmcardle has quit IRC18:10
*** wer_ has joined #openstack-swift18:12
*** wer_ has left #openstack-swift18:12
*** tab___ has joined #openstack-swift18:13
tsgnotmyname: ping18:29
*** annegentle has joined #openstack-swift18:31
tsgnotmyname: will email you on the latest on EC libs18:32
*** tsg is now known as tsg_away18:32
*** zhill has joined #openstack-swift18:33
notmynametsg_away: thanks18:34
*** jrichli has joined #openstack-swift18:40
*** aix has quit IRC18:40
mordrednotmyname, tsg_away: Spamaps is working on escalating your liberasurecode stuff in ubuntu18:41
notmynamemordred: thanks18:42
*** amrith is now known as _amrith_18:46
*** _amrith_ is now known as amrith18:49
*** DCWilliams_VA has joined #openstack-swift18:53
*** geaaru has quit IRC18:58
*** gyee has joined #openstack-swift19:01
openstackgerritThiago da Silva proposed openstack/swift: fix small py26 compatibility issue  https://review.openstack.org/16177019:03
*** tab___ has quit IRC19:16
*** DCWilliams_VA has quit IRC19:25
*** DCWilliams_VA has joined #openstack-swift19:26
*** DCWilliams_VA has quit IRC19:26
*** DCWilliams_VA has joined #openstack-swift19:26
*** tsg_away is now known as tsg19:27
tsgmordred: many thanks!19:27
tsgmordred: any idea where zigo is these days?19:27
tsgmordred: I have been trying to reach him for the last week, but cannot (he is the original Debian package maintainer)19:28
mordredtsg: nope. no idea19:34
*** annegentle has quit IRC19:35
*** annegentle has joined #openstack-swift19:35
lcurtishello all...if i am using keystone auth, would a swift 'account' map to a tenant in openstack?19:44
*** DCWilliams_VA has quit IRC19:52
*** mmcardle has joined #openstack-swift20:00
*** rmcall has joined #openstack-swift20:03
acoleslcurtis: yes, the swift account is usually <some_prefix>_tenantid, and <some_prefix> is typically AUTH_, so you end up with swift account name being AUTH_tenantid20:11
*** fifieldt has quit IRC20:11
*** fifieldt_ has joined #openstack-swift20:12
*** mmcardle has quit IRC20:14
claygalpha_ori: just a few ideas -> https://github.com/swiftstack/counterd/commit/b7bd9b7c80bee3dcff224fd4f6053a5b74f44bf120:15
claygbah :\20:15
*** openstackgerrit has quit IRC20:25
*** openstackgerrit has joined #openstack-swift20:26
*** acoles is now known as acoles_away20:28
*** lpabon has quit IRC20:28
claygalpha_ori: peluse: so on the fragment index change - what do you want to do with tombstones?20:30
claygacoles_away: peluse: all of my comments except for "delete is broken" were also notes to self - and I had delete's working - but wasn't sure if "remove fragment index from tombstone" was the right answer?20:31
lcurtisacoles - thank you!20:32
peluseclayg, I'm sorta kinda online here for a few min.  I haven't been able to look at your comments yet as I have to sorta pay attention in this meeting.  is there one comment I can go look at real quick for context on your question?20:34
pelusewell, I'll just take a min here and look at diskfile comments...20:35
claygdon't worry about the comments - i was sorta realing from all the stuff going on in that patch - I think i have it now20:40
claygthere was one spot where the brokeness was obvious - something about giving a timestamp object to ts_to_fname20:40
claygin diskfile delete - anyway - there was gist that suggested a fix - which was basically to remove all the fragment index stuff from tombstones20:41
peluseOK, started reading the diskfile comments so will finish then look at delete... few min20:43
*** david-lyle_afk has joined #openstack-swift20:45
*** david-lyle_afk has quit IRC20:47
*** david-lyle_afk has joined #openstack-swift20:47
*** nshaikh has left #openstack-swift20:51
peluseclayg, yeah delete needs to be looked at for sure.  I haven't touched that area in a while20:57
claygpeluse: seems to work on feature/ec w/o a fi21:00
*** david-lyle_afk is now known as david-lyle21:03
peluseclayg, yeah, I would not be surprised if I broke delete w/the multiple fi patch21:03
claygok, yeah i think https://gist.github.com/clayg/d349be91bfad19b3cd85 is a totally reasonable fixup - acoles_away is probably already on it21:04
claygthanks for the responses - I'll keep looking at other things21:04
*** bandarji has joined #openstack-swift21:04
clayglike COPY seems to be broken21:05
peluseyup, I like it - thanks for wading through all of this too21:05
claygand I'm still pretty paranoid about not having the right md5's in the put responses or contaier listings - I think there's a patch on that up for review somewhere?21:05
peluseFYI I'm trying to get the OK to come out for a day next week also so we can get through the reconstructor more quickly/efficicently too21:05
claygpeluse: no problem - thanks for doing all the work and taking the brunt of the "well home come you did it like this" whining21:05
claygpeluse: yes another meetup would be good I think - but we also just need some time to churn through the code and work on tests21:06
pelusethanks and yeah, for sure on the tests!21:07
peluseallright I think its almost the end of the day here in this backwards part of the country :)21:08
pelusetime for a cerveza...21:09
*** aerwin has quit IRC21:11
*** lcurtis has quit IRC21:14
openstackgerritMerged openstack/swift: Minor change to the service token sample test config  https://review.openstack.org/15980721:17
mattoliverauMorning21:17
openstackgerritMerged openstack/python-swiftclient: Unindent a chunk of st_list  https://review.openstack.org/15465321:19
openstackgerritMerged openstack/swift: fix small py26 compatibility issue  https://review.openstack.org/16177021:19
*** rdaly2 has joined #openstack-swift21:20
*** mahatic has quit IRC21:27
tdasilvaclayg: https://review.openstack.org/#/c/161030/ should fix the md5 in the PUT responses and container listings21:27
notmynameis HP using multiregion swift clusters?21:27
*** tab____ has joined #openstack-swift21:36
claygtdasilva: awesome thanks - i was looking for that21:46
claygtdasilva: oh - it's small :D21:46
*** jamielennox|away is now known as jamielennox21:56
*** rdaly2 has quit IRC22:06
*** Bsony has quit IRC22:07
claygtorgomatic: man i would have swore your ec put fix addressed all the issues i was seening with large object upload on ec - but now I can't get feature/ec to download the full object for me22:10
claygtdasilva: interestingly feature/ec does seem to be returning the right etag and size on stat - even before your patch (wrong etag on put though...)22:10
torgomaticclayg: like, SLO/DLO large object, or just kinda-big object?22:11
claygtdasilva: your changed fixes the etag on upload - but not the get path22:11
clayglike just an object that's ~23MB22:11
torgomatichuh22:11
claygright - i would have swore after fix ec-chunk it was working fine22:11
torgomaticyeah, same here22:11
claygtorgomatic: i'm getting a pyeclib decode error22:11
torgomaticclayg: oh man those are annoying errors; they're just like "shit broke, yo" and don't really provide any hints as to what22:12
torgomaticwas the object freshly uploaded?22:12
claygyeah - but I think my config is jacked - i'm 6+3 and only 8 disks - not sure when I screwed that up - or why nothing looks at the ring and tells me I'm gunna have a bad time :'(22:13
claygI suppose *technically* with 8 frags you should still be able to rebuild it!  :'(22:13
claygtorgomatic: peluse: tdasilva: you guys right 8 disks right?  4+2?22:13
torgomaticclayg: yeah, if you're getting to the point of ECPyECLibECErrorECExceptionEC being raised, then the proxy thinks it's got enough connections to do the job22:14
claygk, well i'm dropping down to 4+2 - i suppose i could have gone back up to 12 disks22:15
claygok, phew - less ec chunks and enough disks works22:20
claygi'm going to go back up to 6+3 and 12 disks and make sure *that* works22:21
claygnotmyname: see if we move to go we get http2 for free -> https://http2.golang.org/22:29
claygok, something isn't right with 6+3, swift-ec-get script works but proxy blowsup22:38
torgomaticclayg: huh; let me finish up coding what I'm working on, then I'll go poke at that22:39
claygtorgomatic: i could use some help debugging - can you come ... :P22:39
torgomaticbah :P22:39
notmynameclayg: I'm holding out for http322:49
tdasilvawhat's the correct way to clear write access to a container? I'm setting write access like this: curl -i -X PUT -H "X-Auth-Token: $ADMIN" $URL/c1 -H "X-Container-Write: test:tester3" -H "X-Container-Read: " -H 'X-Versions-Location: versions'22:49
claygnotmyname: makes sense22:50
tdasilvaand trying to clear like this: curl -i -X PUT -H "X-Auth-Token: $ADMIN" $URL/c1 -H "X-Container-Write: " -H "X-Container-Read: " -H 'X-Versions-Location: versions'22:50
*** annegentle has quit IRC22:53
tdasilvammm...weird, had to put a pair of single quotes inside. e.g.: -H "X-Container-Write: ''"23:01
notmynametdasilva: you might me running into a curl issue there. older versions didn't send empty headers23:03
notmynameI don't remember if the "remove" syntax works on acls. (/me hopes)23:04
notmynamex-remove-contianer-read23:04
notmynamex-remove-contianer-read: foo   <-- ignores "foo" and removes the header23:04
mattoliverautdasilva: and you might want to use POST to update the existing container23:04
notmynameI know that works with -meta headers23:05
tdasilvamattoliverau: sorry, that was a bad copy and paste, but yes, i was usign POST and not really passing the x-versions-location23:05
tdasilvanotmyname, mattoliverau: I just noticed some inconsistency with acls and obj. versioning and I'm looking for some ideas on how to solve it. If you guys have some time, please take a look at my last comment here: https://review.openstack.org/#/c/134347/23:06
claygfor those playing along at home sam figured it out -> https://gist.github.com/clayg/baced99e9463838026df23:07
claygi'm going to try to write a test that does 9+3 and see if it fails23:07
*** Anticimex has quit IRC23:16
*** Anticimex has joined #openstack-swift23:17
*** tab____ has quit IRC23:22
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925023:50
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873623:51
*** openstack has joined #openstack-swift23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!