Tuesday, 2015-12-01

timburkenotmyname: to what degree should we worry about kilo and juno? they similarly use ignore-errors. juno caps coverage at 3.7.1, but kilo is uncapped00:02
*** jerrygb_ has joined #openstack-swift00:04
*** klrmn1 has joined #openstack-swift00:04
*** jerrygb has quit IRC00:05
notmynametimburke: only care if there is a gerrit branch for them (eg gerrit/stable/juno). if it's not there, then don't care00:06
*** ho has joined #openstack-swift00:07
*** zhill has quit IRC00:10
hogood morning!00:14
openstackgerritTim Burke proposed openstack/python-swiftclient: Change ignore-errors to ignore_errors  https://review.openstack.org/25159100:18
*** tsg has quit IRC00:19
*** klrmn1 has quit IRC00:22
*** klrmn1 has joined #openstack-swift00:22
*** tsg has joined #openstack-swift00:23
*** openstackstatus has quit IRC00:24
*** takashi has joined #openstack-swift00:25
*** openstackstatus has joined #openstack-swift00:26
*** ChanServ sets mode: +v openstackstatus00:26
mattoliverauho: morning00:27
homattoliverau: morning!00:27
takashigood morning.00:27
hotakashi: morning!00:27
takashiho: morning!00:28
*** sgundur has joined #openstack-swift00:29
openstackgerritMerged openstack/python-swiftclient: Suppress iso8601 logging from --debug output  https://review.openstack.org/22274300:31
kota_good morning00:41
mattoliveraukota_: morning00:41
mattoliveraunice to have everyone back, the channel has been very quiet00:42
kota_mattoliverau: :-)00:43
hokota_: morning!00:43
kota_ho: o/00:44
*** diogogmt has quit IRC00:45
*** sgundur has left #openstack-swift00:47
*** zhill has joined #openstack-swift01:10
*** peterlisak has quit IRC01:11
*** peterlisak has joined #openstack-swift01:12
*** zhill has quit IRC01:14
*** openstackgerrit has quit IRC01:22
*** openstackgerrit has joined #openstack-swift01:22
*** lpabon has joined #openstack-swift01:25
openstackgerritPeter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests  https://review.openstack.org/25160601:45
*** zhill has joined #openstack-swift01:46
*** haomaiwang has joined #openstack-swift01:46
openstackgerritPeter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests  https://review.openstack.org/25160601:47
*** zhill has quit IRC01:50
*** jerrygb_ has quit IRC01:51
*** jerrygb has joined #openstack-swift01:52
*** badari has quit IRC01:54
*** jerrygb has quit IRC01:55
*** haomaiwang has quit IRC02:01
*** haomaiwang has joined #openstack-swift02:01
*** ober37 has joined #openstack-swift02:03
*** ober37 has left #openstack-swift02:03
*** ober37 has joined #openstack-swift02:03
*** diogogmt has joined #openstack-swift02:04
*** zhill has joined #openstack-swift02:06
*** klrmn1 has quit IRC02:07
*** badari has joined #openstack-swift02:08
*** zhill_ has joined #openstack-swift02:10
*** zhill has quit IRC02:10
openstackgerritMerged openstack/swift: Expose tempurl's header restrictions via /info  https://review.openstack.org/23271202:11
openstackgerritMerged openstack/python-swiftclient: improve readme contents  https://review.openstack.org/23520902:13
*** zhill_ has quit IRC02:14
*** badari has quit IRC02:14
*** haomaiwang has quit IRC02:33
*** ober37 has quit IRC02:55
*** tsg has quit IRC03:05
*** breitz has quit IRC03:05
*** sanchitmalhotra has joined #openstack-swift03:07
*** sanchitmalhotra1 has joined #openstack-swift03:25
*** sanchitmalhotra has quit IRC03:27
*** lpabon has quit IRC03:35
openstackgerritMerged openstack/swift: add sample proxy pipeline for keystone integration  https://review.openstack.org/25150003:36
*** venkat_p has joined #openstack-swift03:39
*** links has joined #openstack-swift03:39
*** venkat_p has quit IRC03:39
*** venkat_p has joined #openstack-swift03:40
*** venkat_p has quit IRC03:40
*** venkat_p has joined #openstack-swift03:40
*** mahatic has joined #openstack-swift03:54
*** ppai has joined #openstack-swift03:55
openstackgerritMerged openstack/swift: Merge branch 'master' into feature/crypto  https://review.openstack.org/25150703:55
mahaticgood morning04:03
kota_mahatic: morning04:04
*** tsg has joined #openstack-swift04:04
homahatic: morning!04:09
*** sanchitmalhotra1 has quit IRC04:16
*** sanchitmalhotra has joined #openstack-swift04:16
*** links has quit IRC04:17
*** silor has joined #openstack-swift04:21
*** sanchitmalhotra1 has joined #openstack-swift04:37
mattoliveraumahatic: morning04:37
*** sanchitmalhotra has quit IRC04:40
*** ianbrown has joined #openstack-swift04:41
mahatickota_: ho mattoliverau: hello!04:41
openstackgerritMahati Chamarthy proposed openstack/swift: Decrypt multipart mime doc  https://review.openstack.org/24837704:50
*** gyee has quit IRC04:52
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925005:05
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873605:06
*** changbl has quit IRC05:07
*** haomaiwa_ has joined #openstack-swift05:08
*** haomaiw__ has joined #openstack-swift05:11
*** haomaiwa_ has quit IRC05:14
*** badari has joined #openstack-swift05:19
*** haomaiw__ has quit IRC05:30
*** ianbrown has quit IRC05:32
*** badari has quit IRC05:33
*** jerrygb has joined #openstack-swift05:35
*** links has joined #openstack-swift05:35
hoacoles: thanks for the review. i knew you have good dev env than me:P i prefer to not re-use containers and objects for the test because it's easy to understand the precondition for each test if there is no dependency with others. So my idea is reduce test cases using random.sample(cases, x). x will be around 250-300 cases (now 800). what do you think?05:44
hoacoles: above is default behavior and I will add a flag to config for full testing.05:46
openstackgerritMerged openstack/swift: Add config sample reference to KeystoneAuth docs  https://review.openstack.org/25152005:46
*** jerrygb has quit IRC05:52
*** tsg has quit IRC05:55
openstackgerritMerged openstack/swift: Fix Python 3 issues in utils  https://review.openstack.org/23703906:01
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873606:10
*** badari has joined #openstack-swift06:14
*** badari has quit IRC06:22
*** zhill has joined #openstack-swift06:27
*** ChubYann has quit IRC06:34
*** sc68cal has quit IRC06:40
mattoliverauclayg: sigh concurrent gets hurts my head, I went down the greenlet rabbit hole..again.. now my brain hurts, there must be a simpler way, but here is a cleaner way to break out early of a green pile that doesn't cause the issues we're seeing in the tests in the latest patchset. but now other tests fail so am rage quitting until the morning :)  patch 11771006:42
patchbotmattoliverau: https://review.openstack.org/#/c/117710/ - Add concurrent reads option to proxy06:42
*** sc68cal has joined #openstack-swift06:44
*** silor has quit IRC06:53
*** amit213 has quit IRC06:55
*** amit213 has joined #openstack-swift06:55
*** silor has joined #openstack-swift07:04
*** trifon has joined #openstack-swift07:05
*** arnox has joined #openstack-swift08:03
*** zhill has quit IRC08:16
*** ppai has quit IRC08:25
*** zhill has joined #openstack-swift08:30
*** zhill has quit IRC08:30
*** rcernin has joined #openstack-swift08:37
*** ppai has joined #openstack-swift08:37
*** takashi has quit IRC08:38
*** takashi has joined #openstack-swift08:38
*** takashi has quit IRC08:38
*** takashi has joined #openstack-swift08:39
*** jerrygb has joined #openstack-swift08:52
*** ho has quit IRC08:54
openstackgerritPeter Lisák proposed openstack/swift: Change schedule priority of daemon/server in config  https://review.openstack.org/23879909:01
*** NM has joined #openstack-swift09:18
*** hseipp has joined #openstack-swift09:22
*** jordanP has joined #openstack-swift09:29
*** ppai has quit IRC09:36
*** sanchitmalhotra has joined #openstack-swift09:41
*** sanchitmalhotra1 has quit IRC09:43
*** jistr has joined #openstack-swift09:52
*** ppai has joined #openstack-swift10:05
*** aix has joined #openstack-swift10:05
*** wuhg has joined #openstack-swift10:09
*** NM has quit IRC10:09
*** mahatic has quit IRC10:10
*** silor has quit IRC10:11
*** acoles_ is now known as acoles10:16
venkat_pHi all,10:31
*** jerrygb has quit IRC10:31
venkat_pone basic doubt10:32
venkat_pIs services in swift (account, container, object) knows where the other services are running?10:32
venkat_por only the proxy node knows ?10:33
*** mahatic has joined #openstack-swift10:33
*** NM has joined #openstack-swift10:36
ahale_yeah they know where services are, by reading the ring files that are pushed to all the machines - same as how proxies know i guess10:45
*** SkyRocknRoll has joined #openstack-swift10:47
*** kei_yama has quit IRC10:57
*** aix has quit IRC11:06
mahaticacoles: hi, thanks for the rebase. true, was cherrypicking the multi-range GET tests commit. This 248377 is ready for review11:07
*** jerrygb has joined #openstack-swift11:16
*** aix has joined #openstack-swift11:18
*** jerrygb has quit IRC11:19
*** Guest73439 has quit IRC11:27
*** flaper87 has quit IRC11:30
*** flaper87 has joined #openstack-swift11:30
*** chlong has quit IRC11:35
*** chlong has joined #openstack-swift11:35
*** flaper87 has quit IRC11:39
*** flaper87 has joined #openstack-swift11:47
*** flaper87 has joined #openstack-swift11:47
*** tsg has joined #openstack-swift11:54
openstackgerritEran Rom proposed openstack/swift: Container-Sync to iterate only over synced containers  https://review.openstack.org/20580311:59
*** zackmdavis has quit IRC12:05
*** zackmdavis has joined #openstack-swift12:07
*** jerrygb has joined #openstack-swift12:20
acolesmahatic: ok12:26
*** jerrygb has quit IRC12:27
*** NM has quit IRC12:30
mahaticacoles: I was wondering where in the line will this patch 211451 fit in? I saw your note on trello for a round-trip test for encrypter/decrypter12:34
patchbotmahatic: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto12:34
acolesmahatic: imho this ^^ would be first i.e. based on feature/crypto12:36
acolesmahatic: i remember when this was first discussed there were differing opinions as to whether the tests should use real crypto or not. I still favour it.12:37
mahaticacoles: right. will rebase this one and get it up to speed. It needs to be rebased on the latest revision of container listing that was merged12:40
acolesmahatic: thanks!12:41
*** sileht has joined #openstack-swift12:47
*** jmccarthy has quit IRC12:49
*** jmccarthy has joined #openstack-swift12:50
*** proteusguy has quit IRC12:55
*** jerrygb has joined #openstack-swift13:01
*** silor has joined #openstack-swift13:01
openstackgerritMerged openstack/python-swiftclient: Unification of manpages and docstrings  https://review.openstack.org/24522713:03
*** silor1 has joined #openstack-swift13:06
*** silor has quit IRC13:08
*** silor1 is now known as silor13:08
*** proteusguy has joined #openstack-swift13:10
*** venkat_p has quit IRC13:12
openstackgerritPeter Lisák proposed openstack/python-swiftclient: Add --decode-content option  https://review.openstack.org/18495713:17
*** stevemar has quit IRC13:22
*** stevemar_znc has joined #openstack-swift13:23
*** links has quit IRC13:47
*** wuhg has quit IRC13:51
*** tsg has quit IRC13:53
*** ppai has quit IRC14:01
*** sanchitmalhotra has quit IRC14:04
*** breitz has joined #openstack-swift14:05
*** mahatic has quit IRC14:16
*** venkat_p has joined #openstack-swift14:22
*** haomaiwa_ has joined #openstack-swift14:35
*** badari has joined #openstack-swift14:41
*** petertr7_away is now known as petertr714:53
*** blmartin has joined #openstack-swift14:55
openstackgerritChristian Schwede proposed openstack/swift: Add functional test for repeated SLO segments  https://review.openstack.org/25190915:04
*** tsg has joined #openstack-swift15:06
*** NM has joined #openstack-swift15:06
*** sgundur has joined #openstack-swift15:07
*** SkyRocknRoll has quit IRC15:14
*** sgundur has quit IRC15:18
*** sgundur has joined #openstack-swift15:18
pchngacoles: If mahatic's patch 211451 is using real crypto and doing a round-trip, I might just abandon my change 251606, which is doing a round-trip test, but with the FakeCrypto (that's not favoured)15:21
patchbotpchng: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto15:21
pchngacoles: Either that, or change my patch 211451 to use real crypto for round-trip and base it on mahatic's patch 21145115:22
patchbotpchng: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto15:22
patchbotpchng: https://review.openstack.org/#/c/211451/ - Modify unit tests to include real crypto15:22
pchngerr..  my patch is 251606, sorry15:22
acolespchng: i just took a quick look and i don't think 211451 adds any new tests, so rebasing 251606 and having it use real crypto would seem like the way forward.15:24
acolespchng: rebasing 251606 on 211451 perhaps, if necessary - I see its a new module so maybe it is independent15:25
*** chsc has joined #openstack-swift15:26
pchngacoles: You're right, I think it's independent because I created a new module just for the round-trip tests. So no need to rebase.15:26
pchngacoles, jrichli: I think mahatic's changes in 211451 are adding real crypto into the existing *separate* encrypter/decrypter tests, while I'm adding the new round-trip ones. So I'll just amend and change mine to use real crypto.15:27
pchngthanks for the input!15:27
acolespchng: sounds good.15:28
*** siva_krishnan has joined #openstack-swift15:38
openstackgerritPeter Chng proposed openstack/swift: Add round-trip encrypter/decrypter unit tests  https://review.openstack.org/25160615:39
*** diogogmt has quit IRC15:39
*** diogogmt has joined #openstack-swift15:41
*** aix has quit IRC15:49
gmmahanotmyname: peluse: Good Morning15:53
gmmahasorry was on an extended thanksgiving break.. Just got the kid and wife on a plane back to San Fransico15:54
pelusemorning!15:54
peluseno problem man15:54
*** diogogmt has quit IRC15:55
*** petertr7 is now known as petertr7_away16:02
*** wshao has joined #openstack-swift16:04
gmmahapeluse: guesing the keystone piece that you wanted to me to touch is done.. was there anything else you had in mind? :)16:04
*** rcernin has quit IRC16:04
*** venkat_p has quit IRC16:05
pelusegmmaha: nope, notmyname nailed that one already16:07
gmmaha:)16:08
*** changbl has joined #openstack-swift16:09
notmynamegood morning16:10
*** SkyRocknRoll has joined #openstack-swift16:11
*** petertr7_away is now known as petertr716:13
*** petertr7 is now known as petertr7_away16:26
*** changbl has quit IRC16:27
*** petertr7_away is now known as petertr716:29
*** venkat_p has joined #openstack-swift16:29
*** venkat_p has quit IRC16:30
*** diogogmt has joined #openstack-swift16:41
*** changbl has joined #openstack-swift16:42
*** sgundur has quit IRC16:47
*** sgundur has joined #openstack-swift16:48
*** venkat_p has joined #openstack-swift16:55
*** petertr7 is now known as petertr7_away16:58
*** petertr7_away is now known as petertr716:58
*** venkat_p has quit IRC16:58
*** haomaiwa_ has quit IRC17:00
*** wshao has quit IRC17:01
*** links has joined #openstack-swift17:08
*** sgundur has quit IRC17:12
*** sgundur has joined #openstack-swift17:13
*** gyee has joined #openstack-swift17:14
*** klrmn1 has joined #openstack-swift17:23
*** stevemar_znc is now known as stevemar17:25
*** tsg has quit IRC17:31
*** petertr7 is now known as petertr7_away17:31
*** sgundur has quit IRC17:36
*** janonymous has joined #openstack-swift17:40
openstackgerritMerged openstack/swift: Test for content-type params in multi-range response  https://review.openstack.org/25042717:43
*** klrmn1 has quit IRC17:43
claygnotmyname: I think we should put "use oslo.config" to the wishlist - people get so confused/freaked-out everytime they're like "how does an openstack project not use oslo.config!?"17:48
notmynameclayg: is that from following the ML thread on oslo.messaging?17:49
claygnotmyname: and by "use oslo.config" I mean a) fix everything in oslo.config that doesn't work for us b) figure out how to make it work for upgrades c) type type type17:49
claygnotmyname: yeah17:49
*** janonymous_ has joined #openstack-swift17:49
notmynamelol. yeah it's (a) and (b) why nobody's done it yet ;-)17:50
notmynamebut as long as we acknowledge those, I'm ok with adding it to a wishlist17:50
claygnotmyname: really I guess I don't care if *we* use oslo.config - it's more like ho's situation with policies where he just needs to use the oslo thing but everything in the library totally expects olso.config17:50
claygnotmyname: is there something "below wishlist" like "alternative reality where motrals exist outside of finite time"17:51
claygnotmyname: so if we just had a pattern with some docsk that was like "when you need olso.config - DON'T FREAK OUT - we have a /etc/swift/oslo.conf that you can put all your poop in"17:52
claygload it like this -> __MAGIC__17:52
notmynameclayg: don't we need to have a big ol' CONF global singleton to use that, though?17:53
notmynamebut yeah, the "when you need oslo.conf, dont' freak out, do XYZ" would be good anyway. probably starting today17:53
claygnotmyname: yeah sure - but like we don't have to import it - only people that need to use it would17:53
*** sgundur has joined #openstack-swift17:54
claygnotmyname: last I looked the problem was that oslo.config is realy opiniated, like it's not super flexible about how the global conf gets made...17:54
*** jistr has quit IRC17:54
claygnotmyname: you'd think you could just be like oslo_conf = OsloConf.from_file('/path/from/my/for/realz/config')17:55
*** arnox has quit IRC17:55
claygbut because it's all global with like config option "registration" - it ends up being more like "oh did you import me?  What was sys.argv[1] - great we'll load that"17:56
claygso... that'd be the step a bit17:56
notmyname(since yesterday) I've been thinking of the "wishlist" items as just a place to put stuff that might be a good idea, but might not be. Just because someone adds a wishlist item doesn't mean it will get done or that it's even a good idea. so putting a "use oslo.config" there is perfectly fine IMO17:58
*** blmartin has quit IRC17:58
acolesclayg: thanks for the diffs! super improvements as always18:00
*** dmsimard is now known as dmsimard|afk18:00
openstackgerritjanonymous proposed openstack/swift: Eventlet green threads not released back to pool  https://review.openstack.org/22785518:04
*** klrmn1 has joined #openstack-swift18:14
*** tsg has joined #openstack-swift18:15
*** jordanP has quit IRC18:20
*** links has quit IRC18:24
*** klrmn1 has quit IRC18:28
*** hseipp has quit IRC18:31
*** rcernin has joined #openstack-swift18:37
*** klrmn1 has joined #openstack-swift18:38
*** petertr7_away is now known as petertr718:40
*** siva_krishnan has quit IRC18:40
*** ChubYann has joined #openstack-swift18:42
*** vinsh has quit IRC18:53
acolesclayg: also your comment here https://gist.github.com/clayg/039a19b9d1d320b01a5d reminded me that had been bugging me18:55
*** klrmn1 has quit IRC18:59
notmynameacoles: what's status on fast-POST?19:00
openstackgerritAlistair Coles proposed openstack/swift: Make ECDiskFile report all fragments found on disk  https://review.openstack.org/23112119:00
acolesnotmyname: well, i was going to work on fast-post today but ended up on ^^ instead.19:01
*** gyee has quit IRC19:02
notmynamethat's good too :-)19:02
acolesnotmyname: i need to fix the suffix hash calculation on fast-post19:02
notmynameok19:02
acolesbecause clayg spotted that sync'd dirs could in fact have different hashes :/ i think its fixable just haven't got there yet19:02
*** patchbot has quit IRC19:03
acolesand i need to figure out how to handle slo's swift_bytes being appended to content-type, which slo can't reasonably do during a post19:04
*** siva_krishnan has joined #openstack-swift19:04
acolesnotmyname: so fast-post is not forgotten!19:04
*** janonymous_ has quit IRC19:05
openstackgerritAlistair Coles proposed openstack/swift: Merge branch 'master' into feature/crypto  https://review.openstack.org/25202419:08
acolesnotmyname: another easy merge ^^ :)19:09
*** tsg has quit IRC19:09
*** patchbot has joined #openstack-swift19:10
acolesnotmyname: just to explain the flurry of merges...stuff has been landing on master that we could use on feature/crypto. i wasn't expecting it all to land on master in quick succession.19:10
notmynameacoles: didn't you just do that yesterday?19:10
notmynameah ok19:10
acolesmahatic ^^ fyi19:11
*** klrmn1 has joined #openstack-swift19:12
*** patchbot has quit IRC19:12
*** patchbot has joined #openstack-swift19:13
*** acoles is now known as acoles_19:13
*** janonymous_ has joined #openstack-swift19:14
*** janonymous_ has quit IRC19:21
*** janonymous_ has joined #openstack-swift19:33
openstackgerritBill Huber proposed openstack/swift: Refactor server side copy as middleware  https://review.openstack.org/15692319:41
notmynamewbhuber: thanks for working on that one19:43
wbhubernotmyname: sure.  need to consult thiago on removing copy hooks, though.19:44
*** cdelatte has quit IRC19:44
*** cdelatte has joined #openstack-swift19:45
notmynamewbhuber: oh, and I notice that one has DocImpact in the commit message. read the link in the topic about changes there19:45
*** dmsimard|afk is now known as dmsimard19:45
tdasilvawbhuber: i'm here :D19:46
tdasilvasorry, was away last week19:46
*** cdelatte has quit IRC19:49
wbhubernotmyname: guess DocImpact in the commit message needs to be clarified.19:49
wbhubertdasilva: so was i.19:50
*** cdelatte has joined #openstack-swift19:50
wbhubertdasilva: the changes in the commit message mention that the copy hooks in the config need to be eliminated when this middleware is placed before dlo/slo?19:51
*** petertr7 is now known as petertr7_away19:51
tdasilvawbhuber: yeah, so..that's a goal as part of moving copy to middlware...19:53
tdasilvawbhuber: ho had a good summary of what's left to do in one of his comments19:54
tdasilvawbhuber: i think the first step is this: make a common helper for versioned_write middleware and copy middleware19:54
wbhubertdasilva: noted19:56
*** petertr7_away is now known as petertr719:57
tdasilvawbhuber: you might also want to follow up with torgomatic because he might have started on that first step19:57
* torgomatic didn't make any useful progress on that19:57
tdasilvaok19:57
wbhuberok19:57
tdasilvawbhuber: also, just a heads up, there's an issue with SLO manifests...19:58
notmynametdasilva: yeah, I'm reviewing that now19:58
notmynameabout to +2/+A19:58
notmynamefinal tests running19:58
tdasilvanotmyname: mmm..not sure we are talking about the same thing19:59
tdasilvawhat's the patch?19:59
notmynameoh ok :-)19:59
tdasilva:D19:59
notmynamepatch 250099 and it's dependency19:59
patchbotnotmyname: https://review.openstack.org/#/c/250099/ - Fix crash when a SLO repeats a segment.19:59
tdasilvaok...no..the issue is raised when moving the copy middlware to the left of SLO. the first part of a copy (GET) on a SLO manifest returns a manifest that is not "valid" for a PUT request.20:00
notmynameyeah, totally differnet issues with SLOs ;-)20:01
timburkesounds like https://bugs.launchpad.net/swift/+bug/125248220:02
openstackLaunchpad bug 1252482 in OpenStack Object Storage (swift) "make slo multipart-manifest=get better" [Undecided,New]20:02
tdasilvaso when doing the PUT part, you might want to set some kind of flag on the env. so that the slo middlware will not try to validate the manifest20:02
tdasilvatimburke: yeah, sounds exactly like that20:02
notmynameyes! I was just frustrated by that with testing this other patch20:02
timburkeand i was frustrated by it while doing slorange20:03
timburkeis multipart-manifest=get an official, supported API? can we make slo return something that looks more like an uploaded manifest? or should we change it so it can also eat backend manifests? i'm not sure i condone letting middleware PUT slo manifests without any validation, even if it should be fine on a copy...20:07
timburkeoh, and will the copy-as-middleware change also resolve https://bugs.launchpad.net/swift/+bug/1260446? it seems like it may...depending on implementation...20:09
openstackLaunchpad bug 1260446 in OpenStack Object Storage (swift) "when you copy a slo the destination doesn't get its content-length and etag set correctly in the container listings" [Undecided,In progress] - Assigned to Alistair Coles (alistair-coles)20:09
notmynameyeah, it's the only way to get manifests back out, so it's a thing. but I hate that curl .../foo?multipart-manifest=get | curl .../bar?multipart-manifest=put doesn't work20:10
*** blmartin has joined #openstack-swift20:12
*** silor has quit IRC20:13
*** janonymous_ has quit IRC20:13
timburkenotmyname: sure, it's a thing, but we don't give any guidance on its format (beyond "not what you sent me"), and even state that this should primarily be used for debugging: https://github.com/openstack/swift/blob/848d729/swift/common/middleware/slo.py#L148-L15420:19
notmynameyeah20:19
timburke(granted, i'd need to fix swiftclient to not depend on the existing format....)20:19
notmynamewhat about the put command accepting 2 different versions?20:20
timburkeyeah, i rather liked that idea when i said it :)20:20
notmynamehash=etag, name=path, content-length=size-bytes, and ignore extra keys20:21
*** zhill has joined #openstack-swift20:22
timburkestill probably wouldn't fix https://bugs.launchpad.net/swift/+bug/1213200 but it's definitely more useful than before20:22
openstackLaunchpad bug 1213200 in OpenStack Object Storage (swift) "Can't confirm receipt of multipart-manifest PUT w/ETag" [Wishlist,Confirmed]20:22
*** NM has quit IRC20:31
notmynameFYI a swift user's comments on using swift. https://twitter.com/duncsand/status/671783985782083585 (due to twitter's IMO poor UI, be sure to click the "view other replies" link)20:31
notmynametl;dr auth is hard, auth is hard, a "quick-start" guide would be nice20:32
*** sjmc7 has quit IRC20:32
* notmyname lunk20:32
* notmyname lunch20:33
*** aerwin has joined #openstack-swift20:40
*** tsg has joined #openstack-swift20:40
aerwinhello all.20:40
*** tamizh_geek has quit IRC20:44
*** tamizh_geek has joined #openstack-swift20:44
timburkenotmyname: on 2, i wonder how many of the endpoints were for a service with type object-store...as evidenced from https://wiki.openstack.org/wiki/API_Working_Group/Current_Design/Service_Catalog there's a lot of variability, but at least that part seems consistent, and i'd hope it should narrow down the choices a lot20:47
*** zhill has quit IRC20:48
notmynametimburke: yeah, it should20:56
*** doxavore has joined #openstack-swift20:59
openstackgerritSivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py  https://review.openstack.org/24467821:03
*** changbl has quit IRC21:12
claygnotmyname: oh wow, that confusing - so auth, auth, and docs21:17
notmynameyeah, I'm really surprised by the 66-endpoint service catalog. sounds like once he got into the actual swift parts, things were working21:18
claygok, on patch 117710 today - gunna see what I can do to help mattoliverau with those unittests21:25
patchbotclayg: https://review.openstack.org/#/c/117710/ - Add concurrent reads option to proxy21:25
claygthanks for merging all the keystone/pipeline/docs stuff folks!21:26
blmartinmattoliverau: if you get a moment I have a sharding question, I'm only getting shards into left containers (no .gt containers)21:29
*** rcernin has quit IRC21:31
*** jerrygb has quit IRC21:32
*** elligottmc has joined #openstack-swift21:35
*** vinsh has joined #openstack-swift21:35
mattoliverauMorning21:45
mattoliverauclayg: thanks for taking a look21:46
mattoliveraublmartin: I pushed a new change up that fixes a few data consistences issues, mainly better at syncing/replicating the pivot points. Have you tried rebasing with master?21:47
blmartinmattoliverau: I pulled the latest one you had with the new_part changes21:48
blmartinI wiped everything and started from scratch!21:49
mattoliverauOK, if that's not helping, can you explain and put steps to recreate in you trello card? And I'll take a look.21:50
blmartinsure21:51
blmartinI'll keep working though it because I need it working before I break everything with deleting non-leaf containers21:51
mattoliverauLol, please do :)21:53
elligottmcblmartin:  I just replied to the Trello card on deletions21:56
elligottmcHas anyone tried creating ~100 containers and sharding them?21:58
elligottmcI have been doing that inadvertently while writing these tests and notice that sharding definitely slows down21:59
notmynamea few FYI things from the just-concluded cross-project meeting22:05
notmyname(1) the meeting is now held in #openstack-meeting-cp22:05
notmyname(2) patch 226157 is getting a lot of attention as a way to change the way compatibility is done for libraries. I *think* this means no more stable/* releases for swiftclient22:06
patchbotnotmyname: https://review.openstack.org/#/c/226157/ - Backwards compat for libraries and clients.22:06
notmyname(3) there's now a new group of cross-project liaisons to manage openstack-specs22:06
notmyname /fin22:06
*** elligottmc has quit IRC22:12
*** elligottmc has joined #openstack-swift22:12
openstackgerritAlan Erwin proposed openstack/swift: Refactoring the expiring objects feature  https://review.openstack.org/25208522:17
notmynameaerwin: oh cool!22:17
*** trifon has quit IRC22:20
*** gyee has joined #openstack-swift22:22
*** diogogmt has quit IRC22:22
aerwinThanks, thats is the first pass. I want to start getting some feedback from the community.22:23
*** NM has joined #openstack-swift22:23
*** zhill has joined #openstack-swift22:23
*** diogogmt has joined #openstack-swift22:25
*** gmmaha has quit IRC22:26
*** petertr7 is now known as petertr7_away22:26
*** tsg has quit IRC22:27
mattoliverauelligottmc: the sharder deamon might need to be optimised :)22:27
mattoliverauit's very serial atm.22:27
mattoliveraustep 1, does the idea work. Step to make it work betterer :P22:27
*** gmmaha has joined #openstack-swift22:27
mattoliverauaerwin: awesome!, I'll try and find time to take a look today!22:29
elligottmcmattoliverau: yes I very much agree22:30
elligottmcI'm actually enjoying experimenting with it22:30
elligottmclearn more about the sharding code and the swift code every time22:31
mattoliverauelligottmc: cool, and thanks I appreciate all the experimenting.22:31
mattoliverauelligottmc: and when you find something I totally missed or could do better, fix it for me ;)22:32
elligottmcAs soon as I can get a clean run I'll post this code (and then probably immediately change it)22:32
mattoliveraulol, you can go a git log and see how many times it's happened to me :)22:32
*** jerrygb has joined #openstack-swift22:32
mattoliverauelligottmc: I pushed up some new fixes a few days ago. Which is making more stable in my testing, but sure there a ways to go. The sharder being serial has helped debug it, but could really do with improving it, add some concurrency maybe. Feel free to tackle that :)22:34
elligottmcmuch to learn I still have (sorry star wars fever)22:35
elligottmcbut sure I will take a look22:35
*** NM has quit IRC22:35
*** NM has joined #openstack-swift22:36
mattoliverau:)22:37
blmartinbug card added to trello, markdown is a pain22:37
*** jerrygb has quit IRC22:37
mattoliveraublmartin: lol, thanks man22:38
*** tsg has joined #openstack-swift22:43
*** sgundur has quit IRC22:46
*** chmouel has quit IRC22:55
*** chmouel has joined #openstack-swift22:56
*** klrmn1 has quit IRC22:58
aerwinmattoliverau: Thanks that would be great.22:58
aerwinclayg: Where do you recommend I place docs/history for the expiring objects refactor. I currently have a spec, but is there a better place to explain this change?22:59
*** chsc has quit IRC23:00
notmynameaerwin: updating http://docs.openstack.org/developer/swift/overview_expiring_objects.html in your patch would be lovely23:01
openstackgerritBill Huber proposed openstack/swift: Refactor server side copy as middleware  https://review.openstack.org/15692323:01
notmynameaerwin: I mean, you already are updating that, but that's where that stuff goes (if not in a commit message)23:02
notmynameaerwin: eg there's a "history" section on the rings overview page23:02
*** doxavore has quit IRC23:03
*** km has joined #openstack-swift23:04
*** km is now known as Guest7500723:04
*** omkarjoshi has joined #openstack-swift23:06
*** NM has quit IRC23:06
claygaerwin: oh yeah you could crib most of that stuff from the spec - I wouldn't stress to much about it tho - getting the migrations and replication shiz square is more important I think23:06
*** lucy has joined #openstack-swift23:09
*** lucy is now known as Guest7255623:09
openstackgerritSamuel Merritt proposed openstack/swift: Allow smaller segments in static large objects  https://review.openstack.org/25209623:11
*** zhill has quit IRC23:11
Guest72556hi guys, I have questions on the openstack swift acl23:19
Guest72556can somebody tell me the rules of the referrer and group as the acl string in contiainer level?23:20
Guest72556how does the .r and .rlisting giving acl permission to the specified users?23:20
aerwinclayg: I agree. I will get the docs update with the next patch set.23:21
aerwinnotmyname: thanks for the info.23:21
*** klrmn1 has joined #openstack-swift23:22
*** david-lyle has quit IRC23:25
*** blmartin has quit IRC23:25
*** sjmc7 has joined #openstack-swift23:27
*** kei_yama has joined #openstack-swift23:29
*** darrenc is now known as darrenc_afk23:31
Guest72556Hello~? Anybody had experience dealing with openstack acl?23:31
*** Guest72556 has quit IRC23:43
*** darrenc_afk is now known as darrenc23:52
*** diogogmt has quit IRC23:57
*** siva_krishnan has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!