Wednesday, 2017-04-12

*** _JZ_ has quit IRC00:34
*** zhurong has joined #openstack-swift00:39
*** adriant has joined #openstack-swift00:52
kota_good morning01:09
*** m_kazuhiro has joined #openstack-swift01:10
m_kazuhirogood morning01:12
kota_m_kazuhiro: o/01:13
m_kazuhirokota_: o/01:13
*** stradling has joined #openstack-swift01:14
mattoliveraukota_, m_kazuhiro: morning01:19
kota_mattoliverau: o/01:19
m_kazuhiromattoliverau: morning!01:19
*** vint_bra has joined #openstack-swift01:21
*** JimCheung has quit IRC01:39
*** Sukhdev has quit IRC01:47
*** vint_bra has quit IRC01:58
*** JimCheung has joined #openstack-swift01:58
*** JimCheung has quit IRC02:02
*** stradling has quit IRC02:04
*** jamielennox is now known as jamielennox|away02:07
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Follow up for patch 448449  https://review.openstack.org/45587502:11
*** vint_bra has joined #openstack-swift02:55
*** chlong has joined #openstack-swift03:02
*** chlong_ has joined #openstack-swift03:02
*** SkyRocknRoll has joined #openstack-swift03:03
*** SkyRocknRoll has quit IRC03:23
*** jamielennox|away is now known as jamielennox03:23
*** gkadam has joined #openstack-swift03:34
*** rcernin has joined #openstack-swift03:59
*** rcernin is now known as rcernin|wfh|mtg03:59
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Follow up for patch 448449  https://review.openstack.org/45587504:01
*** m_kazuhiro_ has joined #openstack-swift04:02
*** m_kazuhiro has quit IRC04:02
*** links has joined #openstack-swift04:03
*** zhurong has quit IRC04:06
*** m_kazuhiro_ has quit IRC04:14
*** vint_bra has quit IRC04:14
*** m_kazuhiro has joined #openstack-swift04:33
*** zhurong has joined #openstack-swift04:34
*** psachin has joined #openstack-swift04:36
*** chsc has joined #openstack-swift04:36
*** chsc has quit IRC04:51
*** chlong_ has quit IRC05:03
*** chlong has quit IRC05:03
*** PavelK has joined #openstack-swift05:06
PavelKmattoliverau: morning05:07
mattoliverauPavelK: morning05:07
PavelKmattoliverau: patch 454174 is waiting to be merged. can you review it, please?05:07
patchbothttps://review.openstack.org/#/c/454174/ - swift - Container drive error results double space usage o...05:07
mattoliverauPavelK: sure thing :)05:08
PavelKmattoliverau: thanks05:08
*** rcernin|wfh|mtg has quit IRC05:11
*** jaosorior_away is now known as jaosorior05:13
*** Sukhdev has joined #openstack-swift05:19
*** rcernin has joined #openstack-swift05:20
mattoliverauPavelK: done05:21
PavelKmattoliverau: thank you. I hope clayg was only bussy but not frustrated from me as he noticed in review05:22
PavelK*I mean "busy"05:23
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Add Composite Ring Functionality  https://review.openstack.org/44192105:27
kota_PavelK: congrats and thanks for making your effort to land it05:28
kota_mattoliverau: thanks for the final judge to +A ;-)05:28
mattoliverauPavelK: clayg is always busy, but also zealous and excited. But he's really a big teddy bear. I don't think he was frustrated, just being clayg :) In fact he gave your patch so much attention because you did awesome work, and to give you context from a project POV :)05:29
mattoliveraukota_: nps05:29
kota_mattoliverau: +105:30
*** ChubYann has quit IRC05:44
*** cshastri has joined #openstack-swift05:49
*** Sukhdev has quit IRC05:58
*** Dinesh_Bhor has quit IRC06:04
*** RobGThai has joined #openstack-swift06:08
*** gyee has quit IRC06:08
*** klrmn has quit IRC06:18
*** pcaruana has joined #openstack-swift06:30
*** Dinesh_Bhor has joined #openstack-swift06:38
*** kei_yama has quit IRC06:42
*** kei_yama has joined #openstack-swift06:46
*** tesseract has joined #openstack-swift06:49
*** cshastri_ has joined #openstack-swift06:52
*** cshastri has quit IRC06:54
*** jistr has quit IRC06:54
*** jarbod_ has quit IRC06:54
*** jarbod has quit IRC06:54
*** jarbod has joined #openstack-swift06:55
*** jarbod_ has joined #openstack-swift06:55
*** thurloat has quit IRC06:55
*** neonpastor has quit IRC06:55
*** nikivi has quit IRC06:56
*** corvus has quit IRC06:56
*** jistr has joined #openstack-swift06:56
*** neonpastor has joined #openstack-swift06:56
*** corvus has joined #openstack-swift06:56
*** thurloat has joined #openstack-swift06:57
*** nikivi has joined #openstack-swift06:57
*** rcernin has quit IRC06:59
*** d0ugal has joined #openstack-swift07:03
*** d0ugal has quit IRC07:03
*** d0ugal has joined #openstack-swift07:03
*** cshastri_ is now known as cshastri07:07
*** adriant has quit IRC07:15
*** rcernin has joined #openstack-swift07:16
openstackgerritMerged openstack/swift master: Container drive error results double space usage on rest drives  https://review.openstack.org/45417407:21
acolesgood morning07:23
kota_acoles: good morning07:27
kota_acoles: just finishing up the review on patch 44931007:31
patchbothttps://review.openstack.org/#/c/449310/ - swift - Add id to RingBuilder to differentiate rings in co...07:31
onovynotmyname: hi, please ping me when you will be here, thanks07:31
onovymorning to all07:31
kota_onovy: thanks for pushing the db fix to stable branches07:31
acoleskota_: thanks07:31
mattoliverauacoles: morning07:32
acolesonovy: o/07:32
kota_acoles: the main reason for my -1 is the behavor self._id = None if we got IOError07:32
mattoliverauonovy: morning07:32
acolesmattoliverau: thanks for all your notes on patch 45438607:32
patchbothttps://review.openstack.org/#/c/454386/ - swift - Fix install guide filter:authtoken config example07:32
kota_at saving07:32
mattoliverauacoles: no probs. Seems the intall_guide has been fixed07:32
mattoliverau*install07:33
acolesmattoliverau: (a) I am so jealous because you have a keystone with a domain with id=default. I used to have such a thing but not with my recent attempts to install keystone. I'm sure that's my bad. But (b) here's the other side of the story https://docs.openstack.org/mitaka/install-guide-ubuntu/keystone-users.html07:34
acolesmattoliverau: aha - so which install guide got fixed?07:34
mattoliverauacoles: yup, but newton and ocata versions of the same guide is now using bootstrap :)07:34
acolesmattoliverau: woohoo07:35
mattoliverauacoles: as did I when I built my dev keystone + swift env.. which is why I had id=default07:35
*** m_kazuhiro has quit IRC07:35
onovykota_: np :]07:36
*** rcernin has quit IRC07:37
acolesmattoliverau: so this page title is now a little out of date - no longer need to create a domain because the default is there, by default!07:37
*** rcernin_ has joined #openstack-swift07:37
onovybtw: can anyone look to https://review.openstack.org/#/c/448244/ and https://review.openstack.org/#/c/391605/ pls?07:37
patchbotpatch 448244 - swift - Replace slowdown option with *_per_second option07:37
patchbotpatch 391605 - swift - Added rsync_no_change metrics to recon07:37
*** rcernin_ has quit IRC07:38
*** rcernin_ has joined #openstack-swift07:38
acolesmattoliverau: https://docs.openstack.org/ocata/install-guide-ubuntu/keystone-users.html07:38
acolesmattoliverau: hmm, so here it says that its db_sync that creates default domain. although it would seem to be a bootstrappy kind of thing to do07:39
acoleshttps://docs.openstack.org/developer/keystone/devref/services.html#the-default-domain07:39
acolesmattoliverau: anyway, w/e I am glad if we have returned to the default domain defaulting to having id 'default' and name 'Default' :)07:40
mattoliverauacoles: +107:41
acolesmattoliverau: problem is that there's people who deployed keystone using maybe Mitaka and created a domain with *name* default and random id, according to the install guide back then, who then can't get swift to auth using domain-id=default :/ I have had several such issues come up here in channel. Talk about confusing!07:42
acolesmattoliverau: thanks for helping me see the light!07:44
mattoliverauYeah, I feel sorry for those who are now carrying around a "different" default id. But at least for anyone creating new installs, which IMHO will be the people copying and pasting samples would now be getting it right07:44
mattoliverauso long of course they are installing newton +07:45
mattoliverauacoles: your welcome, it might have send me off on a tagent I wasn't expecting, but I've at least learnt alot about keystone and especially keystone + swift ;)07:45
acolesmattoliverau: oh boy: this is ocata install for glance https://docs.openstack.org/ocata/install-guide-ubuntu/glance-install.html , has user_domain_name = default07:46
acolessame in nova07:46
mattoliveraudamn, opps that's not going to go well :(07:48
mattoliveraunot on a default install of keystone nowdays07:48
mattoliverauasettle: FYI ^ these are the wrong keystone defaults for auth_token.07:48
mattoliverauthey could safely change it to:07:50
mattoliverauproject_domain_id = default07:50
mattoliverauuser_domain_id = default07:50
mattoliverauAnd they'd be corrected though07:50
acolesmattoliverau: so this is in the last step of the keystone install 'export OS_USER_DOMAIN_NAME=Default'07:51
mattoliverauanyway, baby bed/dinner rutine time.07:51
acoleshmmm, are domain names case insensitive? if so then all is good ??07:51
mattoliverauacoles: and becauses it's domain_name it should be correct07:51
mattoliveraudomain_id = default, domain_name = Domain07:52
*** geaaru has joined #openstack-swift07:52
acolescan the domain {id=default, name=Default} be referred to using name=default by virtue of case insensitivity??07:52
acolesmattoliverau: have good evening!07:53
*** SkyRocknRoll has joined #openstack-swift08:00
mattoliverauacoles: not in my tests (see review)08:05
acolesmattoliverau: k. and I think case insensitivity (if any) would be a property of backend not intrinsic.08:06
*** cbartz has joined #openstack-swift08:07
acoleskota_: thanks for your reviews08:08
* acoles afk, back later08:08
kota_acoles: np08:11
*** Administrator_ has quit IRC08:12
*** Administrator_ has joined #openstack-swift08:12
*** oshritf__ has joined #openstack-swift08:17
*** SkyRocknRoll has quit IRC08:18
asettlemattoliverau: is there a bug?08:22
*** dmellado has joined #openstack-swift08:23
mattoliverauasettle: pfft of course not (actually no idea) we've just noticed it cause of swift. Plus I'm bathing baby ATM, so a little preoccupied ;)08:23
asettlemattoliverau: when you're done babying - could you do a bug when you got a mo? :)08:23
mattoliverauI don't know how many projects it effects but I try and do that thing in the morn :)08:25
asettlemattoliverau: no worries. If we have one, we can reach out :)08:28
*** links has quit IRC08:35
*** ma9_ has joined #openstack-swift08:46
*** kei_yama has quit IRC08:48
*** links has joined #openstack-swift08:52
*** ma9_ has left #openstack-swift09:01
*** csmart1 has quit IRC09:11
*** thurloat[m] has quit IRC09:11
*** csmart has joined #openstack-swift09:15
*** links has quit IRC09:20
openstackgerritMatthew Oliver proposed openstack/swift master: Fix install guide filter:authtoken config example  https://review.openstack.org/45438609:24
mattoliverauasettle: I just made this one to cover it in Swift: https://bugs.launchpad.net/swift/+bug/168205909:25
openstackLaunchpad bug 1682059 in OpenStack Object Storage (swift) "Fix install guide filter:authtoken config example" [Undecided,Confirmed]09:25
asettlemattoliverau: gracias gracias :D09:26
mattoliverauthen updated the patch we have that fixes it to point to it ^09:26
*** thurloat[m] has joined #openstack-swift09:30
*** gkadam is now known as gkadam-afk09:30
*** links has joined #openstack-swift09:33
*** abhitechie has joined #openstack-swift09:43
*** abhinavtechie has joined #openstack-swift09:44
asettlemattoliverau: reading this further now I've had coffee, I think we did address this issue in master. OR at least, we had a few bugs.09:46
*** abhitechie has quit IRC09:48
mattoliverauasettle: kk, we've just noticed it, and saw that it seemed wrong in glance and nova (see acoles links above). so thought it'll be best to let you know :)10:15
mattoliverauand maybe more, that's all we checked10:15
asettlemattoliverau: yeah I think it's across. I'll look more into it today :) thanks for pointing it out, appreciate it. I'll get onto it :)10:15
mattoliverauasettle: ta :) and in case I don't see you before hand, happy easter!10:16
asettlemattoliverau: likewise dude! Have fun with the fam <310:16
acolesasettle: hi! following on from that discussion - how do we achieve consistency across the install guides for projects - if we change the domain reference in swift, then from the perspective of a user working through an install, swift is the odd one out. do the install guides get published just once per release or will any change we make appear immediately?10:20
asettleacoles: once per release. So if you need to change something in Ocata, you will need to backport.10:20
asettleBut anything for Pike will not appear until August.10:21
acolesasettle: ok, thanks10:22
acolesasettle: my fear is that for Pike the keystone install process reverts to what it was in Mitaka, meanwhile we change to match what is in Ocata, and end up wrong again :/10:24
*** abhinavtechie has quit IRC10:25
asettleacoles: an understandable fear. Unfortunately I don't know what to tell you... We keep up to date with the dev projects cycle. We document what we know/are told.10:27
asettleAdmittedly fixing mistakes along the way.10:27
acolesasettle: sure. I'm just worrying-out-loud ;) any idea if there is a bug on openstack manuals similar to bug 1682059?10:29
openstackbug 1682059 in OpenStack Object Storage (swift) "Fix install guide filter:authtoken config example" [Undecided,Confirmed] https://launchpad.net/bugs/168205910:29
asettleacoles: yeah makes sense. I dunno what to do to help you though :( I mean, tell me if you know... we're just the middle guys ;)10:29
asettleacoles: tbh, yes, pretty sure. LEt me look10:29
asettleacoles: ugh this might take me a while10:36
asettlehttps://review.openstack.org/#/c/453071/210:37
patchbotpatch 453071 - openstack-manuals - Fix horizon/keystone default domain instructions (MERGED)10:37
*** abhitechie has joined #openstack-swift10:37
asettleActually, tbh acoles that looks like that it. I thought there were more for some reason :/10:39
*** JimCheung has joined #openstack-swift10:41
acolesasettle: thanks! so Horizon fixed itself. AFAICT nova and glance install guides are broken.10:41
asettleacoles: superb.10:42
acolesand swift currently, til we merge the patch we have10:42
*** JimCheung has quit IRC10:45
openstackgerritPavel Kvasnička proposed openstack/swift master: WIP: DB replicator cleanup  https://review.openstack.org/44848010:49
asettleacoles: okay I'll keep an eye out.10:50
acolesasettle: thanks for all the info10:52
asettleBest I had, sorry for not being more helpful :(10:52
asettleI'll try and get the install guides fixed on masse. And I'll try and communicate with everyone else that their guides might need to be reviewed.10:53
*** abhitechie has quit IRC11:06
*** PavelK has quit IRC11:06
*** abhitechie has joined #openstack-swift11:11
openstackgerritPavel Kvasnička proposed openstack/swift master: WIP: DB replicator cleanup  https://review.openstack.org/44848011:13
*** abhitechie has quit IRC11:13
*** abhitechie has joined #openstack-swift11:14
acolesasettle: you are helpful! :)11:15
*** abhinavtechie has joined #openstack-swift11:16
*** abhitechie has quit IRC11:17
*** abhinavtechie has quit IRC11:17
acolesasettle: I just commented on patch 454386 that ideally we'd have consistency across project install guides w.r.t. referring not only to the correct domain, but consistently referring via either it's name or id.11:17
patchbothttps://review.openstack.org/#/c/454386/ - swift - Fix install guide filter:authtoken config example11:17
*** abhinavtechie has joined #openstack-swift11:17
*** PavelK has joined #openstack-swift11:18
*** abhinavtechie has quit IRC11:20
*** abhinavtechie has joined #openstack-swift11:20
asettleacoles: at the very least, I know I can fix: Keystone, cinder, neutron, nova, glance and horizon (done)11:24
asettleacoles: actually, what I *would* recommend you do11:24
asettleEmail the CPLs11:24
asettlehttps://wiki.openstack.org/wiki/CrossProjectLiaisons#Documentation11:24
*** zhurong has quit IRC11:26
*** mvk has quit IRC11:31
*** oshritf__ has quit IRC11:34
*** gkadam-afk is now known as gkadam11:42
*** psachin has quit IRC11:51
*** PavelK has quit IRC11:51
*** chlong has joined #openstack-swift11:52
*** chlong_ has joined #openstack-swift11:52
*** chlong_ has quit IRC11:54
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873611:54
*** abhinavtechie has quit IRC11:56
*** joeljwright has joined #openstack-swift11:57
*** ChanServ sets mode: +v joeljwright11:57
*** mvk has joined #openstack-swift12:03
*** klamath has joined #openstack-swift12:04
*** klamath has quit IRC12:04
*** klamath has joined #openstack-swift12:05
*** winggundamth has joined #openstack-swift12:07
*** psachin has joined #openstack-swift12:08
*** stradling has joined #openstack-swift12:45
openstackgerritJuan Antonio Osorio Robles proposed openstack/python-swiftclient master: WIP: Use keystone session when possible  https://review.openstack.org/45620512:48
mathiasbacoles: thanks for the review comments on the barbican patch!12:58
*** gkadam has quit IRC13:05
*** psachin has quit IRC13:06
*** links has quit IRC13:17
*** psachin has joined #openstack-swift13:27
*** catintheroof has joined #openstack-swift13:27
acolesmathiasb: hi, you're welcome13:29
*** zhurong has joined #openstack-swift13:46
*** tongli has joined #openstack-swift13:57
*** _JZ_ has joined #openstack-swift13:58
*** zhurong_ has joined #openstack-swift13:59
*** _JZ_ has quit IRC13:59
*** _JZ_ has joined #openstack-swift14:00
*** zhurong has quit IRC14:01
*** henman has joined #openstack-swift14:16
*** silor has joined #openstack-swift14:29
*** silor has quit IRC14:32
*** links has joined #openstack-swift14:33
*** silor has joined #openstack-swift14:35
*** links has quit IRC14:36
*** cshastri has quit IRC14:43
*** henman has left #openstack-swift14:44
*** Amaz_ has joined #openstack-swift14:46
*** remix_tj has joined #openstack-swift14:47
*** Amaz_ has quit IRC14:48
*** AmazT has joined #openstack-swift14:49
remix_tjhello tdasilva, i've seen your post about running functional tests against swift. We have a 3rd party implementation of Swift (DellEMC ECS) and we would like run tests against it to find out limitations. It may be an idea?14:49
*** silor1 has joined #openstack-swift14:52
tdasilvaremix_tj: yes, it should be pretty straight forward. You just need to edit the test.conf to point to your swift endpoint14:52
*** silor has quit IRC14:52
remix_tjIn general, does the tests available in swift shows the goodness of a swift implementation?14:53
remix_tjtdasilva: yes, i did14:53
*** xinli has joined #openstack-swift14:53
remix_tji launched the tests now, i'll wait for the response.14:53
*** silor1 has quit IRC14:53
tdasilvaremix_tj: yes, in principle the functional tests are black box testing, so it is really just testing the APIs that swift offers14:53
*** silor has joined #openstack-swift14:54
remix_tjperfect14:54
tdasilvaremix_tj: in your 3rd party implementation, are you using the swift proxy? did you implement a new diskfile?14:54
remix_tjtdasilva: emc provides swift apis directly from their hardware appliance14:55
tdasilvaremix_tj: yes, but do you know what software is running there?14:55
remix_tjhttp://emergingtechblog.emc.com/openstack-swift-object-storage-integration-ecs/14:55
remix_tjoh, suppose ViPR (CoprHD)14:56
remix_tjthat is a swift proxy i think14:56
tdasilvaoh yeah, i remember reading the wonderful blog post14:57
tdasilva"OpenStack Swift falls short of being a true enterprise-grade production-ready solution"14:57
*** zhurong_ has quit IRC14:57
acolesI was just enjoying that too14:57
asettleacoles: spoke to cmurphy today, she went through the entire install guide and only found the Default default thing on the two instances she patched up.14:59
tdasilvait's funny how I've heard this twice from people that are supposed to know storage: "Further, as you grow across sites you will require ‘strong’ data consistency"15:00
remix_tjtdasilva acoles fyi the implementation of swift by EMC is a crap. I'm looking for real data to confirm it :-)15:01
tdasilvaremix_tj: sorry, don't mean to be directly at you, btw...i'm sure that blog post was written by marketing folks that love to throw mud at something else to make them look good15:01
*** jaosorior is now known as jaosorior_away15:02
acolesasettle: but swift has the same as glance https://docs.openstack.org/ocata/install-guide-ubuntu/glance-install.html15:03
*** AmazT has quit IRC15:03
remix_tjtdasilva: i use ECS only because my company bought it and i can use it for free :-P i'd never loose time with this kind of hardware when i can have several open implementations15:03
*** rcernin_ has quit IRC15:04
asettleacoles: yeah - she did mention it wasn't perfect. I'll review the guide.15:04
acolesremix_tj: IIRC some of the swift functional tests use the swift discovery api feature to determine if certain features are enabled, and skip tests if they are not, so be aware of that - I have no idea if your service provides the discovery (<endpoint>/info) feature15:05
acolesasettle: you are being sucked into the confusion...:P15:06
asettleacoles: isn't that part of my job description?15:07
acolesasettle: lol. "Role #1: be available for becoming confused"15:08
asettleRole #2: Be prepared to confuse others with your confusion15:08
*** silor1 has joined #openstack-swift15:11
acolesasettle: darn - you made me laugh and now I have completely forgotten what I was doing15:11
asettleacoles: Perfect *dust off hands*15:12
asettleWell I can leave now, job done.15:12
*** silor has quit IRC15:12
*** silor1 is now known as silor15:12
*** cbartz1 has joined #openstack-swift15:13
remix_tjacoles: ok, i'll check this15:14
*** cbartz has quit IRC15:14
remix_tjtdasilva acoles anyway: Ran: 444 tests in 1108.0000 sec. Passed: 18, Skipped: 46, Expected Fail: 0, Unexpected Success: 0, Failed: 38015:15
acolesyou might want to check that all those fails aren't simply due to auth failing15:16
remix_tji see several test.functional.swift_test_client.ResponseError: 400: 'Bad Request'15:17
*** silor has quit IRC15:17
*** silor has joined #openstack-swift15:17
*** chsc has joined #openstack-swift15:18
remix_tjin some test there is explicit error about missing authentication. i.e. there is a 403 returned when connecting with no token instead of a required 401 or 41215:20
acolesremix_tj: if you can get swiftclient to talk to your endpoint then you'll get some insight into how you need to configure the auth in swift's test.conf, the defaults in that file are not for keystone15:23
remix_tji'm already uploading files to swift, without issues by using standard openrc file downloaded from horizon15:24
remix_tjso i think is not a problem about authentication, is simply a bad implementation of swift apis15:24
*** chsc has quit IRC15:24
acolesok, but be sure you have the auth endpoint from your openrc reflected in test.conf, AFAIK the swift functional tests do not pick up env vars.15:26
remix_tjacoles: yes, the file is ok and points to the right auth endpoint15:26
*** SkyRocknRoll has joined #openstack-swift15:28
remix_tji'm using this instructions https://thiagodasilvablog.wordpress.com/2016/11/02/running-functional-test-against-an-openstack-swift-cluster-deployed-with-tripleo/15:28
acolesremix_tj: OIC, that's what I was meaning15:29
*** d0ugal has quit IRC15:30
*** d0ugal has joined #openstack-swift15:30
*** d0ugal has quit IRC15:30
*** d0ugal has joined #openstack-swift15:30
*** d0ugal has quit IRC15:31
*** d0ugal has joined #openstack-swift15:31
*** d0ugal has quit IRC15:31
*** d0ugal has joined #openstack-swift15:31
*** silor has quit IRC15:31
*** silor has joined #openstack-swift15:31
acolesnice post tdasilva ^^15:31
acoleslol - *3rd* sentence - "Did that confuse you yet?"15:32
winggundamthhi all15:34
*** geaaru has quit IRC15:34
winggundamthanyone ever facing TIME_WAIT 50k+ when using Swift before?15:34
winggundamthI already put tw_recycle and tw_reuse = 1 but it doesn't help15:35
*** winggundamth_ has joined #openstack-swift15:36
rledisezhi winggundamth. can i ask you what version of Swift you're using, and if you use replica or EC? I have a similar issue since Swift 2.7 with EC15:36
winggundamth_I can see a lot of "proxy-server: ERROR with Object server 172.27.6.82:6000/sdj re: Trying to get final status of PUT to" in swift proxy error log15:37
winggundamth_rledisez: sure. one sec15:37
tdasilvaacoles, remix_tj sorry had a meeting, reading up scrollback now15:39
*** winggundamth has quit IRC15:40
winggundamth_rledisez: "version": "2.7.1.dev8" from /info15:41
remix_tjtdasilva: no problem15:41
winggundamth_rledisez: I'm using replica15:41
tdasilvaacoles: heh, that was confusing ;)15:43
tdasilvaremix_tj: is your auth keystone? or does ECS use something else?15:44
remix_tjECS supports only Keystone V315:44
remix_tjhas support for keystone v2, but is an internal keystone, not an external one (i.e. the one of an existing openstack setup)15:45
tdasilvai see15:45
remix_tji've saved the full output of the functests and tomorrow i'll take a more detailed look since is very long.15:46
rledisezwinggundamth: you might want to update first, some bugs about leak on replica has been fixed but I can't remember in which version15:48
winggundamth_:(15:51
winggundamth_another question. anyone know the reason why Swift used network thoughput around 500Mbps on every swift node all the time?15:52
winggundamth_try to check with iftop. I can see a lot of thoughput via port 6000. I think it is object server right?15:54
*** Sukhdev_ has joined #openstack-swift15:55
*** silor has quit IRC15:57
*** tesseract has quit IRC15:58
*** mvk has quit IRC16:18
*** JimCheung has joined #openstack-swift16:21
*** vint_bra has joined #openstack-swift16:27
*** cbartz1 has quit IRC16:27
*** Sukhdev_ has quit IRC16:31
*** vint_bra has quit IRC16:35
*** chosafine has joined #openstack-swift16:44
*** chsc has joined #openstack-swift16:45
*** chsc has joined #openstack-swift16:45
*** gyee has joined #openstack-swift16:46
*** psachin has quit IRC16:49
*** tongli has quit IRC16:52
*** pxwang has joined #openstack-swift16:52
*** chosafine has quit IRC16:53
*** pxwang has quit IRC16:54
timburkegood morning16:56
*** klrmn has joined #openstack-swift17:04
*** psachin has joined #openstack-swift17:06
*** klrmn has quit IRC17:10
*** psachin_ has joined #openstack-swift17:11
*** psachin_ has quit IRC17:14
*** psachin_ has joined #openstack-swift17:19
*** klrmn has joined #openstack-swift17:20
*** psachin_ has quit IRC17:21
*** psachin_ has joined #openstack-swift17:22
*** psachin_ has quit IRC17:23
*** silor has joined #openstack-swift17:24
*** oshritf__ has joined #openstack-swift17:26
*** oshritf__ has quit IRC17:32
*** silor has quit IRC17:32
*** oshritf__ has joined #openstack-swift17:33
*** tonanhngo has joined #openstack-swift17:34
*** psachin has quit IRC17:34
*** tonanhngo has quit IRC17:35
*** xinli has quit IRC17:36
*** tonanhngo has joined #openstack-swift17:37
*** oshritf__ has quit IRC17:44
*** AmazT has joined #openstack-swift17:52
AmazTHi All. First time here so I hope this is the right place and audience for my query.17:53
AmazTI'm having an issue that I've hit a dead end with. I'm uploading large objects using SLO to my swift cluster. Once the segments and manifest files have been uploaded, I'm able to download, stat, etc. no problem using python-swiftclient.17:53
AmazTNext, I enable directory listings by running the following commands:17:53
AmazTswift post -m 'web-index:index.html' "Public_Container" swift post -r '.r:*,.rlistings' "Public_Container" swift post -m 'web-listings: true' "Public_Container" swift post -m 'web-directory-type:text/directory'  "Public_Container"17:54
AmazTAs far as I understand, this is achieved via the staticweb pipeline and allows me to browse the contents of "Public_Container" without credentials while also doing some other stuff to generate the html pages.17:54
AmazTEverything is fine so far. All objects in this container that are not large objects can be browsed and downloaded.17:55
AmazTHowever, as soon as I try and download large objects (SLO or DLO), I get errors. WHen I uploaded using SLO, I get the following error in the browser:  "Conflict  There was a conflict when trying to complete your request."17:55
AmazTWhen using DLO, I get the following error:  "Unauthorized  This server could not verify that you are authorized to access the document you requested."17:55
AmazTI'm assuming this is a problem with the staticweb pipeline not handling manifest files well, but I'm not sure. Could you guys point me in the right direction?17:55
timburkeyou'll need to make the segments container public as well -- anonymous users can see the DLO/SLO manifests, but not the backing data17:56
claygonovy: PavelK: only busy - so happy to see the a/c db handoff overreplication bugfix merged!17:56
timburkeyou don't need to (and maybe shouldn't? depends on use-case i suppose) enable static web on the segments container17:57
timburkealternatively, you could specify that the segments should go in the same container as the manifest, but that'll affect listings in a way that's probably not desirable17:58
AmazTAHH! I don't know why I didn't think of that!17:59
AmazTI don't mind making the segments folder public in testing, but I'm not sure I'll want to do that in production.17:59
timburkewhy not, if the "primary" container is?18:00
AmazTI suppose it's not the end of the world.18:01
timburkei mean, i certainly understand how generally "more things publicly readable" is a bad thing, but would you ever put non-segments in it?18:01
AmazTThey don't need to know anything about that container.18:01
AmazTI was thinking from a view point of having to train them to do this themselves18:02
AmazTThey won't remember to do this themselves.18:02
timburkeoh yeah, i wouldn't even tell users about it. part of why i wouldn't bother enabling static web stuff for it18:03
*** ChubYann has joined #openstack-swift18:03
AmazTThe alternatives, though, are that I would have to put segments in the original container. I like that even less.18:03
AmazTThis is a feature though, that I'm thinking of promoting... using the staticweb method to get their files out to the world should they choose to. Quick and dirty, but effective.18:05
AmazTSo if they're using this feature, I'll want to make sure that they know about this and remember to do it for the "_segments" container as well.18:05
AmazTThanks Tim!18:05
timburkesure, happy to help!18:06
timburkei wonder if it'd be reasonable to have swiftclient, during container POSTs, check for a corresponding _segments container and if there is to apply the metadata there as well...18:07
AmazTIt would have my vote.18:09
AmazTWe have a fork of swiftbrowser that we use for our users and I'm going to enable it there.18:09
AmazTI can see it working if the _segments container already exists. If, however, my workflow is that I create a container, make it public, and then upload objects to it, that wouldn't work?18:11
AmazTI have another question if you'll all indulge me.18:12
timburkeyeah, i'm just hesitant to go creating containers that may never be used...18:13
timburkeshoot!18:13
AmazTIs there a way for the account name to be something other than "AUTH_UUID"? I'd like to make it... simpler.18:13
AmazTI understand the need for a unique identifier there. What if I could manage that?18:14
AmazTFollow up question would be: How can I retroactively do that for accounts I've already created?18:14
timburkechanging account names is going to be hard -- it'll require a migration of all data in the old account to the new one18:15
AmazTCurrently, my temp_urls are ugly and long and use port 8080. My aim is to make it very simple. 1) Get rid of the 8080 and move to 80 for the proxy server. 2) Make the account name the name of the client or something like that (unique).18:16
AmazTI don't mind doing the migration on their behalf.18:16
timburkeas far as changing the general format for *new* accounts, you might be able to get your auth system to start using different defaults18:17
timburkecertainly the AUTH_ part is configurable in the proxy config18:17
AmazTI just don't even know where to begin. I tried this in my noob way by changing the proxy config and then going into the database and changing the ID to the name I wanted with limited success.18:18
AmazTBut I'm sure I did more harm that good there. As they say, a little knowledge is a dangerous thing.18:18
AmazTRight, I could remove the AUTH_ and make it something else. I did try that and it didn't work. I'm happy to try that again now because that was a long time ago and I knew even less then!18:19
timburkebut you might also want to take a look at the CNAME lookup and domain remap middlewares; it'll let you have custom, pretty domain names that map back into whatever crazy swift accounts you need18:19
AmazTOh interesting.18:19
AmazTI'm dealing with this right now by setting up an apache reverse proxy in front of the ugly URLs.18:20
AmazTThis would be more elegant because then I don't have to have another server proxying all the traffic.18:20
AmazTI'm going to read up on those middlewares and come back here for the inevitable questions I'll have :) Tim, you're a saint. Thank you!18:22
timburkeiirc, you have cname_lookup map beautiful-url.com -> AUTH_ugliness.swift-host.com, then domain_remap takes that back to swift-host.com/v1/AUTH_ugliness18:22
AmazTOk, nice. That would be just fine I think.18:22
openstackgerritAlistair Coles proposed openstack/swift master: Add id to RingBuilder to differentiate rings in composite  https://review.openstack.org/44931018:23
openstackgerritAlistair Coles proposed openstack/swift master: Add Composite Ring Functionality  https://review.openstack.org/44192118:23
openstackgerritAlistair Coles proposed openstack/swift master: Add composite ring doc  https://review.openstack.org/45150018:23
*** silor has joined #openstack-swift18:27
*** winggundamth_ has quit IRC18:27
brnelsonDoes anyone know of upgrade issues when migrating Swift to a level that's more than 1 version different?  That is, upgrading from version N to N+2 or greater (e.g. icehouse->ocata).  Any potential problems upgrading a node itself or issues with rolling upgrade?18:29
*** SkyRocknRoll has quit IRC18:31
*** RobGThai has quit IRC18:35
*** amac has joined #openstack-swift18:35
*** stradling has quit IRC18:38
*** xinli has joined #openstack-swift18:42
claygbrnelson: it's tested less - but there's been no know instances of pulling out backwards compat migration code18:46
claygthere's no checkpoint release - there are probably some changes that are harder than other to rollback from18:48
claygbut if you're somewhere in the 2.X series thinking of coming up to 2.12 or 2.13 shouldn't be a worry18:48
claygbrnelson: have you ever done a zero-impact rolling swift upgrade before?  they're fun!18:49
AmazT@timburke: I'm reading the documentation for cname_lookup and domain_remap middlewares. It's not clear to me yet how to set this up for multiple accounts.18:51
AmazTSo I'd like beautiful-url1.com->AUTH_1 and beautiful-url2.com ->AUTH_2... etc.18:52
timburkeAmazT: yeah, each account would need its own CNAME record :-/18:52
AmazTDo you have a link to somewhere that has an example of how this has been setup?18:52
claygdoesn't cname lookup just take any old Host: header that comes in and start doing dns queryies till it finds something useful?18:52
claygrledisez: you know how cname lookup works - any pointers for AmazT18:53
*** Sukhdev_ has joined #openstack-swift18:56
*** Sukhdev_ has quit IRC18:59
AmazTI'm reading the section for this in the "Object Storage with Swift" book by Joe and it doesn't have an example of how to configure it either.19:00
AmazTThe book does say though:19:00
*** Sukhdev_ has joined #openstack-swift19:01
AmazT“This feature is useful in certain types of content distribution applications. If your Swift cluster hosts different types or tiers of content, it may be convenient for your content to appear to end-users as originating from different domains. For example, your Swift cluster may hold photos and video from sports events, and you may want to make it available to end-users at URLs such as http://football.video.swift.example.c19:01
AmazTIf you use Domain Remap middleware, and if you have an account called video with a container called football, this can be implemented without any custom code. Create a CNAME record in your DNS configuration pointing from football.example.com to football.video.swift.example.com to enable a simpler URL”  Excerpt From: Joe Arnold. “Object Storage with Swift.” iBooks.19:01
AmazTSo I understand all that, I still don't understand how to implement it.19:01
AmazTAlso, I really want to know more about how I can create an account called video :)19:02
timburkeany "reseller admin" can create any account they like -- if appropriate ACLs are set, other users can then also use them. i know tempauth allows for account-level ACLs, so you can give a user complete control over the account, but i'm not sure you can do it for keystone yet... i seem to recall seeing a patch for that somewhere...19:05
timburkeyeah! /opt/ss/bin/python19:05
timburkedoh! i mean https://review.openstack.org/#/c/356715/19:05
patchbotpatch 356715 - swift - Supporting Account ACL in keystoneauth19:05
openstackgerritAlistair Coles proposed openstack/swift master: Add CompositeRingBuilder class  https://review.openstack.org/45382719:06
acoleskota_: updated this ^^ I am actually thinking that it could completely replace the write_composite_ring function. what do you think??19:07
acolesgood night19:08
AmazT@timburke : I'm using keystone...19:08
*** Sukhdev_ has quit IRC19:09
AmazTAt the moment, it's configured in the "old" way. ie. I have an admin role who is an admin everywhere in all tenants. Then I have  a "swiftoperator" role who can do most things in swift.19:09
AmazTOnly a user with the "admin" role can create tenants/accounts. When I do that, I don't know how to call the account "easyname" instead of "AUTH_uuid".19:10
AmazTas it would appear in both keystone and swift.19:11
*** Sukhdev_ has joined #openstack-swift19:25
*** Sukhdev_ has quit IRC19:26
*** amac has quit IRC19:26
AmazTCan anyone refer me to a resource that would explain how to do that?19:28
*** _JZ_ has quit IRC19:33
*** amac has joined #openstack-swift19:37
timburkeAmazT: i'm afraid i'm a bit out of my depth; i know some people have gotten that to work, but i've only done the actual configuring of CNAME records and the like once or twice19:38
timburkeand even then it was with like dnsmasq, which was fine for testing but may not be appropriate for a proper deployment19:39
timburkesorry :-(19:39
*** joeljwright has quit IRC19:49
*** RobGThai has joined #openstack-swift19:51
*** joeljwright has joined #openstack-swift19:54
*** ChanServ sets mode: +v joeljwright19:54
AmazT@timburke: No worries, I really do appreciate your time. What would you recommend I do? Come back here when there are more people who can help?19:58
*** joeljwright has quit IRC19:59
timburkeyeah, seems reasonable. if you've got a bouncer, someone may even reply while you're gone. fwiw, rledisez is in europe and (like clayg said) has some experience with the combination20:00
claygAmazT: you could send a message to one of the opnstack ML as well20:03
AmazTThanks @timburke. I guess I can try and ping him early tomorrow morning EST.20:04
AmazT@clayg: I'm not sure what you mean by openstack ML.20:04
rledisezAmazT: hi, just got connected :)20:04
AmazT@rledisez: Hello!20:05
AmazTI'm told you're the man who can answer my question :)20:05
claygAmazT: when I typed "openstack ML" into google this was the first link -> https://wiki.openstack.org/wiki/Mailing_Lists20:05
rledisezAmazT, i was quickly reading the IRC log. you first need to setup the middleware in appropriate order. cname_lookup before domain_remap before staticweb20:06
claygAmazT: I was suggesting async communciation could get more bites20:06
rledisezcname_lookup will resolve your own domain to a domain that the proxy will understand, then the domain_remap will change that domain to a real swift URL20:06
AmazTthanks clayg. I'm being daft AND lazy not googling. Appreciate it.20:06
rledisezbasically, you need a wildcard domain pointing to your cluster. eg *.example.com. IN CNAME storage.example.com.20:07
rledisezoops: *.storage.example.com IN CNAME storage.example.com.20:08
rledisezthen, you will create your own domain pointing to that CNAME. eg: video.cooldomain.com IN CNAME auth-abcd.container.storage.example.com.20:08
claygAmazT: lol :P20:09
claygrledisez: it's late for you right?  FWIW, no one planned a swift meeting today20:09
rledisezalso, you must define the storage_domain in the proxyconfig (storage.example.com in this example)20:09
clayghttps://wiki.openstack.org/wiki/Meetings/Swift20:09
rledisezclayg: yeah, i forgot that, and planned an other meeting on IRC with somebody else in an hour :D20:09
claygwe may need someone to chair next week as I think john is out again and we really need to start working on a burndown list of patches critical/high patches to get into swift 2.14.020:10
AmazT@rledisez : Thanks. I'll have to give this a try. I don't have access to my servers anymore but will try it tomorrow morning and probably bug you again !20:11
rledisezAmazT: you will need to do some testing as currently cname_lookup/domain_remap may badly interact with staticweb (hint: https://review.openstack.org/#/c/435771/ :))20:11
patchbotpatch 435771 - swift - Rewrite redirection in cname_lookup & domain_remap20:11
rledisezsure, i’m french time, so i’ll be online when you’ll wake up :)20:12
AmazTPerfect :)20:12
AmazTThanks @rledisez @+timburke and @clayg for your advice!20:13
rledisezdoes anyone run SAIO on mac OS? functest and unittest pass (except 1 test about dropping privilege), but unit tests takes 40 minutes to run for me instead of few minutes on Linux20:15
*** RobGThai has quit IRC20:15
*** AmazT has left #openstack-swift20:33
claygrledisez: lol?20:37
claygi stopped trying to get unitests working on mac after we added the pyeclib depends20:37
rledisezok… i’ll need that VM finally :(20:38
notmynamehello,world20:40
notmynameonovy: I'll be online for probably about an hour20:40
notmynameI'm more disconnected this week than I expected to be (at the openstack leadership training)20:41
*** silor has quit IRC20:42
notmynamerememebr, no swift team meeting today (i ddin't see anyone volunteer to chair20:46
*** tonanhngo_ has joined #openstack-swift20:48
*** tonanhng_ has joined #openstack-swift20:49
*** tonanhngo has quit IRC20:51
*** tonanhngo_ has quit IRC20:52
*** tonanhng_ has quit IRC20:53
*** xinli has quit IRC20:58
*** tonanhngo has joined #openstack-swift20:58
*** pxwang has joined #openstack-swift21:00
*** JimCheung has quit IRC21:01
*** JimCheung has joined #openstack-swift21:02
jungleboyjnotmyname:  Ah, that is why there is no one in there talking.  :-)21:02
notmyname:-)21:02
jungleboyjBack to other work then.  :-)21:03
*** amac has quit IRC21:05
*** ianychoi has quit IRC21:05
*** Sukhdev has joined #openstack-swift21:14
claygI updated https://wiki.openstack.org/wiki/Swift/PriorityReviews#Review_Priorities with some of the open bugs I'm aware of that we should be trying to fixes merged21:24
claygI'm sure everyone has their own pet bugs - if you've having trouble getting the correct priority assigned just hit me up!21:26
-openstackstatus- NOTICE: Restarting Gerrit for our weekly memory leak cleanup.21:26
*** chsc has quit IRC21:35
*** chsc has joined #openstack-swift21:42
*** pcaruana has quit IRC21:51
*** tonanhngo has quit IRC22:03
jrichlibtw - sorry I have been out-of-pocket.  I have been sick - again.  :/  Having strep, acute bronchitis, and a secondary infection to top it off within a month is not fun.22:03
jrichlibut i hope i can do some reviewing tomorrow22:03
*** tonanhngo has joined #openstack-swift22:05
*** tonanhngo_ has joined #openstack-swift22:06
*** tonanhngo_ has quit IRC22:08
*** tonanhngo_ has joined #openstack-swift22:09
*** tonanhngo_ has quit IRC22:09
*** klamath has quit IRC22:09
*** tonanhngo has quit IRC22:09
claygjeez, by launchpad.net22:11
claygjrichli: mandy got strep - my youngest too - it's no fun - hope you're feeling better!22:11
jrichliclayg: thanks!  the strep was over a few weeks ago.  working on the secondary bacterial infection now.  I know, has a lovely name.22:12
claygick22:14
*** tonanhngo has joined #openstack-swift22:15
mattoliveraumorning22:28
claygOMG launchpad - i do not like it when I type up a bug and you timeout error22:28
clayghahaha screw you launchpad this time I saved it in VIM!22:36
*** chsc has quit IRC22:37
mattoliveraulol22:37
mattoliverauclayg: you should ask the storyboard guys what there bug timeouts are ;)22:38
*** pxwang has quit IRC22:40
claygI want a meme for "I best X doesn't have this problem" so I can put story board in there so I can stream line all future griping about issue tracking software22:43
*** catintheroof has quit IRC22:48
clarkbclayg: supposedly if you respond using email that interface is far more reliable to launchpad22:58
claygI best email doesn't have this problem22:59
clayggah did it again!  s/best/bet* - gah22:59
mattoliverauclayg: https://paste.firnsy.com/paste/voWGSd9xo4h9XFhn your welcome23:00
claygmattoliverau: bookmarked23:01
claygyou should have misspelled best for me23:02
mattoliverauI can do that23:02
claygheheh no23:02
claygthis is better23:02
*** adriant has joined #openstack-swift23:02
mattoliverauclayg: too late :P https://paste.firnsy.com/paste/kaMN9IscphElU2xh23:03
claygheh, yeah I don't know which one is better!  thanks!23:03
mattoliverauwell at least the first makes sense :P23:04
*** Sukhdev has quit IRC23:04
*** JimCheung has quit IRC23:15
*** chsc has joined #openstack-swift23:16
*** chsc has joined #openstack-swift23:16
*** chsc has quit IRC23:38
*** ianychoi has joined #openstack-swift23:41
*** stradling has joined #openstack-swift23:43
*** kei_yama has joined #openstack-swift23:44
*** JimCheung has joined #openstack-swift23:48
*** stradling has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!