Friday, 2015-07-10

notmynamelooks like the SF openstack 5th birthyday party is about to kick off here at the office00:10
tdasilvacheers ;)00:14
mattoliveraunotmyname: yay! Have fun, wish I was in SF now :)00:15
*** blmartin has joined #openstack-swift00:18
*** mfalatic has quit IRC00:26
*** early has quit IRC00:26
*** darrenc is now known as darrenc_afk00:34
*** gyee has quit IRC00:36
*** dmorita has joined #openstack-swift00:37
*** jasondotstar has quit IRC00:38
*** annegentle has joined #openstack-swift00:44
*** annegentle has quit IRC00:49
*** h00327910_ has joined #openstack-swift00:51
*** zhill has quit IRC00:56
*** rdaly2 has joined #openstack-swift00:57
*** rdaly2 has quit IRC00:57
*** darrenc_afk is now known as darrenc01:00
*** lpabon has quit IRC01:08
*** kota_ has joined #openstack-swift01:09
*** ChanServ sets mode: +v kota_01:09
kota_Good morning!01:09
*** thurloat is now known as thurloat_isgone01:11
*** asettle is now known as asettle-afk01:17
openstackgerritjanonymous proposed openstack/swift: Adding bandit for security static analysis testing in swift  https://review.openstack.org/19639501:19
*** chlong has joined #openstack-swift01:20
*** zhill has joined #openstack-swift01:22
*** rbrooker has quit IRC01:22
*** zhill has quit IRC01:26
*** jasondotstar has joined #openstack-swift01:32
*** nexusz99 has joined #openstack-swift01:36
*** tongli has joined #openstack-swift01:52
*** haomaiwang has quit IRC01:56
*** zhill has joined #openstack-swift02:08
*** zhill has quit IRC02:12
*** janonymous has quit IRC02:15
*** haomaiwa_ has joined #openstack-swift02:16
mattoliveraukota_: morning02:26
kota_mattoliverau: hello :)02:26
*** asettle-afk is now known as asettle02:30
*** ho has joined #openstack-swift02:32
*** nightanne has joined #openstack-swift02:34
*** vinsh has quit IRC02:49
*** vinsh has joined #openstack-swift02:49
openstackgerritTim Burke proposed openstack/swift: Allow arbitrary UTF-8 storage policy names  https://review.openstack.org/20034302:51
*** haomaiwa_ has quit IRC02:52
*** haomaiwa_ has joined #openstack-swift02:52
openstackgerritTim Burke proposed openstack/swift: Allow arbitrary UTF-8 storage policy names  https://review.openstack.org/20034303:16
*** asettle is now known as alex-afk03:16
*** lpabon has joined #openstack-swift03:20
*** lpabon has quit IRC03:20
*** zhill has joined #openstack-swift03:21
*** nexusz99 has quit IRC03:25
*** nexusz99 has joined #openstack-swift03:25
*** zhill has quit IRC03:26
*** sanchitmalhotra has joined #openstack-swift03:27
*** blair has quit IRC03:28
*** tongli has quit IRC03:32
*** nightanne has quit IRC03:35
*** sanchitmalhotra1 has joined #openstack-swift03:36
*** nightanne has joined #openstack-swift03:36
*** sanchitmalhotra has quit IRC03:37
*** early has joined #openstack-swift03:39
*** sanchitmalhotra has joined #openstack-swift03:40
*** sanchitmalhotra1 has quit IRC03:43
*** sanchitmalhotra1 has joined #openstack-swift04:01
*** sanchitmalhotra has quit IRC04:03
*** nightanne has quit IRC04:09
*** darrenc is now known as darrenc_afk04:15
*** zhill has joined #openstack-swift04:19
*** haomaiwa_ has quit IRC04:20
*** ppai has joined #openstack-swift04:21
*** blmartin has quit IRC04:26
*** wbhuber has joined #openstack-swift04:28
*** darrenc_afk is now known as darrenc04:30
*** wbhuber has quit IRC04:32
zaitcevIt's the first time for me to hit a genuine Python 3 compatibility change, other than Unicode being all screwed up and gratious package renames: https://review.openstack.org/20037104:35
openstackgerritCarlos Cavanna proposed openstack/swift: Improving statistics sent to Graphite.  https://review.openstack.org/20037304:38
*** haomaiwang has joined #openstack-swift04:39
*** zhill has quit IRC04:47
*** jasondotstar has quit IRC04:48
*** zhill has joined #openstack-swift04:53
*** zhill has quit IRC04:53
*** SkyRocknRoll has joined #openstack-swift05:03
*** haomaiwang has quit IRC05:04
*** haomaiwang has joined #openstack-swift05:06
openstackgerritTim Burke proposed openstack/swift: Allow arbitrary UTF-8 storage policy names  https://review.openstack.org/20034305:24
*** zaitcev has quit IRC05:28
*** jbonjean has joined #openstack-swift05:33
*** david-ly_ has joined #openstack-swift05:37
*** david-lyle has quit IRC05:40
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix the missing SLO state on fast-post  https://review.openstack.org/18256405:46
*** ig0r__ has joined #openstack-swift05:51
*** j_king has quit IRC05:53
*** j_king has joined #openstack-swift05:54
*** ig0r_ has quit IRC05:55
*** haomaiwang has quit IRC06:04
*** haomaiwa_ has joined #openstack-swift06:08
*** ianbrown has joined #openstack-swift06:20
*** ppai has quit IRC07:01
*** portante has quit IRC07:09
*** portante has joined #openstack-swift07:11
*** rledisez has joined #openstack-swift07:15
*** ppai has joined #openstack-swift07:15
*** jistr has joined #openstack-swift07:16
*** jamielennox is now known as jamielennox|away07:17
*** alex-afk is now known as asettle07:18
*** hrou has quit IRC07:19
*** ho has quit IRC07:26
*** haomaiwa_ has quit IRC07:27
*** ppai has quit IRC07:27
*** haomaiwa_ has joined #openstack-swift07:28
*** ppai has joined #openstack-swift07:39
*** psanchez has joined #openstack-swift07:41
*** jordanP has joined #openstack-swift07:45
*** psanchez has quit IRC07:51
*** Guest39 has joined #openstack-swift07:51
*** Guest39 has quit IRC07:52
*** psanchez has joined #openstack-swift07:52
*** cazino has joined #openstack-swift07:59
*** sanchitmalhotra has joined #openstack-swift08:04
*** sanchitmalhotra1 has quit IRC08:06
*** joeljwright has joined #openstack-swift08:06
*** ChanServ sets mode: +v joeljwright08:06
*** joeljwright1 has joined #openstack-swift08:07
*** joeljwright has quit IRC08:08
*** joeljwright1 has quit IRC08:08
*** joeljwright has joined #openstack-swift08:09
*** ChanServ sets mode: +v joeljwright08:09
*** chlong has quit IRC08:10
*** haypo has joined #openstack-swift08:13
*** acoles_away is now known as acoles08:26
acolesgood morning08:27
joeljwrightmorning08:28
kota_acoles: joeljwright: morning :)08:29
acoleskota_: hello! my last day before vacation :D08:32
kota_acoles: nice! how do you plan your vacation?08:32
acoleskota_: visiting italy and portugal. resting!08:33
joeljwrightacoles: have fun (I'm very jealous)08:33
acolestime for late breakfast in office...08:33
kota_joeljwright: me too :P08:34
*** haypo has quit IRC08:34
*** haypo has joined #openstack-swift08:34
acolesjoeljwright: thanks!08:34
kota_acoles: anyways, I hope your vacation will be great ;-)08:34
acolesjoeljwright: i'm sure it will be unpleasantly hot and staying in uk would be better :P08:35
kota_lol08:35
joeljwrightacoles: I'm sure you'll find a way to survive ;)08:35
acolesits warm up for austin08:35
acolesjoeljwright: lol08:35
kota_that would be training08:35
kota_for austin08:36
openstackgerritVictor Stinner proposed openstack/swift: Fix tox -e py34  https://review.openstack.org/19903408:36
haypotimburke: ^^ here you have08:37
*** jistr has quit IRC09:00
*** ppai has quit IRC09:08
*** jistr has joined #openstack-swift09:16
*** ppai has joined #openstack-swift09:22
*** sanchitmalhotra1 has joined #openstack-swift09:41
*** sanchitmalhotra has quit IRC09:44
*** mahatic has joined #openstack-swift09:54
*** sanchitmalhotra has joined #openstack-swift10:07
*** sanchitmalhotra1 has quit IRC10:09
*** jasondotstar has joined #openstack-swift10:20
*** sanchitmalhotra1 has joined #openstack-swift10:24
*** nexusz99 has quit IRC10:26
*** sanchitmalhotra has quit IRC10:26
*** janonymous has joined #openstack-swift10:33
*** mutoulbj has joined #openstack-swift10:36
*** haomaiwa_ has quit IRC10:40
*** blair has joined #openstack-swift10:46
*** sanchitmalhotra has joined #openstack-swift10:53
*** jamielennox|away is now known as jamielennox10:54
*** sanchitmalhotra1 has quit IRC10:55
openstackgerritVictor Stinner proposed openstack/swift: Fix tox -e py34  https://review.openstack.org/19903410:55
openstackgerritVictor Stinner proposed openstack/swift: Fix test_wsgi for mock 1.1  https://review.openstack.org/20047411:06
*** cdelatte has joined #openstack-swift11:07
*** delattec has joined #openstack-swift11:07
*** psanchez has quit IRC11:10
haypoplease review https://review.openstack.org/#/c/200474/ -- the release of mock 1.1 broke the python27 gate, and this simple patch should fix the gate11:11
*** ccavanna has quit IRC11:13
*** psanchez has joined #openstack-swift11:19
*** km has quit IRC11:19
*** okdas has quit IRC11:26
*** okdas has joined #openstack-swift11:26
*** okdas has joined #openstack-swift11:26
*** kota_ has quit IRC11:28
*** mutoulbj has quit IRC11:33
*** kei_yama has quit IRC11:35
*** dmorita has quit IRC12:00
*** nightanne has joined #openstack-swift12:08
*** nightanne is now known as morninganne12:11
*** benny_ has joined #openstack-swift12:11
*** jasondotstar has quit IRC12:13
*** ig0r__ has quit IRC12:17
*** ig0r_ has joined #openstack-swift12:19
openstackgerritJiri Suchomel proposed openstack/swift: Let object-info find files in a given directory  https://review.openstack.org/18925812:20
*** david-lyle has joined #openstack-swift12:28
*** chlong has joined #openstack-swift12:28
*** mahatic has quit IRC12:29
*** david-ly_ has quit IRC12:30
openstackgerritPrashanth Pai proposed openstack/swift: Refactor server side copy as middleware  https://review.openstack.org/15692312:33
openstackgerritPrashanth Pai proposed openstack/swift: versioned writes middleware  https://review.openstack.org/13434712:33
*** janonymous has quit IRC12:33
*** sanchitmalhotra has quit IRC12:38
*** mahatic has joined #openstack-swift12:40
*** sanchitmalhotra has joined #openstack-swift12:43
*** mahatic has quit IRC12:44
*** psanchez has quit IRC12:45
*** mutoulbj has joined #openstack-swift12:54
*** benny_ has quit IRC12:54
*** ppai has quit IRC12:54
*** hrou has joined #openstack-swift13:01
*** ccavanna has joined #openstack-swift13:05
*** minwoob has quit IRC13:07
*** thumpba has joined #openstack-swift13:09
*** jamielennox is now known as jamielennox|away13:09
*** jasondotstar has joined #openstack-swift13:10
*** haomaiwa_ has joined #openstack-swift13:10
*** haomaiwa_ has quit IRC13:11
*** haomaiwang has joined #openstack-swift13:11
*** pksingh has joined #openstack-swift13:14
pksingh Hi torgomatic , swifterdarrell , can you please review https://review.openstack.org/#/c/183899/13:16
*** psanchez_ has joined #openstack-swift13:17
*** lpabon has joined #openstack-swift13:18
*** thurloat_isgone is now known as thurloat13:21
*** alexcampbell has joined #openstack-swift13:28
*** aix has quit IRC13:29
*** morninganne has quit IRC13:31
*** mahatic has joined #openstack-swift13:32
*** rvasilets_ has joined #openstack-swift13:33
EmilienMcschwede: hey, can you have a look at https://review.openstack.org/#/c/198695 please ?13:33
*** joeljwright has quit IRC13:34
EmilienMor anything from swift experts ^13:36
*** mahatic has quit IRC13:36
*** mahatic has joined #openstack-swift13:36
*** mahatic has quit IRC13:42
*** morninganne has joined #openstack-swift13:42
*** morninganne has quit IRC13:43
*** benny_ has joined #openstack-swift13:44
openstackgerritVictor Stinner proposed openstack/swift: Fixes for mock 1.1  https://review.openstack.org/20047413:46
*** mahatic has joined #openstack-swift13:46
*** pksingh has quit IRC13:48
*** blmartin has joined #openstack-swift13:54
*** mahatic has quit IRC13:55
CaioBrentanoHi all13:58
*** minwoob has joined #openstack-swift13:58
CaioBrentanoI'm having some trouble to access an object uploaded with --segment-size parameter (swift cli). Even with ".r:*" set on the container, this object is no public13:58
*** aix has joined #openstack-swift13:59
CaioBrentanoIs there anything specific about "segmented objects" to be public?13:59
*** petertr7_away is now known as petertr713:59
*** morninganne has joined #openstack-swift14:01
*** psanchez_ has quit IRC14:03
*** jlhinson has joined #openstack-swift14:04
*** NM has joined #openstack-swift14:05
*** morninganne has quit IRC14:11
*** wbhuber has joined #openstack-swift14:13
*** haypo has quit IRC14:19
*** jistr is now known as jistr|mtg14:22
openstackgerritVictor Stinner proposed openstack/swift: Fixes for mock 1.1  https://review.openstack.org/20047414:37
*** morninganne has joined #openstack-swift14:39
*** thumpba has quit IRC14:39
*** lcurtis has joined #openstack-swift14:39
lcurtishello all...would there ever be a need to set device weight to zero when replacing a failed hard drive?14:40
lcurtisstrating the documentation of our cluster and pondering this scenario14:40
lcurtisstarting14:40
*** tongli has joined #openstack-swift14:42
tdasilvalcurtis: i remember reading this blog post from torgomatic: https://swiftstack.com/blog/2012/04/09/swift-capacity-management/14:43
tdasilvathere's a section about removing capacity gradually that talks about slowly reducing the weight to zero14:44
*** fifieldt has quit IRC14:49
*** morninganne has quit IRC14:50
*** morninganne has joined #openstack-swift14:51
timburkenotmyname: gates for both client and server are broken. https://review.openstack.org/#/c/200474 should fix server, but client will need to wait on https://review.openstack.org/#/c/200344/ from global-requirements14:53
glangelcurtis: I think you just want to replace the hard drive fairly quickly -- swift will still work with a few failed drives -- plus replication is slow14:53
*** SkyRocknRoll has quit IRC14:54
*** chlong is now known as chlong-weekend14:54
*** blmartin_ has joined #openstack-swift14:59
*** joeljwright has joined #openstack-swift15:00
*** ChanServ sets mode: +v joeljwright15:00
*** petertr7 is now known as petertr7_away15:00
lcurtisThank you all!15:01
*** blmartin has quit IRC15:02
*** jrichli has joined #openstack-swift15:03
*** petertr7_away is now known as petertr715:03
*** jrichli has quit IRC15:04
openstackgerritTim Burke proposed openstack/python-swiftclient: Update mock requirements  https://review.openstack.org/20058215:14
*** alexcampbell has quit IRC15:15
*** rdaly2 has joined #openstack-swift15:16
*** alexcampbell has joined #openstack-swift15:18
*** ig0r__ has joined #openstack-swift15:18
tdasilvaglange: when would you recommend decreasing weight slowly over just replacing the drive quickly?15:21
*** ig0r_ has quit IRC15:22
glangeif the drive works and you are just reducing the size of your cluster by removing systems/drives -- you'd want to drain the drives you are removing15:22
tdasilvawould the opposite also apply? e.g., if you are increasing size of cluster by replacing to bigger drives?15:25
*** chlong-weekend has quit IRC15:26
glangeI'd guess you'd replace a small number of drives, then wait till they are replicated to, then increase the weight on them to reflect their greater capacity?15:26
glangebut you'd have to be careful to do it at the right speed, not too quickly?15:27
glangeI've never seen that :)15:27
glangeor maybe you could reduce the weight slowly to zero on a whole system15:28
glangethen put in the bigger drives15:28
*** alexcampbell has quit IRC15:28
glangeand slowly increase the weight15:28
glangebut I've never seen that either :)15:28
*** fthiagogv has joined #openstack-swift15:28
*** alexcampbell has joined #openstack-swift15:28
tdasilvaglange: yeah...i think that's the use case torgomatic used in his blog post. i guess swiftstack mgmt automates that whole process...15:29
glangeI've only seen, add capacity by adding systems and get rid of old systems so we need to drain them15:29
*** jistr|mtg is now known as jistr15:30
*** jkugel has joined #openstack-swift15:31
*** thebloggu has joined #openstack-swift15:34
*** hrou has quit IRC15:38
theblogguis it possible to use auth v2 with tempauth?15:40
*** alexcampbell has quit IRC15:48
openstackgerritAlistair Coles proposed openstack/swift: Refactor diskfile  https://review.openstack.org/19842915:49
*** SkyRocknRoll has joined #openstack-swift15:52
*** haypo has joined #openstack-swift15:54
haypotdasilva, here ;)15:54
*** rdaly2 has quit IRC15:54
tdasilvahaypo: i'm running test again15:55
haypotdasilva, you can use: tox -r -e py27, it's safer than rm -rf .tox15:55
*** mfalatic has joined #openstack-swift15:55
*** jistr has quit IRC15:55
haypotdasilva, it avoids to remove other env, and recently i typed rm -rf .git instead of rm -rf .tox...15:55
*** mfalatic_ has joined #openstack-swift15:56
tdasilvahaypo: oops...good tip15:56
haypotdasilva, upgrading mock on your system doesn't upgrade mock inside the venv, tox uses venv disconnected from the system15:56
tdasilvahaypo: thanks! was able to reproduce the errors now15:58
haypotdasilva, you now feel the power of mock 1.1!15:58
tdasilvalol15:59
haypoin fact, i expected much more changes15:59
haypoit's cool that mock helpd to find real bugs in tests15:59
haypoFYI i also find bugs sometimes when porting tests to python 315:59
hayporecently, i saw: assertEqual(list1.sort(), list2.sort())15:59
tdasilvahaypo: yeah. funny that assert_called didn't even exist15:59
haypohum ok... list.sort() returns None, so yes, None is equal to None16:00
*** mfalatic has quit IRC16:00
haypotdasilva, mocks have any attribute that you want. mock.Mock().whatever() works16:01
haypoit looks like mock.Mock.__getattribute__ now raises an exception when getting attribute with name starting with assert?16:01
haypo        if not self._mock_unsafe:16:01
haypo            if name.startswith(('assert', 'assret')):16:01
haypo                raise AttributeError(name)16:01
haypo"assret" haha16:02
*** jkugel has quit IRC16:02
*** mahatic has joined #openstack-swift16:03
*** petertr7 is now known as petertr7_away16:03
*** pbourke has joined #openstack-swift16:06
pbourkewhen getting 'account not found' errors on a fresh swift deploy, any ideas where I should be looking for the problem?16:06
*** benny_ has quit IRC16:06
*** cazino has left #openstack-swift16:07
*** mgarza has joined #openstack-swift16:09
haypotdasilva, thanks for the review on https://review.openstack.org/#/c/200474/16:10
*** jordanP has quit IRC16:11
*** adiantum has quit IRC16:12
*** rledisez has quit IRC16:12
*** alexcampbell has joined #openstack-swift16:16
*** haypo has quit IRC16:17
*** acoles is now known as acoles_away16:19
*** mahatic has quit IRC16:21
*** jrichli has joined #openstack-swift16:22
notmynamegood morning16:23
*** hrou has joined #openstack-swift16:23
notmynamepbourke: in your proxy server config, make sure you have account_autocreate = True (in the [app:proxy-server] section)16:24
timburkenotmyname: good morning! go fix the gate!16:24
notmynametimburke: I've already downloaded and run tests on patch 20047416:25
patchbotnotmyname: https://review.openstack.org/#/c/200474/16:25
notmynametimburke: so I'm working on it16:25
timburkenotmyname: thank you :)16:25
pbourkenotmyname: yes I have that set. I think the proxy can't talk to keystone. whats the difference between "username/password" conf values and admin_user/admin_password?16:27
*** robefran has joined #openstack-swift16:33
hrouAre you getting 403 or 400/401 - was dealing with keystone / swift integration just recently, paste the output from the swift client16:37
pbourkehrou: client output: http://paste.openstack.org/show/362320/16:42
pbourkehrou: proxy-server output: http://paste.openstack.org/show/362321/16:43
pbourkefinally, here's the crux commands I'm using to register swift with keystone: http://paste.openstack.org/show/362323/16:44
hrouCan you also show: env | grep -i OS_16:44
hrouAnd the proxy conf file for keystone16:44
pbourkehttp://paste.openstack.org/show/362324/16:45
pbourkehttp://paste.openstack.org/show/362326/ -- env | grep OS_16:45
notmynamemock 1.1 issues approved to land. thanks timburke tdasilva haypo16:47
hroupbourke - user_domain_id and project_domain id aren't needed for the V2 keystone API, but that's probably not a problem.16:48
*** adiantum has joined #openstack-swift16:48
pbourkehrou: ok. I was kind of following http://docs.openstack.org/kilo/install-guide/install/apt/content/swift-install-controller-node.html but the conf items seem to differ a bit depending on what guide you're reading16:49
hroupbourke:  Tell me about it ; ) I was doing something similar a couple days ago.  But essentially domain / project was introduced in V3 keystone.  Give me a sec still looking16:50
notmynametimburke: joeljwright: seems that swiftclient tests pass with newest mock, so is there an issue there to fix too?16:50
*** mfalatic_ is now known as mfalatic16:51
timburkenotmyname: yes. https://review.openstack.org/#/c/200582/16:51
pbourke"auth_plugin: password" - is this ok?16:51
*** mutoulbj has quit IRC16:52
hrouI've never actually set that my self I didn't think it was required, not sure that's the issue, looking at how you setup the user and endpoints in keystone now.16:52
notmynametimburke: ah. I was actually just looking for that one16:52
*** mutoulbj has joined #openstack-swift16:52
notmynametimburke: so we're ok with the semicolon version specifier on requirements now?16:53
timburkenotmyname: you can see the error it fixes in the next patch down: https://review.openstack.org/#/c/196970/16:53
timburkenotmyname: yep. we've got latest pbr now :)16:53
*** jkugel has joined #openstack-swift16:53
timburkenotmyname: i suppose i should make futures a py2-only requirement at some point...16:54
notmynametimburke: ah, I see why that's done now. you had to match global requirements. ok, good16:55
notmynametimburke: approved16:55
timburkenotmyname: do we still need to wait on the dep? https://review.openstack.org/#/c/200344/16:56
*** mutoulbj has quit IRC16:56
*** gyee has joined #openstack-swift16:57
hroupbourke:  It almost looks like keystone is fine with your request, when keystone fails you usually see: 'DEBUG:keystoneclient.session:Request returned failure status: 401'16:57
notmynametimburke: probably won't land until that happens. but now our own failing jobs won't be based on our speed to approve stuff. now we're waiting on that other one16:57
hroupbourke:  You have a proxy on http://192.168.0.50:8080 ?16:57
pbourkehrou: im not seeing any output in the keystone log when I run the request, but not sure if that's because its just a little quiet or swift is not hitting it at all16:58
timburkenotmyname: yep. thanks. just checking :)16:58
pbourkehrou: curl http://192.168.0.50:8080/healthcheck - OK16:58
notmynamelook! it's openstack http://cube-drone.com/comics/c/alien-geometries16:59
hroupbourke:  I do typically see keystone log output on every swift invocation, something like "2015-07-10 16:59:04.579 5868 INFO keystone.common.wsgi [-] GET /auth/tokens?nocatalog="17:00
*** bitblt has joined #openstack-swift17:01
hroupbourke:  Do you have account_autocreate = true set btw ?17:01
hroupbourke:  Under the proxy-server service conf17:02
pbourkehrou: yes17:02
hroupbourke: and allow_account_management ?17:03
pbourkeyup :)17:03
hroucool : )17:03
hroupbourke:  I also take it the keystone client (or openstack CLI) work just fine using the same OS_ env vars ?  e.g. keystone user-list ?17:04
pbourkehrou: yes all keystone commands seem to work well and give the right output. I can also get a valid token17:04
hroupbourke:  For the keystone conf file, what are you using for token_format ?17:05
pbourkehmm I dont seem to have that set17:06
pbourkedon't see any reference to it in keystone.conf17:06
hroupbourke, actually I don't think that's going to matter, again it looks like the keystone validation is Ok.17:06
hroupbourke, its probably under [token] now, through 'provider = keystone.token.providers.uuid.Provider' for example.17:07
pbourkehrou: if I try to use the openstackclient I get the following, don't know if it helps shed any light17:07
pbourkeDiscoveryFailure: Could not determine a suitable URL for the plugin17:07
hrou: )  Nah, that's probably because openstack CLI uses V317:08
hrouTry switching to: export OS_AUTH_URL=http://controller:35357/v317:08
*** janonymous has joined #openstack-swift17:08
hrou* well your host name17:08
hrouTry that either way we can try with the swift CLI too as follows17:09
hrouswift -debug -V 3 stat17:09
*** cdelatte has quit IRC17:09
*** delattec has quit IRC17:09
*** AJS_ has joined #openstack-swift17:10
*** zaitcev has joined #openstack-swift17:10
*** ChanServ sets mode: +v zaitcev17:10
pbourkeAuthorization Failure. Authorization failed: The resource could not be found. (HTTP 404)17:10
AJS_hello17:11
*** petertr7_away is now known as petertr717:12
AJS_I'm trying to get swift working and I am getting the popular 401 errors, I've googled this for a couple days now17:12
hroupbourke, btw I noticed something peculiar actually, for the REQ, I would typically expect to see:  DEBUG:swiftclient:REQ: curl -i http://0.0.0.0:8080/v1/AUTH_090ba1ae6d654be0adf512e047a1867d -I -H "X-Auth-Token: 62ef2eb611d24169ac16ab77324b2ccf"   Note the account name after AUTH_  whereas in your case its just the the end point17:12
AJS_not sure if this is the right channel to troubleshoot17:12
hroupbourke,  that seems suspicions17:12
zaitcevAJS_: ask away, just don't hold your hopes too high17:13
notmynameAJS_: welcome. looks like hrou and pbourke might be working through the exact same issue right now17:13
AJS_excellent17:13
hrouYep !  Do you use keystone AJS_  or not ?17:13
hrouFor validation17:13
AJS_yes I am using keystone17:14
zaitcevAnother morning, another syntax error in Keystone endpoint specification.17:14
zaitcevOr actually 2 today17:14
*** zhill has joined #openstack-swift17:14
AJS_when I try to execute swift stat I get a 40117:14
AJS_I have poured over the config files17:15
AJS_I'm pretty sure that my usernames/passwords are correct17:15
AJS_I can obtain a token from keystone17:15
hrouAJS_:  swift proxy conf, env | grep -i OS_, swift -- debug log, then maybe keystone info after17:15
hrouFrom experience, 401's are easier to debug then 404's : - )   401's are generally some legitimate mis-configuration.17:16
AJS_would you like the entire proxy conf or just the important bits?17:16
hrouUse: http://paste.openstack.org   you can still the whole thing17:17
hrouAJS_ I meant to say run:  swift -debug stat     < and capture the output17:18
pbourkehrou: I have to head off now unfortunately but I really appreciate the help. If you find any solutions with AJS_ please ping me and I'll try them on monday17:18
hroupbourke, sure thing we can chat more again, from the quick look it does seem you have keystone configured properly, we'll probably want to look at that other point I made.  I don't think your issues will be the same (i.e. 401 vs 404)17:19
pbourkesure thing17:19
pbourkethanks again17:19
AJS_ok, here is the proxy conf http://paste.openstack.org/show/362439/17:19
AJS_here is the env http://paste.openstack.org/show/362441/17:20
AJS_and here is the output of swift --debug stat http://paste.openstack.org/show/362455/17:22
hrouAJS_, btw do you have keystone logging configured, if so we'll probably see that worked, this is another case where it seems like keystone has now issues, and your problem doesn't lie there.17:25
AJS_I have debug logging turned on in keystone17:26
AJS_but that is behind an haproxy and is quite chatty17:27
hrouAJS_ actually one sec is this the pipeline catch_errors authtoken cache healthcheck proxy-logging proxy-server ?17:27
AJS_yes17:27
AJS_I took keystoneauth out17:27
AJS_read it on some other forum post17:28
hrouhmm, that's rather odd, fairly sure you need that.17:28
hrouI'll try getting rid of it in my case17:29
AJS_ok17:29
AJS_I still get the same 401 errors with or without keystoneauth in the pipeline17:30
hrou** without it: swift stat17:31
hrouAccount HEAD failed: http://0.0.0.0:8080/v1/AUTH_090ba1ae6d654be0adf512e047a1867d 401 Unauthorized17:31
hrou** Add it back, and lets look at the debug info then, I'm nearly positive you need it.17:32
AJS_I will add it back in17:32
hrouAJS_, something like pipeline = ... authtoken keystone proxy-logging proxy-server17:32
*** eandersson has quit IRC17:32
hrouAJS_, in your case its keystoneauth vs keystone17:33
*** cdelatte has joined #openstack-swift17:33
*** delattec has joined #openstack-swift17:33
*** jlhinson has quit IRC17:34
AJS_swift1 proxy-server: Pipeline was modified. New pipeline is "catch_errors gatekeeper authtoken cache healthcheck keystoneauth proxy-logging dlo proxy-server".17:35
AJS_I have added it back in, and here is the new output, looks very similar to me http://paste.openstack.org/show/362491/17:36
hrouAJS_, that output looks strikingly similar to when I remove keystoneauth, namely the fact we drive to requests to the keystone client after the first 40117:44
hrouAJS_, silly question but did you bounce swift after making the change ?17:44
hrouAJS_, at least the proxy.17:44
AJS_just the proxy service17:45
hrouAJS_, just for reference the output in my case when it was removed: http://paste.openstack.org/show/362492/17:45
*** joeljwright has quit IRC17:46
AJS_hmm, your initial request is to controller:3535717:47
AJS_on my system the request goes to controller:5000/v2.017:47
hrouhrou, right, pbourke from earlier was also using port 5000 on keystone as well, I think both should be fine.17:47
AJS_ok17:47
zaitcevI'm trying to remember if AJS_ needs memcached for Keystone or not. Unlike TempAuth, IIRC, the verification goes to Keystone anyway, only slower.17:51
zaitcevI think it's still necessary, but I can't remember17:52
openstackgerritMerged openstack/swift: Fixes for mock 1.1  https://review.openstack.org/20047417:52
zaitcevwhy17:52
hrouAJS_, can you do a keystone user-list ?17:52
AJS_sure, here you go http://paste.openstack.org/show/362493/17:53
zaitcevnaah, he's getting a token already. so it's a missing role or something17:54
hroumaybe : ) or another theory is17:55
hrouadmin_password in authtoken is incorrect17:55
zaitcevno, it's fine, see - DEBUG:urllib3.connectionpool:"POST /v2.0/tokens HTTP/1.1" 200 181917:55
zaitcevactually wait, you're right17:55
zaitcevIt was his client log.17:56
hrouYep ; )17:56
zaitcevWe need to see the /var/log/swift/swift.log17:56
hrouStill a theory though17:56
AJS_yeah that directory isn't there17:56
hrouDid you create it ?17:56
hrouAnd have rsys setup ?17:56
AJS_I think all my proxy logs go to /var/log/messages17:57
hrouSure !  doesn't matter where.17:57
AJS_there is quite a bit of info, I can set up a separate log for easier reading17:58
hrouSo the OS_* settings will validate keystone is allowed to provide a token, we know this is working !  So your OS_ settings are 100% fine17:58
hrou* Also if they were not keystone user-list wouldn't work17:58
zaitcevNot sure why admin_user=swift. Surely it's not actually admin... Athough if it's one of the recent keystones with PKI tokens, Swift does not even need to contact Keystone.17:58
AJS_I ran keystone user-list from the keystone server... not from the swift server17:58
AJS_I'm trying to lab up a distributed openstack17:59
hrouTry it from the swift server it should work there too.17:59
AJS_you're right, it does17:59
hrouzaitcev, most of the setups I see (and the tutorials online) use admin_user swift : )17:59
*** thebloggu has quit IRC18:00
hrouFairly sure all 3 of those values are right ?18:00
hrouThe other thing is to check fi swift is really an admin.18:00
hroukeystone user-get swift18:02
hroukeystone tenant-list18:02
hrouFrom that you can confirm swift is part of the service tenant group18:02
AJS_here is my /var/log/messages | grep swift http://paste.openstack.org/show/362494/18:03
*** proteusguy has quit IRC18:04
hrouAJS_, try this keystone  --os-username swift --os-password SWIFT_PASS --os-tenant-name service user-role-list18:05
hroudoes that work ?18:05
AJS_here is some more output, I believe that my curl shows that swift is part of the service tenant http://paste.openstack.org/show/362498/18:05
zaitcevAJS_: that's useless, all the proxy logging is missing18:06
AJS_sorry! I just uncommented the proxy-server logging portion18:07
hrouAJS_,  you need user-role-list to determine if swift belongs to service, but try what I said above first18:08
zaitcevI'd rather comment all of it back18:08
zaitcevincluding the "log_level = DEBUG" most of all, because then you're sending the logging at debug priority and rsyslog or journald just drops it18:08
AJS_this should show that swift is part of the admin group http://paste.openstack.org/show/362500/18:08
*** morninganne has quit IRC18:10
AJS_ok, I will comment the logging out18:10
hrouAJS_, yea confirms the password is correct as well.18:10
AJS_ch4rger18:16
AJS_lol18:16
zaitcevWell?18:16
*** proteusguy has joined #openstack-swift18:16
AJS_@zaitcev I'm not sure what to try next18:17
hroulogs as indicated are the best bet : )18:17
zaitcevWe're acting like amateurs here, guys.18:18
zaitcevInstead of trying random things, I think, AJS_ needs to trace the lifecycle of token and find out what exact check or operation fails.18:18
zaitcevWell, by accident we have established that the Keystone provides token to credentials admin:admin at least.18:19
zaitcevIt happens on the client.18:19
zaitcevNext, the token is sent to Swift18:19
zaitcevIf it's UUID token, authtoken sends it back to Keystone to verify18:20
zaitcevIf it's PKI token, it just verifies it, although I'm a bit behind and not sure what it uses. It must have some kind of public key at least, so that needs to be checked18:20
AJS_keystone is setup for UUID18:21
hroulikely uuid for most setups, but can check keystone.conf18:21
*** aix has quit IRC18:21
AJS_provider=keystone.token.providers.uuid.Provider18:21
zaitcevFrom there, it passes it down the pipeline to keystoneauth, which then authorizes and can thrown a 401 in case of roles issue. Fortunately, it has a special exception for tennant == user, like admin:admin or foo:foo18:22
zaitcevEach step must have a clear log event from each middleware18:22
AJS_I will gladly do whatever testing, I am just not 100% sure how to get the information you guys need18:22
zaitcevwell... Make sure proxy logs at least. Middlewares might have their own levels that may be useful. I usually just go to github real quick, because it's impossible to remember the million parameters there.18:25
zaitcevhere's the keystoneauth, it's in our own tree - https://github.com/openstack/swift/blob/master/swift/common/middleware/keystoneauth.py18:26
zaitcevthe authtoken we borrow from Keystone people, gimme a sec18:27
zaitcevoh holy mother, they split it all up18:28
zaitcevAnyway, hrou went PM with it for some reason, but you probably want to look at https://github.com/openstack/keystonemiddleware/blob/master/keystonemiddleware/auth_token/__init__.py18:32
openstackgerritTim Burke proposed openstack/python-swiftclient: Update mock requirements  https://review.openstack.org/20058218:33
AJS_I'll work on getting some meaningful logging18:34
zaitcevI agree, it's Job One here. From there, track the lifecycle of token down the pipeline.18:35
timburkenotmyname: looks like global-requirements wanted to do the version-bump as a separate patch. the version pin is already in18:35
*** jrichli has quit IRC18:35
notmynametimburke: we have to change ours then?18:35
zaitcevAt times I had to mod the source right in /usr with "import q" and basically printouts into /tmp/dump, because I had trouble making logging work.18:36
timburkenotmyname: my second patchset should fix it. just wanted to explain the difference18:36
notmynametimburke: ok, so they want >1.0 now and then they'll add in the >1.1 later?18:37
timburkenotmyname: yep18:38
timburkenotmyname: see https://review.openstack.org/#/c/20058318:38
notmynametimburke: seems silly, but ok18:40
*** sanchitmalhotra1 has joined #openstack-swift18:44
*** sanchitmalhotra has quit IRC18:46
*** logan2 has quit IRC18:51
*** logan2 has joined #openstack-swift18:52
*** robefran has quit IRC19:02
*** morninganne has joined #openstack-swift19:03
*** kutija_ has joined #openstack-swift19:06
*** kutija has quit IRC19:09
*** jrichli has joined #openstack-swift19:12
*** morninganne is now known as annegentle19:12
*** kutija has joined #openstack-swift19:15
*** kutija_ has quit IRC19:18
*** ig0r__ has quit IRC19:19
*** ig0r_ has joined #openstack-swift19:19
*** blmartin_ has quit IRC19:19
*** acampbell has joined #openstack-swift19:34
hrouSorry missed zaitcev last msg above, when I ran into my issues with keystone I went down a similar path, and added logging, FYI, the logging will work as is, it will be printed out as if it was from the proxy-server, so in its log (its setup in the auth_token __init__) if you installed from a package generally you can find it here (ubuntu) if you need to change it: /usr/lib/python2.7/dist-packages/keystonemiddleware/auth_token/19:34
zaitcevSame for Red Hat, just in site-packages/19:35
*** jrichli has quit IRC19:36
AJS_I was just typing out a message regarding the logging, I have been having quite a difficult time setting it up, I have rsyslog re-directing logs for swift into /var/log/swift/19:36
AJS_but debugs don't appear to be working19:36
AJS_let me check the auth_token dir19:36
AJS_ok, I have auth_token.py on the server (Centos 7)19:37
AJS_and the __init__.py is empty19:37
*** minwoob has quit IRC19:41
*** alexcampbell has quit IRC19:44
openstackgerritMerged openstack/swift: add domain_remap to /info  https://review.openstack.org/18904519:44
*** wbhuber has quit IRC19:51
*** jkugel1 has joined #openstack-swift19:53
*** jkugel has quit IRC19:56
openstackgerritMerged openstack/swift: Add ring-builder analyzer.  https://review.openstack.org/19739520:12
openstackgerritMerged openstack/swift: Stop moving partitions unnecessarily when overload is on.  https://review.openstack.org/19739620:12
openstackgerritMerged openstack/swift: Ring builder code clean up follow up patch  https://review.openstack.org/19986420:12
torgomaticVICTORY! Once more, the forces of recheck have defeated the gate.20:14
*** bitblt has quit IRC20:14
notmynameyay20:14
pgbridgeand the crowd goes wilf20:20
pgbridges/wilf/wild20:20
AJS_well, I have tried a bunch of things and the logging isn't working as I had hoped20:20
AJS_besides logs, is there another way to validate operations?20:20
*** jasondotstar has quit IRC20:28
*** ccavanna has quit IRC20:32
*** SkyRocknRoll has quit IRC20:34
*** thurloat is now known as thurloat_isgone20:38
*** annegentle has quit IRC20:39
*** fthiagogv has quit IRC20:51
*** tongli has quit IRC20:51
*** petertr7 is now known as petertr7_away20:53
*** lpabon has quit IRC20:54
openstackgerritTim Burke proposed openstack/python-swiftclient: Update mock requirements  https://review.openstack.org/20058220:57
notmynametimburke: *sigh*20:58
timburkenotmyname: yep. i'm a bit annoyed by that one.21:02
*** CaioBrentano has quit IRC21:03
-openstackstatus- NOTICE: Gerrit will be unavailable from 22:00 to 22:30 UTC for project renames21:03
portantefolks, have you all seen this one? http://cube-drone.com/comics/c/relentless-persistence21:05
portanteand, http://cube-drone.com/comics/c/alien-geometries21:06
*** wbhuber has joined #openstack-swift21:10
*** ig0r_ has quit IRC21:10
zaitcevYou came back from the dead for _this_?21:11
*** samueldmq has quit IRC21:12
portantesorry to disappoint21:15
* portante crawls back under a rock21:15
*** alexcampbell has joined #openstack-swift21:15
pgbridgehad never heard of that webcomic before today, thanks for introducing it21:16
*** jasondotstar has joined #openstack-swift21:18
*** annegentle has joined #openstack-swift21:18
tdasilvajust came accross this: https://lwn.net/Articles/650521/21:19
*** annegentle has quit IRC21:19
*** annegentle has joined #openstack-swift21:20
*** jasondotstar has quit IRC21:22
zaitcevBet it requires py321:23
*** jasondotstar has joined #openstack-swift21:31
portantetdasilva: then swifterdarrell's work could be all run in one process!21:31
*** adiantum has quit IRC21:36
*** hrou has quit IRC21:38
*** jasondot_ has joined #openstack-swift21:50
*** jasondotstar has quit IRC21:53
*** alexcampbell has quit IRC21:56
-openstackstatus- NOTICE: Gerrit is unavailable from approximately 22:00 to 22:30 UTC for project renames22:00
*** omame has left #openstack-swift22:00
*** ChanServ changes topic to "Gerrit is unavailable from approximately 22:00 to 22:30 UTC for project renames"22:00
notmynameoh. I guess I won't do this review now22:01
*** annegentle has quit IRC22:09
*** samueldmq has joined #openstack-swift22:10
*** mgarza has quit IRC22:23
*** ChanServ changes topic to "Review Dashboard: http://goo.gl/8IUcKl | Summary Dashboard: http://goo.gl/qHus5v | Hackathon topics: https://etherpad.openstack.org/p/swift-midcycle-aug-2015 | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/"22:31
*** NM has quit IRC22:35
*** sanchitmalhotra has joined #openstack-swift22:49
*** sanchitmalhotra1 has quit IRC22:51
*** dhellmann has quit IRC22:54
*** Anticimex has quit IRC22:54
*** lcurtis has quit IRC22:54
*** Anticimex has joined #openstack-swift22:55
*** dhellmann has joined #openstack-swift22:56
*** lcurtis has joined #openstack-swift22:57
*** lcurtis has quit IRC23:01
*** jkugel1 has left #openstack-swift23:07
*** ccavanna has joined #openstack-swift23:18
*** gyee has quit IRC23:21
*** hrou has joined #openstack-swift23:37
*** openstackgerrit has quit IRC23:39
*** zhill has quit IRC23:39
*** openstackgerrit has joined #openstack-swift23:39
notmynamemordred: we've got a patch on swiftclient to allow for setting the output directory and removing a prefix from objects downloaded. not sure if it will help in the infra world, but it looks interesting23:46
notmynamemordred: https://review.openstack.org/#/c/160283/1623:46
mordrednotmyname: that does look interesting ... although so far we do not download anything in infra land...23:58
mordredBUT23:58
mordredI like that a lot - because with log uploading and whatnot for infra - it should make "hey man, get me all the artifacts from this build" super easy for folks23:58
mordredetc23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!