Thursday, 2015-02-19

jamielennoxhaneef_: so all the - need to be _00:02
jamielennox- isn't valid in ini files i think00:02
openstackgerritMerged openstack/keystone: Check for invalid filtering on v3/role_assignments  https://review.openstack.org/14470300:02
haneef_How are the arguments passed to pluggin, we are not passing kwargs00:03
jamielennoxalso the **kwargs that is passed to load_from_conf_options allow you to override or set options from code that are not present in the conf file00:03
jamielennoxhaneef_: we are passing the CONF object and the group to read the arguments from00:03
haneef_ok, let me debug that and get back to you00:05
jamielennoxhaneef_: https://github.com/openstack/python-keystoneclient/blob/master/keystoneclient/auth/base.py#L276 is where the work is happening00:05
haneef_I see that. let me verify the settings it one more time00:06
jamielennoxhaneef_: so the problem people (swift) has been having is that they expect to be able to pass all these options to the __init__ function rather than use the global conf object00:07
gyeejamielennox, they have to be in the global conf right?00:07
jamielennoxbecause they set the options via paste.ini and not [keystone_authtoken] in service.conf00:07
gyeepaste.ini doesn't work anymore?00:07
jamielennoxi don't have an answer for that yet00:07
jamielennoxgyee: not with plugins00:07
gyeeI remember there was a patch from swift guys00:08
jamielennoxthere was something that tried to address it but it's a fair way off being a general solution00:08
jamielennoxi think the eventual solution will be to have a series of factory functions for AuthToken depending on where you load from00:08
jamielennoxand we instantiate AuthProtocol with like a session directly00:09
jamielennoxi'm just not sure how to get there yet, i had an attempt and it was more difficult than expected00:10
jamielennoxi think i'll have to extract a good subclass out of AuthProtocol that takes the options we want, and then have the AuthProtocol object be all the hacks that will make it continue to work00:10
jamielennoxthen we can deprecate  peoples use of AuthProtocol for the new object00:11
gyeepaste uses factory to instantiate AuthProtocol00:11
jamielennoxright, the paste entry point is not AuthProtocol directly, so we can add some stuff in there for example to make that work right00:12
jamielennoxactually it would be really cool if AuthProtocol just instantiated a ksc.adapter for all this stuff....00:12
jamielennoxhmm00:13
gyeecan we use inspect to figure out who's instantiating it?00:13
gyeethen act accordingly00:13
jamielennoxi'm not sure - but i don't know if it would buy us anything00:14
jamielennoxthe problems are the people we don't know00:14
jamielennoxfor example sahara and everyone that doesn't use paste constructs and AuthProtocol object directly00:14
jamielennox*an00:14
jamielennoxif they're using the paste factory it's fairly easy00:14
gyeeI would think those are in the minority00:15
jamielennoxdoesn't mean we can break them though00:15
jamielennoxswift is in the absolute minority here, not using oslo.config at all00:16
*** stevemar has quit IRC00:16
gyeeoh00:16
gyeebut that's a different issue right?00:17
gyeenot using oslo.config and instantiating AuthProtocol directly00:18
jamielennoxgyee: yes and no, if glance and swift were using oslo.config i don't know if anyone would have even noticed the difference00:18
*** nellysmitt has joined #openstack-keystone00:19
*** markvoelker has quit IRC00:19
morganfainbergjamielennox: glance doesn't use oslo.config?00:20
gyeek, in that case, ksc.adapter seem like way to go00:20
jamielennoxglance does, but they don't use the global CONF00:21
jamielennoxahh, glance.. might be marconi i'm thinking of00:21
jamielennox... or whatever its new name was00:21
jamielennoxswear i've given up tracking all the new project names00:21
morganfainbergMarconi. Yes.00:21
gyeemacaroni :)00:22
*** stevemar has joined #openstack-keystone00:22
*** ChanServ sets mode: +v stevemar00:22
jamielennoxit was flaper who reported the issue, so it was one of those 200:22
*** nellysmitt has quit IRC00:24
openstackgerritSamuel de Medeiros Queiroz proposed openstack/keystone: Extract test_v3_resource from test_v3_assignment  https://review.openstack.org/15408000:32
*** stevemar has quit IRC00:32
*** david-lyle is now known as david-lyle_afk00:41
*** gordc has quit IRC00:42
*** markvoelker has joined #openstack-keystone00:52
*** browne has quit IRC00:53
*** ljfisher has quit IRC00:53
*** bknudson has quit IRC00:58
*** spandhe has quit IRC00:59
*** markvoelker has quit IRC00:59
openstackgerritMerged openstack/keystone: Consistently use oslo_config.cfg.CONF  https://review.openstack.org/14736701:07
openstackgerritMerged openstack/keystone: Consistently use oslo_config.cfg.CONF  https://review.openstack.org/14736701:07
*** vishy has quit IRC01:07
*** vishy has joined #openstack-keystone01:08
*** samueldmq_ has quit IRC01:21
openstackgerritRaildo Mascena de Sousa Filho proposed openstack/keystone: Not allow create a project with slash in name  https://review.openstack.org/15715201:28
*** markvoelker has joined #openstack-keystone01:29
*** ajayaa has joined #openstack-keystone01:29
*** EmilienM is now known as EmilienM|afk01:36
*** stevemar has joined #openstack-keystone01:37
*** ChanServ sets mode: +v stevemar01:37
*** ajayaa has quit IRC01:38
*** devlaps has quit IRC01:55
*** eagleson has joined #openstack-keystone02:06
openstackgerritSteve Martinelli proposed openstack/keystone: Use oslo.policy instead of incubated version  https://review.openstack.org/14862402:06
*** krtaylor has joined #openstack-keystone02:09
*** jaosorior has quit IRC02:11
*** zzzeek has quit IRC02:13
*** nellysmitt has joined #openstack-keystone02:20
*** nellysmitt has quit IRC02:24
openstackgerritBrant Knudson proposed openstack/keystone: Move eventlet server options to a config section  https://review.openstack.org/13096202:25
openstackgerritBrant Knudson proposed openstack/keystone: Regenerate sample config file  https://review.openstack.org/15256302:25
*** erkules_ has joined #openstack-keystone02:27
*** erkules has quit IRC02:29
*** _cjones_ has quit IRC02:30
*** spandhe has joined #openstack-keystone02:41
*** spandhe_ has joined #openstack-keystone02:43
*** spandhe has quit IRC02:46
*** spandhe_ is now known as spandhe02:46
openstackgerritLin Hua Cheng proposed openstack/keystone: Implement validation on the Identity V3 API  https://review.openstack.org/13212202:48
*** dims_ has quit IRC02:52
*** ljfisher has joined #openstack-keystone02:54
*** lhcheng has quit IRC03:00
*** harlowja_ is now known as harlowja_away03:15
*** marg7175 has quit IRC03:21
*** eagleson has quit IRC03:44
jamielennoxgyee: here?03:51
*** richm has quit IRC03:51
*** dims__ has joined #openstack-keystone03:52
*** dims__ has quit IRC03:57
*** henrynash has joined #openstack-keystone04:06
*** ChanServ sets mode: +v henrynash04:06
openstackgerritAbhishek Talwar proposed openstack/python-keystoneclient: User-password-update accepts blank as password  https://review.openstack.org/14739904:12
openstackgerritSteve Martinelli proposed openstack/keystone: Use oslo.policy instead of incubated version  https://review.openstack.org/14862404:14
openstackgerritSteve Martinelli proposed openstack/keystone: Remove incubated version of oslo policy  https://review.openstack.org/15715804:17
*** tqtran has quit IRC04:18
*** nellysmitt has joined #openstack-keystone04:21
*** marg7175 has joined #openstack-keystone04:22
*** marg7175 has quit IRC04:22
*** marg7175 has joined #openstack-keystone04:23
*** lhcheng has joined #openstack-keystone04:24
openstackgerrithenry-nash proposed openstack/keystone: Refactor filter and sensitivity tests in prepartion for LDAP support  https://review.openstack.org/14755104:25
*** lhcheng_ has joined #openstack-keystone04:25
*** nellysmitt has quit IRC04:25
openstackgerritSteve Martinelli proposed openstack/keystone: Provide additional detail if OAuth headers are missing  https://review.openstack.org/14219104:27
*** lhcheng has quit IRC04:28
openstackgerritSteve Martinelli proposed openstack/keystone: Check consumer and project id before creating request token  https://review.openstack.org/14570104:30
openstackgerritSteve Martinelli proposed openstack/keystone: Enable endpoint_policy, endpoint_filter and oauth by default  https://review.openstack.org/15384204:30
openstackgerrithenry-nash proposed openstack/keystone: Refactor filter and sensitivity tests in prepartion for LDAP support  https://review.openstack.org/14755104:32
openstackgerrithenry-nash proposed openstack/keystone: Enable filtering in LDAP backend for listing entities  https://review.openstack.org/14761204:32
*** marg7175 has quit IRC04:34
openstackgerritSteve Martinelli proposed openstack/keystone: Add WebSSO support for federation  https://review.openstack.org/13617704:35
stevemarahh night time, always a good time to rebase things04:36
henrynashstevemar: :-)04:37
stevemarhenrynash, or early morning in your case04:37
stevemari plan on reviewing your stuff before i sleep04:37
henrynashstevemar: indeed…actually not quite so early since I’m in Latvia (of all places) to present at a conference today04:37
stevemarhenrynash, hope you are prepped and ready to go!04:38
henrynashstevemar: ahh, February on the Baltic…..04:38
*** lhcheng_ has left #openstack-keystone04:38
stevemarhenrynash, it's the kind of dream vacation they give away on game shows04:38
henrynashstevemar: not sure…didn’t sleep a wink due to noisy cr*ppy hotle room. so my fall aslpeep in PowerPoint04:38
*** markvoelker has quit IRC04:42
*** markvoelker has joined #openstack-keystone04:42
*** markvoelker has quit IRC04:46
*** henrynash has quit IRC04:47
gyeejamielennox, back04:51
jamielennoxgyee: oh, not that important, can you look at https://review.openstack.org/#/c/122281/22 and the follow up04:52
jamielennoxthey're bknudson's and they've been there a while04:52
jamielennoxi thought they merged ages ago04:52
gyeejamielennox, sure04:52
jamielennoxcould have got stevemar or henry to look04:52
stevemarjamielennox, you could have >.>04:53
jamielennoxstevemar: i thought about it when i mentioned to gyee - then i've been heads down in stuff04:53
jamielennoxripping auth_token appart actually04:54
jamielennoxi thought it would be mean to make him rebase those patches again04:54
stevemarjamielennox, i was going to ping you about it when you asked if gyee was around, but same, decided to rebase all my broken patches04:54
gyeelooks fine, stevemar, mine if I pull the trigger?04:54
stevemargyee, go ahead sir04:55
stevemarfire away!04:55
jamielennoxgyee: do it04:55
gyeedone04:56
jamielennoxthat one has been there since september, the follow up since june04:56
gyeestill waiting for a decent python crypto to come along so we don't have to do this stuff04:56
gyeejamielennox, means I have to rebase because I have internal middleware which extends keystonemiddleware :(04:58
jamielennoxgyee: you're going to hate what i've got coming then04:58
gyeethat's fine04:58
gyeeI love coding :)04:58
*** _cjones_ has joined #openstack-keystone04:59
gyeestevemar, are you rebasing this one? https://review.openstack.org/#/c/153842/05:01
gyeewould love to get that one in too05:01
stevemargyee, i am, but it depends on bknudsons stuff05:02
*** topol has joined #openstack-keystone05:02
*** ChanServ sets mode: +v topol05:02
gyeeoh my, here's another dependency chain05:02
stevemargyee, i swear, everyone misses those :)05:04
gyeestevemar, can you enlighten me on what's going on with line 22 here? https://review.openstack.org/#/c/156071/2/keystone/contrib/federation/routers.py05:10
stevemargyee, i would love to but... https://review.openstack.org/#/c/156071/1..2/keystone/contrib/example/routers.py05:12
*** markvoelker has joined #openstack-keystone05:13
*** spandhe has quit IRC05:13
*** henrynash has joined #openstack-keystone05:13
*** ChanServ sets mode: +v henrynash05:13
stevemari think what it comes down to is, we need to at least import the module to kick off the init, thus registering a dependency, and finally we have self.xyz_api available05:13
*** henrynash has quit IRC05:13
stevemargyee, ^05:13
gyeeI understand the import part, but I don't understand the self assignment part05:14
*** _cjones_ has quit IRC05:15
*** _cjones_ has joined #openstack-keystone05:15
*** markvoelker has quit IRC05:17
openstackgerritSteve Martinelli proposed openstack/keystone: Create extension provider instances once  https://review.openstack.org/15607105:18
*** henrynash has joined #openstack-keystone05:18
*** ChanServ sets mode: +v henrynash05:18
gyeeso the first import initializes the provider, the assign to itself to make them visible?05:19
gyeescope magic05:19
openstackgerritSteve Martinelli proposed openstack/keystone: Avoid multiple instances for a provider  https://review.openstack.org/12459905:20
stevemargyee, there we go, all rebased05:22
gyeestevemar, k, looking05:22
*** jimbaker has quit IRC05:22
openstackgerritSteve Martinelli proposed openstack/keystone: Enable endpoint_policy, endpoint_filter and oauth by default  https://review.openstack.org/15384205:22
stevemarif we can figure this out, we can get it through tonight :O05:22
*** jimbaker has joined #openstack-keystone05:23
*** jimbaker has quit IRC05:23
*** jimbaker has joined #openstack-keystone05:23
*** gyee has quit IRC05:36
*** henrynash has quit IRC05:38
openstackgerritMerged openstack/keystonemiddleware: Refactor extract class for signing directory  https://review.openstack.org/12228105:50
openstackgerritMerged openstack/keystone: refactor: use _get_project_endpoint_group_url() where applicable  https://review.openstack.org/13908005:50
jamielennoxstevemar: here?05:51
*** lhcheng has joined #openstack-keystone05:52
*** zigo has quit IRC05:54
*** zigo has joined #openstack-keystone05:55
stevemarjamielennox, in a metaphysical sort of sense05:56
jamielennoxstevemar: had assumed you'd actually gone to be05:56
jamielennoxd05:56
jamielennoxi thought gyee was going to do both, can you look at https://review.openstack.org/#/c/102403/05:56
jamielennoxor leave it if you're done05:56
stevemarjamielennox, i'll take a look, i assumed he was going to do both as well :)05:57
*** _cjones_ has quit IRC06:00
openstackgerritSteve Martinelli proposed openstack/pycadf: Additional doc clean up  https://review.openstack.org/15646306:00
openstackgerritSteve Martinelli proposed openstack/keystone: Provide additional detail if OAuth headers are missing  https://review.openstack.org/14219106:03
openstackgerritOpenStack Proposal Bot proposed openstack/keystone: Imported Translations from Transifex  https://review.openstack.org/15726606:04
stevemarjamielennox, thats a nice refactor06:09
jamielennoxstevemar: they've both been good for ages06:10
jamielennoxnot sure why they've taken so long06:10
stevemarjamielennox, reviews are pretty down this release06:11
*** markvoelker has joined #openstack-keystone06:13
topolwow stevemar. you went the extra mile on the pycadf format_json patch06:18
*** markvoelker has quit IRC06:18
stevemarjamielennox, at any rate, if you see me on irc late at night and need a review let me know, i'd be more than happy06:18
stevemartopol, it was bugging me06:18
topol:-)06:19
topolstevemar, we are gonna hit like 0 degree F here day after tomorrow. I cant believe it.06:20
topolIm scared my pipes will burst06:20
stevemartopol, that is getting chilly06:20
topolstevemar, we dont build houses for that temp in the south06:20
stevemartopol, it's actually a bit warmer than usual for us tomorrow, we will actually have comparable temperates06:21
stevemartemperatures*06:21
*** nellysmitt has joined #openstack-keystone06:22
topolstevemar, hit the beach!06:22
stevemari wish06:22
stevemartopol, whats the things to do... run the water to prevent the pipes from freezing? could do that if you're really worried06:24
topolstevemar, yep, I'm dripping a faucet or two06:25
stevemari haven't heard of too many cases of residential pipes freezing, happens a lot to pipes running under the streets06:25
topolstevemar, yeah they dont insulate the pipes down here. So better safe than sorry06:26
*** nellysmitt has quit IRC06:26
*** spandhe has joined #openstack-keystone06:27
morganfainbergtopol just run your tap (drip) all night06:37
morganfainbergit's how we did it when it was super cold in the moutains06:37
topolmorganfainberg, will do. BTW I just sent you an urgent email06:37
morganfainberglooking06:37
morganfainbergre that email i'm really trying to force them to involve people06:38
morganfainbergthere is only so much i can do :(06:38
morganfainbergwill fwd to some people06:38
morganfainbergindicating urgency06:38
morganfainbergtmmrrow06:38
morganfainbergok?06:38
morganfainbergactually i'll make a point to call hogepodge and bug him06:39
morganfainbergthis is not something that can linger too much06:39
*** ljfisher has quit IRC06:39
hogepodgemorganfainberg: pong!06:40
morganfainberghogepodge, got a sec?06:40
morganfainberglet me call06:40
hogepodgetopol I'm in Austin right now and will push it tomorrow (today)06:45
topolhogepodge.  THANKS!06:46
*** atmark has quit IRC06:50
*** spandhe has quit IRC06:54
stevemarmorganfainberg, btw i just +Aed this one https://review.openstack.org/#/c/125521/06:57
stevemaryou had a -1 on it, but it was the domain FK thing06:57
stevemari figured it's safe06:58
stevemarmorganfainberg, feel free to review it saying you're cool with it, or undo the approval if you feel it's necessary06:59
morganfainbergstevemar sure07:00
stevemarmorganfainberg, thx dude07:01
openstackgerritSteve Martinelli proposed openstack/keystone: Enable endpoint_policy, endpoint_filter and oauth by default  https://review.openstack.org/15384207:02
morganfainbergstevemar, its a bit late for me here. if the -1 is addressed feel free to override or i'll look at it first thing tomorrow07:03
stevemarmorganfainberg, i would feel better if you took a look at it, i'll rescind my -107:03
morganfainbergstevemar, the FK thing is a non issue with the sql-migration you proposed merged07:03
stevemarerr my +A07:03
morganfainbergstevemar, the +A is fine07:03
morganfainbergmy only concern was the FK07:04
stevemarmorganfainberg, and that definitely merged, i think you +A'ed it :P07:04
morganfainbergyes i did07:04
stevemarthen we are good07:05
morganfainbergso don't worry about overriding my -107:05
stevemarit just looks weird when i +A something and the ptl has a -1 there07:05
stevemar:)07:05
morganfainbergnope you can reference this IRC meeting07:05
morganfainbergs/meeting/convi07:05
morganfainbergconvo*07:05
stevemargood point07:05
morganfainbergdon't worry about it who is going to complain, me?07:05
morganfainberg;)07:05
*** _cjones_ has joined #openstack-keystone07:07
*** afazekas has joined #openstack-keystone07:08
openstackgerritMerged openstack/keystonemiddleware: Refactor auth_token revocation list members to new class  https://review.openstack.org/10240307:09
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Move auth_token into its own folder  https://review.openstack.org/15727607:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Separate exceptions into there own file  https://review.openstack.org/15727707:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Extract SigningDirectory into file  https://review.openstack.org/15727807:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Extract revocations to file  https://review.openstack.org/15727907:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Break default auth plugin into file  https://review.openstack.org/15728007:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Extract all TokenCache related classes to file  https://review.openstack.org/15728107:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Extract IdentityServer into file  https://review.openstack.org/15728207:10
openstackgerritJamie Lennox proposed openstack/keystonemiddleware: Move UserAuthPlugin into its own file  https://review.openstack.org/15728307:10
jamielennox:)07:10
*** markvoelker has joined #openstack-keystone07:14
*** chlong has quit IRC07:19
*** markvoelker has quit IRC07:19
stevemarjamielennox, what did you just do07:20
*** jamiec has quit IRC07:20
jamielennoxmade a headache of a rebasing serious that i'm going to have to chase up for months07:20
jamielennox*series07:20
*** spandhe has joined #openstack-keystone07:21
jamielennoxstevemar: i got really sick of trying to find out where in the >2000 lines of auth_token code something was handled07:22
stevemarauth_token is unnecessarily large07:23
morganfainbergjamielennox, i'm scared07:23
morganfainbergjamielennox, >.>07:23
jamielennoxmorganfainberg: this is why the whole class is private :)07:23
stevemarmorganfainberg, jamielennox i totally got the first patch of the chain07:23
jamielennoxstevemar: :)07:23
stevemarmv auth_token.py to own folder, done!07:24
stevemarjamielennox, ah calling it __init__.py eh07:25
jamielennoxstevemar: i was going to just combine it with the next one, but i figured it could be it's own in case someone does something really stupid in gate07:25
*** topol has quit IRC07:25
stevemarjamielennox, is moving it to it's own folder going to cause issues when it's released?07:27
jamielennoxstevemar: it really shouldn't07:28
jamielennoxhaving auth_token.py or auth_token/__init__.py should be exactly the same AFAIK07:28
stevemarif someone was `from keystonemiddleware import auth_token`, ah it still works cause now it's in __init__07:28
stevemar;)07:28
stevemari gotcha07:28
jamielennoxstill, i think that's my first +0/-0 patch07:28
jamielennoxi wonder if that would get be ATC at summit?07:29
stevemarjamielennox, it's still a patch, so maybe07:29
stevemari'd say yes07:29
stevemargood thing you have it too, not sure about all that other work you do07:29
stevemarnot enough to qualify you or anything07:29
jamielennoxlol07:29
*** dims__ has joined #openstack-keystone07:30
stevemaryou are just ripping out everything!07:31
stevemarthis is lovely07:31
*** _cjones_ has quit IRC07:31
jamielennoxstevemar: if it passes gate it should be super simple to review07:31
stevemaryep07:32
stevemari'm noticing that07:32
*** jamiec has joined #openstack-keystone07:33
*** dims__ has quit IRC07:35
*** browne has joined #openstack-keystone07:41
*** jamiec has quit IRC07:46
openstackgerritMerged openstack/keystone: Internal notifications for cleanup domain  https://review.openstack.org/12552107:53
*** spandhe has quit IRC08:00
*** harlowja_away has quit IRC08:03
*** markvoelker has joined #openstack-keystone08:15
*** markvoelker has quit IRC08:20
*** browne has quit IRC08:20
openstackgerritMerged openstack/keystone: Imported Translations from Transifex  https://review.openstack.org/15726608:21
*** stevemar has quit IRC08:22
*** nellysmitt has joined #openstack-keystone08:22
*** atmark1 has joined #openstack-keystone08:23
*** nellysmitt has quit IRC08:27
*** nellysmitt has joined #openstack-keystone08:36
*** jistr has joined #openstack-keystone08:42
*** zz_avozza is now known as zz_zz_avozza08:44
*** rushiagr_away is now known as rushiagr08:52
openstackgerritAbhishek Talwar proposed openstack/python-keystoneclient: User-password-update accepts blank as password  https://review.openstack.org/14739908:58
*** jamiec has joined #openstack-keystone08:58
*** markvoelker has joined #openstack-keystone09:16
*** markvoelker has quit IRC09:21
*** pnavarro has joined #openstack-keystone09:22
*** lhcheng has quit IRC09:28
*** erkules_ is now known as erkules09:45
*** zz_zz_avozza is now known as avozza09:52
openstackgerritMarek Denis proposed openstack/keystone: Ehncance user identification in mapping engine  https://review.openstack.org/15493410:02
openstackgerritMarek Denis proposed openstack/keystone: Authenticate local users via federated workflow  https://review.openstack.org/15630810:02
openstackgerrithenry-nash proposed openstack/keystone: Refactor filter and sensitivity tests in prepartion for LDAP support  https://review.openstack.org/14755110:02
*** karimb has joined #openstack-keystone10:03
openstackgerrithenry-nash proposed openstack/keystone: Enable filtering in LDAP backend for listing entities  https://review.openstack.org/14761210:05
*** fmarco76 has joined #openstack-keystone10:05
*** lhcheng has joined #openstack-keystone10:13
*** markvoelker has joined #openstack-keystone10:17
*** markvoelker has quit IRC10:22
*** hogepodge has quit IRC10:22
*** hogepodge has joined #openstack-keystone10:24
*** _cjones_ has joined #openstack-keystone10:31
openstackgerritMarek Denis proposed openstack/keystone: Add ``service_providers`` in Service Catalog  https://review.openstack.org/15265910:32
*** _cjones_ has quit IRC10:36
openstackgerritMarco Fargetta proposed openstack/keystone: IdP ID registration and validation  https://review.openstack.org/15215610:48
*** dims__ has joined #openstack-keystone10:50
openstackgerrithenry-nash proposed openstack/keystone: Add support for group membership to data driven assignment tests  https://review.openstack.org/15196210:52
openstackgerrithenry-nash proposed openstack/keystone: Add support for group membership to data driven assignment tests  https://review.openstack.org/15196210:53
*** dims__ has quit IRC10:54
openstackgerrithenry-nash proposed openstack/keystone: Broaden domain-group testing of list_role_assignments  https://review.openstack.org/15430210:56
*** aix has quit IRC11:04
*** aix has joined #openstack-keystone11:05
*** avozza is now known as zz_avozza11:07
openstackgerritMarcos Fermín Lobo proposed openstack/keystone: Implement group related methods for LDAP backend  https://review.openstack.org/15732711:11
*** zz_avozza is now known as avozza11:16
openstackgerritMarco Fargetta proposed openstack/keystone: IdP ID registration and validation  https://review.openstack.org/15215611:18
*** markvoelker has joined #openstack-keystone11:18
*** markvoelker has quit IRC11:23
*** chlong has joined #openstack-keystone11:41
openstackgerritSamuel de Medeiros Queiroz proposed openstack/keystone: Improve List Role Assignment Tests  https://review.openstack.org/13702111:41
*** nicodemos has joined #openstack-keystone11:44
openstackgerritSamuel de Medeiros Queiroz proposed openstack/keystone: Improve List Role Assignments Filters Performance  https://review.openstack.org/13720211:53
*** rushiagr is now known as rushiagr_away11:54
*** amakarov_away is now known as amakarov11:57
*** lhcheng has quit IRC11:58
openstackgerrithenry-nash proposed openstack/keystone: Test list_role_assignment in standard inheritance tests  https://review.openstack.org/15389712:03
*** diegows has joined #openstack-keystone12:08
*** markvoelker has joined #openstack-keystone12:19
openstackgerritSamuel de Medeiros Queiroz proposed openstack/keystone: Extract test_v3_resource from test_v3_assignment  https://review.openstack.org/15408012:22
*** markvoelker has quit IRC12:24
*** pnavarro is now known as pnavarro|lunch12:35
*** htruta has joined #openstack-keystone12:40
*** avozza is now known as zz_avozza12:42
*** dims__ has joined #openstack-keystone12:44
marekdsamueldmq: ^^ change the commit msg and! ;-)12:55
marekds/and//12:55
*** EmilienM|afk is now known as EmilienM12:58
*** lhcheng has joined #openstack-keystone12:58
samueldmqmarekd, k thanks13:02
samueldmqmarekd, should that include just 'bp' or 'blueprint' ? I see on gerrit doc that it should be 'blueprint', at least for 'Implements: blueprint BLUEPRINT'13:02
*** markvoelker has joined #openstack-keystone13:02
*** lhcheng has quit IRC13:03
marekdbp is fine13:03
marekdblueprint as well13:04
samueldmqmarekd, k, regarding restructuration ... well, looks to be a french word13:06
samueldmqmarekd, but describes well what we want ... and it's not worth it to change the bp name/link, once it has been approved :)13:06
samueldmqmarekd, but nice catch13:06
marekdje suis d'accrord avec mot francais.13:07
samueldmqpas mal! :p13:08
openstackgerritSamuel de Medeiros Queiroz proposed openstack/keystone: Extract test_v3_resource from test_v3_assignment  https://review.openstack.org/15408013:08
samueldmqmarekd, ^13:08
marekdsamueldmq: thanks :-)13:09
openstackgerrithenry-nash proposed openstack/keystone: Add support for data-driven backend assignment testing  https://review.openstack.org/14917813:09
openstackgerritMerged openstack/keystone: remove the Conf.signing.token_format option support  https://review.openstack.org/14425013:10
*** zz_avozza is now known as avozza13:10
openstackgerrithenry-nash proposed openstack/keystone: Add support for effective & inherited mode in data driven tests  https://review.openstack.org/15162313:12
*** henrynash has joined #openstack-keystone13:12
*** ChanServ sets mode: +v henrynash13:12
openstackgerrithenry-nash proposed openstack/keystone: Add support for group membership to data driven assignment tests  https://review.openstack.org/15196213:15
openstackgerrithenry-nash proposed openstack/keystone: Broaden domain-group testing of list_role_assignments  https://review.openstack.org/15430213:16
openstackgerrithenry-nash proposed openstack/keystone: Test list_role_assignment in standard inheritance tests  https://review.openstack.org/15389713:18
amakarovhenrynash, good day to you! Quick question: how our new assignment service will scale?13:19
henrynashamakarov: whcih new assignment service?!?13:20
openstackgerrithenry-nash proposed openstack/keystone: Test list_role_assignment in standard inheritance tests  https://review.openstack.org/15389713:21
amakarovhenrynash, afaik assignment will be separated from identity, LDAP assignment backend deprecated - how shall we handle multi-cloud installation with AD as identity provider?13:22
amakarovhenrynash, how shall we scale assignment storage?13:22
henrynashamakarov: so assignment is already separated from identity (that happens a few releases ago)13:23
henrynashamakarov: so LDAP backend will stay around for at least two releases13:24
henrynashamakarov: meanwhile we are discussing with clients best practices for assignment scaleability13:24
openstackgerrithenry-nash proposed openstack/keystone: Support project hierarchies in data driver tests  https://review.openstack.org/15448513:25
amakarovhenrynash, oh, I see. I have such discussions with Mirantis deployment teams too and just hoped there is a solution in the community.13:27
openstackgerrithenry-nash proposed openstack/keystone: Remove manager-driver assignment metadata construct  https://review.openstack.org/14899513:27
amakarovhenrynash, is there any blueprint/spec about it?13:28
*** aix has quit IRC13:29
henrynashamakarov: not for the user of SQL for scaleable assignments, no….want to start one?13:31
amakarovhenrynash, I think I'll have to13:32
amakarovanyway13:32
*** nicodemos has quit IRC13:34
*** jistr_ has joined #openstack-keystone13:37
*** gordc has joined #openstack-keystone13:37
henrynashamakaraov: be happy to work with you on it13:37
samueldmqlbragstad, replied your comments on list role assignments tests, thanks13:37
henrynashamakarov: (sorry, at a conference, so slow to respond)13:38
amakarovhenrynash, that's inspiring :)13:38
*** jistr has quit IRC13:39
*** markvoelker_ has joined #openstack-keystone13:42
*** markvoelker has quit IRC13:42
samueldmqhenrynash, replied your comments on list assignments ... thanks !13:43
samueldmqhenrynash, will revisit data-driven tests still today13:43
henrynashsamueldmq: thx13:43
henrynashsamueldmq: I fixed up those comments in the data driven stuff13:44
*** pnavarro|lunch is now known as pnavarro13:45
lbragstadsamueldmq: cool, I'll give them a look13:46
*** hogepodge has quit IRC13:47
*** jistr_ is now known as jistr13:48
*** hogepodge has joined #openstack-keystone13:49
samueldmqhenrynash, yes I saw you sent new patch sets :) I will revisit them today for sure13:50
samueldmqhenrynash, thanks for +2 +1 on those ! :D13:57
henrynashsamueldmq: :-)13:58
*** aix has joined #openstack-keystone14:01
*** henrynash has quit IRC14:07
openstackgerritRodrigo Duarte proposed openstack/keystone: Not allow create a project with slash in name  https://review.openstack.org/15715214:10
*** richm has joined #openstack-keystone14:10
openstackgerritRodrigo Duarte proposed openstack/keystone: Not allow create a project with slash in name  https://review.openstack.org/15715214:11
*** henrynash has joined #openstack-keystone14:17
*** ChanServ sets mode: +v henrynash14:17
henrynashnathan: thanks or the review of the LDAP filtering - have fixed them both up with your comments14:20
openstackgerritMarcos Fermín Lobo proposed openstack/keystone: Implement group related methods for LDAP backend  https://review.openstack.org/15732714:24
*** browne has joined #openstack-keystone14:27
henrynashnkinder: thanks or the review of the LDAP filtering - have fixed them both up with your comments14:27
*** karimb has quit IRC14:32
*** EmilienM is now known as EmilienM|afk14:32
openstackgerritMarco Fargetta proposed openstack/keystone: IdP ID registration and validation  https://review.openstack.org/15215614:34
*** henrynash has quit IRC14:35
*** hogepodge has quit IRC14:36
*** markvoelker_ has quit IRC14:38
*** hogepodge has joined #openstack-keystone14:39
*** markvoelker has joined #openstack-keystone14:39
openstackgerritHenrique Truta proposed openstack/python-keystoneclient: Creating parameter to list inherited role assignments  https://review.openstack.org/11730014:44
*** krykowski has joined #openstack-keystone14:54
*** browne has quit IRC14:56
openstackgerritOpenStack Proposal Bot proposed openstack/keystonemiddleware: Updated from global requirements  https://review.openstack.org/15673915:05
*** henrynash has joined #openstack-keystone15:14
*** ChanServ sets mode: +v henrynash15:14
*** topol has joined #openstack-keystone15:16
*** ChanServ sets mode: +v topol15:16
*** dims__ has quit IRC15:17
*** dims__ has joined #openstack-keystone15:18
lbragstaddstanek: quick mock unit testing question for you. I've been grepping all over but wondering if you know of a place where we mock out calls to an API that is pulled in via dependency.requires, like dependency.requires('trust_api')?15:18
dstaneklbragstad: you mean to provide a fake API to use?15:19
lbragstadright, I have a part in the token provider that calls to the trust api.15:19
lbragstadself.trust_api.get_trust(), and when I run the unit tests, it's saying that 'TrustTokenFormatter' object has no attribute 'trust_api'. Which makes sense. But I can't seem to mock it out using mock.patch.object or mock.patch15:20
dstaneklbragstad: i don't know off hand, but you should just be able to replace the trust_api with your own and restore the original when you are done15:20
lbragstadok, I figured I could but wasn't sure if there was something obvious I was missing15:21
dstanekno, that should be it15:21
dstanekdid a real quick grep and didn't find an example either15:22
lbragstadI saw on example (kind of) in keystone/tests/unit/identity/test_core.py15:22
lbragstadbut not sure if that's what I'm looking for15:22
lbragstadlet me see if I can clean up a diff15:22
*** timcline has joined #openstack-keystone15:24
*** avozza is now known as zz_avozza15:36
*** EmilienM|afk is now known as EmilienM15:41
*** MasterPiece has joined #openstack-keystone15:41
*** abhirc has joined #openstack-keystone15:44
openstackgerritRodrigo Duarte proposed openstack/keystone: Do not allow create a project with slash in name  https://review.openstack.org/15715215:44
*** ljfisher has joined #openstack-keystone15:52
amakarovdstanek, godd day! Addressed you comment here https://review.openstack.org/#/c/153307/ Would you please review it again?15:55
amakarovs/godd/good/15:56
openstackgerritRodrigo Duarte proposed openstack/keystone: Add is_domain field in Project Table  https://review.openstack.org/15742715:57
*** nellysmitt has quit IRC15:58
*** spandhe has joined #openstack-keystone15:59
openstackgerritRodrigo Duarte proposed openstack/keystone: Add is_domain field in Project Table  https://review.openstack.org/15742716:01
*** diegows has quit IRC16:01
rodrigodshenrynash, first patches from reseller on their way ^ :)16:02
openstackgerritRodrigo Duarte proposed openstack/keystone: Add is_domain field in Project Table  https://review.openstack.org/15742716:03
*** david-lyle_afk is now known as david-lyle16:04
*** afazekas has quit IRC16:05
*** joesavak has joined #openstack-keystone16:07
*** topol has quit IRC16:11
*** nellysmitt has joined #openstack-keystone16:11
*** ljfisher has quit IRC16:11
*** zzzeek has joined #openstack-keystone16:13
*** stevemar has joined #openstack-keystone16:14
*** ChanServ sets mode: +v stevemar16:14
*** joesavak has quit IRC16:14
*** jsavak has joined #openstack-keystone16:19
lbragstaddstanek: said paste from earlier http://pasteraw.com/8orhhmtaezwenul75qy61wu5mo94ers16:20
lbragstad^ that is what I'm attempting to test16:20
lbragstadand this is the test class http://pasteraw.com/ngcwpdzwrwosggbkzn0luamgimgddmh16:20
lbragstadwhere i played around with different mock types16:20
*** zz_avozza is now known as avozza16:23
*** krtaylor has quit IRC16:25
*** henrynash has quit IRC16:26
*** jsavak has quit IRC16:29
*** esp has joined #openstack-keystone16:32
*** nellysmitt has quit IRC16:33
*** nellysmitt has joined #openstack-keystone16:35
*** openstackgerrit has quit IRC16:36
*** openstackgerrit has joined #openstack-keystone16:36
*** pnavarro has quit IRC16:39
samueldmqmarekd, ping - could you take a look at this one ? https://review.openstack.org/#/c/146264/16:41
samueldmqmarekd, I think there is nothing blocking this to workflow+116:42
samueldmqmarekd, and can be your first workflow+1 if you didnt so far :D16:42
samueldmqmarekd, nah, you already have 516:43
openstackgerritRodrigo Duarte proposed openstack/keystone: Do not allow create a project with slash in name  https://review.openstack.org/15715216:45
*** nellysmitt has quit IRC16:45
openstackgerritHenrique Truta proposed openstack/python-keystoneclient: Inherited role domain calls on keystoneclient v3  https://review.openstack.org/11608116:46
*** spandhe has quit IRC16:46
*** krtaylor has joined #openstack-keystone16:47
*** topol has joined #openstack-keystone16:49
*** ChanServ sets mode: +v topol16:49
*** ljfisher has joined #openstack-keystone16:49
*** krykowski has quit IRC16:51
stevemarsamueldmq, it's been a week, marekd is a pro now :P +A'ing and -2'ing16:57
*** henrynash has joined #openstack-keystone17:11
*** ChanServ sets mode: +v henrynash17:11
*** _cjones_ has joined #openstack-keystone17:13
*** afazekas has joined #openstack-keystone17:13
henrynashayoung: hopefully easy one to approve if you are up for it: https://review.openstack.org/#/c/147551/17:15
*** lhcheng has joined #openstack-keystone17:18
*** nellysmitt has joined #openstack-keystone17:21
*** browne has joined #openstack-keystone17:21
*** lhcheng has quit IRC17:22
openstackgerritRodrigo Duarte proposed openstack/keystone: Add is_domain field in Project Table  https://review.openstack.org/15742717:23
*** lhcheng has joined #openstack-keystone17:24
morganfainbergdolphm, talking with some folks here about socializing your gist thing and/or wrapping the capabilities into things like gertty17:26
*** bknudson has joined #openstack-keystone17:26
*** ChanServ sets mode: +v bknudson17:26
*** jistr has quit IRC17:28
*** fmarco76 has left #openstack-keystone17:29
dstaneki feel like i'm falling down the rabbit hole...17:29
samueldmqstevemar, haha yep :D he's a pro17:29
samueldmqstevemar, could you take a look at that one if you ahve time ? https://review.openstack.org/#/c/146264/17:31
samueldmqstevemar, already has 2 +2 :-)17:31
*** lhcheng_ has joined #openstack-keystone17:33
*** arunkant has quit IRC17:34
*** lhcheng has quit IRC17:35
openstackgerritLance Bragstad proposed openstack/keystone: Keystone Lightweight Tokens (KLWT)  https://review.openstack.org/14531717:36
*** arunkant has joined #openstack-keystone17:41
*** spandhe has joined #openstack-keystone17:42
dolphmmorganfainberg: i'd like to do that17:43
dolphmmorganfainberg: do it for every project, show number of stars per review, etc17:44
morganfainbergdolphm, yeah. i figured you would :) reviewday, gerrt, etc17:44
morganfainberggertty17:44
morganfainberg*17:44
*** timcline has quit IRC17:44
*** timcline has joined #openstack-keystone17:45
*** tqtran has joined #openstack-keystone17:48
stevemarsamueldmq, done17:49
dolphmmorganfainberg: i was thinking about building a free-standing non-interactive website and exposing all the data in an api17:49
*** timcline has quit IRC17:50
morganfainbergdolphm, sure.17:50
samueldmqstevemar, thanks :)17:56
*** timcline has joined #openstack-keystone18:07
*** aix has quit IRC18:07
*** avozza is now known as zz_avozza18:09
*** henrynash has quit IRC18:09
*** harlowja has joined #openstack-keystone18:10
*** lhcheng_ is now known as lhcheng18:19
amakarovmorganfainberg, dolphm hi! We have a bug with undecided importance: https://bugs.launchpad.net/keystone/+bug/1420788 can you please look at it?18:23
openstackLaunchpad bug 1420788 in Keystone "Logging blocks on race condition under eventlet" [Undecided,In progress] - Assigned to Alexander Makarov (amakarov)18:23
amakarovhigh availability suffers18:23
dolphmamakarov: does that affect master?18:24
amakarovdolphm, yes18:24
dolphmamakarov: oh, i've reviewed the patch18:24
amakarovthere are fixes for master and juno both18:24
dolphmamakarov: there's no patch for master in the bug?18:25
amakarovcouldn't cherry-pick due to heavy refactoring in the master branch18:25
dolphmamakarov: also, does it affect icehouse?18:25
dolphmamakarov: if it's high/critical, we'll want to fix it there still18:25
amakarovI have a fix18:26
amakarovhttps://review.openstack.org/#/c/154915/18:26
dolphmamakarov: why is the stable/juno fix Partial-Bug?18:26
amakarovdolphm, I asked Boris Bobrov (breton) to repeat the fix for juno - we need to ask him :)18:27
dolphmamakarov: how do you reproduce it?18:29
*** andreaf_ has joined #openstack-keystone18:29
*** htruta has quit IRC18:29
amakarovthe bug hangs our scale-testing 100 nodes env 100% guarantee18:30
dolphmamakarov: how do other people reproduce the issue?18:30
*** henrynash has joined #openstack-keystone18:30
*** ChanServ sets mode: +v henrynash18:30
dstanekamakarov: oh, i didn't see that you added more detail to that18:31
amakarovdolphm, run keystone in 1 thread with eventlet enabled and spam it with auth/other token requests18:32
dstanekamakarov: this isn't a # of nodes problem right? it's a large number or greenlets18:32
*** diegows has joined #openstack-keystone18:33
dolphmamakarov: i don't even bother to run eventlet in my load tests, i guess i'll have to try that18:33
amakarovdstanek, it's a wrong monkey-patching and >1 greenlets :)18:33
*** htruta has joined #openstack-keystone18:34
dolphmamakarov: if i can reproduce it easily, i'd consider it to be critical18:34
* morganfainberg looks at the bug18:34
amakarovdolphm, dstanek: I can paste a 4-string script there showing that logging system uses vanilla locks in eventlets18:35
dolphmamakarov: that'd be great (include it in the bug)18:35
raildovim18:35
morganfainbergcan we just remove eventlet >.>18:35
morganfainberginstead :P18:35
dolphmraildo: vi18:35
dolphmmorganfainberg: +A18:35
raildodolphm, ops... wrong window =P18:36
morganfainbergemacs? >.>18:36
dstanekamakarov: ++; i'm not sure that we can test for this, which is unfortunate18:36
morganfainbergdstanek, no it's not something we can directly test for. but it's an ordering thing we should never monkeypatch after initialing anything we can avoid18:37
morganfainberge.g. initializing config is about all we can do prior to patching18:37
dolphmdstanek: we perform great under apache :P18:38
morganfainbergmy guess is other projects suffer from this too18:38
dolphmmorganfainberg: that's probably true18:38
morganfainbergbut in short - lets kill eventlet with fire18:38
* morganfainberg wonders who would scream if we deprecated eventlet deployment this cycle18:38
morganfainbergfor keystone that is.18:38
amakarovmorganfainberg, ++. I saw a recommendations on using monkeypatching somewhere in oslo wiki - they say "do it ASAP"18:39
morganfainbergamakarov, we usually do a pretty good job on it18:39
*** EmilienM is now known as EmilienM|afk18:40
morganfainbergso, the fix is just don't log in the eventlet environment18:40
morganfainbergif we don't log there, keystone-all should be doing the right thing18:40
morganfainbergand it's a log.debug18:40
dstanekamakarov: so why isn't the fix to move monkey patching into keystone-all?18:41
morganfainbergit's configure_once decorator18:41
morganfainbergdstanek, the fix is don't log here: https://github.com/openstack/keystone/blob/master/keystone/common/environment/__init__.py afaict18:41
morganfainbergit really is a log.debug only18:42
dstanekmorganfainberg: if we leave the monkey patching where it is we may end up having this conversation again as import are moved around18:43
morganfainbergdstanek, i think we move it to https://github.com/openstack/keystone/blob/master/keystone/server/eventlet.py18:43
morganfainbergdstanek, i want to make the stuff in /bin/ become built like nova's console scripts18:43
dstaneki think we are firmly is the doing it wrong realm now - all monkey patching example usually do the patching in the first few lines so that this can't happen18:44
morganfainbergdstanek, i actually am thinking we should just deprecate eventlet18:44
morganfainbergand seriously say "don't run this we've left it here so we don't just break you"18:44
dstanekeven if we do that we still need to fix this issue and prevent it from coming back18:45
morganfainbergdstanek, so i am agreeing with you, if we keep this, we move it to the top of what the console scripts use. i don't want it in the actual console script we have because we should make that go away18:45
morganfainbergdstanek, and the only reason i dont want it in bin/keystone-all itself is because i want that to go away.18:46
dstanekgetting rid of eventlet will be nice because if would actually allow us to play with asyncio18:46
morganfainbergdstanek, the console scripts should just be entry points in setup.cfg like nova has, so we don't need to look outside the code tree if we need to muck with things18:47
dstanekmorganfainberg: i just don't want to have an import happen before keystone.server.eventlet and then do this all over again18:47
morganfainbergwe're close to it because bknudson kicked ass and did a lot of the work.18:47
morganfainbergdstanek, the requirement is we don't put things in keystone.__init__18:48
bknudsonhere's an early stab at it: https://review.openstack.org/#/c/131435/18:48
morganfainbergbknudson, ++18:48
dstanekand you have to be careful if you are adding any imports for keystone-bin18:48
bknudsonthat was pre-moving code out of keystone-all18:48
bknudsonso needs to be reimplemented with that change... should be easier.18:49
morganfainbergbknudson, yeah18:49
morganfainbergdstanek, so we put a massive comment in saying "DO NOT PUT ANY IMPORTS OVER THIS LINE UNLESS YOU KNOW WHAT YOU'RE DOING"18:49
morganfainbergdstanek, and we special case handling the patching :)18:49
morganfainbergi'll bug monty and some folks here and see how much screaming will happen if we deprecate eventlet18:50
morganfainbergin kilo for keystone18:50
morganfainbergi think most people will be ok with it18:51
dstanekamakarov: does the juno patch fix the issue? i would have expected that one of the imported modules import logging and creates the lock18:53
amakarovdstanek, yes18:53
morganfainbergdstanek, amakarov, this is an issue with logging.getLogger() right?18:54
morganfainbergprior to monkeypatching18:54
amakarovdstanek, we actually debugged juno18:54
morganfainbergvs https://github.com/openstack/nova/blob/master/nova/cmd/api.py#L42-L4318:54
amakarovmorganfainberg, ++18:54
dstanekmorganfainberg: not sure what the issue is yet :-)18:54
dstanekimport logging uses an Rlock which should be wrong if the monkeys haven't patched yet18:55
morganfainbergdstanek, right18:55
morganfainbergdstanek, thats what i was thinking18:55
dstanekmorganfainberg: that's why i thought that the juno issue wouldn't have been completely solved, but who knows18:56
morganfainbergyeah18:56
amakarovdstanek, it worked for me18:57
dstanekamakarov: it looks like the things that lock locks are unlikely to happen concurrently unlike logging18:58
*** dims_ has joined #openstack-keystone18:59
*** dims__ has quit IRC19:02
amakarovdstanek, it happens only when logging handler enters it's critical section twice19:02
morganfainbergdstanek, i'm going to post a deprecate eventlet this cycle - lets see how much whining happens when we do it19:02
morganfainbergcc dolphm, bknudson, henrynash, jamielennox, ayoung, topol, stevemar, marekd19:03
morganfainberg^19:03
amakarovmorganfainberg, I'll be the first one to whine ))19:03
morganfainbergamakarov, why are you deploying in eventlet?19:03
morganfainbergit excludes you from using a lot of the identity stuff we're driving towards19:04
morganfainberg*and* has a lot of performance issues.19:04
amakarovmorganfainberg, I think it's some sort of tradition :) I have no other explanation19:04
morganfainbergit also excludes us from using asyncio explicitly.19:04
bknudsonI'm pretty sure our product deploys to eventlet by default, but we should be able to switch.19:04
morganfainbergbknudson, deprecation in kilo, dropped support in M is my thought19:04
morganfainbergi'd love to drop it in L, but...19:05
morganfainbergthat would probably make people cry19:05
bknudsonwe've got other groups that deploy using httpd so shouldn't be a big deal for us.19:05
morganfainbergbknudson, ++ ok i'll post the review, send message to ML linking to the review19:05
openstackgerritMerged openstack/keystone: Removes unnecessary checks when cleaning a domain  https://review.openstack.org/14626419:05
bknudsonthe only real complaint is if someone could never deploy using httpd for some reason.19:05
morganfainbergi'll slate that we should merge it post K3 if there isn't too much whining19:05
bknudsonor some other better container.19:06
morganfainbergbknudson, i can't think of a real reason that would be impossible. i'd also like to support uwsgi and unicorns long term as well, but that would be a container validation in say functional testing19:06
morganfainbergscenarios19:06
bknudsony, use one of those if you don't like apache. we don't need to maintain a crappy container.19:07
morganfainberg++19:08
amakarovmorganfainberg, to be serious, I'd like to remove eventlet - it would be easier to push initiative with keystone behind Apache here19:09
morganfainberg++19:09
morganfainbergamakarov, ack, thanks for the confirmation :)19:09
*** r-daneel has joined #openstack-keystone19:10
topolmorganfainberg, if you deprecate eventlet what will be the default on how Keystone will be setup to run?19:12
morganfainbergtopol, mod_wsgi19:12
morganfainbergthe current default in devstack19:12
morganfainbergand in gate19:12
openstackgerritRodrigo Duarte proposed openstack/keystone: Do not allow create a project with slash in name  https://review.openstack.org/15715219:12
marekdmorganfainberg: so, apache only or no eventloop in Keystone?19:12
morganfainbergwe have a one-off job that tests eventlet does things19:12
marekds/or/and/19:12
morganfainbergmarekd, no eventlet in keystone.19:13
stevemarmarekd, topol we'll have eventlet around for 2 releases19:13
morganfainbergmarekd, apache or other mod_wsgi container19:13
morganfainbergbut eventlet wont go away until M cycle19:13
marekdmorganfainberg: understand.19:13
stevemari would hope people are off of eventlet by then19:13
topolmorganfainberg so in the future you want it setup so that keystone looks  like it should when in production. That is running as part of apache19:14
morganfainbergyep or another wsgi container (uwsgi, unicorn, etc)19:14
morganfainbergand it means we aren't supporting a container that *cant* do federated identity19:15
morganfainbergetc19:15
morganfainbergother containers are wrapped with webservers that can do it.19:15
topolmorganfainberg, because when running with eventlet it is nice but naive, correct19:15
*** henrynash has quit IRC19:15
topolmorganfainberg.  SOLD.  You have me on board :-)19:15
morganfainberg:)19:15
marekdmorganfainberg: have you considered bringing threads in Keystone code? ;-)19:15
morganfainbergmarekd, not opposed to using native threads, or asyncio19:16
morganfainbergbut i don't want *any* of that code in places that could screw up eventlet19:16
morganfainbergif it's a supported deploymode19:16
* topol I remember years ago being the keystone newbie and then learning the eventlet model was this big scam19:16
topol:-)19:16
marekdPython is somehow screwed with native threads. Asyncio isn't another eventlet?19:17
morganfainbergit is eventlet, but with explicit callbacks / programming19:17
morganfainbergnot "oh it magically just works"19:17
*** henrynash has joined #openstack-keystone19:17
*** ChanServ sets mode: +v henrynash19:17
marekdand wsgi container + asyncio would work?19:17
morganfainbergpotentially19:18
marekdi guess it would, as long as coroutines would.19:18
morganfainbergbut... mod_Wsgi solves the same issue as coroutines mostly do19:18
*** r-daneel has quit IRC19:19
marekduhm.19:19
morganfainbergfor keystone workloads19:20
openstackgerritMorgan Fainberg proposed openstack/keystone: Deprecate Eventlet Deployment in favor of wsgi containers  https://review.openstack.org/15749519:20
*** dims_ has quit IRC19:26
*** nellysmitt has quit IRC19:26
amakarovmarekd, iirc gunicorn has gevent support out of the box19:27
*** ljfisher has quit IRC19:28
dstanekgevent is essentially eventlet (same model)19:28
marekdamakarov: libev is the same family? In general i like event loop programming.19:29
marekdas long as impl is not screwed.19:29
amakarovmarekd, ++19:29
dstanekmarekd: i'm the opposite - so far i've not have love for it because it's usually harder to test19:30
*** abhirc has quit IRC19:31
marekdthank threads?!19:32
marekdthan19:32
morganfainbergdstanek, i'd be ok with keeping a "Dev-only" worker to support debugging but clearly limit it/mark it as development debug only if needed19:33
morganfainbergdstanek, email sent to ML and review posted19:33
*** ljfisher has joined #openstack-keystone19:34
stevemarmorganfainberg, sounds like time for a survey19:34
morganfainbergstevemar, nope. no survey this time ;)19:34
morganfainberg>.>19:34
morganfainbergtrying the "go comment on review and/or via the ML"19:34
morganfainbergthe surveys have been tragically low response rates19:34
openstackgerritRodrigo Duarte proposed openstack/keystone-specs: Recursive deletion and project disabling  https://review.openstack.org/14873019:36
*** krtaylor has quit IRC19:38
bknudsonhas anyone tried keystone in uwsgi?19:43
morganfainbergbknudson, i have not yet19:43
morganfainbergbknudson it has been on my todo list for a while19:43
morganfainbergit *should* work afaict19:43
morganfainbergmaybe minor changes to get there19:44
bknudsonshould be like "uwsgi --http :9090 --wsgi-file keystone.py"19:44
morganfainbergyeah19:44
*** nkinder is now known as nkinder_away19:46
amakarovdolphm, please see example script in last comment https://bugs.launchpad.net/keystone/+bug/142078819:46
openstackLaunchpad bug 1420788 in Keystone juno "Logging blocks on race condition under eventlet" [Undecided,In progress] - Assigned to Alexander Makarov (amakarov)19:46
amakarovmorganfainberg, so what shall we do with a drunken sailor?.. with the bug :)19:48
*** nellysmitt has joined #openstack-keystone19:54
morganfainbergamakarov, uhmmmm. :P19:55
amakarovmorganfainberg, :b19:56
morganfainbergin juno it should be easy to just move the patch up some.19:56
morganfainbergsame in icehouse19:56
morganfainbergin kilo, uhhhh19:56
amakarovmorganfainberg, I hope we won't just leave it like that with deployers cursing keystone team? :)19:58
morganfainbergamakarov, ehhhhhhhh >.>19:59
dolphmbknudson: i believe dstanek has20:01
*** dims__ has joined #openstack-keystone20:01
dstanekdolphm, bknudson: i have some sample code for that here somewhere - i also rewrote at gevent so that i could properly test gunicorn20:02
dolphmdstanek: "rewrote at gevent" ?20:03
dstanekgunicorn was all kinds of fail for keystone20:03
dolphmdstanek: how long ago?20:03
dstaneks/as/at/20:03
dstanekmaybe a year ago20:03
dstaneki think is was around the time of the Atlanta summit because were were talking asyncio there20:05
*** dims__ has quit IRC20:05
openstackgerritDavid Stanek proposed openstack/keystone: Support for running functional federation tests  https://review.openstack.org/13913720:06
openstackgerritDavid Stanek proposed openstack/keystone: enables bashate checking on upcoming dsvm code  https://review.openstack.org/15130920:06
openstackgerritDavid Stanek proposed openstack/keystone: adds a devstack plugin for running a pysaml2 IdP  https://review.openstack.org/15131020:06
openstackgerritDavid Stanek proposed openstack/keystone: adds a devstack plugin for setting up federation  https://review.openstack.org/15131120:06
openstackgerritDavid Stanek proposed openstack/keystone: adds a tox target for functional tests  https://review.openstack.org/15052820:06
*** amakarov is now known as amakarov_away20:06
openstackgerritSteve Martinelli proposed openstack/keystone: Avoid multiple instances for a provider  https://review.openstack.org/12459920:12
openstackgerritSteve Martinelli proposed openstack/keystone: Enable endpoint_policy, endpoint_filter and oauth by default  https://review.openstack.org/15384220:13
bknudsondstanek: I tried tox -e functional and it didn't work...20:13
bknudsonnetifaces.c:1:20: fatal error: Python.h: No such file or directory20:13
*** g2` has quit IRC20:13
dstanekbknudson: hmmm..did you get any errors when it built the venv for you?20:14
bknudsondstanek: that is building the venv20:14
dstanekbknudson: ah you probably don't have the python3.4 dev package installed20:14
bknudsonI think it's python3.4-dev20:14
dstanekoops in all this rebasing i seem to have lost my dummy test20:15
*** krtaylor has joined #openstack-keystone20:16
bknudsonImportError: Start directory is not importable: './keystone/tests/functional'20:17
*** diegows has quit IRC20:19
dstanekbknudson: yes, i somehow lost my sample test during rebasing - getting another one together now20:20
openstackgerritSteve Martinelli proposed openstack/keystone: Enable endpoint_policy, endpoint_filter and oauth by default  https://review.openstack.org/15384220:21
*** zzzeek has quit IRC20:23
*** abhirc has joined #openstack-keystone20:25
dstanekbknudson: ah, nope i took if out of the chain since i wasn't happy with it yet - i'll add an empty directory structure to the tox commit20:26
bknudsondstanek: either way works for me.20:26
openstackgerritDavid Stanek proposed openstack/keystone: Support for running functional federation tests  https://review.openstack.org/13913720:28
openstackgerritDavid Stanek proposed openstack/keystone: enables bashate checking on upcoming dsvm code  https://review.openstack.org/15130920:28
openstackgerritDavid Stanek proposed openstack/keystone: adds a devstack plugin for running a pysaml2 IdP  https://review.openstack.org/15131020:28
openstackgerritDavid Stanek proposed openstack/keystone: adds a devstack plugin for setting up federation  https://review.openstack.org/15131120:28
openstackgerritDavid Stanek proposed openstack/keystone: adds a tox target for functional tests  https://review.openstack.org/15052820:28
*** g2` has joined #openstack-keystone20:28
raildoIn the reseller implementation, I need to change this UniqueConstraint https://github.com/openstack/keystone/blob/master/keystone/common/sql/migrate_repo/versions/034_havana.py#L224 to reference to the parent_id and name. Someone know how can I remove a UniqueConstraint(and add a new) in a migrate script?20:30
raildoI'm trying to use the migration_helpers but its not help me a lot =P20:31
mfischmorganfainberg: puppet still defaults to eventlet, so I opened a bug: https://bugs.launchpad.net/puppet-keystone/+bug/142368520:35
openstackLaunchpad bug 1423685 in puppet-keystone "default service should be run under apache, eventlets will deprecated in M " [Undecided,New]20:35
mfischmorganfainberg: and ignore my stupid question..20:39
openstackgerritTom Cameron proposed openstack/keystone: Add docstrings to remaining functions  https://review.openstack.org/14731320:39
openstackgerritTom Cameron proposed openstack/keystone: Add docstrings to remaining functions  https://review.openstack.org/14731320:41
*** atiwari has quit IRC20:48
*** arosen has quit IRC20:50
openstackgerritTom Cameron proposed openstack/keystone: Add docstrings to remaining functions  https://review.openstack.org/14731320:51
*** gyee has joined #openstack-keystone20:53
*** ChanServ sets mode: +v gyee20:53
*** jamiec has quit IRC20:56
*** henrynash has quit IRC20:59
*** henrynash has joined #openstack-keystone20:59
*** ChanServ sets mode: +v henrynash20:59
*** nellysmitt has quit IRC21:01
*** jamiec has joined #openstack-keystone21:02
*** spandhe has quit IRC21:10
*** abhirc has quit IRC21:13
*** csoukup has joined #openstack-keystone21:15
*** abhirc has joined #openstack-keystone21:17
*** spandhe has joined #openstack-keystone21:17
openstackgerritSteve Martinelli proposed openstack/keystone: Avoid multiple instances for a provider  https://review.openstack.org/12459921:21
openstackgerritSteve Martinelli proposed openstack/keystone: Enable endpoint_policy, endpoint_filter and oauth by default  https://review.openstack.org/15384221:21
*** timcline has quit IRC21:21
morganfainbergmfisch thnx21:27
*** darrenc is now known as darrenc_afk21:28
morganfainbergmfisch, updated the title of the bug: https://bugs.launchpad.net/puppet-keystone/+bug/142368521:29
openstackLaunchpad bug 1423685 in puppet-keystone "default service should be run under apache, eventlet will deprecated in K, Removed in M" [Undecided,New]21:29
*** dims__ has joined #openstack-keystone21:29
*** samueldmq_ has joined #openstack-keystone21:32
*** morganfainberg is now known as needscoffee21:32
*** samueldmq_ has quit IRC21:48
*** MasterPiece has quit IRC21:56
jamielennoxnice, bye bye eventlet22:01
stevemarneedscoffee, so by including the service providers in the catalog, we run the risk of breaking horizon :D22:02
needscoffeestevemar, how so?22:03
*** darrenc_afk is now known as darrenc22:03
stevemarneedscoffee, https://github.com/openstack/django_openstack_auth/blob/master/openstack_auth/user.py#L305-L31222:03
needscoffeeit's not an endpoint22:03
needscoffeeshould be excluded22:04
jamielennoxgyee: neutronclient and novaclient released overnight22:04
needscoffeefrom that for-loop22:04
jamielennoxmy overnight - during the day22:04
openstackgerritJamie Lennox proposed openstack/python-keystoneclient: Enforce that some plugin options are required  https://review.openstack.org/14878422:04
openstackgerritIan Cordasco proposed openstack/oslo.policy: Add Rules.from_dict classmethod  https://review.openstack.org/15754822:05
needscoffeestevemar, it would be under: "service_providers": [ not "endpoints": [22:06
needscoffeestevemar, so no risk in breaking horizon, django wont look in the catalog for that stuff22:06
jamielennoxyea - don't mix those two22:07
openstackgerritJamie Lennox proposed openstack/python-keystoneclient: Provide a means to get all installed plugins  https://review.openstack.org/15646622:09
jamielennoxbknudson: so not pushing for a review yet, just so you know i took your splitting up auth_token functionality into pieces to extremes: https://review.openstack.org/#/c/157276/22:11
bknudsonjamielennox: I saw it and I like the change in principal.22:11
bknudsonnot sure I like using "there" where "their" should be used, though.22:12
jamielennoxdamn - i caught myself with that mistake once or twice22:14
*** openstackstatus has joined #openstack-keystone22:15
*** ChanServ sets mode: +v openstackstatus22:15
jamielennoxi didn't copy & paste the commit messages, it's interesting the way they changed over the ~8 patches22:15
*** dims__ has quit IRC22:15
*** henrynash has quit IRC22:17
*** henrynash has joined #openstack-keystone22:18
*** ChanServ sets mode: +v henrynash22:18
*** diegows has joined #openstack-keystone22:21
*** _cjones_ has quit IRC22:24
*** henrynash has quit IRC22:24
*** henrynash has joined #openstack-keystone22:25
*** ChanServ sets mode: +v henrynash22:25
*** _cjones_ has joined #openstack-keystone22:28
*** henrynash_ has joined #openstack-keystone22:37
*** ChanServ sets mode: +v henrynash_22:37
*** henrynash has quit IRC22:38
*** henrynash_ is now known as henrynash22:38
openstackgerritTom Cameron proposed openstack/keystone: Add docstrings to remaining functions  https://review.openstack.org/14731322:44
*** henrynash_ has joined #openstack-keystone22:45
*** ChanServ sets mode: +v henrynash_22:45
*** henrynash has quit IRC22:47
*** henrynash_ is now known as henrynash22:47
*** topol has quit IRC22:56
openstackgerritIan Cordasco proposed openstack/oslo.policy: Fix the order of args to assertEqual in tests  https://review.openstack.org/15757222:59
*** andreaf_ has quit IRC23:00
*** nellysmitt has joined #openstack-keystone23:02
*** abhirc has quit IRC23:04
*** nellysmitt has quit IRC23:07
openstackgerritIan Cordasco proposed openstack/oslo.policy: Fix the order of args to assertEqual in tests  https://review.openstack.org/15757223:09
stevemarany oslo.policy guys want to take a crack at that one ^^23:10
needscoffeethat one is a bit rought23:10
needscoffeerough*23:10
stevemarneedscoffee, oh yeah, a real doozie23:10
needscoffeebut yesh23:10
openstackgerritIan Cordasco proposed openstack/oslo.policy: Use assertTrue or assertFalse where appropriate  https://review.openstack.org/15758323:17
openstackgerritSteve Martinelli proposed openstack/keystone: Use oslo.policy instead of incubated version  https://review.openstack.org/14862423:18
*** henrynash has quit IRC23:24
*** joesavak has joined #openstack-keystone23:29
*** jsavak has joined #openstack-keystone23:31
*** joesavak has quit IRC23:34
openstackgerritPriti Desai proposed openstack/keystone: Fix for listing role assignments by project admin  https://review.openstack.org/15372323:37
*** samueldmq_ has joined #openstack-keystone23:42
needscoffeejamielennox, i think something is wonky with the pypi project for python-keystoneclient-kerberos23:43
needscoffeejamielennox, what did you do to create it?23:44
lbragstadneedscoffee: updated with the current state of klw/ae tokens https://review.openstack.org/#/c/145317/23:44
needscoffeelbragstad, thanks.23:44
openstackgerritPriti Desai proposed openstack/keystone: Fix for listing role assignments by project admin  https://review.openstack.org/15372323:44
lbragstadneedscoffee: np, marked WIP just because it's not passing right now due to Keyczar23:44
samueldmq_gyee, ping - replied your comments on list role assignments performance23:45
needscoffeejamielennox, i think i see the issue23:45
lhchengbknudson, stevemar: do you guys still recall the next step for this patch: https://review.openstack.org/#/c/93982/ ?23:45
lhchengbknudson, stevemar: should we add back the validation of user_id/group_id during role assignment?23:45
samueldmq_gyee, both the tests and the refactoring have +2 from henrynash (refactoring +1 because he's co-authoring) :-)23:45
needscoffeejamielennox, i need you to make openstackCI the maintainer not just owner.23:46
needscoffeejamielennox, i think that is preventing CI from publishing the tags23:46
needscoffeeas a package23:46
jamielennoxneedscoffee: i have no idea, i made like 3 repos that time23:46
needscoffeejamielennox, yeah make openstackCI the maintainer not just owner23:46
jamielennoxneedscoffee: if that's the issue i'd check -federation as well23:46
needscoffeeyep23:46
needscoffeeboth need it23:46
needscoffeecan you change that?23:46
marekdI will leave you off with a request to take a look at patch https://review.openstack.org/#/c/156509/ , especially whether we go with what's is being proposed in the patch or what gyee suggests. Sadly, I don't have very strong oppinions on that so I need your help.23:47
*** csoukup has quit IRC23:47
jamielennoxyep, i did the same process for requests-mock, not sure why that's different23:47
openstackgerritRodrigo Duarte proposed openstack/keystone: Do not allow the use of slash in the project name  https://review.openstack.org/15715223:47
jamielennoxneedscoffee: should i remove owner?23:47
needscoffeenah owner is fin23:48
needscoffeefine*23:48
openstackgerritRodrigo Duarte proposed openstack/keystone: Do not allow the use of slash in the project name  https://review.openstack.org/15715223:48
needscoffeebut maintainer is important23:48
jamielennoxso openstackci has owner on requests-mock and it's published releases before23:48
jamielennoxi'm just going to give up on correct spelling and punctuation i think23:48
needscoffeehm23:49
*** markvoelker has quit IRC23:49
needscoffeeok23:49
needscoffeeso python-keystoneclient-kerberos is broken23:49
needscoffeesomehow23:49
needscoffeeand i can't seem to chase down the log(s)23:49
*** browne has quit IRC23:52
jamielennoxneedscoffee: aparently client is in trouble for something in -infra as well23:52
*** ljfisher has quit IRC23:52
needscoffeenot directly23:53
jamielennoxbut my IRC is lighting up in 3 or 4 different channels so i haven't followed that one at all yet23:53
needscoffeethis is the pin vs cap vs things and neutronclient released23:53
*** bknudson has quit IRC23:53
jamielennoxapparently us jumping to 1.0 was more of an issue than we though23:54
jamielennoxt23:54
needscoffeeyep. not like this is easy to undo now23:54
needscoffeei actually specifically asked a bunch of people on that front before we did it23:55
needscoffeeso, unforseen consequences :(23:55
*** abhirc has joined #openstack-keystone23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!