Friday, 2017-05-26

*** r-daneel has quit IRC00:02
*** markvoelker has joined #openstack-keystone00:04
*** thorst has joined #openstack-keystone00:06
*** stingaci has joined #openstack-keystone00:10
*** markvoelker has quit IRC00:16
*** Shunli has joined #openstack-keystone00:18
*** adriant has joined #openstack-keystone00:21
*** markvoelker has joined #openstack-keystone00:21
*** thorst has quit IRC00:22
*** thorst has joined #openstack-keystone00:22
*** markvoelker has quit IRC00:27
*** thorst has quit IRC00:27
*** markvoelker has joined #openstack-keystone00:30
*** markvoelker has quit IRC00:31
*** lamt has quit IRC00:36
openstackgerritColleen Murphy proposed openstack/keystone master: WIP - start adding foundation for unified limits  https://review.openstack.org/46822300:39
*** lamt has joined #openstack-keystone00:43
*** markvoelker has joined #openstack-keystone00:54
*** markvoelker has quit IRC00:58
*** markvoelker has joined #openstack-keystone00:58
*** john5223_ has quit IRC00:59
openstackgerritMerged openstack/keystone master: Basic overview of tempest and devstack plugins  https://review.openstack.org/45776801:01
*** lamt has quit IRC01:02
*** lamt has joined #openstack-keystone01:04
*** lamt has quit IRC01:05
*** dikonoor has joined #openstack-keystone01:08
openstackgerrityangweiwei proposed openstack/keystone master: update keystone federation auth  https://review.openstack.org/46757101:12
*** stingaci has quit IRC01:12
*** dikonoor has quit IRC01:15
*** gmann has joined #openstack-keystone01:17
*** dave-mccowan has joined #openstack-keystone01:21
*** edmondsw has joined #openstack-keystone01:23
*** ducttape_ has joined #openstack-keystone01:24
*** edmondsw has quit IRC01:27
*** thorst has joined #openstack-keystone01:27
*** lamt has joined #openstack-keystone01:29
*** thorst has quit IRC01:32
openstackgerritrocky proposed openstack/keystone master: Migrate render_token_data_response to keystone.common.controller  https://review.openstack.org/46495601:36
*** dave-mccowan has quit IRC01:36
*** ducttape_ has quit IRC01:41
*** markvoelker has quit IRC01:41
*** thorst has joined #openstack-keystone01:48
openstackgerritOpenStack Proposal Bot proposed openstack/keystone master: Updated from global requirements  https://review.openstack.org/46824201:48
*** thorst has quit IRC01:48
*** ducttape_ has joined #openstack-keystone01:50
*** zhurong has joined #openstack-keystone01:51
*** ducttape_ has quit IRC01:53
*** ducttape_ has joined #openstack-keystone01:56
*** ducttape_ has quit IRC02:01
*** ducttape_ has joined #openstack-keystone02:03
*** ducttape_ has quit IRC02:03
*** ducttape_ has joined #openstack-keystone02:06
*** ducttape_ has quit IRC02:17
openstackgerritZhangHongtao proposed openstack/keystone master: Addition of "type" optional attribute to list credentials.  https://review.openstack.org/46825402:19
*** ducttape_ has joined #openstack-keystone02:20
*** ducttape_ has quit IRC02:26
*** ducttape_ has joined #openstack-keystone02:32
*** ducttape_ has quit IRC02:40
*** ducttape_ has joined #openstack-keystone02:44
*** ducttape_ has quit IRC02:47
*** ducttape_ has joined #openstack-keystone02:47
*** thorst has joined #openstack-keystone02:49
*** ducttape_ has quit IRC02:53
*** thorst has quit IRC02:54
*** ducttape_ has joined #openstack-keystone02:55
*** ducttape_ has quit IRC03:08
*** edmondsw has joined #openstack-keystone03:11
*** edmondsw has quit IRC03:15
*** prashkre has joined #openstack-keystone03:23
*** stingaci has joined #openstack-keystone03:38
*** thorst has joined #openstack-keystone03:50
*** stingaci has quit IRC03:53
*** thorst has quit IRC03:54
*** lamt has quit IRC03:59
*** aojea has joined #openstack-keystone04:00
*** aselius has quit IRC04:00
*** aojea has quit IRC04:04
*** zhurong has quit IRC04:07
*** aojea has joined #openstack-keystone04:15
*** markvoelker has joined #openstack-keystone04:19
*** zhurong has joined #openstack-keystone04:45
*** lamt has joined #openstack-keystone04:48
*** thorst has joined #openstack-keystone04:51
*** thorst has quit IRC04:55
*** edmondsw has joined #openstack-keystone04:59
*** edmondsw has quit IRC05:03
*** gyee has quit IRC05:26
*** aojea has quit IRC05:35
*** aojea has joined #openstack-keystone05:42
*** stingaci has joined #openstack-keystone05:42
*** pcaruana has joined #openstack-keystone05:43
*** stingaci has quit IRC05:47
*** adriant has quit IRC05:49
*** thorst has joined #openstack-keystone05:52
*** aojea has quit IRC05:55
*** aojea has joined #openstack-keystone05:57
*** aojea has quit IRC06:00
*** AlexOughton has quit IRC06:03
*** AlexOughton has joined #openstack-keystone06:03
*** thorst has quit IRC06:10
*** belmoreira has joined #openstack-keystone06:10
*** rcernin has joined #openstack-keystone06:10
*** markvoelker has quit IRC06:12
*** toabctl has joined #openstack-keystone06:15
toabctlcould some core approve https://review.openstack.org/#/c/467836 to fix the gate for keystonemiddleware please?06:17
openstackgerrityangweiwei proposed openstack/keystone master: fix bugs in mapping rules with blacklist  https://review.openstack.org/46827806:31
*** markvoelker has joined #openstack-keystone06:44
*** jamielennox is now known as jamielennox|away06:48
*** markvoelker has quit IRC06:49
*** zhurong has quit IRC06:54
*** markvoelker has joined #openstack-keystone06:56
*** zhurong has joined #openstack-keystone07:00
*** markvoelker has quit IRC07:02
*** jaosorior has joined #openstack-keystone07:06
*** thorst has joined #openstack-keystone07:07
*** Dinesh_Bhor has quit IRC07:07
*** markvoelker has joined #openstack-keystone07:11
*** thorst has quit IRC07:11
*** tobberydberg has joined #openstack-keystone07:13
*** Dinesh_Bhor has joined #openstack-keystone07:13
*** markvoelker has quit IRC07:15
*** pnavarro has joined #openstack-keystone07:16
*** aojea has joined #openstack-keystone07:18
*** stingaci has joined #openstack-keystone07:20
*** markvoelker has joined #openstack-keystone07:25
*** markvoelker has quit IRC07:30
openstackgerrityangweiwei proposed openstack/keystone master: Fix bugs to list domains or projects to federated user  https://review.openstack.org/46829007:33
*** stingaci has quit IRC07:35
*** openstackgerrit has quit IRC07:48
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-keystone08:00
*** thorst has joined #openstack-keystone08:07
*** Shunli has quit IRC08:10
*** Shunli has joined #openstack-keystone08:11
*** thorst has quit IRC08:13
*** openstackgerrit has joined #openstack-keystone08:19
openstackgerritrocky proposed openstack/keystonemiddleware master: add a log when the option in conf can't be identitied  https://review.openstack.org/46790808:19
*** markvoelker has joined #openstack-keystone08:19
*** markvoelker has quit IRC08:28
pooja_jadhavHi all, I want to discuss about the keystone credential API, If user passes invalid query parameter while list of credentials, then what should be the output.. whether i should give all list of credentials or should give bad request for invalid query parameter?08:35
*** edmondsw has joined #openstack-keystone08:35
*** edmondsw has quit IRC08:39
openstackgerrityangweiwei proposed openstack/keystone master: fix bug in keystone federation auth  https://review.openstack.org/46757109:02
*** thorst has joined #openstack-keystone09:08
*** thorst has quit IRC09:13
*** markvoelker has joined #openstack-keystone09:13
*** markvoelker has quit IRC09:18
*** zhurong has quit IRC09:19
*** Shunli has quit IRC09:27
*** markvoelker has joined #openstack-keystone09:47
*** pnavarro has quit IRC09:49
*** markvoelker has quit IRC09:52
openstackgerritMerged openstack/keystonemiddleware master: Fix oslo.messaging deprecation of get_transport  https://review.openstack.org/46783610:07
*** lucasxu has joined #openstack-keystone10:09
*** thorst has joined #openstack-keystone10:09
*** thorst has quit IRC10:13
*** markvoelker has joined #openstack-keystone10:15
*** markvoelker has quit IRC10:19
*** markvoelker has joined #openstack-keystone10:34
*** markvoelker has quit IRC10:39
*** lucasxu has quit IRC10:40
*** markvoelker has joined #openstack-keystone10:43
openstackgerritrocky proposed openstack/keystonemiddleware master: add a log when the option in conf can't be identitied  https://review.openstack.org/46790810:44
openstackgerritrocky proposed openstack/keystonemiddleware master: add a log when the option in conf can't be identitied  https://review.openstack.org/46790810:45
*** markvoelker has quit IRC10:48
*** pnavarro has joined #openstack-keystone10:53
*** raildo has joined #openstack-keystone11:01
*** thorst has joined #openstack-keystone11:10
*** thorst has quit IRC11:14
*** stingaci has joined #openstack-keystone11:16
*** markvoelker has joined #openstack-keystone11:29
*** stingaci has quit IRC11:32
*** markvoelker has quit IRC11:34
*** thorst has joined #openstack-keystone11:42
*** edmondsw has joined #openstack-keystone11:56
*** masber has quit IRC12:00
*** markvoelker has joined #openstack-keystone12:00
*** d0ugal has quit IRC12:02
*** markvoelker has quit IRC12:05
*** markvoelker has joined #openstack-keystone12:08
openstackgerritMichal Dulko proposed openstack/keystone master: Update doctor warning about caching  https://review.openstack.org/46839412:11
*** markvoelker has quit IRC12:13
*** d0ugal has joined #openstack-keystone12:18
*** ducttape_ has joined #openstack-keystone12:20
*** frontrunner has joined #openstack-keystone12:23
*** d0ugal has quit IRC12:24
*** ducttape_ has quit IRC12:25
*** ducttape_ has joined #openstack-keystone12:26
openstackgerritMerged openstack/keystonemiddleware master: Updated from global requirements  https://review.openstack.org/46715512:37
*** d0ugal has joined #openstack-keystone12:37
*** ducttape_ has quit IRC12:40
*** ducttape_ has joined #openstack-keystone12:40
*** ducttape_ has quit IRC12:42
*** thorst has quit IRC12:45
*** markvoelker has joined #openstack-keystone12:51
*** markvoelker has quit IRC12:58
*** thorst has joined #openstack-keystone13:04
*** Dinesh_Bhor has quit IRC13:05
*** dims has quit IRC13:07
*** chlong has joined #openstack-keystone13:07
*** piliman974 has joined #openstack-keystone13:11
*** markvoelker has joined #openstack-keystone13:12
*** lucasxu has joined #openstack-keystone13:14
*** ducttape_ has joined #openstack-keystone13:28
*** ducttap__ has joined #openstack-keystone13:30
*** ducttape_ has quit IRC13:33
*** cristicalin has joined #openstack-keystone13:37
*** ducttap__ has quit IRC13:38
*** pooja_jadhav has quit IRC13:39
*** ducttape_ has joined #openstack-keystone13:43
*** jerrygb has joined #openstack-keystone13:45
*** jerrygb has quit IRC13:45
*** jerrygb has joined #openstack-keystone13:45
*** __Nautilus__ has joined #openstack-keystone13:58
openstackgerritLance Bragstad proposed openstack/keystone-specs master: Specification for global roles  https://review.openstack.org/46476313:58
*** dims has joined #openstack-keystone14:04
*** markvoelker has quit IRC14:15
*** AlexOughton has quit IRC14:27
*** AlexOughton has joined #openstack-keystone14:28
lbragstadmorgan: didn't you have a patch for deprecating the credential API?14:32
lbragstadI found this one - https://review.openstack.org/#/c/438096/14:33
*** tobberydberg has quit IRC14:33
morganlbragstad nope14:37
morgannot that I remember14:37
morganpolicy API, but that was a nightmare to suss out14:37
morgantempest checks it14:38
morganso, I wasn't really willing to drive a deprecation.14:38
morganit was low priority anyway14:38
*** piliman974 has quit IRC14:38
lbragstadyeah14:39
lbragstadmorgan: https://bugs.launchpad.net/keystone/+bug/1693498 was opened and i don't know if its worth the work given we wanted to deprecate both14:39
openstackLaunchpad bug 1693498 in OpenStack Identity (keystone) "Credential list API returns list of available credentials when user passes invalid name as query parameter" [Undecided,New] - Assigned to Pooja Jadhav (poojajadhav)14:39
*** piliman974 has joined #openstack-keystone14:40
bretonwe want to deprecate credentials?14:43
bretonwe just switched them to be encrypted, no?14:43
lbragstadbreton: we did - but it was something we discussed in ATL during the PTG14:43
*** markvoelker has joined #openstack-keystone14:45
*** ducttape_ has quit IRC14:53
lbragstadmorgan: what was the reasoning for attaching secrets to the user?14:54
lbragstadfrom the etherpad https://etherpad.openstack.org/p/pike-ptg-keystone-deprecations14:54
lbragstad"OUTCOME: Make TOTP and EC2 secrets attach to the user and give it a specific API, then we can deprecate the credential API just like we did the policy API"14:54
lbragstadmorgan: unless keeping the policy API around is useful for future policy work?14:56
*** masuberu has joined #openstack-keystone14:58
morganbecause the credential api sucks15:00
morganit basically assumes a relational model and leaks that to the user15:00
morganif it was attached to the user itself, like passwords are, you have less overhead. also we can be more strict about the data involved15:01
lbragstadmorgan: sure - but what did we mean by "make TOTP and EC2 secrets attach to the user"15:01
morganthe credential api was kindof a dumping ground of ick15:01
*** stingaci has joined #openstack-keystone15:01
morganlike passwords15:01
morganan actual loaded data value15:01
morganuser.ec2_creds or user.totp_secrets15:01
lbragstadah15:01
morganvs user -> get creds -> look for totp_creds, try, fail, next, nope, error15:02
lbragstadso making those things first class attributes15:02
morganyeah15:02
morgani think that was what we said15:02
morganhonestly, i am guessing based upon context15:02
lbragstadbut - they still shouldn't be in keystone15:02
lbragstadso - it would be the best case for having something like that in keystone, if i'm understanding this correctly15:03
lbragstadoption 1) store ec2 and totp secrets in something that's not keystone 2.) store them as first class attributes of the user15:03
*** jerrygb has quit IRC15:03
*** rcernin has quit IRC15:04
*** d0ugal has quit IRC15:04
morganany and all auth creds need to be in keystone or something like vault15:04
*** jerrygb has joined #openstack-keystone15:04
morganit can't be in barbican or something that relies on keystone15:04
lbragstadright15:04
morganthey're likely going to have to be 1st class (even in remote backend) from a keystone perspective15:05
morganall auth data should be15:05
*** gyee has joined #openstack-keystone15:06
lbragstadok - so our totp implementation will have to consider that15:07
lbragstadand change as well15:07
morganyeah15:07
lbragstadmorgan: ok - cool, that helps clear that up15:08
lbragstadmorgan: with policy and the discussion we've been having, could the existing implementation be repurposed in the future?15:08
morganunlikely15:09
morganyou want something very service specific15:09
morgannot lumped into a poor key-value-store of blobs15:09
lbragstadmorgan: imo it looks like the policy api was an initial attempt at copying AWS IAM15:10
morganthe policy api should be deprecated, and default turned off (policy.json/incode) but that is a big hurdle because now tempest (not in-tree plugin) tests it's existence15:10
lbragstadand how it does policy15:10
morganit sortof was15:10
lbragstadok15:10
morganit was "shove a policy.json into keystone and give an id to retrieve it"15:10
morganthe problem is this poses a lot of caching issues, deployment issues, and "store by uuid" issues15:10
lbragstadso let's say we actually get the a better place with policy across openstack and we end up needing additional policy in keystone15:11
morganit's really a generic "store blob in a db and call it policy"15:11
lbragstadbut the policy api namespace is taken15:11
lbragstadfor v3 anyway15:11
morganmake v415:11
morganand i am being serious15:11
* lbragstad blinks15:11
morgansplit auth/catalog to /auth and /catalog15:11
morgan /v4 becomes v3 without cruft15:12
lbragstadso reuse the policy namespace but break everything about it and do it right15:12
morganif needed15:12
morganthough i also think policy is a bad name15:12
morganyou could call it /RBAC15:12
morganor something like that15:12
lbragstadsure15:12
lbragstadif we still wanted to do it in v315:12
morgani am an advocate of v4 being a thing w/o auth, without catalog (rendering, get for token, it can still be constructed)15:13
morganand dumping other cruft15:13
morganv3 becomes deprecated / maintained.15:13
morganand we work on /auth and /catalog15:13
morganand then move ksa to that15:13
morgan... anyway ...15:14
lbragstadah15:14
*** pnavarro has quit IRC15:14
lbragstadso making auth and catalog versionless15:15
lbragstadwell - no15:15
lbragstadjust not having to roll it into v415:15
*** stingaci has quit IRC15:16
*** d0ugal has joined #openstack-keystone15:18
morganyes15:18
*** cristicalin has quit IRC15:25
*** belmoreira has quit IRC15:39
*** aojea has quit IRC15:43
*** aojea has joined #openstack-keystone15:44
knikollaayoung: stumbled upon a very old article of yours https://adam.younglogic.com/2013/07/a-vision-for-keystone/15:46
ayoungknikolla, ah to be young and naive again15:48
ayoungknikolla, I just noticed that I posted that on my birthday.15:48
ayoungI really need to straighten out my priorities15:48
*** aojea has quit IRC15:49
knikollaayoung: writing visions of the future is not a good way to spend birthdays15:50
knikollaayoung: it was one of the top results on google for keystone jwt somehow15:51
ayoungknikolla, I did an updated one a few years later15:51
*** aselius has joined #openstack-keystone16:06
openstackgerritKristi Nikolla proposed openstack/python-keystoneclient master: Moved release no to the correct path  https://review.openstack.org/46845816:12
openstackgerritKristi Nikolla proposed openstack/python-keystoneclient master: Moved release note to the correct path  https://review.openstack.org/46845816:12
openstackgerritKristi Nikolla proposed openstack/keystone master: Route based RBAC Management Interface  https://review.openstack.org/40180816:28
*** david-lyle has joined #openstack-keystone16:30
*** markvoelker has quit IRC16:30
openstackgerritKristi Nikolla proposed openstack/keystonemiddleware master: WIP - Role check in middleware  https://review.openstack.org/45893116:32
gyeeayoung, knikolla, about RBAC, in the talk, one of you mentioned to you a magic script to get an inventory of all the service APIs or was I hearing it wrong16:33
ayounggyee, I was projecting.  I scraped mine from the API docs:16:38
ayounghttps://developer.openstack.org/api-ref/compute/16:38
*** piliman974 has quit IRC16:38
ayoungIf you view source on it, you should be able to see how straight forward it would be to convert that to a JSON doc16:38
gyeeayoung, I was thinking you have something like pulling the catalog from Keystone, then following the refs to collect all the APIs our there16:39
gyeesimilar to version discovery16:40
*** piliman974 has joined #openstack-keystone16:41
lbragstadstevemar: want to kick this through stable? https://review.openstack.org/#/c/466873/116:46
lbragstadstevemar: it closes a bug for us16:46
openstackgerritMatthew Edmonds proposed openstack/keystone master: Handle group NotFound in effective assignment list  https://review.openstack.org/46810316:48
*** jaosorior has quit IRC16:49
*** ducttape_ has joined #openstack-keystone16:54
*** david-lyle has quit IRC16:58
edmondswknikolla would appreciate your review on https://review.openstack.org/#/c/46810317:05
edmondswknikolla the original test_list_role_assignments_group_not_found you'd written wasn't actually working properly. It was skipping some of what you were trying to test because there were no group assignments entering that method. I believe I've fixed it17:06
samueldmqedmondsw: there was a similar issue for that but for user rather than group17:13
samueldmqedmondsw: I remember reviewing something like that lately17:14
edmondswsamueldmq the user test shouldn't have the same issue since there are users entering that method17:14
edmondswbut then again, it should still be fixed to check that, or not rely on that being the case17:14
samueldmqedmondsw: ++17:14
samueldmqI have reviewed something similar to that17:15
edmondswsamueldmq I only addressed the group issue, since the defect I was working under was group-specific17:15
samueldmqI will see if I can find it, sanity check17:15
samueldmqedmondsw: https://review.openstack.org/#/c/465395/17:15
edmondswsamueldmq that's where the test was added17:16
edmondswsamueldmq I'd be surprised if there was a review up to fix the tests, other than the one I linked above (which only addresses groups)17:17
samueldmqedmondsw: ok, and the issue is that the tests added there were wrong17:17
edmondswsamueldmq right17:18
samueldmqand cause another bug?17:18
samueldmqthe one referenced in the patch you mentioned?17:18
edmondswsamueldmq no... just don't check everything they intend to check17:18
*** sjain has joined #openstack-keystone17:18
edmondswsamueldmq the bug I mentioned is separate, but related, so the same test needed to be updated to account for it... and in doing so I noticed the original test wasn't really working as designed17:19
samueldmqedmondsw: hmm would you mind to walk me through why it was not working properly17:20
samueldmqI dont see why we need to clean up all the role assignments in the test setup17:20
openstackgerritOpenStack Proposal Bot proposed openstack/keystone master: Updated from global requirements  https://review.openstack.org/46824217:20
samueldmqsince we're creating a brand new group17:20
openstackgerritOpenStack Proposal Bot proposed openstack/keystonemiddleware master: Updated from global requirements  https://review.openstack.org/46848517:20
sjainHi, can someone please review this patch, https://review.openstack.org/#/c/466066/ Thanks!17:20
edmondswsamueldmq those are separate questions :) but I can answer them both17:21
edmondswfirst, why it wasn't working properly...17:21
edmondswthe `if 'group_name' in assignment` check was always false, so that block was never entered17:21
samueldmqok :)17:21
edmondswbecause there were no group assignments17:22
edmondswto make sure that never happens again, I added the stuff about includes_group_assignments17:22
samueldmqno group assigs17:22
samueldmq++17:22
edmondswbut it also got me thinking that this shouldn't have been possible if we were good about not leaving things behind from previous tests17:23
edmondsweach test should be self-contained unless specifically noted otherwise17:23
samueldmqI think I am the one who pushed that patch through :p17:23
edmondswI don't have bandwidth to go cleanup all the tests to be self-contained (cleaning up what they create before they exit) but I did that for this one17:23
samueldmqedmondsw: yeah that's a recurrent question on where we should or not include things in the global setup things (for the whole test class)17:24
samueldmqedmondsw: oh I think what exists if coming from the setUp17:24
edmondswsamueldmq I think some global setup is fine if it's going to be needed globally, or at least doesn't hurt globally17:24
samueldmqbut it's possible things are coming from other tests too17:24
samueldmq++17:24
edmondswsamueldmq but when you get into individual tests (not global setup), they shouldn't be leaving things behind17:25
samueldmqI like the addCleanup calls to make sure things get properly cleaned up17:25
samueldmqedmondsw: completely agree17:25
edmondswsamueldmq I guess you could argue that I should cleanup more than the grant at the end...17:26
edmondswsamueldmq yeah, let me go do that and push up another revision17:26
samueldmqedmondsw: what if we fixed the original test in a separate test17:26
samueldmqand make a different test for that new case?17:26
samueldmqjust an idea, not sure would be better, but the test looks a bit big17:27
edmondswsamueldmq I thought they made sense to go together17:27
edmondswif we split them, the name will need to change for both to cover the different variations17:27
edmondswbut they're extremely related17:27
edmondswsamueldmq it's only big now because of the setup/cleanup  involved17:28
samueldmqedmondsw: yeah, I am fine with that as it is17:28
*** ducttape_ has quit IRC17:34
*** piliman974 has quit IRC17:35
*** ducttape_ has joined #openstack-keystone17:38
*** sjain has quit IRC17:39
*** tobberydberg has joined #openstack-keystone17:48
openstackgerritMatthew Edmonds proposed openstack/keystone master: Handle group NotFound in effective assignment list  https://review.openstack.org/46810317:49
*** stingaci has joined #openstack-keystone17:49
*** stingaci has quit IRC17:50
*** stingaci has joined #openstack-keystone17:50
*** raildo has quit IRC17:51
*** tobberydberg has quit IRC17:53
openstackgerritMatthew Edmonds proposed openstack/keystone master: Handle group NotFound in effective assignment list  https://review.openstack.org/46810317:55
edmondswsamueldmq couldn't cleanup the users/groups because that raises LDAP read-only issues... surprised it let me create them, but I guess that's probably mocked somewhere and the same just wasn't done for delete17:56
edmondswsamueldmq so I just added a TODO about that for now17:57
*** ducttap__ has joined #openstack-keystone17:59
knikollaedmondsw: oh right, assignment_list is for both users and group assignments18:00
*** rderose has joined #openstack-keystone18:00
knikollabut there are only user assignments18:00
knikollaedmondsw: thanks for catching that18:00
*** pcaruana has quit IRC18:00
*** ducttape_ has quit IRC18:00
knikollaedmondsw: unit tests make ldap writable because almost every single unit test depends on creating them18:02
edmondswknikolla makes sense... should also make it writable for deletes :)18:02
knikollaedmondsw: no, i deleted the code for ldap delete entirely18:03
*** raildo has joined #openstack-keystone18:03
edmondswknikolla means we can't really cleanup during UTs :( but I guess we've lived without that this long...18:04
*** ducttape_ has joined #openstack-keystone18:04
knikollaedmondsw: at least in the case of ldap, the ldapdb is completely deleted after each unit test.18:05
knikollaedmondsw: https://github.com/openstack/keystone/blob/master/keystone/tests/unit/ksfixtures/ldapdb.py#L3318:06
knikollaedmondsw: i believe the same to be the case for sql18:07
*** ducttap__ has quit IRC18:07
edmondswknikolla must not be every UT, else the assignments that are getting carried over from one test to another would have been pointing to users and groups that no longer existed, and we'd have caught these bugs a long time ago18:07
edmondswknikolla maybe ever UT class?18:08
knikollaedmondsw: https://github.com/openstack/keystone/blob/master/keystone/tests/unit/default_fixtures.py18:08
knikollathese are recreated for each unit test18:08
knikollahttps://github.com/openstack/keystone/blob/master/keystone/tests/unit/core.py#L68718:09
edmondswknikolla ah, ic18:09
edmondswknikolla but that only has 1 assignment, and I was seeing 618:10
edmondswknikolla oh, I guess assignments are in sql, so they wouldn't be cleaned up the same way18:11
edmondswknikolla I didn't check to see if the 6 assignments all used those users18:11
knikollathere's a for loop that assigns users to projects18:11
knikollaedmondsw: maybe that's that https://github.com/openstack/keystone/blob/master/keystone/tests/unit/core.py#L722-L74118:12
knikollai haven't paid too close attention to assignments as the part i was refactoring for ldap is the identity18:12
edmondswknikolla yeah that would probably do it... 5 users would mean 5 assignments from that, plus the 1 assignment in default_fixtures = 618:13
knikollaedmondsw: yes :)18:14
knikollaedmondsw: instead of creating users, try to use the existing ones from setup18:15
edmondswknikolla it's not going to be a problem to add those to a group?18:15
edmondswknikolla I saw a bunch of places in that file creating users, so I just did the same18:15
knikollaedmondsw: no, but no groups are created from the default_fixtures, so you'll have to create one18:15
knikollaedmondsw: i know, that is wrong.18:16
edmondswknikolla.... eh... I'm not sure why we need the default_fixtures users, honestly18:16
*** aojea has joined #openstack-keystone18:17
knikollaedmondsw: then we have to maintain mocks for create_user for ldap. we shouldn't depend on identity_api having create_user since not all backends are writable. instead we should ask the test to precreate the backend in the state we want it to be.18:18
*** aojea has quit IRC18:18
*** aojea has joined #openstack-keystone18:18
knikolladuring setup18:18
edmondswknikolla makes sense18:19
edmondswknikolla it's the "how to precreate" that I'm stuck on18:19
edmondswknikolla I'd be happy to move all that setup I did into a fixture if I knew how18:20
edmondswknikolla we can't just have everyone using the default fixture if everyone needs a different pre-created state, so there would have to be a lot more fixtures18:21
edmondswknikolla which probably isn't a bad thing... again, back to the how18:22
knikollaedmondsw: that's true.18:22
knikollaedmondsw: but going through identity_api.create_user is different than creating the user straight in ldap18:22
knikollafor example identity mappings18:22
edmondswknikolla sure... I'm sold that using a fixture would be better. Give me the "how" and I'll try to do it18:23
knikollaedmondsw: there's a lot of cases which we've discovered by the ldap state changing without keystone's control18:23
knikollaedmondsw: working on that https://review.openstack.org/#/c/466406/18:23
knikollait'll be a looooooooooong way though18:23
*** ducttape_ has quit IRC18:24
knikollai'm mocking create_user with the bare minimums for ldap first.18:24
knikollaeventually i want to read the state from a dictionary18:24
*** rderose has quit IRC18:24
knikollait's painful for ldap. for sql i think we can get by with how it works now. since we assume full control of sql.18:24
knikollajust have the fixtures use the api like they do now. so only ldap needs to change.18:25
edmondswknikolla you going to add _create_group as well?18:25
knikollayes. with the bare minimum code for it to pass tests. so that the tests verify my bare minimum implementation. then i'll drop the mocks and use fixtures once i have a clear handle on what ldap directory fixtures are needed.18:27
knikollaedmondsw18:27
knikollai want to make this evolutionary rather than revolutionary18:28
edmondsw+118:28
edmondswknikolla I don't really know much about how to use fixtures... can you help me figure out how to replace my setup code with a fixture?18:29
edmondswI'm not finding an example18:29
edmondswor can I just leave it as-is for now?18:29
knikollaedmondsw: for example, instead of creating a user and a project https://github.com/openstack/keystone/blob/master/keystone/tests/unit/assignment/test_backends.py#L680-L68118:30
knikollathe test gets the users from the fixtures18:30
knikollauser foo and tenant bar18:30
edmondswknikolla but that's from the default fixture... how do I make it use a different fixture of my creation?18:32
edmondswand there's this: https://github.com/openstack/keystone/blob/master/keystone/tests/unit/default_fixtures.py#L15-L1618:32
knikollaedmondsw: you can't save from adding them to default fixtures. and default fixtures has no groups, so you would still need to create a group.18:34
knikollaedmondsw: i would say for now just go ahead and keep it like you're doing it18:34
knikollawith create_group18:34
knikollaand create_user18:35
edmondswknikolla k, I'll leave it as-is... thanks!18:35
*** ducttape_ has joined #openstack-keystone18:35
*** ducttape_ has quit IRC18:35
*** ducttape_ has joined #openstack-keystone18:36
knikollaedmondsw: as for the performance impact, that is because everything in that file is created before each unit tests is run. you saw the double for loops. but having different fixtures for different tests will help with that :)18:36
edmondsw++18:36
*** aojea has quit IRC18:42
*** aojea has joined #openstack-keystone18:42
*** aojea has quit IRC18:47
*** ducttap__ has joined #openstack-keystone18:49
*** ducttap__ has quit IRC18:50
*** ducttap__ has joined #openstack-keystone18:51
*** ducttape_ has quit IRC18:52
*** Aurelgadjo has quit IRC18:53
*** lucasxu has quit IRC18:58
gyeelbragstad: https://bugs.launchpad.net/keystonemiddleware/+bug/169390719:02
openstackLaunchpad bug 1693907 in keystonemiddleware "audit middleware changed the request context causes breakage in HEAT" [Undecided,New]19:02
gyeeI think this one is pretty serious19:02
lbragstadgyee: checking19:05
gyeeI suspect this one may impact other services which depending on the request context19:07
*** piliman974 has joined #openstack-keystone19:08
lbragstadgyee: the patch in question merged a year ago?19:11
lbragstadhttps://review.openstack.org/#/c/216889/719:11
gyeeyes19:12
lbragstadgyee: is there trace of this breaking in heat?19:12
gyeesome people just upgraded to Newton, ya known :-)19:12
lbragstador in the gate somewhere?19:12
gyeeproblem is, I don't think services have any gates with audit middleware deployed19:13
lbragstaddevstack?19:13
gyeewon't be devstack, it would be in each services paste ini file19:14
*** lucasxu has joined #openstack-keystone19:14
gyeenot sure if any service enable it by default19:16
gyeeI kinda doubt it19:17
lbragstadwe need steps to recreate it19:17
lbragstadgyee: can that be included in the bug report?19:17
gyeesure19:17
lbragstadwhat needs to be enabled for this to break heat?19:18
gyeejust enable it here https://github.com/openstack/heat/blob/master/etc/heat/api-paste.ini19:20
gyeelet me see if I can get the folks to share the deployment configuration19:20
lbragstadthat would help19:20
lbragstadgyee: lets see if we can get stevemar and jamielennox|away involved19:22
lbragstadthe original bug was triaged as low initially and never escalated to anything higher19:23
*** aojea has joined #openstack-keystone19:27
gyeelbragstad, yeah19:27
*** ducttap__ has quit IRC19:27
gyeewe either back that one out or implement an adapter and properly deprecate it19:27
gyeeto me, req.context is API19:27
gyeeI can push a patch once we decided what to do19:30
*** prashkre has quit IRC19:30
*** cristicalin has joined #openstack-keystone19:40
*** ducttape_ has joined #openstack-keystone19:43
*** frontrunner has quit IRC19:44
*** stingaci has quit IRC19:44
*** ducttap__ has joined #openstack-keystone19:44
*** stingaci has joined #openstack-keystone19:45
morganholy crap, it's a wild gyee19:46
gyeemorgan: :-)19:48
*** ducttape_ has quit IRC19:48
gyeestill need to pay the bills man19:48
knikollaayoung: for matching routes, the routes mapper might not be the best choice. it can only match one, and order matters in the case of the catchall.19:54
knikollaayoung: i'm feeling tempted to hardcode behaviour for a "*" route.19:55
*** piliman974 has quit IRC19:58
*** piliman974 has joined #openstack-keystone20:00
*** aojea has quit IRC20:02
*** aojea has joined #openstack-keystone20:03
*** aojea has quit IRC20:08
lbragstadgyee: yeah - the original bug didn't seem super high priority20:08
* lbragstad is headed out for the day20:09
lbragstadi hope everyone has a safe and happy memorial weekend!20:10
gyeelbragstad, have a great long weekend to you too20:10
ayoungknikolla, do it20:12
ayoungif none are matched, and there is a catchall, then see if the catchall matches?20:12
knikollaayoung: that was my plan.20:12
ayoungworks for me.20:12
ayoungwe can unit test that code thoroughly20:12
knikollaayoung: yes. it's pretty easy to extensively unit test.20:13
knikollaayoung: i also need to add validation in the server side. if any of the the routes has wrong syntax the mapper will fail to build.20:13
knikollaayoung: but on the bright side, i tested it and it worked.20:14
*** aojea has joined #openstack-keystone20:24
ayoungknikolla, ah.  adding a route should do a syntax check.  Good point20:29
*** raildo has quit IRC20:32
*** piliman974 has quit IRC20:36
*** thorst has quit IRC20:40
*** cristicalin has quit IRC20:43
openstackgerritKristi Nikolla proposed openstack/keystonemiddleware master: WIP - Role check in middleware  https://review.openstack.org/45893120:46
*** d0ugal has quit IRC20:46
*** nkinder has quit IRC20:46
*** frontrunner has joined #openstack-keystone20:50
*** aojea has quit IRC20:53
*** aojea has joined #openstack-keystone20:53
*** aojea_ has joined #openstack-keystone20:57
*** aojea has quit IRC20:59
*** nkinder has joined #openstack-keystone20:59
*** thorst has joined #openstack-keystone21:00
*** thorst has quit IRC21:04
*** masuberu has quit IRC21:07
*** ducttap__ has quit IRC21:14
*** gyee has quit IRC21:19
*** lucasxu has quit IRC21:26
*** catintheroof has joined #openstack-keystone21:33
*** catintheroof has quit IRC21:39
*** ducttape_ has joined #openstack-keystone21:40
*** ducttape_ has quit IRC21:55
*** ducttape_ has joined #openstack-keystone22:06
openstackgerritBoris Kudryavtsev proposed openstack/keystone master: Add user_id_attribute support to _dn_to_id  https://review.openstack.org/46638922:07
openstackgerritMatthew Edmonds proposed openstack/keystone master: Handle group NotFound in effective assignment list  https://review.openstack.org/46810322:10
*** aojea_ has quit IRC22:12
*** bkudryavtsev has quit IRC22:17
*** __Nautilus__ has quit IRC22:26
*** piliman974 has joined #openstack-keystone22:46
*** ducttape_ has quit IRC23:05
*** chlong has quit IRC23:10
*** piliman974 has quit IRC23:30
*** david-lyle has joined #openstack-keystone23:31
*** david-lyle has quit IRC23:36
*** stingaci has quit IRC23:40
*** piliman974 has joined #openstack-keystone23:41
*** stingaci has joined #openstack-keystone23:46
*** stingaci has quit IRC23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!