Wednesday, 2016-07-27

*** dan_nguyen has quit IRC00:01
*** browne has quit IRC00:01
*** nkinder has quit IRC00:11
*** jamielennox is now known as jamielennox|away00:12
*** Krenair has joined #openstack-keystone00:18
adriantAnyone able to have a quick look at one of my patches to see why python3 might be failing? I'm at a loss to see why.00:21
*** roxanaghe has quit IRC00:23
*** Krenair has left #openstack-keystone00:26
*** adrian_otto has quit IRC00:28
*** davechen has joined #openstack-keystone00:38
*** code-R has joined #openstack-keystone00:42
*** code-R_ has joined #openstack-keystone00:44
*** sdake_ has quit IRC00:45
*** code-R has quit IRC00:47
*** sdake has joined #openstack-keystone00:47
*** tonytan4ever has joined #openstack-keystone00:47
stevemaradriant: which?00:48
*** code-R_ has quit IRC00:48
*** code-R has joined #openstack-keystone00:49
*** ddieterly has joined #openstack-keystone00:49
adriantstevemar: https://review.openstack.org/#/c/34342200:52
patchbotadriant: patch 343422 - keystone - adding totp support to password auth plugin00:52
adriantthe unit tests I added don't pass python3, although based very much so on passing tests :/00:53
*** tonytan4ever has quit IRC00:53
*** tqtran has quit IRC00:56
*** jrist has quit IRC00:59
*** sdake has quit IRC01:04
*** jrist has joined #openstack-keystone01:11
*** nk2527 has quit IRC01:16
*** ddieterly is now known as ddieterly[away]01:20
*** ddieterly[away] is now known as ddieterly01:20
*** openstackgerrit has quit IRC01:33
*** openstackgerrit has joined #openstack-keystone01:33
*** woodster_ has quit IRC01:39
*** tonytan4ever has joined #openstack-keystone01:49
rderoseadriant: should this line be user_id=self.default_domain_user['id']?01:49
*** davechen has quit IRC01:50
*** davechen has joined #openstack-keystone01:51
rderoseadriant: referring to test_v3_auth.py, ln 515901:52
*** tonytan4ever has quit IRC01:53
*** ddieterly has quit IRC01:57
rderoseadriant: sorry, I see you overwrote the _make_auth_data_by_id(...) method02:00
adriantrderose: yeah, I was originally going to just extend the TOTP class, but by doing so it duplicated the tests it ran, so I ended up making duplicates of the helper functions02:04
rderoseadriant: I see02:04
rderoseadriant: yeah, so far I'm not seeing the error02:05
*** julim has joined #openstack-keystone02:05
adriantYeah, I'm confused as all hell. Unless something weird is happening in the plugin itself.02:05
adriantbut... the password part of it obviously still works since the other tests are passing!02:06
rderoseadriant: right02:06
rderoseadriant: lets do a recheck just for kicks :)02:08
adriantrderose: fair enough. :P02:08
adriantalthough I get the same problem running it locally02:08
rderoseadriant: hmm...02:09
*** spandhe has joined #openstack-keystone02:10
*** sdake has joined #openstack-keystone02:12
*** spandhe has quit IRC02:13
*** ebalduf has joined #openstack-keystone02:16
*** roxanaghe has joined #openstack-keystone02:24
*** iurygregory_ has joined #openstack-keystone02:29
*** tonytan4ever has joined #openstack-keystone02:35
*** jamielennox|away is now known as jamielennox02:41
*** ebalduf has quit IRC02:45
*** sdake has quit IRC02:53
*** tqtran has joined #openstack-keystone02:55
*** ddieterly has joined #openstack-keystone02:56
*** tqtran has quit IRC02:59
*** gyee has quit IRC03:03
*** ddieterly has quit IRC03:08
adriantrderose: I've found the issue...03:08
adriantpasscode isn't a str, it's byte... so password+passcode does stupid shit like: 'password': "d611d450a801454195daae19d565c0a8b'249283'"03:09
*** sdake has joined #openstack-keystone03:12
*** thumpba has joined #openstack-keystone03:15
*** thumpba has quit IRC03:18
*** lamt has quit IRC03:21
rderoseadriant: ah, that's great03:29
rderoseadriant: glad you found it :)03:30
adriantrderose: yes, but I can't solve it... yet03:30
*** adrian_otto has joined #openstack-keystone03:31
adriantrderose: it's so stupid and weird03:34
adriantthe actual str value of the passcode is a byte str... but python thinks it's a str03:35
adriant'passcode': "b'008785'"03:35
adriantI'm vaguely surprised the other TOTP stuff hasn't fallen over for this same issue03:36
rderoseadriant: wow...03:36
adriantI may need to talk to the person who wrote the passcode generation code as that seems to be the issue03:37
rderoseadriant: I think you need to decode the byte03:37
adriantor just rewrite it myself03:37
rderose>>> b"abcde".decode("utf-8")03:38
rderose'abcde'03:38
rderoseadriant: found that online: http://stackoverflow.com/questions/606191/convert-bytes-to-a-python-string03:38
adriantit's type str though03:38
rderoseadriant: oh crap03:38
rderose:)03:38
adriantyeah03:38
adriantthis is so very broken03:38
adriantI could use regex to parse it... but that's not a solution, that's a hack03:39
rderoseyeah, seems like it.  just don't know how the unit tests passed03:39
rderoseyeah, that would be a hack.  think you have to bite the bullet and just fix it.03:40
adriantI'll get a hold of the writer of the original TOTP patch for their input, and yeah, rewrite the passcode function03:40
rderosewas it werner?03:41
adriantyeah I think so03:41
adrianti'll add him as reviewer to the patch as well03:41
rderosecool03:41
adriantbloody python 303:42
rderose:) dam though, that was a touch one to uncover03:42
rderoseglad you were able to find the root cause03:42
adriantLots of digging, and checking all the variable outputs :/03:43
adriantthanks btw for trying :) This was very weird03:44
*** dikonoor has joined #openstack-keystone03:46
adriantrederose: ahaha, and if I try and encode it as a byte I get this:   b"b'522346'"03:46
adriantoh wow that is glorious03:46
*** sheel has joined #openstack-keystone03:48
openstackgerritTin Lam proposed openstack/keystone: Add schema validation to v2 create tenant  https://review.openstack.org/34659403:48
rderose:)03:48
adriantrderose: OH! I know why python3 tests are passing for TOTP03:50
adriantbecause it generates the same screwed up byte+str on both sides03:51
adriantand I'm only seeing the problem because I'm trying to concatenate it with a password03:51
adriantso the tests are passing, but the functionality is broken for python303:51
*** adrian_otto has quit IRC03:52
*** links has joined #openstack-keystone03:54
rderoseadriant: oh my goodness03:58
rderoseadriant: yeah, that totally makes sense03:58
*** thumpba has joined #openstack-keystone04:00
adriantrderose: it gets worse... open a python3 interpreter and try this:   str(b'something')04:02
*** thumpba has quit IRC04:06
*** links has quit IRC04:09
*** links has joined #openstack-keystone04:12
*** jaugustine has quit IRC04:13
*** gagehugo_ has quit IRC04:13
*** thumpba has joined #openstack-keystone04:15
*** NishaYadav has joined #openstack-keystone04:15
*** NishaYadav is now known as Guest753804:15
*** jaugustine has joined #openstack-keystone04:16
openstackgerritAdrian Turjak proposed openstack/keystone: adding totp support to password auth plugin  https://review.openstack.org/34342204:19
*** thumpba has quit IRC04:27
*** richm has quit IRC04:27
*** aastha has quit IRC04:29
*** jamielennox is now known as jamielennox|away04:30
*** Guest7538 has quit IRC04:32
*** nishaYadav has joined #openstack-keystone04:32
*** thumpba has joined #openstack-keystone04:36
*** GB21 has joined #openstack-keystone04:39
*** iurygregory_ has quit IRC04:43
*** davechen has quit IRC04:45
*** adu has joined #openstack-keystone04:48
*** jamielennox|away is now known as jamielennox04:51
*** gagehugo has joined #openstack-keystone04:58
*** GB21 has quit IRC05:03
*** GB21 has joined #openstack-keystone05:03
*** adriant has quit IRC05:06
*** roxanaghe has quit IRC05:11
*** roxanaghe has joined #openstack-keystone05:12
*** browne has joined #openstack-keystone05:14
*** roxanaghe has quit IRC05:17
openstackgerritEric Brown proposed openstack/keystone: Invalid tls_req_cert constant as default  https://review.openstack.org/34752305:20
*** browne has quit IRC05:20
*** maestropandy has joined #openstack-keystone05:21
*** GB21 has quit IRC05:25
*** GB21 has joined #openstack-keystone05:27
*** adu has quit IRC05:35
*** spandhe has joined #openstack-keystone05:45
*** GB21 has quit IRC05:49
*** GB21 has joined #openstack-keystone05:51
*** EinstCrazy has joined #openstack-keystone05:53
*** maestropandy has quit IRC05:54
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Add role functional tests  https://review.openstack.org/33511805:56
*** EinstCrazy has quit IRC05:58
*** tqtran has joined #openstack-keystone05:58
*** EinstCrazy has joined #openstack-keystone06:02
*** tqtran has quit IRC06:02
*** nishaYadav has quit IRC06:06
*** nishaYadav has joined #openstack-keystone06:07
*** nishaYadav is now known as Guest4124706:07
*** EinstCra_ has joined #openstack-keystone06:12
*** code-R has quit IRC06:12
*** code-R has joined #openstack-keystone06:13
*** roxanaghe has joined #openstack-keystone06:13
*** GB21 has quit IRC06:15
*** GB21 has joined #openstack-keystone06:16
*** EinstCrazy has quit IRC06:16
*** sdake has quit IRC06:16
*** roxanaghe has quit IRC06:18
*** GB21 has quit IRC06:21
*** spandhe has quit IRC06:26
*** davechen has joined #openstack-keystone06:31
*** Guest41247 is now known as nishaYadav06:33
*** amitkqed has joined #openstack-keystone06:35
*** amitkqed has quit IRC06:36
*** amitkqed has joined #openstack-keystone06:37
*** GB21 has joined #openstack-keystone06:40
*** tesseract- has joined #openstack-keystone06:44
*** sdake has joined #openstack-keystone06:45
*** rcernin has joined #openstack-keystone06:47
*** maestropandy has joined #openstack-keystone06:48
*** jraim has quit IRC06:49
*** zhiyan has quit IRC06:49
*** briancurtin has quit IRC06:49
*** jraim has joined #openstack-keystone06:52
*** briancurtin has joined #openstack-keystone06:52
*** zhiyan has joined #openstack-keystone06:52
*** thumpba has quit IRC06:53
*** sdake has quit IRC07:01
*** danpawlik has joined #openstack-keystone07:15
*** thumpba has joined #openstack-keystone07:15
*** thumpba has quit IRC07:18
*** pnavarro has joined #openstack-keystone07:21
*** amakarov_away is now known as amakarov07:31
*** itisha has joined #openstack-keystone07:33
*** mtreinish has quit IRC07:36
*** mtreinish has joined #openstack-keystone07:36
*** gagehugo has quit IRC07:37
*** code-R has quit IRC07:37
*** rdo has quit IRC07:38
*** basilAB has quit IRC07:38
*** code-R has joined #openstack-keystone07:38
*** maestropandy has quit IRC07:38
*** basilAB has joined #openstack-keystone07:39
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/keystone: [WIP] Testing latest u-c  https://review.openstack.org/31843507:46
openstackgerritKseniya Tychkova proposed openstack/oslo.policy: Refactoring of Enforcer class  https://review.openstack.org/34600207:52
*** nishaYadav has quit IRC07:57
*** tonytan4ever has quit IRC07:58
*** GB21 has quit IRC07:58
*** tonytan4ever has joined #openstack-keystone07:59
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-keystone08:00
*** roxanaghe has joined #openstack-keystone08:01
*** nishaYadav has joined #openstack-keystone08:06
*** roxanaghe has quit IRC08:06
*** nishaYadav is now known as Guest9046508:06
*** pgbridge has quit IRC08:09
openstackgerritDavanum Srinivas (dims) proposed openstack/keystone: [WIP] Testing latest u-c  https://review.openstack.org/31843508:10
*** pgbridge has joined #openstack-keystone08:10
*** tonytan4ever has quit IRC08:11
*** hoonetorg has quit IRC08:13
*** hoonetorg has joined #openstack-keystone08:17
*** code-R has quit IRC08:21
*** marekd2 has joined #openstack-keystone08:33
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Add project functional tests  https://review.openstack.org/33287108:41
*** Guest90465 is now known as nishaYadav08:42
*** rdo has joined #openstack-keystone08:44
*** EinstCra_ has quit IRC08:45
*** EinstCrazy has joined #openstack-keystone08:46
*** EinstCrazy has quit IRC08:47
*** EinstCrazy has joined #openstack-keystone08:47
*** GB21 has joined #openstack-keystone08:53
*** roxanaghe has joined #openstack-keystone09:00
*** tonytan4ever has joined #openstack-keystone09:01
*** tonytan4ever has quit IRC09:05
*** roxanaghe has quit IRC09:06
*** GB21 has quit IRC09:07
*** nisha_ has joined #openstack-keystone09:08
*** nishaYadav has quit IRC09:09
*** GB21 has joined #openstack-keystone09:11
*** EinstCrazy has quit IRC09:17
*** maestropandy has joined #openstack-keystone09:19
*** GB21 has quit IRC09:20
*** EinstCra_ has joined #openstack-keystone09:25
*** EinstCra_ has quit IRC09:27
*** EinstCrazy has joined #openstack-keystone09:28
*** davechen has quit IRC09:41
*** EinstCra_ has joined #openstack-keystone09:42
*** EinstCrazy has quit IRC09:43
*** rdo has quit IRC09:45
*** tangchen has quit IRC09:50
*** maestropandy has quit IRC09:57
*** LarsErikP has joined #openstack-keystone09:57
*** LarsErikP has left #openstack-keystone09:57
*** chlong_POffice has quit IRC09:57
*** tangchen has joined #openstack-keystone10:04
*** hwcomcn has joined #openstack-keystone10:06
*** mvk has quit IRC10:07
*** chlong_POffice has joined #openstack-keystone10:10
*** EinstCra_ has quit IRC10:13
*** EinstCrazy has joined #openstack-keystone10:13
*** mnikolaenko_ has quit IRC10:17
*** davechen has joined #openstack-keystone10:21
*** maestropandy has joined #openstack-keystone10:27
*** mvk has joined #openstack-keystone10:38
*** nisha_ has quit IRC10:46
*** maestropandy has quit IRC10:51
*** rdo has joined #openstack-keystone11:23
*** thiagolib has joined #openstack-keystone11:26
*** gordc has joined #openstack-keystone11:46
*** rodrigods has quit IRC12:09
*** rodrigods has joined #openstack-keystone12:09
*** maestropandy has joined #openstack-keystone12:16
*** tonytan4ever has joined #openstack-keystone12:17
*** ddieterly has joined #openstack-keystone12:19
*** chlong_POffice has quit IRC12:21
*** tonytan4ever has quit IRC12:22
*** ddieterly has quit IRC12:22
*** sdake has joined #openstack-keystone12:23
*** hwcomcn has quit IRC12:25
*** chlong has joined #openstack-keystone12:29
*** ddieterly has joined #openstack-keystone12:39
*** EinstCrazy has quit IRC12:40
*** lamt_ has joined #openstack-keystone12:41
stevemaro/12:42
stevemarmy bouncer is having a rough time12:42
*** ddieterly has quit IRC12:44
*** pauloewerton has joined #openstack-keystone12:47
*** woodster_ has joined #openstack-keystone12:49
dstanekstevemar: what seems to be the problem?12:50
stevemardstanek: no idea, lots of disconnects12:50
dstanekstevemar: from you to bouncer or boucer to irc?12:50
stevemardstanek: bouncer to irc12:50
stevemarbut it seems to have settled12:51
dstaneki had a few disconnects early this morning, but nothing significant12:54
*** samueldmq has joined #openstack-keystone12:55
*** ChanServ sets mode: +v samueldmq12:55
*** sheel has quit IRC12:56
*** links has quit IRC13:08
*** jsavak has joined #openstack-keystone13:12
*** edmondsw has joined #openstack-keystone13:17
stevemarthat fuel-ccp discussion on the mailing list o_O13:19
bretonstevemar: which one?13:20
bretonoh, i see13:22
stevemargerrit is le slow13:24
stevemarbreton: there's only one :P13:24
stevemarat least, one in my mailing list folder13:24
*** david-lyle_ has joined #openstack-keystone13:31
*** david-lyle_ has quit IRC13:31
*** roxanaghe has joined #openstack-keystone13:32
*** ebalduf has joined #openstack-keystone13:33
*** david-lyle has quit IRC13:34
openstackgerritDolph Mathews proposed openstack/keystone: Add feature support matrix to documentation  https://review.openstack.org/31611813:35
*** davechen has joined #openstack-keystone13:36
*** davechen has left #openstack-keystone13:36
*** roxanaghe has quit IRC13:37
*** code-R has joined #openstack-keystone13:37
*** richm has joined #openstack-keystone13:37
*** ayoung has joined #openstack-keystone13:41
*** ChanServ sets mode: +v ayoung13:41
*** maestropandy has left #openstack-keystone13:42
*** jsavak has quit IRC13:46
*** jsavak has joined #openstack-keystone13:47
*** code-R_ has joined #openstack-keystone13:49
*** spandhe has joined #openstack-keystone13:50
*** code-R has quit IRC13:52
-openstackstatus- NOTICE: Gerrit is being restarted now to relieve performance degradation13:52
lbragstad^ that explains it13:52
lbragstadluckily I saved the novel of a comment I was about to leave!13:53
openstackgerritMerged openstack/keystone-specs: move old APIs to the attic  https://review.openstack.org/34239913:53
*** dikonoor has quit IRC13:58
lbragstadhere are a couple easy ones in case anyone is looking for a review - https://review.openstack.org/#/c/345686/14:01
patchbotlbragstad: patch 345686 - keystone - Make AuthWithTrust testable against uuid and fernet14:01
lbragstadand https://review.openstack.org/#/c/345687/14:01
patchbotlbragstad: patch 345687 - keystone - Allow V2TestCase to be tested against fernet and uuid14:01
*** gagehugo has joined #openstack-keystone14:02
*** code-R_ has quit IRC14:05
*** code-R has joined #openstack-keystone14:05
*** raildo has joined #openstack-keystone14:06
*** code-R_ has joined #openstack-keystone14:07
*** code-R has quit IRC14:11
*** aswadr_ has joined #openstack-keystone14:11
*** nishaYadav has joined #openstack-keystone14:13
*** ravelar159 has joined #openstack-keystone14:15
*** TxGVNN has joined #openstack-keystone14:16
*** tonytan4ever has joined #openstack-keystone14:17
openstackgerritDolph Mathews proposed openstack/keystone: Add token feature support matrix to documentation  https://review.openstack.org/31611814:17
*** spandhe has quit IRC14:18
*** jsavak has quit IRC14:27
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Add region functional tests  https://review.openstack.org/33915814:28
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Improve docs for v3 endpoints  https://review.openstack.org/33946814:30
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Add endpoint functional tests  https://review.openstack.org/34041814:30
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Improve docs for v3 roles  https://review.openstack.org/33454614:31
openstackgerritBoris Bobrov proposed openstack/keystone: Eagerly load passwords for local users  https://review.openstack.org/34755214:31
openstackgerritNisha Yadav proposed openstack/python-keystoneclient: Add role functional tests  https://review.openstack.org/33511814:32
openstackgerritBoris Bobrov proposed openstack/keystone: test  https://review.openstack.org/34787614:35
openstackgerritDolph Mathews proposed openstack/keystone: Add token feature support matrix to documentation  https://review.openstack.org/31611814:40
*** ebalduf has quit IRC14:42
*** jsavak has joined #openstack-keystone14:42
*** michauds has joined #openstack-keystone14:46
lbragstadcrinkle looks like i was able to recreate what you were seeing on rderose's patch - https://review.openstack.org/#/c/340074/2914:49
patchbotlbragstad: patch 340074 - keystone - PCI-DSS Lockout requirements14:49
lbragstadcrinkle good catch14:49
lbragstadcrinkle although - i have no idea how that error message gets logged (?!)14:49
*** ebalduf has joined #openstack-keystone14:50
*** code-R_ has quit IRC14:52
*** code-R has joined #openstack-keystone14:52
*** ddieterly has joined #openstack-keystone14:54
*** jistr is now known as jistr|call15:00
*** nk2527_ has joined #openstack-keystone15:01
*** nk2527_ has quit IRC15:03
*** nk2527_ has joined #openstack-keystone15:03
*** ravelar159 has quit IRC15:04
*** nk2527_ is now known as nk252715:05
*** slberger has joined #openstack-keystone15:07
*** KevinE has joined #openstack-keystone15:07
*** KevinE has quit IRC15:07
*** ravelar159 has joined #openstack-keystone15:07
*** aastha has joined #openstack-keystone15:10
*** nkinder has joined #openstack-keystone15:15
*** pcaruana has quit IRC15:17
*** danpawlik has quit IRC15:18
*** akscram has quit IRC15:20
*** roxanaghe has joined #openstack-keystone15:20
*** jdennis has quit IRC15:23
*** rcernin has quit IRC15:24
*** roxanaghe has quit IRC15:25
*** GB21 has joined #openstack-keystone15:27
*** code-R has quit IRC15:28
crinklelbragstad: yeah i could not figure that out15:29
*** ravelar159 has quit IRC15:29
lbragstadcrinkle you see the UserDisabled exception below it?15:29
*** samueldmq has quit IRC15:30
crinklelbragstad: yep, and that one doesn't have the same issue15:30
lbragstadcrinkle that's what I thought, too15:30
lbragstadbut it turns out when a user is disabled this is thrown instead - https://github.com/openstack/keystone/blob/9d54eb33c1d74ff39c947af6ff984ef2e0bf4be4/keystone/identity/core.py#L90215:30
lbragstadcrinkle which is a totally different beast15:30
lbragstadwhen it comes to rendering the error message15:31
crinklelbragstad: oh right i remember this, i think i commented that it's doing that validation in an entirely different place15:32
lbragstadcrinkle it looks like user.enabled validation is done in the manager15:32
lbragstadand the account lockout stuff is done in the driver15:33
*** ebalduf has quit IRC15:34
*** nk2527_ has joined #openstack-keystone15:35
*** jistr|call is now known as jistr15:35
crinklebut since the lockout feature is specific to the sql backend i would expect the driver to be the right place for that validation15:35
lbragstadcrinkle agree - but the exceptions threw me for a loop15:36
lbragstadsince i expected the sql driver to throw the UserDisabled exception15:36
*** nk2527 has quit IRC15:37
crinkleyep15:37
*** pnavarro has quit IRC15:37
*** tqtran has joined #openstack-keystone15:38
*** samueldmq has joined #openstack-keystone15:39
*** ChanServ sets mode: +v samueldmq15:39
rderosecrinkle lbragstad: yeah, I think it's strange we're checking that the user is enabled at the plugin level (the method eventually gets called by mapped and password plugins)15:43
*** david-lyle has joined #openstack-keystone15:43
rderosecrinkle lbragstad: not sure I want to change it and didn't want to remove the check from the driver15:44
*** code-R has joined #openstack-keystone15:44
lbragstadrderose is there ever a case where the UserDisabled exception from the driver is raised instead of the one in the identity Manager()?15:44
*** ravelar159 has joined #openstack-keystone15:45
rderoselbragstad: I don't think so because it is based on sql backend and gets checked at password plugin15:45
*** adrian_otto has joined #openstack-keystone15:46
rderoselbragstad: while i'm checking during auth in the driver, the validation really happens in the sql model15:46
lbragstadrderose interesting - I wonder if we should remove that line that raises a UserDIsabled exception15:47
lbragstador push that validation from the identity manager into the driver()15:47
*** ninag has joined #openstack-keystone15:47
*** adrian_otto has quit IRC15:49
dstaneklbragstad: i'm not sure you want to push validation into the driver unless it truly is specific to that driver15:49
rderoselbragstad: like I said though, I'd don't believe the manager code is doing the validation, it's being called from the plugins15:50
lbragstadrderose sure - that makes sense15:50
*** nul0op has joined #openstack-keystone15:50
rderoselbragstad dstanek: disable inactive users is specific to that driver15:50
lbragstadrderose dstanek the tricky part that crinkle and I started tripping over was where the exception was being raised.15:51
rderoselbragstad: yeah, I'll dig into that this morning; push out a new patch soon.15:51
lbragstadrderose dstanek this is what we found - https://review.openstack.org/#/c/340074/29/keystone/identity/backends/sql.py15:51
patchbotlbragstad: patch 340074 - keystone - PCI-DSS Lockout requirements15:51
lbragstadrderose i started hacking on it locally to see if I could post a diff15:51
lbragstadbut I haven't gotten the AccountLocked exception to work yet (without displaying the programmer error message)15:52
*** brancaleone has joined #openstack-keystone15:54
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Password expires validation  https://review.openstack.org/33336015:55
rderoselbragstad: hmm... okay15:56
lbragstadrderose do those comments in https://review.openstack.org/#/c/340074/29/keystone/identity/backends/sql.py make sense?15:56
patchbotlbragstad: patch 340074 - keystone - PCI-DSS Lockout requirements15:56
*** adrian_otto has joined #openstack-keystone15:57
dstaneklbragstad: do you have a stack trace for the missing kwargs error?15:57
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Password expires validation  https://review.openstack.org/33336015:58
lbragstaddstanek yeah - in the comment https://review.openstack.org/#/c/340074/29/keystone/identity/backends/sql.py15:58
patchbotlbragstad: patch 340074 - keystone - PCI-DSS Lockout requirements15:58
nul0ophello guys. I was hit by https://bugs.launchpad.net/horizon/+bug/1297130 ... I did a mistake by removing the default project in an HP Helion openstack instance. project named 'service', I lost all communication since then and not able to connect to the Horizon portal.15:59
openstackLaunchpad bug 1297130 in OpenStack Dashboard (Horizon) "prevent default tenant deletion" [Wishlist,Confirmed]15:59
bretonsqlalchemy has events that are emitted on actions. Is there an event to listen to for selects that happen when Fk are accessed?16:00
bretonor just an event to listen to all selects?16:00
dstaneklbragstad: i don't see a stacktrace anywhere16:00
nul0opthe bug sched some light on a possible solution: fix the database by adding back missing rows. i tried to did it. fixed project table, assignment table for user admin and required roles. (taking time to use the correct id each time of course)16:00
nul0opbut still without success in restoring the console. I think i have to do it not only for admin user, but also for 'neutron', 'heat','cinder', ... users16:01
*** code-R has quit IRC16:01
*** brancaleone has quit IRC16:01
*** ninag has quit IRC16:01
nul0opanyone here knowledgeable about this N?16:01
rderoselbragstad: yeah, make sense. has to be something with how I'm logging the error16:02
dstaneklbragstad: rderose: i can't duplicate manually using the exception directly16:02
rderosehmm...16:04
rderosewhat the heck is happening then...16:04
dstanekhow do i reproduce with keystone.... just fail login too many times?16:04
*** jsavak has quit IRC16:04
*** jsavak has joined #openstack-keystone16:05
* lbragstad dstanek rderose looks like the programming error is thrown here - https://github.com/openstack/keystone/blob/9d54eb33c1d74ff39c947af6ff984ef2e0bf4be4/keystone/common/wsgi.py#L229-L23216:05
dstaneklbragstad: that code looks ok, the keys match the expected keys. what makes you think it is there?16:07
dstaneklbragstad: or are you saying the str(e) is what causes the error?16:07
*** itlinux has quit IRC16:13
lbragstaddstanek i'm not sure - i dropped into a debugger and noticed that the programming error is logged at that line16:13
lbragstadbecause I couldn't figure out when it was happening16:13
*** brancaleone has joined #openstack-keystone16:14
*** code-R has joined #openstack-keystone16:15
*** roxanaghe has joined #openstack-keystone16:17
dstaneklbragstad: my guess is that it's the str(e) - so whatever throws that exception isn't providing the correct kwargs16:18
lbragstaddstanek rderose the weird part is that when I debug it locally - I can see if rendered properly once, then the exception is thrown without any kwargs...16:19
lbragstadwhich is where the error is coming from I assume16:19
dstaneklbragstad: i'm trying to reproduce now too, but to better debug the source of the error set keystone.exception._FATAL_EXCEPTION_FORMAT_ERRORS = True16:19
dstanekthat will cause the error as soon as it happens and not wait for it to be rendered later16:20
lbragstaddstanek are you using apache or eventlet?16:20
lbragstader - keystone-wsgi-admin?16:20
dstanekapache...eventlet is gone16:20
dstaneklbragstad: i haven't gotten that far though... just created a test user and i'm in the process of locking it out16:21
*** roxanaghe has quit IRC16:21
dstaneklbragstad: rderose: the only way this should be possible is if there is an untested code path16:22
dstanekunit test would have caught this otherwise16:22
openstackgerritGage Hugo proposed openstack/keystone: Add schema validation to create service in v2  https://review.openstack.org/34696216:22
lbragstaddstanek you mean the only way for the `missing exception kwargs (programmer error)` to happen/16:23
*** KevinE has joined #openstack-keystone16:24
rderosedstanek: really? I thought it may have something to do with the SecurityError code here: https://github.com/openstack/keystone/blob/master/keystone/exception.py#L17616:24
lbragstadrderose specifically the _build_message() method?16:25
dstaneklbragstad: yes16:25
dstanekrderose: not sure i follow16:25
rderoseyeah16:25
rderosedstanek: this error is logged when the exception is thrown and the exception is based off of the SecurityError class16:27
lbragstadthe Error class also has a _build_message() method16:27
*** dritux has joined #openstack-keystone16:27
rderosedstanek: and I'm not exactly sure what _build_message is doing, but wondering if that is causing this16:27
dstanekrderose: i don't think it is logged when it is thrown16:27
lbragstadthe SecurityError._build_message() method just makes it more secure when logging16:28
rderoselbragstad: I see16:28
*** david-lyle has quit IRC16:28
*** dikonoor has joined #openstack-keystone16:29
*** ddieterly is now known as ddieterly[away]16:30
lbragstaddstanek rderose fwiw - if i set _FATAL_EXCEPTION_FORMAT_ERRORS = True I can't recreate the issue16:31
lbragstadhttps://github.com/openstack/keystone/blob/master/keystone/exception.py#L6316:31
*** roxanaghe has joined #openstack-keystone16:32
dstaneklbragstad: i don't see that error message when logging into a locked account16:32
lbragstaddstanek do you have _FATAL_EXCEPTION_FORMAT_ERRORS = False?16:33
*** slberger1 has joined #openstack-keystone16:33
dstanekoh wait lol....jas16:33
*** code-R_ has joined #openstack-keystone16:34
*** slberger has quit IRC16:34
lbragstadWhen I set _FATAL_EXCEPTION_FORMAT_ERRORS at False and lock a user out i hit https://github.com/openstack/keystone/blob/master/keystone/exception.py#L6116:35
lbragstadwhich explains when https://github.com/openstack/keystone/blob/master/keystone/exception.py#L66 is logged16:35
lbragstadbut in that case my kwargs = {} (which is where the KeyError comes from)16:36
lbragstadand my message variable is = u'The account is locked for user: 73e00ad54377426e88b91c9eebd7bba5'16:36
lbragstadwhich it looks like the substitution has already taken place16:37
lbragstadhttp://cdn.pasteraw.com/km3kq2jn1xs51s9656yft8915a9r7nc16:37
*** code-R has quit IRC16:37
rderoseah ha!  is it because SecurityError already did the substitution?16:39
*** dan_nguyen has joined #openstack-keystone16:39
*** roxanaghe has quit IRC16:39
lbragstadrderose possibly16:39
*** mvk has quit IRC16:39
dstaneki think i may have found a security problem in this patch16:40
lbragstadthen we should technically see the same thing with https://github.com/openstack/keystone/blob/master/keystone/exception.py#L214-L21616:40
dstaneknope...close, but i don't think a user can see different behviour with a good password vs. a bad one16:43
dstanekrderose: do we check for lockout *after* we validate password?16:43
rderoselbragstad: it has to be coming from SecurityError._build_message(...)16:43
rderosedstanek: no, before16:44
rderosedstanek: why?16:45
*** roxanaghe has joined #openstack-keystone16:45
dstanekrderose: that message only seems to appear in the log when i login to a locked account with a good password and not when i use a bad one16:47
rderosedstanek: hmm... that's interesting16:48
*** ddieterly[away] is now known as ddieterly16:48
lbragstaddstanek the programming error message only appears when you use a good password?16:48
rderosedstanek: http://paste.openstack.org/show/542663/16:49
dstaneklbragstad: pretty sure...i have so many auths happening that it's hard to say for sure :-(16:49
rderosedstanek: if account is locked, password check should never be reached16:49
dstanekfg16:50
dstaneklol16:50
lbragstadto recreate this i do:16:50
lbragstad- create new user16:50
lbragstad- create rc file with a bad password16:50
lbragstadand auth repeatedly16:50
lbragstadjust doing an `openstack token issue`16:50
drituxhello openstackers. help me, please.16:52
drituxWhen the horizon is configured for multi region, It is necessary to authenticate when you select another region16:52
drituxDoes anyone know a transparent solution. I don't need to re-authenticate in keystone.16:52
rderoselbragstad: I think the error is coming from here: https://github.com/openstack/keystone/blob/master/keystone/exception.py#L19316:52
rderosethe keyerror16:52
openstackgerritSteve Martinelli proposed openstack/keystone: [api] add blurb about experimental status  https://review.openstack.org/34794716:52
dstanekrderose: it is, but the question is why16:53
dstanekrderose: it appears to me that the exception is getting rendered twice some how16:55
*** roxanaghe has quit IRC16:55
lbragstaddstanek yes, that what I think too16:56
rderoselbragstad: if you are still looking at this, can you replace that line and just return _format_with_unicode_kwargs(message, kwargs)16:57
rderosethe line above16:57
rderosehttps://github.com/openstack/keystone/blob/master/keystone/exception.py#L19216:57
*** dan_nguyen has quit IRC16:58
*** gyee has joined #openstack-keystone17:03
*** ChanServ sets mode: +v gyee17:03
*** jsavak has quit IRC17:03
*** nul0op has quit IRC17:04
*** jsavak has joined #openstack-keystone17:04
lbragstadrderose yeah - one sec17:06
dstanekrderose: that doesn't fix it does it?17:07
rderosedstanek: not sure, my devstack is hosed17:08
dstaneki would not expect that to17:08
lbragstadrderose this? http://cdn.pasteraw.com/kdhxhvq2rn51g502jxrlsvlnnauiiqw17:09
dstanekoh, shit.....17:09
rderoselbragstad: yeah, but just return message17:10
lbragstadrderose like this? http://cdn.pasteraw.com/904j6bxyyobd2cbrt7xz0ezb04mnekg17:10
rderoselbragstad: yeah17:11
*** dan_nguyen has joined #openstack-keystone17:11
lbragstadrderose nope that didn't fix it17:11
lbragstadhttp://cdn.pasteraw.com/bwi1n1qu9fd2mh16ccfxnqsi6z6wmfl17:11
rderosehmm... yeah, if it's getting called twice, it wouldn't...17:12
rderosethx17:12
lbragstadnp17:12
*** ddieterly is now known as ddieterly[away]17:13
*** tesseract- has quit IRC17:13
*** ebalduf has joined #openstack-keystone17:13
*** Gorian_ has joined #openstack-keystone17:13
*** roxanaghe has joined #openstack-keystone17:15
*** links has joined #openstack-keystone17:15
*** sdake has quit IRC17:15
dstanekfound one interesting (maybe related error) that i'm going to push a patch for....we are using super in our exception module and exceptions are not new-style classes17:17
bretonstevemar: rderose: the bug with N queries for list users stopped to reproduce for me on master :(17:18
bretonstevemar: rderose: i even starting to think that it never reproduced17:18
rderosebreton stevermar: are you saying that you are unable to reproduce this in master17:19
*** spandhe has joined #openstack-keystone17:19
bretonstevemar: rderose: yep17:19
rderosebreton stevemar: it's because of this patch: https://review.openstack.org/#/c/327817/17:20
patchbotrderose: patch 327817 - keystone - Change LocalUser sql model to eager loading (MERGED)17:20
*** akscram has joined #openstack-keystone17:20
bretonrderose: yep17:20
rderosebreton stevemar: which wasn't in mitaka17:20
*** david-lyle has joined #openstack-keystone17:20
bretonrderose: so lets just backport it17:20
stevemarrderose: ahh17:20
stevemarrderose: breton i mentioned that in your review :P17:20
rderosebreton: agree17:20
rderosestevemar: missed that17:21
stevemarclick that backport button!17:21
bretoni've actually wrote a test17:21
bretonthat counts number of queries17:21
stevemarbreton: submit the test in a separate patch17:21
lbragstaddstanek rderose the interesting part is that the exception returned by the client is "The account is locked for user: 73e00ad54377426e88b91c9eebd7bba5 "17:22
stevemarrderose: breton, either of you want to backport this sucker? https://review.openstack.org/#/c/327817/ it doesnt backport automagically17:22
patchbotstevemar: patch 327817 - keystone - Change LocalUser sql model to eager loading (MERGED)17:22
lbragstadbut the logs say "Authorization failed. The account is locked for user: %(user_id)s"17:23
bretonstevemar: yep, i started to figure out why it doesn't work and... figured out that it works.17:23
stevemarbreton: :)17:23
rderosestevemar breton: I can do this (backport)17:23
*** TxGVNN has quit IRC17:23
*** david-lyle has quit IRC17:23
*** david-lyle_ has joined #openstack-keystone17:23
stevemarrderose: cool, just make sure to mention "Closes-Bug: 1606426" in the commit message17:24
openstackbug 1606426 in OpenStack Identity (keystone) mitaka "user list is much slower in mitaka and newton" [Critical,In progress] https://launchpad.net/bugs/1606426 - Assigned to Boris Bobrov (bbobrov)17:24
lbragstadso I wonder if the AccountLocked exception is being called once for raising the exception and once for logging it (or if that is even possible)?17:24
stevemarrderose: let me know if you need help backporting it17:24
*** david-lyle_ is now known as david-lyle17:24
stevemarrderose: i wrote scrappy notes on how to do it here: https://gist.github.com/stevemart/06ace005f82691435d0b#backporting-a-patch17:24
rderosestevemar: cool, thx17:25
*** david-lyle_ has joined #openstack-keystone17:25
rderosestevemar: what's this do? git review -x <patch #>17:25
rderosestevemar: I wouldn't have a patch number, just checkout stable mitaka, right?17:26
lbragstadrderose that cherry-picks a patch from gerrit to whatever branch you have locally17:26
lbragstadrderose you'd need to checkout stable/mitaka locally then cherry-pick the patch from gerrit (which merged to master i'm assuming)17:26
stevemarrderose: its the patch number you want to cherry pick17:26
stevemarlbragstad: correctamundo17:27
*** ebalduf has quit IRC17:27
rderosestevemar lbragstad: sorry, don't I just need to checkout stable mitaka, make the change and commit?17:27
* breton uses awesome `git ready` suggested by dolphm 17:27
lbragstadrderose it's very similar to `git review -d <patch #>` but -d will actually perform a checkout - which drops you on the exact point in time that patch was proposed17:28
stevemarrderose whatever works for you, i guess for a small change it's easy enough17:28
lbragstadrderose or use `git-ready`17:28
stevemarrderose: but for something 100s of lines..17:28
lbragstad`git-ready stable/mitaka` I think?17:28
lbragstadbreton is that ^ how you checkout stable branches?17:28
*** david-lyle has quit IRC17:29
openstackgerritBoris Bobrov proposed openstack/keystone: Test number of queries on list_users  https://review.openstack.org/34796717:29
bretonlbragstad: yep17:29
bretonlbragstad: without the '-'17:29
lbragstadbreton ah - nice.. I have a different bin name for it17:30
lbragstaddstanek rderose alright - i am going to break for lunch. Want to keep debugging this logging thing this afternoon?17:31
rderosesounds good17:31
*** ebalduf has joined #openstack-keystone17:31
rderosethx lbragstad and dstanek17:31
*** david-lyle_ has quit IRC17:34
*** david-lyle_ has joined #openstack-keystone17:34
stevemarbreton: so how many calls should it have?17:35
stevemarreferring to https://review.openstack.org/#/c/347967/1/keystone/tests/unit/test_backend_sql.py17:35
patchbotstevemar: patch 347967 - keystone - Test number of queries on list_users17:35
*** tonytan_brb has joined #openstack-keystone17:36
bretonstevemar: 917:37
*** browne has joined #openstack-keystone17:37
bretonif 'joined' is used instead of 'subquery' it becomes 6 or 7 (don't remember exactly)17:38
*** tonytan4ever has quit IRC17:38
*** dritux has left #openstack-keystone17:38
*** david-lyle_ has quit IRC17:42
bretonoh wow17:42
bretoni changed all `subquery` to `joined` and now there is only 1 query17:42
bretonand user_list takes 0.35217:43
samueldmqbreton: yep, question is whether 1 big join is going to be better than multiple direct queries17:44
samueldmqbreton: maybe a single can be better, even if it does multiple joins, but we'd have to test it17:44
*** slberger1 has quit IRC17:44
samueldmqbreton: that's very interesting though...17:44
*** dikonoor has quit IRC17:48
openstackgerritBoris Bobrov proposed openstack/keystone: Make fetching all foreign keys in a join  https://review.openstack.org/34797217:48
*** slberger has joined #openstack-keystone17:50
*** spandhe has quit IRC17:53
*** spandhe has joined #openstack-keystone17:53
*** spandhe has quit IRC17:54
*** TxGVNN has joined #openstack-keystone17:54
*** links has quit IRC17:54
*** marekd2 has quit IRC17:56
*** marekd2 has joined #openstack-keystone17:56
*** mvk has joined #openstack-keystone17:58
*** TxGVNN has quit IRC17:59
rderosestevemar breton: https://review.openstack.org/#/c/347975/17:59
patchbotrderose: patch 347975 - keystone (stable/mitaka) - Change LocalUser sql model to eager loading17:59
*** marekd2 has quit IRC18:01
stevemarbreton: propose the patch i suppose18:04
stevemaroh you did18:04
stevemardoh18:04
stevemarrderose: so one thing about backports18:06
stevemarrderose: it has to have the same change ID as the original18:06
stevemari'll tweak it real quick18:06
rderosestevemar: ah, okay thanks18:09
rderosestevemar: the original change id for stable/mitaka?18:10
*** jamielennox is now known as jamielennox|away18:10
stevemarrderose: yeah, the backport should match the change id from master18:10
stevemardolphm: take a look at https://review.openstack.org/#/c/347975/18:10
patchbotstevemar: patch 347975 - keystone (stable/mitaka) - Change LocalUser sql model to eager loading18:10
*** adrian_otto has quit IRC18:11
*** ddieterly[away] has quit IRC18:13
*** nisha_ has joined #openstack-keystone18:14
*** nishaYadav has quit IRC18:16
*** ddieterly has joined #openstack-keystone18:22
*** ayoung has quit IRC18:25
dolphmstevemar: +A cc- rderose18:25
dolphmrderose: next time you have a bug fix that should apply to a stable branch as well, be sure to propose a backport!18:26
lbragstaddstanek rderose i traced the `missing exception kwargs (programmer error)` here - https://hg.python.org/cpython/file/2.7/Lib/logging/__init__.py#l145618:29
lbragstadlooks like that is where it is actually logged18:29
rderosedolphm: are you referring to the original bug fix?18:30
dolphmrderose: yes18:30
lbragstaddstanek rderose http://cdn.pasteraw.com/dtrndze6enkkh30umoffk7kzq3n5s9x18:30
dolphmlbragstad: that sounds like an error from keystone.exception.Exception18:30
lbragstaddstanek rderose dstanek a bit more context - http://cdn.pasteraw.com/s941506uzfwbyo058a9rra8bz67nzse18:31
dolphmlbragstad: the keystone exception class you're using has required keyword arguments that you're not passing18:31
lbragstaddolphm but we seem to passing them in here - https://review.openstack.org/#/c/340074/29/keystone/identity/backends/sql.py18:32
patchbotlbragstad: patch 340074 - keystone - PCI-DSS Lockout requirements18:32
rderosedolphm: ah, to propose backport, I would add Mitaka potential to the commit message?18:32
lbragstadsee line 6218:32
dolphmrderose: not quite, mitaka-backport-potential would be a valid tag on the launchpad bug18:32
rderosedolphm: okay, cool18:32
dolphmrderose: but after the patch to master merges, cherry pick it to a stable branch with $ git checkout stable/mitaka && git review -X <review number from master>18:33
dolphmrderose: and then git-review that, after any conflict resolution18:33
dstanekdolphm: so i created a fix the removes use of super in keystone.exception, but i'm still seeing the error :-(18:33
rderosedolphm: I see18:33
dstanekjust got back from lunch so i'm going to start looking again18:34
*** jsavak has quit IRC18:34
dolphmdstanek: this is the error you're seeing https://github.com/openstack/keystone/blob/master/keystone/exception.py#L6618:34
dstanekdolphm: yes18:35
*** jsavak has joined #openstack-keystone18:35
dolphmoh, lance linked it18:35
dstanekdolphm: it looks like the object is created twice...just have to figure out why18:35
*** spandhe has joined #openstack-keystone18:36
lbragstaddstanek I was digging in the i18n stuff and oslo_log but I don't think those have anything to do with it18:36
dolphmdstanek: lbragstad: maybe remove that try/except -- you could be seeing a different KeyError18:36
dolphmdstanek: lbragstad: the code in the try block is much more complicated than it was when that try / except was written18:37
lbragstaddolphm you mean this? https://github.com/openstack/keystone/blob/master/keystone/exception.py#L59-L6718:38
dolphmlbragstad: yes18:38
dolphmlbragstad: maybe it's an unexpected keyerror in your case18:38
*** nisha_ has quit IRC18:39
dstanekdolphm: it's not. what seems to be happening is AccountLocked(user_id=...) is called and then shortly later it appears to be called again, but with the rendered string from the original18:39
*** nisha_ has joined #openstack-keystone18:39
dstanekalmost list AccountLocked(str(AccountLocked(user_id=...)))18:40
dstaneks/list/like/18:40
lbragstadwhen the programmer error message is logged - the message variable is the rendered string and the kwargs are empty18:40
dolphmlbragstad: what's the actual message you're seeing in the logs after that?18:41
lbragstaddstanek exactly - so the inner AccountLocked() is actually working properly18:41
lbragstaddolphm grabbing a trace18:41
dstaneklbragstad: yes18:41
dolphm"Authorization failed. The account is locked for user: %(user_id)s from 127.0.0.1"18:42
dstanekalso exceptions in exceptions seem to get swallowed somewhere18:42
lbragstaddolphm yes18:42
lbragstadhttp://cdn.pasteraw.com/oaglrgcvkeu8h628qz4r8txhx15ibf518:42
lbragstadfwiw - if I drop a break point here http://cdn.pasteraw.com/4tjasujkku80pw2wpxlyqdu67rtb9aw I hit the AccountLocked() thing twice18:43
lbragstadalmost exactly like what dstanek described18:43
*** ericksonsantos has quit IRC18:44
dolphmlbragstad: the "Authorization failed. " part of the error message makes it look like one exception is wrapping another, if that's what you mean18:44
*** tonytan_brb has quit IRC18:44
lbragstadhere are the variable states in each occurrence - http://cdn.pasteraw.com/pq6umrz0l0phjp2l9rkeg6wealmm0u118:46
*** slberger has quit IRC18:47
*** slberger has joined #openstack-keystone18:48
dstanekdolphm: the 'authorizaiton failed' is actually coming from keystone.common.wsgi18:49
dstanekit's just part of the log message18:49
dolphmdstanek: ah, that makes more sense18:50
*** jdennis has joined #openstack-keystone18:53
*** timcline has joined #openstack-keystone18:55
lbragstaddstanek we do raise the exception again in the notification module18:56
*** timcline_ has joined #openstack-keystone18:57
*** david-lyle_ has joined #openstack-keystone18:57
lbragstadhttps://github.com/openstack/keystone/blob/master/keystone/notifications.py#L489-L49418:57
dolphmlbragstad: L494? that's a blind raise18:57
dolphmlbragstad: it's just passing the object along, it shouldn't build a message18:58
dstaneklbragstad: actually i think that's it....that's where i am in rpdb right now18:58
lbragstaddstanek if you go a bit farther you'll end up in keysotne/common/wsgi.py:23018:59
*** timcline has quit IRC18:59
lbragstadwhich is where we except exception.Unauthorized and attempt to log a warning about failed auth18:59
lbragstade19:00
*** ebalduf has quit IRC19:00
lbragstadin that case - e.message is u'The account is locked for user: 73e00ad54377426e88b91c9eebd7bba5'19:00
dolphmlbragstad: but it only logs19:00
lbragstadwhich is already substituted (?)19:00
lbragstaddolphm right - I think we only see this error in the logs19:01
dolphmlbragstad: that's just catching the AccountLocked instance and rendering it as a string19:01
dolphmlbragstad: that's the intent in keystone.exception19:01
dolphmalthough, as the author of the (programmer error) message, this really, really doesn't smell like the intended use case19:01
dstanekdolphm: lbragstad: ok, the issue is oslo_i18n19:03
dstanekit recreates the object19:03
dstaneksee http://paste.openstack.org/show/542682/ _reconstruct19:03
*** slberger has quit IRC19:04
dolphmdstanek: wat19:05
lbragstaddstanek what is `param` in copy.deepcopy(param) ?19:05
dolphmcopy ... deepcopy ... an exception?!19:05
dolphmlbragstad: dstanek: copy.deepcopy https://github.com/openstack/oslo.i18n/blob/master/oslo_i18n/_message.py#L219-L22519:06
*** david-lyle_ is now known as david-lyle19:07
lbragstadhttp://cdn.pasteraw.com/2yv2uk7fu1vc6290sk8qwdk70afiell19:08
lbragstadyeah - it's an exception19:08
*** fifieldt has quit IRC19:08
lbragstadexception.Unauthorized specifically19:08
*** haplo37__ has joined #openstack-keystone19:09
dstanekthat's like super awesome fail19:11
lbragstadthe params here end up being https://github.com/openstack/oslo.i18n/blob/master/oslo_i18n/_message.py#L21619:11
dolphmlbragstad: where did THAT exception get created?19:11
lbragstad{'exception': Unauthorized(u'The request you have made requires authentication.',), 'remote_addr': '127.0.0.1'}19:12
lbragstaddolphm I think that Unauthorized exception is the same one that is excepted here - https://github.com/openstack/keystone/blob/9d54eb33c1d74ff39c947af6ff984ef2e0bf4be4/keystone/common/wsgi.py#L22819:13
lbragstadbut I can't be sure19:13
lbragstadwell - i'm not sure yet19:13
*** jsavak has quit IRC19:14
*** samueldmq has quit IRC19:15
*** slberger has joined #openstack-keystone19:15
*** tonytan4ever has joined #openstack-keystone19:17
*** brancaleone has quit IRC19:17
*** fifieldt has joined #openstack-keystone19:18
*** michauds has quit IRC19:20
*** ddieterly is now known as ddieterly[away]19:22
*** nisha_ has quit IRC19:22
*** michauds has joined #openstack-keystone19:22
*** sdake has joined #openstack-keystone19:25
*** jsavak has joined #openstack-keystone19:27
*** ebalduf has joined #openstack-keystone19:29
openstackgerritDolph Mathews proposed openstack/keystone: Add token feature support matrix to documentation  https://review.openstack.org/31611819:29
*** jsavak has quit IRC19:32
*** roxanaghe has quit IRC19:39
*** ebalduf has quit IRC19:41
*** gordc has quit IRC19:41
*** sdake has quit IRC19:43
lbragstaddolphm dstanek rderose crinkle this seems to fix the (programming error) for me locally - http://cdn.pasteraw.com/7d38iizi836gvfyk4ncuq6x6m7nkgah19:46
dolphmlbragstad: how about unicode(e) instead of e?19:47
*** ddieterly[away] is now known as ddieterly19:47
lbragstaddolphm let me try that19:47
lbragstaddolphm yep - http://cdn.pasteraw.com/bxtpgziuj7cbq4gqickwu9el2ymiouw works too19:48
lbragstadhere are the logs with that patch19:48
crinklelbragstad: neat19:48
dolphmlbragstad: the .message will throw it's own deprecation warnings in ... some ... version of python19:48
dolphmlbragstad: but, the fix actually makes sense! good eye19:49
lbragstadhttp://cdn.pasteraw.com/a5dyaifypzq3x6ig4puly7kuri8hnfs19:49
*** slberger has quit IRC19:49
*** ebalduf has joined #openstack-keystone19:50
*** ntpttr- has quit IRC19:50
*** ntpttr- has joined #openstack-keystone19:51
*** slberger has joined #openstack-keystone19:53
*** sdake has joined #openstack-keystone19:53
lbragstadalright - i'm going to refill coffee19:54
*** jsavak has joined #openstack-keystone19:54
*** afred312 has joined #openstack-keystone19:56
*** jsavak has quit IRC19:59
*** jsavak has joined #openstack-keystone19:59
dstanekthis feels like a bandaid20:02
bknudsonkeystone is a pile of bandaids.20:03
dstanekin the course of using an object how it's meant to be used we have a situation where a hard to debug error it raised20:03
*** ebalduf has quit IRC20:03
bknudsonat least it's not spaghetti code.20:03
stevemarbknudson: let me get the guaze20:04
dstanekbknudson: it's at least close20:04
stevemardstanek: depends on the module :P20:04
*** brancaleone has joined #openstack-keystone20:09
*** roxanaghe has joined #openstack-keystone20:09
lbragstaddstanek it looks like this only happens when we have an exception and we try to log it20:12
lbragstaddstanek shouldn't we be passing the string that we want to log anyway?20:12
dstaneklbragstad: maybe? but this seems to be a common pattern based on how exceptions are supposed to work20:15
dstaneklbragstad: trying to see why olso_i18n is doing that copying20:16
*** tangchen has quit IRC20:17
dstaneklbragstad: i have an alternative fix that i'm trying to evaluate20:17
lbragstadok20:18
*** michauds has quit IRC20:18
*** tangchen has joined #openstack-keystone20:19
*** ericksonsantos has joined #openstack-keystone20:20
dstanekdo we have tests for internationalization right now?20:21
lbragstaddstanek that's a good question20:21
*** michauds has joined #openstack-keystone20:27
lbragstaddstanek it doesn't look like it20:27
*** aswadr_ has quit IRC20:31
stevemardolphm: around-ish?20:32
*** adrian_otto has joined #openstack-keystone20:33
*** MadOtis has joined #openstack-keystone20:33
lbragstaddstanek let me know when/if you get a patch up for the exception logging thing - i'm curious to see your fix20:36
MadOtisHello, all... I'm having a hard time with wht I believe may be a keystone problem.  I'm trying to install swift on a new Centos 7 cluster and so far, all services are running fine.  When I get to install swift, I am getting an error with the validation of the swift services.20:37
dstaneklbragstad: just trying to reproduce the error in a test20:38
MadOtisWhen executing the "swift stat" validation, I get an error 503 returned back.  The swift logs show authentication errors, and I've tripple-checked the swift proxy configuration and shared it with the gang in the #os-swift channel.20:39
MadOtisThey seem to think the issue may be coming from keystone.20:39
MadOtisThe error I'm getting is: Account HEAD failed: http://controller:8080/v1/AUTH_bc82ecd267e34d91bc775867adb94bc7 503 Service Unavailable20:40
notmynameMadOtis: wait. you said you were getting a 401. I thought we fixed the 50320:40
*** roxanaghe has quit IRC20:41
MadOtisnotmyname: there were some service issues that were resolved according to the logs.  But this problem still remains.20:42
MadOtisThe services had some issues that I was able to work out in the #os-swift channel, so I'm trying to fix this remaining issue.20:43
MadOtisHere is a paste of what is in the logs, now: http://paste.openstack.org/show/542692/20:43
dstanekMadOtis: is the 503 coming from swift or keystone?20:45
*** adrian_otto has quit IRC20:45
MadOtisdstanek: I believe it's coming from swift, but I was told in the swift channel that it could be keystone.20:46
*** sdake has quit IRC20:46
*** adrian_otto has joined #openstack-keystone20:46
openstackgerritGage Hugo proposed openstack/keystone: Add schema validation to create service in v2  https://review.openstack.org/34696220:48
dstanekMadOtis: do you have access to the logs to check definitively?20:49
dstaneklbragstad: hmmm....i don't know how to reproduce this in a test20:49
*** ebalduf has joined #openstack-keystone20:49
lbragstaddstanek you'd have to capture the logs wouldn't you?20:50
MadOtis+dstranek: Yes, here is a paste from the controller and the 2 object nodes grepped on one of the UID's passed in: http://paste.openstack.org/show/542693/20:51
dstanekmordred: those 503s are definitly coming from swift. do they think that keystone is cause swift to 503?20:53
MadOtisI'm talking to notmyname in swift, now.  Thank you20:55
*** ayoung has joined #openstack-keystone20:55
*** ChanServ sets mode: +v ayoung20:55
dstanekMadOtis: np20:55
dstaneklbragstad: shouldn't have to because that boolean is set for the tests so an exception should be raised20:56
*** roxanaghe has joined #openstack-keystone21:00
openstackgerritBilly Olsen proposed openstack/keystone: Maintain ordered list for KVS token persistence  https://review.openstack.org/34804021:01
*** MadOtis has left #openstack-keystone21:01
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Password expires validation  https://review.openstack.org/33336021:04
mordreddstanek: aroo?21:04
* mordred reads21:04
mordreddstanek: no clue - notmyname is a much better human to talk to21:06
dstanekmordred: oops...it looks like i invoked you on accident21:07
mordred*phew*21:07
*** clenimar has quit IRC21:08
dstanekmordred: i was helping MadOtis and i think i had a tab completion failure21:09
*** raildo has quit IRC21:09
*** gagehugo has quit IRC21:09
mordreddstanek: I was just worried that I was supposed to know something21:10
*** pauloewerton has quit IRC21:11
*** roxanaghe has quit IRC21:12
*** ebalduf has quit IRC21:13
*** roxanaghe has joined #openstack-keystone21:15
*** jamielennox|away is now known as jamielennox21:17
bknudsonjamielennox is back.21:17
* jamielennox is still in san jose21:17
bknudsonstill in meetings?21:18
jamielennoxbknudson: meetings are mostly done, watching and helping with some training today, ansible stuff tomorrow then home on saturday21:19
bknudsonjamielennox: are you at almaden research lab?21:19
jamielennoxbknudson: i'm watching spencer try to convince people to run from master21:19
jamielennoxbknudson: umm, i don't think so, the one at the very top of Nth 1st st21:19
bknudsonjamielennox: that isn't an easy sell.21:19
jamielennoxhe's pretty good, though talks quite fast, at least most people have some openstack experience21:20
bknudsonjamielennox: who are you presenting to now?21:20
jamielennoxbknudson: i don't think there's one group, there's a few people working on octavia stuff, then some IBM stuff i've never heard of that is supposed to be in cloud :(21:21
openstackgerritLance Bragstad proposed openstack/keystone: Don't log exception objects  https://review.openstack.org/34804721:22
lbragstaddstanek my hack-tastic fix ^21:22
bknudsonjamielennox: when I saw you signing on at 4pm I thought that meant you were in oz.21:22
jamielennoxbknudson: next week, trying to put off the flight for as long as i can21:23
*** david-lyle has quit IRC21:25
dstaneklbragstad: i figured out my testing issue21:43
openstackgerrithenry-nash proposed openstack/keystone-specs: Add rolling upgrade steps to keystone-manage  https://review.openstack.org/33768021:43
lbragstaddstanek yeah?21:43
henrynashdstanek, btopol: henry-nash proposed openstack/keystone-specs: Add rolling upgrade steps to keystone-manage  https://review.openstack.org/33768021:43
henrynashtopol: henry-nash proposed openstack/keystone-specs: Add rolling upgrade steps to keystone-manage  https://review.openstack.org/33768021:44
*** ravelar159 has quit IRC21:46
*** spandhe has left #openstack-keystone21:50
lbragstaddstanek what was the issue?21:50
*** tonytan4ever has quit IRC21:51
dstaneklbragstad: crazyness with the debug-mode/logging/ect21:51
dstanekworking on docs for my patch now21:51
*** haplo37__ has quit IRC21:52
openstackgerrithenry-nash proposed openstack/keystone-specs: Add rolling upgrade steps to keystone-manage  https://review.openstack.org/33768021:54
*** adriant has joined #openstack-keystone21:55
*** ddieterly is now known as ddieterly[away]22:01
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Lockout requirements  https://review.openstack.org/34007422:01
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Lockout requirements  https://review.openstack.org/34007422:01
*** adrian_otto1 has joined #openstack-keystone22:06
*** KevinE has quit IRC22:06
*** adrian_otto1 has quit IRC22:07
*** adrian_otto has quit IRC22:07
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Lockout requirements  https://review.openstack.org/34007422:08
*** kswiatek_ has joined #openstack-keystone22:11
openstackgerritJamie Lennox proposed openstack/keystone: Implement Views and convert credentials  https://review.openstack.org/33542322:13
*** kswiatek has quit IRC22:13
*** jsavak has quit IRC22:20
*** david-lyle has joined #openstack-keystone22:22
*** edmondsw has quit IRC22:25
*** david-lyle has quit IRC22:25
*** david-lyle has joined #openstack-keystone22:25
*** ddieterly[away] is now known as ddieterly22:25
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Lockout requirements  https://review.openstack.org/34007422:26
*** michauds has quit IRC22:30
*** ddieterly has quit IRC22:34
openstackgerritRon De Rose proposed openstack/keystone: PCI-DSS Lockout requirements  https://review.openstack.org/34007422:37
*** jamielennox is now known as jamielennox|away22:45
*** slberger has left #openstack-keystone22:48
*** david-lyle has quit IRC22:50
*** david-lyle_ has joined #openstack-keystone22:50
*** timcline_ has quit IRC22:55
*** Gorian_ has quit IRC22:59
*** david-lyle_ has quit IRC23:01
*** sdake has joined #openstack-keystone23:17
*** sdake has quit IRC23:25
*** ravelar159 has joined #openstack-keystone23:26
openstackgerritAdrian Turjak proposed openstack/keystone: TOTP auth not functional in python3  https://review.openstack.org/34808123:26
*** ravelar159 has quit IRC23:30
*** bill_az has joined #openstack-keystone23:38
*** chlong has quit IRC23:38
*** ddieterly has joined #openstack-keystone23:42
*** ddieterly has quit IRC23:42
*** nkinder has quit IRC23:43
*** ddieterly has joined #openstack-keystone23:45
openstackgerritDavid Stanek proposed openstack/keystone: WIP: Adds test for SecurityError's translation behavior  https://review.openstack.org/34808523:46
openstackgerritDavid Stanek proposed openstack/keystone: WIP: Adds a custom deepcopy handler  https://review.openstack.org/34808623:46
dstaneklbragstad: ^23:46
openstackgerritRon De Rose proposed openstack/keystone: Test number of queries on list_users  https://review.openstack.org/34796723:53
dstanekadriant: just responded on your review. let me know if you have any questions. i may be heading to the gym soon, but i'll be around23:54
adriantHey, main question is one about the unittests23:55
adriantcurrently, by setting the password_totp as default in the cfg file, ALL the tests run with it as the password auth23:56
dstanekadriant: besides your new unit tests what did you want to run?23:56
adriantwhich confirms that it works exactly as intended as a replacement23:56
*** code-R_ has quit IRC23:56
openstackgerritRon De Rose proposed openstack/keystone: Make fetching all foreign keys in a join  https://review.openstack.org/34797223:56
adriantif not, then we need to write a lot more tests to just confirm that, which would be silly.23:56
dstanekadriant: what tests are missing to confirm that?23:57
adriantwhen there are already a ton of tests which validate the password auth23:57
dstaneki think what you have is probably enough to cover the usecases. are there cases you don't think are covered?23:57
*** adu has joined #openstack-keystone23:57
adriantActually... let me test something. I have a feeling with the cfg unchanged my unit tests fail as they would instead run against the old plugin23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!