Tuesday, 2016-04-12

*** mpanetta_ has joined #openstack-zaqar00:29
*** mpanetta_ has quit IRC00:30
*** mpanetta_ has joined #openstack-zaqar00:30
*** Qiming has quit IRC00:38
*** mpanetta_ has quit IRC00:43
*** mpanetta_ has joined #openstack-zaqar00:44
*** mpanetta_ has joined #openstack-zaqar00:44
wanghaomorning, everyone~01:11
wanghaoflwang: hi, feilong, this patch https://review.openstack.org/#/c/286433/ may need you to add +1 again for workflow, seems it didn't merge master now...01:12
openstackgerritwangxiyuan proposed openstack/python-zaqarclient: Add update queue function in v2  https://review.openstack.org/29436801:13
wanghaoflwang: btw, xiyuan and I have some summaries about the differences between aliyun's mns and zaqar and what we can do, I will make a list today later.01:15
*** mpanetta_ has quit IRC01:16
openstackgerritwanghao proposed openstack/zaqar: Show default attributes for queue  https://review.openstack.org/28643301:20
flwangwanghao: awesome01:24
flwangwanghao: did you do a rebase or just upload a new patchset?01:26
wanghaoflwang: yes, and remove the depends-on.01:26
wanghaoflwang: rebase too.01:27
flwangok, cool01:27
*** Qiming has joined #openstack-zaqar01:34
flwangwanghao: in summary, is there a big gap comparing with aliyun?01:36
flwangi think we're in good shape as for the messaging part01:36
flwangbased on my review01:36
flwangbut for notification part, our notification format need to be improved01:37
*** kgriffs is now known as kgriffs|afk02:11
wanghaoflwang: not big gap, some details I think we can improve our Zaqar.02:19
wanghaoflwang: for messaging, I feel two places we can thank about, for notification, we found three points we can improve.02:22
flwangwanghao: awesome, looking forward to details02:25
wanghaoflwang: sure02:26
*** mpanetta_ has joined #openstack-zaqar02:38
*** flwang1 has joined #openstack-zaqar02:42
*** mpanetta_ has quit IRC02:46
*** akanksha_ has joined #openstack-zaqar03:23
*** achanda has joined #openstack-zaqar03:49
*** Kevin_Zheng has joined #openstack-zaqar03:51
*** achanda has quit IRC04:05
*** rcernin has joined #openstack-zaqar04:52
*** flwang1 has quit IRC05:02
*** akanksha_ has quit IRC06:17
*** achanda has joined #openstack-zaqar06:23
*** tesseract has joined #openstack-zaqar06:24
*** tesseract is now known as Guest1511506:24
*** khushbu_ has joined #openstack-zaqar07:23
*** khushbu_ has quit IRC08:46
*** khushbu has joined #openstack-zaqar08:58
*** khushbu has quit IRC09:06
*** khushbu has joined #openstack-zaqar09:07
*** khushbu__ has joined #openstack-zaqar09:15
*** khushbu has quit IRC09:15
*** openstackgerrit has quit IRC09:17
*** openstackgerrit has joined #openstack-zaqar09:17
*** khushbu__ has quit IRC09:26
*** shu-mutou is now known as shu-mutou-AFK09:35
*** openstackstatus has quit IRC09:57
*** openstack has joined #openstack-zaqar09:58
*** openstackstatus has joined #openstack-zaqar10:00
*** ChanServ sets mode: +v openstackstatus10:00
*** achanda has quit IRC10:08
*** Qiming has quit IRC10:14
*** achanda has joined #openstack-zaqar10:38
*** achanda has quit IRC10:47
*** khushbu has joined #openstack-zaqar10:50
*** khushbu has quit IRC10:57
*** achanda has joined #openstack-zaqar11:08
*** achanda has quit IRC11:12
*** Qiming has joined #openstack-zaqar11:22
*** openstack has quit IRC12:04
*** openstack has joined #openstack-zaqar12:05
wanghaoflwang: hi, there is summary about the difference between MNS and Zaqar, plz have a look: http://paste.openstack.org/show/493777/12:40
ryansbwanghao: I am not flwang, but that looks really handy, thanks for doing the research :)12:42
Eva-iryansb: Hello. I want your opinion. Look at my last comment on this patch: https://review.openstack.org/#/c/294368/ and wxy's replies. Should we pre-create queue in API v2 in the client, like in API v1 in the client? Also here's my discussion with flwang about it, we have different points of view: http://eavesdrop.openstack.org/irclogs/%23openstack-zaqar/%23openstack-zaqar.2016-04-07.log.html13:08
ryansbsure thing13:09
Eva-iryansb: nice =)13:09
ryansbour logs really need a filter so it doesn't record 1 billion join/quit messages13:17
klambrecEva-i, It seems to me that Zaqar completely ignores the X-Project-Id header provided in a keystone setup, all requests are processed against the requester's Primary Project, this seems to match with https://bugs.launchpad.net/zaqar/+bug/1544328 - Am I right in assuming that this header is in the API but is basically completely unimplemented ?13:24
openstackLaunchpad bug 1544328 in zaqar "Zaqar doesn't require X-PROJECT-ID header in requests (noauth)" [Undecided,New] - Assigned to Eva Balycheva (ubershy)13:24
Eva-iklambrec: as I know, when Zaqar is configured to use Keystone, X-Project-Id header provided by the user is always ignored, because Zaqar takes X-Project-Id header from Keystone itself based on the X-Auth-Token header provided by the user.13:27
Eva-iklambrec: if it wasn't implemented like that, I think, a single user could access messages/queues/subscriptions of any project, which is bad. Of course it doesn't matter when there's no authentication.13:30
klambrecWell not quite, in Keystone you have a Primary Project, but can be assigned roles in any other projects.13:31
Eva-iklambrec: but when there's authentication, we shouldn't allow the user to use any X-Project-ID header.13:31
klambrecObviously if in Keystone I have not been mapped a member of another Project, I should not get access, but when Ive been granted membership of some secondary Projects, I should be able to access those.13:32
Eva-iklambrec: aha, I see. I didn't know the user can be associated with multiple projects in keystone.13:34
Eva-iklambrec: so better behavior of Zaqar would be: not ignore, but accept the X-Project-ID header provided by the user, but check if it's associated with the token provided, right? Because the user can have access to multiple projects, right?13:38
Eva-iklambrec: and if no X-Project-ID header is provided, but only token, take primary project from keystone?13:39
klambrecYes I think that would be ideal.13:40
klambrecI *think* that a token is only valid for one Project at a time, so if a user has access to multiple projects, he will need to get mulitiple tokens. But I'm not 100% sure on that one.13:41
klambrecNever really submitted anything to Open Stack before, is it worth to create a bug for this, or it will it get duped to yours anyway ?13:42
*** ametts has joined #openstack-zaqar13:43
*** khushbu has joined #openstack-zaqar13:45
Eva-iklambrec: "token is only valid for one Project at a time" if this is true, Zaqar works good now and we must keep the current implementation, I think.13:47
Eva-iklambrec: a bit later I'll ask people in keystone chat to make sure13:48
klambrecEva-i, well to be clear : Zaqar ignores the Project ID inside the token, it actually seems to get the Primary Project from Keystone and use that.13:49
*** amitgandhinz has joined #openstack-zaqar13:49
klambrecSo my primary project is X, but I have permissions on Project Y, I request & get a token for Project Y, use that token with Zaqar & specify the X-Project-Id as project Y ... my requests still hit project X.13:50
klambrecI think that's wrong, or well, up for improvement :)13:50
Eva-iklambrec: aha, I see, it really seems wrong, please create a bug report for this. I'll work on it later.13:53
Eva-iklambrec: and thanks =)13:53
klambrecEva-i, , also for your existing bug, so this behavior with noauth, I've seen that the v1.1 API DOES expect the X-Project-Id in place, but only sometimes, I think it was inside the message functions. Some generic requests, listing queues etc.. do not require it. Either way, quite inconsistent.13:54
klambrecI'll see if I can reproduce exactly what it was and update your bug.13:54
*** khushbu has quit IRC13:55
*** jhesketh has left #openstack-zaqar13:56
Eva-iklambrec: my bug report is for Zaqar configured to not use authentication and the problem there is different from yours. I think a new bug report should be created.13:59
klambrecEva-i, I know, I agree they are different problems.14:00
klambrecBut I was testing Zaqar with noauth last week as well, and ran into similar observations.14:00
Eva-iklambrec: that's strange. In noauth x-project-id header is never ignored as I know.14:02
klambrecI mean similar to yours. In noauth, there are no project ids of course, so Zaqar will accept anything. That's ok, but I noticed that some requests are accepted without X-Project-Id, while other request types DO require you to provide some X-Project-Id14:04
*** khushbu has joined #openstack-zaqar14:04
klambrecAnyway, I will retest it later and update your bug with what I know.14:05
Eva-iklambrec: I might be wrong, but I think some resources in Zaqar are shared amongst project ids, for example pools and flavors, so maybe it's okay that they don't require project id. Messages, queues and subscriptions resources are different and they definitely should require project id. Also ping or health requests also don't require project id and I think it's okay.14:12
Eva-iklambrec: if you think something is strange, of course update bug or leave a comment, it would be nice.14:14
klambrecOk, thanks for the feedback. I seem to have found that in a keystone auth scenario, even a ping requires a valid auth token i.e.. but I need to test more and make sure it's not a problem on my end.14:15
*** khushbu has quit IRC14:24
Eva-iklambrec: It's okay for Zaqar to require valid token for ping request in keystone scenario. It's not because Zaqar wants to get x-project-id from Keystone by using token, but because it just needs to validate access. Ping is same for all clients, no matter which project ids are associated with users.14:30
klambrecWell it causes some problems for i.e. HAProxy which just wants to send a simple HTTP request to check if Zaqar is alive, it has no understanding of project ids. But I'm already discussing that one with flwang .14:32
Eva-iklambrec: For example, in case the user wants to send messages to Zaqar, not only access is validated, but x-project-id is taken from Keystone by token. Because available messages are different for each x-project-id.14:32
klambrecOther Open Stack components seem to accep that.14:32
ryansbhrm, that's a good point.14:32
*** flwang has quit IRC14:32
ryansbOur ping endpoint doesn't need any project info really, though doing it that way could mean pings "work" when the keystone backend is degraded/down14:33
*** flwang has joined #openstack-zaqar14:36
klambrecAgreed, there's no ideal approach there; maybe you could send a similiar ping to keystone as well and only respond 204 No Content if that returns successful as well to increase the meaningfulness.14:36
klambrecOr well other components must have considered this one already at lenght, probably best to get some feedback there.14:36
Eva-iklambrec: our API v2 uses policy.json. With this file you can grant access to anyone to make PING requests.14:36
klambrecHaa ! I hadn't thought of that. Maybe that's the answer.14:37
Eva-iklambrec: zaqar policy.json is located in /etc/zaqar/ directory14:37
ryansboh, well there you have it14:38
ryansbthanks Eva-i14:38
Eva-iklambrec: according to this manual it's possible to grant access to anyone: http://docs.openstack.org/kilo/config-reference/content/policy-json-file.html, but I haven't tried.14:38
klambrecThanks indeed, I'll try that.14:38
Eva-iklambrec: I hope with this instruction it's possible to allows anybody access, not only all users registered in Keystone.14:39
Eva-i*to allow14:40
Eva-iif it will not work, perhaps we need to think about another solution, for example, make Zaqar not require token on ping request.14:42
wxyklambrec: Eva-i: There are two kinds of token: unscoped and scoped14:44
wxyUsually, we use the scoped token out of Keystone. And then  the token contains the project id.14:47
wxySo IMO, the behavior in zaqar now looks ok. or maybe there are bugs in some API. klambrec, you'd better create a bug.I'll take a look at it tomorrow and I guess I could help a little. :)14:51
klambrecShall do.14:55
*** ametts has quit IRC14:59
Eva-iryansb: hey, I answered to you in this patch: https://review.openstack.org/#/c/29436815:12
Eva-iryansb: this is my last argument after thinking.15:12
ryansbEva-i: lol! "queue = cli.queue('somequeue', auto_create=True, force_create=False, really_create=True)"15:14
ryansbyou're the best15:14
*** kgriffs|afk is now known as kgriffs15:15
Eva-ihehe15:15
*** kgriffs is now known as kgriffs|afk15:15
*** khushbu has joined #openstack-zaqar15:17
*** openstackgerrit has quit IRC15:18
*** openstackgerrit has joined #openstack-zaqar15:18
*** itisha has joined #openstack-zaqar15:21
*** achanda has joined #openstack-zaqar15:25
*** kgriffs|afk is now known as kgriffs15:30
*** itisha has quit IRC15:31
*** itisha has joined #openstack-zaqar15:33
Eva-iwxy: ryansb: okay, let's not pre-create queue in metadata(). The patch is almost good now, except one little mistake. After it will be fixed, I'll mark it +2. ;)15:37
*** achanda has quit IRC15:38
*** fesp has joined #openstack-zaqar15:43
*** fesp has quit IRC15:45
*** mpanetta has joined #openstack-zaqar16:05
*** Qiming has quit IRC16:22
*** achanda has joined #openstack-zaqar16:25
*** flwang has quit IRC16:29
*** achanda has quit IRC16:30
*** flwang has joined #openstack-zaqar16:33
*** david_cu has joined #openstack-zaqar16:39
*** khushbu has quit IRC16:44
*** kgriffs is now known as kgriffs|afk16:45
*** kgriffs|afk is now known as kgriffs16:45
*** Guest15115 has quit IRC16:55
*** david_cu has quit IRC17:10
*** davideag_ has quit IRC17:28
*** davideagnello has joined #openstack-zaqar17:32
*** achanda has joined #openstack-zaqar17:34
klambrecI've created a bug for the OPTIONS ping. Accessing secondary Projects works fine though, my mistake.17:38
*** ametts has joined #openstack-zaqar17:45
*** flwang1 has joined #openstack-zaqar17:45
flwang1morning/evening, guys17:47
*** rcernin has quit IRC17:53
*** Eva-i has quit IRC17:58
openstackgerritFei Long Wang proposed openstack/zaqar: Make sure use IPv6 sockets for Zaqar in IPv6 environment  https://review.openstack.org/30480017:58
*** Eva-i has joined #openstack-zaqar17:59
*** david_cu has joined #openstack-zaqar18:21
*** achanda has quit IRC18:23
*** kukacz has quit IRC18:24
openstackgerritMerged openstack/zaqar: Show default attributes for queue  https://review.openstack.org/28643318:42
*** david_cu has quit IRC18:48
openstackgerritFei Long Wang proposed openstack/zaqar: Fix auth when accessing "/"  https://review.openstack.org/30481718:56
*** ametts has quit IRC18:58
openstackgerritFei Long Wang proposed openstack/zaqar: Make sure use IPv6 sockets for Zaqar in IPv6 environment  https://review.openstack.org/30480019:01
openstackgerritFei Long Wang proposed openstack/zaqar: Fix auth issue when accessing root path "/"  https://review.openstack.org/30481719:02
flwang1klambrec: i have fixed your haproxy issue, pls try it https://review.openstack.org/30481719:03
*** achanda has joined #openstack-zaqar19:05
*** achanda has quit IRC19:05
*** david_cu has joined #openstack-zaqar19:09
*** david_cu has quit IRC19:10
*** david_cu has joined #openstack-zaqar19:17
*** david_cu has quit IRC19:29
*** david_cu has joined #openstack-zaqar19:33
*** flwang1 has quit IRC19:34
*** david_cu has quit IRC19:34
*** david_cu has joined #openstack-zaqar19:43
*** tqtran has joined #openstack-zaqar20:00
*** mpanetta has quit IRC20:55
*** ametts has joined #openstack-zaqar21:06
*** flwang1 has joined #openstack-zaqar21:23
*** flwang1 has quit IRC21:37
*** amitgandhinz has quit IRC21:38
*** amitgandhinz has joined #openstack-zaqar21:40
*** amitgandhinz has quit IRC21:42
*** david_cu has quit IRC21:46
*** flwang1 has joined #openstack-zaqar22:01
flwangEva-i: ping22:08
klambrecflwang, yes that works beautifully now.22:08
flwangklambrec: awesome22:09
Eva-iflwang: hello22:09
flwangklambrec: i will get it in and backport to mitaka22:09
flwangEva-i: can you help review the top 3 commits ? https://review.openstack.org/#/q/project:openstack/zaqar22:09
flwangEva-i: and this one https://review.openstack.org/#/c/297695/22:10
flwanghttps://review.openstack.org/29693722:10
flwangsorry for the pushing ;)22:10
klambrecflwang, thanks !22:12
flwangklambrec: anytime, sir22:12
Eva-iflwang: oki22:14
Eva-iflwang: should I prioritize top 3 commits?22:15
flwangEva-i: the two +2ed patches should be the low-hanging-fruit22:15
flwangbut i would highlight the HAproxy issue and the ipv6 patch22:16
flwangup to you :)22:16
flwangryansb: vkmc: flaper87: don't be lazy before summit ;)   https://review.openstack.org/#/q/project:openstack/zaqar+status:open22:17
Eva-iflwang: okay, I'll try to review 1-3 patches and go to sleep22:18
flwangEva-i: oh, sorry, i'm not pushing you to review it right now22:19
flwangi know it could be late for you22:20
Eva-iflwang: nothing to sorry, it's okay22:20
flwang:)22:20
openstackgerritMerged openstack/zaqar-specs: Make queues lazy in subscriptions  https://review.openstack.org/28418022:26
*** klambrec has quit IRC22:27
*** ametts has quit IRC22:37
Eva-iflwang: how do you test a patch like this: https://review.openstack.org/#/c/302479 ?22:51
ryansbof course :)23:11
flwangEva-i: run the shell23:18
Eva-iflwang: what do you mean?23:23
Eva-iflwang: I want to test it too, but don't know how to run23:23
*** itisha has quit IRC23:29
*** Qiming has joined #openstack-zaqar23:35
Eva-iflwang: from where can I start?23:36
flwangEva-i: download the shell gate_hook.sh  and then run ./gate_hook.sh tempest23:39
Eva-iflwang: hm, oki, I'll try tomorrow23:48
flwangEva-i: cool, thanks23:50
*** tqtran has quit IRC23:53
Eva-iflwang: ryansb: see you tomorrow =)23:55
flwanggood night23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!