Friday, 2014-12-19

*** ametts has quit IRC00:14
*** amitgandhinz has joined #openstack-zaqar00:36
*** amitgandhinz has quit IRC00:40
*** sgotliv has quit IRC00:55
openstackgerritJeffrey Zhang proposed openstack/zaqar: Use the oslo.serialization instead of openstack/common/jsonutils  https://review.openstack.org/13518701:32
*** mpanetta_ has joined #openstack-zaqar01:40
*** mpanetta_ has quit IRC01:40
*** mpanetta has quit IRC01:42
*** amalagon has quit IRC02:19
*** wpf has joined #openstack-zaqar02:27
openstackgerritFei Long Wang proposed openstack/zaqar: Clean up the 'queues' package for tests  https://review.openstack.org/14264203:11
*** amalagon has joined #openstack-zaqar03:29
*** amalagon has quit IRC03:33
*** yfujioka has quit IRC03:47
*** vkmc has quit IRC04:02
*** flwang has quit IRC04:16
*** achanda has joined #openstack-zaqar04:20
*** achanda has quit IRC04:48
*** achanda has joined #openstack-zaqar04:49
*** achanda has quit IRC04:53
cpallareshey flwang1 :)04:59
cpallareshow are you doing?04:59
*** cpallares has quit IRC05:34
*** pcaruana has joined #openstack-zaqar06:49
openstackgerritZhi Yan Liu proposed openstack/zaqar: Integrate OSprofiler with Zaqar  https://review.openstack.org/14135607:00
*** reed has quit IRC07:04
*** boris-42 has quit IRC07:33
*** amalagon has joined #openstack-zaqar07:56
*** exploreshaifali has joined #openstack-zaqar08:02
exploreshaifaliflaper87: goooooood morning :)08:11
flaper87exploreshaifali: gooooood morning :D08:14
exploreshaifaliflaper87: can your robot mind help me in identifying where are QueueController's storage configs exist08:15
exploreshaifali:P08:15
* flaper87 puts some oil in his head08:17
flaper87exploreshaifali: lets do it08:17
flaper87exploreshaifali: so, there're no queue controller specific configs08:17
flaper87but there are data_plane/control_plane specific ones08:17
* flaper87 gets some links08:18
exploreshaifaliflaper87: yes08:18
flaper87exploreshaifali: https://github.com/openstack/zaqar/blob/master/zaqar/storage/mongodb/driver.py#L7508:20
flaper87We do that for the data driver, right?08:20
flaper87and we have a `queue_controller` in the data driver08:20
flaper87we need to move that to the control driver08:20
*** dynarro has joined #openstack-zaqar08:20
flaper87and everything should happen magically08:20
flaper87BUT08:20
flaper87it's not all flowers and butterflies08:20
exploreshaifalihow queueController is in data_plane?08:21
flaper87You'll face some issues because in some places the message controller needs to access the queue's controller08:21
flaper87exploreshaifali: https://github.com/openstack/zaqar/blob/master/zaqar/storage/base.py#L212-L21408:21
flaper87that's the base implementation of the DataDriver08:22
exploreshaifaliflaper87: yes, fine :)08:23
exploreshaifaliflaper87: I am suppose to move that into control_plane08:23
flaper87exploreshaifali: correct08:23
flaper87but keep in mind what I said above08:23
flaper87there are places where the message_controller needs to talk to the queue_controller08:24
flaper87I wish that wasn't the case but well.08:24
flaper87I'd say move it and see what the failures are :P08:24
exploreshaifaliflaper87: okay :)08:24
flaper87exploreshaifali: thanks :D08:25
flaper87I'm really exited about this08:25
exploreshaifaliflaper87: I will move it in ControlPlane and then let see what happens08:25
exploreshaifaliflaper87: lol08:25
flaper87exploreshaifali: be prepare to see explosions, failures and kittens dying08:26
flaper87prepared*08:26
exploreshaifaliflaper87: also I want to talk about removing queues08:27
exploreshaifaliI agree that it will reduce extra overhaed08:27
exploreshaifaliif we remove queues08:27
exploreshaifaliand use topics instead08:27
exploreshaifaliflaper87: but as like queue was compulsary for posting messages, topics will also be compulsory for posting message08:28
ekarlso-what storage is used for zaqar ?08:30
flaper87exploreshaifali: right, the difference is in how they're managed/represented in Zaqar08:30
*** sgotliv has joined #openstack-zaqar08:30
flaper87ekarlso-: mongodb/redis08:30
flaper87for now...08:30
ekarlso-doh08:30
flaper87ekarlso-: what ?08:30
exploreshaifaliflaper87: so the problem is only of flying messages08:31
flaper87exploreshaifali: what do you mean?08:31
flaper87ekarlso-: ? :)08:33
ekarlso-flaper87: hehehe, mongo gpl thingie ...08:33
flaper87ekarlso-: you can use redis then :)08:34
*** exploreshaifali has quit IRC08:35
*** sgotliv has quit IRC08:38
*** sgotliv has joined #openstack-zaqar08:41
*** sgotliv has quit IRC08:54
*** flwang has joined #openstack-zaqar08:55
*** exploreshaifali has joined #openstack-zaqar08:59
*** exploreshaifali has quit IRC09:05
*** exploreshaifali has joined #openstack-zaqar09:14
exploreshaifaliflaper87: I am asking about the problem with this idea of using topics instead of queues09:15
exploreshaifaliflaper87: like one problem is with messages in fly and the flavor of their topic is being chaged as mentioned here https://review.openstack.org/#/c/134015/3/specs/kilo/migrate-to-topics.rst09:16
exploreshaifalisecond commet of Rayn Browm09:16
flaper87exploreshaifali: we have the same problems with queues09:16
exploreshaifaliflaper87: yes exactly09:17
exploreshaifaliflaper87: that is what I was thinking... how did you people managed same problem with queues09:17
flaper87exploreshaifali: we don't :)09:17
flaper87the problem still exist09:17
exploreshaifalithe same could be applied with topics09:17
flaper87exists*09:17
flaper87that's something we need to fix09:17
exploreshaifaliokay09:17
exploreshaifaliflaper87: so there is not any other issue with this proposal?09:18
flwangflaper87: ping09:18
flwangdid you notice the gate failure?09:18
flaper87exploreshaifali: I honestly don't think there is09:24
flaper87the URL thing is definitely one09:24
flaper87flwang: what failure ?09:24
flaper87flwang: py33 ?09:24
flwanghttp://logs.openstack.org/51/142451/3/check/gate-zaqar-python27/36dc7b2/testr_results.html.gz09:24
flwangflaper87: but I can't recreate it on my local env09:27
flwangstill investigating...09:27
exploreshaifaliflaper87: As queue's names are used in URL here we will use topic's name in URL or topic only body will work?09:28
exploreshaifaliflwang: my patch also failed, though changes in this patch has nothing to do with py27 or py33 or pypy09:30
exploreshaifalihttps://review.openstack.org/#/c/142451/09:30
flaper87exploreshaifali: that's something we still need to decide :/09:35
flaper87I mean, my hope was to remove it09:35
flaper87but removing it will require lots of changes09:35
flaper87and probably aweful backwards incompatibility issues09:35
flaper87so, we'll probably keep it09:35
flaper87flwang: oh, mmh, did something change in keystone?09:35
flwangflaper87: not sure :(09:39
exploreshaifaliflaper87: what I think of messages in flight is tthat they are those messages which are in queue, i.e, they are produced by producer and are waiting to get comsumed by consumer09:41
flwangmaybe there are some change from keystonemiddleware09:41
exploreshaifaliflaper87: is it correct ?09:41
flaper87exploreshaifali: yes, that's correct09:44
flwangflaper87: i can recreate it now09:46
flwangfixing...09:46
flaper87flwang: what's broken ?09:49
* flaper87 is digging to09:49
flwangflaper87: there is a new version of keystonemiddleware09:49
flwangseems it's requiring something we missed09:49
flaper87mmh, I haven't seen any sync from global-requirements09:50
flwangwe're setting the dependency as keystonemiddleware>=1.0.009:51
flwangand infra will always get the latest version, so it's using 1.3.009:52
flaper87yes09:52
flaper87what I mean is09:52
flaper87what's changed that we need to fix?09:52
flaper87also09:52
flaper87wait09:52
flwangstill need to figure out09:53
flaper87flwang: mind sending an email to the m-l saying that the new version of keystonemiddleware broke Zaqar's gate ?09:54
flaper87I can send it if you don't want to :P09:54
flaper87if it's a breaking change, then stable branches should be caped and master should be >=1.309:54
flwangflaper87: it can be done by PTL :)09:54
flaper87who's that?09:55
flwangflaper87: but we still need to fix the issue, right?09:55
flwangwho owe me a beer09:55
flaper87flwang: yup09:56
*** exploreshaifali has quit IRC09:56
flaper87flwang: I think we just need to add an auth_section option09:58
flwangflaper87: from the error log, yes09:58
flwangand I have tried to add it into keystone_auth.conf, but seems it doesn't work09:59
flaper87may I ask where you added it?10:01
flaper87s/ask/know/10:01
flaper87I mean, what section10:01
flwanghttps://github.com/openstack/zaqar/blob/master/tests/etc/keystone_auth.conf10:02
flwangflaper87: or any other place we should try?10:04
*** exploreshaiflai has joined #openstack-zaqar10:04
flaper87flwang: did you put it in the DEFAULT group or in the keystone_auth group ?10:05
flwangboth didn't  work :(10:06
flaper87mmh, the error says it should be in keystone_authtoken10:07
flwangyep, that's my first10:08
flwangfirst try10:08
flwang[keystone_authtoken]10:08
flwangauth_section = XXX10:08
exploreshaiflaiflaper87: the pupper_zaqar is related to http://en.wikipedia.org/wiki/Puppet_%28software%29 only10:09
flaper87exploreshaiflai: yup10:09
flaper87flwang: what version of keystoneclient do you have installed ?10:10
flwangit's a good question10:10
flwangmaybe I should update that10:10
flaper87right10:10
flaper87I think with 1.0 it should work10:10
flwangI'm running icehouse for some tests10:10
flwangsorry10:10
flaper87but for some reason, the gate is not installing 1.010:10
flwangwhat did you mean?10:10
flwangfor 1.0 it works definately10:11
flwangi have update the middleware to 1.3 to reproduce the issue10:11
flaper87wait10:11
flwangflaper87: do you want me submit a patch to pin the version?10:11
flaper87keystonemiddleware 1.3 and keystoneclient 1.010:11
flaper87https://pypi.python.org/pypi/python-keystoneclient10:12
flaper87keystoneclient was released yday10:12
flaper87I think that's what is causing issues10:12
flwangfeilong@feilong-ThinkPad-X1-Carbon-2nd:~/MyWorkspace/workspace_community/zaqar$ keystone --version10:12
flwang1.0.010:12
flwangi'm using the latest version10:12
flwangi mean keystonemiddleware 1.3 and keystoneclient 1.010:13
flaper87yeah, I think keystoneclient 1.0 is what broke everything10:13
flaper87I know what happened10:23
flaper87https://github.com/openstack/keystonemiddleware/blob/a1ae56cc3bce45b9ef2b7fa6bacc295c948486c3/keystonemiddleware/auth_token.py#L35610:23
flaper87it fucking assumes everyone is using a global CONF object10:23
flaper87arrrggggh10:24
flwangso should we pin the keystonemiddleware  version under 1.3, it can fix the issue, I just verified10:24
*** dynarro has quit IRC10:26
flaper87yeah, lets do it for now until this is fixed in keystone10:26
flwangflaper87: ok, I will submit a patch in 3 minutes10:27
flaper87thank you10:27
flaper87I'll send an email10:27
flwangflaper87: cool10:28
*** exploreshaiflai has quit IRC10:30
flaper87flwang: actually, a better fix10:35
flaper87instead of caping10:35
flaper87flwang: we should import keystoneclient auth and register the required options https://github.com/openstack/keystonemiddleware/blob/a1ae56cc3bce45b9ef2b7fa6bacc295c948486c3/keystonemiddleware/auth_token.py#L35610:36
flwangbut that's the next step, right?10:36
flaper87flwang: we can do it ourselves in https://github.com/openstack/zaqar/blob/master/zaqar/transport/auth.py#L3410:37
flaper87just to avoid caping and then having conflicts with the global-req bot10:37
flwangdid you mean using keystoneclient replace the keystonemiddleware ?10:39
flaper87no, keystonemiddleware requires keystoneclient, that means we can assume it's installed10:40
flaper87what we need to do is import keystoneclient in that file10:40
flaper87import this: https://github.com/openstack/keystonemiddleware/blob/a1ae56cc3bce45b9ef2b7fa6bacc295c948486c3/keystonemiddleware/auth_token.py#L18310:40
flaper87and then call: https://github.com/openstack/keystonemiddleware/blob/a1ae56cc3bce45b9ef2b7fa6bacc295c948486c3/keystonemiddleware/auth_token.py#L35610:40
flwangok, let me try10:42
*** sgotliv has joined #openstack-zaqar10:53
*** exploreshaiflai has joined #openstack-zaqar10:59
openstackgerritFei Long Wang proposed openstack/zaqar: Use keystoneclient auth and register required options  https://review.openstack.org/14303811:02
flwangflaper87: ^11:03
flwangflaper87: i'm going to drop off11:03
*** wpf has quit IRC11:26
*** wpf has joined #openstack-zaqar11:26
*** wpf has quit IRC11:35
*** wpf has joined #openstack-zaqar11:38
flaper87flwang: thank you12:05
*** exploreshaiflai has quit IRC12:07
openstackgerritFlavio Percoco proposed openstack/zaqar: Use keystoneclient auth and register required options  https://review.openstack.org/14303812:10
*** jasondotstar is now known as jasondotstar|afk12:16
*** sgotliv has quit IRC12:32
*** dguerri has quit IRC12:45
*** wpf has quit IRC12:47
*** dguerri has joined #openstack-zaqar12:47
*** wpf has joined #openstack-zaqar12:48
*** sgotliv has joined #openstack-zaqar12:50
*** vkmc has joined #openstack-zaqar13:10
* vkmc lurks13:18
*** exploreshaifali has joined #openstack-zaqar13:21
flaper87vkmc: what's up with the good morning thing ?13:22
flaper87:P13:22
flaper87vkmc: HELLOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO13:22
vkmcflaper87, oooooooooooooooh gooood morniiiiiiiiiiiiiiing13:23
vkmcI'm quite tired today13:24
*** boris-42 has joined #openstack-zaqar13:38
flaper87vkmc: it's friday, don't worry13:42
flaper87:)13:42
flaper87btw https://review.openstack.org/#/c/143038/13:42
flaper87still working on fixing that issue13:42
flaper87good thing we already cut k-113:42
flaper87oh wait, this breaks k-113:42
flaper87fuck13:42
flaper87:(13:42
vkmcI saw the mailing... fuck13:43
vkmcso... for some reason its not being able to connect to keystone13:46
flaper87right13:46
*** sgotliv has quit IRC13:57
*** achanda has joined #openstack-zaqar14:06
*** sriram has joined #openstack-zaqar14:07
vkmcflaper87, shouldn't we update the tests as well? https://github.com/openstack/zaqar/blob/master/zaqar/tests/queues/transport/wsgi/v1_1/test_auth.py14:28
flaper87mmh, i don't think so :/14:29
flaper87ah wait14:30
flaper87those are unittests14:30
vkmcyup14:30
flaper87why is it connecting to keystone ?14:30
*** ametts has joined #openstack-zaqar14:30
flaper87OMG, let me guess14:31
vkmcits using auth_token to assert if the app is an instance of authprotocol14:31
vkmchhhmmm14:31
*** exploreshaifali has quit IRC14:39
*** achanda has quit IRC14:41
flaper87sorry got distracted14:51
flaper87vkmc: this http://logs.openstack.org/38/143038/2/check/gate-zaqar-python27/85012dd/console.html#_2014-12-19_12_15_50_61114:51
flaper87it's trying to get an endpoint14:52
flaper87https://github.com/openstack/keystonemiddleware/blob/master/keystonemiddleware/auth_token.py#L1310-L136514:53
flaper87why? I mean, why?14:53
vkmclol15:00
vkmctl;dr15:00
vkmcbrb15:05
*** jasondotstar|afk has quit IRC15:16
*** amitgandhinz has joined #openstack-zaqar15:21
*** jasondotstar|afk has joined #openstack-zaqar15:24
*** achanda has joined #openstack-zaqar15:35
*** jasondotstar|afk has quit IRC15:41
*** pcaruana has quit IRC15:59
*** jasondotstar has joined #openstack-zaqar16:00
*** mpanetta has joined #openstack-zaqar16:02
amitgandhinzflaper87: does zaqar currently have an assigned service type in keystone?16:03
*** mpanetta has quit IRC16:03
*** mpanetta has joined #openstack-zaqar16:03
flaper87amitgandhinz: yes, it's messaging16:08
amitgandhinzthanks16:08
amitgandhinzwas there a process to get the service type "messaging"16:08
amitgandhinzie did zaqar have to be incubated first/is it documented somewhere/etc ?16:09
flaper87nah, we just added to devstack16:11
flaper87that somehow made it official :P16:11
amitgandhinzinteretsing16:15
amitgandhinzthanks =016:15
amitgandhinz=)16:15
*** sgotliv has joined #openstack-zaqar16:20
*** sgotliv has quit IRC16:22
*** sgotliv has joined #openstack-zaqar16:23
*** cpallares has joined #openstack-zaqar16:26
*** exploreshaifali has joined #openstack-zaqar16:26
*** boris-42 has quit IRC16:33
*** reed has joined #openstack-zaqar16:54
flaper87vkmc: btw, I already synced with folks from  keystone, they're fixing the issue in the middleware17:00
flaper87flwang: ^17:01
exploreshaifalithat's great flaper87  :)17:04
*** achanda has quit IRC17:04
flaper87exploreshaifali: :D17:05
flaper87yeah17:05
flaper87finally17:05
flaper87we'll still the work around for hte other thing but the most critical issue is fixed now17:05
exploreshaifaliflaper87, yeah.... hope every thing will work out soon!17:05
*** achanda has joined #openstack-zaqar17:07
*** amalagon has quit IRC17:21
*** flwang has quit IRC17:26
*** achanda has quit IRC17:28
*** achanda has joined #openstack-zaqar17:28
*** sgotliv has quit IRC17:30
*** achanda has quit IRC17:33
*** achanda has joined #openstack-zaqar17:40
*** amalagon has joined #openstack-zaqar17:43
*** exploreshaifali has quit IRC17:45
*** sriram has quit IRC18:29
*** sriram has joined #openstack-zaqar18:30
*** sriram has joined #openstack-zaqar18:30
*** sgotliv has joined #openstack-zaqar18:37
*** openstack has joined #openstack-zaqar19:09
*** openstackstatus has joined #openstack-zaqar19:10
*** ChanServ sets mode: +v openstackstatus19:10
*** achanda has quit IRC19:40
cpallareso/19:46
cpallares\o19:46
cpallares\o\19:46
cpallares/o/19:46
mpanettacpallares: Is it time to dance?19:46
mpanetta:)19:46
cpallaresmpanetta: It's zarconi dance party time19:47
cpallareshow are you, mpanetta? :)19:47
mpanettazarconi? :)19:47
mpanettaI am ok. Sick from some sort of viral infection tho :(19:47
cpallaresmpanetta: zaqar + marconi19:47
mpanettaHow are you cpallares?19:47
mpanettaAh!19:48
cpallaresmpanetta: oh no that's sad to hear :(19:48
mpanettaI'll be ok.19:49
cpallaresmpanetta: Hope you get better19:49
kragnizmpanetta: I'm sorry if you caught it off me19:49
cpallaresmpanetta: I recommend hot tea and tv marathons :P19:49
mpanettaAt least I doged the flu19:49
mpanettacpallares: Heck yea!19:49
cpallaresmpanetta: Dr's orders19:49
* cpallares is a doctor19:49
mpanettaBeen doing stargate marathons anyway :P19:49
* cpallares took that one biology class that one time19:49
mpanettahehe19:49
cpallaresmpanetta: nice, I haven't watched stargate. Do you recommend?19:50
mpanettaI do! 1000%19:50
mpanettaOne of my fav shows.  That and Farscape19:50
* cpallares has never heard of farscape19:50
cpallaresmpanetta: have you watched firefly? :D19:50
mpanettaOh yes, that too :)19:50
mpanettaThat one is good19:51
cpallaresmpanetta: I really like firefly19:52
mpanettaIf you like FireFly you may like Farscape.  Has that good camp19:52
* cpallares wants to be zoe19:52
cpallaresmpanetta: Oh nice :)19:52
cpallaresI'll watch it then.19:52
mpanettaMy fav character is kaylee19:52
cpallaresmpanetta: aw she's adorbs19:53
mpanettaThe actress is also in Stargate Atlantis (another stargate series)19:53
mpanettaShe plays a dr there19:53
cpallaresmpanetta: always going for the smart roles :P19:53
mpanettaWell, I tend to like the smart characters better :P19:54
*** amalagon has quit IRC19:59
*** amalagon has joined #openstack-zaqar20:00
*** amalagon has quit IRC20:05
* flaper87 is eating like a proper geek20:15
mpanettaflaper87: oh?20:15
mpanettawhats for dinner?20:15
flaper87on my laptop20:15
mpanettahah20:16
*** exploreshaifali has joined #openstack-zaqar20:27
*** cpallares has quit IRC21:05
*** exploreshaifali has quit IRC21:19
*** amalagon has joined #openstack-zaqar21:23
* vkmc lurks21:40
*** flwang has joined #openstack-zaqar22:04
flwangflaper87: around?22:05
flaper87flwang: yes22:05
flwangseems the fix doesn't work22:06
flaper87flwang: wait, there's another problem22:06
flaper87I already talked with keystone guys22:06
flaper87the fix should be landing soon22:06
flaper87and a new keystonemiddleware release will be issued22:06
flwangflaper87: wow, ok22:06
flaper87:)22:06
flwangshit22:06
flwangbut cool22:06
flwangso we just need to wait, right?22:07
flaper87yeah22:09
flwangflaper87: ok, i'm reading your mail22:10
flaper87flwang: https://review.openstack.org/#/c/140765/22:10
flaper87the email referred to the other issue22:10
flaper87yeah, there were 222:10
flaper87:D22:10
flaper87https://review.openstack.org/#/c/140765/ <- this is for the one your patch is hitting now22:10
flwangWTF22:11
flaper87:P22:12
flwangbtw, did you think about the message publish of notification?22:12
flwangi mean when there is a new msg post to a queue, how to call taskflow to send it out?22:13
flwang i'm thinking if there is a way which won't impact current post msg performance22:14
*** vkmc has quit IRC22:18
*** amitgandhinz has quit IRC22:53
*** sriram1 has quit IRC22:58
*** mpanetta has quit IRC23:00
*** ametts has quit IRC23:21
*** flwang has quit IRC23:26

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!