Tuesday, 2016-04-26

*** wxy has joined #openstack-zaqar01:04
*** david_cu has joined #openstack-zaqar04:55
*** njohnston has quit IRC05:02
*** njohnston has joined #openstack-zaqar05:04
*** david_cu has quit IRC05:18
openstackgerritOpenStack Proposal Bot proposed openstack/zaqar: Imported Translations from Zanata  https://review.openstack.org/30759506:23
*** rcernin has joined #openstack-zaqar07:13
*** pcaruana has joined #openstack-zaqar10:32
*** AAzza has quit IRC11:08
*** AAzza has joined #openstack-zaqar11:09
*** pcaruana has quit IRC13:28
*** amitgandhinz has joined #openstack-zaqar14:03
aduflwang: pong14:58
aduI tried to run the wsgi and got: 2016-04-21 11:34:34.243 3548 CRITICAL zaqar [-] InvalidDriver: No 'zaqar.control.storage' driver found, looking for 'mongodb'14:59
*** pcaruana has joined #openstack-zaqar15:21
*** Eva-i has quit IRC15:22
*** Eva-i has joined #openstack-zaqar15:28
*** mpanetta has joined #openstack-zaqar16:06
*** GB21 has joined #openstack-zaqar16:19
*** david_cu has joined #openstack-zaqar16:37
*** david_cu_ has joined #openstack-zaqar16:38
*** david_cu has quit IRC16:41
*** shakamunyi has joined #openstack-zaqar16:59
*** david_cu_ has quit IRC17:02
*** tesseract has joined #openstack-zaqar17:06
*** tesseract is now known as Guest861317:06
Eva-iryansb: vkmc: hello, people. How the summit is going?17:07
Eva-iryansb: vkmc: have you decided who's going to provide laptop for me and flwang to attend to the design sessions remotely?17:10
*** GB21 has quit IRC17:14
*** GB21 has joined #openstack-zaqar17:51
*** GB21 has quit IRC18:24
*** david-lyle has joined #openstack-zaqar18:25
*** GB21 has joined #openstack-zaqar18:35
*** rcernin has quit IRC18:47
*** david-lyle has quit IRC18:49
*** GB21 has quit IRC18:52
*** GB21 has joined #openstack-zaqar18:55
*** david-lyle has joined #openstack-zaqar19:00
*** GB21 has quit IRC19:06
*** flwang1 has joined #openstack-zaqar19:09
flwang1adu: ping19:09
aduflwang1: are you a bot?19:09
flwang1adu: no :)19:09
aduyey19:09
flwang1yesterday, you asked how to deploy zaqar in productioin, right?19:10
aduyes19:10
flwang1adu: may i know more details? I'm the PTL of zaqar, hopefully i can help19:10
aduI’ve followed the instruction to setup a dev server, with backend=noauth19:10
*** david-lyle has quit IRC19:10
aduand I’m using python-zaqarclient to construct a client object with the following conf19:11
aduhttp://pastie.org/1081415319:11
aduI19:12
aduI’ve figured out how to create and delete messages19:12
flwang1adu: so what's the error you're seeing?19:12
flwang1adu: ok, cool19:12
aduand I’ve figured out how to claim messages with curl, but I can’t figure out how to claim messages with python-zaqarclient19:13
flwang1adu: i'm curious why you want to use noauth mode?19:13
aduwhen i do client.queue(‘Q1’).claim(ttl=1209500, grace=60, limit=1) I get:19:13
aduMalformedRequest: Error response from Zaqar. Code: 400. Title: Invalid API request. Description: The TTL for a claim may not exceed 1209600 seconds, and must be at least 60 seconds long..19:13
aduI don’t want to use noauth mode, I want to use keystone, but I only have a finite amount of time in my day...19:14
flwang1:) can't see the relationship between the auth mode and your time of day19:15
flwang1did you mean the auth mode will take more time to set up?19:15
adupossibly, I don’t know19:15
flwang1adu: ok, if it's a bug, i can help figure out and fix. but before that, would you mind sharing more info about your side?19:17
adumy side?19:17
aduhmm, as in mongodb?19:17
flwang1like what's your usercase? why do you want to deploy zaqar in your prod?19:17
aduah19:17
aduorder processing19:18
flwang1so you guys have already deployed openstack, right? which version?19:18
aduwe currently have about 6 distinct queue systems, most of which are for one-off jobs, and zaqar is a nice fit for that, I think19:19
aduno, we have a contract with Rackspace19:19
flwang1it's a PoC or you guys have decided to use zaqar?19:19
aduand that’s pretty similar to OpenStack19:19
flwang1adu: so Rackspace will help you guys deploy openstack in your prod?19:20
aduI wanted to compare Rackspace Cloud Queues with an in-house Zaqar deployment19:20
flwang1ah, i see.19:21
mpanettaadu: Zaqar would be better.  Cloud Queues is in sustain mode.19:21
aduflwang1: no, iirc, rackspace is to openstack as netscape is to mozilla19:21
mpanettaI am the maintainer of CQ which is why I know this heh19:21
flwang1mpanetta: haha, thanks for showing up :)19:22
mpanettaI'm always here :P  Just in hiding hehe19:22
flwang1adu: Rackspace is using the early version of zaqar as their cloud queues19:22
adumpanetta: So can I use an in-house zaqar that points to rackspace keystone? or would I have to run our own keystone server?19:22
mpanettayes quite an early version19:22
mpanettaI'm thinking you would have to set up your own keystone19:23
flwang1adu: if you're concerning about the performance, i think an in-house deployment is better for sure19:23
mpanettaSince you don't have admin rights to the rackspace one.19:23
mpanettaYes it most definitely is better19:23
flwang1adu: and IIRC, Rackspace is not using Keystone as auth19:24
flwang1mpanetta: pls fix me ^19:24
mpanettaThey aren't19:24
mpanettaIt is a contract compliant thing19:24
mpanettabut not keystone proper19:24
aduI thought it was keystone with a million custom extensions19:25
mpanettanah19:25
mpanettaits a java app of some sort iirc19:25
aduwell, that’s not very pythonic :/19:25
mpanettahah yeah19:25
flwang1adu: so based on what we discussed above, it's totally depending on your user case19:26
mpanettaadu: If it is private cloud I would set up my own probably.19:26
aduso I already see how zaqar can help with most of our order processing needs, but there is one area that we need help with that isn’t so obvious19:27
flwang1if you really want a in-house queue to get better performance, then zaqar is a good choice, but if you want it to play with Rackspace cloud, you may need some extra effort19:27
flwang1adu: the area is ?19:27
aduaccount polling19:27
aduwe poll customer accounts like every 2 minutes or so19:28
flwang1adu: why do you guys have to use poll?19:28
flwang1adu: we have notification, maybe it could help if i can know more details about t the case19:29
aduflwang1: that’s a good question, I’ve been asking Ticketmaster for a while now, but so far no response19:29
flwang1in other words, why do you guys want to poll the account? :)19:29
flwang1adu: ok, again, is it still in PoC?19:29
flwang1i mean the thing you're doing :)19:30
aduflwang1: proof-of-concept19:30
adu?19:30
flwang1yes :) sorry19:30
aduYes, I’m currently in proof-of-concept mode, but I was worried that there was no production user guide, only development user guide19:31
aduI’m trying to see if I can replace our 6 wierd queues with zaqars19:32
flwang1adu: pls blame the bad doc policy of openstack19:32
flwang1adu: we do have user guide19:32
aduok19:32
flwang1and based on the old policy of openstack, the non-core project can't put user guide on docs.openstack.org19:33
flwang1and that's what i'm working on19:33
flwang1adu: i will push the user guide to publish asap to address your concern19:35
flwang1adu: FWIW, see https://github.com/openstack/zaqar/tree/master/doc/user-guide19:35
aduI think I found a rendering of that somewhere19:37
flwang1adu: it's possible, but we will improve it as well19:39
flwang1adu: btw, can you show me the error about the claim issue? i mean the server side log19:39
*** david-lyle has joined #openstack-zaqar19:41
*** pcaruana has quit IRC19:45
adu2016-04-26 15:15:00.371 13888 DEBUG zaqar.transport.wsgi.v1_1.claims [(None,) - - - - -] [project_id:dd75a015-b93e-4a20-a715-7185a215b64f] The TTL for a claim may not exceed 1209600 seconds, and must be at least 60 seconds long. on_post /Users/ajr/1t/src/zaqar/zaqar/transport/wsgi/v1_1/claims.py:9719:45
aduI put lots of LOG.debug things everywhere, and verified that _params is {'limit': '1'} and metadata is {'grace': 60, 'ttl': 1209500}19:45
flwang1adu: cool, thanks, will review the source code to see if there is a bug19:47
aduso the claim creation in the client is passing the right data to the server19:47
*** flwang1 has quit IRC19:52
*** Guest8613 has quit IRC19:54
*** david-lyle has quit IRC19:57
*** vipuls has quit IRC20:08
*** david_cu has joined #openstack-zaqar20:35
*** david_cu has quit IRC20:43
*** adu has quit IRC20:58
*** flwang1 has joined #openstack-zaqar21:13
*** amitgandhinz has quit IRC21:18
*** amitgandhinz has joined #openstack-zaqar21:19
*** amitgandhinz has quit IRC21:19
*** khushbu has joined #openstack-zaqar22:01
*** david_cu has joined #openstack-zaqar22:10
*** adu has joined #openstack-zaqar22:17
aduflwang1: back22:18
aduum, I mean ping22:18
flwang1adu: cool22:18
aduI just got home from work22:19
flwang1adu: is that ok for you?22:19
flwang1overtime ? ;)22:19
*** khushbu has quit IRC22:19
aduoh yes, since I'm having fun too :)22:19
*** khushbu_ has joined #openstack-zaqar22:20
flwang1awesome22:21
aduok, I don't have the error message anymore22:21
flwang1adu: you mean the claim issue can't be reproduced anymore?22:21
aduoh, I can just ssh into work, n/m22:22
flwang1ok, so you can still reproduce the claim issue, right?22:27
flwang1just double check22:27
aduyes22:27
aduI just need to ssh to reproduce it :P22:27
aduSorry for the confusion22:28
flwang1ok, got it22:28
aduI wonder if that issue would go away with keystone22:28
flwang1adu: would you mind opening a bug https://bugs.launchpad.net/zaqar/+filebug ?22:28
adulike if the validation is failing because x-auth-token is missing, but it raises a TTL issue instead?22:28
flwang1to track this issue and it would be nice if you can add some reproduce steps22:29
flwang1then today i will work on that22:29
flwang1and as for your user case, i think we're good. either TTL or delete manually could work22:30
flwang1adu: i assume you know how to set TTL of message, and as for message delete, here is the api https://wiki.openstack.org/wiki/Zaqar/specs/api/v1.1#Delete_Multiple_Messages22:31
*** david_cu has quit IRC22:32
*** david_cu has joined #openstack-zaqar22:36
aduok22:39
flwang1so do you have any other concern?22:40
flwang1about using zaqar to meet your user case22:40
aduconcerns?22:44
aduI'm not concerned about this particular issue22:44
aduI'm pretty sure it's me being a dumb ass22:44
aduMy only concerns are that zaqar can take care of one-off and periodic jobs22:45
flwang1yep, that is what i'm asking :)22:45
flwang1sorry, i'm not a native english speaker22:46
aduflwang1: what is your native language?22:46
flwang1mandarin22:47
aduoOo22:47
flwang1I"m a Chinese22:47
*** mpanetta has quit IRC22:51
aduSo another thing is, I was running both zaqar-server and python-zaqarclient on MacOSX22:54
adubut when I try and reproduce it in linux, I get: "ImportError: cannot import name IncompleteRead" when trying to pip install python-zaqarclient22:55
aduI think I remember pip install -U pip fixing this22:55
flwang1adu: did you every try use devstack to get a fully work env?22:56
aduflwang1: yes, my computer crashed because of not enough RAM22:57
flwang1wow22:57
aduit has 16 GB22:57
flwang1hmm.... i would recommend install devstack in a VM if so22:58
flwang1with ubuntu14.0422:58
aduit was in a vm23:00
aduand I think I allocated 8GB of ram to the vm23:00
aduit still crashed23:00
adubut then again, I think I had 25 services configured23:00
flwang1adu: hmm... interesting, it works fine on my laptop and VM23:00
flwang1ah, why not try disable most of the other service and only keep keystone, zaqar and the others you want23:01
flwang1anyway, i don't think 'any bug' is a problem to block you to use zaqar in your production23:01
aduI don't think I tried just keystone and zaqar23:02
flwang1so i would suggest let's focus on the user cases23:02
aduuser cases?23:02
flwang1yep, i mean what you're trying:  if zaqar can meet all your requirements23:02
aduyes23:03
*** khushbu_ has quit IRC23:03
flwang1so anything i can help to make things easier?23:05
flwang1accelerate your test, etc, etc :)23:05
aduI guess I'll use devstack23:09
aduI just don't understand devstack too well, which is why I wanted to run it in isolation23:10
aduI think I tried adding zaqar to the default devstack, and I still got 25 services running23:10
flwang1do you want to try it today?23:12
flwang1if so,i can share my localrc file for you23:12
flwang1so that you can give it a try right now23:12
aduoh, that would help23:13
flwang1wait a sec23:15
flwang1adu: http://paste.openstack.org/show/495474/23:16
flwang1if you're using a VM, replace the SERVICE_HOST and HOST_IP with your VM's IP address23:16
flwang1so that you can talk with those openstack service from your host23:16
aduflwang1: I think it was glance and cinder that was causing the crash, do you have one with those services disabled?23:17
flwang1adu: you can comment them out, but i would suggest try again and show me the errors23:18
flwang1i guess it's cinder23:18
flwang1so you can try comment out cinder first23:18
aduok, will do, I will update in several hours23:23
flwang1adu: awesome, btw, what's your timezone?23:23
adu-523:25
aduI think23:25
aduEST23:25
adu"EST5EDT" in tzdata23:25
flwang1i always use this http://www.worldtimebuddy.com/23:29
aduI use timeanddate.com23:38

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!