Tuesday, 2017-02-21

catinthe_jd_: thanks !00:01
*** donghao has joined #openstack-telemetry00:17
*** catinthe_ has quit IRC00:17
*** catintheroof has joined #openstack-telemetry00:19
*** donghao has quit IRC00:23
*** catintheroof has quit IRC00:23
openstackgerritliusheng proposed openstack/python-aodhclient master: Clean deprecated "query" paremeter in alarm.list()  https://review.openstack.org/43066900:55
*** pradk has quit IRC01:06
*** sam_nowitzki has joined #openstack-telemetry01:19
*** vint_bra has joined #openstack-telemetry01:19
*** vint_bra has quit IRC01:19
*** pradk has joined #openstack-telemetry01:27
*** thorst has joined #openstack-telemetry01:29
*** gongysh has joined #openstack-telemetry01:38
*** iceyao has joined #openstack-telemetry01:40
*** iceyao has quit IRC01:54
*** iceyao has joined #openstack-telemetry01:54
*** lhx__ has joined #openstack-telemetry01:59
*** g3ek has quit IRC02:01
*** g3ek has joined #openstack-telemetry02:11
openstackgerritliusheng proposed openstack/panko master: Support using panko as publisher than dispatcher  https://review.openstack.org/43627902:25
*** dave-mccowan has quit IRC02:58
*** zhurong has joined #openstack-telemetry03:01
*** sudipto has joined #openstack-telemetry03:01
*** sudipto_ has joined #openstack-telemetry03:01
*** thorst has quit IRC03:04
*** thorst has joined #openstack-telemetry03:05
*** thorst has quit IRC03:21
openstackgerritHanxi Liu proposed openstack/aodh master: test  https://review.openstack.org/43629203:39
openstackgerritHanxi Liu proposed openstack/ceilometermiddleware master: Trivial: remove support for py34  https://review.openstack.org/43629303:39
*** zhurong has quit IRC04:01
*** chlong has joined #openstack-telemetry04:03
*** Gautam has joined #openstack-telemetry04:16
*** sudipto_ has quit IRC04:32
*** sudipto has quit IRC04:32
*** lhx__ has quit IRC04:38
*** lhx__ has joined #openstack-telemetry04:38
*** lhx__ has quit IRC04:44
*** lhx__ has joined #openstack-telemetry04:48
*** nadya has joined #openstack-telemetry04:59
*** nadya has quit IRC05:04
*** nadya has joined #openstack-telemetry05:18
*** Jack_Iv has joined #openstack-telemetry05:18
*** sudipto has joined #openstack-telemetry05:20
*** sudipto_ has joined #openstack-telemetry05:20
*** nadya has quit IRC05:23
*** Jack_Iv has quit IRC05:32
*** adriant has quit IRC05:38
*** donghao has joined #openstack-telemetry05:40
*** tlian has quit IRC05:41
*** donghao has quit IRC05:45
*** longlq_ has joined #openstack-telemetry05:58
*** sam_nowitzki has quit IRC05:58
*** Jack_Iv has joined #openstack-telemetry06:01
*** lhx__ has quit IRC06:02
*** nadya has joined #openstack-telemetry06:15
*** Jack_Iv has quit IRC06:38
*** Jack_Iv has joined #openstack-telemetry06:39
*** nadya has quit IRC06:39
*** nadya has joined #openstack-telemetry06:40
*** nadya has quit IRC06:44
*** sanchitmalhotra has quit IRC07:10
*** sanchitmalhotra has joined #openstack-telemetry07:10
*** yprokule has joined #openstack-telemetry07:13
*** lhx__ has joined #openstack-telemetry07:19
*** tesseract has joined #openstack-telemetry07:25
*** longlq_ has quit IRC07:28
*** sam_nowitzki has joined #openstack-telemetry07:28
*** openstackgerrit has quit IRC07:32
*** pcaruana has joined #openstack-telemetry07:37
*** Gautam has quit IRC07:43
*** Gautam has joined #openstack-telemetry07:43
*** Gautam has quit IRC07:47
*** nadya has joined #openstack-telemetry07:50
lhx__jd_, if the release of tooz is automatic?08:10
*** Gautam has joined #openstack-telemetry08:15
*** Gautam has quit IRC08:20
*** Gautam has joined #openstack-telemetry08:31
jd_lhx__: no, u can send a release patch to openstack/releases08:43
lhx__jd_, when to send a release? after the u-c being updated?08:47
*** yassine has joined #openstack-telemetry09:12
*** yassine is now known as Guest1507909:13
*** Guest15079 has quit IRC09:21
*** gongysh has quit IRC09:27
*** yprokule has quit IRC09:29
*** iceyao has quit IRC09:29
*** Guest15079 has joined #openstack-telemetry09:37
*** pece has joined #openstack-telemetry09:55
*** nadya has quit IRC10:01
*** nijaba has quit IRC10:05
*** pece has quit IRC10:06
*** Guest15079 has quit IRC10:09
*** yassine_ has joined #openstack-telemetry10:09
*** nijaba has joined #openstack-telemetry10:12
*** nijaba has quit IRC10:12
*** nijaba has joined #openstack-telemetry10:12
*** Gautam has quit IRC10:14
*** Gautam has joined #openstack-telemetry10:15
*** sudipto has quit IRC10:17
*** sudipto_ has quit IRC10:17
*** Gautam has quit IRC10:20
*** yprokule has joined #openstack-telemetry10:25
*** nadya has joined #openstack-telemetry10:31
*** nadya has quit IRC10:36
*** nadya has joined #openstack-telemetry10:49
*** sam_nowitzki has quit IRC10:52
*** lhx__ has quit IRC10:56
*** lhx__ has joined #openstack-telemetry11:01
*** Gautam has joined #openstack-telemetry11:02
*** Gautam has quit IRC11:07
*** rbak has quit IRC11:36
*** rbak has joined #openstack-telemetry11:37
*** Gautam has joined #openstack-telemetry11:58
*** jianghuaw has quit IRC12:02
*** Gautam has quit IRC12:03
lhx__jd_, could you tell how to generate the hash value?12:08
lhx__https://github.com/openstack/releases/commit/493e60153dc9bf1bbd51b31f4982fd2f617acec6#diff-0dd7a1ae49fc3aeb2afa21d698f7c5a4R2512:08
*** Gautam has joined #openstack-telemetry12:22
*** jianghuaw has joined #openstack-telemetry12:22
*** gordc has joined #openstack-telemetry12:43
*** openstackgerrit has joined #openstack-telemetry12:51
openstackgerritgordon chung proposed openstack/panko master: add ceilometer publisher  https://review.openstack.org/43159312:51
*** lhx__ has quit IRC13:02
*** chenyb has joined #openstack-telemetry13:09
*** nadya has quit IRC13:11
*** afazekas is now known as afazekas|broken_13:20
*** gongysh has joined #openstack-telemetry13:21
*** thorst has joined #openstack-telemetry13:24
*** thorst has quit IRC13:33
*** thorst has joined #openstack-telemetry13:34
*** thorst has quit IRC13:36
*** thorst has joined #openstack-telemetry13:40
*** thorst_ has joined #openstack-telemetry13:44
*** thorst has quit IRC13:45
*** tlian has joined #openstack-telemetry13:46
*** tlian has quit IRC13:49
*** dave-mccowan has joined #openstack-telemetry13:52
*** vint_bra has joined #openstack-telemetry13:54
*** dave-mcc_ has joined #openstack-telemetry13:55
*** dave-mccowan has quit IRC13:57
*** Gautam has quit IRC13:59
*** Gautam has joined #openstack-telemetry14:00
*** cdent has joined #openstack-telemetry14:01
*** Gautam has quit IRC14:04
openstackgerritMerged openstack/aodh master: Install test dependencies in docs  https://review.openstack.org/43563414:05
*** dave-mcc_ has quit IRC14:10
openstackgerritMerged openstack/aodh master: Trivial-fix: use domain_id instead of domain_name  https://review.openstack.org/43412114:10
*** david-lyle has joined #openstack-telemetry14:12
*** fguillot has joined #openstack-telemetry14:16
*** thorst_ has quit IRC14:17
*** nicodemus_ has joined #openstack-telemetry14:17
*** thorst has joined #openstack-telemetry14:17
*** lhx_ has joined #openstack-telemetry14:18
*** lhx_ has quit IRC14:23
*** Gautam has joined #openstack-telemetry14:25
*** nadya has joined #openstack-telemetry14:26
openstackgerritMerged openstack/gnocchi master: Document the possible locations of the config file.  https://review.openstack.org/43040514:27
*** gongysh_ has joined #openstack-telemetry14:30
*** gongysh_ has quit IRC14:30
openstackgerritMerged openstack/ceilometer master: Ship YAML file to /usr/share  https://review.openstack.org/41230914:31
*** gongysh has quit IRC14:31
*** gongysh has joined #openstack-telemetry14:31
*** dave-mccowan has joined #openstack-telemetry14:33
*** lhx_ has joined #openstack-telemetry14:33
openstackgerritMerged openstack/ceilometermiddleware master: Trivial: remove support for py34  https://review.openstack.org/43629314:34
*** gongysh has quit IRC14:35
*** cdent has quit IRC14:37
*** cdent has joined #openstack-telemetry14:38
*** david-lyle has quit IRC14:45
*** rbak has quit IRC14:46
*** david-lyle has joined #openstack-telemetry14:46
*** david-lyle has quit IRC14:46
lhx_gordc, could you tell me how to generate the hash value?14:47
lhx_https://github.com/openstack/releases/commit/493e60153dc9bf1bbd51b31f4982fd2f617acec6#diff-0dd7a1ae49fc3aeb2afa21d698f7c5a4R2514:47
gordclhx_: its' the commit id in git... you don't generate it.14:49
gordclhx_: what are you trying to release? you need ptl to do release anyways so you'll need to ask jd_ (if it's related to our projects)14:50
gordclhx_: for example, that line ^ means it's creating a release from https://github.com/openstack/tooz/commit/9ad740fa1e0bd435844e7d7831199f37e964684714:51
openstackgerritMerged openstack/ceilometermiddleware master: switch to topics when declaring notifier  https://review.openstack.org/43512014:52
*** david-lyle has joined #openstack-telemetry14:53
lhx_gordc, oh, got it. there is nothing to release, just for curious14:55
lhx_:)14:55
*** Gautam has quit IRC14:55
*** harlowja has quit IRC14:56
gordclhx_: i see :)14:56
*** david-lyle has quit IRC14:57
lhx_gordc, another problem, could these ports change to 8042?14:58
lhx_https://github.com/openstack/aodh/blob/master/aodh/api/controllers/v2/alarms.py#L366-L36814:58
*** shardy has joined #openstack-telemetry14:58
*** donghao has joined #openstack-telemetry14:59
*** chenyb has left #openstack-telemetry15:00
gordclhx_: no. well it doesn't really matter since it's example data15:00
gordclhx_: the actions target something that isn't aodh so it's not suppose to point back to aodh if that is what you are asking.15:01
*** sanchitmalhotra has quit IRC15:05
*** sanchitmalhotra has joined #openstack-telemetry15:06
lhx_gordc, yeah, no matter what15:09
lhx_i wonder if it relates to the default port in pbr15:09
lhx_http://git.openstack.org/cgit/openstack-dev/pbr/tree/pbr/packaging.py#n28915:09
lhx_if using aodh-api, people has to change the default port manully15:10
lhx_s/manully/manually15:11
gordclhx_: sorry? i don't understand. change what port manually?15:13
*** alextricity25 has joined #openstack-telemetry15:13
gordchttps://github.com/openstack/aodh/blob/master/aodh/api/controllers/v2/alarms.py#L366-L36815:13
gordc^ doesn't need to be changed.15:13
alextricity25Hi all. I presume that "ceilometer.tests.tempest.api.test_telemetry_notification_api" is deprecated, correct? I recently removed my ceilometer collector service and am explicitly using gnocchi as my publisher in the pipepline. Will this test always fail in my scenario?15:17
*** thorst has quit IRC15:18
stevellethat looks like a yes.15:19
stevellewould be good to get another opinion15:19
gordcalextricity25: what stevelle said.15:20
gordcthat test validates ceilometer api. which isn't relevant in your case15:20
alextricity25I thought so. What would be a better tempest to run for my case?15:21
openstackgerritMerged openstack/python-aodhclient master: Clean deprecated "query" paremeter in alarm.list()  https://review.openstack.org/43066915:21
*** rbak has joined #openstack-telemetry15:22
lhx_gordc, https://bugs.launchpad.net/aodh/+bug/164279815:22
openstackLaunchpad bug 1642798 in Aodh "aodh-api server can not start " [Undecided,Invalid]15:22
gordcwe have gate-telemetry-dsvm-integration-* gate that validates ceilometer+gnocchi+aodh+panko(+heat+nova) scenario.15:22
lhx_aodh-api default to 800015:22
gordclhx_: in the comments the solution is to run wsgi service. aodh-api is only for testing.15:23
*** cdent has quit IRC15:26
alextricity25gordc: oh nice. Where could I see the tempest tests that gate runs?15:27
*** nadya has quit IRC15:28
gordcalextricity25: i'll be honest, i have no idea how it works.lol15:28
*** catintheroof has joined #openstack-telemetry15:28
*** shardy has quit IRC15:28
lhx_gordc, hum..., jd said would be cool if pbr would offer a way to customize somewhere… or we should just replace that with a uwsgi wrapper15:28
gordcalextricity25: something related to this https://github.com/openstack/ceilometer/blob/master/tox.ini#L28-L3615:28
gordclhx_: i imagine you need to patch pbr then.15:29
catintheroofgordc: hi, can i ask you a couple of questions about deploying agent-compute and agent-notification partitioned ? (HA)15:29
*** david-lyle_ has joined #openstack-telemetry15:29
lhx_gordc, so i thought if i could do something15:29
gordclhx_: sure? i don't know how to do it :)15:29
gordccatintheroof: go for it15:30
*** thorst has joined #openstack-telemetry15:31
catintheroofgordc: if all compute nodes push just to notifications.sample but i have 10 notifications agents coordinated by redis consuming notifications.sample, would that work ? and if it works, what is the gain of making agent-compute declaring several queues and pushing to them, and making notification agent consuming from thos several queues ?15:31
lhx_gordc, yeah, but i had no clue.15:31
jd_lhx_:++15:32
*** thorst has quit IRC15:32
jd_lhx_: uwsgi wrapper would be cool because scalable at least…15:32
gordccatintheroof: i don't think you can push each compute agent to it's own queue (not without some hacking)15:33
gordccatintheroof: but in theory, if you did that, you don't really need to coordinate the notification agents (if you have one notificatino agent listen to each queue)15:34
gordcif you have notification agents listening to all queues than doing that hack will gain you nothing. since notification agents will still need to sort them so all samples of a resource get processed by same notification agent15:35
gordcjd_: i see you've already hacked away all the openstack stuff from gnocchi :)15:38
jd_gordc: told ya :P15:39
gordcdidn't realise http://gnocchi.xyz/ points to stable and not master15:39
catintheroofgordc: i was just saying multiple queues, just because of this (https://docs.openstack.org/admin-guide/telemetry-data-collection.html#notification-agent-ha-deployment) saying this "The notification agent creates multiple queues to divide the workload across all active agents. The number of queues can be controlled by the pipeline_processing_queues option in the ceilometer.conf configuration file."15:42
catintheroofgordc: so ... maybe i didnt understand how ha works, so for my understanding, all compute agents will still push just to notifications.sample ?15:42
*** cdent has joined #openstack-telemetry15:42
gordccatintheroof: oh. yeah, that's the 'sort them so all samples of a resource get processed by same notification agent' part15:43
*** shardy has joined #openstack-telemetry15:43
*** shardy has quit IRC15:43
*** donghao has quit IRC15:44
*** thorst has joined #openstack-telemetry15:44
lhx_jd_, uwsgi wrapper? i wonder why it refers to api port. :((15:44
gordccatintheroof: yeah, all the compute agents push to mq, notification agents listen to mq, grab messages and figure out who should 'handle it' (the mulitple queues part).15:44
*** thorst has quit IRC15:44
*** thorst has joined #openstack-telemetry15:44
catintheroofgordc: so when the doc says this "To enable the Compute agent to run multiple instances simultaneously with workload partitioning, the workload_partitioning option has to be set to True under the Compute section in the ceilometer.conf configuration file" what does this enable ont he agent computes ?15:45
*** donghao has joined #openstack-telemetry15:47
openstackgerritHanxi Liu proposed openstack/ceilometer master: doc: update pipeline link  https://review.openstack.org/43651115:51
*** donghao has quit IRC15:52
openstackgerritMerged openstack/ceilometer master: Correct the use of marker function  https://review.openstack.org/43475815:54
gordccatintheroof: it means if you deploy multiple compute agents on a compute node15:55
gordccatintheroof: in that case, the compute agents would split which instances to poll.15:56
gordcand i guess if one agent went down, the other would keep going.15:57
openstackgerritgordon chung proposed openstack/gnocchi master: remove openstack link  https://review.openstack.org/43651715:58
*** donghao has joined #openstack-telemetry15:59
*** david-lyle has joined #openstack-telemetry16:02
*** david-lyle_ has quit IRC16:02
*** donghao has quit IRC16:04
openstackgerritHanxi Liu proposed openstack/ceilometer master: doc: update pipeline link  https://review.openstack.org/43651116:05
*** tlian has joined #openstack-telemetry16:12
*** Jack_Iv has quit IRC16:14
*** Jack_Iv has joined #openstack-telemetry16:14
*** thorst_ has joined #openstack-telemetry16:16
*** Jack_Iv has quit IRC16:16
*** Jack_Iv has joined #openstack-telemetry16:16
*** thorst has quit IRC16:17
*** shardy has joined #openstack-telemetry16:18
catintheroofgordc: perfect, but in the end, they all push to notifications.sample, so, when multiple notification-agent are deployed, they all read notifications.sample in an "coordinated" manner, and then where does the "multiple queues" kicks in ? (sorry that i ask so many questions, but i need to understand perfectly)16:19
*** david-lyle has quit IRC16:27
gordccatintheroof: there are two read steps in notification agent. first, it greedily grabs from notifications.* and normalises messages, it then sorts the normalised data into multiple queues for transformations.16:27
*** cdent has quit IRC16:27
gordcin theory, if you don't use transformations, you don't really need that 'multiple queue' step.16:27
gordcand you can launch multiple notification agents 'uncordinated'16:28
catintheroofgordc: i use loooots of transformations, so ... once it put the normalized message into multiple queues ? whata then ?16:29
*** cdent has joined #openstack-telemetry16:33
gordcwhen it's normalised, it will sort messages into one of the 'multiple queues' based resource_id. so all samples of resourceA will go to queueX. and then one of the notificatino agents will process that queue, transform the data, and sent it to gnocchi or whatever you set ast publisher16:34
*** david-lyle has joined #openstack-telemetry16:34
gordcso basically all the agents are listening to notifications.* and only one of the agents is listening to any of the internal 'multiple queues'.16:34
gordccatintheroof: i'm working on the docs. i'll add ^ to developer docs16:35
catintheroofgordc: great, can you let me know when you have a new version to i can take it a look ?16:46
gordccatintheroof: maybe this week... but i also said this 1+ years ago.16:47
gordc:/16:47
*** cdent has quit IRC16:50
*** lhx_ has quit IRC16:50
*** Jack_Iv_ has joined #openstack-telemetry16:51
*** Jack_Iv has quit IRC16:54
*** david-lyle has quit IRC16:58
*** thorst_ has quit IRC17:00
*** shardy has quit IRC17:01
*** thorst has joined #openstack-telemetry17:05
*** thorst has quit IRC17:07
*** thorst has joined #openstack-telemetry17:07
*** dave-mccowan has quit IRC17:08
*** pcaruana has quit IRC17:12
*** yassine_ has quit IRC17:12
*** david-lyle has joined #openstack-telemetry17:16
*** david-lyle has quit IRC17:16
*** tomoiaga1 has joined #openstack-telemetry17:19
*** thorst has quit IRC17:23
openstackgerritMerged openstack/ceilometer master: remove PaaS event format  https://review.openstack.org/43233617:24
*** thorst has joined #openstack-telemetry17:28
catintheroofgordc: :O17:28
*** thorst has quit IRC17:30
*** thorst has joined #openstack-telemetry17:32
gordccatintheroof: it'll be done soon. i've more motivation now.17:37
catintheroofgordc: i will be trying it during this week and begining of the next one, so ... i'll give you all the motivation you need XD17:38
gordccatintheroof: kk. no promises.17:39
*** tesseract has quit IRC17:41
stevellegordc: you accept bribes, right?17:45
*** thorst has quit IRC17:46
openstackgerritMerged openstack/ceilometer master: doc: update pipeline link  https://review.openstack.org/43651117:47
gordcstevelle: as long as everyone knows. got to keep it 'open' :P17:48
*** thorst has joined #openstack-telemetry17:51
*** sudipto has joined #openstack-telemetry17:54
*** sudipto_ has joined #openstack-telemetry17:54
*** thorst has quit IRC17:56
*** thorst has joined #openstack-telemetry17:56
*** sanfern has joined #openstack-telemetry17:59
openstackgerritMerged openstack/gnocchi master: remove openstack link  https://review.openstack.org/43651718:00
*** nadya has joined #openstack-telemetry18:04
*** dave-mccowan has joined #openstack-telemetry18:04
*** nadya has quit IRC18:05
*** sudipto has quit IRC18:05
*** sudipto_ has quit IRC18:05
*** sudipto_ has joined #openstack-telemetry18:05
*** sudipto has joined #openstack-telemetry18:06
*** sudipto_ has quit IRC18:07
*** sudipto has quit IRC18:07
*** shardy has joined #openstack-telemetry18:10
*** openstack has joined #openstack-telemetry18:14
*** shardy has quit IRC18:17
*** shardy has joined #openstack-telemetry18:17
*** cdent has joined #openstack-telemetry18:21
*** yprokule has quit IRC18:25
*** thorst_ has joined #openstack-telemetry18:27
*** thorst has quit IRC18:29
*** dave-mccowan has quit IRC18:32
*** dave-mccowan has joined #openstack-telemetry18:34
*** shardy has quit IRC18:34
*** tlian has quit IRC18:42
*** david-lyle has joined #openstack-telemetry18:46
*** cdent has quit IRC18:55
*** sanfern has quit IRC18:56
*** sanfern has joined #openstack-telemetry18:56
*** sanfern has quit IRC18:57
*** sanfern has joined #openstack-telemetry18:57
*** david-lyle has quit IRC18:57
alextricity25Hi all. I'm running ceilometer+aodh+gnocchi, but for some reason i'm still seeing that my metering.sample and event.sample queues are still growing in my messaging queues. How do I tell ceilometer not to publish to those queues now that I'm using gnocchi?18:59
*** sanfern has quit IRC19:01
gordcalextricity25: change your pipeline.yaml and event_pipeline.yaml19:02
gordcthe publishers should be gnocchi:// and not notifier://19:02
gordcif you do that, you shouldn't need collector either19:02
alextricity25gordc: That's easy :) I'll do that, flush out my queue, and see if it's still growing19:03
*** tlian has joined #openstack-telemetry19:05
*** thorst_ has quit IRC19:05
*** cdent has joined #openstack-telemetry19:08
*** cdent has quit IRC19:08
*** thorst has joined #openstack-telemetry19:09
*** dave-mccowan has quit IRC19:19
*** dave-mccowan has joined #openstack-telemetry19:21
*** tlian has quit IRC19:22
*** cdent has joined #openstack-telemetry19:22
*** cdent has quit IRC19:23
*** cdent has joined #openstack-telemetry19:24
*** thorst has quit IRC19:32
*** cdent has quit IRC19:36
*** dave-mccowan has quit IRC19:39
*** dave-mccowan has joined #openstack-telemetry19:41
*** thorst has joined #openstack-telemetry19:50
*** donghao has joined #openstack-telemetry19:51
*** donghao has quit IRC19:57
*** catintheroof has quit IRC20:01
*** chlong has quit IRC20:01
*** david-lyle has joined #openstack-telemetry20:01
*** chlong has joined #openstack-telemetry20:08
*** dave-mccowan has quit IRC20:12
*** Jack_Iv has joined #openstack-telemetry20:15
*** thorst_ has joined #openstack-telemetry20:21
*** david-lyle has quit IRC20:23
*** thorst has quit IRC20:23
*** tlian has joined #openstack-telemetry20:36
*** david-lyle has joined #openstack-telemetry20:38
*** tlian has quit IRC20:41
*** adriant has joined #openstack-telemetry20:44
*** tlian has joined #openstack-telemetry20:44
pradkgordc, jd_, we're seeing some issues with gnocchi  apache processes .. can you take a look at https://bugs.launchpad.net/tripleo/+bug/1666072/comments/1020:46
openstackLaunchpad bug 1666072 in tripleo "CI / SSL: 504 Gateway Time-out" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm)20:46
pradksagi did some investigation and found that apache threads from gnocchi are holding on and not letting other requests go through20:47
*** david-lyle has quit IRC20:49
*** nicodemus_ has quit IRC20:50
*** cdent has joined #openstack-telemetry20:51
gordcpradk: i don't use threads. i actually don't know how apache works but i always just use processes and set 1 thead.20:51
pradkwe set the  ApacheMaxRequestWorkers: 32 and gnocchi seems to be grabbing all20:51
gordci don't really have a suggestion (i'd just be googling myself) i also use uwsgi and still just set threads to 120:53
pradkhmm we set the threads to 1 in puppet .. https://github.com/openstack/puppet-gnocchi/blob/master/manifests/wsgi/apache.pp#L98 and compute the processes based on cpucount20:55
*** david-lyle has joined #openstack-telemetry20:56
pradkbut its seems to be grabbing all 32 which is the max limit still20:56
*** thorst_ is now known as thorst_afk20:56
gordclike all 32 processes? i wouldn't be entirely surprised. if you have collector i think it deploys 64threads worker.. so you have 64x posts at any given time?20:58
gordci think that's how it works logically (never tested)20:58
*** david-lyle has quit IRC20:59
*** shardy has joined #openstack-telemetry20:59
pradkright 32 processes.. if you see http://paste.openstack.org/show/599888/21:00
gordcyou don't use collector?21:01
gordci dont' really know how to read that21:01
pradkit should be there.. this is a ci deployment, so i dont know whats really running there21:02
gordci don't think there's any retry logic in api so not entirely sure it's gnocchi holding connection21:02
*** dave-mccowan has joined #openstack-telemetry21:22
openstackgerritJulien Danjou proposed openstack/python-gnocchiclient master: Improve authentication documentation  https://review.openstack.org/43668421:25
*** dave-mccowan has quit IRC21:29
*** fguillot has quit IRC21:30
*** shardy has quit IRC21:30
jd_pradk: "1) Investigate and solve it in gnocchi/ceilometer projects" lol21:36
jd_izi21:36
jd_pradk: I don't understand why /v1/capabilities/ makes it busy, the return is instantaneous21:36
jd_is there a dump of /server-status for real ?21:36
pradkyea thats whats weird.. capabilities is just retuning static data21:38
pradkdonno i can ask sagi21:38
jd_ah yeah I missed http://paste.openstack.org/show/599888/21:40
jd_so it looks like it's really blocked there21:40
jd_pradk: ah I know maybe21:40
jd_pradk: I wrote a comment with my idea21:43
*** Jack_Iv has quit IRC21:46
*** cdent has quit IRC21:48
pradkhmm interesting,  seems like a reasonable hypothesis21:48
*** thorst_afk has quit IRC21:51
gordcpradk: does rdo need ceilometerclient and pecan on compute node for ceilometer?22:00
gordci'm fixing this doc right now https://docs.openstack.org/project-install-guide/telemetry/draft/configure_services/nova/install-nova-rdo.html#install-and-configure-components22:01
*** thorst_afk has joined #openstack-telemetry22:03
*** thorst_afk has quit IRC22:04
*** flwang has quit IRC22:09
*** vint_bra has quit IRC22:09
*** dave-mccowan has joined #openstack-telemetry22:13
*** tlian has quit IRC22:15
*** flwang has joined #openstack-telemetry22:21
*** dave-mccowan has quit IRC22:24
openstackgerritgordon chung proposed openstack/ceilometer master: chill out on the number of items in toc  https://review.openstack.org/43670322:35
*** tlian has joined #openstack-telemetry22:40
*** vishwanathj has joined #openstack-telemetry22:45
*** tlian has quit IRC22:49
openstackgerritgordon chung proposed openstack/ceilometer master: remove collector instructions  https://review.openstack.org/43670922:55
*** rbak has quit IRC22:56
*** gordc has quit IRC22:56
*** tlian has joined #openstack-telemetry22:59
*** tlian has quit IRC23:18
*** ddyer has quit IRC23:27
*** donghao has joined #openstack-telemetry23:28
*** donghao has quit IRC23:32
openstackgerritMerged openstack/aodh master: Add keystoneauth1 in requirements  https://review.openstack.org/43553823:40
*** catintheroof has joined #openstack-telemetry23:53
alextricity25Are there any good tutorial/getting started guides for Panko?23:56
*** tlian has joined #openstack-telemetry23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!