Wednesday, 2018-11-14

*** psachin has joined #openstack-telemetry02:49
*** Bhujay has joined #openstack-telemetry03:53
*** Bhujay has quit IRC05:29
*** dave-mccowan has joined #openstack-telemetry06:01
openstackgerritOpenStack Proposal Bot proposed openstack/aodh master: Imported Translations from Zanata  https://review.openstack.org/61788206:06
*** threestrands has quit IRC06:34
*** gkadam has joined #openstack-telemetry07:12
*** dave-mccowan has quit IRC07:25
*** pcaruana has joined #openstack-telemetry07:42
*** cdent has joined #openstack-telemetry08:04
*** pvradu has joined #openstack-telemetry09:13
*** pvradu has quit IRC09:23
*** pvradu has joined #openstack-telemetry09:23
*** cdent has quit IRC09:43
*** Bhujay has joined #openstack-telemetry09:50
*** Bhujay has quit IRC09:51
*** Bhujay has joined #openstack-telemetry09:51
*** dave-mccowan has joined #openstack-telemetry09:54
*** cdent has joined #openstack-telemetry10:06
*** dave-mccowan has quit IRC10:07
ivveout of context, could anyone point me where to troubleshoot this kind of error: https://hastebin.com/cujidovoja.sql10:31
ivveit comes from gnocchi-metricd10:31
*** alexchadin has joined #openstack-telemetry10:49
jd_hi ivve11:04
jd_ivve: what's your coordination backend?11:04
ivvehi jd_11:04
ivveim using ceilometer, aodh and gnocchi so ceilometer11:05
ivveand store in ceph11:05
ivveyou think its a problem somewhere else?11:05
*** dave-mccowan has joined #openstack-telemetry11:06
ivvei have done tons of troubleshooting, so far i have tried different stuff with gnocchi.conf11:07
ivvei have tried purging my ceph pool and running gnocchi-upgrade. no issues with that and gnocchi-config is created11:07
ivvehowever im not exactly sure how that object should look like11:07
ivvebut contents look like this: {"sacks": 128}11:08
ivvetried running with debug for extra info, no cigar11:08
ivvetried installting tooz11:09
ivvegnocchi version is 7.0.211:09
ivvehow important is [incoming] in gnocchi.conf when using ceph? i only have the ceph settings in the [storage] stanza11:10
ivvejd_: im open for any suggestions and i can provide more logs/confs if needed11:11
jd_you did not answer my question11:11
jd_also gnocchi 7.0.2 does not exist, that's gnocchiclient version11:11
jd_you should put your coordination backend to redis or something like that11:12
ivveah11:12
jd_though it should not raise an error, so that's also a bug you should report :)11:13
ivveceph then, not using redis11:13
jd_you cannot use ceph as a coordinator11:14
jd_check your coordination_url  parameter in gnocchi.conf11:14
ivveguess i have a problem then11:14
ivve:)11:15
jd_if it's unset, set it to something like a Redis URL11:15
jd_(i'd suggest use redis for incoming too)11:15
ivveits strange because i checked exactly gnocchi.conf for two versions (kolla-ansible) and the difference in [incoming] is empty vs redis or empty11:16
ivveand the first one worked, meaning [incoming] was completely empty11:16
*** alexchadin has quit IRC11:16
ivvei guess i could redeploy and see the difference. im just so surprised it worked before and now it doesn't11:17
ivvejd_: so how would this even work? https://github.com/openstack/kolla-ansible/blob/stable/queens/ansible/roles/gnocchi/templates/gnocchi.conf.j211:18
ivvejd_: ill deploy a redis and deploy it, see if that solves it. thanks for the clue :)11:21
ivveredeploy gnocchi*11:21
*** dave-mccowan has quit IRC11:28
*** cdent has quit IRC11:36
*** cdent has joined #openstack-telemetry12:12
*** dave-mccowan has joined #openstack-telemetry12:25
ivvejd_: configured redis n all, now this :( https://hastebin.com/sehogaburu.sql12:38
ivvesomething tells me it can't load any incoming drivers at all, therefor previous setup also had issues12:40
ivvebtw, something i was under the impression is confirmed here12:41
ivvefrom gnocchi docs: By default, the incoming driver is configured to use the same value as the storage driver.12:42
ivvein my case ceph.. so ceph can't be incoming?12:42
ivvei've had it like that before.. and it worked :D12:42
ivvesorry im not an expert of gnocchi :)12:44
ivvealright i think i got it now. the default coordinator is tooz and incoming and outgoing backends are ceph12:52
ivvefunyn thing is first error message just whined about tooz12:52
ivveand now its whining about redis after i switched12:52
ivveso its the coordinator indeed that is broken. i will investigate further :)12:52
jd_you can have ceph as incoming, though it's not recommended12:56
jd_you can't have ceph as coordinator12:56
ivveim checking the docker files for tooz versions and trying to find the virtualenv12:56
ivvejd_: check, i didn't know the default was baked into metricd docker12:57
ivveand that it was tooz12:57
ivve:)12:57
ivveso tooz comes in the openstack-base image12:58
ivveand it looks like it doesn't install with ubuntu, which im using13:00
ivvebut panko is there13:00
ivvelets try with panko then :)13:00
ivvei love these kind of learning experience13:02
ivves13:02
*** Bhujay has quit IRC13:14
*** gmann has joined #openstack-telemetry13:22
*** openstackgerrit has quit IRC13:51
*** zigo has joined #openstack-telemetry13:56
*** dave-mccowan has quit IRC14:03
*** lemko has joined #openstack-telemetry14:46
*** gkadam has quit IRC14:58
*** cdent has quit IRC15:09
*** cdent has joined #openstack-telemetry15:12
*** pvradu has quit IRC15:47
*** dave-mccowan has joined #openstack-telemetry16:04
*** cdent has quit IRC16:06
*** irclogbot_3 has quit IRC16:07
*** irclogbot_3 has joined #openstack-telemetry16:08
*** dave-mccowan has quit IRC16:20
*** pcaruana has quit IRC16:29
*** cdent has joined #openstack-telemetry16:46
*** jmlowe has joined #openstack-telemetry16:52
*** psachin has quit IRC16:58
*** pcaruana has joined #openstack-telemetry17:11
*** cdent has quit IRC17:38
*** openstackgerrit has joined #openstack-telemetry17:55
openstackgerritRafael Folco proposed openstack/aodh master: DNM: Remove tripleo newton and ocata jobs  https://review.openstack.org/61800417:55
*** psachin has joined #openstack-telemetry18:12
*** psachin has quit IRC18:25
*** lemko has quit IRC19:19
ivvejd_: i had gnocchi 4.3.0, upgraded to 4.3.2 and ran gnocchi-upgrade and it solved my issue (tested with redis)19:48
*** jmlowe has quit IRC19:50
ivvejd_:  wierdly enough this is the same problem https://github.com/gnocchixyz/gnocchi/issues/96619:52
ivveanyways, im off to rebuild the container19:53
*** pcaruana has quit IRC19:54
*** threestrands has joined #openstack-telemetry21:32
*** dave-mccowan has joined #openstack-telemetry23:17

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!