Thursday, 2019-10-10

*** mrunge has quit IRC01:33
*** mrunge has joined #openstack-telemetry01:39
*** mrunge has quit IRC01:46
*** mrunge has joined #openstack-telemetry01:48
*** threestrands has joined #openstack-telemetry02:13
*** openstackgerrit has joined #openstack-telemetry03:30
openstackgerritMerged openstack/aodh master: heat notifier: Fix getting unhealthy resource names  https://review.opendev.org/68752303:30
*** psachin has joined #openstack-telemetry03:34
openstackgerritLingxian Kong proposed openstack/aodh stable/train: heat notifier: Fix getting unhealthy resource names  https://review.opendev.org/68777103:37
*** dave-mccowan has quit IRC04:51
*** mbindlish has joined #openstack-telemetry05:05
*** pcaruana has joined #openstack-telemetry05:07
*** pcaruana has quit IRC05:35
*** threestrands has quit IRC06:36
*** threestrands has joined #openstack-telemetry06:36
*** threestrands has quit IRC06:41
*** soumplis has joined #openstack-telemetry06:43
*** pcaruana has joined #openstack-telemetry06:51
*** tesseract has joined #openstack-telemetry06:59
*** rcernin has quit IRC07:07
openstackgerritpengyuesheng proposed openstack/telemetry-tempest-plugin master: Sync Sphinx requirement  https://review.opendev.org/68780307:09
*** witek has joined #openstack-telemetry08:05
*** arxcruz|rover is now known as arxcruz08:11
*** witek has quit IRC08:42
*** witek has joined #openstack-telemetry09:29
*** witek has quit IRC10:13
openstackgerritRafael Weingärtner proposed openstack/ceilometer master: Create dynamic pollster feature  https://review.opendev.org/67703111:18
*** witek has joined #openstack-telemetry12:01
openstackgerritRafael Weingärtner proposed openstack/ceilometer master: Create dynamic pollster feature  https://review.opendev.org/67703112:39
openstackgerritjun923.gu proposed openstack/ceilometer master: Add hardware.ipmi.power metric collected  https://review.opendev.org/68788512:51
*** psachin has quit IRC13:15
*** dave-mccowan has joined #openstack-telemetry13:43
*** spsurya has joined #openstack-telemetry13:57
*** adriant has quit IRC14:29
*** adriant has joined #openstack-telemetry14:31
*** pcaruana has quit IRC14:39
*** dave-mccowan has quit IRC14:41
*** jmlowe has quit IRC14:45
*** jmlowe has joined #openstack-telemetry15:01
*** pcaruana has joined #openstack-telemetry15:01
joadavismbindlish: sorry for my slow response, its a strange week at work.  It could be another configuration issue. I'll see if I can dig up a reference15:17
mbindlishThanks joadavis !!15:19
*** jmlowe has quit IRC15:26
*** pcaruana has quit IRC15:26
*** witek has quit IRC15:36
joadavisMy first step would be to check your logs for any other errors, especially about being unable to connect to endpoints.15:39
*** dave-mccowan has joined #openstack-telemetry15:40
joadavisyou can also check if monasca is getting any metrics with 'monasca metric-list'.  I often then 'monasca metric-list | grep ceilometer -A 5 -B 7' to see if any of the metrics came from datasource: ceilometer15:40
joadavisThen I'd check configuration files.  Do you have a /etc/ceilometer/pipeline.yaml that specifies a publishers: -monasca:// url ?15:41
joadavisFWIW, there are some Troubleshooting notes on https://wiki.openstack.org/wiki/Ceilosca15:46
*** witek has joined #openstack-telemetry15:56
joadavis(which could use some beefing up)15:57
mbindlishmonasca is getting metrics from monasca metric-list but there is no metrics from datasource: ceilometer15:58
mbindlishYes pipeline.yaml has publisher for monasca15:59
joadavisWhich metrics are configured to publish to that monasca sink?  On my devstack I only have image.size, snapshot.size and volume.size configured16:07
mbindlishWhat I have found16:07
mbindlish File "/opt/stack/ceilometer/ceilometer/opts.py", line 113, in16:07
mbindlishOct 10 07:44:40 dev-queen-ceilosca ceilometer-agent-notification[31592]:     ('rgw_client', ceilometer.objectstore.rgw.CLIENT_OPTS),16:07
mbindlishOct 10 07:44:40 dev-queen-ceilosca ceilometer-agent-notification[31592]: AttributeError: 'module' object has no attribute 'CLIENT_OPTS'16:07
mbindlishceilometer services are failing and ceilometer notification is expecting  "CLIENT_OPTS' which was introduce from rocky but when I see the branch of ceilometer, it is showing stable/queens16:07
joadavisthat is odd. and ceilosca should not have any interaction with RGW16:08
*** witek has quit IRC16:09
mbindlish@joadavis yes  image.size, snapshot.size and volume.size  are configured on my devstack too. I am expecting image.size becomes visible in monasca metric-list. Also I created instance for image.size but still not get any metrics from ceilometer16:09
joadavisyes, my pipeline.yaml is just the default from https://opendev.org/openstack/monasca-ceilometer/src/branch/master/etc/ceilometer/ceilosca-devstack_pipeline.yaml16:10
joadavisoh, hmm. maybe then the rocky version of monasca-ceilometer isn't as compatible with the queens version of Ceilometer as I thought16:12
joadavishonestly, the team I was on at the time skipped from Pike to Rocky, so there wasn't any testing on Queens for Ceilosca16:13
joadavistypically we have tried to be backward compatible, but there must have been a change (the Rados gateway client) that changed in between versions that didn't get accounted for16:14
mbindlishseems like that, actually ceilometer services are not running after devstack successfull installation...reason as I mentioned above as traceback16:15
joadavisyeah, I should have mentioned to check that Ceilometer was running as a first step. :P16:15
joadavis so you have a few options.  Do you really need to run on the Queens release?16:16
mbindlishyes, actually we have to run on queens16:16
mbindlishIs there any way to proceed on it?16:17
joadavisyou could probably just hack the file and comment out that line, though I don't know what else you would need to hack16:17
mbindlishI have tried that, after then got another error16:18
mbindlishhttps://www.irccloud.com/pastebin/BM7FJyRs/16:18
joadavisI can take a quick look at the diff between mon-ceil in Pike and Rocky and compare to ceil Queens.  I don't have a ton of time, but can give it a try16:19
mbindlishyeah sure joadavis, I will also try to debug16:20
mbindlishthanks joadavis for your help !!16:21
joadavisWell, the good news is that when the monasca publisher commit is merged to Ceilometer this will be simpler in the U+ releases.16:22
mbindlishjoadavis: yes it is really good, i have seen your patch16:25
joadavisI have to give witek credit for incorporating some feedback to make it better16:26
mbindlishyeah witek work is prominent and appreciable16:28
*** jmlowe has joined #openstack-telemetry16:35
*** pcaruana has joined #openstack-telemetry16:40
joadavisjust to set expectations, I probably won't have anything useful to update until tomorrow earliest17:00
*** joadavis has quit IRC17:42
*** joadavis has joined #openstack-telemetry17:53
*** jmlowe has quit IRC18:22
*** mbindlish has quit IRC19:01
*** jmlowe has joined #openstack-telemetry19:03
*** pcaruana has quit IRC20:15
*** spsurya has quit IRC20:28
openstackgerritLingxian Kong proposed openstack/ceilometer master: Create dynamic pollster feature  https://review.opendev.org/67703120:48
*** tesseract has quit IRC20:53
*** ryn_eq has quit IRC21:44
*** ryn_eq has joined #openstack-telemetry21:55
*** jbadiapa has quit IRC22:02
*** rcernin has joined #openstack-telemetry22:46
openstackgerritLingxian Kong proposed openstack/ceilometer master: Create dynamic pollster feature  https://review.opendev.org/67703123:28

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!