Monday, 2017-11-06

*** oanson has quit IRC00:34
*** dave-mcc_ has joined #openstack-telemetry00:37
*** oanson has joined #openstack-telemetry00:42
*** sbezverk has joined #openstack-telemetry00:45
*** sbezverk has quit IRC00:50
*** sbezverk has joined #openstack-telemetry00:51
*** thorst has joined #openstack-telemetry00:58
*** thorst has quit IRC01:01
*** thorst has joined #openstack-telemetry01:02
*** thorst has quit IRC01:02
*** liusheng has quit IRC01:14
*** edmondsw has joined #openstack-telemetry01:20
*** sbezverk has quit IRC01:22
*** dave-mcc_ has quit IRC01:23
*** edmondsw has quit IRC01:48
*** edmondsw has joined #openstack-telemetry01:48
*** edmondsw has quit IRC01:49
*** edmondsw has joined #openstack-telemetry01:49
*** edmondsw has quit IRC01:54
*** edmondsw_ has joined #openstack-telemetry01:59
*** edmondsw_ has quit IRC01:59
*** dave-mccowan has joined #openstack-telemetry02:00
*** lhx__ has joined #openstack-telemetry02:30
*** sbezverk has joined #openstack-telemetry02:31
*** edmondsw has joined #openstack-telemetry02:36
*** edmondsw has quit IRC02:41
*** dave-mccowan has quit IRC02:46
*** daidv has joined #openstack-telemetry02:46
*** sbezverk has quit IRC02:52
*** dave-mccowan has joined #openstack-telemetry02:53
*** shardy has joined #openstack-telemetry02:58
*** thorst has joined #openstack-telemetry03:03
*** edmondsw has joined #openstack-telemetry03:13
*** edmondsw has quit IRC03:17
*** dave-mccowan has quit IRC03:18
*** thorst has quit IRC03:19
*** thorst has joined #openstack-telemetry03:19
*** thorst has quit IRC03:19
*** shardy has quit IRC03:21
*** dave-mccowan has joined #openstack-telemetry03:30
*** sbezverk has joined #openstack-telemetry03:37
*** edmondsw has joined #openstack-telemetry03:40
*** edmondsw has quit IRC03:41
*** rwsu has joined #openstack-telemetry03:49
*** sbezverk has quit IRC03:54
*** Tom has joined #openstack-telemetry03:55
*** Tommy-Tom has joined #openstack-telemetry03:55
*** Tom is now known as Guest4436103:56
*** dave-mccowan has quit IRC03:58
*** Tommy-Tom has quit IRC04:01
*** Tommy-Tom has joined #openstack-telemetry04:01
*** dave-mccowan has joined #openstack-telemetry04:03
*** Tommy-Tom has quit IRC04:05
*** thorst has joined #openstack-telemetry04:33
*** Tommy-Tom has joined #openstack-telemetry04:35
*** Guest44361 has quit IRC04:43
*** psachin has joined #openstack-telemetry04:54
*** Tom has joined #openstack-telemetry04:55
*** Tom is now known as Guest8444704:55
*** dave-mccowan has quit IRC04:56
*** Tommy-Tom has quit IRC04:56
*** Tommy-Tom has joined #openstack-telemetry04:56
*** Tommy-Tom has quit IRC04:57
*** Tommy-Tom has joined #openstack-telemetry04:57
*** zhurong has joined #openstack-telemetry05:11
*** dave-mccowan has joined #openstack-telemetry05:11
*** edmondsw has joined #openstack-telemetry05:21
*** Tommy-Tom has quit IRC05:55
*** Tommy-Tom has joined #openstack-telemetry05:56
*** Tommy-Tom has quit IRC05:59
*** Tommy-Tom has joined #openstack-telemetry05:59
*** thorst has quit IRC06:00
*** edmondsw has quit IRC06:02
*** edmondsw has joined #openstack-telemetry06:03
*** edmondsw has quit IRC06:07
*** dave-mccowan has quit IRC06:12
*** purplerbot has quit IRC06:13
*** purplerbot_ has joined #openstack-telemetry06:13
*** purplerbot_ is now known as purplerbot__06:13
*** purplerbot__ is now known as purplerbot06:13
*** Tommy-To_ has joined #openstack-telemetry06:13
*** Tommy-Tom has quit IRC06:14
*** tasdomas has quit IRC06:14
*** Tommy-To_ has quit IRC06:14
*** Tommy-Tom has joined #openstack-telemetry06:14
*** tasdomas has joined #openstack-telemetry06:15
*** sbezverk has joined #openstack-telemetry06:19
*** Tommy-To_ has joined #openstack-telemetry06:25
*** sbezverk has quit IRC06:26
*** BoJin has joined #openstack-telemetry06:27
*** Tommy-To_ has quit IRC06:29
*** Tommy-To_ has joined #openstack-telemetry06:29
*** Tommy-Tom has quit IRC06:31
*** psachin has quit IRC06:31
*** openstackgerrit has quit IRC06:31
*** john5223 has quit IRC06:31
*** john5223_ has quit IRC06:31
*** hughhalf has quit IRC06:31
*** edmondsw_ has joined #openstack-telemetry06:55
*** edmondsw_ has quit IRC06:59
*** iranzo has joined #openstack-telemetry07:00
*** iranzo has quit IRC07:00
*** iranzo has joined #openstack-telemetry07:00
*** edmondsw has joined #openstack-telemetry07:01
*** liusheng has joined #openstack-telemetry07:04
*** BoJin has quit IRC07:05
*** edmondsw has quit IRC07:05
*** spectr has joined #openstack-telemetry07:09
*** psachin has joined #openstack-telemetry07:12
*** openstackgerrit has joined #openstack-telemetry07:12
*** john5223 has joined #openstack-telemetry07:12
*** hughhalf has joined #openstack-telemetry07:12
*** john5223_ has joined #openstack-telemetry07:12
*** sbezverk has joined #openstack-telemetry07:15
*** zhurong has quit IRC07:17
*** edmondsw has joined #openstack-telemetry07:26
*** thorst has joined #openstack-telemetry07:27
*** sbezverk has quit IRC07:30
*** edmondsw has quit IRC07:30
*** thorst has quit IRC07:32
*** yprokule has joined #openstack-telemetry07:44
*** pcaruana has joined #openstack-telemetry07:47
*** Tommy-To_ has quit IRC07:51
*** Tommy-Tom has joined #openstack-telemetry07:52
*** Tommy-Tom has quit IRC07:54
*** Tommy-Tom has joined #openstack-telemetry07:54
*** zhurong has joined #openstack-telemetry07:59
*** Tommy-Tom has quit IRC08:05
*** Tommy-Tom has joined #openstack-telemetry08:06
*** Tommy-Tom has quit IRC08:11
*** lpigueiras has quit IRC08:14
*** tesseract has joined #openstack-telemetry08:17
*** Tommy-Tom has joined #openstack-telemetry08:29
*** AlexeyAbashkin has joined #openstack-telemetry08:33
openstackgerritMerged openstack/panko master: Support admin to get all events  https://review.openstack.org/49438208:36
*** sheel has joined #openstack-telemetry08:37
*** AlexeyAbashkin has quit IRC08:51
*** AlexeyAbashkin has joined #openstack-telemetry08:51
*** Guest84447 has quit IRC08:57
*** zhurong has quit IRC08:59
*** Tommy-Tom has quit IRC09:09
*** Tommy-Tom has joined #openstack-telemetry09:09
*** Tommy-Tom has quit IRC09:14
*** Tommy-Tom has joined #openstack-telemetry09:14
*** Tom has joined #openstack-telemetry09:14
*** Tom is now known as Guest6978209:15
openstackgerritMerged openstack/ceilometer master: Clarify that there is only one polling agent  https://review.openstack.org/51707409:18
*** openstackgerrit has quit IRC09:18
*** thorst has joined #openstack-telemetry09:28
*** Guest69782 has quit IRC09:38
*** AlexeyAbashkin has quit IRC10:00
*** nijaba has quit IRC10:02
*** AlexeyAbashkin has joined #openstack-telemetry10:02
*** AlexeyAbashkin has quit IRC10:06
*** nijaba has joined #openstack-telemetry10:09
*** nijaba has quit IRC10:09
*** nijaba has joined #openstack-telemetry10:09
*** Tommy-Tom has quit IRC10:36
*** thorst has quit IRC10:37
*** Tommy-Tom has joined #openstack-telemetry10:37
*** Tommy-Tom has quit IRC10:41
*** Tommy-Tom has joined #openstack-telemetry10:43
*** sheel has quit IRC10:46
*** Tommy-Tom has quit IRC10:47
*** AlexeyAbashkin has joined #openstack-telemetry11:06
*** zhurong has joined #openstack-telemetry11:08
*** edmondsw has joined #openstack-telemetry11:22
*** hoonetorg has quit IRC11:32
dr_gogeta86hi guys11:33
dr_gogeta86i'm troubleshooting some problems on my openstack installation11:34
*** hoonetorg has joined #openstack-telemetry11:48
*** AlexeyAbashkin has quit IRC11:52
*** Gautam_ has joined #openstack-telemetry11:54
*** AlexeyAbashkin has joined #openstack-telemetry11:55
*** openstackgerrit has joined #openstack-telemetry11:58
openstackgerritMerged openstack/ceilometer stable/pike: Remove direct publisher since it is deprecated  https://review.openstack.org/51718211:58
*** AlexeyAbashkin has quit IRC12:00
*** Gautam_ has quit IRC12:04
*** Gautam_ has joined #openstack-telemetry12:07
*** AlexeyAbashkin has joined #openstack-telemetry12:13
*** john5223 has quit IRC12:16
*** zhurong has quit IRC12:16
*** Gautam_ has quit IRC12:22
*** edmondsw has quit IRC12:31
*** john5223 has joined #openstack-telemetry12:32
*** AlexeyAbashkin has quit IRC12:34
*** Tommy-Tom has joined #openstack-telemetry12:36
*** Gautam_ has joined #openstack-telemetry12:48
*** gordc has joined #openstack-telemetry12:52
*** thorst has joined #openstack-telemetry12:56
*** Gautam__ has joined #openstack-telemetry13:00
*** Gautam_ has quit IRC13:02
*** lhx__ has quit IRC13:02
*** edmondsw has joined #openstack-telemetry13:05
*** catintheroof has joined #openstack-telemetry13:06
*** pcaruana has quit IRC13:08
*** edmondsw has quit IRC13:09
jd_dr_gogeta86: cool cool13:11
dr_gogeta86i've have major issues on my memory pollsters ...13:12
dr_gogeta86i dunno why happen13:12
*** catintheroof has quit IRC13:12
*** catintheroof has joined #openstack-telemetry13:14
dr_gogeta86i can't retrive nor memory nor cpu13:14
dr_gogeta86but checking with virsh all ok13:14
gordcdr_gogeta86: check your logs (specifically compute agent). that's the only way to debug your system.13:17
dr_gogeta86gordc, i'm digging it13:17
dr_gogeta86http://paste.openstack.org/show/625623/13:18
*** pcaruana has joined #openstack-telemetry13:20
jd_is not that a bug we fixed a while back? what's your version of ceilometer dr_gogeta86 ?13:21
dr_gogeta86newton13:21
dr_gogeta86can you point me to some review13:22
dr_gogeta86 ?13:22
*** evgenyl has quit IRC13:23
*** AndyWojo has quit IRC13:23
*** hogepodge has quit IRC13:23
*** AndyWojo has joined #openstack-telemetry13:24
*** evgenyl has joined #openstack-telemetry13:24
*** hogepodge has joined #openstack-telemetry13:24
dr_gogeta86jd_, the .py come from python-ceilometer-7.0.4-4.el7ost.noarch if it can help you13:25
jd_dr_gogeta86: this is 3 versions behind the latest stable for 7.x13:25
dr_gogeta86i see13:26
jd_dr_gogeta86: so yeah it seems there's a bug in reconnection that's been fixed a long time13:26
jd_upgrade first :)13:26
dr_gogeta86was updated on agoust13:26
dr_gogeta86if found a changelog i can ask for upgrade13:26
dr_gogeta86jd_, tnx in advance13:28
jd_you're welcome doc13:29
*** jmlowe has quit IRC13:31
dr_gogeta86found13:33
dr_gogeta86https://bugzilla.redhat.com/show_bug.cgi?id=145457613:33
openstackbugzilla.redhat.com bug 1454576 in openstack-ceilometer "ceilometer-polling: libvirt: QEMU Driver error : Domain not found: no domain with matching uuid" [Unspecified,Closed: errata] - Assigned to mabaakou13:33
*** Gautam__ has quit IRC13:35
*** Gautam_ has joined #openstack-telemetry13:37
*** lhx_ has joined #openstack-telemetry13:40
*** AlexeyAbashkin has joined #openstack-telemetry14:02
*** pcaruana has quit IRC14:05
Gautam_Hi jd_, w.r.t. Gnocchi Janitor worker working on file based backend driver, it seems that if there is no limit set on the file size set on the system, all the metric measures for an aggregation are being written in single file. So if I set timespan to 15 days and let Gnocchi running more than that, the older records are not removed, because all records beyond and before 15 days timespan are in same file.14:12
Gautam_What I have tried then is setting a ulimit on gnocchi user to something like 2KB, so that once the measure file gets filled to 2K, OS creates new file. Then Gnocchi Janitor worker can delete older records in the old file.14:12
Gautam_Not sure if this is right way of going about it. Do you have any other recommendations?14:13
jd_I don't think I understood the problem Gautam_14:13
jd_can you detail the _problem_?14:13
jd_and only that :)14:13
Gautam_So I am facing the issue that Janitor worker is not removing the old records beyond the timespan specified in archival policy. When I debugged it, I found that the OS ulimit for file size is set to unlimited. Since I have Gnocchi configured with File backend, the metric measures are being written to File. But since there is no ulimit, all records are being written to single file.14:15
*** AlexeyAbashkin has quit IRC14:16
Gautam_So when the time defined by timespan passes and Janitor worker runs to find files which have older records, it can not remove any, because all measures are in same metric measure file.14:16
*** Tommy-Tom has quit IRC14:16
*** Tommy-Tom has joined #openstack-telemetry14:17
Gautam_If I let the file size defined by ulimit let "unlimited", the file system can theoretically grow very huge as no records are going to get deleted.14:17
*** pcaruana has joined #openstack-telemetry14:17
gordcGautam_: that's not how the cleanup/purge works in gnocchi. it's not a ttl but rather it's how you define policy and the last data of the series.14:18
*** Tommy-Tom has quit IRC14:21
*** Tommy-Tom has joined #openstack-telemetry14:21
jd_Gautam_: I don't think you understand how the xpieration works14:22
jd_Gautam_: it's a number of point, not a timespan per-say14:23
jd_Gautam_: and no expiration is tied to $NOW; Gnocchi is a database that does not care about what time it is14:23
Gautam_jd_ : yeah, I thought of it as TTL. I am trying to understand again.14:23
jd_no prob14:23
Gautam_ok..14:23
*** spectr has quit IRC14:29
*** spectr has joined #openstack-telemetry14:30
*** Tommy-Tom has quit IRC14:39
*** edmondsw has joined #openstack-telemetry14:48
*** AlexeyAbashkin has joined #openstack-telemetry14:51
*** edmondsw has quit IRC14:52
*** Gautam_ has quit IRC15:04
openstackgerritgordon chung proposed openstack/ceilometer master: refresh agent if group membership changes  https://review.openstack.org/51733715:09
openstackgerritgordon chung proposed openstack/ceilometer master: refresh agent if group membership changes  https://review.openstack.org/51733715:11
*** AlexeyAbashkin has quit IRC15:15
*** jmlowe has joined #openstack-telemetry15:18
*** edmondsw has joined #openstack-telemetry15:19
openstackgerritgordon chung proposed openstack/ceilometer master: test why pipeline queues filling  https://review.openstack.org/51706615:21
*** edmondsw has quit IRC15:24
openstackgerritgordon chung proposed openstack/ceilometer master: revise doc of "workload_partitioning" and term "Notification Agents"  https://review.openstack.org/51564215:33
*** Gautam_ has joined #openstack-telemetry15:33
*** Tommy-Tom has joined #openstack-telemetry15:39
Gautam_jd_: I checked the archive policy again w.r.t. number of points.. seems to be removing old data fine. Thanks !15:46
jd_Gautam_: cool! :)15:47
*** edmondsw has joined #openstack-telemetry15:51
*** Gautam_ has quit IRC15:53
*** psachin has quit IRC15:53
*** edmondsw has quit IRC15:55
*** Guest30702 has quit IRC16:15
*** catintheroof has quit IRC16:19
*** Tommy-Tom has quit IRC16:22
gordcsileht: you know how oslo.messaging controls which queue it polls if there's multiple targets?16:34
silehtgordc, no idea16:35
gordcsileht: :(16:35
gordcseeing this a lot in gate: https://bugs.launchpad.net/ceilometer/+bug/172986516:35
openstackLaunchpad bug 1729865 in Ceilometer "partitioning queues not cleared" [Critical,New]16:35
gordci know that only one of the processes is getting all the queues but not sure if that's only reason why.16:37
*** itlinux has joined #openstack-telemetry16:42
*** edmondsw has joined #openstack-telemetry16:54
*** edmondsw has quit IRC16:58
*** pcaruana has quit IRC17:01
silehtgordc, for me it's up to rabbit to choice which message we got17:10
silehtand by default I think it's fifo17:10
*** tesseract has quit IRC17:10
*** catintheroof has joined #openstack-telemetry17:12
silehtgordc, https://www.rabbitmq.com/img/tutorials/python-five.png17:13
silehtgordc, this is what we do with oslo.messaging: https://www.rabbitmq.com/tutorials/tutorial-five-python.html17:14
*** catintheroof has quit IRC17:17
gordcsileht: ok. i'll search oslo.messaging for that17:19
gordcsileht: it does seem like it fails if the pipeline queues get assign to a single worker and passes if each agent gets assigned one17:20
silehtgordc, does the processes have multiple notification listener ?17:31
*** yprokule has quit IRC17:32
gordcsileht: no, not anymore. in newton/ocata, someone added a batch where it's a single listener and it listens to multiple queues.17:34
*** catintheroof has joined #openstack-telemetry17:37
*** catintheroof has quit IRC17:41
*** catintheroof has joined #openstack-telemetry17:56
openstackgerritgordon chung proposed openstack/ceilometer master: Revert "devstack: Set an optimal processing queue"  https://review.openstack.org/51804718:02
openstackgerritgordon chung proposed openstack/ceilometer master: Revert "devstack: Set an optimal processing queue"  https://review.openstack.org/51804718:03
openstackgerritgordon chung proposed openstack/ceilometer master: Revert "devstack: Set an optimal processing queue"  https://review.openstack.org/51804718:04
*** edmondsw has joined #openstack-telemetry18:05
*** edmondsw has quit IRC18:09
*** harlowja has joined #openstack-telemetry18:19
*** Tommy-Tom has joined #openstack-telemetry18:22
*** itlinux has quit IRC18:24
*** Tommy-Tom has quit IRC18:27
*** lhx_ has quit IRC18:49
*** itlinux has joined #openstack-telemetry18:50
*** sbezverk has joined #openstack-telemetry19:07
*** sbezverk has quit IRC19:08
openstackgerritMerged openstack/ceilometer master: Fix bug for ceilometer polling generates an exception  https://review.openstack.org/51719119:19
openstackgerritgordon chung proposed openstack/ceilometer stable/pike: Fix bug for ceilometer polling generates an exception  https://review.openstack.org/51809619:39
*** rwsu has quit IRC19:40
openstackgerritgordon chung proposed openstack/ceilometer master: libvirt: share disk device listing  https://review.openstack.org/51809719:42
openstackgerritgordon chung proposed openstack/ceilometer stable/ocata: Fix bug for ceilometer polling generates an exception  https://review.openstack.org/51809819:46
*** edmondsw has joined #openstack-telemetry19:52
*** edmondsw has quit IRC19:56
*** iranzo has quit IRC19:56
*** pcaruana has joined #openstack-telemetry19:57
*** pcaruana has quit IRC20:03
*** edmondsw has joined #openstack-telemetry20:12
*** sbezverk has joined #openstack-telemetry20:38
*** itlinux has quit IRC20:39
openstackgerritMerged openstack/ceilometer master: revise doc of "workload_partitioning" and term "Notification Agents"  https://review.openstack.org/51564220:39
*** sbezverk has quit IRC20:42
*** rwsu has joined #openstack-telemetry20:48
*** AlexeyAbashkin has joined #openstack-telemetry21:00
*** AlexeyAbashkin has quit IRC21:04
*** jmlowe has quit IRC21:04
*** edmondsw has quit IRC21:14
*** jmlowe has joined #openstack-telemetry21:17
*** Tommy-Tom has joined #openstack-telemetry21:22
*** jmlowe has quit IRC21:24
*** Tommy-Tom has quit IRC21:27
*** prodriguez83 has quit IRC21:44
*** dave-mccowan has joined #openstack-telemetry21:50
*** dave-mccowan has quit IRC21:51
*** catintheroof has quit IRC21:51
*** edmondsw has joined #openstack-telemetry21:59
*** dave-mccowan has joined #openstack-telemetry22:01
*** edmondsw has quit IRC22:02
*** dave-mcc_ has joined #openstack-telemetry22:05
*** dave-mccowan has quit IRC22:06
*** jmlowe has joined #openstack-telemetry22:12
*** thorst has quit IRC22:22
*** jmlowe has quit IRC22:23
*** edmondsw has joined #openstack-telemetry22:25
*** thorst has joined #openstack-telemetry22:25
*** edmondsw has quit IRC22:29
*** thorst has quit IRC22:30
*** pradk has quit IRC22:31
*** jmlowe has joined #openstack-telemetry22:46
openstackgerritgordon chung proposed openstack/ceilometer stable/ocata: Fix bug for ceilometer polling generates an exception  https://review.openstack.org/51809822:52
*** thorst has joined #openstack-telemetry22:54
*** dave-mcc_ has quit IRC22:56
*** rwsu has quit IRC22:56
*** thorst has quit IRC22:58
*** edmondsw has joined #openstack-telemetry23:10
*** jmlowe has quit IRC23:12
*** jmlowe has joined #openstack-telemetry23:13
*** edmondsw has quit IRC23:15
*** jmlowe has quit IRC23:15
*** jmlowe has joined #openstack-telemetry23:16
*** yassine has joined #openstack-telemetry23:20
*** yassine is now known as Guest2724223:20
*** dave-mccowan has joined #openstack-telemetry23:40
*** sbezverk has joined #openstack-telemetry23:47
*** edmondsw has joined #openstack-telemetry23:53
*** gordc has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!