Friday, 2017-06-09

*** thorst_afk has joined #openstack-telemetry00:00
*** thorst_afk has quit IRC00:33
*** thorst_afk has joined #openstack-telemetry00:42
*** thorst_afk has quit IRC00:43
*** zhurong has joined #openstack-telemetry00:49
*** leitan has joined #openstack-telemetry00:56
*** thorst_afk has joined #openstack-telemetry01:14
*** zhurong has quit IRC01:29
*** thorst_afk has quit IRC01:31
*** leitan has quit IRC01:32
*** leitan has joined #openstack-telemetry01:34
*** thorst_afk has joined #openstack-telemetry01:38
*** dave-mccowan has joined #openstack-telemetry01:38
*** thorst_afk has quit IRC01:44
*** r-daneel has quit IRC01:47
*** Tamayo has quit IRC01:59
*** zhurong has joined #openstack-telemetry02:04
*** thorst_afk has joined #openstack-telemetry02:06
*** thorst_afk has quit IRC02:06
*** thorst_afk has joined #openstack-telemetry02:37
openstackgerritMerged openstack/panko master: Fix the port for Panko API in devstack  https://review.openstack.org/47198002:38
*** leitan has quit IRC02:44
*** thorst_afk has quit IRC02:48
*** larainema has quit IRC03:02
*** larainema has joined #openstack-telemetry03:13
*** Jack_Iv has joined #openstack-telemetry03:18
*** Jack_Iv has quit IRC03:23
*** thorst_afk has joined #openstack-telemetry03:45
*** dave-mccowan has quit IRC03:47
*** thorst_afk has quit IRC04:04
*** links has joined #openstack-telemetry04:20
*** zhurong has quit IRC04:25
*** zhurong has joined #openstack-telemetry04:34
*** Jack_Iv has joined #openstack-telemetry04:55
*** links has quit IRC05:10
*** yprokule has joined #openstack-telemetry05:24
*** links has joined #openstack-telemetry05:26
*** Jack_Iv has quit IRC05:31
*** Jack_Iv has joined #openstack-telemetry05:32
*** Jack_Iv has quit IRC05:36
*** thorst_afk has joined #openstack-telemetry06:02
*** thorst_afk has quit IRC06:06
*** Jack_Iv has joined #openstack-telemetry06:37
*** tesseract has joined #openstack-telemetry06:53
*** zhurong has quit IRC06:55
*** zhurong has joined #openstack-telemetry06:56
*** shardy has joined #openstack-telemetry06:56
*** zhurong has quit IRC06:57
*** thorst_afk has joined #openstack-telemetry07:03
*** pcaruana has joined #openstack-telemetry07:05
*** thorst_afk has quit IRC07:07
*** links has quit IRC07:09
*** rcernin has joined #openstack-telemetry07:09
openstackgerritVu Cong Tuan proposed openstack/aodh master: Remove pbr warnerrors in favor of sphinx check  https://review.openstack.org/47254407:13
openstackgerritVu Cong Tuan proposed openstack/aodh master: Remove pbr warnerrors in favor of sphinx check  https://review.openstack.org/47254407:16
*** links has joined #openstack-telemetry07:25
openstackgerritVu Cong Tuan proposed openstack/ceilometer master: Remove pbr warnerrors in favor of sphinx check  https://review.openstack.org/47255307:28
*** Jack_Iv has quit IRC07:57
*** lhx__ has joined #openstack-telemetry07:59
*** thorst_afk has joined #openstack-telemetry08:03
*** thorst_afk has quit IRC08:23
*** cdent has joined #openstack-telemetry08:43
openstackgerritPallavi proposed openstack/ceilometer master: Fix html_last_updated_fmt for Python3.  https://review.openstack.org/47259008:46
openstackgerritVu Cong Tuan proposed openstack/aodh master: Remove pbr warnerrors in favor of sphinx check  https://review.openstack.org/47254408:48
openstackgerritZhangHongtao proposed openstack/aodh master: Fix html_last_updated_fmt for Python3.  https://review.openstack.org/47259909:17
*** thorst_afk has joined #openstack-telemetry09:20
*** thorst_afk has quit IRC09:24
*** links has quit IRC09:51
*** Guest77651 has quit IRC09:51
*** zhurong has joined #openstack-telemetry09:54
*** Guest77651 has joined #openstack-telemetry09:55
openstackgerritLingyong Xu proposed openstack/aodh master: Fix html_last_updated_fmt for Python3  https://review.openstack.org/47261309:55
*** links has joined #openstack-telemetry10:03
*** zhurong has quit IRC10:06
openstackgerritLingyong Xu proposed openstack/panko master: Fix html_last_updated_fmt for Python3  https://review.openstack.org/47262910:23
*** cdent has quit IRC10:29
*** cdent has joined #openstack-telemetry10:58
openstackgerritPallavi proposed openstack/panko master: Fix html_last_updated_fmt for Python3.  https://review.openstack.org/47264811:39
*** thorst_afk has joined #openstack-telemetry11:59
*** shardy has quit IRC12:08
*** shardy has joined #openstack-telemetry12:17
*** gordc has joined #openstack-telemetry12:38
*** catintheroof has joined #openstack-telemetry12:40
*** dave-mccowan has joined #openstack-telemetry12:43
*** shardy has quit IRC12:43
*** catintheroof has quit IRC12:45
*** catintheroof has joined #openstack-telemetry12:46
*** links has quit IRC12:48
*** shardy has joined #openstack-telemetry12:56
*** purplerbot has quit IRC13:16
*** purplerbot has joined #openstack-telemetry13:16
*** lhx__ has quit IRC13:21
*** chlong has joined #openstack-telemetry13:51
*** leitan has joined #openstack-telemetry13:55
*** tesseract has quit IRC14:16
*** tesseract has joined #openstack-telemetry14:23
*** cdent has quit IRC14:23
*** liusheng has quit IRC14:29
*** liusheng has joined #openstack-telemetry14:30
*** nicodemus_ has joined #openstack-telemetry14:32
*** yprokule has quit IRC14:41
bretontoday we use ceilometer to process events and panko to store them14:48
bretonhow reliable are these events?14:48
bretoncan i reconstruct all user's actions based on the events and be sure that i have not lost, for example, server shutdown?14:49
bretonwhat are the cases when an event gets lost?14:51
gordcbreton: the dataflow is nova generates notification on shutdown start -> queue -> ceilometer notification normalises -> queue -> ceilometer notification pushes it to panko -> db <- api14:52
gordcceilometer should requeue if it has an error14:52
gordcbut depends on how durable rabbitmq is i guess.14:53
*** cdent has joined #openstack-telemetry14:53
gordcbreton: i think rabbitmq guarantees at-least-once since we use acknowledgements in oslo.messaging so in theory it should reach storage.14:55
bretonok, more general question then. Do people rely on these events for billing? Or do they re-query nova each cycle?14:56
gordci think they usually bill on cpu, memory, disk usage... those are usually polled data.14:57
gordci think RAX used to use events for billing (which ended up being events in ceilometer) but that was years ago and i don't know what they do now.14:58
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted now to clear an issue arising from an unanticipated SSH API connection flood14:58
*** rbak has joined #openstack-telemetry15:05
*** rcernin has quit IRC15:08
*** rbak has quit IRC15:30
bretongordc: well, amazon charges based on instance count15:38
gordcbreton: that's unfortunate :P15:47
gordcbreton: i would say given the path the notification takes from nova to panko, i imagine it could get lost if things explode.15:48
*** rbak has joined #openstack-telemetry15:50
gordci know people use the polled data to in theory let you assume events (ie, if you don't have polled data, it's because vm isn't "running")15:50
*** rbak has quit IRC15:52
bretonwhat should explode then? How many controllers and what part of network?15:52
bretonand how do i know that things that are specific to message delivery got broken? Maybe something else will explode?15:54
bretonfor example, if mysql goes away, everything will explode loudly. No tokens, no project info, angry users calling support -- all easy to notice.15:55
jd_gordc: https://review.openstack.org/#/c/465009/ ?15:57
*** r-daneel has joined #openstack-telemetry16:01
gordcbreton: i think nova scheduler creates event https://github.com/openstack/nova/blob/5d95cb9dbca403790db4e9680919e6716fa5cb76/nova/compute/manager.py#L2092-L2094, and ceilometer-notification-agent normalises and pushes to panko16:01
gordcbreton: if rabbitmq goes away, you don't get event... if your panko db, in theory you should still get event (i believe)16:02
gordci should add disclaimer, there is no active resource on panko currently.16:03
gordcjd_: i wanted to get pankoclient up first.16:03
jd_gordc: you mean human?16:03
jd_gordc: "up"?16:03
gordcs/resource/humna/16:03
gordcjd_: https://review.openstack.org/#/q/project:openstack/python-pankoclient16:04
gordci'm going to merge it all. no one really cares anyways16:04
bretonyes, i understand that. But maybe if my company uses it, they will have to contribute :p16:04
breton> if your panko db, in theory you should still get event (i believe)16:05
bretonhow's that, if there is no rabbit?16:05
gordcbreton: i'd welcome that (not the false hope though :P)16:05
gordcbreton: by the time it gets to ceilometer-notification-agent it is basically pushing directly to whatever db you've configured for panko16:06
gordcit doens't push to panko http endpoint.16:06
jd_gordc: it's already up on PyPI so it's up to me…16:07
jd_gordc: I confirm I don't care :)16:07
bretonto get to ceilometer-notification-agent it needs rabbitmq, right?16:08
gordcbreton: right16:08
bretonok. Will https://github.com/openstack/nova/blob/5d95cb9dbca403790db4e9680919e6716fa5cb76/nova/compute/manager.py#L2092-L2094 fail with a traceback and set some kind of "Failed" state if rabbit is broken?16:10
gordcbreton: that i don't know. sorry16:11
openstackgerritMerged openstack/python-pankoclient master: switch to use non-legacy SessionClient  https://review.openstack.org/46515716:12
openstackgerritMerged openstack/python-pankoclient master: move shell out of osc  https://review.openstack.org/46572516:13
bretongordc: anyway, this is great, thanks! I guess there will be an exception, so things should be fine.16:26
gordcbreton: right. there should be an exception at some point if you do miss it in panko for some reason (except if rabbitmq implodes before the event can be picked up by ceilometer)16:31
*** vint_bra has joined #openstack-telemetry16:32
bretongordc: i understand that part in ceilometer well, but don't fully understand how things work in nova16:32
*** tesseract has quit IRC16:32
gordcyou and me both :)16:32
openstackgerritVictoria Martinez de la Cruz proposed openstack/ceilometer master: Add share create/delete/expand/shrink meters  https://review.openstack.org/47275216:33
*** pcaruana has quit IRC16:34
*** leitan has quit IRC16:44
*** rcernin has joined #openstack-telemetry16:45
*** leitan has joined #openstack-telemetry16:47
*** jmlowe_ has joined #openstack-telemetry17:01
*** jmlowe has quit IRC17:02
*** vint_bra has quit IRC17:17
*** leitan has quit IRC17:19
*** vint_bra has joined #openstack-telemetry17:22
openstackgerritgordon chung proposed openstack/python-pankoclient master: add panko shell  https://review.openstack.org/46573617:30
openstackgerritgordon chung proposed openstack/python-pankoclient master: clean up utils  https://review.openstack.org/46774517:30
openstackgerritMerged openstack/python-ceilometerclient master: Deprecate ceilometerclient  https://review.openstack.org/46500917:39
*** Tamayo has joined #openstack-telemetry17:42
*** prad_ has joined #openstack-telemetry17:43
*** liusheng has quit IRC17:50
*** liusheng has joined #openstack-telemetry17:51
*** leitan has joined #openstack-telemetry17:56
openstackgerritMerged openstack/python-pankoclient master: add panko shell  https://review.openstack.org/46573617:59
openstackgerritMerged openstack/python-pankoclient master: clean up utils  https://review.openstack.org/46774518:00
*** vint_bra has quit IRC18:11
*** vint_bra has joined #openstack-telemetry18:13
marcoarildoHy guys, I need to calculate the external traffic "in/out" "bandwidth" by project between a dates, someone knows what is the ceilometer "meter" ?18:26
gordcmarcoarildo: i'm not sure what external traffic means but i'm guessing no one in neutron channel answered you?18:51
*** leitan has quit IRC19:22
marcoarildogordc: Sorry my English is not soo good. I will explain different. I need to calculate the bandwidth traffic consumed per project using only Floating Ips.19:31
*** prad_ has quit IRC19:52
*** thorst_afk has quit IRC20:18
*** thorst_afk has joined #openstack-telemetry20:20
*** thorst_afk has quit IRC20:25
*** rbak has joined #openstack-telemetry20:32
*** thorst_afk has joined #openstack-telemetry20:39
*** thorst_afk has quit IRC20:43
*** gordc has quit IRC21:03
*** gordc has joined #openstack-telemetry21:08
*** shardy has quit IRC21:13
*** nicodemus_ has quit IRC21:20
*** chlong has quit IRC21:58
*** dave-mccowan has quit IRC22:06
*** dave-mccowan has joined #openstack-telemetry22:07
*** rcernin has quit IRC22:19
*** rbak has quit IRC22:20
*** r-daneel has quit IRC22:34
*** vint_bra has quit IRC22:35
*** catintheroof has quit IRC22:42
*** Guest77651 has quit IRC23:17
*** Guest77651 has joined #openstack-telemetry23:26
*** leitan has joined #openstack-telemetry23:38
*** gordc has quit IRC23:40
*** cdent has quit IRC23:44

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!