Wednesday, 2017-05-17

*** thorst has joined #openstack-telemetry00:25
*** leitan has joined #openstack-telemetry00:25
*** thorst has quit IRC00:27
*** dixiaoli has joined #openstack-telemetry00:51
*** thorst has joined #openstack-telemetry00:57
*** daidv has joined #openstack-telemetry01:02
*** harlowja has quit IRC01:08
*** thorst has quit IRC01:16
*** tovin07_ has joined #openstack-telemetry01:26
*** dave-mccowan has quit IRC01:28
*** dixiaoli has quit IRC01:30
*** thorst has joined #openstack-telemetry01:31
*** thorst has quit IRC01:33
*** Kevin_Zheng has joined #openstack-telemetry01:36
*** gongysh has joined #openstack-telemetry01:47
*** dave-mccowan has joined #openstack-telemetry01:51
*** donghao has joined #openstack-telemetry01:52
*** donghao has quit IRC01:57
*** leitan has quit IRC02:04
*** leitan has joined #openstack-telemetry02:05
*** leitan has quit IRC02:05
*** leitan has joined #openstack-telemetry02:06
*** leitan has quit IRC02:10
*** thorst has joined #openstack-telemetry02:18
*** thorst has quit IRC02:19
*** thorst has joined #openstack-telemetry02:29
*** thorst has quit IRC02:29
*** liusheng has quit IRC02:39
*** vint_bra has joined #openstack-telemetry02:40
*** dave-mccowan has quit IRC02:42
*** vint_bra has quit IRC02:58
*** thorst has joined #openstack-telemetry03:00
*** liusheng_ has joined #openstack-telemetry03:12
*** thorst has quit IRC03:18
*** links has joined #openstack-telemetry03:43
*** links has quit IRC03:51
*** donghao has joined #openstack-telemetry03:54
*** links has joined #openstack-telemetry03:55
*** donghao has quit IRC03:59
*** thorst has joined #openstack-telemetry04:15
*** gongysh has quit IRC04:15
*** thorst has quit IRC04:20
*** links has quit IRC04:24
*** harlowja has joined #openstack-telemetry04:33
*** zhangguoqing has joined #openstack-telemetry04:40
*** gongysh has joined #openstack-telemetry04:53
*** links has joined #openstack-telemetry05:06
*** thorst has joined #openstack-telemetry05:16
*** thorst has quit IRC05:21
*** yprokule has joined #openstack-telemetry05:37
*** pcaruana has joined #openstack-telemetry05:48
*** harlowja has quit IRC05:54
*** liusheng_ has quit IRC06:12
*** liusheng_ has joined #openstack-telemetry06:13
*** thorst has joined #openstack-telemetry06:17
*** rcernin has joined #openstack-telemetry06:18
*** thorst has quit IRC06:22
*** gongysh has quit IRC06:31
*** liusheng_ has quit IRC06:34
*** gongysh has joined #openstack-telemetry06:43
*** mgagne has quit IRC06:53
*** mgagne has joined #openstack-telemetry06:56
*** mgagne is now known as Guest2410306:56
*** rcernin has quit IRC06:57
*** shardy has joined #openstack-telemetry07:06
*** rcernin has joined #openstack-telemetry07:12
*** thorst has joined #openstack-telemetry07:18
*** thorst has quit IRC07:22
*** rcernin has quit IRC07:29
*** rcernin has joined #openstack-telemetry07:35
*** rcernin has quit IRC07:35
*** rcernin has joined #openstack-telemetry07:35
*** ioggstream has joined #openstack-telemetry07:43
*** gongysh has quit IRC07:56
*** thorst has joined #openstack-telemetry08:18
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometermiddleware master: retrieve project id to ignore from keystone  https://review.openstack.org/46455908:23
*** thorst has quit IRC08:23
*** Drankis has joined #openstack-telemetry08:27
*** gongysh has joined #openstack-telemetry08:34
*** luisnho223 has joined #openstack-telemetry08:41
luisnho223hey guys. Anyone already worked with CloudKitty? I am using gnocchi as collector but it does not generate costs reports08:43
*** shardy has quit IRC08:53
silehtluisnho223, maybe asks on #cloudkitty channel08:54
*** shardy has joined #openstack-telemetry08:56
*** Tamayo has quit IRC08:57
*** gongysh has quit IRC09:14
*** gongysh has joined #openstack-telemetry09:15
*** thorst has joined #openstack-telemetry09:19
openstackgerritJulien Danjou proposed openstack/gnocchi master: Remove oslo.utils dependency  https://review.openstack.org/46500809:36
openstackgerritJulien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.fnmatch  https://review.openstack.org/46500609:36
openstackgerritJulien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.netutils  https://review.openstack.org/46500709:36
*** thorst has quit IRC09:39
*** links has quit IRC09:48
ioggstreamhi@all!09:53
ioggstreamon rhosp10 the default interval collection policy is 600sec, but the default metric archive-policy  is low, with granularity 30009:54
ioggstreamthis causes all alarms to ignore metrics!09:54
ioggstreamShouldn't be default archive-policy.low.granularity and ceilometer/pipeline.yaml:interval aligned ?09:55
*** tovin07_ has quit IRC09:56
*** links has joined #openstack-telemetry10:01
*** donghao has joined #openstack-telemetry10:01
*** donghao has quit IRC10:05
*** faizy has joined #openstack-telemetry10:14
*** daidv has quit IRC10:30
silehtioggstream, agreed the default looks bad10:33
ioggstreamsileht: yep :( How I could fix that?10:33
silehtioggstream, the 600 is historic, because when Ceilometer was using mongodb, putting less result to a disacter10:33
silehtioggstream, but with Gnocchi it's safer to lower the Ceilometer side10:34
silehtioggstream, you can change the /etc/ceilometer/polling.yaml and put less10:34
silehtat least some <= 30010:34
ioggstreamsileht: I read this article that sticks with 600 ...10:34
ioggstream(looking for it)10:34
ioggstreamsileht: https://access.redhat.com/solutions/297177110:35
*** thorst has joined #openstack-telemetry10:35
ioggstream(I'm on  newton )10:36
silehtioggstream, this article doesn't care about Aodh, I will propose to change the default10:37
silehtioggstream, we will see what other devs will thing about that10:38
ioggstreamsileht: that would be great10:38
ioggstreamsileht: being kb-backed is good10:39
ioggstream:)10:39
ioggstreamsileht: I work on top of openstack and I have to push my claims with the team that deployed it10:39
ioggstream(I'm openshift-on-openstack'ing)10:39
silehtioggstream, ok10:39
*** thorst has quit IRC10:40
ioggstreamsileht: feel free to spam me at will ;)10:40
silehtioggstream, We also have people that what to do autoscaling that complains about this default too10:40
ioggstreamsileht: I imagine ;)10:41
ioggstreamfor now I'll try to make them put 30010:42
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer master: Change default polling interval  https://review.openstack.org/46549910:43
-openstackstatus- NOTICE: gerrit is being restarted to help stuck git replication issues10:55
*** links has quit IRC11:05
*** gongysh has quit IRC11:18
*** gongysh has joined #openstack-telemetry11:18
*** gongysh has quit IRC11:19
*** cdent has joined #openstack-telemetry11:19
*** gongysh has joined #openstack-telemetry11:19
*** gongysh has quit IRC11:19
*** gongysh has joined #openstack-telemetry11:20
*** gongysh has quit IRC11:20
*** links has joined #openstack-telemetry11:22
*** iogg has joined #openstack-telemetry11:32
*** ioggstream has quit IRC11:32
*** Kevin_Zheng has quit IRC11:36
openstackgerritJulien Danjou proposed openstack/gnocchi master: Fix Carbonara compression with Cradox and LZ4 >= 0.9.2  https://review.openstack.org/46551911:36
*** Jack_Iv has joined #openstack-telemetry11:46
*** thorst has joined #openstack-telemetry11:46
*** gongysh has joined #openstack-telemetry11:49
*** donghao has joined #openstack-telemetry11:52
*** chlong has quit IRC11:57
*** donghao has quit IRC11:57
*** gongysh has quit IRC11:58
*** gordc has joined #openstack-telemetry12:00
*** luisnho223 has quit IRC12:00
*** luisnho223 has joined #openstack-telemetry12:17
*** vint_bra has joined #openstack-telemetry12:46
*** leitan has joined #openstack-telemetry12:54
*** fguillot has joined #openstack-telemetry12:56
*** zhangguoqing has quit IRC12:57
*** lamt has joined #openstack-telemetry12:58
openstackgerritMerged openstack/ceilometer master: Change default polling interval  https://review.openstack.org/46549913:01
*** Jack_Iv has quit IRC13:12
*** Jack_Iv has joined #openstack-telemetry13:12
*** Jack_Iv has quit IRC13:13
*** Jack_Iv has joined #openstack-telemetry13:13
*** Jack_Iv has quit IRC13:13
*** chlong has joined #openstack-telemetry13:15
*** lhx_ has joined #openstack-telemetry13:27
gordcjd_: i think there's the same blocking issue on single omap you and akrzos found from metricd pov as well.13:35
gordcseems metricd is much better with multiple buckets vs single bucket (unless there's a change we did to ceph recently)13:36
*** thorst is now known as thorst_afk13:36
akrzosgordc: I suspected there was but i haven't had the time to investigate yet13:37
akrzosso thats seems to confirm my suspicion13:37
akrzosthats promising to hear13:37
gordcakrzos: yeah, can't wait for your next benchmarks :)13:38
gordcakrzos: i wanted to followup, but do you have numbers on how many metrics you captured in your test?13:38
gordci think you said 55 metrics/instances?13:38
akrzoslet me grab that13:39
akrzosso the 10k test had 43 metrics/instance13:39
akrzosso my test with just booting instances without a network would create an instance and an instance disk resources13:40
akrzosthe instance had 30 metrics13:40
akrzosand the disk had 13 metrics13:40
luisnho223anyone already worked with cloudkitty? Nobody answers me in #cloudkitty channel13:40
akrzoswhen you add a nic into the picture you get 12 more metrics13:40
akrzosso instance + disk + nic is 55 metrics13:40
gordcakrzos: kk, that's pretty good then. my test was against 20K metrics, seems you're closer to 300K metrics in your test13:43
akrzosi was wondering if we could prune that down (The number of metrics) and maybe optimize some to a larger collection rate (greater time definition) if that would be desired by operators13:45
akrzosthat might get too much into the subjective realm though of what people consider billing vs capacity planning vs performance analysis13:46
gordcluisnho223: try the mailing list13:46
gordcakrzos: yeah, agreed. i'm kind of interested in storing more than 300K so i'm slightly biased and want to see you store more. :)13:47
*** lamt has quit IRC13:47
akrzosi'm not saying store less (win by reducing the work) but maybe we don't need certin metrics at a lower interval and maybe we can trade that for other metrics more frequently13:48
gordcakrzos: ah, yeah, we could do that. i imagine disk usage might be less important than memory usage13:52
gordcno idea how people have it configured in production.13:52
akrzosthat would be great data to have13:52
akrzoswhat production people are really looking for13:52
akrzosi know what i'm looking for so I'm partial to anything system metric wise and a 10s interval :)13:53
*** lamt has joined #openstack-telemetry13:53
*** Drankis has quit IRC13:55
*** donghao has joined #openstack-telemetry13:55
gordcakrzos: 10s interval? sure. let's aim for that.13:57
*** donghao has quit IRC14:00
*** luisnho223 has quit IRC14:00
gordcakrzos: oh, one more question. do you have details on your ceph cluster? how many OSDs, nodes, etc...14:00
akrzos12 nodes, 192 osds (16 osd disks, nvme for journal)14:01
*** iogg has quit IRC14:02
*** zhangguoqing has joined #openstack-telemetry14:02
*** vint_bra has quit IRC14:03
*** iogg has joined #openstack-telemetry14:03
*** p01nt3r75 has joined #openstack-telemetry14:04
*** vint_bra has joined #openstack-telemetry14:06
gordcakrzos: ... ok. i think it's safe to say i'm going to see any breakage with my 20OSD before you see anything on your end.14:07
akrzosyeah i would say so14:08
akrzosi have another small cluster this week14:08
akrzosi'm gonna stress some more14:08
akrzosi'd like togtry and get the latest metricd code on it14:08
akrzoss/togtry/to try14:08
gordccool. i have https://review.openstack.org/#/c/464757/ patch up... which gets rid of small objects for omap values... i'm testing it right now to see how many entries i can shove into omap before it keels over14:10
*** Tamayo has joined #openstack-telemetry14:11
*** Guest24103 is now known as mgagne14:32
*** mgagne has quit IRC14:32
*** mgagne has joined #openstack-telemetry14:32
*** iogg has quit IRC14:35
*** dave-mccowan has joined #openstack-telemetry14:38
*** links has quit IRC14:55
*** rcernin has quit IRC15:04
*** zhangguoqing has quit IRC15:04
*** zhangguoqing has joined #openstack-telemetry15:04
lhx_jd_, gordc, is there an etherpad discussion for Telemetry during the Boston Summit?15:08
*** zhangguoqing has quit IRC15:09
gordclhx_: nope. same as always. if you have requirements, contribute them. if you don't but want to contribute, fix bugs or work on roadmap items :)15:11
lhx_gordc, okay, the summit ended and my session work ended. So I have more time to work on Telemetry15:16
lhx_:)15:16
gordclhx_: good to hear!15:20
lhx_gordc, you may hear about this on Summit15:21
lhx_https://github.com/apolloliu/zcp15:21
gordclhx_: i actually missed that presentation. thanks for reminder15:22
gordclhx_: you send metrics to mongodb and pull it into zabbix>?15:22
silehtthat's soon overkill to have mongo in the middle :)15:23
gordcsileht: :) i didn't want to say it.15:23
silehtgordc, we do the same thing during a long time, so I can't really comment15:24
lhx_gordc, it's a simplified edition15:24
lhx_it just pull metrics from ceilometer or mongo15:25
lhx_I have added gnocchi handler to pull metrics to zabbix, but not synchronized to the community15:27
*** p01nt3r75 has quit IRC15:29
lhx_sieht, agree, mongo is not the trend15:30
lhx_sileht,15:30
openstackgerritJulien Danjou proposed openstack/gnocchi master: Remove oslo.utils dependency  https://review.openstack.org/46500815:30
openstackgerritJulien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.fnmatch  https://review.openstack.org/46500615:30
openstackgerritJulien Danjou proposed openstack/gnocchi master: Stop using oslo_utils.netutils  https://review.openstack.org/46500715:30
*** p01nt3r75 has joined #openstack-telemetry15:31
gordclhx_: you have a dependency on zabbix storage? i would probably just build a zabbix publisher? or even better, just use gnocchi :)15:31
*** donghao has joined #openstack-telemetry15:33
lhx_gordc, at least a zabbix server, we use zabbix api to display data15:33
lhx_I guess it has no dependency15:34
*** yprokule has quit IRC15:35
lhx_gordc, use gnocchi as zabbix storage?15:36
jd_that'd be cool15:37
*** donghao has quit IRC15:38
*** donghao has joined #openstack-telemetry15:39
lhx_jd_, it can also integrate with grafana.15:40
lhx_but the project seems have no much users15:40
openstackgerritJulien Danjou proposed openstack/gnocchi master: Fix Carbonara compression with Cradox and LZ4 >= 0.9.2  https://review.openstack.org/46551915:41
jd_lhx_: well you can have Gnocchi and Grafana so… :)15:41
lhx_jd_, haha, that's was written for the Liberty Ceilometer. but it's more scalability. Gnocchi and Grafana is a good direction.15:48
jd_lhx_: time to upgrade :p15:48
lhx_jd_, User is driving force, I have to see if there any user for it. :)15:49
jd_make sense :)15:50
* lhx_ nod15:51
*** pradk has quit IRC16:03
*** pradk has joined #openstack-telemetry16:10
*** pcaruana has quit IRC16:11
*** p01nt3r75 has quit IRC16:20
*** harlowja has joined #openstack-telemetry16:33
*** lhx_ has quit IRC16:54
openstackgerritMerged openstack/python-pankoclient master: add .gitignore file  https://review.openstack.org/46515817:00
*** donghao has quit IRC17:04
*** donghao has joined #openstack-telemetry17:04
*** donghao has quit IRC17:12
*** harlowja has quit IRC17:26
*** shardy has quit IRC17:32
*** leitan has quit IRC18:42
*** catintheroof has joined #openstack-telemetry18:59
catintheroofjd_: im having issues doing pyhton setup.py install with stable/3.0 -> https://pastebin.com/sdkWSneq19:05
catintheroofjd_: thoughts ?19:05
*** donghao has joined #openstack-telemetry19:10
*** donghao has quit IRC19:15
*** pradk has quit IRC19:28
jd_catintheroof: always use pip: pip install .19:29
jd_catintheroof: RTFM ;)19:29
*** harlowja has joined #openstack-telemetry19:39
openstackgerritJulien Danjou proposed openstack/gnocchi master: Remove oslo.utils dependency  https://review.openstack.org/46500819:43
*** pradk has joined #openstack-telemetry19:47
*** harlowja has quit IRC19:53
*** harlowja has joined #openstack-telemetry19:57
openstackgerritgordon chung proposed openstack/python-pankoclient master: remove unit tests against common code  https://review.openstack.org/46514419:59
openstackgerritgordon chung proposed openstack/python-pankoclient master: switch to use non-legacy SessionClient  https://review.openstack.org/46515719:59
openstackgerritgordon chung proposed openstack/python-pankoclient master: use extras  https://review.openstack.org/46514119:59
openstackgerritgordon chung proposed openstack/python-pankoclient master: move shell out of osc  https://review.openstack.org/46572519:59
*** harlowja has quit IRC20:00
*** vint_bra has quit IRC20:01
*** cdent has quit IRC20:05
*** vint_bra has joined #openstack-telemetry20:08
*** vint_bra has quit IRC20:22
*** vint_bra has joined #openstack-telemetry20:26
*** pradk has quit IRC20:27
*** fguillot has quit IRC20:27
*** pradk has joined #openstack-telemetry20:28
*** lamt has quit IRC20:33
*** lamt has joined #openstack-telemetry20:35
openstackgerritgordon chung proposed openstack/python-pankoclient master: move shell out of osc  https://review.openstack.org/46572520:36
openstackgerritgordon chung proposed openstack/python-pankoclient master: add panko shell  https://review.openstack.org/46573620:37
*** chlong has quit IRC20:52
*** catintheroof has quit IRC21:01
*** thorst_afk has quit IRC21:03
*** gordc has quit IRC21:08
*** donghao has joined #openstack-telemetry21:13
*** donghao has quit IRC21:17
*** agatea_ has joined #openstack-telemetry21:32
openstackgerritJulien Danjou proposed openstack/gnocchi master: redis: fix CLIENT_LIST_ARGS parsing  https://review.openstack.org/46574821:32
*** agatea_ has quit IRC21:44
*** aagate has joined #openstack-telemetry21:52
*** thorst_afk has joined #openstack-telemetry22:00
*** vint_bra has quit IRC22:00
*** harlowja has joined #openstack-telemetry22:02
*** aagate has quit IRC22:06
*** aagate has joined #openstack-telemetry22:08
*** aagate has quit IRC22:13
*** aagate has joined #openstack-telemetry22:13
*** aagate_ has joined #openstack-telemetry22:14
*** aagate_ has quit IRC22:14
*** aagate has quit IRC22:14
*** aagate has joined #openstack-telemetry22:14
*** aagate has quit IRC22:16
*** aagate has joined #openstack-telemetry22:16
*** rwsu has quit IRC22:17
*** harlowja has quit IRC22:18
*** aagate has quit IRC22:18
*** thorst_afk has quit IRC22:20
*** aagate has joined #openstack-telemetry22:27
*** leitan has joined #openstack-telemetry22:28
*** pradk has quit IRC22:51
*** lamt has quit IRC22:57
*** rwsu has joined #openstack-telemetry23:10
*** thorst_afk has joined #openstack-telemetry23:20
*** thorst_afk has quit IRC23:41
*** leitan has quit IRC23:43
*** vint_bra has joined #openstack-telemetry23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!