Monday, 2015-07-20

*** promulo_ has joined #openstack-ceilometer00:18
*** primechuck has joined #openstack-ceilometer00:20
*** promulo__ has quit IRC00:22
*** changbl has joined #openstack-ceilometer01:17
*** changbl has quit IRC01:25
*** changbl_ has joined #openstack-ceilometer01:36
*** changbl has joined #openstack-ceilometer01:38
*** lan has joined #openstack-ceilometer01:39
*** changbl_ has quit IRC01:43
*** ddieterly has quit IRC01:43
*** ankita_wagh has quit IRC01:46
*** deepthi has joined #openstack-ceilometer01:47
*** changbl has quit IRC01:49
*** lexholden has quit IRC01:51
*** liusheng has joined #openstack-ceilometer02:03
*** Kennan2 has joined #openstack-ceilometer02:05
*** Kennan has quit IRC02:05
*** Kennan2 is now known as Kennan02:07
openstackgerritMerged openstack/ceilometer: Add necessary executable permission  https://review.openstack.org/20235302:11
openstackgerritMerged openstack/ceilometer: Updated from global requirements  https://review.openstack.org/20065902:12
*** changbl has joined #openstack-ceilometer02:17
*** ankita_wagh has joined #openstack-ceilometer02:39
*** ddieterly has joined #openstack-ceilometer02:44
*** primechuck has quit IRC02:46
*** ddieterly has quit IRC02:48
*** ddieterly has joined #openstack-ceilometer03:11
*** ankita_wagh has quit IRC03:25
*** ankita_wagh has joined #openstack-ceilometer03:41
*** ankita_wagh has quit IRC03:41
*** ankita_wagh has joined #openstack-ceilometer03:42
*** swann has quit IRC03:48
*** liusheng has quit IRC04:06
*** liusheng has joined #openstack-ceilometer04:06
*** htruta has quit IRC04:15
*** ddieterly has quit IRC04:17
*** changbl has quit IRC04:19
*** changbl has joined #openstack-ceilometer04:33
*** swann has joined #openstack-ceilometer04:36
*** ankita_w_ has joined #openstack-ceilometer04:42
*** ankita_wagh has quit IRC04:46
*** yprokule has joined #openstack-ceilometer04:58
*** ddieterly has joined #openstack-ceilometer05:18
*** ddieterly has quit IRC05:22
*** rex_lee has quit IRC05:35
*** serverascode has quit IRC05:35
*** h00327910_ has quit IRC05:36
*** chinmay_g has quit IRC05:36
*** serverascode has joined #openstack-ceilometer05:39
*** cmyster has quit IRC05:39
*** cmyster has joined #openstack-ceilometer05:40
*** h00327910_ has joined #openstack-ceilometer05:48
*** rex_lee has joined #openstack-ceilometer05:49
*** chinmay_g has joined #openstack-ceilometer05:51
*** ankita_w_ has quit IRC05:55
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometer: Imported Translations from Transifex  https://review.openstack.org/20289106:10
*** lsmola has joined #openstack-ceilometer06:12
*** ddieterly has joined #openstack-ceilometer06:19
*** ddieterly has quit IRC06:23
*** eglynn__ has joined #openstack-ceilometer06:27
*** boris-42 has joined #openstack-ceilometer06:38
*** cmyster has left #openstack-ceilometer06:39
*** _nadya_ has joined #openstack-ceilometer06:43
*** ankita_wagh has joined #openstack-ceilometer06:44
*** eglynn__ has quit IRC06:47
*** afazekas_ has joined #openstack-ceilometer07:09
*** ildikov has quit IRC07:11
*** shardy has joined #openstack-ceilometer07:15
*** ddieterly has joined #openstack-ceilometer07:20
*** ddieterly has quit IRC07:24
_nadya_prad: hi Pradeep! I have one question about declarative notifications. What's the plan? Will we migrate all plugins into declarative stuff and remove code from plugins?07:28
*** tshtilma has joined #openstack-ceilometer07:28
*** jasonamyers has quit IRC07:31
*** rex_lee has quit IRC07:31
*** zhiyan has quit IRC07:31
*** serverascode has quit IRC07:31
*** Ala has joined #openstack-ceilometer07:34
*** belmoreira has joined #openstack-ceilometer07:36
*** jasonamyers has joined #openstack-ceilometer07:38
*** ildikov has joined #openstack-ceilometer07:38
*** ankita_wagh has quit IRC07:39
*** pcaruana has quit IRC07:42
*** zhiyan has joined #openstack-ceilometer07:48
*** safchain has joined #openstack-ceilometer07:55
*** eglynn__ has joined #openstack-ceilometer07:55
*** serverascode has joined #openstack-ceilometer07:57
*** rex_lee has joined #openstack-ceilometer08:01
*** eglynn__ has quit IRC08:02
*** eglynn__ has joined #openstack-ceilometer08:03
*** ddieterly has joined #openstack-ceilometer08:21
*** ddieterly has quit IRC08:25
*** belmoreira has quit IRC08:30
*** Ala has quit IRC08:36
*** pcaruana has joined #openstack-ceilometer08:43
*** shardy_ has joined #openstack-ceilometer08:44
*** shardy has quit IRC08:45
*** Ala has joined #openstack-ceilometer08:47
*** eglynn__ has quit IRC08:47
*** shardy_ has quit IRC08:49
*** shardy has joined #openstack-ceilometer08:50
*** eglynn__ has joined #openstack-ceilometer09:04
*** eglynn__ has quit IRC09:13
*** ddieterly has joined #openstack-ceilometer09:21
openstackgerritMerged openstack/ceilometer: add Trove(DBaaS) events  https://review.openstack.org/20074609:24
*** ddieterly has quit IRC09:26
*** belmoreira has joined #openstack-ceilometer09:48
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: return 410 if only Gnocchi is enabled  https://review.openstack.org/20292509:56
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: Redirect request to aodh if available  https://review.openstack.org/20292609:56
*** lexholden has joined #openstack-ceilometer09:57
*** shardy_ has joined #openstack-ceilometer10:03
*** shardy has quit IRC10:04
*** shardy_ has quit IRC10:08
*** shardy has joined #openstack-ceilometer10:09
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API  https://review.openstack.org/20258910:10
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Improves send_test_data tools  https://review.openstack.org/20336610:10
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Adds batch dispatcher  https://review.openstack.org/20334910:10
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: concurrency post resource/measures  https://review.openstack.org/20355310:10
*** Ala has quit IRC10:14
*** tshtilma has quit IRC10:16
*** belmoreira has quit IRC10:16
*** ddieterly has joined #openstack-ceilometer10:22
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API  https://review.openstack.org/20258910:26
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Improves send_test_data tools  https://review.openstack.org/20336610:26
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Adds batch dispatcher  https://review.openstack.org/20334910:26
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: concurrency post resource/measures  https://review.openstack.org/20355310:26
*** ddieterly has quit IRC10:27
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API  https://review.openstack.org/20258910:28
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Improves send_test_data tools  https://review.openstack.org/20336610:28
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Adds batch dispatcher  https://review.openstack.org/20334910:28
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: concurrency post resource/measures  https://review.openstack.org/20355310:28
*** tshtilma has joined #openstack-ceilometer10:35
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: return 410 if only Gnocchi is enabled  https://review.openstack.org/20292510:39
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: Redirect request to aodh if available  https://review.openstack.org/20292610:39
*** yprokule has quit IRC10:52
*** yprokule has joined #openstack-ceilometer10:52
openstackgerritliusheng proposed openstack/python-ceilometerclient: Add support for client redirecting to aodh endpoint if available  https://review.openstack.org/20293810:52
openstackgerritMerged openstack/ceilometer: Switch to the oslo_utils.fileutils  https://review.openstack.org/19951510:55
*** eglynn-officeafk has joined #openstack-ceilometer10:56
*** cdent has joined #openstack-ceilometer11:02
*** tshtilma has quit IRC11:05
*** ig0r_ has joined #openstack-ceilometer11:08
*** ViswaV has joined #openstack-ceilometer11:11
*** tshtilma has joined #openstack-ceilometer11:15
*** boris-42 has quit IRC11:22
*** ddieterly has joined #openstack-ceilometer11:23
*** ddieterly has quit IRC11:27
*** ViswaV has quit IRC11:34
*** ViswaV has joined #openstack-ceilometer11:37
*** thorst has joined #openstack-ceilometer11:40
*** liusheng has quit IRC11:47
*** liusheng has joined #openstack-ceilometer11:48
*** julim has joined #openstack-ceilometer11:56
*** gordc has joined #openstack-ceilometer11:56
jasonamyersgood morning11:57
*** eglynn__ has joined #openstack-ceilometer12:00
*** ig0r_ has quit IRC12:05
*** changbl has quit IRC12:09
*** ViswaV has quit IRC12:12
*** eglynn__ has quit IRC12:12
*** gordc has quit IRC12:17
*** gordc has joined #openstack-ceilometer12:17
*** htruta has joined #openstack-ceilometer12:18
*** ddieterly has joined #openstack-ceilometer12:24
*** ddieterly has quit IRC12:28
*** edmondsw has joined #openstack-ceilometer12:29
openstackgerritChris Dent proposed openstack/ceilometer: Pollsters now send notifications without doing transforms  https://review.openstack.org/19886512:33
*** Ala has joined #openstack-ceilometer12:37
*** deepthi has quit IRC12:37
*** edmondsw has quit IRC12:40
*** cmyster has joined #openstack-ceilometer12:49
*** cmyster has joined #openstack-ceilometer12:49
*** yprokule has quit IRC12:53
*** deepthi has joined #openstack-ceilometer12:54
*** cmyster has quit IRC12:58
*** yprokule has joined #openstack-ceilometer12:59
*** lexholden has quit IRC13:06
*** changbl has joined #openstack-ceilometer13:09
*** pradk has joined #openstack-ceilometer13:17
*** edmondsw has joined #openstack-ceilometer13:18
*** primechuck has joined #openstack-ceilometer13:22
cdentgordc: gave you another response on that caching stuff. you didn't freak out about gnocchi not having metadata so I wonder if you noticed that part of my comments, so I made it again more visibly...13:22
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object initial patch  https://review.openstack.org/17867513:26
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object for Alarm and AlarmChange model  https://review.openstack.org/18090813:26
gordccdent: yeah, i got the metadata part.13:27
cdentaight den13:27
gordctbh, i'm thinking of it's just best to use generic resource for gnocchi (no metadata)13:28
*** boris-42 has joined #openstack-ceilometer13:28
gordccdent: have you seen the sql backend how we hash resource?13:30
cdentI've not looked at closely13:30
cdentwhy?13:30
gordci think your plan is what we tried in cache but had to push to db. (sql db)13:31
cdentbecause of the change in metadata handling in gnocchi, the resource attributes are far easier to hash13:32
gordcbased on last statement, it seems your solution is gnocchi specific, so the caching bit becomes a bit easier.13:32
cdentno nested dicts or other non-atomic stuff13:32
gordcit wasn't that difficult to hash for sql solution, only drawback was we might get some false collisions due to size of what we're hashing.13:33
gordcor theorectically we could. i don't know how that translate to real life.13:33
gordcbut have we settled that the patching is the part that is actually slow in the gnocchi dispatcher?13:34
cdentI have this vague sense that we're still sort of not really talking about all the same stuff here.13:34
gordcor is it the updating storage part.13:34
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Convert identity, sahara and image to meters yaml  https://review.openstack.org/20303113:35
cdentI don't know what we've settled on but I do know what we've discovered:13:35
cdentboth _create_resource and _update_resource are called redundantly, several times, per-resource, per-polling/notification cycle13:35
cdentand we know that http overhead is significant13:35
gordccdent: right. so another reason why i brought up sql was we had similar write issues.13:36
cdentthat POC that I've posted is simply to solve that one problem, not come up with a one size fits all solution to everything13:37
cdentbecause those kinds of solutions are what leads to stuff either never working or never being created13:37
gordcone thing we did was we store hash (in db) so we do basically your poc proposal but not cache (because of support across all db issue i mention)13:37
gordci brought up sql backen because the design and notes there probably might help13:38
cdentin a sense an etag is a bit like in-db-storage of hash if you think of the gnocchi-api as the db13:39
cdent"probably might help" what?13:39
gordccdent: yeah, that's what i figured when i read doc13:39
cdentwhat is it that needs help?13:39
gordcgive some ideas of stuff write issues we ran into originally.13:40
cdentENOPARSE13:40
cdent(I'm not being intentionally obtuse or anything here, legitimately confused on what you're trying to convey)13:41
gordci don't know what enoparse means.13:41
cdentError No Parse13:41
cdentI'm unable to parse what you are saying13:41
*** jdandrea has joined #openstack-ceilometer13:42
gordci was just saying we write issues in sql and we did certain things to fix them in that driver. maybe it will help with gnocchi13:42
gordcor not. just a suggestion.13:42
cdentIs that a suggestion specific to the use/implementation of caching in that patchset or just a general comment on making dispatch-to-gnocchi better?13:43
gordcgeneral comment.13:43
cdentah, okay, that makes more sense. I thought you were drawing a more direct connection13:43
cdentand couldn't quite figure out what that connection was13:44
*** yassine__ has joined #openstack-ceilometer13:44
*** yassine__ has quit IRC13:45
cdentsileht: you still have several dispatch-to-gnocchi patches pending, yeah? If that's the case there's no point trying to make the caching stuff "correct" yet. Once that stabilizes, we can look again perhaps13:45
*** yassine__ has joined #openstack-ceilometer13:45
*** rbak has joined #openstack-ceilometer13:50
*** exploreshaifali has joined #openstack-ceilometer13:50
silehtcdent, especially this one: https://review.openstack.org/#/c/202589/13:54
* cdent nods13:55
* cdent stills thinks we should cache all the things all the time everywhere ;)13:55
cdentotherwise we can't really claim to be cool13:56
*** shardy_ has joined #openstack-ceilometer13:56
*** shardy has quit IRC13:57
gordcsileht: is there going to be an oslo.messaging release soon?13:57
silehtI done some testing with my pile of patches, remove the PATCH when is not usefull would really incrase performance13:57
gordcsileht: that's great to hear.13:57
gordccdent: are you planning on doing that next cycle?13:58
silehtgordc, I'm waiting for dims_ for a last patch and then we can really a new oslo.msg13:58
gordcsileht: awesome!13:58
cdentgordc: next cycle I'm going to remove all the stevedore extensions13:58
*** yprokule has quit IRC13:58
gordcso caching this cycle?13:59
cdentno way man, I'm just going to have ideas and let other people do the work13:59
* gordc walks away13:59
silehtcdent, gordc my quick test was to inject 2000 random samples from 10 resources13:59
silehtwith PATCH : 2m15, without PATH: 1m2014:00
silehtthe metadata of the resource was always the same, so it wasn't usefull to send them to gnocchi14:00
cdentgordc: I'm happy to do caching this time around if it makes sense, but I dont want to do it just cuz, I'd like us to chat about, see if it makes sense, etc14:00
gordcsileht: 2000 different metric types?14:00
*** yprokule has joined #openstack-ceilometer14:00
silehtgordc, just 'instance' from the tool 'send_test_data.py'14:01
*** shardy_ has quit IRC14:01
cdentgordc: so since _not_ having caching in there yet is causing sileht to do cool and interesting things, we best wait14:01
gordcsileht: kk. i'll give your patch a try locally. my devstack is a lot slower. :(14:01
*** shardy has joined #openstack-ceilometer14:02
silehtgordc, for my tests I have used the 'batch dispatcher' with size=128 (yes I have finally write it :p)14:02
gordccdent: makes sense. i just asked because last time i tried to do caching was in August, i ran out of time. so if someone were to start, they need to do it now.14:03
gordcsileht: ah cool.14:03
openstackgerritChris Dent proposed openstack/ceilometer: Pollsters now send notifications without doing transforms  https://review.openstack.org/19886514:09
*** cmyster has joined #openstack-ceilometer14:12
*** pradk has quit IRC14:13
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: reduce the number of patch to gnocchi API  https://review.openstack.org/20258914:15
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Improves send_test_data tools  https://review.openstack.org/20336614:15
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Adds batch dispatcher  https://review.openstack.org/20334914:15
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: concurrency post resource/measures  https://review.openstack.org/20355314:15
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Move gnocchi resources definition in yaml file  https://review.openstack.org/20250014:15
*** rex_lee_ has joined #openstack-ceilometer14:38
*** Taytay has joined #openstack-ceilometer14:38
*** _nadya_ has quit IRC14:40
gordcsileht: if i create a new pool. and the consumer of the pool dies/leaves, that queue will continue to grow right? there's no way to kill a queue from pool.14:40
silehtgordc, right, you have to use rabbitmq admin tools14:41
*** krotscheck_ has joined #openstack-ceilometer14:41
*** krotscheck has quit IRC14:42
*** swamireddy_ has quit IRC14:42
*** rex_lee has quit IRC14:42
*** pasquier-s has quit IRC14:42
*** sudorandom has quit IRC14:42
*** mstyne has quit IRC14:42
*** briancline has quit IRC14:42
*** eglynn-officeafk has quit IRC14:42
*** titilambert has quit IRC14:42
*** briancline has joined #openstack-ceilometer14:42
*** sudorandom has joined #openstack-ceilometer14:42
*** mstyne has joined #openstack-ceilometer14:42
*** krotscheck_ is now known as krotscheck14:42
*** rex_lee_ is now known as rex_lee14:42
gordcsileht: kk. i will continue brainstorming.14:43
*** swamireddy has joined #openstack-ceilometer14:43
*** pasquier-s has joined #openstack-ceilometer14:43
*** ddaskal has joined #openstack-ceilometer14:55
*** lexholden has joined #openstack-ceilometer14:58
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: return 410 if only Gnocchi is enabled  https://review.openstack.org/20292514:59
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: Redirect request to aodh if available  https://review.openstack.org/20292614:59
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Allow to enforce API behavior without keystone  https://review.openstack.org/20368915:00
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Allow to enforce API behavior without keystone  https://review.openstack.org/20368915:01
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: return 410 if only Gnocchi is enabled  https://review.openstack.org/20292515:03
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: Allow to enforce API behavior without keystone  https://review.openstack.org/20368915:03
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer: api: Redirect request to aodh if available  https://review.openstack.org/20292615:03
*** exploreshaifali has quit IRC15:16
*** jwcroppe_ is now known as jwcroppe15:19
*** deepthi has quit IRC15:24
*** rjaiswal has joined #openstack-ceilometer15:34
*** tongli has joined #openstack-ceilometer15:35
*** lexholden has quit IRC15:37
jasonamyerswhy is it every time I touch devstack it feels like starting over...15:38
jasonamyersguess I've gotten to used to kolla containers15:38
gordcnever update15:38
jasonamyershaha15:39
jasonamyersI can never remember how to get ceilo setup in it15:39
jasonamyersI have a vagrant config for the other parts15:39
gordchttp://paste.openstack.org/show/391948/15:40
gordcthat's what i have in local.conf15:40
cdentjasonamyers: a) never get rid of your local.conf, just always add more and more comments to it and save it away, b) add containers to devstack?15:40
*** tshtilma has quit IRC15:49
*** mgarza_ has joined #openstack-ceilometer15:51
openstackgerritMerged openstack/aodh: trust: remove useless conf imports  https://review.openstack.org/20311715:54
*** afazekas_ has quit IRC15:57
openstackgerritJulien Danjou proposed openstack/gnocchi: metricd: allow to be killed by SIGTERM  https://review.openstack.org/20370916:00
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Enable entry points for new declarative meters  https://review.openstack.org/20303216:08
*** vishwanathj has joined #openstack-ceilometer16:12
*** ildikov has quit IRC16:19
*** _cjones_ has joined #openstack-ceilometer16:22
*** julim has quit IRC16:22
*** ankita_wagh has joined #openstack-ceilometer16:23
*** jwcroppe has quit IRC16:23
*** jwcroppe has joined #openstack-ceilometer16:23
*** jwcroppe has quit IRC16:28
*** jwcroppe has joined #openstack-ceilometer16:43
*** Ala has quit IRC16:44
*** ankita_wagh has quit IRC16:50
*** shardy_ has joined #openstack-ceilometer17:01
*** ildikov has joined #openstack-ceilometer17:01
*** shardy has quit IRC17:02
*** shardy_ has quit IRC17:06
*** shardy has joined #openstack-ceilometer17:07
*** yprokule has quit IRC17:10
*** ankita_wagh has joined #openstack-ceilometer17:12
*** openstackgerrit has quit IRC17:16
*** openstackgerrit has joined #openstack-ceilometer17:17
*** safchain has quit IRC17:17
*** tshtilma has joined #openstack-ceilometer17:20
*** jwcroppe has quit IRC17:21
*** jwcroppe has joined #openstack-ceilometer17:21
*** lexholden has joined #openstack-ceilometer17:22
openstackgerritRohit Jaiswal proposed openstack/ceilometer: Handles dns.domain.exists event in Ceilometer  https://review.openstack.org/20277217:23
*** jwcroppe has quit IRC17:26
*** lexholden has quit IRC17:27
*** lexholden has joined #openstack-ceilometer17:27
*** Ephur has joined #openstack-ceilometer17:29
*** tshtilma has quit IRC17:29
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Delete old notification handlers  https://review.openstack.org/20374017:29
*** tshtilma has joined #openstack-ceilometer17:30
*** lexholden has quit IRC17:30
*** lexholden has joined #openstack-ceilometer17:32
*** changbl has quit IRC17:33
*** Ephur has quit IRC17:33
*** lexholden has quit IRC17:37
*** lexholden has joined #openstack-ceilometer17:39
*** tshtilma has quit IRC17:42
*** rjaiswal has quit IRC17:44
*** lexholden has quit IRC17:44
*** lexholden has joined #openstack-ceilometer17:45
*** shardy_ has joined #openstack-ceilometer17:59
*** pcaruana has quit IRC18:00
*** shardy has quit IRC18:01
*** shardy_ has quit IRC18:05
*** shardy has joined #openstack-ceilometer18:05
*** tshtilma has joined #openstack-ceilometer18:06
gordccdent: darn. i think i need your pollster-no-transform patch to send single samples... you win.18:07
cdentoh yeah? how did you figure that out?18:07
gordccdent: i'm trying to figure out a way to scale out notification agent.18:08
gordci think i can bucketise them using resource_id (or some configurable value later)18:08
*** primechu_ has joined #openstack-ceilometer18:09
gordconly problem is if it comes in a batch, i will always need to break it down into single datapoints or else the bucketise logic don't work18:09
*** primechuck has quit IRC18:10
* cdent neds18:10
cdentnods18:10
gordci can break it down in notification agent... but maybe it's cleaner to just have it single always so we need to have a check all the time to see if it's single or list...18:11
cdentgordc: so I can see two ways to go: a) single samples b) pre-process into lumped by resource on the sending end18:11
cdentI think b is a horrible idea because it makes assumptions about the consumer that aren't always going to be true18:12
gordccdent: yeah. b won't be true always.18:12
gordccdent: i'll try breaking it down in notification agent for now... but maybe we can look at single samples in payload across everything later... as a clean up18:13
cdentI can change it now if that's useful (especially since it is and always has been the right way to do it ;) )18:13
gordc... i take it back. i don't want you to be right18:13
cdenthah!18:14
*** tshtilma has quit IRC18:14
gordcmaybe make it a second patch... i don't know if anyone will get around to cleaning up payload==single datapoint18:14
*** lexholden has quit IRC18:14
openstackgerritChris Dent proposed openstack/gnocchi: Remove special configuration of heat plugin  https://review.openstack.org/20375518:18
gordccdent: i guess we can batch some places and unbatch at notification agent... i've no idea. i just know it has to happen at notification agent at the latest. will dig more later.18:18
openstackgerritChris Dent proposed openstack/ceilometer: Send a notification per sample, do not batch  https://review.openstack.org/20375718:27
cdentthere go gordc ^18:27
ekarlsogordc: how did the discussion ofthe notification stuff go ?18:28
gordccdent: cool cool18:29
gordcekarlso: we didn't come up with formal schema, we will track schema work done elsewhere ie. nova.18:29
ekarlsogordc: so stuff like Avro isnt in the concideration space ?18:30
gordcekarlso: we talked about moving our declarative meters to the respective projects so the projects could see the 'schema' ceilometer expects and so projects could control their own metrics18:30
gordcekarlso: no. tbh, we started talking about it and we realised if we scope something large, it won't happen in OpenStack.18:31
ekarlsogordc: what's so large with avro ?18:31
gordcnot avro itself. but to plan something beyond our own project (ceilometer)18:32
ekarlsogordc: yeah, sucks that operators dont hammer down on stuff like this :p18:32
ekarlsoand the big guys' customers18:33
ekarlsothe confluent schema registry stuff, kafka and avro would be a coolie for notifications / events18:33
gordcekarlso: yeah, i'm not sure exactly sure who needs to initialise it, but it's definitely not a common developer.18:33
cdentyou're pretty uncommon gordc18:38
gordcnaw, there's over 1.5 billion of me. i'm very common. :)18:40
*** lexholden has joined #openstack-ceilometer18:40
* gordc wonders if it's cool to talk about race... meh, too late.18:40
* cdent sends gordc for reconditioning18:44
gordclol i still didn't do new hire orientation yet. i blame that.18:45
jasonamyershaha18:45
gordcjasonamyers: i had a question, do you guys watch pan am games in the states?18:48
jasonamyersno18:48
jasonamyersat least not in the southern states :P18:49
gordci see.. yeah canada beat usa at baseball (and softball)... i take it we're just facing the B-team... or the F-team.18:49
jasonamyershonestly until you just asked me about it, I forgot those even existed18:50
gordclol. yeah, i don't think i watch it normally. it just happens to be in my hometown currently.18:51
* gordc appreciates the nightly fireworks.18:51
*** jwcroppe has joined #openstack-ceilometer18:53
*** nijaba has quit IRC18:54
jasonamyers./stack.sh .... error.... ./unstack.sh18:54
jasonamyersrepeat forevers18:55
cdentjasonamyers: what errors?18:55
* cdent apparently have devstack kung fu18:55
jasonamyersblew up during migrations this last time18:55
jasonamyerswaiting for this current stack to do a thing18:55
*** lexholden has quit IRC18:56
*** adam_g` is now known as adam_g19:01
*** thorst has quit IRC19:01
*** adam_g has quit IRC19:01
*** adam_g has joined #openstack-ceilometer19:01
jasonamyershttps://www.irccloud.com/pastebin/cnEvtzXF/19:07
jasonamyerscdent that's the current blow up ^19:07
jasonamyersgonna run a clean and retry19:07
* cdent reads19:08
cdentthat's from cinder I believe? I have cinder turned off these days19:08
cdentI tend turn off anything not relevant to the current batch of stuff19:09
cdentwhich is good&bad19:09
cdentjasonamyers: usually I try to fix stuff as I find it, but as I've never had cause to learn _anything_ about cinder that's one of the ones I skip19:14
cdentgordc: do we have any numbers on the kind read concurrency we'd like gnocchi to be able to support, or the read concurrency that existing ceiometer installations do support?19:20
cdentjd__: you too on ^19:20
jd__cdent: BILLIONS19:21
cdentmaybe nine billion?19:21
jd__cdent: I think currently the concurrency is pretty bad due to mongo etc, but with Gnocchi it should be pretty high and easily scalable for metrics19:21
jd__is there a more deep sense in your question I'm missing?19:21
cdentI'm doing some simple apachebench tests with GETs on aggregation19:22
cdenttrying to see where it goes bad19:22
cdentand thus far it is pretty good, but I have a very small amount of data19:22
gordccdent: don't think we have target for reads. not from concurrency pov19:23
cdentno deep sense in the question, jd__, just wondering: it is hard to know where to focus energy and analysis when we don't have metrics19:23
cdentIRONY!19:23
gordccdent: "not worse than existing dbs"19:24
jd__cdent: yeah I think we're already pretty good on that front so far :)19:25
cdentgordc: are you from management?19:25
gordccdent: you see my suit!19:26
gordci expect some "not worse than existing db" charts19:26
*** _nadya_ has joined #openstack-ceilometer19:27
*** _nadya__ has joined #openstack-ceilometer19:28
*** _nadya_ has quit IRC19:28
*** _nadya__ has quit IRC19:29
*** _nadya_ has joined #openstack-ceilometer19:30
gordcprad: is it easier to just enable meter.yaml when it is empty?19:31
*** changbl has joined #openstack-ceilometer19:31
gordcit might be easier for you to debug, so you can get 1:1 match, turn off one, enbale one19:31
pradgordc, we could enable it empty first, if that makes it easier to review too19:32
pradi already have a deprecation commit, i'll move the populated meters to that19:32
gordcprad: yeah, it'd be easier for me. but i think that's just how my brain works.19:32
pradgordc, though we already merged the populated meters.yaml in previous commit19:33
gordcprad: yeah... :(19:34
gordcit's not doing anything so it's ok to remove i think.19:34
gordcprad: because i don't think your expect samples should increase. there's something wrong.. or being duplicated.19:35
pradgordc, hmm that would mess up https://review.openstack.org/#/c/203031/319:35
*** miand has joined #openstack-ceilometer19:35
pradgordc, k lemme try that locally first and see19:35
gordcprad: yeah, so suggestion is just to switch the order.19:35
*** miand has quit IRC19:35
gordcenable it and then start adding more definitions and deleting corresponding proces_notification code19:36
*** thorst has joined #openstack-ceilometer19:41
openstackgerritMerged openstack/ceilometer: Imported Translations from Transifex  https://review.openstack.org/20289119:48
openstackgerritMerged openstack/ceilometer: make notifier default event publisher  https://review.openstack.org/20163019:53
pradgordc, k so narrowed it down to instance event meters, if i remove those from the yaml i get the right samples.. looks like the event_type compute.instance.* is matching more than one meter20:18
*** _nadya_ has quit IRC20:19
*** _nadya_ has joined #openstack-ceilometer20:19
pradgordc, i'll include those separately, i might just have to make the event type explicit instead of .*20:20
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Enable entry points for new declarative meters  https://review.openstack.org/20303220:21
*** _nadya_ has quit IRC20:24
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Convert identity, sahara and image to meters yaml  https://review.openstack.org/20303120:28
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Enable entry points for new declarative meters  https://review.openstack.org/20303220:28
gordcprad: should the event_type match whatever we have defined in code?20:28
pradgordc, it does, but in this case more than one meter has the same event type compute.instance.*20:29
pradgordc, instead we probably want the event type to be compute.instance.memory or compute.instance.disk or something like that20:29
gordcprad: i'm thinking that's more a bug... i don't really see why it should change.20:29
cdentAll this breaking stuff has been awesome. Finding lots of assumptions.20:30
gordccdent: i don't like your optimism20:30
cdentwe're supposed to find bugs20:31
cdentthat's our primary job20:31
cdentit is _not_ to add features20:31
cdenthowever it seems like the only way we can actively find bugs is to create features20:31
cdentfeatures which are outside the norm20:31
gordcwe don't have bugs.20:31
cdentbend the rules20:31
cdentetc20:31
* cdent rotflcoptrs20:32
gordcprad: that said, i think it's a bug in your patch. not existing bug.20:32
gordccdent: just fyi, the new release of oslo.messaging is in gate. if we still see random failures we gots problems.20:33
* cdent lights some candles20:33
pradgordc, i think its just how we define it in the definition..20:34
gordcprad: can you put a breakpoint in your tests to see what the samplesare20:34
gordcsamples are* just so we can see what the 3 samples are when it should be 220:34
*** jwcroppe has quit IRC20:35
gordcprad: https://github.com/openstack/ceilometer/blob/master/ceilometer/tests/test_notification.py#L20320:36
gordcwe only have 2 meters defined, i'm not sure why you'd get 3 meters from one notifications.20:36
*** jwcroppe has joined #openstack-ceilometer20:36
*** yassine__ has quit IRC20:37
pradgordc, yea already did.. i see 1 memory and two instance samples20:37
gordcprad: hmm... weird.. do you define it twice in yaml?20:37
pradgordc, instead of 1 instance.. and i'm thinking thats because i dint deprecate the instance meters from setup.cfg yet20:37
gordcseems like it.20:38
*** ankita_w_ has joined #openstack-ceilometer20:39
*** jwcroppe has quit IRC20:40
*** jwcroppe has joined #openstack-ceilometer20:40
*** ankita_wagh has quit IRC20:42
*** rjaiswal has joined #openstack-ceilometer20:45
*** changbl has quit IRC20:46
*** thorst has quit IRC20:50
openstackgerritgordon chung proposed openstack/ceilometer: distributed coordinated notifications  https://review.openstack.org/20381820:55
*** changbl has joined #openstack-ceilometer20:58
* cdent attempts to understand gordc code20:59
gordccdent: https://docs.google.com/presentation/d/1QgjDOLRnKDboqP8P1LvV0kR5aQEv_VJsDtMlh6u7tIY/edit?usp=sharing21:02
gordci have no idea if slide 7 makes any sense, but that's what i'm trying to do.21:02
cdentthe commit message made relatively good sense (probably because I was warmed up to the idea already)21:03
gordccdent: coolio. i should also add, i need to test this.21:04
gordci'm guessin we need to enable workload partitioning by default now (especially if we merge your single datapoint patch)21:05
cdentgordc: It may just be because I'm sleepy but I can't figure out where you're accounting for agents leaving and joining the group?21:13
cdentor more specifically how self.transporters is being kept up to date21:14
gordccdent: i reuse existing logic. https://github.com/openstack/ceilometer/blob/master/ceilometer/notification.py#L164-L16521:21
gordchmm21:22
gordcalthough i now see i need to reload pipemanager too21:23
gordccdent: good question21:23
* cdent was getting cake21:24
gordcankita_w_: what were the error message you weren't getting? the audit ones?21:24
ankita_w_Hi gordc : I am trying to catch nova 500 errors using ceilometer. I see all 200s and 400s in ceilometer but when a 500 error is generated. The outcome says "unknown" . I have enabled the audit middleware21:25
ankita_w_Is this a known issue?21:25
ankita_w_am not able to see any nova 500 errors21:26
gordcankita_w_: do you see unknown event or no event at all?21:26
ankita_w_the outcome of the event says unknown21:26
*** cdent has quit IRC21:26
gordcah i see.. it might be some classification logic issue in middleware.21:27
gordci'll take a look21:27
gordcankita_w_: are you using keystonemiddleware or pycadf copy?21:28
ankita_w_am using pycadf copy21:28
ankita_w_since am generating events on nova icehouse21:29
gordchmm. weird. seems like it only sets outcome as unknown if you have no response.21:29
ankita_w_actually sorry....I dont see any events at all21:30
ankita_w_for the 500s21:30
gordcoh.21:30
ankita_w_the unknowns are a different issue21:30
gordcdo you see any errors in nova api logs?21:30
ankita_w_lemme check21:31
ankita_w_I see the error in nova-api21:35
ankita_w_2015-07-20 21:35:01.954 28966 INFO nova.api.openstack [req-74cbf773-a2b2-4c98-913f-9108d1d9aa1d nova 872bc6b2edd84bbf91c9ceb5bbefd84c] http://nova-api.dvt2.symcpe.net:8774/v2/872bc6b2edd84bbf91c9ceb5bbefd84c/flavors/LMM_ZO_KA returned with HTTP 50021:35
gordcankita_w_: hmm... do you see the request event or do you not see either request or response event?21:37
ankita_w_no request or response21:40
*** changbl has quit IRC21:43
gordcankita_w_: that's weird, if it was an issue with nova i'd think you would still get a request notification21:45
gordcseems like it's with middleware itself... do you see any pycadf specific logs?21:45
ankita_w_nopes21:48
*** htruta_ has joined #openstack-ceilometer21:48
ankita_w_Can anybody plz confirm, about nova 500 errors21:53
gordcgordc: that's strange. the only other place would be notification agent is failing to build sample. i don't see why it'd work for others but fail for error21:57
gordcankita_w_: ^21:57
*** ildikov has quit IRC21:57
*** rbak_ has joined #openstack-ceilometer22:00
*** tongli has quit IRC22:00
*** rbak has quit IRC22:02
*** changbl has joined #openstack-ceilometer22:15
*** edmondsw has quit IRC22:19
ankita_w_Hi gordc : I tested again...Here's the thing. Its copying entire stacktrace of nova-api error in payload22:25
*** primechu_ has quit IRC22:27
*** changbl has quit IRC22:27
gordcankita_w_: and it's too large for db?22:27
ankita_w_it doesnt get the reason.reasonCode22:28
ankita_w_I need that22:28
gordci don't quite understand, so you do get the notification but it's missing info or is it so large it's breaking stuff?22:29
openstackgerritgordon chung proposed openstack/ceilometer: distributed coordinated notifications  https://review.openstack.org/20381822:36
*** changbl has joined #openstack-ceilometer22:40
*** ddaskal has quit IRC22:52
*** gordc has quit IRC22:54
*** rbak_ has quit IRC22:54
*** jwcroppe has quit IRC23:07
*** prad has quit IRC23:09
*** changbl has quit IRC23:15
*** bitblt has joined #openstack-ceilometer23:20
*** jwcroppe has joined #openstack-ceilometer23:22
*** henriquetruta has joined #openstack-ceilometer23:24
*** jwcroppe has quit IRC23:27
*** htruta_ has quit IRC23:28
*** changbl has joined #openstack-ceilometer23:29
*** changbl has quit IRC23:37
*** changbl has joined #openstack-ceilometer23:38
*** jwcroppe has joined #openstack-ceilometer23:39
*** mgarza_ has quit IRC23:47
*** primechuck has joined #openstack-ceilometer23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!