Friday, 2015-07-24

*** ddieterly has joined #openstack-ceilometer00:13
openstackgerritMichael Bayer proposed openstack/gnocchi: Switch to facade  https://review.openstack.org/20466900:14
*** ddieterly has quit IRC00:23
*** ddieterly has joined #openstack-ceilometer00:25
*** ddaskal has joined #openstack-ceilometer00:32
*** cchang has quit IRC00:38
*** david-lyle has quit IRC00:40
openstackgerritgordon chung proposed openstack/ceilometer-specs: highly distributed coordinated notifications  https://review.openstack.org/19933100:43
*** promulo__ has joined #openstack-ceilometer00:45
*** jaosorior has quit IRC00:46
*** promulo_ has quit IRC00:49
*** cchang has joined #openstack-ceilometer01:01
*** _cjones_ has quit IRC01:05
*** ankita_wagh has quit IRC01:06
*** gordc has quit IRC01:07
*** Kennan has quit IRC01:17
openstackgerritMichael Bayer proposed openstack/gnocchi: Switch to facade  https://review.openstack.org/20466901:23
*** Kennan has joined #openstack-ceilometer01:24
*** jdandrea has quit IRC01:34
*** cchang has quit IRC01:36
*** r-mibu has quit IRC01:41
*** cchang has joined #openstack-ceilometer01:42
*** r-mibu has joined #openstack-ceilometer01:46
*** liusheng has joined #openstack-ceilometer01:49
*** thorst has joined #openstack-ceilometer01:51
*** ddieterly has quit IRC02:03
*** ankita_wagh has joined #openstack-ceilometer02:30
*** deepthi has joined #openstack-ceilometer02:36
*** rjaiswal has quit IRC02:44
*** ddaskal has quit IRC02:45
*** thorst has quit IRC02:54
*** ddieterly has joined #openstack-ceilometer03:04
*** cchang has quit IRC03:09
*** ddieterly has quit IRC03:10
*** jwcroppe has joined #openstack-ceilometer03:11
*** david-lyle has joined #openstack-ceilometer03:17
*** liusheng has quit IRC03:39
*** liusheng has joined #openstack-ceilometer03:40
*** fawadkhaliq has joined #openstack-ceilometer03:47
*** cchang has joined #openstack-ceilometer03:55
*** deepthi has quit IRC03:58
*** ddieterly has joined #openstack-ceilometer04:06
*** jwcroppe has quit IRC04:07
*** jwcroppe has joined #openstack-ceilometer04:08
*** ddieterly has quit IRC04:11
*** jwcroppe has quit IRC04:12
*** fawadk has joined #openstack-ceilometer04:30
*** htruta_ has quit IRC04:30
*** fawadkhaliq has quit IRC04:33
*** ankita_wagh has quit IRC04:36
*** ankita_wagh has joined #openstack-ceilometer04:37
*** _nadya_ has joined #openstack-ceilometer05:02
*** ddieterly has joined #openstack-ceilometer05:07
*** deepthi has joined #openstack-ceilometer05:08
*** ankita_wagh has quit IRC05:11
*** ddieterly has quit IRC05:12
*** ankita_wagh has joined #openstack-ceilometer05:12
*** jwcroppe has joined #openstack-ceilometer05:18
*** belmoreira has joined #openstack-ceilometer05:18
*** cchang has quit IRC05:24
*** _nadya_ has quit IRC05:46
*** _nadya_ has joined #openstack-ceilometer05:47
*** _nadya_ has quit IRC05:51
*** rex_lee has quit IRC06:03
*** rex_lee has joined #openstack-ceilometer06:03
*** ddieterly has joined #openstack-ceilometer06:08
*** belmoreira has quit IRC06:08
*** ddieterly has quit IRC06:12
*** vishwanathj has quit IRC06:13
*** exploreshaifali has joined #openstack-ceilometer06:24
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometer: Imported Translations from Transifex  https://review.openstack.org/20491206:28
*** yprokule has joined #openstack-ceilometer06:48
*** ankita_wagh has quit IRC06:55
*** belmoreira has joined #openstack-ceilometer06:55
*** ddieterly has joined #openstack-ceilometer07:08
*** Ala has joined #openstack-ceilometer07:10
*** pcaruana has joined #openstack-ceilometer07:10
*** belmoreira has quit IRC07:12
*** pcaruana is now known as centos07:13
*** ddieterly has quit IRC07:13
*** centos is now known as Guest5973007:13
*** Guest59730 is now known as pcaruana07:13
*** jasonamyers has quit IRC07:19
*** jasonamyers has joined #openstack-ceilometer07:20
*** ankita_wagh has joined #openstack-ceilometer07:30
*** Ala has quit IRC07:31
*** Ala has joined #openstack-ceilometer07:32
*** shardy has joined #openstack-ceilometer07:42
*** jaosorior has joined #openstack-ceilometer07:44
*** ankita_wagh has quit IRC07:49
*** _nadya_ has joined #openstack-ceilometer07:58
*** safchain has joined #openstack-ceilometer08:02
*** jwcroppe has quit IRC08:03
*** ddieterly has joined #openstack-ceilometer08:09
openstackgerritJulien Danjou proposed openstack/aodh: Move service classes to their correct subdir  https://review.openstack.org/20517208:13
openstackgerritJulien Danjou proposed openstack/aodh: keystone_client: stop using cfg.CONF  https://review.openstack.org/20517308:13
openstackgerritJulien Danjou proposed openstack/aodh: Switch to oslo.utils.fileutils  https://review.openstack.org/20500008:13
openstackgerritJulien Danjou proposed openstack/aodh: tests: remove unused fake class  https://review.openstack.org/20516908:13
openstackgerritJulien Danjou proposed openstack/aodh: rpc: stop using global conf object in some functions  https://review.openstack.org/20517008:13
openstackgerritJulien Danjou proposed openstack/aodh: api: use oslo.config to validate data for worker  https://review.openstack.org/20517108:13
openstackgerritJulien Danjou proposed openstack/aodh: notifier: move from alarm to top-level  https://review.openstack.org/20410708:13
openstackgerritJulien Danjou proposed openstack/aodh: Move Gnocchi options out of the "alarms" group  https://review.openstack.org/20498208:13
openstackgerritJulien Danjou proposed openstack/aodh: Remove aodh/tests/alarm, move last test out  https://review.openstack.org/20498108:13
openstackgerritJulien Danjou proposed openstack/aodh: evaluator: move to top-level  https://review.openstack.org/20498008:13
*** ddieterly has quit IRC08:14
*** belmoreira has joined #openstack-ceilometer08:18
jd__do we have people using Gnocchi now? https://www.openstack.org/summit/tokyo-2015/vote-for-speakers/presentation/401008:31
jd__https://www.openstack.org/summit/tokyo-2015/vote-for-speakers/presentation/478608:31
openstackgerritJulien Danjou proposed openstack/gnocchi: opts: use new min= in IntOpt from oslo.config  https://review.openstack.org/20513208:38
openstackgerritLiangHuifei proposed openstack/ceilometer: Romove excess comma  https://review.openstack.org/20543508:40
openstackgerritJulien Danjou proposed openstack/gnocchi: Unify requirements  https://review.openstack.org/20543708:41
*** belmoreira has quit IRC08:44
jd__zzzeeek rocks https://review.openstack.org/#/c/204669/08:45
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object for Meter and Sample model  https://review.openstack.org/19052108:50
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object initial patch  https://review.openstack.org/17867508:50
*** nijaba has quit IRC09:01
*** shardy_ has joined #openstack-ceilometer09:01
*** shardy has quit IRC09:02
*** shardy_ has quit IRC09:06
*** shardy has joined #openstack-ceilometer09:07
*** ddieterly has joined #openstack-ceilometer09:10
*** ddieterly has quit IRC09:14
*** _nadya_ has quit IRC09:19
*** _nadya_ has joined #openstack-ceilometer09:20
*** lsmola has quit IRC09:21
*** _nadya_ has quit IRC09:24
openstackgerritJulien Danjou proposed openstack/aodh: api: stop using cfg.CONF and use request local conf  https://review.openstack.org/20546009:30
openstackgerritJulien Danjou proposed openstack/aodh: notifier: stop relying on global conf object  https://review.openstack.org/20546109:30
openstackgerritJulien Danjou proposed openstack/aodh: evaluator: stop using global conf in Evaluator  https://review.openstack.org/20546209:30
openstackgerritJulien Danjou proposed openstack/aodh: evaluator: stop using global conf in evaluator service  https://review.openstack.org/20546309:30
openstackgerritJulien Danjou proposed openstack/aodh: storage: pass conf rather at __init__ than using a global one  https://review.openstack.org/20546409:30
openstackgerritJulien Danjou proposed openstack/aodh: coordination: stop using global conf object  https://review.openstack.org/20546509:30
openstackgerritJulien Danjou proposed openstack/gnocchi: Disable global constraints in devstack  https://review.openstack.org/20546909:35
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: rest: improves NamedMetricController errors  https://review.openstack.org/20547009:36
openstackgerritJulien Danjou proposed openstack/gnocchi: Disable global constraints in devstack  https://review.openstack.org/20546910:05
openstackgerritJulien Danjou proposed openstack/gnocchi: opts: use new min= in IntOpt from oslo.config  https://review.openstack.org/20513210:05
openstackgerritJulien Danjou proposed openstack/gnocchi: Unify requirements  https://review.openstack.org/20543710:05
*** ddieterly has joined #openstack-ceilometer10:11
*** ddieterly has quit IRC10:15
*** cdent has joined #openstack-ceilometer10:27
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object for Meter and Sample model  https://review.openstack.org/19052110:35
openstackgerritJulien Danjou proposed openstack/aodh: tests: use config fixture in evaluator tests  https://review.openstack.org/20548910:43
openstackgerritJulien Danjou proposed openstack/aodh: notifier: stop using global conf object  https://review.openstack.org/20549010:43
*** logan2 has quit IRC10:47
*** logan2 has joined #openstack-ceilometer10:50
*** openstackgerrit has quit IRC11:01
*** openstackgerrit has joined #openstack-ceilometer11:01
*** shardy_ has joined #openstack-ceilometer11:05
*** r-mibu has left #openstack-ceilometer11:06
*** shardy has quit IRC11:06
cdentjd__: restamp your +A here if you can please https://review.openstack.org/#/c/202926/11:07
cdentand the related one too11:08
* cdent is all about moving code11:08
*** shardy_ has quit IRC11:10
*** shardy has joined #openstack-ceilometer11:11
*** ddieterly has joined #openstack-ceilometer11:12
*** ddieterly has quit IRC11:16
*** jwcroppe has joined #openstack-ceilometer11:17
*** shardy_ has joined #openstack-ceilometer11:27
*** shardy has quit IRC11:28
*** shardy_ has quit IRC11:37
*** shardy has joined #openstack-ceilometer11:37
*** jwcroppe has quit IRC11:46
*** jwcroppe has joined #openstack-ceilometer11:47
*** jwcroppe has quit IRC11:52
*** chinmay_g has quit IRC11:53
*** chinmay_g has joined #openstack-ceilometer11:53
*** thorst has joined #openstack-ceilometer12:05
*** jaosorior has quit IRC12:11
*** jaosorior has joined #openstack-ceilometer12:11
*** ddieterly has joined #openstack-ceilometer12:12
*** thorst has quit IRC12:13
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Enable entry points for new declarative meters  https://review.openstack.org/20303212:13
*** _nadya_ has joined #openstack-ceilometer12:16
*** ddieterly has quit IRC12:17
*** deepthi has quit IRC12:19
*** pauldix has joined #openstack-ceilometer12:26
*** pauldix has quit IRC12:27
*** pauldix has joined #openstack-ceilometer12:28
*** pauldix has quit IRC12:30
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object for Meter and Sample model  https://review.openstack.org/19052112:30
*** pauldix has joined #openstack-ceilometer12:32
*** pauldix has quit IRC12:35
*** prad has joined #openstack-ceilometer12:37
openstackgerritMerged openstack/ceilometer: Imported Translations from Transifex  https://review.openstack.org/20491212:45
jd__so many mock sometimes we're not really testing anything -_-12:49
openstackgerritJulien Danjou proposed openstack/aodh: coordination: stop using global conf object  https://review.openstack.org/20546512:49
openstackgerritJulien Danjou proposed openstack/aodh: notifier: stop using global conf object  https://review.openstack.org/20549012:49
openstackgerritJulien Danjou proposed openstack/aodh: tests: use config fixture in evaluator tests  https://review.openstack.org/20548912:49
cdentjd__: Did my comment about pecan.request.cfg not make any sense? It's different than all the other conf changes12:49
cdentI'm fine with it going in, no big deal, but your response makes it sound like you didn't understand my comment12:50
jd__cdent: well I understand it's about the commit message rather than the patch right?12:50
cdentno12:50
jd__ah so I didn't understand indeed12:50
cdentAll the other changes are about replacing a global config with a local config12:50
cdenton that change you're replacing a global config with a global config12:50
jd__well it's not a global config per-say12:50
jd__it's a request local config12:51
* jd__ dodging mode12:51
cdent:)12:51
cdentit's magicl config object that you can import anywhere12:51
cdentwhich oslo config likes to think it is but is not12:51
jd__since you +2'ed I understand that you got that and was just nitpicking the message but you think there's an issue with that?12:51
jd__that's what we do in Gnocchi12:52
cdentThe change is fine, but I just though it was worth highlighting that it is not in the same class as all the others12:52
jd__and actually there is a ConfigHook for that already we just never used it it seems…that's not used for that12:52
jd__s/that's not used for that//12:52
cdentAnd was hoping, mostly idly, that you would reflect upon the difference12:52
jd__cdent: well it's part of my same branch toward the ultimate goal12:52
cdentit's not a big deal, or even a small deal12:52
jd__I'm not sure what you would like me to change actually?12:53
jd__if anything :)12:53
cdentnothing12:53
cdentmore sort of a regular reminder of: We, the readers, would like to see inside your devious mind jd__12:54
* jd__ nods12:54
cdentalso I was fishing to see what form of "dodging mode" you would take, or even, god forbid, just making random conversation in gerrit comments12:55
cdentso, no worries, you're off the hook, we're all good, carry, I hope we land that giant stack soon12:55
jd__yeah me too I don't want to rebase it too much12:58
jd__it's like playing Jenga12:58
*** jdandrea has joined #openstack-ceilometer12:59
pradjd__, question, so started poking around gnocchi cli support.. i assume we want to use the *new* openstack client for this?12:59
jd__prad: weeeelll I started to write things for the new openstack client but I'm not really sure we want to go that road13:00
jd__I mean the new openstack client had a lot of sense when we had OpenStack13:00
jd__now that it's a wild west, I don't know how things are going to work out13:00
jd__wild west = big tent13:00
pradhmm i see, seems like thats still the preferred way going beyond from what i hear13:01
pradunless things are changing13:01
pradthe os-client way i mean13:02
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: rest: improves NamedMetricController errors  https://review.openstack.org/20547013:02
jd__prad: yeah there's os-client and os-sdk13:03
jd__I started to work on os-sdk for Gnocchi mainly so far13:03
jd__I think I'm not going to continue13:03
jd__but if os-client wants to use gnocchiclient, fine with me13:03
jd__that does not block us for writing a gnocchi CLI tool anyway13:04
pradjd__, ok so when you say "if os-client wants to use gnocchiclient" .. we just expose the client libs and let the os client call in13:05
jd__prad: exactly13:06
jd__prad: what I don't say is that we don't have gnocchiclient yet ;-)13:06
*** yassine__ has joined #openstack-ceilometer13:06
pradjd__, i'll take that approach then instead of spending time on something we're not sure13:06
jd__prad: gnocchiclient?13:07
openstackgerritMerged openstack/aodh: notifier: move from alarm to top-level  https://review.openstack.org/20410713:08
openstackgerritMerged openstack/aodh: evaluator: move to top-level  https://review.openstack.org/20498013:09
openstackgerritMerged openstack/aodh: Remove aodh/tests/alarm, move last test out  https://review.openstack.org/20498113:10
openstackgerritMerged openstack/aodh: Move Gnocchi options out of the "alarms" group  https://review.openstack.org/20498213:10
openstackgerritMerged openstack/aodh: Switch to oslo.utils.fileutils  https://review.openstack.org/20500013:10
openstackgerritJulien Danjou proposed openstack/aodh: coordination: stop using global conf object  https://review.openstack.org/20546513:10
openstackgerritJulien Danjou proposed openstack/aodh: notifier: stop using global conf object  https://review.openstack.org/20549013:10
openstackgerritJulien Danjou proposed openstack/aodh: tests: use config fixture in evaluator tests  https://review.openstack.org/20548913:10
*** pauldix has joined #openstack-ceilometer13:12
openstackgerritMerged openstack/aodh: tests: remove unused fake class  https://review.openstack.org/20516913:12
openstackgerritMerged openstack/aodh: rpc: stop using global conf object in some functions  https://review.openstack.org/20517013:12
openstackgerritMerged openstack/aodh: api: use oslo.config to validate data for worker  https://review.openstack.org/20517113:13
openstackgerritMerged openstack/aodh: Move service classes to their correct subdir  https://review.openstack.org/20517213:13
*** ddieterly has joined #openstack-ceilometer13:13
pradjd__, yea and we probably need a new project and coordinate with infra and everything for that?13:14
openstackgerritMerged openstack/aodh: keystone_client: stop using cfg.CONF  https://review.openstack.org/20517313:14
openstackgerritMerged openstack/aodh: api: stop using cfg.CONF and use request local conf  https://review.openstack.org/20546013:14
openstackgerritMerged openstack/aodh: notifier: stop relying on global conf object  https://review.openstack.org/20546113:14
openstackgerritMerged openstack/aodh: evaluator: stop using global conf in Evaluator  https://review.openstack.org/20546213:15
openstackgerritMerged openstack/aodh: evaluator: stop using global conf in evaluator service  https://review.openstack.org/20546313:15
openstackgerritMerged openstack/aodh: storage: pass conf rather at __init__ than using a global one  https://review.openstack.org/20546413:15
*** julim has joined #openstack-ceilometer13:17
*** ddieterly has quit IRC13:18
*** dikonoor has joined #openstack-ceilometer13:18
*** thorst1 has joined #openstack-ceilometer13:18
jd__prad: yup as soon as somebody start writing some code :)13:19
pradjd__, I'm on it, now that i have the declarative stuff completely blocked by grenade .. will start looking into it today13:20
jd__prad: ok let me know if you need help13:20
pradwill do13:21
*** fawadk has quit IRC13:23
cdentjd__: are you aware of anyone already making progress on gate jobs for aodh?13:23
*** fawadkhaliq has joined #openstack-ceilometer13:24
*** ddieterly has joined #openstack-ceilometer13:25
jd__cdent: hasn't sileht posted a patch on infra for that?13:26
cdentdunno, but as far as I can tell the gate hook stuff that needs to happen in the devstack dir aren't up for review anywhere yet?13:27
silehtjd__, I have posted a patch to run the heat integration tests with aodh to not break them13:27
*** pauldix has quit IRC13:29
jd__so that's likely good but not enough?13:29
cdentseems that way13:30
cdentI'll look into copying gnocchi's stuff to aodh and translating13:30
cdentto get some basics in place13:30
* cdent needs to make something, not just review13:30
*** exploreshaifali has quit IRC13:30
openstackgerritMerged openstack/ceilometer: api: return 410 if only Gnocchi is enabled  https://review.openstack.org/20292513:31
*** pauldix has joined #openstack-ceilometer13:31
openstackgerritMerged openstack/ceilometer: api: Redirect request to aodh if available  https://review.openstack.org/20292613:31
*** tristanC has quit IRC13:31
jd__FAILED (id=153, failures=671 (+670), skips=18)13:31
jd__YOU'RE FIRED13:32
jd__ok :( ok :(13:32
*** pauldix has quit IRC13:32
*** tristanC has joined #openstack-ceilometer13:32
silehtgood score :)13:32
openstackgerritKamil Rykowski proposed openstack/ceilometer: Versioned object for Event model  https://review.openstack.org/18133813:32
*** pauldix has joined #openstack-ceilometer13:33
jasonamyersjd__ FINISH HIM! .... FATALITY13:35
cdentjasonamyers: you pop up at the most opportune times13:36
* jasonamyers hides13:36
jd__haha jasonamyers13:36
openstackgerritMerged openstack/gnocchi: file: do not raise if dir is created in the meantime  https://review.openstack.org/20511913:38
*** gordc has joined #openstack-ceilometer13:41
gordccdent: missed your ping yesterday. still need me?13:45
gordccd /opt/stack/ceilometer/13:45
cdentgordc: I don't remember13:46
gordccoolio13:46
cdentobviously I still need you gordc, but whatever it was about yesterday, I got over it13:51
gordclol too much.13:52
*** lexholden has joined #openstack-ceilometer13:55
*** edmondsw has joined #openstack-ceilometer13:56
gordcildikov: thanks for hosting meeting yesterday. reading log now, anything of interest i should be aware of?13:57
ildikovgordc: hey13:57
ildikovgordc: nothing really major as far as I can remember13:57
gordccool cool. that's what it seems like.13:57
ildikovgordc: ityaptin mentioned a few thing sregarding InfluxDB, so it seems that we could reach out to them with a short list13:58
ildikovotherwise work is ongoing with Gnocchi including bug fixing activity13:58
gordcildikov: yeah, pauldix said to let him know so he can prioritise13:58
pauldixildikov, gordc: I'm listening :)13:59
ildikovand IIRC sommeone asked about how often we release our client, I'm not sure it was answered finally...13:59
ildikovpauldix: hey, I couldn't find you on IRC yesterday to connect you with ityaptin, he knows more about the details13:59
ityaptinpauldix: Hi!13:59
ildikovpauldix: I encouraged him to collect what they found and reach out to you14:00
ildikovgordc: there were also a few questions around dynamic config, there is a bug to triage and there is a BP that the feature could be extended to the event config, I said it's enough to register a bug for that one14:02
ildikovgordc: I assumed it does not require a spec as the base functionality will not be changed14:02
ildikovgordc: I think that's all :)14:03
gordcildikov: regarding ceilometerclient. it's usually released based on whether we added something useful. we could probably do a release for aodh support.14:03
ildikovgordc: yeap, I know, I just wasn't sure whether anyone described it yesterday finally14:04
gordcyeah, the event_definition stuff should be trivial... i'll let rohit know it's fine as a bug.14:04
openstackgerritMerged openstack/ceilometer: Send a notification per sample, do not batch  https://review.openstack.org/20375714:04
gordcreload stuff*14:04
ildikovgordc: I think I wrote something like we can wait a bit if anything pops up regarding mostly Aodh14:04
ildikovgordc: cool, then I didn't suggest anything against your wishes :)14:05
ildikovso for the client we have Aodh support now, it's just not a rush as we still have the old alarming code14:05
gordcildikov: yeah. i think we're blocked from gating anyways.14:06
ildikovgordc: yeap14:07
*** thorst has joined #openstack-ceilometer14:08
*** thorst1 has quit IRC14:08
gordcsileht: are you working on adding aodh devstack plugin to gate?14:09
cdentgordc, sileht: I think we just decided I'd start that14:10
jasonamyersgordc will fix those things you requested14:10
cdentabout 40mins ago14:10
*** r-daneel has joined #openstack-ceilometer14:11
gordccdent: cool! works for me.14:14
gordci guess after that is there anything else we really need to do? except for docco to explain difference between aodh setup and classical setup?14:15
gordcjasonamyers: thanks!14:15
cdentgordc: use it?14:15
gordccdent: nah, next year.14:16
cdents/use/test/14:18
gordccdent: yeah. more realistic14:18
*** jaosorior has quit IRC14:21
*** ildikov is now known as ildikov_afk14:26
gordcjd__: i should ask this before i hit approve. but how do we ensure the option is loaded with this patch: https://review.openstack.org/#/c/20546514:26
*** pauldix has quit IRC14:27
openstackgerritMerged openstack/aodh: coordination: stop using global conf object  https://review.openstack.org/20546514:29
*** pauldix_ has joined #openstack-ceilometer14:29
jd__gordc: because everything is imported correctly14:30
jd__gordc: but anyway all the register_opts() are going away in a next patch14:31
openstackgerritliusheng proposed openstack/aodh: Delete its corresponding history data when deleting an alarm  https://review.openstack.org/20482814:33
gordcjd__: i see... i will have faith14:34
gordcliusheng: fyi, ^^^ cdent is working on aodh gate. do you have any other items that you think need to be addressed?14:35
*** jwcroppe has joined #openstack-ceilometer14:36
liushenggordc: cool, I will continue the tempest change after cdent's change being mereged.14:37
*** dikonoor has quit IRC14:38
liushenggordc: https://review.openstack.org/#/c/202418/14:38
gordcliusheng: cool cool.14:41
openstackgerritJulien Danjou proposed openstack/aodh: storage: always use get_connection_from_config()  https://review.openstack.org/20556114:46
openstackgerritJulien Danjou proposed openstack/aodh: tests.db: simplify connection handling  https://review.openstack.org/20556214:46
openstackgerritJulien Danjou proposed openstack/aodh: mongodb: stop using global config object  https://review.openstack.org/20556314:46
liushenggordc: maybe some doc changes about aodh are needed, but if there is any other works I can pick, please tell me ;-)14:47
cdentgordc, liusheng: have we beaten gnocchi hard enough yet?14:47
*** jaypipes has joined #openstack-ceilometer14:48
jasonamyersgordc: in my nova_client.py you sure you want those lumped into a function named instance_get_all_by_host?14:48
jasonamyersAdding since to that and getting changes doesn't fit that name very well14:48
liushengcdent: not exactly, I think :)14:50
cdent:)14:50
cdentmaybe more of that14:50
gordci was going to wait until sileht's patches merge14:50
cdentah, good point14:51
* cdent was getting confused on whether the giant stack of stuff merging lately was aodh, gnocchi, both, something else, pie14:51
gordcjasonamyers: i think that is ok. that's the point of optional parameters. they are both getting instances of host, but if you pass in 'since', it becomes subset14:51
jasonamyersokay fixing doc string for that14:51
jasonamyersbtw ISO is the date format14:52
jasonamyersI appended it to people would know it's a string not a date time instance14:52
gordcjasonamyers: cool cool.14:53
jasonamyersgordc want me to change it to self.last_run_iso_datetime?14:54
jasonamyersor just drop the iso all together14:55
*** _nadya_ has quit IRC14:56
cdentBURNIT14:56
*** _nadya_ has joined #openstack-ceilometer14:56
*** ddieterly has quit IRC14:57
gordccdent: are you talking to jasonamyers?14:58
jasonamyersI'm gonna drop it14:58
cdentI'm joking at jasonamyers, everything must burn! all the things!14:58
gordccdent: your bipolar responses are very hard to gauge.14:59
*** liusheng has quit IRC15:00
cdentI gotta keep you on your toes gordc15:00
jasonamyersgordc: I just assume he really wants me to destroy it all15:00
jasonamyersand set about doing it15:00
cdenti'm not the boss of you!15:00
*** _nadya_ has quit IRC15:01
* jasonamyers is a follower... followers gonna follow15:01
gordclol15:01
openstackgerritJulien Danjou proposed openstack/aodh: api.hooks: stop using global conf object  https://review.openstack.org/20557115:04
openstackgerritJulien Danjou proposed openstack/aodh: api: stop using a global Enforcer object  https://review.openstack.org/20557215:04
openstackgerritJason Myers proposed openstack/ceilometer: WIP Instance Caching  https://review.openstack.org/20438815:04
*** fawadkhaliq has quit IRC15:04
jasonamyersgordc: pushed up your requested changes, tests are underway, need to delete the ones for the new method (choose to work on them first)15:06
gordcjasonamyers: cool cool. will tests today. hoping it helps.15:07
jasonamyerscool no rush about to checkout and go enjoy some party time15:08
gordcjasonamyers: you guys buy another company?15:08
jasonamyersI got older15:09
gordcyeah? happy bday dude.15:09
cdentcake!15:09
jasonamyersbut I'm sure we bought someone knowing us15:09
jasonamyersCOOKIES!15:09
* gordc ate too much cookies in university.15:09
gordccutting back... cookies are like smokes to me.15:10
openstackgerritgordon chung proposed openstack/ceilometer-specs: highly distributed coordinated notifications  https://review.openstack.org/19933115:10
jasonamyershaha gordc15:12
pradwe celebrated os birthday with some cake & pizza at our meetup - https://pkilambi.fedorapeople.org/os-birthday.jpg15:20
*** thorst has quit IRC15:20
gordcprad: who hosted?15:21
*** ddieterly has joined #openstack-ceilometer15:22
*** ddieterly has quit IRC15:24
pradgordc, I organize the Triangle Openstack Meetup in RTP area with a couple of guys .. we did in a brewery near by, OS foundation funded part of it and some from other corps in the area (usual suspects) ..15:24
*** ddieterly has joined #openstack-ceilometer15:24
gordcprad: cool cool15:27
*** ddaskal has joined #openstack-ceilometer15:28
*** pauldix_ has quit IRC15:34
*** pauldix has joined #openstack-ceilometer15:35
jasonamyers@prad that's cool15:36
*** ankita_wagh has joined #openstack-ceilometer15:36
*** david-lyle has quit IRC15:44
*** bitblt has joined #openstack-ceilometer15:56
*** ddieterly has quit IRC16:05
*** jwcroppe has quit IRC16:11
*** ddieterly has joined #openstack-ceilometer16:14
*** _cjones_ has joined #openstack-ceilometer16:16
*** _cjones_ has quit IRC16:17
*** _cjones_ has joined #openstack-ceilometer16:17
*** david-lyle has joined #openstack-ceilometer16:20
*** ddieterly has quit IRC16:22
pradjd__, started with some basic shell setup here https://github.com/pkilambi/python-gnocchiclient .. next will add some sub commands etc16:36
pradjd__, if you can tell me how to initiate the repo creation process .. I can initiate it with infra16:37
jd__prad: so much copy paste from elsewhere :(16:37
pradyep basically from ceiloclient.. just the basic stuff16:37
pradit has no subcommands etc16:38
pradjd__, if you prefer to wait until some api calls are in place thats fine16:38
openstackgerritChris Dent proposed openstack/aodh: Add basic gate functional testing jobs for aodh  https://review.openstack.org/20561616:40
cdentjd__, gordc that ^ was more painful that I expected16:41
cdentthere's also this: https://review.openstack.org/205617  (project-config)16:41
openstackgerritChris Dent proposed openstack/gnocchi: rest: improves NamedMetricController errors  https://review.openstack.org/20547016:47
cdentsileht: I went ahead and changed the commit message and approved that ^16:49
cdentbecause why not16:49
*** ddieterly has joined #openstack-ceilometer16:52
jd__prad: no it's fine we'll hackit from there16:52
jd__prad: though I was hoping to use something async for the http client but well16:53
cdentgreedy16:58
pradjd__, sure, once i have the barebones working I can add that.. i'll get the metrics api working first16:58
*** ankita_wagh has quit IRC16:58
pradmost of this client stuff looks the same everywhere, i guess that was the goal of os-client to abstract the common stuff out16:58
jd__prad: not really, that's the goal of os-sdk16:59
pradah yea the sdk..17:00
pradwhich makes sense to have, but you can we dont want to use that?17:00
*** Ala has quit IRC17:08
*** ddaskal has quit IRC17:10
*** ankita_wagh has joined #openstack-ceilometer17:17
openstackgerritMerged openstack/ceilometer: Updated from global requirements  https://review.openstack.org/20438717:23
openstackgerritMerged openstack/gnocchi: rest: improves NamedMetricController errors  https://review.openstack.org/20547017:27
*** ankita_wagh has quit IRC17:39
*** ddieterly has quit IRC17:42
*** yprokule has quit IRC17:44
openstackgerritPradeep Kilambi proposed openstack/ceilometer: Enable entry points for new declarative meters  https://review.openstack.org/20303217:48
*** dikonoor has joined #openstack-ceilometer17:49
*** fawadkhaliq has joined #openstack-ceilometer17:53
*** _nadya_ has joined #openstack-ceilometer17:57
*** ankita_wagh has joined #openstack-ceilometer17:58
*** belmoreira has joined #openstack-ceilometer17:58
*** _nadya_ has quit IRC18:01
*** belmoreira has quit IRC18:06
dikonoorgordc:18:09
dikonoorgordc:hi18:09
dikonoorgordc:this is about the events rbac18:09
gordcsure thing18:10
dikonoorgordc: my prev implementation to solve the problem was to filter the events based on the rules in policy.json and it has obvious perf overheads and thus i have been thinking of how we can comprehensively take care of this problem18:11
gordccool :)18:11
*** safchain has quit IRC18:11
dikonoorgordc: i agree that using rules in policy.json for tackling this problem is not feasible due to perf and thus rbac has to be implemented within events code with some assumptions18:12
dikonoorgordc: I mean some checks can come from policy.json but not all..18:13
dikonoorgordc: as events cover events from all services, it makes it all the more important to restrict the data ..because if we don;t we are creating a loophole to leak the data from different services..18:14
dikonoorgordc: currently there's a hardcoded check that ensures that only admins can view the events data...but that would mean admins can view data from any project..18:15
gordchmm.. why can't we use rules from policy.json?18:16
gordccan we not grab all the projects they have access to and query on that?18:17
gordcsorry im not really familiar with policies18:17
*** ankita_w_ has joined #openstack-ceilometer18:18
*** ankita_wagh has quit IRC18:18
dikonoorwell..we can define some things using policy.json and somethings using code logic. i believe to start with , there could be a rule defined in the policy.json that defines which role can view data..So let's say there'a rule that says events:index: role:admin..this allows admins to view events..18:18
dikonoorgordc: but then like you said when we run the wuery to get events, we says return the events for that project only18:19
dikonoorgordc: Is there going to be any case where an admin has a see the events from all projects?18:20
*** thorst1 has joined #openstack-ceilometer18:20
dikonoorgordc: something like a super-admin or so..If that's a valid scenario, then there could be something like a query parameter (for e..all_tenants) that can be sent along with the rest api query and there could be a corresponding rule in the policy.json that suggests who can view it18:21
dikonoorgordc: https://github.com/openstack/nova/blob/master/etc/nova/policy.json#L1318:22
dikonoorgordc: a similar example can be found in nova18:22
dikonoorgordc: If the user is not an admin , only the events applicable to that user should be shown18:23
gordcdikonoor: yes, we probably want a super admin view. but it's not that important.18:24
gordci think ideally we follow the policy behaviour that is consistent with all other projects.18:24
gordcdo all projects post-filter their results? there's no way to do it before hand?18:24
*** gordc has quit IRC18:25
dikonoorgordc: However, if the user wants to see events for all users under the user's project , then we could use a similar parameter like all_users and define a corresponding rule in policy.json to suggest which user can make that request18:25
dikonoorgordc: post-filtering results is the tricky part18:25
dikonoorgordc: I was going through the nova code which filters the results of all servers ..If first checks if a all_tenant parameter has been passed.If yes, the it uses the corresponding rule in the policy.json to proceed ..this is similar to the super-admin I talked about..if this parameter is not passed only servers belonging to that project is returned18:27
dikonoorlet me pull that code18:27
dikonoorgordc: https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/servers.py#L207-L21718:28
dikonoorgordc: this is not a great implementation..18:29
*** gordc has joined #openstack-ceilometer18:29
*** ddaskal has joined #openstack-ceilometer18:30
dikonoorgordc: its easy to implement rbac using policy for operations like POST, PUT, DELETE, get which involves one resource (because you can apply the policy rule and dont have to bother abt performance)18:30
openstackgerritMerged openstack/aodh: tests: use config fixture in evaluator tests  https://review.openstack.org/20548918:30
openstackgerritMerged openstack/aodh: notifier: stop using global conf object  https://review.openstack.org/20549018:30
dikonoorgordc: when it comes to the index implementation that gets all resources , it gets complicated ..and i think all services will have problems for this type of api calls18:31
dikonoorgordc: thus we have to arrive at a consensus on what kind of rbac restrictions should be applied to all events call18:32
dikonoorgordc: First , as events in ceilometer carry data from other services (and I think most of the events should have some user/project information associated) for event rbac to work effectively..18:33
dikonoorgordc: gordc: and thus it makes more sense to have user_id and project_id as base attributes rather than as traits18:34
*** jaypipes is now known as funkypipes18:34
dikonoorgordc: and all events should have these attributes filled18:35
openstackgerritOpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements  https://review.openstack.org/20565018:36
dikonoorgordc: I was going through https://github.com/openstack/ceilometer/blob/master/etc/ceilometer/event_definitions.yaml . Do you know of any events listed in here that cannot have a user_id and project_id associated with it18:36
gordcdikonoor: most of them. i'm sure you can arbitrarily assign a value to them but only audit events really have proper user/project id assigned to them18:37
gordci think it's safe to assume if it's missing project/user. it's meant for super admin user18:38
dikonoorgordc: how about events around compute instance for eg..they are definitely associated with user and project18:38
gordcpossibly...18:38
dikonoorgordc: and even the image , snapshot and volume related events would also have them18:39
gordci don't understand the argument it must be base attr vs trait. they have the same filtering funcitonalities regardless of where it is.18:39
gordcdikonoor: possibly. there's no schema so it's really just an assumption they have them. you'd hope they have user/project id.18:39
dikonoorgordc: yeah..I agree that technically for the sake of filtering it doesn't matter18:39
gordcbut it's not for sure.18:39
dikonoordikonoor : Ok..Let's park the base attr vs traits discussion and go back to the events rbac implementation logic..18:40
dikonoorgordc: sorry i meant gordc:18:40
gordcdikonoor: especially in the case if we add logs... there's probably a very low chance of project/user id18:40
*** ankita_w_ has quit IRC18:41
dikonoorgordc: sorry..didn't et you..add logs?18:41
gordcdikonoor: sounds good :)18:41
*** ankita_wagh has joined #openstack-ceilometer18:41
gordcdikonoor: log processing. some people may want to combine logs with events... as we use ElasticSearch backend.18:41
dikonoorgordc: ok..means ..events go to logs and not to the message queue18:42
gordcmaybe it's best to have behavoiur as: 1) if you are general user, you can see only events with your user.18:43
gordcif you are admin, you can only see events for your project18:43
dikonoorgordc: yeah18:43
gordcand if you are super admin, you see everything18:43
dikonooryeah..18:43
gordcso i'm guessing the above is not possible? or is it that it doesn't fit the RBAC policy behvaiour.18:44
gordcapologies on stupid questions, i'm still shocked policies really only work for single resources.18:45
dikonoorgordc: above is possible .. we need to define some things in the policy.json..foe eg.., the only way we can tell who is a admin or super-admin is based on a rule in policy.json18:45
gordcand can we do that without post-filtering?18:46
dikonoorgordc: no.. we do it before filtering..18:47
gordcright, that's what i meant.18:48
dikonoorgordc: but i think you got the general idea18:48
gordci think the above seems like a sane way to restrict access? i don't know if you have any concerns?18:49
dikonoorgordc: of what I am trying to say..Does these kind of changes require a bp..or a LP bug is enough?..I probably don;t want to make all the changes toether18:49
dikonoorgordc: yes..the above is a way to restrict access18:49
dikonoordikonoor:I mean I think we can implement this18:50
gordcdikonoor: cool!18:50
dikonoorgordc: Does these kind of changes require a bp..or a LP bug is enough?..I probably don;t want to make all the changes toether ..18:50
gordci think you can just write the code. tbh, i thought that was the work that fabio was doing.18:50
dikonoorgordc: could you point me to fabio's work so that I don't have to re-do it18:51
gordcdikonoor: his blueprint?18:52
gordcor his code? his code is in there... the stuff that you are trying to change.18:52
dikonoorgordc: ah..ok..18:52
gordchttp://specs.openstack.org/openstack/ceilometer-specs/specs/kilo/ceilometer-rbac.html18:53
gordcthat was the spec18:53
dikonoorgordc: the current code just has a hard-coded check that verifies if the user is an admin..but that leaks out way too much of information about data from any service in a multi-tenant env like openstack18:54
gordcif you want to write a quick bp you can create one that says:18:54
gordc1. if you general user, only see your events, etc...18:54
gordcdikonoor: yeah i agree. it's not granular enough.18:54
dikonoorgordc: right..ok..Thanks gordc! and please think about that traits vs base attributes thing again..Perhaps I am not able to convince you enough..Perhaps I will someone else to talk to you to try and convince you :)18:56
gordcdikonoor: hahaha!18:57
gordcyou can create a spec. i won't block it, i promise. i probably won't approve it myself though.18:57
dikonoorgordc: i was thinking of clubbing the base attribute spec with rbac spec..18:58
gordcprobably best that it's separate... not just because i'm not sold on base attr. the policy control stuff i think is important for liberty18:59
dikonoorgordc: ok..makes sense..18:59
gordcif you have time, feel free propose for liberty. just want to make reviews as easy/quick as possible19:00
*** ankita_wagh has quit IRC19:01
*** ankita_wagh has joined #openstack-ceilometer19:02
dikonoorgordc: yeah..I plan it for liberty19:02
gordcdikonoor: cool cool.19:03
dikonoorgordc: ok..then ttyl..bye for now19:03
gordclaters. thanks for the help19:03
*** thorst1 has quit IRC19:06
*** dikonoor has quit IRC19:08
gordccdent: i'm testing the individual samples patch...it looks like it's causing compute agent to consume twice CPU load (on poll) and causing longer max CPU load on notification agent19:14
*** EmilienM is now known as EmilienM|brb19:18
*** fawadkhaliq has quit IRC19:21
*** fawadkhaliq has joined #openstack-ceilometer19:22
*** bitblt has quit IRC19:22
*** ankita_wagh has quit IRC19:43
gordcjasonamyers: looks promising so far. your patch seems to drop CPU load to 35%-50% of existing load (without your patch)19:44
*** ankita_wagh has joined #openstack-ceilometer19:46
cdentgordc: that's not very surprising, sounds like a bug in oslo.messaging :p19:55
*** EmilienM|brb is now known as EmilienM19:59
*** _nadya_ has joined #openstack-ceilometer19:59
gordccdent: i think that's another bug20:02
gordc(half joking) for some reason notification agent is running a noticeable cpu load even when nothing is happening20:04
cdentis this with your multiple listener code in place?20:04
*** lexholden has quit IRC20:04
gordcwithout.20:04
gordcand single agent20:05
gordci'm just going to open a bug20:05
cdentand nothing is happening on the bus?20:05
gordcnot that i know of.20:05
gordcqueues are empty20:05
gordcpollsters are off20:05
gordccollectors are chilling.20:05
gordcmaybe it's the pipeline reloading code.20:06
*** shardy_ has joined #openstack-ceilometer20:09
cdentnova running?20:09
cdentgordc ^20:09
gordcyeah20:09
* cdent does not trust the pipeline reloading20:09
gordcit should be disable20:09
*** shardy has quit IRC20:10
cdentit would surprise me not one bit if there aren't bugs everywhere, including in my stuff20:11
cdentit's all terribly opaque20:11
gordcMAGIC20:12
cdentI can look for real next week, too20:12
openstackgerritDoug Hellmann proposed openstack/aodh: Use stevedore directive to document plugins  https://review.openstack.org/20569320:12
gordcyeah. this seems like a job for next week20:12
gordchttps://bugs.launchpad.net/ceilometer/+bug/1478135 vague useless bug20:12
openstackLaunchpad bug 1478135 in Ceilometer "notification agent never idles" [Undecided,New]20:12
cdentgordc: for me the notification agent is sitting idle but the collector is running at a constant 6-7% (which pollsters turned off)20:14
*** shardy_ has quit IRC20:14
*** shardy has joined #openstack-ceilometer20:15
gordc... something is f'd20:15
cdentand that behavior appears to be it chatting to mongo for no apparent reason every few seconds20:16
*** ddieterly has joined #openstack-ceilometer20:17
gordccdent: oh yeah. i'm on mysql.20:17
gordcmongo requires a lot more memory... it's faster (write) at lease.20:18
gordcleast*20:18
cdentbut why does the collector need to talk to it every few minutes?20:18
gordcoh i've no idea.20:18
cdentseconds I mean20:18
gordci assume it's oslo.messaging heartbeat or something20:19
gordcmy collector uses 1% every few sc20:19
gordcsec*20:19
cdentalso the collector is in a very tight epoll_wait loop (if you do an strace on the process you'll see what I mean)20:20
cdentwhereas the notification agent is actually blocking pleasantly20:20
cdentI think we could benefit from actually doing some real debugging and testing on these tools rather than just throwing more code at them20:21
cdentit's pretty clear they are not ideal20:22
gordccdent: you're talking like we know what we're doing20:29
cdentwell that's just it isn't it20:29
gordccdent: only sales knows what they're talking about20:30
cdentHowever, I've got a lot of experience at dealing with this kind of thing, so I could dredge up that personality and figure it out but it is hard to find the time. I'd like to.20:30
gordcif you find something we can always get in post-freeze.20:31
gordcjust say memory leak20:31
cdentpeople do get scared of that20:32
gordcyep. no need to prove.20:32
*** ddieterly has quit IRC20:34
*** fawadk has joined #openstack-ceilometer20:46
*** fawadkhaliq has quit IRC20:49
ddaskal@gordc: I see you posted that Mongo requires more memory, but is faster than MySQL20:50
ddaskalany reason why I shouldn't choose MongoDB over MySQL, coming from someone on sql20:50
*** vishwanathj has joined #openstack-ceilometer20:53
gordcddaskal: um... i think you'll have differing opinions on that (like with all options)20:54
gordcddaskal: for sql you'll need a lot more workers to write to db, i think it's ~5x slower20:55
gordcddaskal: that said, the sql backend is about 4x-10x more efficient from disk space pov20:55
gordcddaskal: i haven't tested read performance... not recently.20:56
*** _nadya_ has quit IRC20:56
*** _nadya_ has joined #openstack-ceilometer20:57
ddaskalvery good information to know20:57
ddaskalthank you!20:57
ddaskalI've been reading alot online trying to gather as many opinions as possible20:57
gordcddaskal: np. i should mention don't try sql if you are using anything pre-Juno.20:58
ddaskalyeah I did see that, luckily we'll be doing Kilo20:58
gordcddaskal: yeah. i think most have been using mongo... i think some people are using sql but definitely a minority20:59
gordcand of course we're testing/improving Gnocchi... that would be the biggest win from disk space and read performance21:01
*** _nadya_ has quit IRC21:01
ddaskalok I've written all that down, thank you again!21:05
*** edmondsw has quit IRC21:06
openstackgerritgordon chung proposed openstack/ceilometer: add flexible grouping key  https://review.openstack.org/20414021:06
openstackgerritgordon chung proposed openstack/ceilometer: distributed coordinated notifications  https://review.openstack.org/20381821:06
gordcddaskal: let us know how it goes (or what needs to be fixed)21:07
*** ankita_w_ has joined #openstack-ceilometer21:11
*** ankita_wagh has quit IRC21:14
*** rjaiswal has joined #openstack-ceilometer21:27
rjaiswalgordc: would be great to have this looked at: https://blueprints.launchpad.net/ceilometer/+spec/dynamic-event-pipeline21:27
gordcrjaiswal: i'm heading out right now. did you want the spec looked at or just a general approval?21:28
gordcwe talked about it earlier and i think since change is just using previous logic it probably doesn't need spec.21:29
gordcyou can just code it up21:29
rjaiswalgordc: dont have a spec detailed out, i meant just the idea and genereal opinion21:29
rjaiswalohok21:29
gordci assume it's reusing 85+% of code21:30
rjaiswalmakes sense, gordc, will add a bug to track it21:30
rjaiswalyeah21:30
gordccool cool. heading out. have a good weekend21:30
rjaiswalhave a good one21:31
*** gordc has quit IRC21:31
openstackgerritRohit Jaiswal proposed openstack/ceilometer: Fixes querying alarm history with severity field  https://review.openstack.org/20023821:32
*** yassine__ has quit IRC21:33
*** cdent has quit IRC21:38
*** prad has quit IRC21:40
*** vishwanathj has quit IRC21:47
*** r-daneel has quit IRC21:53
*** ddaskal has quit IRC22:22
openstackgerritMerged openstack/ceilometer: Move gnocchi resources definition in yaml file  https://review.openstack.org/20250022:23
*** ddieterly has joined #openstack-ceilometer22:26
*** ddieterly has quit IRC22:27
*** fawadk has quit IRC22:45
*** pauldix has quit IRC22:46
*** ankita_w_ has quit IRC23:03
*** ddieterly has joined #openstack-ceilometer23:25
*** funkypipes has quit IRC23:50
*** htruta_ has joined #openstack-ceilometer23:53
*** ildikov_afk has quit IRC23:54
*** ildikov_afk has joined #openstack-ceilometer23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!