Wednesday, 2014-03-26

*** Trozz has joined #openstack-ceilometer00:03
*** matsuhashi has joined #openstack-ceilometer00:27
*** terriyu has quit IRC00:58
*** terriyu has joined #openstack-ceilometer01:04
*** terriyu has quit IRC01:04
*** changbl has joined #openstack-ceilometer01:12
*** matsuhashi has quit IRC01:12
*** matsuhashi has joined #openstack-ceilometer01:14
*** sdake_ has quit IRC01:15
*** sdake has quit IRC01:16
*** kun_huang has joined #openstack-ceilometer01:23
*** liusheng has joined #openstack-ceilometer01:23
*** nosnos has joined #openstack-ceilometer01:27
*** sdake has joined #openstack-ceilometer01:35
*** sdake_ has joined #openstack-ceilometer01:35
*** _cjones_ has quit IRC01:37
*** alexpilotti has quit IRC01:47
*** flwang has quit IRC02:00
*** matsuhashi has quit IRC02:00
*** matsuhashi has joined #openstack-ceilometer02:08
*** anamalagon has joined #openstack-ceilometer02:39
*** flwang has joined #openstack-ceilometer02:41
*** nati_ueno has quit IRC02:42
*** thomasem has joined #openstack-ceilometer02:53
*** anamalagon has quit IRC03:05
*** matsuhashi has quit IRC03:15
*** nosnos has quit IRC03:28
*** thomasem has quit IRC03:39
*** nati_ueno has joined #openstack-ceilometer04:02
*** mihgen has joined #openstack-ceilometer04:22
*** matsuhashi has joined #openstack-ceilometer04:25
*** nosnos has joined #openstack-ceilometer04:36
*** _nadya_ has joined #openstack-ceilometer05:02
*** _nadya_ has quit IRC05:03
*** flwang1 has joined #openstack-ceilometer05:27
*** kun_huang has quit IRC05:28
*** flwang has quit IRC05:29
*** _nadya_ has joined #openstack-ceilometer05:30
*** ildikov_ has quit IRC05:52
openstackgerritPiyush Masrani proposed a change to openstack/ceilometer: Documenting hypervisor support for nova meters  https://review.openstack.org/7991005:57
*** nati_ueno has quit IRC05:57
*** _nadya_ has quit IRC06:00
openstackgerritJenkins proposed a change to openstack/ceilometer: Imported Translations from Transifex  https://review.openstack.org/7676206:04
*** sdake has quit IRC06:12
*** sdake_ has quit IRC06:12
*** saju_m has joined #openstack-ceilometer06:19
*** sdake has joined #openstack-ceilometer06:24
*** sdake has quit IRC06:24
*** sdake has joined #openstack-ceilometer06:24
*** sdake_ has joined #openstack-ceilometer06:27
*** matsuhashi has quit IRC06:33
*** matsuhashi has joined #openstack-ceilometer06:35
*** eglynn has joined #openstack-ceilometer06:53
*** liusheng has quit IRC06:55
*** matsuhas_ has joined #openstack-ceilometer07:03
*** flwang1 has quit IRC07:03
*** matsuhas_ has quit IRC07:04
*** flwang has joined #openstack-ceilometer07:06
*** matsuhas_ has joined #openstack-ceilometer07:06
*** matsuhashi has quit IRC07:07
*** ildikov_ has joined #openstack-ceilometer07:11
*** gibi has joined #openstack-ceilometer07:11
*** saju_m has quit IRC07:13
*** liusheng has joined #openstack-ceilometer07:28
*** inc0 has joined #openstack-ceilometer07:29
eglynnjd__: good morning!07:34
jd__hi eglynn07:34
eglynnjd__: if you got a spare sec, could you consider restoring your +1 on https://review.openstack.org/82672 ?07:34
eglynn(patch set 2 is just a test improvement, basic fix is unchanged)07:34
jd__let me check07:34
eglynnjd__: I spoke too soon! :)07:35
jd__I think so :)07:35
eglynnildikov_: ta much!07:35
jd__ildikov_: is fast07:35
eglynnjd__: apols for the noise :)07:35
jd__np :)07:35
ildikov_eglynn, jd__: good morning guys :)07:37
eglynnildikov_: good morning!07:37
ildikov_eglynn: please check my comment on the second patch set07:37
eglynnildikov_: looking now07:37
eglynnildikov_: good point on the volume > 1 being unrealistic for the instance meter07:39
eglynnildikov_: though in this case, shouldn't impact on what test is seeking to achieve07:40
jd__FYI rc1 is targetted for Friday07:40
eglynnildikov_: ...  as long as count(sample) > 100 while count(distinct(resource_id)) > 100, the volume won't really matter than much07:40
ildikov_eglynn: I know that it will not affect the test flow, but after our conversation about testing, I think it is important to use realistic test data (both for positive and negative test cases)07:40
eglynnildikov_: you're absolutely correct! I'll fix next time my nose is in that code :)07:41
ildikov_jd__: cool, thanks for the info07:41
eglynnjd__: yeah just reading the backlog for the project/release meeting last night07:41
eglynnjd__: ... that should be doable, or?07:42
ildikov_eglynn: sorry for arguing so much about tests07:43
eglynnildikov_: ... nah, you were absolutely correct to point out that issue :)07:43
jd__eglynn: I hope so07:44
eglynnjd__: I'll line up a ceiloclient release with RC1, there are about 2 more client patches I'd like to see land first07:45
eglynn(... time-constrained alarms and selectable aggregates)07:46
jd__great07:46
ildikov_eglynn: I will try to look at those patches today, but I cannot promise anything, I started it yesterday, but I got distracted :(07:48
ildikov_eglynn: as for the selectable aggregates patch, I haven't seen any test for checking the printed format of the returned data, I assume there should be a test like that, am I correct?07:49
*** mihgen has quit IRC07:50
eglynnildikov_: for the client tests, there isn't universal coverage of the formatted output of shell commands07:53
eglynnildikov_: ... usually the pattern is to assert on the returned representation instead IIRC07:54
eglynnildikov_: ... but in some cases (such as alarm-history) a more complete assertion on the formatted output is done07:54
ildikov_eglynn: I meant the table format with those ugly assertEqual checks in the test cases07:55
eglynnildikov_: ... a-ha, ok, the expected-actual ordering issue, do you mean?07:55
*** mihgen has joined #openstack-ceilometer07:57
* eglynn is not sure what ugly means in this context ...07:58
ildikov_eglynn: I'm talking about the test_shell.py07:58
*** matsuhas_ has quit IRC07:59
eglynnildikov_: ... a-ha ok, that's kinda what I understood also originally07:59
inc0ildikov_, true, but well, there is no test for statistics shell call at all08:00
ildikov_eglynn: there are several query output tests08:00
eglynnildikov_: so only a representative subset of commands are covered by https://github.com/openstack/python-ceilometerclient/blob/master/ceilometerclient/tests/v2/test_shell.py08:00
inc0I think thats separate matter, but yes, it is an issue08:00
ildikov_inc0: it's not a good excuse that there isn't any test currently ;)08:01
eglynnildikov_: ... but you are correct, we should strive to have more complete coverage there08:01
eglynnildikov_: ... ugliness notwithstanding ;)08:01
inc0ildikov_, can't argue with that;) all I'm saying is that should be separate patch imho08:01
inc0also, we should check if there are any more non-tested methods out there08:02
inc0I'll run coverage over it08:03
*** matsuhashi has joined #openstack-ceilometer08:04
ildikov_inc0: I can agree with that it can be a separate patch08:04
* eglynn loves the sweet, sweet smell of an emergant consensus ... :)08:06
jd__eglynn: https://bugs.launchpad.net/ceilometer/+bug/1297677 wtf?08:07
ildikov_inc0: it would be good, if you could run a coverage test, I had time only had look at Ceilometer's test coverage report without the client code08:07
eglynnjd__: ... looking08:07
inc0eglynn, btw, about this trace I got yesteday = AttributeError at https://github.com/openstack/ceilometer/blob/master/ceilometer/compute/util.py#L43 , I think I spotted an bug. Not sure why, but for time to time (every hour to be more exact) I get notification, in which message['payload']['metadata'] == []08:10
inc0instead of for example {}08:10
eglynnjd__: ... ickk, that looks very wrong08:11
eglynnjd__: ... I'll need to dig thru the git fossil record to figure out how that happened08:11
eglynnjd__: ... that small fragment of code around alarm ownership/visibility was refactored multiple times IIRC08:11
eglynninc0: ... only for notifications originating from nova?08:12
eglynninc0: ... that could be a bug in the nova instance audit logic08:12
inc0maybe its due to our not-too-fresh nova version08:13
jd__eglynn: I'm surprised we don't have tests for that08:13
eglynninc0: ... that generates instance.exists notification every hour, day, week (cadence based on nova config)08:13
eglynnjd__: ... yep, me too08:13
*** mihgen has quit IRC08:13
eglynnjd__: ... I'll confirm it this morning when I get in to the office08:13
ildikov_eglynn, jd__: there are post alarm test cases only with admin role, if I see right, so it seems that nothing protected that part of the code08:13
jd__eglynn: cool thanks08:13
inc0still, I think we should check type before parsing it, bug or no bug in nova08:14
ildikov_eglynn, jd__: but I will have a deeper look in the test code08:14
eglynninc0: yes you are correct, we need to tolerant any chaotic variations in notification structure that the other services feel like throwing at us08:17
jd__inc0: eglynn: that's why there was a plan to schematize these notif :(08:17
eglynninc0: can you file a couple of bugs, one definite for ceilo and one tentatively for nova?08:17
inc0I'll report one for ceilo and look if its known issue in nova08:18
eglynnjd__: yeah, but I thought we discussed that and concluded we'd just have to be tolerant of variation anyway?08:18
eglynninc0: cool, thanks!08:18
jd__eglynn: no actually there's a bp in oslo.messaging to do that08:18
jd__just didn't have time to push it more so far08:18
eglynnjd__: a-ha, cool08:19
ildikov_jd__: which is that BP in oslo.messaging?08:19
inc0https://bugs.launchpad.net/ceilometer/+bug/129768608:20
openstackgerritUros Jovanovic proposed a change to openstack/python-ceilometerclient: Adds alarm time constraint support to ceilometer CLI  https://review.openstack.org/7835608:25
jd__ildikov_: https://blueprints.launchpad.net/oslo.messaging/+spec/notification-structured08:26
inc0jd__, it doesn't seem to have much activity in it :(08:29
ildikov_jd__: thanks, I will check it, as I have a bug about inconsitently handled metadata, which would need some centralized handling of this data too08:29
openstackgerritA change was merged to openstack/ceilometer: Avoid swallowing AssertionError in test skipping logic  https://review.openstack.org/8229708:29
openstackgerritA change was merged to openstack/ceilometer: Ensure idempotency of cardinality reduction in mongo  https://review.openstack.org/8267208:29
jd__ildikov_: great08:30
ildikov_jd__: I had a look at CADF events, but metadata is an unhandled part of the payload in CADF too, I was wondering if we could have some metadata model or something to handle this08:32
ildikov_jd__: anyway, I will try to find some time in schedule to take a deeper look at, and then we will see, what could be the next step to push this forward08:34
openstackgerritA change was merged to openstack/ceilometer: spawn multiple workers in services  https://review.openstack.org/7996208:38
*** Ruetobas has quit IRC08:40
*** admin0 has joined #openstack-ceilometer08:40
admin0hello all08:40
admin0i was able to write a python daemon that takes the ceilometer stats and sends it to graphite08:43
jd__ildikov_: well part of the point is not to have metadata anymore, but thigns structured in notifications – so that would be structured data rather than random key/values08:43
admin0now i am looking for a way to create it as an adapter08:43
openstackgerritA change was merged to openstack/ceilometer: fix create_or_update logic to avoid rollbacks  https://review.openstack.org/8196908:43
ildikov_jd__: you mean that there would be no resource/user metadata?08:44
ildikov_jd__: when I checked the CADF related BPs and wiki pages it did not solve this problem, but if the goal is to move to the metadataless direction and include the data into the notifications in a structured way, I'm not against it08:45
*** inc0 has quit IRC08:47
*** Ruetobas has joined #openstack-ceilometer08:47
ildikov_jd__: as for the alarm bug, I modified one of the tests to set the role to "tenant" instead of "admin" and I got back a nice Unauthorized error08:48
*** inc0 has joined #openstack-ceilometer08:49
*** Ruetobas has quit IRC08:51
*** Ruetobas has joined #openstack-ceilometer08:52
*** mihgen has joined #openstack-ceilometer09:06
eglynnildikov_: IIUC I've confirmed the alarm bug in devstack09:08
*** yassine has joined #openstack-ceilometer09:08
*** yassine has quit IRC09:08
*** yassine has joined #openstack-ceilometer09:08
eglynnildikov_: ... create an alarm with user_id & project_id explicitly set to an admin user_id/project_id that differs from the current non-admin user's identity09:09
eglynnildikov_: ... in that case the alarm is created with the user_id & project_id of the current user, as opposed to failing with an explicit auth error09:11
eglynnildikov_, jd__: ^^^ thinking about it some more, it's not outrageously bad behaviour, as there's no leakage of privilege involved09:12
eglynn... but it does go against the "principle of least astonishment" ;)09:13
*** massi_ has joined #openstack-ceilometer09:17
eglynn... also inconsistent with the behaviour seen if the alarm query constrains on the admin project_id09:18
jd__yeah that sounds weird09:19
eglynn(i.e. that case fails as expected with 401 "Not Authorized to access project $ADMIN_TENANT_ID"09:19
eglynnjd__: target to RC1 do you reckon?09:20
eglynnjd__: (... I can prepare a patch in case ZhiQiang Fan doesn't show up with a fix by EoD)09:20
admin0hi eglynn , i was able to write a python script that formats the messages from udp and push to graphite .. now instead of running another daemon, i want to create a graphite publisher .. .. would adding graphite.py be enough for ceilometer to recognise this publisher which I can use from pipeline ?09:21
ildikov_eglynn: a-ha, ok, I had a meeting in the meantime, so I did not have time for the specific cases, I just verified the regular behavior :)09:21
eglynnildikov_: cool, np!09:21
eglynnadmin0: I guess that would depend on what's in your graphite.py09:22
admin0i am copying the udp.py and formatting it send directly to graphite09:22
eglynnadmin0: but yeah the general idea is that the publishers are discovered and automatically loaded if the module exists09:23
ildikov_eglynn: I think it's another point on the side of talking about testing on the summit, do you agree? :)09:23
eglynnildikov_: ... the lack of coverage for that particular alarm creation usecase?09:24
eglynnildikov_: ... sure, one of the many gaps ... I guess shows up the limitation of measuring coverage in line-counts09:24
ildikov_eglynn: yes, I will collect the list of test issues occurred in the past one or two weeks09:24
eglynnildikov_: nice one! thanks09:25
ildikov_eglynn: what about sharing a session about this and using your preso and my list?09:25
eglynnildikov_: a capital idea! :)09:26
admin0eglynn: so i don't need to declare my class graphite in setup.cfg under celimoeter.publisher , but just leave the graphite.py file insider publishers and it will pick it up automatically ?09:26
eglynnildikov_: ... do you wanna throw a proposal up on http://summit.openstack.org/ ?09:27
ildikov_eglynn: with gibi we are also on writing up some gate job proposals for coverage check and some kind of spell checking, so we will have some items to improve on this area09:27
ildikov_eglynn: sure, I just wanted to ask, if it is ok with you, if I throw up one :)09:27
eglynnildikov_: cool, thanks!09:27
ildikov_eglynn: /me thanks :)09:27
eglynnadmin0: yeah, sure, that's the way all stevedore extensions are loaded by ceilo09:28
ildikov_eglynn: I will register the proposal for this today09:28
*** Trozz has quit IRC09:28
eglynnadmin0: ... i.e. the entry point is defined so that the extension name (e.g. "udp") can be associated with a concrete class (e.g. "ceilometer.publisher.udp:UDPPublisher")09:29
eglynnadmin0: ... what I meant was that your code does not have be present in the ceilometer code tree09:29
*** Trozz has joined #openstack-ceilometer09:29
eglynnadmin0: ... or in the ceilometer packages/RPMs that you've installed09:29
*** admin0 has quit IRC09:29
eglynnadmin0: ... it just needs to be loadable from somewhere09:30
*** Trozz_ has joined #openstack-ceilometer09:30
*** Trozz_ has quit IRC09:30
*** Trozz has quit IRC09:30
eglynn... /me scurries off on his commute, laters09:31
*** Trozz has joined #openstack-ceilometer09:31
*** eglynn has quit IRC09:31
*** Trozz_ has joined #openstack-ceilometer09:31
*** mich5225 has joined #openstack-ceilometer09:32
*** Trozz has quit IRC09:33
*** Trozz_ has quit IRC09:33
*** mich5225 has quit IRC09:33
*** Trozz has joined #openstack-ceilometer09:33
*** flwang has quit IRC09:35
*** Trozz has quit IRC09:39
*** Trozz has joined #openstack-ceilometer09:40
*** Trozz has quit IRC09:40
*** Trozz has joined #openstack-ceilometer09:43
*** Trozz has quit IRC09:45
openstackgerritIlya Tyaptin proposed a change to openstack/ceilometer: Fix order of arguments in assertEquals  https://review.openstack.org/7159509:46
*** admin0 has joined #openstack-ceilometer09:49
admin0sorry .. got disconnected .. had a standup09:50
*** admin0 has left #openstack-ceilometer09:50
*** admin0 has joined #openstack-ceilometer09:50
*** admin0 has quit IRC09:52
*** admin0 has joined #openstack-ceilometer10:06
*** matsuhashi has quit IRC10:09
admin0back again10:12
*** eglynn has joined #openstack-ceilometer10:19
*** nacim has joined #openstack-ceilometer10:24
*** eoutin has joined #openstack-ceilometer10:24
*** Trozz has joined #openstack-ceilometer10:31
*** admin0 has quit IRC10:33
*** admin0 has joined #openstack-ceilometer10:33
*** Trozz has quit IRC10:34
*** admin0 has quit IRC10:37
*** matsuhashi has joined #openstack-ceilometer10:39
*** admin0 has joined #openstack-ceilometer10:39
*** Trozz has joined #openstack-ceilometer10:41
*** admin0 has quit IRC10:41
*** Trozz has quit IRC10:42
*** Trozz has joined #openstack-ceilometer10:44
*** Trozz has quit IRC10:45
*** liusheng has quit IRC10:46
openstackgerritliusheng proposed a change to openstack/python-ceilometerclient: Display message on HTTPException  https://review.openstack.org/8302810:48
openstackgerritliusheng proposed a change to openstack/python-ceilometerclient: Display message on HTTPException  https://review.openstack.org/8302810:51
*** liusheng has joined #openstack-ceilometer10:52
*** vrovachev has joined #openstack-ceilometer10:55
*** janisg has quit IRC10:58
*** eoutin has quit IRC10:58
openstackgerritA change was merged to openstack/ceilometer: Fix updating alarm can specify existing alarm name  https://review.openstack.org/7849510:59
*** janisg has joined #openstack-ceilometer11:00
openstackgerritMichal Jastrzebski proposed a change to openstack/ceilometer: Fixing problem with inconsistent metadata structure in messages from nova. When message['payload']['metadata'] was not dict ceilometer raised AttributeError.  https://review.openstack.org/8303411:10
*** admin0 has joined #openstack-ceilometer11:12
openstackgerritMichal Jastrzebski proposed a change to openstack/ceilometer: Metadata in compute.instance.exists fix  https://review.openstack.org/8303411:14
*** saju_m has joined #openstack-ceilometer11:21
*** Trozz has joined #openstack-ceilometer11:23
*** Trozz has quit IRC11:23
*** Trozz has joined #openstack-ceilometer11:29
*** Trozz has quit IRC11:36
*** Qlawy has joined #openstack-ceilometer11:43
QlawyHi11:43
QlawyCan anyone help me with empty list from ceilometer?11:43
Qlawyall lists :(11:43
Qlawyin central.log and compute.log I have 2014-03-26 12:39:46.674 28118 AUDIT ceilometer.publisher.rpc [-] Publishing 1 samples on metering11:45
Qlawyco it looks like sth is working...11:45
inc0Qlawy, which list?11:52
inc0what exactly are you doing?11:52
*** bogdando has quit IRC11:58
*** Trozz has joined #openstack-ceilometer12:02
Qlawyinc0: I configured ceilometr (i hope i did it right)12:02
*** Trozz has quit IRC12:03
Qlawyinc0: and then ceilometer resource-list ... ist empty12:03
Qlawyinc0: ceilometer meter-list is empty too12:03
inc0(btw, are you from Poland by any chance?;))12:03
Qlawyinc0: tak12:03
inc0tak sądziłem12:03
Qlawymaj inglish iz soł bed? :P12:03
inc0anyway, did you install all the agents?12:03
Qlawynope, just central and compute12:03
Qlawyand ofc api12:03
inc0confirm that all agents are running12:04
inc0notification etc12:04
QlawyI have openstack-ceilometer-api openstack-ceilometer-central and openstack-ceilometer-compute up and running12:05
inc0you need: ceilometer-agent-central and ceilometer-agent-notification12:05
inc0on cloud controler12:05
inc0also running12:05
Qlawythis one is aio12:05
QlawyI think I have not collector running Oo12:05
inc0yes, collector is also helpful ;)12:06
inc0and agent-compute should be running on compute nodes12:07
Qlawyok, its running12:07
inc0not cloud controler12:07
Qlawyas I said its all-in-one ;)12:07
Qlawyhowever I have additional 2 compute nodes where I can run just compute agent12:08
inc0yup12:08
*** flwang has joined #openstack-ceilometer12:08
*** kun_huang has joined #openstack-ceilometer12:09
*** promulo has quit IRC12:09
*** matsuhashi has quit IRC12:10
*** bogdando has joined #openstack-ceilometer12:10
*** matsuhashi has joined #openstack-ceilometer12:11
Qlawylooks better12:11
Qlawyinc0: now... any idea how to get cpu usage from compute node? Should I change sth in pipeline.yaml?12:12
*** matsuhas_ has joined #openstack-ceilometer12:13
*** matsuhashi has quit IRC12:13
inc0Qlawy, you mean ticks or what?12:14
inc0http://docs.openstack.org/developer/ceilometer/measurements.html look here12:15
inc0you can get eighter usage in % or cpu time12:15
Qlawyinc0: yeah, but I dont see resourceId in ceilometer resurce-list for host12:16
Qlawyinc0: and yeah, % is better for my purposes12:17
eglynnQlawy: re. "any idea how to get cpu usage from compute node"12:18
eglynnQlawy: ... note that cpu and cpu_util relate to CPU usage of the *instances* running on the compute node, as opposed to the node itself12:19
eglynnQlawy: ... for the latter, you'd need to used SNMP monitoring12:19
Qlawycompute_monitors = ComputeDriverCPUMonitor12:20
QlawyBy default, Nova will not collect the following meters related to the host compute node machine. Nova option ‘compute_monitors = ComputeDriverCPUMonitor’ should be set in nova.conf to enable meters.12:20
QlawyI feel a bit confused :(12:21
eglynnQlawy: my fault, that's yet another was of getting CPU from the compute12:21
eglynnQlawy: ... in this case via nova notifications12:21
Qlawyeglynn: thank you anyway ;)12:22
Qlawybut still no compute.node.* in resource list ;/12:23
Qlawyperhaps I have to configure sth in pipline or somethere12:24
*** eoutin has joined #openstack-ceilometer12:26
eglynnQlawy: I'm not too familiar with the corresponding nova feature, but IIUC these data should be emmitted as nova notifications and picked up by the catch-all meter_pipeline/meter_source in the ceilometer pipeline.yaml12:27
eglynnQlawy: ... this BP doesn't seem full complete https://blueprints.launchpad.net/nova/+spec/utilization-aware-scheduling12:27
Qlawyeglynn: yeah...12:32
Qlawyit looks like my openstack "flavor" has no monitor implemented yet12:36
QlawyI mean this: https://github.com/openstack/nova/tree/8252b4a1dc1b584f82e3d0c52a355b3cb3252ce6/nova/compute/monitors12:36
*** promulo has joined #openstack-ceilometer12:37
*** eoutin has quit IRC12:39
*** inc0 has quit IRC12:41
*** jaypipes has quit IRC12:51
*** thomasem has joined #openstack-ceilometer12:52
*** gordc has joined #openstack-ceilometer12:54
*** jaypipes has joined #openstack-ceilometer12:56
*** inc0 has joined #openstack-ceilometer13:00
openstackgerritgordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend  https://review.openstack.org/8046113:00
openstackgerritgordon chung proposed a change to openstack/ceilometer: improve performance of resource-list in sql  https://review.openstack.org/8034313:01
gordcdhellmann: if you have time, could you take a look at the comment here with your name: https://review.openstack.org/#/c/80343/6/ceilometer/api/controllers/v2.py  (tried to find ryanpetrello but he seems to be MIA)13:06
*** matsuhas_ has quit IRC13:07
*** julim has joined #openstack-ceilometer13:16
*** mihgen has quit IRC13:17
*** thomasem has quit IRC13:19
openstackgerritgordon chung proposed a change to openstack/ceilometer: DBDeadlock exception in sql backend  https://review.openstack.org/8046113:21
*** admin0 has joined #openstack-ceilometer13:25
*** pas-ha has joined #openstack-ceilometer13:27
*** yassine_ has joined #openstack-ceilometer13:32
*** nacim has quit IRC13:34
*** nosnos has quit IRC13:35
admin0hey13:40
*** flwang has quit IRC13:49
openstackgerritEoghan Glynn proposed a change to openstack/ceilometer: Verify user/project ID for alarm created by non-admin user  https://review.openstack.org/8307213:49
*** flwang has joined #openstack-ceilometer13:50
*** nacim has joined #openstack-ceilometer13:51
openstackgerritEoghan Glynn proposed a change to openstack/ceilometer: Verify user/project ID for alarm created by non-admin user  https://review.openstack.org/8307214:01
*** prad_ has joined #openstack-ceilometer14:04
inc0hmm, how long does it take to run tox -e py27 for you?14:05
inc0because its 5min now and it seems hanged for me...14:06
eglynninc0: ... /me hopes it wasn't my 200-sample test in https://review.openstack.org/82672 that's slowing it down14:07
eglynninc0: ... e.g. if sqlite totters under such a "massive" workload14:08
eglynninc0: ... maybe run tests again after trying: git revert 6426ca9b11bd29dcf9ef5926fcc51763b84f913e14:10
eglynninc0: ... to see if that's actually the case14:10
eglynninc0: ... if so, I could look at making that test specific to the mongo scenario14:11
inc0eglynn, I don't think so. I had some problems with mongo on my osx, so that would be my guess14:11
eglynninc0: ... k, cool14:11
inc0I don't trust neighter osx nor mongo14:11
eglynnLOL :)14:11
eglynn... when /me had a MacBook back in the day, I only ever used it to ssh into a RHEL VM14:12
eglynn... seemed wrong somehow to try to do real development on what looked like a consumer appliance ;)14:13
inc0well they asked me if I want mac os or dell, I figured out that I'll give mac a try, I'm still thinking of installing ubuntu here after all14:14
*** massi_ has quit IRC14:14
eglynnyou prolly choose well, at least the battery life on the Mac rocks :)14:14
inc0true, and this magic mouse thingy is greay14:15
inc0great*14:15
inc0thats why I'm still enduring mac os14:15
eglynnif only it had a proper gesture for "double click"14:16
eglynn... tho it prolly does by now14:16
eglynn... prolly had all along only I was dumb to find it14:16
inc0well dclick is simply dclick for me14:16
inc0with few apps its pretty configurable14:16
eglynn... /me needs to eat, brain power is rapidly declining ;)14:17
*** eglynn is now known as eglynn-lunch14:17
admin0eglynn, as you said, I created a file called graphite.py and put it inside /usr/lib/python2.6/site-packages/ceilometer/publisher/   .. then in pipeline, i set it to graphite://  .. but i get  TRACE ceilometer.pipeline RuntimeError: No 'ceilometer.publisher' driver found, looking for 'graphite ..14:28
admin0what am i missing14:29
openstackgerritA change was merged to openstack/python-ceilometerclient: Adds alarm time constraint support to ceilometer CLI  https://review.openstack.org/7835614:32
gordcadmin0: you need to create an entry point14:33
admin0gordc: where do I do that ?14:33
gordcadmin0: if you're working against source you should update https://github.com/openstack/ceilometer/blob/master/setup.cfg#L16014:34
openstackgerritMichal Jastrzebski proposed a change to openstack/ceilometer: Metadata in compute.instance.exists fix  https://review.openstack.org/8303414:34
gordcadmin0: if not, there should be an entry_points.txt file you can edit.14:35
*** inc0 has quit IRC14:37
admin0gordc: thanks .. i found /usr/lib/python2.6/site-packages/ceilometer-2013.2.2-py2.6.egg-info/entry_points.txt   .. and i think i need to add my change under [ceilometer.publisher] and try again14:38
gordcadmin0: np, give that a try.14:38
*** alexpilotti has joined #openstack-ceilometer14:39
admin0pipeline has:  - graphite://localhost:5005  , in entry_points, I added: graphite = ceilometer.publisher.graphite:GraphitePublisher     and my /usr/lib/python2.6/site-packages/ceilometer/publisher/graphite.py  file has class GraphitePublisher(publisher.PublisherBase):   and error and code  is here: http://pastebin.com/QchMTf0314:44
admin0what might I be missing14:47
*** jmckind has joined #openstack-ceilometer14:48
*** julim_ has joined #openstack-ceilometer15:00
*** julim has quit IRC15:01
admin0gordc: any ideas15:02
admin0or pointers as where i should look15:02
*** mihgen has joined #openstack-ceilometer15:07
gordcadmin0: looks like it found your file... it says it can't process "from ceilometer.publisher import utils"15:07
gordcadmin0: i'm not sure why.15:07
admin0i did a copy paste of the udp.py and just changed the LOG value from udp to graphite ..15:08
admin0to test15:08
admin0before I add in my codes15:08
admin0while udp is working fine, this does not15:08
gordcadmin0: does ceilometer.publisher.utils.py file exist?15:09
admin0 not inside publishers .. /usr/lib/python2.6/site-packages/ceilometer/utils.py15:10
admin0i copied the utils.py from ceilometer to inside publishers .. same error .15:12
admin0now 2014-03-26 15:11:48.719 20968 ERROR stevedore.extension [-] Could not load 'graphite': no such group: collector15:12
admin0udp.py works fine15:13
*** admin0 has quit IRC15:14
gordcadmin0: are you using havana?15:14
gordci find it strange none of these files exist...it seems like you're copying master copy of udp.py and trying to use it against havana.15:16
*** lsmola_ has quit IRC15:19
*** pas-ha has quit IRC15:19
*** fnaval has joined #openstack-ceilometer15:21
*** lsmola_ has joined #openstack-ceilometer15:34
*** piyushmasrani has quit IRC15:34
*** kun_huang has quit IRC15:35
*** mihgen has quit IRC15:36
*** admin0 has joined #openstack-ceilometer15:37
openstackgerritgordon chung proposed a change to openstack/ceilometer: improve performance of resource-list in sql  https://review.openstack.org/8034315:39
*** saju_m has quit IRC15:43
*** kun_huang has joined #openstack-ceilometer15:44
*** _cjones_ has joined #openstack-ceilometer15:48
*** sayalilunkad has joined #openstack-ceilometer15:52
*** Ruetobas has quit IRC16:01
*** Ruetobas has joined #openstack-ceilometer16:03
*** lsmola_ has quit IRC16:06
*** Ruetobas has quit IRC16:08
*** eglynn-lunch is now known as eglynn16:09
*** _nadya_ has joined #openstack-ceilometer16:10
*** Ruetobas has joined #openstack-ceilometer16:13
*** lsmola_ has joined #openstack-ceilometer16:20
*** leews has joined #openstack-ceilometer16:23
openstackgerritJenkins proposed a change to openstack/ceilometer: Updated from global requirements  https://review.openstack.org/7763916:24
*** boris-42 has quit IRC16:24
*** nacim has quit IRC16:30
*** kun_huang has quit IRC16:30
*** boris-42 has joined #openstack-ceilometer16:36
_nadya_guys, it seems to me that we have problems with anotification service again16:41
_nadya_maybe someone knows anything? I do not see screen with this service in latest Jenkins run16:42
_nadya_e.g. http://logs.openstack.org/24/83024/1/check/check-tempest-dsvm-full/3fc18a5/logs/16:42
ildikov__nadya_: and also Ceilometer python26, 27 gates are failing continuously for a while now16:44
_nadya_hmm...let me ask infra-team16:45
ildikov__nadya_: as I saw, the gates were failing only in case of Ceilometer, I did not see anything useful after the first quick look16:47
_nadya_ildikov_: I'll check that16:47
ildikov__nadya_: cool, thanks, I did not have time for having a deeper look16:49
*** admin0 has quit IRC16:52
openstackgerritEoghan Glynn proposed a change to openstack/ceilometer: Verify user/project ID for alarm created by non-admin user  https://review.openstack.org/8307216:52
*** nati_ueno has joined #openstack-ceilometer17:00
*** gpizza has joined #openstack-ceilometer17:03
*** admin0 has joined #openstack-ceilometer17:04
*** kun_huang has joined #openstack-ceilometer17:07
*** anamalagon has joined #openstack-ceilometer17:09
gordc_nadya_:17:09
gordc_nadya_: whoops too late. i push a fixed here: https://review.openstack.org/#/c/83103/17:09
_nadya_gordc: ah, ok :)17:10
gordc_nadya_: want me to close mine. i don't think anyone from infra knows about it yet.17:10
_nadya_gordc: it's ok, don't mind. Mine is later :) I will abandon17:11
gordc_nadya_: cool cool17:11
*** gpizza has quit IRC17:13
openstackgerritgordon chung proposed a change to openstack/ceilometer: Sync oslo-incubator code  https://review.openstack.org/7813217:13
_nadya_gordc: I decided to check that tempest tests are success after several workers commit but they aren't. Hope that after gating fix they will pass :)17:17
gordc_nadya_: there's quite a few issues i'm looking at.17:18
gordc_nadya_: we will need this patch https://review.openstack.org/78132 to get postgres working i believe.17:18
_nadya_gordc: oh... besides, we had problem without DBDeadlock fix17:19
*** anamalagon has quit IRC17:22
admin0gordc: i gave up further17:24
admin0cannot figure it out17:24
*** _nadya_ has quit IRC17:26
openstackgerritgordon chung proposed a change to openstack/ceilometer: SSL errors thrown with Postgres on multi workers  https://review.openstack.org/8314017:43
*** erecio has joined #openstack-ceilometer17:44
*** prad__ has joined #openstack-ceilometer17:44
*** prad_ has quit IRC17:45
*** anamalagon has joined #openstack-ceilometer17:48
*** prad__ has quit IRC17:51
*** admin0 has quit IRC17:51
*** eglynn has quit IRC17:52
*** prad_ has joined #openstack-ceilometer17:55
*** _nadya_ has joined #openstack-ceilometer17:55
*** prad_ has quit IRC17:55
*** saju_m has joined #openstack-ceilometer17:57
*** ruhe has joined #openstack-ceilometer18:10
*** sayalilunkad has quit IRC18:12
*** niteshselkari__ has joined #openstack-ceilometer18:15
*** prad_ has joined #openstack-ceilometer18:23
niteshselkari__hi18:28
*** prad_ has quit IRC18:31
openstackgerritIldiko Vancsa proposed a change to openstack/ceilometer: Fix ceilometer.conf.sample mismatch  https://review.openstack.org/8316418:32
*** prad_ has joined #openstack-ceilometer18:34
*** Alexei_987 has quit IRC18:36
*** prad_ has quit IRC18:38
*** lexholden has joined #openstack-ceilometer18:38
*** flwang has quit IRC18:41
ildikov_gordc: hi. are you around?18:47
*** nacim has joined #openstack-ceilometer18:51
*** lexholden has quit IRC18:52
*** flwang has joined #openstack-ceilometer18:57
*** troy_psx has joined #openstack-ceilometer18:58
*** lexholden has joined #openstack-ceilometer18:59
*** lexholden has quit IRC19:03
gordcildikov_: yep.19:04
ildikov_gordc: I just wanted to ask you to check this patch, if I'm on a right direction or not: https://review.openstack.org/8316419:05
gordcildikov_: lol19:06
*** niteshselkari__ has quit IRC19:06
gordcildikov_: i was going to just drop the checkuptodate.sh  check.19:07
gordcildikov_: that conf stuff is starting to annoy me with it's random changes.19:07
ildikov_gordc: there is the same issue in cinder too, as I saw on the gate19:07
ildikov_gordc: and for me the problem occured only after rebuilding the tox env19:08
ildikov_gordc: that is why I thought to investigate a bit, I've found a possible responsible keystoneclient change19:08
gordcyeah. it's cause of oslo libraries i think. the gate always pulls in latest version of lib19:09
ildikov_gordc: https://bugs.launchpad.net/ceilometer/+bug/129799919:09
ildikov_gordc: there was a bug earlier, with a same issue as this after a keystoneclient upgrade: https://bugs.launchpad.net/nova/+bug/126861419:09
gordcildikov_:  i know nova pulled out the check a whlie back. don't know if they added it back in again19:10
ildikov_gordc: a-ha, ok I did not follow these changes19:10
gordcildikov_: i think we should pull it out for now but we'll see.... it's becoming a hassle guessing which options are right or wrong when we can't generate it locally.19:11
*** lexholden has joined #openstack-ceilometer19:12
ildikov_gordc: what do you mean here by pull it out?19:12
gordcildikov_: remove this: https://github.com/openstack/ceilometer/blob/master/tox.ini#L1519:13
gordcildikov_: if you can fix it that'd be better but removing it is a lot easier.19:13
ildikov_gordc: well, it is a bit late now here for making a proper fix I'm afraid :)19:15
ildikov_gordc: but if you think that it is also a proper solution to remove that line, I definitely can do that :)19:16
gordcildikov_: i'm lazy. that's the reason i'd do that :)19:16
*** erecio has quit IRC19:16
*** lexholden has quit IRC19:17
gordcildikov_: i think the issue is the conf.sample generator pulls options from external libraries as well and our local env libraries don't necessarily match up with gate env19:18
ildikov_gordc: that sound reasonable19:19
gordcildikov_: it'd be cool if jenkins ran it for us like it does for translations... but that's a dream for me.  bring the bug up during meeting (if you are attending)19:20
ildikov_gordc: what about removing that line as a quick solution to let the gate work, if you do not think that the conf.sample should be changed, and then readd it after having the proper fix?19:21
ildikov_gordc: that was my plan19:21
gordcildikov_: i support dropping it for now.19:21
*** nacim has quit IRC19:22
ildikov_gordc: ok, I will upload a second patch set with dropping that check and then I will bring it up during the meeting19:22
gordcildikov_: cool cool19:23
ildikov_gordc: thanks19:23
_nadya_gordc: could you please take a look on https://review.openstack.org/#/c/82048/3/ceilometer/storage/impl_sqlalchemy.py ? I'm not sure that I'm correct with my suggestion19:24
gordc_nadya_: that is a strange fix...19:26
_nadya_gordc: it's related to https://bugs.launchpad.net/ceilometer/+bug/1295463 mostly19:28
_nadya_gordc: very likely my understanding what tsmin and tsmax are is not correct19:30
*** anamalagon has quit IRC19:32
_nadya_gordc: is it the earliest timestamp within all entries? (tsmin)19:33
gordctsmin will give you earliest timestamp value of samples based on your filter.19:33
_nadya_gordc: yep, I meant within a filter. And filter already has start and end. but anyway we may get a situation when tsmin>>filter.start, don't we?19:37
*** kun_huang has quit IRC19:39
gordc_nadya_: you mean have a tsmin value later than filter.start? that makes sense... if tsmin is earlier than filter.start we have a problem.19:39
_nadya_gordc: let me try to find an example in tests, it will be easier to ask19:41
gordcok.19:41
*** nealph_ has quit IRC19:41
*** nacim has joined #openstack-ceilometer19:46
ildikov_gordc: BTW, you were right about Nova, there isn't any checkupdate.sh in tox.ini: https://github.com/openstack/nova/blob/master/tox.ini19:50
ildikov_gordc: there is a [testenv:genconfig] section instead19:51
*** nacim has quit IRC19:52
openstackgerritIldiko Vancsa proposed a change to openstack/ceilometer: Fix ceilometer.conf.sample mismatch  https://review.openstack.org/8316419:53
gordcildikov_: seems like simplest fix19:53
ildikov_gordc: I now removed the checkupdate.sh, but I haven't added a genconfig section like the one in Nova's tox.ini19:54
*** jergerber has joined #openstack-ceilometer19:59
*** nealph has joined #openstack-ceilometer20:00
ildikov_gordc: I will be disconnected a bit, I would like to get home before the meeting, it's not as much fun at 10pm in the office :)20:01
*** julim_ has quit IRC20:03
*** ildikov_ has quit IRC20:08
_nadya_gordc: looks like I've understood the problem. In case when user sets start, end and period we don't care about tsmin. So e.g. we have 1 Sample 20.01.2013 but user asks from 1.01.2013 till 21.01.2013 with period 1 day. We should return 19 times noting and the last value will not be empty20:09
_nadya_gordc: but if start is not set we will return only one non-empty value20:10
gordc_nadya_: i don't get it. start is set in example...and period isn't.20:11
_nadya_gordc: period is 1 day20:11
*** saju_m has quit IRC20:11
_nadya_gordc: I've reread the bug https://bugs.launchpad.net/ceilometer/+bug/1295463. the get_meter_statistics() method will try to query sample before time of earliest sample - looks like it's correct. We may not have samples for 1 week after 'start' but user asks them and we return smth like [none] (I don't know exactly)20:16
gordc_nadya_: the bug is correct or the code is correct? sorry i only half read the bug.20:17
_nadya_gordc: as for me, bug is incorrect, code is correct20:18
gordc_nadya_: yeah, i get the same feeling. i'd need to take a look at it completely20:18
*** yassine_ has quit IRC20:18
_nadya_gordc: I'll try to write a comment to review with example, thanks! sorry for disturbing20:20
*** yassine has quit IRC20:23
*** promulo has quit IRC20:26
*** anamalagon has joined #openstack-ceilometer20:28
*** saju_m has joined #openstack-ceilometer20:29
*** _nadya_ has quit IRC20:30
openstackgerritgordon chung proposed a change to openstack/ceilometer: fix rollback errors in sql backend  https://review.openstack.org/8320320:32
*** anamalagon_ has joined #openstack-ceilometer20:32
*** anamalagon has quit IRC20:33
*** anamalagon_ is now known as anamalagon20:33
openstackgerritgordon chung proposed a change to openstack/ceilometer: fix rollback errors in sql backend  https://review.openstack.org/8320320:33
*** ildikov_ has joined #openstack-ceilometer20:36
*** saju_m has quit IRC20:37
*** _nadya_ has joined #openstack-ceilometer20:41
*** julim has joined #openstack-ceilometer20:45
*** terriyu has joined #openstack-ceilometer20:50
*** eglynn has joined #openstack-ceilometer20:55
openstackgerritgordon chung proposed a change to openstack/ceilometer: enable a single worker by default  https://review.openstack.org/8321520:59
*** boris-42 has quit IRC20:59
*** admin0 has joined #openstack-ceilometer21:00
admin0hey all21:00
*** boris-42 has joined #openstack-ceilometer21:16
*** urulama has joined #openstack-ceilometer21:25
openstackgerritgordon chung proposed a change to openstack/ceilometer: enable a single worker by default  https://review.openstack.org/8321521:37
*** claudiub_ has joined #openstack-ceilometer21:56
claudiub_Hi21:58
*** terriyu has quit IRC21:59
claudiub_I have some commits that has to be backported. Most of them are small ones. :)21:59
claudiub_If you have the time, can you take a look at them? :)21:59
claudiub_https://review.openstack.org/#/c/83023/22:00
claudiub_https://review.openstack.org/#/c/83073/22:00
claudiub_https://review.openstack.org/#/c/57017/22:00
claudiub_disregard the last one. :D22:01
*** _nadya_ has quit IRC22:02
claudiub_https://review.openstack.org/#/c/83024/22:02
gordcany core want to approve this: https://review.openstack.org/#/c/83164/22:02
*** dhellmann is now known as dhellmann_22:03
gordcclaudiub_: i've no approve power on backports.22:03
claudiub_i see. could you give me some names that can help with the backports? :)22:05
*** nikhil__ is now known as nikhil__|afk22:12
eglynnclaudiub_: I'll have a look tmrw22:13
claudiub_sure thanks. :)22:13
*** eglynn has quit IRC22:15
openstackgerritgordon chung proposed a change to openstack/ceilometer: fix rollback errors in sql backend  https://review.openstack.org/8320322:16
*** troy_psx has quit IRC22:23
openstackgerritgordon chung proposed a change to openstack/ceilometer: enable a single worker by default  https://review.openstack.org/8321522:27
*** jergerber has quit IRC22:28
*** dhellmann_ is now known as dhellmann22:31
*** jmckind has quit IRC22:37
*** dhellmann is now known as dhellmann_22:41
*** julim has quit IRC23:05
*** Trozz has joined #openstack-ceilometer23:10
*** nati_ueno has quit IRC23:23
*** admin0 has quit IRC23:23
*** nati_ueno has joined #openstack-ceilometer23:23
openstackgerritA change was merged to openstack/ceilometer: Fix ceilometer.conf.sample mismatch  https://review.openstack.org/8316423:24
*** urulama has quit IRC23:26
*** admin0 has joined #openstack-ceilometer23:26
*** alexpilotti has quit IRC23:28
openstackgerritgordon chung proposed a change to openstack/ceilometer: WIP fix rollback errors in sql backend  https://review.openstack.org/8320323:35
*** Trozz has quit IRC23:40
*** admin0 has quit IRC23:42
*** fnaval has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!