Wednesday, 2014-08-06

*** ccrouch has joined #openstack-ceilometer00:04
*** Ruetobas has joined #openstack-ceilometer00:04
*** fnaval has quit IRC00:08
*** flwang_ has joined #openstack-ceilometer00:08
*** fnaval has joined #openstack-ceilometer00:09
*** yasukun has joined #openstack-ceilometer00:11
*** flwang_ has quit IRC00:13
*** fnaval has quit IRC00:13
*** _nadya_ has quit IRC00:25
*** _nadya_ has joined #openstack-ceilometer00:52
*** palar has quit IRC00:56
*** sbfox has joined #openstack-ceilometer00:57
*** sbfox has quit IRC00:57
*** sbfox has joined #openstack-ceilometer00:59
*** palar has joined #openstack-ceilometer01:00
*** mitz has quit IRC01:10
*** mitz has joined #openstack-ceilometer01:11
*** Ruetobas has quit IRC01:19
*** Ruetobas has joined #openstack-ceilometer01:27
*** Ruetobas has quit IRC01:32
*** Ruetobas has joined #openstack-ceilometer01:32
*** nosnos has joined #openstack-ceilometer01:42
*** rwsu has quit IRC01:54
*** thomasem has joined #openstack-ceilometer01:59
*** thomasem has quit IRC02:03
*** rwsu has joined #openstack-ceilometer02:07
*** flwang_ has joined #openstack-ceilometer02:09
*** flwang_ has quit IRC02:14
*** shakamunyi has joined #openstack-ceilometer02:17
*** fnaval has joined #openstack-ceilometer02:57
*** changbl has joined #openstack-ceilometer02:59
*** flwang has left #openstack-ceilometer03:23
*** _cjones_ has quit IRC03:23
*** mrmoje has quit IRC03:23
*** _cjones_ has joined #openstack-ceilometer03:24
*** _cjones_ has quit IRC03:28
*** tongli has quit IRC03:29
*** nosnos has quit IRC03:39
*** cmyster has joined #openstack-ceilometer03:50
*** cmyster has joined #openstack-ceilometer03:50
*** flwang_ has joined #openstack-ceilometer03:58
*** Longgeek has joined #openstack-ceilometer03:58
*** flwang_ has quit IRC04:02
*** raymondr has joined #openstack-ceilometer04:03
*** deepthi has joined #openstack-ceilometer04:05
*** palar has quit IRC04:14
*** nosnos has joined #openstack-ceilometer04:19
*** jaypipes has joined #openstack-ceilometer04:30
*** jasondotstar has joined #openstack-ceilometer04:38
*** fnaval has quit IRC04:41
*** jasondotstar has quit IRC04:43
*** k4n0 has joined #openstack-ceilometer04:47
*** raymondr has quit IRC04:54
*** jasondotstar has joined #openstack-ceilometer04:56
*** Titilambert has quit IRC04:57
*** Titilambert has joined #openstack-ceilometer04:58
*** scroiset has quit IRC04:58
*** scroiset has joined #openstack-ceilometer04:58
*** jd__ has quit IRC04:58
*** jd__ has joined #openstack-ceilometer04:59
*** jasondotstar has quit IRC05:19
*** raymondr has joined #openstack-ceilometer05:19
*** ildikov has quit IRC05:29
*** raymondr has quit IRC05:39
*** flwang_ has joined #openstack-ceilometer05:59
*** palar has joined #openstack-ceilometer06:00
*** flwang_ has quit IRC06:03
*** palar has quit IRC06:05
*** mitz has quit IRC06:07
*** mitz has joined #openstack-ceilometer06:09
*** tomoiaga has joined #openstack-ceilometer06:09
*** vrovachev has joined #openstack-ceilometer06:11
*** ildikov has joined #openstack-ceilometer06:13
*** tomoiaga has left #openstack-ceilometer06:14
*** shakamunyi has quit IRC06:16
*** k4n0 has quit IRC06:18
*** Dev_Jin has joined #openstack-ceilometer06:26
*** zigo has quit IRC06:28
*** Longgeek has quit IRC06:31
*** deepthi has quit IRC06:31
*** Longgeek has joined #openstack-ceilometer06:31
*** zigo has joined #openstack-ceilometer06:33
*** Longgeek has quit IRC06:35
*** Longgeek has joined #openstack-ceilometer06:38
*** deepthi has joined #openstack-ceilometer06:44
*** Dev_Jin has quit IRC06:49
*** _cjones_ has joined #openstack-ceilometer06:59
*** Longgeek has quit IRC07:03
*** _nadya_ has quit IRC07:04
*** Longgeek has joined #openstack-ceilometer07:12
*** arezmerita has quit IRC07:12
*** Longgeek has quit IRC07:13
*** arezmerita has joined #openstack-ceilometer07:13
*** Longgeek has joined #openstack-ceilometer07:15
*** cmyster has quit IRC07:15
openstackgerritMehdi Abaakouk proposed a change to openstack/ceilometer: Permit usage of notifications for metering  https://review.openstack.org/8022507:16
openstackgerritMehdi Abaakouk proposed a change to openstack/ceilometer: Allow to requeue a sample  https://review.openstack.org/11222507:16
*** cmyster has joined #openstack-ceilometer07:22
*** cmyster has joined #openstack-ceilometer07:22
*** IvanBerezovskiy1 has joined #openstack-ceilometer07:23
*** sbfox has quit IRC07:28
*** sbfox has joined #openstack-ceilometer07:29
*** _nadya_ has joined #openstack-ceilometer07:30
*** ildikov_ has joined #openstack-ceilometer07:33
*** ildikov has quit IRC07:34
openstackgerritLadislav Smola proposed a change to openstack/ceilometer: Adding script for TripleO default set of test data  https://review.openstack.org/10994707:41
*** ifarkas has joined #openstack-ceilometer07:41
*** sbfox has quit IRC07:44
*** palar has joined #openstack-ceilometer07:48
*** palar has quit IRC07:53
*** dmsimard_away has quit IRC07:58
*** sdake has quit IRC07:58
*** sdake has joined #openstack-ceilometer07:59
*** dmsimard_away has joined #openstack-ceilometer07:59
*** dmsimard_away is now known as dmsimard07:59
*** flwang_ has joined #openstack-ceilometer07:59
*** safchain has joined #openstack-ceilometer08:00
*** ildikov_ has quit IRC08:00
*** ildikov has joined #openstack-ceilometer08:00
*** flwang_ has quit IRC08:04
*** Longgeek has quit IRC08:18
*** Longgeek has joined #openstack-ceilometer08:19
*** Ruetobas has quit IRC08:23
*** Longgeek has quit IRC08:24
*** Longgeek has joined #openstack-ceilometer08:25
*** claudiub has joined #openstack-ceilometer08:29
*** Ruetobas has joined #openstack-ceilometer08:31
*** Ruetobas has quit IRC08:36
*** Ruetobas has joined #openstack-ceilometer08:42
*** mrmoje has joined #openstack-ceilometer08:43
lsmolansaje: ping08:46
*** _cjones_ has quit IRC08:46
*** cmyster has quit IRC08:49
*** deepthi has quit IRC08:53
*** sbadia has quit IRC08:53
*** deepthi has joined #openstack-ceilometer08:53
ekarlsoHi, do you guys know of a way to configure multiple notification topics for glance ?08:55
*** sbadia has joined #openstack-ceilometer08:55
*** cmyster has joined #openstack-ceilometer09:00
*** yatin has joined #openstack-ceilometer09:05
openstackgerritRen Qiaowei proposed a change to openstack/ceilometer: XenAPI support: List the instances  https://review.openstack.org/11224409:08
*** claudiub has quit IRC09:24
*** palar has joined #openstack-ceilometer09:24
*** Manish_ has joined #openstack-ceilometer09:28
*** palar has quit IRC09:29
*** yatin has quit IRC09:37
Manish_Hi All09:38
Manish_i have one query regarding Ceilometer with SWIFT... Can some one in forum help?09:38
cmysterManish_: just ask, someone will answer (if anyone knows)09:39
Manish_cmyster: thanks :)09:40
Manish_Do we need Ceilometer middleware to be placed under SWIFT code base, just for "storage.objects.incoming.bytes" , "storage.objects.outgoing.bytes" and "storage.api.request" ., But not for other meters such as "storage.objects" , "storage.objects.size" etc?09:40
*** yatin has joined #openstack-ceilometer09:50
*** flwang_ has joined #openstack-ceilometer09:53
eglynnManish_: some of those data can be acquired by *externally* polling the public swift API09:55
eglynnManish_: i.e. the info needed for "storage.objects" , "storage.objects.size" can be retrieved in that way09:55
*** palar has joined #openstack-ceilometer10:00
Manish_eglynn: Thanks for info. I wanted to understand the working of Ceilometer Middleware in more detail10:05
eglynnManish_: in order to surface per-tenant metrics on the API call traffic, we need to inject the middleware into the swift dispatch path10:05
eglynnManish_: hence the difference in requirements for the two types of swift meter10:06
Manish_eglynn: Is it like that everytime a request for READ or WRITE object  will come to SWIFT, this middleware will send the data to Ceilometer?10:06
eglynnManish_: yeap, that was discussed recently on the upstream ML10:06
eglynnManish_: ... i.e. the scalability concerns around this approach and the possibility to batch up the resultant AMQP traffic10:07
Manish_eglynn: Is there any other modification required on SWIFT code side for providing support/information to Ceilometer?10:07
eglynnManish_: no, the middleware can be installed without modify swift code10:07
Manish_eglynn: i mean for data which can be acquired through external polling, doesn't require any change in SWIFT code as basically they are gathered by Ceilometer through HEAD rest api of SWIFT on Account/Container10:08
Manish_right?10:08
*** sanu has joined #openstack-ceilometer10:09
eglynnManish_: yes10:09
Manish_but for information like incoming bytes and outgoing bytes, we just need to add this middleware in SWIFT code. Is my understanding correct?10:09
eglynnManish_: yes10:11
Manish_eglynn: Thank you so much for this information..this is really very helpful :)10:11
eglynnManish_: np! :)10:12
*** sanu has quit IRC10:13
*** yatin has quit IRC10:20
*** yasukun has quit IRC10:26
*** Longgeek has quit IRC10:41
*** Longgeek has joined #openstack-ceilometer10:42
lsmolansaje: eglynn hola10:44
lsmolansaje: eglynn just a quick check, this should be valid pipeline, right? http://paste.openstack.org/show/90985/10:45
*** yatin has joined #openstack-ceilometer10:45
eglynnlsmola: fyi nsaje is on PTO10:45
* eglynn looks10:45
lsmolansaje: eglynn for some reason it duplicates my samples, except of the transformed one10:45
lsmolaeglynn: ok, that explains why I didn't see him :-)10:46
*** cdent has joined #openstack-ceilometer10:46
lsmolaeglynn: so for 3 sinks, all my samples are there 3 times with same timestamp10:46
*** Longgeek has quit IRC10:46
eglynnlsmola: lines 7-9 associate the source with multiple sinks10:46
eglynnlsmola: so the samples should go to each10:47
lsmolaeglynn: right, does it mean it should also save them?10:47
lsmolaeglynn: cause when I put there just one transformation, it saves just the transformed sample10:47
eglynnlsmola: not sure what you mean by save them? (save them in memory?)10:47
lsmolaeglynn: no as samples in the DB10:48
eglynnlsmola: so the transformer will just change the sample and send it onto the publisher10:48
eglynnlsmola: the saving in the DB is done after the published metering message is collected10:48
eglynnlsmola: so let's start with "what behaviour did you expect to see?"10:49
lsmolaeglynn: ok10:50
lsmolaeglynn: so I want to save all the samples + 2 new samples from transformations10:50
eglynnlsmola: ok10:50
lsmolaeglynn: the example pipeline has it similar like this, but I didn't check whether it also duplicates samples10:52
*** _nadya_ has quit IRC10:52
eglynnlsmola: and what exactly are you seeing, duplicated original samples as well as the transformed samples?10:52
lsmolaeglynn: I tried it with multiple sources too, but then it duplicates only the meters defined in the source10:52
*** _nadya_ has joined #openstack-ceilometer10:53
lsmolaeglynn: so when I do e.g. sample list for cpu_idle10:53
lsmolaeglynn: I see 3 samples with the same timestamp10:53
lsmolaeglynn: that means that also each transformer is saving the originaml sample do DB10:53
eglynnlsmola: and for say hardware.system_stats.cpu.util or hardware.memory.swap.util?10:53
eglynnlsmola: how many samples for those?10:54
lsmolaeglynn: that has just one sample10:54
eglynnlsmola: one sec10:54
lsmolaeglynn: only the source is always duplicated10:54
lsmolaeglynn: but only if I have there the blank transformer10:54
lsmolaeglynn: if I map e.g. just sink with cpu_util transformer, only cpu_util sample is in the db10:55
eglynnlsmola: OK, so you get either duplication or absence of the original sample?10:57
lsmolaeglynn: I wanted to try it with just one sink with multiple transformers, but then the original data were not saved10:57
lsmolaeglynn: yes :-)10:57
lsmolaeglynn: I guess the most beautiful solution (less code) will be using one sink with 2 transformers and saving original data10:58
lsmolaeglynn: but multiple transformers of the same name are probably not allowed, right? so this should be the nicest solution :-)10:59
lsmolaeglynn: is there some benefit of defining also multiple sources in the pipeline in this context?11:03
eglynnlsmola: sorry, interrupted there11:03
eglynnlsmola: so that smells like a bug either in the pipeline logic or the transformer11:04
eglynnlsmola: ... but it's not revealing itself to me in a quick code inspection11:05
eglynnlsmola: ... so I'm gonna have to dig some more11:05
lsmolaeglynn: right, I didn't see it too11:05
eglynnlsmola: ... I'm late for a call now, will have to get back to this later in the afternoon11:05
lsmolaeglynn: walking through transformer code, it seemed to me it is sending just the new Samples11:05
lsmolaeglynn: cool, thank you11:06
eglynnlsmola: ... I'll ping you later once I've figured out what's going on11:06
lsmolaeglynn: ok, great11:06
*** Longgeek has joined #openstack-ceilometer11:10
*** nosnos has quit IRC11:10
openstackgerritIlya Tyaptin proposed a change to openstack/ceilometer: [Hbase] Add column for source filter in _get_meter_samples  https://review.openstack.org/10055811:21
openstackgerritIlya Tyaptin proposed a change to openstack/ceilometer: [HBase] Improve uniqueness for row in meter table  https://review.openstack.org/11128511:22
*** palar has quit IRC11:40
openstackgerritA change was merged to openstack/ceilometer: Replace datetime of time_constraints by aware object  https://review.openstack.org/10733211:46
*** ifarkas has quit IRC11:54
*** ifarkas has joined #openstack-ceilometer11:57
openstackgerritIgor Degtiarov proposed a change to openstack/ceilometer: [HBase] Refactor hbase.utils  https://review.openstack.org/11127011:59
*** flwang_ has quit IRC12:08
*** palar has joined #openstack-ceilometer12:12
*** cmyster has quit IRC12:14
*** deepthi has quit IRC12:17
*** _nadya_ has quit IRC12:21
*** yatin has quit IRC12:23
*** ildikov has quit IRC12:30
*** ildikov has joined #openstack-ceilometer12:31
*** safchain has quit IRC12:41
openstackgerritDina Belova proposed a change to stackforge/gnocchi: [WIP] Add OpenTSDB storage driver  https://review.openstack.org/10798612:42
*** thomasem has joined #openstack-ceilometer12:43
*** _nadya_ has joined #openstack-ceilometer12:45
*** tongli has joined #openstack-ceilometer12:45
*** gordc has joined #openstack-ceilometer12:47
*** tong_ has joined #openstack-ceilometer12:47
*** tong_ has quit IRC12:50
*** tongli has quit IRC12:50
*** raymondr has joined #openstack-ceilometer12:51
*** renatoarmani has joined #openstack-ceilometer12:51
*** safchain has joined #openstack-ceilometer12:53
*** rbowen has joined #openstack-ceilometer12:54
*** nsaje has quit IRC12:59
*** julim has joined #openstack-ceilometer12:59
*** raymondr has quit IRC13:06
*** aviau has joined #openstack-ceilometer13:08
*** Manish_ has quit IRC13:09
*** raymondr has joined #openstack-ceilometer13:12
*** fnaval has joined #openstack-ceilometer13:12
openstackgerritDina Belova proposed a change to stackforge/gnocchi: Add OpenTSDB storage driver  https://review.openstack.org/10798613:20
openstackgerritIgor Degtiarov proposed a change to openstack/ceilometer: [HBase] Refactor hbase.utils  https://review.openstack.org/11127013:22
*** jmckind has joined #openstack-ceilometer13:32
*** _nadya_ has quit IRC13:33
*** raymondr has quit IRC13:33
*** jasondotstar has joined #openstack-ceilometer13:34
*** jmckind has quit IRC13:37
*** _nadya_ has joined #openstack-ceilometer13:37
*** _nadya_ has quit IRC13:38
*** tongli has joined #openstack-ceilometer13:39
*** jasondotstar has quit IRC13:40
*** alexpilotti has joined #openstack-ceilometer13:41
ekarlsodoes ceilometer need to consume from notifications topic or can it do another ?13:46
*** ddieterly has joined #openstack-ceilometer13:46
*** ddieterly has quit IRC13:47
*** raymondr has joined #openstack-ceilometer13:48
*** raymondr has quit IRC13:48
*** amalagon has joined #openstack-ceilometer13:49
*** alexpilotti_ has joined #openstack-ceilometer13:50
*** alexpilotti has quit IRC13:53
*** alexpilotti_ is now known as alexpilotti13:53
*** jasondotstar has joined #openstack-ceilometer13:53
openstackgerritA change was merged to openstack/ceilometer: Fix make_test_data tools script  https://review.openstack.org/10994414:01
openstackgerritA change was merged to openstack/ceilometer: Extracting make_resource_metadata method  https://review.openstack.org/10994514:04
*** admin0 has joined #openstack-ceilometer14:06
openstackgerritChris Dent proposed a change to openstack/ceilometer: Allow tests to run outside tox  https://review.openstack.org/11026214:06
*** shakamunyi has joined #openstack-ceilometer14:08
*** flwang_ has joined #openstack-ceilometer14:09
*** ildikov has quit IRC14:09
*** fnaval has quit IRC14:11
*** fnaval has joined #openstack-ceilometer14:11
*** flwang_ has quit IRC14:13
jd__eglynn: what the fook is that revert bullshit on the specs ?14:14
jd__is the process is not having 2*+2 to have a spec approved, please let me know14:15
jd__s/is/if/14:15
*** fnaval has quit IRC14:16
jd__Gosh I'm already pissed off by the mount of bureauracy we have so if we start merging, reverting, discussing things even past deadline just to manage some people sensitivity14:16
jd__be aware that it's starting to getting on my sensitivity too14:17
jd__http://images.sodahead.com/polls/000831383/polls_funny_pictures_angry_grey_cat_sulks_4410_896402_answer_3_xlarge.jpeg14:17
jd__:)14:17
eglynnjd__: LOL :)14:18
eglynnjd__: this is a once-off situation, for a *limited* time, where folks thought the patch was merged before their review input could be heard14:18
jd__those people shoud better than it's a git repository a the good reason we can review and also amend things14:18
jd__like, send patches14:18
openstackgerritChris Dent proposed a change to openstack/ceilometer: Use a FakeRequest object to test middleware  https://review.openstack.org/11030214:19
eglynnjd__: yeah, fair point, TBH I was conflicted on the revert also14:19
eglynnjd__: but went ahead so as to be scruplously fair14:20
jd__I don't think it's fair14:20
jd__there's no fairness as all rules are violated, in term of delay or process14:20
jd__that's why I rant, I feel injustice on my side as an approver14:21
eglynnjd__: I feel your pain14:22
eglynnjd__: not meant sarcastically BTW14:22
jd__:)14:22
*** llu has quit IRC14:23
jd__sure I know you know14:23
*** llu has joined #openstack-ceilometer14:23
eglynnjd__: so, we've done the meeting on the first alternative approach, and will discus the second alternative approach this evening14:23
eglynnjd__: after than we revert to the normal gerrit based workflow14:24
jd__I'll think about drinking beers :->14:24
jd__did fabio write something concrete? spec anything?14:24
eglynnjd__: a slidedeck14:25
jd__a slide deck?14:25
eglynnyeap14:25
jd__are we going to let sales people write spec or what?14:25
jd__rofl14:25
*** raymondr_ has joined #openstack-ceilometer14:25
eglynnso I'm emphasized the point repeatedly that gerrit is THE vector for discussing design/code ideas needing approval14:26
jd__amen to that14:26
jd__I think I'm emphasizing that by mostly making zero effort toward other vectors14:26
eglynnyeap, I hear ya14:26
jd__but that's my call indeed I don't oblige anyone to do that14:27
eglynngiven the complexity of the problem in this case and there being two competing approaches, we'll discuss preso-stylee off-gerrit as a one-time exception14:27
eglynnthis is stuff we should prolly have been doing at mid-cycle14:27
eglynnor even in ATL TBH14:27
jd__I think we did a bit at the mid-cycle?14:27
jd__or is it different than what we (especially you and fabio) talked about for hours on the whiteboard?14:28
eglynnabsolutely we did ... but then lost a bit of momentum straight after14:28
cdentWas nejc at mid-cycle? If not, that's the variable here.14:28
eglynn(due to vacation etc.)14:28
jd__eglynn: ok14:28
jd__cdent: nop14:28
cdentHis solution, is different enough from the notes at mid-cylce to have thrown things out of wack somewhat14:28
eglynncdent: Nejc couldn't attend due to university exams that week14:29
cdent(in the right direction I think)14:29
*** ildikov has joined #openstack-ceilometer14:29
eglynncdent: he started with Red Hat the very next week, just unfortunate timing14:29
jd__bah we can discuss in mid-cycle, summit, hangout, whatever, but the rest is on Gerrit14:29
* cdent nods14:29
eglynnjd__: agreed14:29
jd__if it's not on Gerrit it doesn't exist14:29
cdent(to both)14:29
jd__it almost rhymes14:29
cdentOH NOES MY MOM DOESNLT EXIST :(14:29
jd__cdent: I feel your pain14:29
cdentheh14:30
*** renatoarmani has quit IRC14:30
jd__DO NOT TRY TO PATCH MY MOM14:30
*** itisit has joined #openstack-ceilometer14:30
cdentTOO LATE14:30
* cdent brings the tone down even more14:30
jd__fine, I'll review yours!14:30
eglynnyep, we revert to exclusively gerrit-based spec discussion once I've reciprocated the preso this evening14:30
*** raymond__ has joined #openstack-ceilometer14:30
*** terriyu has joined #openstack-ceilometer14:31
jd__eglynn: if you or someone wants to sum up the yesterday/tonight discussion I'd be glad14:31
jd__otherwise I'll poke you tomorrow anyway14:31
jd__just curious14:31
eglynnjd__: FYI the re-submitted patch is here https://review.openstack.org/11197814:32
*** fnaval has joined #openstack-ceilometer14:32
eglynnjd__: TL;DR1: use two database tables to manage contention between agents14:32
* jd__ sighs14:33
eglynnjd__: TL;DR2: discovery agents populate a coarse-grained table to take on responsibility to discover a certain type of resources14:33
*** raymondr_ has quit IRC14:33
eglynnjd__: TL;DR3: polling agents populate a fine-grained (per-resource) table to take on responsibility to poll an individual resource14:34
jd__that's the task distribution part, but how do you handle the HA part, how you know an agent is dead/alive?14:34
eglynnjd__: TL;DR4: a subscriber agent listens to AMQP heatbeats and detects when discovery/polling agents fall off a cliff, wipes corresponding rows in DB14:34
jd__ok14:35
jd__so suggest to write an oslo.messaging backend to tooz14:35
jd__that should cover TL;DR414:35
eglynnyeap, one of my suggestions last night was that we cleave off two separate problem spaces14:35
eglynn1. workload distribution amoung agents14:36
jd__for the task distribution part, I didn't think that through enough but if the hash distribution is enough it's gonna be way better to have a no-sharing method that a db based one14:36
jd__did someone invite harlowj to those meetings?14:36
eglynn2. liveness detection within the pool of agents, restarting if necessary14:36
eglynnjd__:yep Josh was invited but on PTO so he deputized Marco14:37
jd__I'm pretty sure he would be interested to hear about that because it might be something generic enough to repose in taskflow14:37
eglynnyeap, I think that was the reason to invite him14:37
jd__like the group membership is generic-ized in tooz14:37
jd__cool14:37
*** jd__ has left #openstack-ceilometer14:37
*** jd__ has joined #openstack-ceilometer14:37
jd__grrrr14:38
eglynnjd__: on decomposing the problem, the hash-based approach seems to fully address #114:38
eglynnjd__: whereas the "subscriber agent" approach could be used to ensure no worker pool emptiness for #214:38
eglynn(or a generalization of same, as part of taskflow)14:39
*** Longgeek_ has joined #openstack-ceilometer14:39
jd__yeah, #2 is entirely covered by tooz, and you can have a oslo.messaging backend to it14:39
jd__#1 is either taskflow, hash-based or db-based14:39
eglynnin any case, the highest priority for juno is #1 IMO14:40
jd__your call14:40
eglynnand I think the hash-based approach is the most lightweight way of addressing #114:40
eglynnjd__: would you prioritize differently between #1 & #2 for juno?14:40
jd__I think that too, most lightweight and scalable14:40
jd__eglynn: I think #2 is easier to achieve14:41
jd__because we already have tooz ready to be used to implement it14:41
jd__whereas #1 would be more a from scratch start14:41
jd__but honestly I won't sulk in a corner whatever is prioritized14:42
*** Longgeek has quit IRC14:42
eglynnwell #1 with the has based approach will also leverage tooz14:42
jd__we should prioritize what people wants to work on anyway…14:42
jd__eglynn: yeah, but then you more or less implementing #2 at the same time no?14:43
jd__if you start using tooz to distribute the tasks, you have liveness detection right away14:43
eglynntho' yeah, #2 can kinda fall out of the tooz approach also14:43
jd__to you're kinda doing #1 and #2 at the same time14:43
eglynnwe just need to add the restart policies etc.14:43
jd__s/to/so/14:43
*** prad has joined #openstack-ceilometer14:45
eglynnjd__: yeah, liveness detection is needed for the hash-based approach to trigger the bucket resizing14:45
eglynnjd__: ... but the spec doesn't also envisage using that info to drive restrarting agents14:46
eglynnjd__: ... but yeah, seems like a natural extension to the approach14:46
openstackgerritA change was merged to openstack/ceilometer: Add the arithmetic transformer endpoint to setup.cfg  https://review.openstack.org/11169214:55
*** thomasem has quit IRC14:58
*** admin0 has quit IRC14:58
*** thomasem has joined #openstack-ceilometer15:00
*** renatoarmani has joined #openstack-ceilometer15:00
*** sbfox has joined #openstack-ceilometer15:03
*** renatoarmani has quit IRC15:10
*** sdake has quit IRC15:13
*** sdake has joined #openstack-ceilometer15:13
*** sdake has joined #openstack-ceilometer15:13
* cdent needs more bandwidth15:14
*** fabiog has joined #openstack-ceilometer15:18
*** ddutta has joined #openstack-ceilometer15:20
* eglynn needs more beerwidth15:20
*** fnaval has quit IRC15:21
eglynnjd__: FYI http://lists.openstack.org/pipermail/openstack-dev/2014-August/042080.html15:22
*** fnaval has joined #openstack-ceilometer15:22
*** fnaval_ has joined #openstack-ceilometer15:22
* cdent eglynn that's a well put together message but it makes it very obvious that there is some skullduggery going on15:24
cdentwhoops that was not supposed to be a /me15:24
dduttaeglynn: hi .... gnocchi sounds interesting ....15:24
eglynncdent: that was the exact opposite of my intention15:25
openstackgerritIlya Tyaptin proposed a change to openstack/ceilometer: [HBase] Improve uniqueness for row in meter table  https://review.openstack.org/11128515:25
cdentthat's unfortunate then eglynn :)15:25
cdentWhat I mean is that the need for the message points out that people have been talking elsewhere (not ceilo people, but tc etc)15:25
eglynncdent: the "It's come to my attention ..." bit connotes the skullduggery?15:26
*** fnaval has quit IRC15:26
ekarlsoHi15:26
cdentsort of. Just the message existing in general15:26
*** ddutta_ has joined #openstack-ceilometer15:27
ekarlsodo you guys know how I can configure glance to have 2 topics ?15:27
cdentIt's not a bad thing, more of an "okay, let's take this out in the open". That's a _good_ thing.15:27
eglynncdent: I guess the main point I trying to make was it was out in the open all along15:28
cdentI don't think that's really true. It's true that it has never been hidden.15:28
cdentBut that's not the same as "out in the open, published, discussed, marketed"15:29
*** ddutta has quit IRC15:29
openstackgerritChris Dent proposed a change to openstack/ceilometer: Use a FakeRequest object to test middleware  https://review.openstack.org/11030215:30
*** _nadya_ has joined #openstack-ceilometer15:31
eglynncdent: out in the open ... https://etherpad.openstack.org/p/ceilometer-tsdaas15:33
eglynncdent: published ... https://wiki.openstack.org/wiki/Gnocchi15:33
*** arezmerita has quit IRC15:33
eglynncdent: marketed ... http://www.openstack.org/vote-paris/Presentation/rethinking-ceilometer-metric-storage-with-gnocchi-time-series-as-a-service15:33
cdentNo one would ever be able to find those things if you didn't point them or they didn't know some other way to look.15:34
*** ityaptin has quit IRC15:34
cdentThe only way to publish something so lots of people actually know about is the mailing list.15:34
cdentI'm not trying to argue with you here, just trying to give you some perspective from the ignorant (but wanting not to be) side of the fence.15:34
cdentThe Paris presentation is a great idea (I even voted for it) but if you felt compelled to make an email to defray people's concerns about an out of the blue big architectural change, then it is too late as a marketing tool.15:36
cdentit == the presentation15:36
cdentOf course, I'm not really clued up on why you felt compelled to make that posting, so..... who knows?15:36
eglynnwell there was no real complusion there15:37
eglynnback-chatter from the TC suggested it would be a good idea to explain the background of what we're doing15:38
cdentokay, well there you go, all my comment was is "your message makes it pretty clear there has been back-chatter"15:38
eglynna-ha, got it :)15:39
cdentDepending on your standpoint that's either the status quo, or a weakness in the organization.15:39
* eglynn was reading more into the word "skullduggery"15:39
*** BillArnold has joined #openstack-ceilometer15:41
cdentjd__: I've cooked this patchset to remove swift (again) from the middleware, at the cost of some duplication. https://review.openstack.org/#/c/110302/ Given the complexity on the other stuff (using notifications, performance, etc) it is best to just fix this thing and move on?15:42
jd__cdent: looks like a fair plan to me yeah15:42
cdentthanks15:43
*** ityaptin has joined #openstack-ceilometer15:45
*** ityaptin has quit IRC15:45
*** ifarkas has quit IRC15:45
*** ityaptin has joined #openstack-ceilometer15:45
*** mrmoje has quit IRC15:49
openstackgerritgordon chung proposed a change to openstack/ceilometer: normalise resource data  https://review.openstack.org/11131315:50
*** promulo_ has quit IRC15:58
*** sbfox1 has joined #openstack-ceilometer15:58
*** sbfox has quit IRC16:00
*** Ruetobas has quit IRC16:01
*** ddutta_ has quit IRC16:02
*** tong_ has joined #openstack-ceilometer16:05
*** atan8 has joined #openstack-ceilometer16:06
*** sbfox1 has quit IRC16:09
*** flwang_ has joined #openstack-ceilometer16:10
*** flwang_ has quit IRC16:14
*** _cjones_ has joined #openstack-ceilometer16:14
*** renatoarmani has joined #openstack-ceilometer16:17
openstackgerritEric Pendergrass proposed a change to openstack/ceilometer-specs: Placeholder commit during draft stage  https://review.openstack.org/11213716:18
*** vrovachev has quit IRC16:22
*** Longgeek_ has quit IRC16:23
*** IvanBerezovskiy1 has left #openstack-ceilometer16:31
*** _cjones_ has quit IRC16:33
*** ssakhamuri has joined #openstack-ceilometer16:34
*** _cjones_ has joined #openstack-ceilometer16:34
openstackgerritMathieu Gagné proposed a change to openstack/ceilometer: Handle Cinder attach and detach notifications  https://review.openstack.org/11235216:38
openstackgerritFabio Giannetti proposed a change to openstack/ceilometer-specs: Central Agent High Availability in Active/Active State  https://review.openstack.org/10128216:41
*** _nadya_ has quit IRC16:43
openstackgerritFabio Giannetti proposed a change to openstack/ceilometer-specs: Central Agent High Availability in Active/Active State  https://review.openstack.org/10128216:44
*** drjones has joined #openstack-ceilometer16:50
*** aviau has quit IRC16:52
*** _cjones_ has quit IRC16:53
*** amalagon_ has joined #openstack-ceilometer16:54
*** amalagon has quit IRC16:58
*** amalagon_ is now known as amalagon16:58
*** sbfox has joined #openstack-ceilometer16:58
*** sbfox has quit IRC17:00
*** sbfox has joined #openstack-ceilometer17:00
*** fabiog has quit IRC17:01
openstackgerritgordon chung proposed a change to openstack/ceilometer: normalise resource data  https://review.openstack.org/11131317:06
*** aviau has joined #openstack-ceilometer17:06
*** sbfox has quit IRC17:21
*** sbfox has joined #openstack-ceilometer17:21
*** fnaval_ has quit IRC17:22
*** fnaval has joined #openstack-ceilometer17:23
*** ildikov_ has joined #openstack-ceilometer17:25
*** _nadya_ has joined #openstack-ceilometer17:25
*** raymond__ has quit IRC17:26
*** sdake has quit IRC17:27
*** ildikov has quit IRC17:28
*** fnaval has quit IRC17:28
*** eglynn has quit IRC17:29
*** sdake has joined #openstack-ceilometer17:29
*** sdake has joined #openstack-ceilometer17:29
* cdent will be back in 30min17:30
*** aviau has quit IRC17:32
*** packet has joined #openstack-ceilometer17:35
*** renatoar_ has joined #openstack-ceilometer17:36
*** renatoarmani has quit IRC17:37
*** renatoar_ has quit IRC17:37
*** raymondr_ has joined #openstack-ceilometer17:41
*** mspreitz has joined #openstack-ceilometer17:41
*** packet has quit IRC17:41
mspreitzdhellman: are you there?17:45
*** aviau has joined #openstack-ceilometer17:45
mspreitzdhelmann: are you there?17:45
mspreitzdhellmann: are you there?17:45
*** raymondr_ has quit IRC17:45
mspreitzDoes anybody know where Ceilometer's doc/source/contributing/areas.rst goes?  Is it sitting nicely formatted somewhere?17:48
*** fabiog has joined #openstack-ceilometer17:49
*** raymondr_ has joined #openstack-ceilometer17:51
mspreitzWhere is it documented how to write cross-references between documents?17:52
*** raymondr_ has quit IRC17:55
*** raymondr_ has joined #openstack-ceilometer17:56
gordcmspreitz: are you asking if the rst files are generated/hosted somewhere?17:56
nealphmspreitz:it's published to http://docs.openstack.org/developer/ceilometer/contributing/areas.html17:56
gordcthat^17:56
mspreitzgordc: yes, as a source of examples for how to do what I want to learn17:56
gordcyou can also generate them locally before you check in by running tox -edocs17:57
mspreitzIf I had a working tox -docs on my mac I could17:57
mspreitzs/-docs/-edocs/17:57
mspreitzAny easy way to get all the pre-reqs for tox -edocs on a mac?17:58
mspreitzI tried working through them one by one, until a C compilation problem stopped me17:58
gordcmspreitz: using linux... but i do vaguely remember there being weird side dependencies required to run docs17:58
nealphor using the http://rst.ninjs.org/ tool17:59
nealphif you want to simply see the pretty version.17:59
mspreitzI need cross-references working17:59
gordcwhat do you get you when you run tox -edocs?17:59
mspreitzbetween separate docs17:59
mspreitzgordc: ... recreating...18:00
*** raymondr_ has quit IRC18:00
*** raymondr_ has joined #openstack-ceilometer18:00
*** eglynn has joined #openstack-ceilometer18:01
DinaBelovaeglynn-office, o/18:01
nealpheglynn-office: hangouts link?18:01
eglynnDinaBelova: o/18:01
DinaBelovamay you share link to the hangout, please18:01
eglynnone sec18:01
DinaBelovaa-ha :)18:01
eglynnhttps://plus.google.com/hangouts/_/g76hohzf4ljsjefkn2irzwdwlma18:01
* DinaBelova not alone :)18:01
DinaBelovaeglynn, thank you sir :)18:01
nealphDinaBelova: yep. :)18:01
eglynnnealph, DinaBelova, ildikov_, cdent, fabiog, gordc: link above ...18:01
cdentdanke18:02
mspreitzgordc: clang: error: unknown argument: '-mno-fused-madd' [-Wunused-command-line-argument-hard-error-in-future]18:02
mspreitzand bad consequences18:02
mspreitzthat was while building xattr18:03
*** ildikov has joined #openstack-ceilometer18:03
mspreitzis there doc for how to write cross-references?18:03
mspreitzI want to reference a section named "Plugins" in another oc18:03
mspreitzs/oc/doc/18:03
mspreitzI guess I will follow suit and just reference it without any qualification18:04
mspreitzlike areas.rst does18:04
eglynnnealph, DinaBelova, ildikov_, cdent, fabiog, gordc: slides are at https://docs.google.com/presentation/d/1fUMG5EPMAt2YPuPNslZgnhQQQKO12kwagYcHAJy3T-g/edit?usp=sharing18:04
mspreitzbut: is there a way to make such a reference in-line, rather than as a display?18:05
*** raymondr_ has quit IRC18:05
gordc... another doc outside of ceilometer docs? there's a few examples if you search through rst18:05
gordci've no idea what that error is.lol18:05
fabiogeoghan: I cannot hear anything18:05
*** raymondr_ has joined #openstack-ceilometer18:05
DinaBelovafabiog, hm18:05
mspreitzgordc: examples of inline cross-references?18:05
DinaBelovait was for a while for me as wel18:05
DinaBelovawell18:05
DinaBelovathen it was ok18:06
*** ildikov_ has quit IRC18:06
*** ildikov|2 has joined #openstack-ceilometer18:06
mspreitzgordc: I assume my problem with building xattr is some undeclared prereq of xattr18:06
*** ildikov has quit IRC18:07
gordcoh... that's the error you get with your edits?18:07
mspreitzOK, I am finding inline cross-references18:08
mspreitzgordc: the clang error I quoted is from when `tox -edocs` is installing pre-reqs for building docs18:08
gordcmspreitz: cool cool. yeah. do that. i typically just copy/modify.18:08
gordcmspreitz: oh... yeah i've never seen taht before... no idea what that is.18:08
*** raymondr_ has quit IRC18:10
*** flwang_ has joined #openstack-ceilometer18:10
*** safchain has quit IRC18:11
*** raymondr_ has joined #openstack-ceilometer18:12
openstackgerritMike Spreitzer proposed a change to openstack/ceilometer: Documented Stevedore usage and source details  https://review.openstack.org/11190718:13
*** flwang_ has quit IRC18:15
*** raymondr_ has quit IRC18:16
*** raymondr_ has joined #openstack-ceilometer18:16
*** raymondr_ has quit IRC18:21
*** mspreitz has quit IRC18:22
*** raymondr_ has joined #openstack-ceilometer18:24
*** fnaval has joined #openstack-ceilometer18:25
*** ildikov|2 has quit IRC18:25
*** ildikov has joined #openstack-ceilometer18:25
*** thomasem has quit IRC18:34
*** drjones has quit IRC18:41
*** _cjones_ has joined #openstack-ceilometer18:42
*** sbfox has quit IRC18:42
*** palar_ has joined #openstack-ceilometer18:46
*** mspreitz has joined #openstack-ceilometer18:47
*** palar has quit IRC18:50
*** palar_ has quit IRC18:51
*** _cjones_ has quit IRC18:59
openstackgerritgordon chung proposed a change to openstack/ceilometer: normalise resource data  https://review.openstack.org/11131319:00
*** thomasem has joined #openstack-ceilometer19:00
*** _cjones_ has joined #openstack-ceilometer19:00
*** terriyu has quit IRC19:02
*** atan8 has quit IRC19:04
*** _cjones_ has quit IRC19:05
*** ildikov has quit IRC19:09
*** ildikov has joined #openstack-ceilometer19:10
*** ssakhamuri has quit IRC19:13
*** shakamunyi has quit IRC19:17
*** ildikov_ has joined #openstack-ceilometer19:17
*** ildikov has quit IRC19:18
*** ildikov has joined #openstack-ceilometer19:18
cdentdone with call eglynn or still going?19:19
*** ildikov has quit IRC19:19
eglynncdent: hangout finished about 10 mins ago19:19
cdentcool, thanks19:19
DinaBelovahttps://review.openstack.org/67164 and https://review.openstack.org/70998 :)19:23
DinaBelovaeglynn ^^ :)19:23
cdent"Until there is a ceilometer flush implemented, we should not land any more of these."19:24
cdentwhat does that even mean?19:24
DinaBelovacdent, I guess the question is with periodical (and actually not predictable) ceilometer notification tests failures we met with merged nova notifications19:25
DinaBelovacdent, the reason is still mystique19:25
DinaBelovaas there was no actual reason for them found19:25
*** sbfox has joined #openstack-ceilometer19:25
cdentBut if it is "notifications" then a flush on the ceilometer side seems the wrong side of the bus to be flushing?19:25
DinaBelovacdent, yeah, it might be so19:26
DinaBelovaprobably I need to find more nice words here19:26
cdent:)19:26
DinaBelovafolks, btw - eglynn, ildikov_, cdent - my mongodb trusty experimental job was merged19:27
* cdent loves merges19:27
DinaBelovaso let's try "check experimental" on the changes you'd love to check19:27
DinaBelovacdent, hehe :)19:27
DinaBelovaindeed :)19:27
ildikov_DinaBelova: cool :)19:27
DinaBelovaI've done some fixes, etc. while this noop change testing - https://review.openstack.org/#/c/111691/19:28
eglynnDinaBelova: yay! nice work! :)19:28
DinaBelovaeglynn, ildikov_ - yeah :)19:28
ildikov_DinaBelova: yeap, good job! :)19:28
DinaBelovaso let's try this command in different changes - just to have more statistics here if it's stable19:28
DinaBelovaildikov_, thanks :)19:28
DinaBelovacurrently it looks really ok - at least, for now19:29
DinaBelovaand if it'll be stable - let's say next week - I'll make it not experimental19:29
ildikov_DinaBelova: sounds good, we need some periods when things at least look ok :)19:29
DinaBelovajust not-voting, but ordinary one19:29
DinaBelovaildikov_, yes, exactly19:29
DinaBelovawe have too much gate instability sometimes19:29
DinaBelovadon't want to bring new one :D19:29
ildikov_DinaBelova: anyway, looks like a good plan19:30
ildikov_DinaBelova: yeap, indeed :)19:30
*** Guest27295 is now known as mgagne19:31
*** mgagne has quit IRC19:31
*** mgagne has joined #openstack-ceilometer19:31
eglynnamalagon: o/19:31
eglynnamalagon: belated 1:1 time?19:32
amalagonyeah - 2 mins19:32
cdentDinaBelova: if you figure out some way to explore those non-deterministic issues (Sean's concerns) please let me know, it's something I'd like to help improve19:34
DinaBelovacdent, thank you sir, your help will be really great here. Vadim <vrovachev> spent some time on trying to figure this out... sadly without the success - as locally it was completely ok19:35
DinaBelovaafter several tries19:35
DinaBelovaso that was like dead-end research19:36
DinaBelovawithout any clear result19:36
cdentMy problem at this stage is that I don't know what's required to replicate the situation19:36
cdentI still have quite a lot of ignorance about how I can run those tests myself19:36
cdent(at least in a way that is similar to what the gate does)19:37
DinaBelovacdent, some field to run tempest and try to test it19:37
DinaBelovaactually that is devstack vm19:37
DinaBelovawith tempest then running on it19:37
DinaBelovasometimes that occurs in the gate19:37
DinaBelova*sometimes*19:37
DinaBelovathat's the main word19:37
DinaBelovait seems not to depend on node type, whatever19:38
DinaBelovaI found no connection or smth actually similar between successful runs and not successful ones19:38
DinaBelovaso kind of mystery19:38
cdentthe fault is that sometimes notificaitons fail to show up?19:39
DinaBelovayeah - no notifications came and that's it19:39
DinaBelovaeglynn even made nova notifications passed currently19:39
DinaBelovaas all gate became unstable with these ones running19:40
* DinaBelova needs to go, 11:40pm local time19:40
DinaBelovacdent, let's continue this discussion tomorrow19:40
cdentsure, I should be here all tday19:41
DinaBelovaI'll have pto tomorrow (paid time off) - but I'll be around close to the irc meeting for sure19:41
DinaBelovaprobably some other time too19:41
cdentwell, no rush19:41
DinaBelova:)19:41
DinaBelovathanks for the productive day :)19:41
DinaBelovasee u folks!19:41
DinaBelovacdent, ildikov_, eglynn - goodbye!19:42
cdentsee ya19:42
*** cdent has left #openstack-ceilometer19:42
*** cdent has joined #openstack-ceilometer19:42
ildikov_DinaBelova: good night!19:42
*** raymondr_ has quit IRC19:43
*** fnaval has quit IRC19:43
*** fnaval has joined #openstack-ceilometer19:44
fabiogsee ya19:46
*** fabiog has quit IRC19:46
*** _cjones_ has joined #openstack-ceilometer19:48
*** fnaval has quit IRC19:49
*** _nadya_ has quit IRC20:03
* cdent waves20:05
*** cdent has quit IRC20:05
*** flwang_ has joined #openstack-ceilometer20:11
*** flwang_ has quit IRC20:16
*** raymondr_ has joined #openstack-ceilometer20:22
*** raymondr_ has quit IRC20:22
*** raymondr_ has joined #openstack-ceilometer20:22
*** _cjones_ has quit IRC20:28
*** sbfox has quit IRC20:29
*** _cjones_ has joined #openstack-ceilometer20:29
*** _cjones_ has quit IRC20:34
*** sbfox has joined #openstack-ceilometer20:37
*** eglynn has quit IRC20:53
*** fnaval has joined #openstack-ceilometer20:53
*** prad has quit IRC20:53
*** amalagon has quit IRC20:56
openstackgerritMike Spreitzer proposed a change to openstack/ceilometer: Documented Stevedore usage and source details  https://review.openstack.org/11190721:05
*** _cjones_ has joined #openstack-ceilometer21:07
*** sbfox has quit IRC21:11
*** prad has joined #openstack-ceilometer21:12
*** mspreitz has quit IRC21:14
*** sbfox has joined #openstack-ceilometer21:17
*** BillArnold has quit IRC21:17
*** tong_ has quit IRC21:18
*** tongli has quit IRC21:19
*** jaypipes is now known as thorn-in-side21:38
*** thorn-in-side is now known as jaypipes21:39
*** itisit has quit IRC21:44
nealphjd__: ping...question for you on oslo notifications/amqp setup?21:46
*** itisit has joined #openstack-ceilometer21:55
openstackgerritgordon chung proposed a change to openstack/ceilometer: normalise resource data  https://review.openstack.org/11131322:11
*** flwang_ has joined #openstack-ceilometer22:12
*** dmsimard is now known as dmsimard_away22:16
*** flwang_ has quit IRC22:16
*** _cjones_ has quit IRC22:20
*** _cjones_ has joined #openstack-ceilometer22:21
*** thomasem has quit IRC22:25
*** _cjones_ has quit IRC22:25
*** gordc has quit IRC22:27
*** _cjones_ has joined #openstack-ceilometer22:35
*** prad has quit IRC22:36
*** sbfox1 has joined #openstack-ceilometer22:48
*** itisit has quit IRC22:48
*** sbfox has quit IRC22:49
*** raymondr_ has quit IRC22:51
*** mrmoje has joined #openstack-ceilometer22:55
*** _nadya_ has joined #openstack-ceilometer23:04
*** _nadya_ has quit IRC23:09
*** alexpilotti has quit IRC23:22
*** ddutta has joined #openstack-ceilometer23:29
*** raymondr has joined #openstack-ceilometer23:44
*** raymondr has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!