Tuesday, 2018-02-13

*** openstackgerrit has quit IRC01:03
*** bhujay has joined #cloudkitty04:10
*** bhujay has quit IRC05:29
*** bhujay has joined #cloudkitty05:29
*** bhujay has quit IRC06:55
*** openstackgerrit has joined #cloudkitty08:31
openstackgerritNguyen Hung Phuong proposed openstack/cloudkitty master: Replaces yaml.load() with yaml.safe_load()  https://review.openstack.org/54385008:31
zigopeschk_l: I still wonder why the tenant fetcher only gets my admin login, not *ALL* tenants...09:03
peschk_lzigo, you need to give cloudkitty the 'rating' role on tenants you want to rate09:04
zigopeschk_l: I did so. Let me check my PoC again.09:05
zigoHum...09:06
zigoNow it looks like working ... :/09:06
peschk_lOK, good news then :)09:06
zigoThough summary-get only shows one single tenant, maybe in a few minutes it will work?09:06
zigo(ie: I restarted cloudkitty switching from fake tenant fetcher to keystone)09:07
peschk_lwhat storage backend are you using09:07
peschk_l?09:07
zigopeschk_l: For gnocchi, file backend.09:07
zigopeschk_l: How do I check the one of cloudkitty?09:07
zigoI believe I'm using db.09:07
peschk_lit's in cloudkitty.conf, in the [storage] section09:08
zigopeschk_l: It's only a PoC, I'll soon write the puppet stuff for deploying it all, then it will use Ceph and all.09:08
peschk_ldefault is sqlalchemy09:08
zigoI'm still using sqlalchemy.09:08
zigoYep.09:08
zigopeschk_l: What's recommended?09:08
zigopeschk_l: Gnocchi ?09:08
peschk_lsqlalchemy is fine09:09
zigopeschk_l: It produces A LOT of records, really a lot.09:09
zigopeschk_l: I don't think it's going to scale well enough when there will be 1000+ VMs running.09:09
peschk_lzigo we know, that's why we introduced the hybrid storage in this release09:09
zigopeschk_l: How does that work?09:09
peschk_lthe hybrid storage stores the state of each tenant in an SQL database, but that's on ly one entry per tenant. All the storage informations are stored in a timeseries database09:10
zigopeschk_l: I also wonder, cloudkitty only does back-charge, meaning I'd have to write a daemon to check if the customer isn't above his account, in which case I'd shutdown his VMs. Is that kind of feature planned in Cloudkitty?09:10
peschk_lFor now, gnocchi is the only supported backend for the hybrid storage but we should support more in the future09:11
zigopeschk_l: Very good, that's exactly what's needed. Will it be there for Queens?09:11
peschk_lzigo: yes, it's in upstream, but not considered stable yet09:11
zigoI'm currently doing the Queens packaging for Debian, and probably, that's what is going to end up in production over here.09:11
peschk_lshould be stable in Rocky though09:12
zigoI don't mind running bleeding edge master if that still continues to work with Queens.09:12
zigo:)09:12
peschk_lwell the hybrid storage might become the v2 storage, so that would imply to modify the conf a little09:13
peschk_lbut it should work with Queens components :)09:13
zigoOk.09:14
zigopeschk_l: Will there be a way to move the storage from the old backend to the new?09:14
peschk_lzigo: and no, it is not planned to check if customers are above their account09:14
zigoMaybe, just scrap the data, and let the processor run again ?09:14
zigopeschk_l: Hum ... is that something that can be done with aodh, maybe?09:15
zigoThe goal is to run the customers of our cloud using pre-paid accounts only.09:15
zigoAll together, I was surprised how nice cloudkitty is, though really, it lacks a lot of docs, it was hard for me to understand what was going on.09:17
zigoIt'd be super cool to have a shell script to set all the components billing at once, for example, so there would be no mistake possible.09:17
zigoMaybe I can contribute that?09:18
peschk_lWell I don't know much about aodh but if there's a way to query the cloudkitty API you should be able to do this09:18
peschk_lwhat do you mean, a script that would create the required services etc ?09:18
peschk_l(I mean services in cloudkitty's hashmap module)09:18
zigoYup.09:19
zigoAll of that.09:20
zigoWith just a bit of config on top of the script.09:20
zigoThen later, it'd be easy for anyone to only change pricing ...09:20
zigoAnd that'd be just something to push with the docs / examples / contrib ...09:20
zigo(pick your choice)09:21
peschk_lAnd the docs are a keypoint for the next release (developper documentation most of all, we need more contributors)09:21
peschk_lzigo: make a story here https://storyboard.openstack.org/#!/project/89009:21
peschk_land we'll look at it :)09:21
zigo:)09:21
zigoThanks.09:21
openstackgerritNguyen Hung Phuong proposed openstack/cloudkitty master: Replaces yaml.load() with yaml.safe_load()  https://review.openstack.org/54385009:23
openstackgerritLuka Peschke proposed openstack/cloudkitty master: Add i18n support for error message  https://review.openstack.org/43733110:14
openstackgerritMartin CAMEY proposed openstack/cloudkitty master: Simplify metrics.yml fields and usage  https://review.openstack.org/54356410:34
openstackgerritMartin CAMEY proposed openstack/cloudkitty master: WIP: Allow Cloudkitty to collect non-OpenStack metrics  https://review.openstack.org/53825610:41
*** bhujay has joined #cloudkitty12:19
bhujayfinally got it running13:46
bhujaycloudkitty summary-get13:46
bhujay+-----------+---------------+---------+---------------------+---------------------+13:46
bhujay| Tenant ID | Resource Type | Rate    | Begin Time          | End Time            |13:46
bhujay+-----------+---------------+---------+---------------------+---------------------+13:46
bhujay| ALL       | ALL           | 20950.0 | 2018-02-01T00:00:00 | 2018-03-01T00:00:00 |13:46
bhujay+-----------+---------------+---------+---------------------+---------------------+13:46
bhujaythis is for a  hashmap-compute-service with flavor_id as filed mapping but  How to see the hourly statistics from gnocchi , will it not be stored there with total.cost or compute.cost ? these metrics are not there ? Would be grateful if someone gives few minutes to explain13:49
peschk_lbhujay: what do you want to do exactly ?14:25
peschk_lget a report per hour ?14:25
bhujaypeschk_l: that right14:26
bhujaypeschk_l: report per hour14:26
peschk_lyou can specify the starting end ending time for cloudkitty summary-get and cloudkitty total-get14:27
peschk_l*starting and ending14:27
bhujaypeschk_l:got it , thanks will try it . But it must be storing the data in gnocchi , i am wondering why cant i see it using openstack metric measure show command14:28
*** prodriguez83 has quit IRC14:29
*** openstackgerrit has quit IRC14:33
bhujaybhujay@ansiblenew:~$ cloudkitty summary-get -s volume -b 2018-02-13T16:00:00+05:30 -e 2018-02-13T18:00:00+05:3014:49
bhujayinvalid literal for float(): 2018-02-13T16:00:00+05:3014:49
bhujaypeschk_l: sorry to bother you again , isn't the time format right ?14:50
peschk_lbhujay: the time has to be a unix timestamp for summary-get. If you want to use this timeformat, you can use total-get14:53
bhujaypeschk_l: ok , many thanks14:53
peschk_lbhujay: let me know if this works for you :)14:54
bhujaypeschk_l: yes , thanks peschk_1 , total-get works ,  let me explore more ..15:01
*** bhujay has quit IRC15:13
*** openstackgerrit has joined #cloudkitty17:31
openstackgerritMartin CAMEY proposed openstack/cloudkitty master: WIP: Allow Cloudkitty to collect non-OpenStack metrics  https://review.openstack.org/53825617:31
openstackgerritMartin CAMEY proposed openstack/cloudkitty master: WIP: Allow Cloudkitty to collect non-OpenStack metrics  https://review.openstack.org/53825617:44

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!