Friday, 2019-09-13

openstackgerritLuka Peschke proposed openstack/cloudkitty master: Add a v2 API endpoint to retrieve DataFrame objects  https://review.opendev.org/67963607:27
openstackgerritMerged openstack/cloudkitty-specs master: Spec: Add an ElasticSearch v2 storage driver  https://review.opendev.org/67346107:32
*** priteau has joined #cloudkitty07:57
openstackgerritLuka Peschke proposed openstack/cloudkitty master: Add a v2 API endpoint to retrieve DataFrame objects  https://review.opendev.org/67963608:04
openstackgerritMerged openstack/cloudkitty-dashboard master: Add exception to error messages  https://review.opendev.org/68058408:31
openstackgerritMerged openstack/cloudkitty master: Add a v2 API endpoint to retrieve DataFrame objects  https://review.opendev.org/67963612:54
openstackgerritLuka Peschke proposed openstack/cloudkitty master: Add an ElasticSearch v2 storage driver  https://review.opendev.org/67907213:30
*** Arfeen has joined #cloudkitty14:59
peschk_lo/15:00
*** jferrieu has joined #cloudkitty15:01
peschk_ljferrieu around ?15:01
peschk_lah yes15:01
jferrieuYeah, hi15:01
peschk_lDo we have external people interested in todays meeting ?15:02
peschk_lall right, let's start15:02
peschk_l#startmeeting cloudkitty15:02
openstackMeeting started Fri Sep 13 15:02:55 2019 UTC and is due to finish in 60 minutes.  The chair is peschk_l. Information about MeetBot at http://wiki.debian.org/MeetBot.15:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:02
*** openstack changes topic to " (Meeting topic: cloudkitty)"15:02
openstackThe meeting name has been set to 'cloudkitty'15:02
peschk_lHi everybody, welcome to the september cloudkitty meeting15:03
peschk_lToday's agenda can be found here: https://etherpad.openstack.org/p/cloudkitty-meeting-topics15:03
peschk_las usual, feel free to add any topic you'd like to discuss15:04
peschk_land there will be a Q&A session at the end15:04
peschk_l#topic feature freeze15:04
*** openstack changes topic to "feature freeze (Meeting topic: cloudkitty)"15:04
peschk_las you know, the feature freeze for the Trains cycle happened yesterday15:05
peschk_lI'm quite happy with what we achieved this release, as we have  achieved more than what was planned15:05
peschk_land the last feature patch will be merged today, meaning we're only one day late, which is a pretty good score for openstack projects :)15:06
peschk_lanyway the complete list of release notes can be found here: https://docs.openstack.org/releasenotes/cloudkitty/unreleased.html15:06
peschk_land you'll have to add an experimental v2 storage driver for elasticsearch to that list15:07
peschk_l(the patch is currently being gate tested/ merged by zuul)15:07
peschk_lA lot of new features and hardening happened during this cycle, and jferrieu and I will spend the feature freeze expanding the tempest plugin15:08
peschk_l(If we find no bug, of course :) )15:09
peschk_lconcerning the community goals: we've been one of the first projects to implement full python3 support, and I'd like to drop python2 support ASAP15:10
peschk_lit'll probably be one of the first things in the U cycle15:10
jferrieuthat would be a good thing indeed15:10
peschk_lwell as soon as the TC gives a green light of course15:11
peschk_lIonce support for py2 has been dropped, I'd like to progressively introduce typ[e annotations15:11
peschk_lwith eventual mypy checking15:11
peschk_lthey've already been some proposal for that in openstack, but the answer was "meh, let's wait for py3, we don't want two types of annotations"15:12
peschk_lanyway, adding some typing would really help with hardening IMO15:13
jferrieuI agree15:13
peschk_lconcerning the second community goal, which is PDF generation, we haven't been able to implement it yet15:13
peschk_lthe biggest problem I encoutered being that tables and API reference generation is not supported by latex15:14
peschk_lso only a small part of the doc can be generated15:14
peschk_lI'm waiting for help of the docs team on this15:14
peschk_lsomebody proposed a patch on the dashboard. We'll have to review it, but frome what I've seen, only a "project"official" badge is visible in the final pdf15:15
peschk_l#link https://review.opendev.org/#/c/681703/15:15
peschk_lany questions about the feature freeze / community goals ?15:16
jferrieuI'm good15:16
peschk_lall right, next topic then15:16
peschk_l#topic meeting schedule15:17
*** openstack changes topic to "meeting schedule (Meeting topic: cloudkitty)"15:17
peschk_lwe've gained some part-time contributors on the project. They'll be working from monday to wednesday15:17
peschk_lAlso, huats lives in montreal now, so I'd like to propose a new meeting time that's at the beginning of the week, and that is compatible with the montreal and Paris timezones15:18
peschk_lI'd also like to make the meeting happen twice a month, and publish a recap on the openstack-discuss mailing list15:19
peschk_lwould the 1st and 3rd monday of each month be okay for you ?15:20
peschk_lat 14h UTC15:20
jferrieuI am ok with this, the recap will be a nice plus also imo15:20
peschk_lgreat15:20
peschk_lOf course, if we gain contributors from other timezones, we'd be pleased to have at least one of both meetings on a timeslots that suits them15:21
peschk_lokay then, I'll propose a patch in order to change the meeting schedule15:22
peschk_land I guess that was it concerning the meeting schedule15:22
peschk_l#topic storyboard15:23
*** openstack changes topic to "storyboard (Meeting topic: cloudkitty)"15:23
peschk_lnew release cycle, new resolutions15:23
peschk_lduring the last release cycle, we've been writing specs for each new feature, and we keep doing it, which is a nice thing. I'd like to push storyboard usage now15:24
peschk_lIt will need some celaning (Ill take care of it), but once it is done, I'd like to have every bug to be registered there15:25
peschk_land not just the major, like we did until now15:25
peschk_lone of the first we'll need to adress is that hashmap rules are reloaded way too often, which can lead to a real SQL database hammering when a short collect period is used15:26
peschk_lwe'll probably introduce some kind of TTL cache in the Hashmap module for this15:27
peschk_lWe'll also use storyboard to follow the v1 API porting status15:28
openstackgerritMerged openstack/cloudkitty master: Add an ElasticSearch v2 storage driver  https://review.opendev.org/67907215:28
peschk_l(ah, this was our last feature patch :) )15:28
jferrieucongrats15:29
priteauIdeally the API would notify the processors to force refresh of their hashmap cache when rules are updated, otherwise this could lead to puzzling behaviour15:29
priteauOh and hello :)15:29
peschk_lpriteau: hi :) agreed15:30
peschk_lThe TTL cache would rather be a quick fix15:30
peschk_lbut we'll eventually have the same problem with the new rating module so yeah, the long-term fix would be a notification sent out to the processors15:31
peschk_lI think that's it concerning storyboard15:33
peschk_l#topic open discussion15:33
*** openstack changes topic to "open discussion (Meeting topic: cloudkitty)"15:33
peschk_lpriteau: you were intersted in the elasticsearch storage driver, right ?15:34
priteauYes, particularly if it could help to charge based on events rather than metrics.15:35
peschk_lpriteau: well it doesn't change the way we charge, but It provides some features wich INfluxDB does not15:36
peschk_lHA, etc15:36
*** Arfeen has quit IRC15:37
peschk_lpriteau: But you're using the monasca collector right ? If monasca provides proper support for events, it would be a nice addition to the monasca collector15:37
priteauMonasca event support is just a spec for now. Once there is code it might be a solution.15:38
peschk_lI see15:39
peschk_lwhat kind of events do you have in mind ? recource creation / deletion ?15:40
peschk_l*resource15:40
priteauYes, there are notifications for creation/update/deletions of many types of resources in OpenStack already which could be used for rating.15:41
priteauI suppose the difficulty is keeping track of what resources are allocated if there is no periodic notification.15:42
peschk_lYup. Given ck's design it would require to "make them look like a metric"15:44
peschk_lMeaning having some kind of pollster somewhere checking if the resources still exist15:45
peschk_lWhich is more or less what ceilometer does15:45
peschk_lpriteau: i don't remember, did you use monasca alone for rating or did you also use ceilosca?15:46
priteauBoth actually. In the blog post already published I used Ceilosca, but I also configured rating using an openstack prometheus exporter sending data to Monasca (still need to write the blog post for this one)15:48
peschk_lOkay15:49
priteauI may be able to work on this again soon, I will be able to find out what works bes.15:51
priteaubest15:52
peschk_lpriteau: We'de definitely be interested in feedback15:53
peschk_la temporary solution for event-based rating might also be to push already rated dataframes into15:54
peschk_linto cloudkitty15:54
peschk_ljferrieu recently added a v2 API endpoint for that15:54
priteauI'll look into it, thanks15:55
peschk_lAre there other topics to be discussed ?15:58
jferrieuI'm ok :)15:59
peschk_lpriteau, do you have more questions ?16:01
priteauNot for now, probably in a few weeks when I have the chance to work with CloudKitty again ;-)16:01
peschk_lpriteau: all right, we're available on IRC, and not just on meeting times :)16:02
priteauThank you16:02
peschk_lthanks guys!16:02
peschk_l#endmeeting16:03
*** openstack changes topic to "Rating component for OpenStack https://wiki.openstack.org/wiki/CloudKitty"16:03
openstackMeeting ended Fri Sep 13 16:03:13 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:03
openstackMinutes:        http://eavesdrop.openstack.org/meetings/cloudkitty/2019/cloudkitty.2019-09-13-15.02.html16:03
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/cloudkitty/2019/cloudkitty.2019-09-13-15.02.txt16:03
openstackLog:            http://eavesdrop.openstack.org/meetings/cloudkitty/2019/cloudkitty.2019-09-13-15.02.log.html16:03
*** priteau has quit IRC17:28
*** openstackgerrit has quit IRC20:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!