Monday, 2021-02-22

*** vishalmanchanda has joined #cloudkitty04:24
zigoHi. I'm getthing this in the cloudkitty-processor.log:12:06
zigohttp://paste.openstack.org/show/802883/12:06
zigoThen it stops processing completely...12:06
zigoAny idea how can this be fixed?12:06
priteauHi zigo. There was a bug reported a few days ago: https://storyboard.openstack.org/#!/story/200859812:10
priteauI'll bring it up at today's IRC meeting12:11
zigopriteau: This looks similar to what I'm experiencing with the CPU.12:11
priteauI've added it to today's meeting topics: https://etherpad.opendev.org/p/cloudkitty-meeting-topics12:13
priteauIt's at 1400 UTC here, if you want to attend.12:13
*** mkarpiarz has joined #cloudkitty12:17
zigopriteau: In this channel ?12:19
zigoI'll be there, ping me then ...12:20
*** rafaelweingartne has joined #cloudkitty13:49
rafaelweingartneHello guys13:59
rafaelweingartne#startmeeting cloudkitty14:00
openstackMeeting started Mon Feb 22 14:00:04 2021 UTC and is due to finish in 60 minutes.  The chair is rafaelweingartne. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: cloudkitty)"14:00
openstackThe meeting name has been set to 'cloudkitty'14:00
rafaelweingartneRoll count14:00
priteauo/14:00
mkarpiarzHi!14:01
rafaelweingartne#topic New core reviewers14:03
*** openstack changes topic to "New core reviewers (Meeting topic: cloudkitty)"14:03
rafaelweingartneI proposed Marius as a new core reviewers. I guess that we will approve this proposal. I am not sure now about the next steps.14:03
rafaelweingartneMaybe priteau could guide me through the process?14:03
priteauOn Gerrit, go to:14:04
priteauBrowse > Groups14:04
priteauSearch for cloudkitty-core14:04
priteauClick on it14:04
priteauClick members on the left14:05
priteauThere is an option to add a new member14:05
mkarpiarzThank you guys, I'm honoured! :)14:05
rafaelweingartnehmm14:06
rafaelweingartneI do not see this option14:06
rafaelweingartneI see all of the different CloudKitty groups, but this one14:06
rafaelweingartneI am logged in*14:06
rafaelweingartneah, I found it14:06
rafaelweingartnenever mind14:06
rafaelweingartneSo, I just add there?14:07
rafaelweingartnemkarpiarz, can you confirm if this is your user?14:07
rafaelweingartneMariusz Karpiarz <mariusz.karpiarz@vscaler.com>14:07
mkarpiarzYes, that's me.14:07
rafaelweingartneOk, added14:15
rafaelweingartnepriteau: do I need to do anything else?14:16
rafaelweingartneWelcome to the core team mkarpiarz14:16
mkarpiarz:)14:17
rafaelweingartnemkarpiarz, Can you test it?14:17
priteauHooray!14:17
rafaelweingartneto see if you have the permissions now14:17
mkarpiarzAre there any extra responsibilities that come with being part of the core?14:17
mkarpiarz(aside for what I've been asked to do so far, so reviewing changes, submitting patches, etc)14:18
rafaelweingartneI guess nothing much besides helping on reviews, and merging things sometimes14:18
priteaumkarpiarz: You can now merge patches by voting with W+1. So don't merge stupid or buggy patches ;-)14:18
mkarpiarzChecking now.14:18
mkarpiarzYes, I can see +-2s in code review and +-1 for workflow.14:19
rafaelweingartneAwesome14:19
rafaelweingartneMoving on...14:20
rafaelweingartne#topic Review priorities14:20
*** openstack changes topic to "Review priorities (Meeting topic: cloudkitty)"14:20
rafaelweingartneDo you guys have some review priorities to ask for?14:20
rafaelweingartneI see that one of my specs was merged last week. Therefore, I will be working on the patch to submit this week14:20
mkarpiarzI didn't have much time for Cloudkitty last week but this week should be better.14:21
mkarpiarzI'll be testing https://review.opendev.org/c/openstack/cloudkitty/+/774520, unless there are other priorities.14:21
rafaelweingartneah, that is a cool one to test14:22
rafaelweingartnewe have in production already here14:22
priteauThere are two low-impact patches we can merge to clear the queue14:22
priteauhttps://review.opendev.org/c/openstack/cloudkitty/+/77023614:22
priteauhttps://review.opendev.org/c/openstack/cloudkitty/+/76850614:22
rafaelweingartneagreed14:23
rafaelweingartnemkarpiarz: would you do the honors?14:23
mkarpiarzBoth look good to me.14:24
rafaelweingartneThey can be your first merge :)14:25
priteaumkarpiarz: We didn't say explicitly earlier, it is customary to require two +2 votes before merging14:25
priteauThese two patches have my +2 so you're good to go.14:25
priteaumkarpiarz: You can give the +2 and W+1 in a single vote14:29
mkarpiarzOk, so what are we missing on https://review.opendev.org/c/openstack/cloudkitty/+/770236?14:29
mkarpiarz(to be able to merge)14:29
priteauNothing missing.14:30
priteauIt's in the Zuul gate now14:30
priteauZuul need to run gate jobs, it will take ~40 minutes14:31
mkarpiarzCool. How can you check what's in the gate?14:31
priteauhttps://zuul.openstack.org/status#cloudkitty14:31
rafaelweingartneAwesom!14:31
priteauShould we move to the next topic?14:32
mkarpiarzThanks, https://review.opendev.org/c/openstack/cloudkitty/+/768506 should be good to go soon as well.14:33
rafaelweingartneMoving on...14:33
rafaelweingartne#topic Help request14:33
*** openstack changes topic to "Help request (Meeting topic: cloudkitty)"14:33
rafaelweingartneThere was a help request, but I am not sure if the reported is here in the channel14:33
priteauping zigo14:34
rafaelweingartneI guess that should be something to be discussed in the mailing list right?14:34
priteau(not the first reporter, but someone else who saw the bug)14:34
priteauI don't think it has to be on the mailing list. We have a bug tracker for this.14:34
rafaelweingartneI put there some of the details we would need to help them, but I am not sure if they will provide a follow-up14:34
zigoYeah, got the bug with Victoria.14:34
priteauMailing list is good for more open-ended questions, when you don't really know who to ask, cross-project issues, etc.14:35
zigopaste.openstack.org/show/802883/14:35
rafaelweingartnepriteau, I mentioned the mailing list because it seems easier, at least to me, to request data, inspect code and so on before replying14:35
priteauWell, you can do the same thing with Storyboard14:36
zigoI'm available if you need me to investigate some data...14:36
priteauFor context, we are discussing https://storyboard.openstack.org/#!/story/200859814:36
rafaelweingartnezigo: we would need more inputs, such as the gnocchi resource show for the problematic metric14:36
zigoHard to tell which is the problematic one...14:37
priteauI wonder why we haven't seen this in CI.14:37
priteauCould it be a regression from new gnocchi or gnocchiclient releases?14:37
rafaelweingartneI am suspecting that the aggregation method `mean` is not configured to the CPU metric for instance14:37
rafaelweingartneor maybe, the aggregation is using a different time frame14:37
zigorafaelweingartne: How would I do that?14:38
rafaelweingartnegnocchi resource show <resource_id>14:38
rafaelweingartneget the metric ID there14:38
rafaelweingartnethen, gnocchi metric show14:38
zigorafaelweingartne: We wont solve it during this meeting, but ok, we can investigate together if you have time for it.14:39
rafaelweingartnewe can interact in the Story board then14:39
zigoOne solution could indeed be cloudkitty nicely and gracefully printing the advise you're giving.14:39
rafaelweingartneyou could post the data there, and we move on from that point14:39
zigoI'm not sure how to get the <resource_id> you're mentionning above ...14:40
rafaelweingartneI see, it will be easier for us to interact there in the story board them14:40
rafaelweingartnecan you post your doubts there, and we move on via Story board then14:40
zigoWell, ok, though it'd be faster if we interact on IRC, IMO.14:41
zigoThen we can post on Storyboad when I know what to post.14:41
rafaelweingartneI do not use IRC besides attending meeting14:41
zigo:/14:41
zigoWont be easy then.14:41
rafaelweingartneTherefore, to me, it would be more problematic. I would prefer an Async method of interaction14:41
zigorafaelweingartne: Can we just take 10 minutes on IRC just after this meeting ?14:42
zigoAfter that, I'm ok to use Storyboard.14:43
rafaelweingartnezigo it will be lunch time here. I am already late for it :)14:44
zigo:)14:44
zigoNv mind then...14:44
rafaelweingartneMoving on...14:45
rafaelweingartne#topic AOB14:45
*** openstack changes topic to "AOB (Meeting topic: cloudkitty)"14:45
rafaelweingartneNow, I open for general questions and topics that people might have.14:45
mkarpiarzNothing on my side.14:45
mkarpiarzI'll see if I can reproduce zigo's problem in my test environment.14:47
priteauI've tried to reproduce the metadata issues I saw with Monasca, but it works in DevStack14:48
priteauMaybe it was just a wrong configuration14:48
rafaelweingartnemkarpiarz: I am suspecting a mismatch between the aggregation method or time frame used in CloudKitty and the one actually used in Gnocchi14:48
mkarpiarzzigo: Could you paste your metrics.yaml file under the Story?14:48
rafaelweingartneAnyways. Thank you guys for participating. Have a nice week.14:49
rafaelweingartne#endmeeting14:49
*** openstack changes topic to "Rating component for OpenStack https://wiki.openstack.org/wiki/CloudKitty"14:49
openstackMeeting ended Mon Feb 22 14:49:28 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:49
openstackMinutes:        http://eavesdrop.openstack.org/meetings/cloudkitty/2021/cloudkitty.2021-02-22-14.00.html14:49
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/cloudkitty/2021/cloudkitty.2021-02-22-14.00.txt14:49
openstackLog:            http://eavesdrop.openstack.org/meetings/cloudkitty/2021/cloudkitty.2021-02-22-14.00.log.html14:49
*** rafaelweingartne has quit IRC14:49
zigomkarpiarz: As I wrote, I can't find the matching <resource-id> ...14:49
zigomkarpiarz: Can you help me finding it out ?14:52
mkarpiarzI don't know where this file is in Devstack but you should see a file which looks like this one:14:52
mkarpiarzhttps://github.com/mkarpiarz/cloudkitty-playground/blob/gnocchi-collector/kolla/config/cloudkitty/metrics.yml14:52
priteauzigo: if you install at the usual locations, it should be in /etc/cloudkitty14:53
zigoI do have a /etc/cloudkitty/metrics.yml14:53
zigoThen what ?14:53
zigoFYI, that's the "normal" OpenStack Victoria installation that I have (the same thing which I all uploaded to Debian Sid and that we will release with the already frozen Debian 11 aka Bullseye).14:55
mkarpiarzThe one you see in that github repo works for me so if you share yours metrics.yaml file, I can try it in my test environment.14:55
zigohttp://paste.openstack.org/show/802886/14:57
zigoThat's what I have.14:57
mkarpiarzBetter to post the content of this file as a comment in Storyboard.14:59
mkarpiarz(IRC's not idea for messages with multiple lines)15:00
zigoWell, the Debian package which I maintain just takes it from etc/cloudkitty/metrics.yml from the original Cloudkitty sources.15:01
mkarpiarzAh, OK, this simplifies things. I'll grab it from there then.15:01
zigoWhat the Debian package does is (from debian/rules):15:02
zigo        for i in api_paste.ini metrics.yml ; do \15:02
zigo                install -D -m 0664 etc/cloudkitty/$$i $(CURDIR)/debian/cloudkitty-common/usr/share/cloudkitty-common/$$i ; \15:02
zigo        done15:02
zigothen in the postinst, it takes files in /usr/share/cloudkitty-common and installs them in /etc/cloudkitty if none already exist there.15:02
zigoThen chown them to root:cloudkitty with mode 640...15:03
zigoJust as most OpenStack config files.15:03
zigoI do that to make sure all is owned in a safe way that even the service itself can't write to.15:03
zigoThat's common security practice, I believe...15:03
mkarpiarzYeah, this should work.15:04
mkarpiarzAs for getting that resource_id, I'd say start with `openstack metric list`.15:05
mkarpiarzThis will show you all metrics stored in Gnocchi.15:06
MrClayPoleHi, just getting started with CloudKitty. I've got it charging for volume sizes and all instances per project but its just showing total billing of each in horizon. We would like to break it out so we can see how much each instance is costing the customer for detailed billing reporting. Can this be done it CloudKitty?15:08
zigomkarpiarz: It takes forever, and I have at least hundreds of them. How do I filter ?15:10
zigomkarpiarz: I'm only interested to find out the metric that makes the processor fails ...15:10
zigoThis isn't devstack ... :)15:10
priteauMrClayPole: You can extract "dataframes"  via the CLI which will show per-resource and per-time period charging15:12
MrClayPoleThanks I'll take a look15:15
openstackgerritMerged openstack/cloudkitty master: remove unicode from code  https://review.opendev.org/c/openstack/cloudkitty/+/77023615:54
openstackgerritMerged openstack/cloudkitty master: Remove six  https://review.opendev.org/c/openstack/cloudkitty/+/76850615:54
zigomkarpiarz: priteau: What can I do then to find out what metric is wrong?16:12
*** vishalmanchanda has quit IRC16:34
*** sboyron has joined #cloudkitty18:33
*** sboyron has quit IRC18:37

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!