15:00:46 #startmeeting monasca 15:00:47 Meeting started Wed Sep 26 15:00:46 2018 UTC and is due to finish in 60 minutes. The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:48 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:00:50 The meeting name has been set to 'monasca' 15:01:00 Hello everyone 15:01:24 hello 15:01:39 hi koji_n, hi pandy 15:01:52 Hi witek:) 15:01:55 hi 15:02:01 hi 15:02:21 the agenda is pretty full again today 15:02:25 that's nice :) 15:02:30 o/ 15:02:37 let's start with leftovers 15:02:42 https://etherpad.openstack.org/p/monasca-team-meeting-agenda 15:02:53 #topic pre-upgrade checks 15:03:08 we have started this actually last week 15:03:43 there is a new component in oslo for this 15:03:44 https://github.com/openstack/oslo.upgradecheck 15:03:53 should we use this one? 15:04:52 I didn't grab the oslo.upgradecheck code because it was still being worked on last week. It would be nice to use something consistent, but the code is still developing 15:05:17 so I thought it would be good to have a very simple start then refactor it later to use the library when it is available 15:05:44 The library certainly seems very green 15:06:00 Also, the code I wrote will likely need to be moved to a good place for deployment 15:06:29 Matt has left you some comments in review 15:07:07 yes, I've been working some bugs and haven't incorporated his comments yet, but they were good feedback 15:07:33 s/bugs/unrelated bugs/ 15:07:37 :) 15:07:59 so, you want to continue to work on this, or prefer to come back to this later? 15:08:23 I don't think it is top priority, but can tinker with it when i have time 15:08:50 If someone else is interested they are welcome to take it up 15:09:15 ok, thanks 15:09:47 #topic monasca-notification clean-up 15:10:46 the first change should probably be the schema update 15:10:57 So we hit some issues configuring plugins via Oslo 15:11:05 Yeah - agreed 15:11:15 It would be nice to push those old patches through 15:11:28 yes, we need them 15:11:55 I've seen you've added this to our board 15:11:57 https://storyboard.openstack.org/#!/board/111 15:12:01 I 've got enough feedback from Johannes to fix up the alembic migration 15:12:09 great 15:12:17 Thanks to Johannes + Amir for the review 15:13:06 So that's probably it on this for now - I will focus on the old patches in the little time I have at the moment and circle back around to Charana's ones when those are done. 15:13:42 is there a particular sequence in which the changes should be merged? 15:13:46 Also, thanks Witek for taking a look! 15:13:59 I will add a 'depends on' to the commit message 15:14:11 thanks 15:15:11 btw. during ptg we've agreed to create a second board for tracking bug fixing 15:15:20 ah, ok 15:15:27 I think the last two changes from your set would be good candidates 15:15:36 I haven't created the board yet though 15:15:47 Sounds good, I can look at moving it when we have the board 15:15:49 will do tomorrow 15:16:01 thanks 15:16:27 thanks Doug for working on this 15:16:34 #topic new Grafana image 15:16:40 np 15:17:10 pandy? 15:17:20 Hi Witek, I have requested two features to be in grafana like getting "OK" & "UNDETERMINED" state in notification and fix "save" in one click 15:17:38 it was fixed by Charana & Dougz verified and pushed to master https://github.com/monasca/monasca-grafana/commit/85b7eb46c1cbb561e6c7737b3ee75271fa83af7b 15:17:49 we have pushed the new image today 15:17:52 https://hub.docker.com/r/monasca/grafana/ 15:18:04 Nice - I thought I saw that fly past my inbox 15:18:11 It will be great if we udpate this grafana enhancement to new image, currently, i did rebuild in my own dockerhub repo 15:18:32 pandy: happened today 15:18:41 oh great :) 15:18:55 https://hub.docker.com/r/monasca/grafana/tags/ 15:19:02 4.0.0-1.5.1 15:19:45 Sure i will check it :) Thats it related to monasca- grafana, let me know can i start my next topic in agend which is lsited at bottom now or will wait ? :) 15:20:13 let's go in the sequence please 15:20:28 #topic Stein prios 15:20:47 I have put together the results of our priorisation game 15:21:28 as we discussed earlier, I didn't want to put too many tasks 15:21:36 I started writing the Merge APIs spec earlier will have it finished today, then I can add a link to the doc. 15:22:04 great, I just wanted to ask you folks to add the descriptions :) 15:22:18 :) 15:23:03 Will do. 15:23:09 also, if you think there is anything important we should add there during the cycle 15:23:17 we're free to do so 15:23:51 #topic Kafka config opts in monasca-api 15:24:28 It looks like some refactoring left these behind 15:24:41 Just wanted to check I hadn't missed something before removing them? 15:24:56 also, that will probably change anyway during the work with confluent-kafka client 15:25:21 Yeah - envisaged some overlap 15:25:53 I want to finish my Kafka spec this week 15:26:05 https://review.openstack.org/601268 15:26:20 so I will go through these options as well 15:26:34 and will leave you a comment in story 15:26:42 Awesome, thanks witek. 15:27:08 I guess we could backport any small patch to remove them to avoid confusing people with the generated config file from tox 15:28:18 so you mean, remove all of them now to be in sync with auto-generated, and then backport if needed? 15:28:39 Yeah 15:29:10 yes, it will work as well 15:30:09 #topic libvirt upgrade 15:30:52 joadavis: have you added this one? 15:31:31 yes. 15:31:50 I heard there was a plan for nova to update the libvirt and qemu version for the T release 15:32:05 I just wanted to raise it as a sanity check here - I don't think it will be a problem 15:32:36 do you have any reference to additional information about this upgrade? 15:33:50 the problem with libvirt plugin is, that we don't have any automated testing included 15:33:56 there was an email to the openstack-dev mailing list... 15:34:31 Proposal -------- Looking at the DistroSupportMatrix[2], it seems like we can pick the libvirt and QEMU versions supported by the next LTS release of Ubuntu -- 18.04; "Bionic", which are: libvirt: 4.0.0 QEMU: 2.11 15:35:36 should we add a task to the backlog for this? 15:36:08 I think the Operating Systems will support it. It may be good for us to have a task to at least check the release notes for libvirt for any api changes or things that might need an update 15:36:15 in monasca-agent 15:37:19 also, only partially related, do you know if we could run tempest tests on bionic already? 15:37:53 I don't know. Are other projects doing that already? 15:38:07 haven't checked, just came to my mind 15:38:13 good thought 15:39:33 could you create a testing task for monasca-agent and add it to the board please? 15:39:40 sure 15:39:45 thanks joadavis 15:40:24 I'll have a look at running devstack plugin on bionic 15:40:43 #topic reviews 15:41:27 rpm-packaging change looks good to me 15:41:48 :thumbsup" 15:42:12 #topic bugs 15:42:24 https://storyboard.openstack.org/#!/story/2001593 15:43:06 to be honest, I haven't looked in detail into it, but don't like the sudoers idea 15:43:50 it would make the installation/configuration even more complex 15:44:59 other thoughs? 15:45:08 Yeah, I was struggling with a good answer. Another engineer here is looking at the problem. It appears that in the rpm-packaging there are already a few programs set up for monasca-agent user which are granted in the sudoers file 15:46:06 I'm not sure how it works, but if it is possible to grant elevated permission to the monasca-agent user for just the ip command, that might be good. But as you said, it is a more complex configuration 15:46:44 I wanted to bring it up in case our monasca community has some other great ideas. :) 15:47:33 we'll ping our team about it 15:47:47 also, we'll add it to our new bugs board 15:47:54 thanks 15:48:13 I think we should try to find a nicer solution 15:48:39 but if that doesn't work, we could set up sudoers 15:49:43 #topic monasca-agent in large deployments 15:50:18 pandy: that's yours, right? 15:50:20 Hi 15:50:34 yes mine 15:50:52 quick explanation of my environment 15:50:53 Installed monasca using docker on 3 dedicated baremetals, Please note: used monasca docker images for monasca-api, grafana, notification, mysql, influxdb, where kafka & zookeeper used different version 15:50:54 for scaling and running on docker swarm mode 15:51:05 In 500+ compute installed monasca agent and did configuration using monasca-setup as per https://github.com/openstack/monasca-agent/blob/master/docs/Agent.md 15:51:12 Where added libvirt.yaml plugin to collect VM metrics and here configuration of libvirt.yaml http://paste.openstack.org/show/730940/ 15:51:22 Issue is some of monasca agent is hitting Neutron API very frequently 15:51:29 just suspected these parameters are causing issue so disabled it 15:51:29 ""vm_network_check_enable: false" "ping_check: false" "vm_ping_check_enable: false"" 15:51:46 Here my question: "Would like to know "Which Monasca agent plugins & parameters will hit Neutron API and whats the interval period ?" & "How can control hitting to Neutron API ?"" 15:52:18 sorry i was prepared already, so sent messages in row. 15:52:35 is libvirt the only plugin, you've enabled on compute nodes? 15:53:11 by default it has given me process, cpu, network and i have added libvirt.yaml to it 15:54:14 default i have congestion, disk, load, network, process, cpu, memory, ntp. I have added "libvirt" into /etc/monasca/agent/conf.d 15:54:41 would like to know which plugin is hitting Neutron API ? 15:55:31 Neutron.yaml here http://paste.openstack.org/show/730940/ 15:55:48 libvirt plugin communicates with Neutron, but I cannot answer your question about configuration option right now 15:56:14 libvirt and ovs plugin only hits neutron 15:56:18 as per my understanding 15:56:25 at this moment, ovs and libvirt plugin is using neutronclient 15:56:45 i am using libivirt, where disabling "ping_check" will stop hitting neutron API ? 15:57:44 FYI, we are not using namespace in compute nodes, so i feel "ping_check" no need, other than that what are parameters inside libivirt will hit Neutron API 15:58:19 koji_n: will you be able to check this? 15:58:25 https://github.com/openstack/monasca-agent/blob/819822529422e68614dd4c3b95a9b530795e4bcf/monasca_agent/collector/checks_d/libvirt.py#L186-L192 15:58:32 probably, pandy is correct 15:58:52 neutronclient is used only the above section in libvirt plugin 15:59:15 that was quick, thanks koji_n :) 15:59:39 koji_n, whether "ping_check" only use neutron API ? 15:59:54 np, but i didn't test it, so maybe it's wrong 16:00:04 How about "vm_network_check_enable" ""vm_ping_check_enable: false"" 16:00:27 have to close the meeting 16:00:34 thanks for joining everyone 16:00:39 Thanks witek, bye all 16:00:39 thanks all 16:00:42 see you next week 16:00:43 witek, i need someone from libvirt to help out this 16:00:55 #endmeeting