14:00:32 <acabot> #startmeeting watcher
14:00:33 <openstack> Meeting started Wed Jun  1 14:00:32 2016 UTC and is due to finish in 60 minutes.  The chair is acabot. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:34 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:00:36 <openstack> The meeting name has been set to 'watcher'
14:00:41 <acabot> hi
14:00:47 <alexchadin> hi
14:01:02 <acabot> agenda for today #link https://wiki.openstack.org/wiki/Watcher_Meeting_Agenda#06.2F01.2F2016
14:01:54 <jed56> hello
14:01:57 <hvprash> hi
14:02:02 <vincentfrancoise> hi
14:02:04 <tkaczynski> hi
14:02:10 <dtardivel> hi
14:02:23 <seanmurphy> hi
14:02:25 <tpeoples> o/
14:02:31 <brunograz> hi
14:02:41 <acabot> hi tpeoples ; good to see you ;-)
14:02:53 <acabot> #topic Announcements
14:03:05 <tkaczynski> big tent :)
14:03:07 <acabot> #info Watcher has been accepted for the OpenStack big tent
14:03:15 <acabot> last night
14:03:26 <acabot> so congrats to everyone
14:03:30 <seanmurphy> great news!
14:03:37 <brunograz> +1
14:03:43 <acabot> #link https://review.openstack.org/#/c/320941/
14:03:43 <sballe_> o/
14:04:09 <acabot> #link http://eavesdrop.openstack.org/meetings/tc/2016/tc.2016-05-31-20.02.log.html if you want to look at the TC discussion
14:04:15 <jwcroppe> o/
14:04:26 <acabot> just some quotes I'd like to share with you
14:04:28 <alexchadin> beautiful!
14:04:36 <acabot> <johnthetubaguy> lots of operators seemed interested in the project at the ops meetup in manchester
14:04:47 <acabot> <ttx> I like to think of it as more generally the background process that will apply some long-term optimization policy as you have churn on your resources
14:04:56 <acabot> <sdague> "cloud defrag"
14:05:05 <acabot> <jroll> another example use case besides power saving: shuffle things around to get a bunch of empty hypervisors, update kernels on the empties, move things back around to get other empties
14:05:13 <acabot> <russellb> "policy based live migration" is what it's called in some other things ...
14:05:33 * johnthetubaguy nods at good highlights picked out there
14:05:37 <jwcroppe> all very great comments
14:06:05 <ttx> also pretty great diveristy achieved pre-officialness
14:06:10 <ttx> diversity*
14:06:16 <acabot> the only "issue" we had was the tag "diverse-affiliation"
14:06:36 <acabot> ttx : thx ;-)
14:07:15 <acabot> so now we can check metrics on stackalytics #link http://stackalytics.com/?project_type=openstack&metric=commits&module=watcher-group
14:07:29 <sballe_> +1
14:08:18 <acabot> we need more contribs to lower bcom contributions under 50%
14:08:32 <acabot> if we want to get the "diverse-affiliation" tag ;-)
14:08:35 <gzhai2> :)
14:09:16 <acabot> #info This achievement has been announced on the ML
14:09:24 <acabot> #link http://lists.openstack.org/pipermail/openstack-dev/2016-June/096340.html
14:09:39 <alexchadin> I'm trying to invite more colleagues to watcher's contributing
14:10:12 <acabot> I hope it will all help you to get more traction inside companies
14:10:44 <acabot> lets move to watcher activity now
14:10:44 <alexchadin> Rally peoples are interested in Watcher
14:10:59 <acabot> #info Newton-1 release has been packaged on May 30th watcher v0.27, python-watcher client v0.23 & watcher-dashboard v0.3
14:11:18 <acabot> all packages are available on pypi & launchpad
14:11:25 <tkaczynski> becoming big tent project definitely helps with traction I think
14:11:50 <jwcroppe> +1
14:11:55 <hvprash> +1
14:12:12 <acabot> tkaczynski : I hope so and we will see that in the coming weeks, I would like to have bcom contribs under 50% by our next mid-cycle !
14:12:39 <acabot> #info seanmurphy published a blog post about Watcher
14:12:45 <acabot> #link https://blog.zhaw.ch/icclab/employing-openstack-watcher-in-geyser-to-make-openstack-more-energy-efficient/
14:12:58 <acabot> thx seanmurphy
14:13:17 <seanmurphy> np - it’s not super high visibility stuff tbh
14:13:21 <sballe_> that is super. thx
14:13:39 <seanmurphy> but the bit of work that we’re doing here is within the context of that proj, so we have to promote it a bit
14:13:43 <hvprash> nice !
14:13:45 <tkaczynski> do we have release notes somewhere with features released in newton-1 ?
14:14:03 <acabot> I forgot to mention it but I wrote down an article on bcom website #link https://b-com.com/en/news/back-austin-openstack-summit-antoine-cabot-gives-us-news-about-watcher-project
14:14:44 <acabot> tkaczynski : actually no, we rely on launchpad to identify blueprints that have been implemented, we should probably improve this
14:15:00 <tkaczynski> acabot: thanks
14:15:18 <acabot> tkaczynski : I will look at it as soon as we have the Watcher doc hosted on openstack.org
14:15:31 <tkaczynski> +1
14:15:36 <vincentfrancoise> tkaczynski acabot: we should maybe use reno (http://docs.openstack.org/developer/reno/) to generate the release notes
14:16:00 <acabot> #action acabot look at improving release notes for Watcher / use reno
14:16:20 <acabot> #info mid-cycle details will be announced on the ML by EOW
14:16:36 <acabot> sballe_ : how many attendees do you have ?
14:16:45 <tkaczynski> vincentfrancoise: good idea, but I guess this will require more discipline in putting the right comments in the commits or whatever is used to generate these release notes
14:16:49 <sballe_> for now 6
14:16:55 <sballe_> so we can use more
14:17:11 <sballe_> jwcroppe: tpeoples jed56 acabot hvprash and sballe
14:17:38 <sballe_> I hope to get more people from intel. I just sent them out the notification
14:17:40 <acabot> ok can you send an email on the ML to promote it ?
14:18:01 <sballe_> sure
14:18:09 <sballe_> will do later today
14:18:12 <vincentfrancoise> tkaczynski: Probably yes, but we already write openstack compliant commit messages so this should help
14:18:18 <jwcroppe> ML activity will help a lot I think - we should also send an 'intro' note maybe now that we're Big Tent?
14:18:28 <acabot> #action sballe_ send an email on the ML to promote our mid-cycle meetup
14:18:48 <acabot> jwcroppe : I did http://lists.openstack.org/pipermail/openstack-dev/2016-June/096340.html
14:19:10 <acabot> #info Watcher puppet repository is now available
14:19:38 <acabot> thanks to the puppet team
14:19:49 <acabot> #link https://github.com/openstack/puppet-watcher
14:19:50 <sballe_> acabot: for the internal intel clluster should edwin and I ask for rally to be installed?
14:20:04 <sballe_> +1 puppet team
14:20:23 <acabot> we are looking for feedback from Rally team
14:20:30 <acabot> alexchadin : any update on this ?
14:20:34 <vincentfrancoise> thanks to danpawlik for initiating it as well ;)
14:20:37 <alexchadin> acabot: yes
14:20:37 <jed56> IMHO, rally is design to benchmark Openstack
14:20:50 <sballe_> ok let us know since we are being ask for setup requirements
14:20:56 <acabot> yes thx to danpawlik (I was looking for his IRC nick...)
14:21:03 <alexchadin> acabot: I got instructions from Rally team of modifying Rally for Watcher Support
14:21:11 <sballe_> I agree but I am not a rally expert so not sure what to do if things go wrong
14:21:14 <alexchadin> I can handle this if you want
14:21:27 <sballe_> but I can learn :)
14:21:36 <hvprash> sballe_ what about telemetry ?
14:21:39 <jed56> alexchadin: what are the modifications they want to perform ?
14:21:53 <sballe_> edwin asked for ceilomter/monasca
14:21:56 <danpawlik> we are community,  each brings a lot for this project :)
14:22:00 <sballe_> hvprash: ^^
14:22:20 <gzhai2> alexchadin: Do you have plan to enhance rally for watcher?
14:22:28 <hvprash> thx sballe_, if any help needed on ceilometer will be happy to
14:22:41 <alexchadin> jed56: we need WatcherOSClient in rally.osclients.OSClient
14:22:53 <alexchadin> jed56: gate jobs
14:23:09 <alexchadin> jed56: contexts
14:23:12 <alexchadin> jed56: http://rally.readthedocs.io/en/latest/plugins/context_plugin.html
14:23:19 <jed56> I'm not sure that we need to stress the watcher api
14:23:26 <alexchadin> jed56: and scenarios http://rally.readthedocs.io/en/latest/plugins/scenario_plugin.html
14:23:50 <sballe_> acabot: jed56 do we think ceilomter will scal eok for the 30 node test?
14:23:53 <alexchadin> gzhai2: I do
14:23:54 <jed56> the watcher-api  didn't need to scale a lot
14:24:33 <sballe_> I would prefer to ask for Ceilomter as the back end then Monasca. I have no real experience with Monasca
14:24:45 <acabot> sballe_ : dtardivel is looking at testing the latest version and ceilometer and probably bench Monasca later on
14:24:59 <jed56> sballe : I don't think so
14:25:00 <sballe_> ok perfect
14:25:20 <sballe_> does anybody remember waht the etherpad was called for this activity?
14:25:42 <gzhai2> https://etherpad.openstack.org/p/watcher-test-environment-specifications
14:25:58 <jed56> alexchadin:  we need more a tool the generate specifics workloads in the VMs
14:26:05 <acabot> sballe_ : bookmark this one https://etherpad.openstack.org/p/watcher-etherpads ;-)
14:26:18 <sballe_> perfect
14:26:21 <alexchadin> jed56: what kind of loads?
14:26:29 <alexchadin> jed56: CPU, RAM, Disk?
14:27:02 <acabot> alexchadin : yes if we want to trigger migrations based on CPU load we need to deploy loaded VMs
14:27:03 <jed56> We can have several scenario depending of the goals
14:27:26 <vtech> I was using the stress tool for that
14:27:42 <vtech> there is a newer version stress-ng
14:27:48 <acabot> vtech : that's what we did also but its far from reality ;-)
14:27:57 <tkaczynski> there are some tools which can generate some specific workloads, like CPU, redis, etc. we used that for demo
14:28:13 <jed56> tkaczynski: yes filebench for example
14:28:36 <tkaczynski> I can try to find our what we used if that helps
14:28:40 <seanmurphy> we found ceilometer to slow down the watcher api quite a bit - don’t have specifics to hand but can provide some details on the openstack-watcher chat in next day or two - even for a small scenario
14:28:45 <tkaczynski> I would need to ask my colleagues
14:28:50 <acabot> this is what we need to do now, define what will run in the infra to demonstrate watcher capabilities
14:28:51 <vtech> stress-ng provides much more control than the original stress - http://kernel.ubuntu.com/~cking/stress-ng/
14:29:09 <acabot> vtech : thx, I will look at it
14:29:18 <jed56> The perfect tool can generate noisy neighboor , unbalanceload, etc
14:29:34 <sballe_> jed56 doo we have one of those
14:29:37 <hvprash> there is the google perfkit benchmark. haven't tried it yet though - https://github.com/GoogleCloudPlatform/PerfKitBenchmarker
14:29:41 <acabot> any other announcement ?
14:29:51 <jed56> vtech: I agree but they are micro-benchmark
14:29:58 <dtardivel> acabot: could we create a etherpad about stress and workload tools ?
14:30:20 <jed56> hvprash:  I tried perfkitbenmark
14:30:35 <hvprash> any better ?
14:30:37 <sballe_> dtardivel: I am adding it to the etherpad for the test env
14:30:40 <acabot> dtardivel : I would prefer to create a sub-section in https://etherpad.openstack.org/p/watcher-test-environment-specifications
14:30:51 <dtardivel> acabot: +1
14:30:54 <sballe_> acabot: I am doing that
14:30:58 <vtech> jed56, sure, I just thought stress-ng worth mentioning...
14:31:09 <jed56> IMHO, we need some to tool to stress a real infrastructure but also use simulators
14:31:27 <acabot> sballe_ ok
14:31:27 <sballe_> jed56, dtardivel feel free to add to the etehrpad
14:31:43 <jed56> I have a POC which connect the watcher strategies with CloudSIm
14:31:57 <sballe_> What's CloudSim
14:32:19 <jed56> #link www.cloudbus.org/cloudsim
14:32:35 <jed56> this an academic cloud simulator
14:32:40 <jed56> *is
14:33:03 <jed56> #link http://beyondtheclouds.github.io/VMPlaceS/
14:33:47 <acabot> sorry but I'd like to come back to the agenda :-)
14:33:51 <sballe_> lol
14:33:54 <acabot> #topic Review Action Items
14:33:56 <jed56> :-)
14:34:19 <acabot> #info Add Watcher Continiously Optimization spec has been merged #link Add Watcher Continiously Optimization spec has been merged
14:34:35 <acabot> alexchadin is working on the implem
14:34:40 <sballe_> +1
14:34:43 <alexchadin> +1
14:34:51 <tkaczynski> +1
14:34:56 <acabot> Audit parameters should be persistent in Db needs review from core #link https://review.openstack.org/#/c/317130/
14:35:01 <alexchadin> it is ready to review
14:35:12 <acabot> #action acabot sballe_ jwcroppe review https://review.openstack.org/#/c/317130/
14:35:13 <hvprash> yeah, need more comments
14:35:36 <dtardivel> hvprash: I will have a look on it
14:35:38 <acabot> alexchadin : sorry I missed it
14:35:42 <jwcroppe> will look
14:35:49 <hvprash> thx
14:36:09 <acabot> alexchadin needs more reviewers on https://review.openstack.org/#/c/321411/
14:36:45 <sballe_> I will look at it too
14:36:46 <tpeoples> i'll take a look at that
14:36:56 <acabot> #info Cluster model objects wrapper has been unassigned from tpeoples #link https://review.openstack.org/#/c/287019/
14:36:57 <vincentfrancoise> I can review it
14:37:25 <tpeoples> acabot: does vincentfrancoise plan to pick that up? i can help with the implmentation, but don't think i'll be able to drive the whole thing
14:37:28 <acabot> #action sballe_ tpeoples vincentfrancoise review https://review.openstack.org/#/c/321411/
14:37:49 <alexchadin> vincentfrancoise: I appreciate this:)
14:38:18 <dtardivel> #action dtardivel review https://review.openstack.org/#/c/317130/ :)
14:39:00 <acabot> tpeoples : vincentfrancoise plan to work on it as soon as efficacy indicator will be merged but he will need help on implementation
14:39:19 <vincentfrancoise> acabot: +1
14:39:53 <tpeoples> ok acabot.. let me get back into the swing of things and i'll start hacking at that like i planned to originally... :( :). when vincentfrancoise frees up he can help out
14:40:19 <acabot> Graph model describing virtual and physical elements in a data center & Consolidation of multiple Action-plans into a single one need reviews #link https://review.openstack.org/#/c/298891/ https://review.openstack.org/#/c/298871/
14:40:38 <jed56> acabot you can pick me
14:41:02 <acabot> #action jed56 review  https://review.openstack.org/#/c/298891/ & https://review.openstack.org/#/c/298871/
14:41:13 <acabot> lets move to Watcher
14:41:30 <acabot> #info plugins-parameters has been merged #link https://review.openstack.org/#/q/status:merged+project:openstack/watcher+branch:master+topic:bp/plugins-parameters
14:41:44 <acabot> 2 new strategies have been merged Workload balance migration strategy implementation & Add Overload standard deviation strategy
14:41:52 <acabot> #link https://review.openstack.org/#/c/292188/
14:42:00 <acabot> #link https://review.openstack.org/#/c/292188/
14:42:17 <acabot> #link https://review.openstack.org/#/c/298891/
14:42:36 <acabot> Watcher CLI
14:43:06 <acabot> #info openstackclient-plugin has been merged #link https://review.openstack.org/#/q/topic:bp/openstackclient-plugin
14:43:27 <acabot> so now you can use watcher with "openstack optimize" CLI ;-)
14:43:38 <sballe_> +1
14:43:46 <dtardivel> About the watcher cli, please have a look on latest documentation. Command syntax has changed !!!
14:44:38 <acabot> you can still use both "watcher" and "openstack optimize" command
14:44:56 <acabot> #link http://factory.b-com.com/www/watcher/doc/python-watcherclient/openstack_cli.html
14:45:17 <acabot> Watcher puppet
14:45:48 <acabot> danpawlik has submited the initial commit https://review.openstack.org/#/c/323864/
14:46:08 <acabot> and need reviewers (if you are familiar with puppet :-))
14:46:23 <dtardivel> danpawlik: +1
14:46:46 <danpawlik> acabot: people from puppet are very helpful and I guess there will be no problem in review :)
14:46:57 <acabot> danpawlik : ok
14:47:04 <acabot> #topic Blueprint/Bug Review and Discussion
14:47:32 <gzhai2> acabot: who can review optimization-threshold?
14:47:32 <acabot> #info Newton-2 is our next milestone due July 11th (just before the mid-cycle)
14:47:51 <acabot> gzhai2 : right I missed this one, sorry for that
14:48:25 <acabot> gzhai2 : still a jenkins issue ?
14:48:38 <acabot> gzhai2 needs reviewers on https://review.openstack.org/#/c/297556/
14:48:39 <gzhai2> acabot: I think so.
14:49:15 <gzhai2> jenkins has py34 and multinode error.
14:49:36 <acabot> who wants to review https://review.openstack.org/#/c/297556/ ?
14:49:51 <vincentfrancoise> gzhai2: I have made the review but still in draft for now
14:50:08 <gzhai2> vincentfrancoise: thanks!
14:50:21 <acabot> Newton-2 #link https://launchpad.net/watcher/+milestone/newton-2
14:51:02 <acabot> tkaczynski : deadline is July 11th, are you back on the scoring module ?
14:51:04 <vincentfrancoise> gzhai2: There is the question of how to validate the parameters that still bugs me but I will be discussing this with jed56 before posting the review ;)
14:51:32 <jed56> +1
14:51:41 <gzhai2> vincentfrancoise: we can discuss it in watcher chanel after meeting.
14:51:53 <tkaczynski> acabot: TAP sprint for the release is finishing next Tuesday (7th June), from Wednesday I'm back 100% to Watcher
14:52:04 <sballe_> +1
14:52:15 <jed56> tkaczynski: great :)
14:52:19 <acabot> tkaczynski : ok I will keep it for Newton-2 then
14:52:33 <vincentfrancoise> gzhai2: sure
14:52:43 <acabot> we still have an unassigned BP regarding policies #link https://blueprints.launchpad.net/watcher/+spec/watcher-policies
14:52:56 <acabot> does anyone wants to take it ?
14:53:00 <tkaczynski> I should be able make some good progress, not sure if finish 100%, documentation etc.
14:53:37 <vincentfrancoise> tkaczynski: break down your changesets so we can validate the code even if you didn't finish the doc
14:54:08 <tkaczynski> vincentfrancoise: will do my best :)
14:54:22 <acabot> tkaczynski : do you plan to come at the mid-cycle ?
14:54:59 <acabot> 5 minutes left for open discussions
14:55:00 <tkaczynski> I would like to, but I need to talk to management about funding
14:55:08 <acabot> #topic Open Discussion
14:55:22 <acabot> tkaczynski : still the same issue at Intel ;-)
14:55:35 <acabot> should we add puppet repository and watcher-dashboard to project-config to get IRC notifications from CI ?
14:55:39 <tpeoples> acabot: regarding the policies BP, shouldn't nearly all of the APIs be admin only? trying to think why an end user should have access, unless we would be using policies for certain types of admins
14:56:01 <jed56> tpeoples: +1
14:56:06 <vincentfrancoise> Why not
14:56:12 <tkaczynski> acabot: always :) but I think it makes a sense to look at every dollar spent :) it would definitely help to have meetup somewhere closer
14:56:13 <alexchadin> I will adapt Rally for Watcher and see what we can got from this
14:56:15 <acabot> tpeoples : dtardivel had a look at it a couple of months ago
14:57:37 <sballe_> tkaczynski: it is at the Intel location. aybe you can visit wih other peopel
14:57:49 <acabot> coming back to my original discussion, should we add IRC notifications on our 2 new repos ?
14:58:18 <jed56> acabot yes
14:58:20 <tpeoples> might as well as long as it isn't spammy
14:58:30 <sballe_> What the Openstak way? we are now an official project
14:58:31 <jed56> vote ?  :)
14:58:34 <acabot> I really like to have on IRC but I dont want to spam everyone
14:58:44 <dtardivel> tpeoples: yes, we could have different types of admin user. We want just to allow an admin to configure rules from a policy file.
14:58:47 <tkaczynski> sballe_: maybe. I should know more in few days I guess
14:59:17 <tpeoples> dtardivel: sure, that sounds reasonable... just don't think many deployers will utilize that sort of feature
14:59:24 <acabot> #startvote should we add IRC notifs ? yes, no
14:59:24 <openstack> Begin voting on: should we add IRC notifs ? Valid vote options are yes, no.
14:59:25 <openstack> Vote using '#vote OPTION'. Only your last vote counts.
14:59:36 <tpeoples> #vote yes
14:59:38 <jed56> #vote yes
14:59:39 <sballe_> #vote yes
14:59:39 <acabot> #vote yes
14:59:47 <dtardivel> #vote yes
14:59:47 <alexchadin> #vote yes
14:59:49 <gzhai2> #vote yes
14:59:51 <hvprash> #vote yes
14:59:55 <vincentfrancoise> #vote yes
15:00:01 <acabot> #endvote
15:00:02 <openstack> Voted on "should we add IRC notifs ?" Results are
15:00:03 <openstack> yes (9): vincentfrancoise, tpeoples, alexchadin, hvprash, jed56, dtardivel, acabot, gzhai2, sballe_
15:00:07 <acabot> ok done
15:00:18 <sballe_> I am glad we voted ;-)
15:00:20 <jed56> FYI, I'm starting to develop a POC to avoid to bypass the nova scheduler rules
15:00:26 <tkaczynski> acabot: by the way, I was thinking in the meantime about scoring module in Watcher and it seems that I will need to make some changes comparing to what is in the spec
15:00:28 <acabot> #action dtardivel add watcher-puppet & watcher-dashboard notifs on IRC
15:00:46 <tkaczynski> acabot: do I need to update the spec and go through the review again?
15:00:50 <sballe_> jed56: 1
15:00:51 <acabot> we have to end the meeting
15:00:55 <acabot> thx
15:00:56 <sballe_> bye
15:00:59 <sballe_> thx
15:01:00 <hvprash> bye
15:01:01 <acabot> #endmeeting