14:00:09 #startmeeting watcher 14:00:11 Meeting started Wed Sep 21 14:00:09 2016 UTC and is due to finish in 60 minutes. The chair is acabot. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:12 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:14 The meeting name has been set to 'watcher' 14:00:16 o/ 14:00:24 o/ 14:00:26 hi everyone 14:00:26 Hi 14:00:26 o/ 14:00:30 \o 14:00:39 I am woking with dtardivel on something 14:00:59 agenda for today #link https://wiki.openstack.org/wiki/Watcher_Meeting_Agenda#09.2F21.2F2016 14:01:21 #topic Announcements 14:01:35 #info Watcher Newton RC1 (v0.30.0) has been released, please follow instructions sent on the ML 14:01:43 #link http://lists.openstack.org/pipermail/openstack-dev/2016-September/103989.html 14:02:01 #info Newton stable branches have been created by the TC for watcher & python-watcherclient 14:02:15 o/ 14:02:15 hi 14:02:17 hi 14:02:42 so if you file a bug that needs to be released in newton, please tag it as *newton-rc-potential* 14:03:10 now we will have to deal with a newton stable branch 14:04:06 watcher-dashboard is still waiting for a rc-final release next week 14:04:20 #info we need your help to test the release and submit bugs before the final release next week 14:04:55 #info acabot will be Watcher PTL for Ocata cycle 14:05:04 as I'm the only candidate 14:05:07 acabot: congrats :) 14:05:14 so thanks for electing me :-D 14:05:14 congrats ! 14:05:18 +2 14:05:20 o/ 14:05:25 acabot: congrats! 14:05:46 #info design summit sessions timeslots are available on the dedicated etherpad 14:05:53 #link https://etherpad.openstack.org/p/watcher-ocata-design-session 14:06:06 sballe_: btw, the presentation looks good... few nits I'll send today/tomorrow 14:06:17 jwcroppe: thx 14:06:48 as you may probably know, I wont be with you in Barcelona so I hope sballe_ can deal with PTL assignements during the summit 14:06:54 acabot: I can drive the filling out of design sessions 14:07:14 sballe_ : definitely 14:07:15 thx 14:07:26 I am the virtual acabot ... Pretty big shoes to fill ;-) 14:07:43 #action sballe_ start filling working sessions agenda in https://etherpad.openstack.org/p/watcher-ocata-design-session 14:08:04 sballe_ : I'm sure you will fit the role ;-) 14:08:14 thx 14:08:28 any other announcement ? 14:08:55 lets move on 14:08:59 #topic Review Action Items 14:09:05 Watcher specs 14:09:13 Resize instance base on workload needs a new PS and should be retargeted to Ocata 14:09:20 #link https://review.openstack.org/#/c/359690/ 14:09:35 Yumeng : are you working on it ? 14:09:38 yep 14:09:45 hanrong has uploaded a new patch about this spec. and some problems are reported in jekins. we will do more revision asap. 14:10:15 Yumeng_ : please retarget it to Ocata in your next PS 14:10:39 ok. 14:10:43 i will do that 14:10:47 #action Yumeng_ hanrong retarget and update https://review.openstack.org/#/c/359690/ 14:10:55 automatic triggering of action plans for AUDIT needs reviews 14:11:01 #link https://review.openstack.org/#/c/342473/ 14:11:19 diga_ : I saw that you added a new PS, is that ready to be reviewed ? 14:11:34 acabot: yes 14:11:39 I made some comments on it already 14:11:57 ok 14:12:08 there is 1 main question that still misses an answer 14:12:20 sballe_ jwcroppe hvprash : anyone who wants to review it ? 14:12:32 I can d that 14:12:36 +1 14:13:02 +1 14:13:14 +1 14:13:23 #action hvprash sballe_ acabot gzhai jwcroppe review https://review.openstack.org/#/c/342473/ 14:13:45 vincentfrancoise: Your comment "How do plan on making sure there only one action plan that is executed at a time? " 14:13:51 Limit concurrent actions invoked by Watcher needs reviews 14:14:02 #link https://review.openstack.org/#/c/348049/ 14:14:23 sorry I didn't have time to review it yet, anyone here who wants to review ? 14:14:50 i can 14:14:54 ditto 14:15:07 #action hvprash sballe_ review https://review.openstack.org/#/c/348049/ 14:15:26 vincentfrancoise: we are introducing the AUTO_TRIGGER_ACTION_PLAN attribute in the AUDIT, only those Audits action plan executed 14:15:28 hvprash : dont take too many reviews because you have a spec to write ;-) 14:15:28 diga_: yes that's the one question that needs to be addressed 14:15:52 thats fine acabot :) 14:16:11 diga_: yes but if 2 action plans have that AUTO_TRIGGER_ACTION_PLAN flag, they will be concurrently executed and we don't want that 14:16:26 been away for few weeks and was missing some action ;) 14:16:39 hvprash ;-) 14:16:50 Add team priorities for Ocata needs reviews and will be merged during the summit 14:16:56 #link https://review.openstack.org/#/c/372528/ 14:17:10 I had a discussion with alexchadin about the watcher roadmap 14:17:25 vincentfrancoise: how many action plan we can execute for one audit, can we execute many action plan for audit ?? 14:17:32 and realized that we didn't set priorities after the mid-cycle 14:17:38 diga: we need to add some logic on the watcher-applier side to make sure that only 1 action plan can be executed at a time 14:17:50 vincentfrancoise: okay 14:17:51 diga: 2 action plans from 2 different audits 14:18:00 diga_ vincentfrancoise : could you please iterate through gerrit ? 14:18:14 acabot: okay 14:18:15 acabot: ok 14:18:43 so I did a first draft of Ocata priorities, I could have missed some important BPs so please review it before the summit 14:19:00 We need a spec for Define grammar for workload characterization 14:19:08 yes 14:19:08 #link https://blueprints.launchpad.net/watcher/+spec/workload-characterization-grammar 14:19:10 working on it 14:19:34 +1 14:19:36 #action sballe_ jwcroppe hvprash review https://review.openstack.org/#/c/372528/ 14:19:49 hvprash: pull me in 14:19:53 #action hvprash submit a spec for https://blueprints.launchpad.net/watcher/+spec/workload-characterization-grammar 14:19:56 of course sballe_ 14:20:07 moving to Watcher 14:20:19 many bug fixes merged last week 14:20:40 now that we have a stable branch, we can start merging code for Ocata 14:20:52 Add Audit Scope Handler needs reviews 14:21:10 #link https://review.openstack.org/#/q/status:open++topic:bp/define-the-audit-scope 14:21:27 who wants to review the audit scope handler ? 14:21:35 +1 14:21:44 +1 14:21:57 #action dtardivel sballe_ review https://review.openstack.org/#/q/status:open++topic:bp/define-the-audit-scope 14:22:09 Graph cluster model implementation needs reviews 14:22:16 #link https://review.openstack.org/#/c/362730/ 14:22:32 who wants to review the graph model ? 14:22:50 me 14:22:59 me 14:23:09 #action vincentfrancoise dtardivel review https://review.openstack.org/#/c/362730/ 14:23:19 Watcher dashboard 14:23:27 Dashboard devstack plugin has been disabled until a bug is fixed in devstack 14:23:36 #link https://bugs.launchpad.net/devstack/+bug/1540328 14:23:38 Launchpad bug 1540328 in devstack "Devstack cannot install Horizon plugins using pip 8.x" [Undecided,Confirmed] - Assigned to YAMAMOTO Takashi (yamamoto) 14:23:45 it impacts many different projects 14:24:06 and our devstack setup does not work anymore 14:24:40 #topic Blueprint/Bug Review and Discussion 14:24:53 acabot: I would like to check watcher:stable/newton branch on devstack, but stable/newton branch on devstack is not yet available... 14:25:36 as discussed last week, after the RC-1 release, all BPs targeted for Ocata were medium or low priority 14:25:47 #link https://blueprints.launchpad.net/watcher/ocata 14:26:03 so I tried to set a priority and a milestone for each BP 14:26:41 I'd like everyone to review it and check if the priority and milestone is ok 14:27:12 we have 17 BPs for Ocata (15 have been completed in Newton) 14:27:48 of course if I missed important BP in the list https://blueprints.launchpad.net/watcher please let me know asap 14:28:11 this is a good cadense. pretty impressive 14:28:41 the Ocata schedule is shorter than previous cycle 14:28:55 as there will be the PTG event in february 14:29:23 where is the PTG event? I forgot 14:29:28 Atlanta 14:29:52 scalability tests - platform status 14:30:09 dtardivel sballe_ gzhai : any updates on the platform ? 14:30:13 yes 14:30:33 we are going to check all the platform conf with Susanne 14:30:40 We have systems up and runnign with Monasca but dtardivel and I are debugging it 14:30:53 Monacsa needs to be configured 14:31:04 I have access to the systems now s we shoul dbe moving forward 14:31:23 a million thx to dtardivel for his help here 14:31:26 how many nodes do we have now ? 14:31:34 12=15 14:31:40 12+15 14:31:54 and 3 as control plane 14:31:58 ok 14:32:19 any idea of when we will be able to run PKB ? 14:32:37 as soon as we have it debugged and ceilosca installd 14:32:44 hopefuly next week 14:32:48 ok 14:33:11 Monday 26th 14:33:21 dtardivel: and I still have some debugging to do 14:33:40 yep 14:33:46 lol 14:33:52 sballe_ : we planned to have the platform until Monday 26th :-) 14:34:09 I have been told we can have it unitl the end of october 14:34:18 sballe_ : good news 14:34:34 I hope we will be able to get metrics before the summit 14:34:34 :-) 14:34:55 #topic Open discussions 14:35:03 Notifications in Watcher is too big and need to be segmented 14:35:09 #link https://blueprints.launchpad.net/watcher/+spec/watcher-notifications-ovo 14:35:24 vincentfrancoise : your subject ;-) 14:35:53 well this BP is quite big and tackles many aspects of Watcher at the same time 14:36:06 +2 ;) 14:36:07 first of there is the setup of the notification system 14:36:37 and then we have to lay down all the notifications (and their respective payload) we want for each one of the Watcher objects 14:37:22 so I would suggest we use this BP to only create the common plumbing 14:37:44 and then create a separate BP for the Audit notifications, Action Plan notifications, and so on... 14:38:22 this is a good idea 14:38:40 vincentfrancoise : so you plan to have only the Audit updated in this BP ? 14:38:47 + the plumbing 14:39:34 well I plan to do the common plumbing and the new audit-related notifications BP 14:39:40 so yes 14:39:49 vincentfrancoise: +1 14:40:15 my main concern would be, if we merge the Audit and then dont have time to update other Watcher objects, will Watcher still be usable ? 14:40:19 IMHO, the most important objects we need to focus on in ocata should be audit and action plan 14:40:54 as we will use 2 different mechanisms to deal with objects 14:41:20 because Watcher actions involve Nova (e.g. for migrations or service state update) 14:41:34 and these already emit notifications of their own 14:42:07 and the audit template is pretty much copied as an audit before any action gets done so audit notifications should suffice 14:42:29 ok 14:42:57 could you please update the BP description and submit a draft of spec for it ? 14:43:17 vincentfrancoise : could you please update the BP description and submit a draft of spec for it ? 14:43:37 acabot: yes I will, I am still in an 'exploration' stage 14:44:04 #action vincentfrancoise update BP description and submit a draft spec for https://blueprints.launchpad.net/watcher/+spec/watcher-notifications-ovo 14:44:13 vincentfrancoise : ok thx 14:44:22 we should provide a user documentation for each strategy 14:44:41 +1 14:45:09 as dtardivel was testing strategies last week, we realized that there is no dedicated doc for each strategy available in watcher 14:45:35 acabot: yep. the main idea is to propose a template doc to explain a strategy 14:45:57 what do you think ? 14:46:14 acabot: and how to use it, what are required metrics, how to collect them ? .... 14:46:43 the most important bit was the metrics requirements 14:46:48 should we let devs build there own doc when they submit a new strategy or should we guide them with a template ? 14:47:17 and then the parameter tunings 14:47:26 acabot: I prefer a template doc ... and an exemple 14:47:31 +1 14:47:47 +1 14:48:09 ok do we need a BP for that ? (I dont think so) 14:48:29 I created a wishlist bug 14:48:34 acabot: a BP might be needed to go through all existing strategies 14:48:43 its a doc improvement, I think a bug is sufficient 14:49:17 +1 14:49:21 vincentfrancoise : if we have a template, I think we can ask every strategy provider to add a doc 14:49:34 +1 14:49:36 +1 14:49:38 who wants to start working on a template ? 14:50:02 I can try on basic consolisation strategy 14:50:13 ok 14:50:47 #action build a template for strategy doc using basic consolidation as an example 14:50:58 #action dtradivel build a template for strategy doc using basic consolidation as an example 14:51:07 #action dtardivel build a template for strategy doc using basic consolidation as an example 14:51:17 * acabot a bit tired... 14:51:33 fix requirements 14:51:39 https://review.openstack.org/#/q/status:open+topic:tox/requirements 14:51:49 #link https://review.openstack.org/#/q/status:open+topic:tox/requirements 14:52:14 dtardivel : do you want to explain this change sets ? 14:52:34 vincentfrancoise: please can you explain it ? :))) 14:52:42 dtardivel: ok :p 14:53:42 so basically, these are needed to set precise requirement versions 14:54:57 e.g. for the stable/newton branch, this will guarantee that all test are passing with with the newton-capped package versions instead of beeing changed all the time 14:55:07 so now stable newton branch has fixed requirements right ? 14:55:13 strict requirements are set in openstack/requirements github project, in the file upper-contraints.txt 14:55:36 so do we have to test it again with these requirements or it was already done ? 14:55:56 requirements.txt only defines the lower boundary for package requirements 14:56:05 So we add into tox.ini a way to read this strict requirements and to update our dependencies versions while running unitary tests 14:56:13 with this, we now have the upper boundary 14:56:44 ok 14:56:57 4 min left, any other discussion to open ? 14:57:51 acabot: I proposed a commit for stable/newton and master branches on watcher and python-watcherclient project 14:58:03 s/commit/patchset 14:58:29 dtardivel : https://review.openstack.org/#/q/status:open++topic:tox/requirements 14:58:54 ok thank you all 14:59:00 have a nice day/night 14:59:02 bye 14:59:05 bye 14:59:11 #endmeeting