14:00:30 #startmeeting watcher 14:00:31 Meeting started Wed Jan 13 14:00:30 2016 UTC and is due to finish in 60 minutes. The chair is acabot. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:32 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:35 The meeting name has been set to 'watcher' 14:00:39 hi 14:00:43 o/ 14:00:46 Hi 14:00:55 o/ 14:00:56 o/ 14:00:59 agenda for today #link https://wiki.openstack.org/wiki/Watcher_Meeting_Agenda#01.2F13.2F2016 14:01:27 hi 14:01:34 \o 14:02:01 hi 14:02:07 #topic Annoucements 14:02:39 #info 1st draft of mid-cycle agenda is available https://wiki.openstack.org/wiki/Watcher_mitaka_mid-cycle_meetup_agenda#Agenda 14:02:41 o/ 14:03:07 feel free to change timings and subjects 14:03:58 acabot: Do you know if we can do working lunches? I think an hour for lunch is a long time. 14:04:37 maybe we do lunch in 30 minutes 14:04:41 sballe: thats my french spirit ;-) 14:04:49 lol 14:05:04 Maybe we can a topic regarding ceilometer ( performance, cache, .. ) 14:05:11 +1 14:05:19 I will ask jwcroppe 14:05:54 #action acabot add a topic regarding ceilometer to the agenda 14:05:55 jed56: I would add that topic to open discussions. Not sure we 2 hours for open discussions 14:06:12 the Nova mid-cycle will take place in Bristol in 2 weeks and they plan to discuss scheduler improvements https://etherpad.openstack.org/p/mitaka-nova-priorities-tracking 14:06:39 sballe : I am just wondering what we're doing to make us think Ceilometer won't pose a performance problem? Is there some other caching that's happening somewhere? 14:06:49 I wont be able to attend but we should look at the etherpads between the 2 meetings 14:07:21 any other announcement ? 14:07:25 acabot: I cannot go either to the Nova meeting. I hope jwcroppe can go 14:07:41 I won't be at the Nova mid-cycle either 14:07:48 jed56: I think Ceilomter is a problem so I would like for us to discss that 14:08:07 #topic Review Action Items 14:08:21 jed56 I think we said it wasn't a problem for the poc since we weren't doing produciton liek stuff 14:08:34 i don't think jwcroppe was planning on making it to the nova midcycle 14:08:41 ok 14:09:06 sballe: maybe we should discuss also Monasca integration ;-) 14:09:23 acabot: +1 14:09:24 ok. acabot since you guys are kind of local could you send somebody just so our voice is heard 14:09:39 Monasca and Ceilosca should be considered. 14:10:21 sballe: unfortunately I cant but I had a discussion with bauzas who will attend about our requirements, I'm also in discussion with him to submit a talk for the summit 14:10:37 ok cool! 14:10:55 lets move to Watcher specs now 14:11:13 #info Intel POC specs have been merged 14:12:07 #info dynamic actions specs have been merged and there is a lot of code moving right now 14:12:14 yeah +1 thx to everybody who contributed to make that happen 14:12:42 #link https://review.openstack.org/#/q/status:open+project:openstack/watcher+branch:master+topic:bp/watcher-add-actions-via-conf 14:13:01 all these reviews will have to be merged at the same time 14:13:28 jed56: do you think we can do it by end of week ? 14:13:29 ok 14:13:50 yes I think a waiting for last reviews 14:14:42 there are still 2 specs open regarding consolidation grammar and constraints management 14:14:54 sballe: did you have a look at them ? 14:15:09 tpeoples: we waiting for another +2 on these patchsets ;) 14:15:10 cdupont: do you handle both of them ? 14:15:15 yes 14:15:26 they are in our hands 14:15:34 looking dtardivel 14:15:50 acabot: I will look at them today/ I have been traveling and it messes up my todos 14:15:53 it's a proof of concept for a strategy using BtrPlace 14:16:04 cdupont: as I said in my last comment, I dont think we should have our own system dealing with constraints 14:16:12 OK 14:16:13 +1 14:16:31 I'm not sure I understood your comment :) 14:16:39 Where would the constraints come from? 14:16:46 cdupont : Nova 14:17:04 but the implementation/solver could be in Watcher? 14:17:24 cdupont: yes 14:17:28 OK 14:17:36 so this work should be paused? 14:17:41 cdupont : yes but the way you have written specs, you dont get constraints from Nova 14:17:53 I see 14:17:59 IMHO, we have to pull the constraints from (congress, nova, ... ) 14:18:20 and then use it we any strategies or sovler 14:18:24 +1 and then deal with consolidation through algorithms in Watcher 14:18:27 how the constraints are solved at the moment? 14:18:38 +1 on what jed56 said 14:18:48 cdupont : we don't :p 14:18:54 I mean, this is an NP hard problem, so only using filters is limited 14:19:02 we have to call nova filters for the P.OC 14:19:23 https://blueprints.launchpad.net/watcher/+spec/helper-nova-select-destinations 14:19:35 cdupont : +1 14:19:53 cdupont : we are looking at how to get these constraints from Nova #link https://blueprints.launchpad.net/watcher/+spec/helper-nova-select-destinations 14:19:56 using a solver like CP solver / linear integer etc. can lead to better placements 14:19:56 jed56: remember, though, there is no public interface to Nova's filtering 14:20:07 cdupont: but its a tricky question 14:20:08 edlefe : yes sadly 14:20:08 jed56: and there isn't any planned in the future 14:20:49 I think we can deal with contraints without nova filter but something it can be nice to use it 14:20:53 edleafe: right, we need to discuss it at the mid-cycle 14:21:06 the best way to work with nova is to select a host and then call live-migrate. If the host doesn't match the filter requirement, catch that and retry 14:21:07 So I'll wait that this question is stabilised to make progress 14:21:10 remeber, scheduler select_destinations() only returns one host per instance 14:21:19 I agree this is a good topic for the mid-ccyle 14:21:20 bzhou : +1 14:21:31 bzhou: +1 14:21:35 bzhou: remember too that there is no way to call select_destinations from outside of Nova. 14:21:51 cdupont: I will keep your BPs in discussion state for now 14:21:58 acabot: OK 14:22:10 acabot: We should bring this up as an issues at the nova mid-cycle. can you pass this on to your contact 14:22:10 as we use live migration in watcher, we can leverage nova's bp: check_destination 14:22:22 IMHO, the first thing is to find the best way to collect the constraints 14:22:33 sballe: I will 14:22:36 which will fail if the specified target host cannot pass filters 14:22:41 acabot: thx 14:22:42 if we want to solve it 14:22:54 bzhou: yes, that seems to be the only way. Select a host, and let check_destination reject it if necessary 14:23:08 #action acabot give bauzas a more detailed view of our requirements on Nova scheduler 14:23:35 that's definitely going to have scale issues edleafe , but i understand currently that would be our only option. i think we should at least try to work with nova to get something better 14:23:55 tpeoples: +1 14:23:59 tpeoples : +1 14:24:06 tpeoples: agreed. But when I spoke with people there after last week's meeting, they didn't seem very eager 14:24:35 Unfortunately, the scheduler is strictly internal to Nova for the foreseeable future 14:24:38 :( 14:24:55 edleafe: I read your discussion. I heard Neutron also wants a similar feature? 14:25:19 :( acabot can we work with bauzas to understand if using the scheduler filters in the way we want is out of the picture? 14:25:25 Neutron, Cinder, and one or two others all have generic scheduling needs 14:25:35 bzhou : yes Neutron has pretty much the same use case and they plan to discuss it full day during the nova mid-cycle 14:25:38 tpeoples: +1 14:25:42 But nova's scheduler is specific to compute resources 14:25:47 it can't handle anything else 14:25:54 +1 14:25:57 it even has a very hard time with ironic 14:26:05 lol +1 14:26:09 is that the goal of the super scheduler by harlowja, to fill this void? 14:26:23 i haven't had time to look into that much 14:26:26 tpeoples: not familiar with that. Link? 14:26:40 IMO we don't need a super scheduler We just need ApI to the various schedulers 14:26:42 https://review.openstack.org/#/c/210549/ 14:26:50 #link https://review.openstack.org/#/c/210549/ 14:27:13 fhermeni is working on this review 14:27:17 thx I hadn't seen that work 14:27:37 it is done on "OpenStack global specs" 14:27:53 no acabot, i don't want to go into the deep end with that super scheduler, just wanted to mention it. 14:28:01 tpeoples: the purpose of the « super-scheduler » is to provide a unique entry point to every scheduling aspects. The implementation at the backend might handle the scheduling completely or split and forward to different schedulers (nova, neutron …) 14:28:07 ok just added myself as a reviewer 14:28:55 #info there is a super-scheduler wip https://review.openstack.org/#/c/210549/ 14:28:55 tpeoples: it just exposes an entry point where users specify their expectations in terms of scheduling 14:29:28 sorry, I'm coming back to the agenda 14:29:35 thanks fhermeni 14:29:45 #info devstack plugin has been merged 14:29:52 cool! +1 14:29:58 great job tpeoples 14:30:11 do we want to send a note to the ML about this ? 14:30:19 definetly 14:30:21 thx for that, it was one of our Mitaka priorities 14:30:34 tpeoples: great, thanks 14:30:37 #action tpeoples send note to ML regarding devstack 14:30:43 thx 14:31:15 dtardivel started working on Watcher CLI 14:31:26 to bring Watcher evolutions in our client 14:31:29 tpeoples: we have to validate again live migration triggered by Watcher on devstack 14:31:44 #info Watcher client launchpad is now set up https://blueprints.launchpad.net/python-watcherclient 14:31:59 tpeoples: this is an opened bug on it :) 14:32:07 link? 14:32:31 ah yes 14:32:42 #link https://bugs.launchpad.net/watcher/+bug/1531912 14:32:43 Launchpad bug 1531912 in watcher ""MIGRATE" action triggered by Watcher Applier failed on devstack" [High,Confirmed] - Assigned to David TARDIVEL (david-tardivel) 14:32:47 i have a workaround for that, but i was waiting for jed56's refactoring stuff to merge first 14:32:52 now, when you submit a BP, please think about where it is the most suitable (Watcher or Watcher CLI) 14:33:33 #topic 14:33:39 #topic Blueprint/Bug Review and Discussion 14:33:44 same as you dtardivel, so OK :) 14:34:10 could everyone update the delivery field of its BPs ? https://blueprints.launchpad.net/watcher 14:34:39 it would be much easier for me to track progress ! 14:34:51 acabot: +1 14:35:28 will do 14:35:49 #action jed56 seanmurphy vmahe acabot tpeoples vincentfrancoise bzhou update delivery field on launchpad for affected blueprints 14:36:20 any update on BPs from alexstav ? 14:36:43 doesn't look like he's here 14:36:56 tpeoples : thx ;-) 14:37:22 if i see him on irc i'll ask him during the US day 14:37:22 we need to create a new repo for Watcher UI (in horizon) 14:37:57 can we agree on naming it "Watcher dashboard" as it is the common name used by other openstack projects ? 14:38:11 watcher-dashboard, watcher-ui 14:38:16 i'm fine with either 14:38:16 or anyone wants another name ? 14:38:20 watcher-ui 14:38:48 the other projects => monasca-ui, magnum-ui , zaqar-ui 14:38:56 watcher-dashboard 14:39:11 :D 14:39:12 but doesn't matter to me really 14:39:15 I like to follow the rest of openstack 14:39:16 jed56 : ok murano-dashboard, cloudkitty-dashboard ;-) 14:39:22 yes : ) 14:39:26 lol 14:39:31 vincentfrancoise:+1 14:40:04 I prefer watcher-ui. this is the name used internaly 14:40:05 dashboard is probably better in case we later get a ops-console 14:40:17 ui can be dashboard and console 14:40:35 but I can go either way 14:41:16 #startvote Watcher UI name ? watcher-ui, watcher-dashboard, dont care 14:41:17 Begin voting on: Watcher UI name ? Valid vote options are watcher-ui, watcher-dashboard, dont, care. 14:41:18 Vote using '#vote OPTION'. Only your last vote counts. 14:41:32 #vote watcher-ui 14:41:34 #vote watcher-dashboard 14:41:35 #vote watcher-dashboard 14:41:44 #vote watcher-dashboard 14:41:48 #vote watcher-dashboard 14:41:55 #vote watcher-ui :p 14:41:55 #vote watcher-ui 14:41:56 jed56: watcher-ui :p is not a valid option. Valid options are watcher-ui, watcher-dashboard, dont, care. 14:41:59 #vote watcher-dashboard 14:42:03 #vote watcher-ui 14:42:13 #vote watcher-dashboard 14:42:26 #showvote 14:42:27 watcher-dashboard (6): bzhou, vincentfrancoise, sballe, acabot, edleafe, brunograz 14:42:28 watcher-ui (3): tpeoples, dtardivel, jed56 14:42:35 #vote watcher-ui 14:42:43 dashboard it is 14:42:48 :) 14:42:50 #endvote 14:42:51 Voted on "Watcher UI name ?" Results are 14:42:51 even with fhermeni ^ 14:42:52 watcher-dashboard (6): bzhou, vincentfrancoise, sballe, acabot, edleafe, brunograz 14:42:54 watcher-ui (4): tpeoples, dtardivel, jed56, fhermeni 14:43:10 lets go with watcher-dashboard 14:43:12 thx 14:43:15 good luck dtarvidel for the refactoring ! 14:43:22 haha 14:43:25 ups! 14:43:29 I was in your side :p 14:43:30 jed56: :( 14:43:40 :D 14:43:46 dtardivel: sorry about that :( 14:44:18 #info bugs status for mitaka-2 https://launchpad.net/watcher/+milestone/mitaka-2 14:44:55 we should freeze mitaka-2 around January 20th 14:45:38 #info we will need someone on this one https://bugs.launchpad.net/watcher/+bug/1527189 14:45:39 Launchpad bug 1527189 in watcher "Update the documentation to explain how to change the ceilometer API backend" [High,New] 14:46:23 #topic Open Discussion 14:46:31 14 minutes left 14:46:47 Can we talk about the talk submisisons 14:46:50 Proposed talks are still in review https://etherpad.openstack.org/p/Watcher_abstracts_austin2016 14:47:00 and sballe wants to submit them asap 14:47:14 can we submit them by end of week ? 14:47:41 I just need the email addresses people use with openstack. 14:47:48 please add them to the etherpad 14:48:05 ok 14:48:20 global requirements https://bugs.launchpad.net/watcher/+bug/1533282 14:48:21 Launchpad bug 1533282 in watcher "Watcher should use openstack global requirements" [Undecided,New] - Assigned to Taylor Peoples (tpeoples) 14:48:21 Who else should be onthe "Watcher a Resource Manager for OpenStack: Plans for the N-release and beyond" talk 14:48:30 I have acabot, jwcroppe and sballe 14:48:42 i'd be interested in talking for the demo regarding devstack sballe 14:49:09 tpeoples: put your name on the hands-on lab 14:49:16 +1 14:49:27 alright 14:49:43 dtardivel and I discussed yesterday and agreed that we should be included in openstack/requirements project 14:49:45 for the hands on we will need more people to help. 14:49:56 which basically makes sure our requirements are always in sync with openstack 14:50:02 's global requirements 14:50:11 +1 14:50:15 but it looks like we'll need to move our requirements to master, not liberty 14:50:18 are we OK with that? 14:51:01 what are the difference ? 14:51:06 the version are more updated ? 14:51:11 just different versions essentially 14:51:31 i can change them locally and do a smoke test and make sure nothing major is broken 14:51:36 tpeoples: what is the risk ? :) 14:51:40 acabot: tpeoples I'll check on the status of the etherpad on friday and submit EOD friday. ok? 14:51:50 nothing really, i think we need to do it dtardivel 14:51:57 so i'll move forward 14:52:03 acabot: Can you add jed56 or dtardivel to the hands on lab? 14:52:03 sballe: submit 2 talks for the summit before friday EOD 14:52:54 tpeoples: +2 14:52:57 sballe: not clear about how many people we will have at the summit 14:53:39 any other discussion ? 14:54:35 acabot: understood. In the past various companies were only sending people ot Openstack that had a talk so this is why I have been pushing for adding people :) 14:54:49 cdupont : do you think we could add btrPlace as a new strategy in Watcher ? 14:54:57 sballe: thats a good way to do ;-) 14:55:09 I think so 14:55:13 Rackspace and HP are operating taht way 14:55:26 and I believe so is Intel 14:55:36 fhermeni might also have an opinion on that 14:56:01 but we need to translate the Nova constraints to BtrPlace constraints 14:56:07 cdupont fhermeni : would you be interested in working on this ? 14:56:45 acabot: it would be great but on my side, it is too soon. I am working on the scheduler spec for the moment 14:56:46 Actually in CN the next months will be very hard 14:56:52 cdupont : yes, we need to solve the constraints pb before but as btrPlace is in Java, it will take time to have it in Python 14:57:05 yes 14:57:35 acabot: I will have agenda issues as well :D. I will first make BtrPlace compatible with the spec language for fun for the moment 14:57:36 cdupont : it was a suggestion 14:57:50 fhermeni : ok ths 14:58:26 acabot: so I can work at spec level but implementation is not possible at the moment for resource reasons :( 14:58:57 cdupont : thx 14:59:08 time to end the meeting 14:59:12 thanks everyone 14:59:18 bye 14:59:20 thanks, bye! 14:59:24 bye thx 14:59:26 bye 14:59:35 #endmeeting