16:00:27 #startmeeting Solum Team Meeting 16:00:28 Meeting started Tue Jun 3 16:00:27 2014 UTC and is due to finish in 60 minutes. The chair is adrian_otto. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:29 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:32 The meeting name has been set to 'solum_team_meeting' 16:00:35 https://wiki.openstack.org/wiki/Meetings/Solum#Agenda_for_2014-06-03_1600_UTC Our Agenta 16:00:43 #topic Roll Call 16:00:45 Adrian Otto 16:00:46 Paul Montgomery 16:00:48 Chris Alfonso 16:00:53 Julien Vey 16:00:59 tom blankenship 16:01:08 Devdatta Kulkarni 16:01:18 Pierre Padrixe 16:01:45 Ravi Sankar 16:01:54 murali allada 16:01:55 Ed Cranford 16:02:42 cz was double-booked and won't make this meeting today 16:02:47 welcome everyone 16:02:53 thanks datsun180b 16:02:59 Hello all 16:03:04 I am happy to have your original nick back! 16:03:16 hello iqbalmohomed 16:04:01 ok, let's begin with announcements. Anyone else who has not chimed in may feel free to chat us at any time to be recorded in attendance. 16:04:17 #topic Announcements 16:04:33 ok, first of all, we extend our gratitude to Anita Kuno who agreed to serve as our election official 16:05:27 you may be pleased that in accordance with our ratified election rules, no further action is required for an election this cycle, as no new candidates for the PTL position were declared. 16:05:42 I will serve as your PTL for this cycle. 16:06:21 congrats adrian_otto 16:06:27 I will re-open candidacy when the Juno cycle comes to a close. 16:06:46 adrian_otto: congrats and thanks for performing this role for the project! 16:07:09 thanks everyone for your support. I am very proud of the work we do here, and am humbled to be a part of it. 16:07:22 next up, action items. 16:07:29 #topic Review Action Items 16:07:38 asalkeld follow up with keystone team by ML, and IRC (as needed) to explore options for multi-service trust tokens, OAuth, or chaining, and finding the right fit for Solum. 16:07:46 I did see an email thread about this. 16:07:51 yes, http://lists.openstack.org/pipermail/openstack-dev/2014-June/036490.html 16:08:10 it seems we will have to go with chained trusts in keystone 16:08:16 but it is not implemented yet 16:08:18 #link http://lists.openstack.org/pipermail/openstack-dev/2014-June/036490.html ML Discussion about Trust Tokens 16:08:27 thanks julienvey for the link 16:08:47 ok, I think I saw a review in the queue for something about OAuth 16:08:56 yes, I abandonned that 16:09:06 I'm pretty sure I down-voted that awaiting an outcome from this discussion. 16:09:11 ok, thanks julienvey 16:09:39 I think steve from the heat is working with the keystone guys to have chained trusts between services 16:09:41 do we have an expected timeframe for chained trusts? Are we able to contribute that, or is it happening regardless? 16:10:11 I will ask angus or steve if there is a blueprint or a bug open about that 16:10:14 ok, julienvey are you willing to reach out to him a few times this week to see if there is anything we can do to help? 16:10:20 and if someone is working on that 16:10:30 adrian_otto: sure 16:10:40 I'm pretty interested in these discussions as well. 16:10:40 would you accept that as an action item? I see this as a high priority matter for us. 16:10:53 yes 16:11:32 #action julienvey to follow up with Heat contributors about Keystone chained trusted tokens, to offer our support. Include Solum Stackers in discussions. 16:11:38 ok, awesome, thanks for that. 16:12:04 next we have a bunch of topics relating to our top areas of development focus 16:12:23 I'd like us to timebox each of these so we have time to at least touch on each. 16:13:02 we do not need implementation plan perfection today, but at the very least subgroups of us who are interested, or who we know we can include to drive forward progress on each. 16:13:08 here we go... 16:13:24 #topic Mistral Integration Discussion (target 10 min discussion) 16:13:36 devkulkarni: this was from you 16:13:47 we have three links to share: 16:13:50 this is progressing along. datsun180b and asalkeld made headways into this 16:14:03 actually two 16:14:04 #link https://blueprints.launchpad.net/solum/+spec/pipeline Pipeline Blueprint 16:14:12 #link https://bugs.launchpad.net/solum/+bug/1322748 Initial Mistral Feature Task 16:14:18 feel free to add other references 16:14:39 asalkeld has series of patches integrating mistral and pipeline resources 16:14:53 datsun180b will be able to provide more updates 16:14:59 ok, what key issues are open that we can offer guidance about? 16:15:26 so one key issue is whether to expose the mistral dsl to app developers 16:15:38 datsun180b: anything potentially controversial? 16:15:40 oh the majority of what i accomplished is just getting mistral into our vagrant env 16:15:45 my impression is mistral dsl is still too level and we should not expose that to the app developers 16:15:55 devkulkarni: yes, the dsl is a good one to cover. 16:15:57 thoughts? 16:16:12 if I may summarize that one for the others here today 16:16:25 please do adrian_otto. that will be helpful 16:16:26 +1 devkulkarni we need a simpler DSL to be exposed to the end user 16:16:27 devkulkarni: you think solum should act as a dsl on top of mistral's dsl ? 16:16:29 I think we should not expose the mistral dsl to end users. 16:16:31 Don't expose Mistral DSL to users directly. It would make switching out workflows really difficult later unless we accept Mistral DSL as the language for Solum workflow forever. 16:16:32 we intend to use Mistral as the backend our first implementation of Pipelines 16:16:53 it has a DSL, but we think it might be best not to expose that directly, in the interest of keeping the user experience very simple 16:17:01 Not exposing the DSL also lets people use a different workflow engine 16:17:15 we will link through to the mistral resources, so if someone is so inclined as to interact with the mistral service, they can customize those workflows there. 16:17:22 +1 iqbalmohomed 16:17:22 iqbalmohomed: exactly. 16:17:34 +1 iqbalmohomed 16:17:42 julienvey: thoughts? 16:17:51 but the overall intent here is to make something useful for the general case without complicating the UX 16:18:04 having a dsl over the mistral dsl would require a lot more work on our side 16:18:14 in the long term, it's good 16:18:35 but we could start with angus' way of dealing with it 16:18:44 having a workbook url in the pipeline 16:19:17 so I am thinking that the dsl that we come up with is more about describing the pipeline 16:19:33 http://workflowpatterns.com/evaluations/standard/index.php might be useful if we want to partially adopt a standard. 16:19:34 it can refer to existing workbooks 16:20:02 that is huge listing paulmo. 16:20:06 devkulkarni: good idea 16:20:10 gut reaction is NO :) 16:20:18 such as heat templates can reference another heat template 16:20:28 yep 16:20:53 yep I also like it 16:21:19 do we want to get an agreed on this or think it over a bit and revisit next time again? 16:21:30 I think there is a way for us to allow for workflows to be tweaked without making a comprehensive DSL 16:22:05 so to the extent that is practical, I suggest that as our direction, and we can continue to revisit this as we learn more. 16:22:10 sound fair? 16:22:29 +1 16:22:38 and there would be no need to adopt the Mistral DSL until we had such a discussion 16:22:59 agree 16:23:01 ok, any more thoughts on this before we advance to the next tpic? 16:23:18 next... 16:23:23 #topic Custom Language Pack Discussion 16:23:31 #link https://blueprints.launchpad.net/solum/+spec/auto-select-lang-pack 16:23:45 • #link https://blueprints.launchpad.net/solum/+spec/custom-language-packs Custom Language Pack Blueprint 16:23:50 So noorul, adrian_otto have been brainstorming about what do we mean by custom lang packs 16:24:48 in my mind there are three kinds of lang packs — 1) provided by operator 2) lang packs/build packs belonging to other PaaS systems that we can support in Solum 3) lang packs that an app developer wants to create with custom libraries (e.g. chef testing tools) 16:25:15 devkulkarni: what's the difference between 1 and 2 ? 16:25:18 I want to hear what you all think about this topic? 16:25:30 We have at least two options for how we define the LP itself. 1) The LP is just an image in glance, done. 2) The LP may leverage an existing image, but add a git-repo to use as an external build-pack (approach consistent with Heroku and Cloud Foundry) 16:25:37 would cedarish fit into 1 or 2 ? 16:25:38 the two are not mutually exclusive 16:25:47 operator may provide some base lang packs which may or may not be compatible with other systems 16:25:49 cedarish would be #2 in my list 16:25:50 It seems 2 would go into bucket 1 or 3? 16:25:54 I think cedarish is 2 16:26:20 I think 2 can fit into 1 16:26:30 yes 16:26:36 cedarish is a "multi-language" LP 16:27:03 sure 16:27:13 so perhaps we start out with the #1 definition type, and then plan to expand that to add git-repo plugin capability to allow Solum users to extend it. 16:27:34 and operators can decide whether to include the images that contain the hooks for that extensibility 16:27:46 hooks are a good idea 16:27:49 adrian_otto: your definition of LP is not complete in the sense that #1 will be required no matter what 16:27:57 ok, any alternate points of view to consider here? 16:28:15 #1 is what we actually have to do for any LP to be supported via Solum 16:28:26 so that is not really a defining characteristic of a LP imo 16:28:34 devkulkarni: #1 is required. The question is whether to have #2 as well. 16:28:47 exactly 16:28:53 we agree 100%. 16:29:14 and the discussion at least to me is what are conceptually options available for #2 16:29:30 so I suppose I cold ahve framed the options as (1), or (1+2) 16:29:45 the proposed git repo hook approach — that would cover app developers specifying their required libs etc. 16:30:05 would that be similar to heroku's buildpacks? 16:30:09 would that also cover mechanisms in solum to support LPs/build packs from other PaaSes 16:30:21 the remote repo does a bit more as well, allowing the actual build execution logic to be adjusted. 16:30:23 or that could be a separate discussion 16:30:30 because alternate scripts could be provided. 16:30:42 this is via git execution hooks? 16:30:52 i think the example for (2) is adding the .net capability to cedarish. Am I right ? 16:30:53 so I don't hear any argument against using both approaches 16:31:08 julienvey: yes, that's a perfect example 16:31:20 I'd like to be able to allow a user to add that without a code patch to solum :-) 16:31:55 adrian_otto: +1 on using both approaches 16:32:12 yes, and hooks (in solum) to add capabalities would be an elegant way of dealing with it, imo 16:32:34 ok, hold on, lets reiterate what the two approaches are. 16:32:47 I see only only approach — git hooks 16:32:50 what is the other approach? 16:33:03 images in glance? 16:33:04 saving LP in glance is not an approach 16:33:15 that is required no matter what 16:33:26 devkulkarni: I don't understand what you mean by git hooks 16:33:37 we are talking about customizing language packs 16:33:52 we need approaches to do that .. the end result will go in glance no matter what 16:34:01 sure 16:34:26 the extensibility point will be a way to indicate that a build should consult the content in an external git repo that contains a build pack (compatible with Heroku and CF) 16:34:34 one approach that is coming up, as suggested by adrian_otto, is to use custom repo with git hooks (paraphrasing — could be wrong) 16:34:38 that could be a parameter, or metadata, etc. 16:34:54 it's not exactly a hook 16:35:03 thanks for clarification adrian_otto 16:35:08 just an external reference of where to get plugin code to adapt the build processing 16:35:37 ok, I think that was the confusion point 16:35:42 i was thinking since CF and Heroku build packs are already there with an ecosystem 16:35:54 wouldn't it make sense to base our definition on those 16:35:59 rather than trying to build a new one 16:36:13 rajdeep: but they are not same, or are they? 16:36:20 I think it's time to record this in a task ticket, possibly linked to a wiki that can exhibit a simple block diagram to express the concept. 16:36:26 they are mostly 16:36:35 Cf is based on heroku build packs 16:36:51 what about OpenShift cartridges? 16:36:59 we also have a task that would allow compatibility with Openshift Catridges too 16:37:06 that's already on the wishlist 16:37:12 infact CF team introduced them later as it was the best way to introduce a new platform 16:37:19 but let's walk before we run. 16:37:25 how will this approach help the user to create his own language pack? 16:38:09 so that is other other category (#3) that I had in mind 16:38:18 aratim: as an end user I can post my custom build scripts in a git repo, and pick an LP entry that uses an image that will take my repo as a parameter/metadata and download it (as needed) and use it to run the build 16:38:19 which I think will be addressed by the custom repo approach 16:38:23 suggested by adrian_otto 16:39:08 yeah, that should work 16:39:10 ok, let's wrap up on this one and move to the next 16:39:14 adrian_otto: yeah makes sense 16:39:34 devkulkarni: are you willing to take an action item to work with me on this to clearly document the approach and how it addresses each use case? 16:39:42 sure adrian_otto 16:39:50 lets do it 16:40:18 #action devkulkarni to work with adrian_otto to document the LP devleopment approach in BP+task+wiki to clearly outline our approach, and how it solves each use case. 16:40:43 and we will take input from anyone who is willing to review this, and add remarks 16:40:55 next, we have... 16:40:58 #topic Source to Image Pipeline Discussion 16:41:20 muralia has the latest on the pipeline -> plan discussion 16:41:36 We touched on this last week, but did not have time to explore nova-docker enhancements 16:41:48 there is a google doc with some approaches. I'm going ot move these comments to the blueprint. 16:41:54 https://docs.google.com/document/d/1a0yjxKWbwnY7g9NZtYALEZdm1g8Uf4fixDZLAgRBZCU/edit?pli=1# 16:42:27 muralia: I have the Solum Spec repo further down in the agenda 16:42:37 ok. 16:42:46 okay, so about nova docker improvements.. 16:42:53 once we open that, let's put the GoogleDoc content into RST and post it there for review. 16:42:53 we touched upon it last time. 16:43:16 the questions that I had (which we touched upon last time), was what are the exact things needed from us for that 16:44:29 that=nova-docker? 16:44:36 yes 16:44:41 glance integration 16:44:45 nova docker driver improvements 16:44:50 needs a multi-tenant solution 16:45:18 so rather than interfacing through docker to docker-registry to glance, we can just integrate directly with glance 16:45:36 and that approach works as a first iteration workaround 16:45:50 yeah, that should be helpful 16:45:55 then we can explore the future of docker-registry with the #nova-docker team 16:46:24 we did discuss that subject in Atlanta, and it appears to have non-technical aspects to motivating the stakeholders 16:46:56 this is something that the #openstack-containers team can deal with. 16:47:07 cool.. I guess my questions were more from the Juno-1 feature list (this is listed in Juno-1) 16:47:36 do you think nova docker driver improvements should be in Juno-1 or could they be moved out? 16:47:53 yes, bypassing nova-docker's use of docker-registry will suit our near term needs 16:48:12 and fixing docker-registry can be deferred as needed. 16:48:25 Anyone disagree? 16:48:50 should we collect our requirements in a single place/document, prioritze them, identify any must have features for Solum juno release, etc? 16:48:50 I guess we need time to think :) 16:48:55 ok, let's advance to our last couple of topics. These should be short. 16:49:03 #topic Review Tasks 16:49:09 I don't see why this is in our roadmap, it's a dependency we have on nov-docker, like we have on heat or mistral 16:49:15 I am doing some housekeeping on this: 16:49:33 #link https://launchpad.net/solum/+milestone/2014.1.2 16:49:45 I plan to tag this release today or tomorrow 16:49:55 julienvey: same thoughts here 16:49:59 I am moving everything that's not fix released to juno 16:50:25 and pulling everything in juno that is fix-released into 2014.1.2 16:50:42 so expect to see that shuffling in our tasks and BPs 16:50:54 any concerns with this? 16:51:07 I'd like to also lock down our demo to using the tagged release 16:51:14 so it's not a moving target 16:51:27 +1 to locking down demo to a tagged release 16:51:35 Yeah, +1 to that as well 16:51:36 I can tag releases as often as we need to in order to make changes to the demo setup 16:52:09 #agreed we will adjust our demo environment to use the upcoming 2014.1.2 release, and update to newer releases as needed. 16:52:17 ok, last agenda item 16:52:23 (next to last) 16:52:29 #topic Solum Spec Repo 16:53:06 I am planning to start a new code repository that will hold RST files of our specifications. The porpose of this is to allow for review of our design plans in the same way we do code reviews 16:53:17 the same reviewers will be attached to this repo 16:53:43 I think this will be helpful.. at least instead of googledocs 16:53:54 muralia will place our design work there, and we can more easily source input and have debate on items where we disagree 16:53:55 that will be very useful 16:54:10 +1 16:54:11 ok, so I will give you a heads up on the ML once that merges 16:54:15 +1 to this idea; btw, http://rst.ninjs.org/ might be useful for editors and such 16:54:15 is there a way to timebox the review period? 16:54:33 we can try that out, and switch to something else later if we don't find it useful 16:54:39 is there a need to timebox review period? 16:54:43 the Keystone team has used this approach successfully 16:55:00 devkulkarni: we can do that as needed 16:55:15 that's something we can certainly negotiate on an ML thread per design 16:55:16 devkulkarni: sometimes, I think it would be useful. 16:55:30 adrian_otto: +1 16:55:33 I agree that having a deadline on something can help us focus on key issues 16:55:38 will we have to post all our design there or only high-level features ? 16:55:42 not every design needs a deadline 16:55:56 but ones that are critical to our Juno milestones should 16:56:16 julienvey: we can use our discretion 16:56:18 adrian_otto: again, agree... 16:56:26 let's use it to see if it helps 16:56:38 I also like the timebox idea in that we can define a minimum review time to give folks in various time zones a fair chance. 2 days minimum I would think. 16:56:44 and we can adjust as needed.. 16:56:46 btw, kgriffs warned about the design process getting heavy handed .. take a look at this email on marconi 16:57:12 *his 16:57:36 thanks devkulkarni. We can take that as an opportunity to learn from our peers. 16:57:49 devkulkarni: do you have a link ? 16:58:00 paulmo: +1 16:58:07 I will also offer myself as a release valve if any of our contributors are not comfortable with any design proceedings, please see me about it so I can work to address those concerns for you. 16:58:09 will send it to you julienvey (don't have it handy) 16:58:22 it was sent couple of days back 16:58:24 #topic Open Discussion 16:58:29 2 mins remaining. 16:59:38 have we done customer validation of features being built for solum 16:59:46 thanks everyone for attending today. Next week we should have a shorter agenda, so not quite as rushed. 17:00:08 rajdeep: we would love more! 17:00:13 #endmeeting