18:05:50 <SergeyLukjanov> #startmeeting savanna
18:05:50 <openstack> Meeting started Thu Aug  8 18:05:50 2013 UTC and is due to finish in 60 minutes.  The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:05:51 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
18:05:53 <openstack> The meeting name has been set to 'savanna'
18:05:56 <_tmckay> I am not here :)  jk
18:06:27 <SergeyLukjanov> are there anyone from Hortonworks?
18:07:12 <SergeyLukjanov> let's wait for several minutes
18:08:37 <SergeyLukjanov> #topic Agenda
18:08:37 <SergeyLukjanov> #info News / updates
18:08:37 <SergeyLukjanov> #info Roadmap cleanup / update
18:08:37 <SergeyLukjanov> #info Action items from the last meeting
18:08:37 <SergeyLukjanov> #info General discussion
18:08:58 <SergeyLukjanov> #topic News / updates
18:09:53 <SergeyLukjanov> the only update from me is that we are working on finalizing conductor module
18:10:26 <SergeyLukjanov> what's about EDP news?
18:10:56 <tmckayrh> small news, I should have a commit for job origin REST api today, and hopefully database objects tomorrow
18:11:11 <tmckayrh> maybe implementation of "get" to hdfs early next week...
18:11:13 <SergeyLukjanov> tmckayrh, great!
18:11:21 <aignatov_> that's great, tmckayrh
18:11:28 <tmckayrh> you're too kind :)
18:11:29 <crobertsrh> I have some dummy skeleton impl done for the EDP UI.  I'll be tweaking the forms over the next few days.
18:11:52 <aignatov_> I have one question for all edp mates: did we agree to use savanna sql db to store binaries?
18:11:59 <akuznetsov> for EDP we add a model not it is on review
18:12:06 <aignatov_> in Joborigin I  mean
18:12:23 <akuznetsov> #link https://review.openstack.org/#/c/40227/
18:12:35 <SergeyLukjanov> want to ask everyone to split big changes to small ones
18:12:43 <akuznetsov> also we start working on conductor layer for EDP
18:13:04 <akuznetsov> #link https://review.openstack.org/#/c/40591/
18:13:07 <aignatov_> also I have one patch on the review to creating map-reduce workflow.xml
18:13:17 <tmckayrh> aignatov_, yes, I think we agreed to look at savanna db storage for binaries to support sites that don't have swift
18:13:32 <tmckayrh> aignatov_, I can pursue that first...
18:13:42 <aignatov_> great, thx
18:13:51 <akuznetsov> now we have two workflows one for pig and classic for jar files
18:13:59 <SergeyLukjanov> let's move edp to separated section
18:14:05 <SergeyLukjanov> only news here, please
18:14:21 <aignatov_> #link https://review.openstack.org/#/c/40590/
18:14:38 <SergeyLukjanov> are there any other updates on edp?
18:15:10 <SergeyLukjanov> mattf, are there any news about savanna in fedora?
18:15:46 <mattf> anyone have opinions about giving savanna-api it's own uid/gid?
18:15:54 <mattf> s/it's/its/
18:16:10 <SergeyLukjanov> mm, nope :)
18:16:29 <mattf> fedora has two options for user/group, you can be added to the setup rpm and have a static id in /etc/passwd|groups, or you can have a dynamic id created when the package is installed.
18:16:51 <SergeyLukjanov> mattf, I think static one could be helpful
18:17:05 <mattf> i'm honestly ambivalent when it comes to using a static uid/gid. the package reviewer would like a static one to go along with other static ids for openstack components.
18:17:18 <mattf> how would a static one be helpful?
18:18:21 <SergeyLukjanov> mattf, no ideas now, just I think that it would be no worse than dynamic ones
18:18:51 <SergeyLukjanov> mattf, btw have no expertise in areas around this topic
18:19:03 <mattf> my trajectory is to say we'll be dynamic for now, static if we find a specific need in the future. the fedora folks are sticklers when it comes to handing out static ids.
18:19:43 <mattf> i do. typically shared files across a network filesystem need static ids.
18:19:43 <SergeyLukjanov> mattf, yep, I think it's reasonable, agreed
18:19:54 <aignatov_> I think, mattf, you only know the best way how to do that in a right way :)
18:19:57 <mattf> but the savanna-api service should be able to operate on local files
18:20:24 <mattf> in any event. sounds like we're all kinda ambivalent. let's move on.
18:20:31 <SergeyLukjanov> yep
18:20:41 <SergeyLukjanov> are there any other updates?
18:21:29 <SergeyLukjanov> ok, next topic
18:21:31 <SergeyLukjanov> #info Roadmap cleanup / update
18:21:41 <mattf> #link https://wiki.openstack.org/wiki/Savanna/Roadmap
18:21:57 <SergeyLukjanov> we have several discussions about it and decided to update it with bps
18:22:42 <SergeyLukjanov> additionally, we decided to update it by discussions on our weekly irc meetings
18:22:55 <SergeyLukjanov> so, the question is
18:23:04 <SergeyLukjanov> are there any missed points in bp?
18:23:21 <rnirmal> so as far as roadmap is concerned I have some comments and concerns about the current api
18:23:51 <rnirmal> I haven't gotten to documenting it all but want to discuss it sooner rather than later
18:24:19 <mattf> i'm comfortable w/ the roadmap items for this week. i do think we should keep buckets for the next two releases on the roadmap, e.g. 1.0 and 1.1 since we're working on 0.3
18:24:54 <SergeyLukjanov> mattf, yes, I think it'll be good
18:24:54 <aignatov_> do we plan to move from 0.3 right to 1.0,1.1?
18:25:13 <mattf> aignatov_, that's pretty much what the roadmap says
18:25:30 <aignatov_> ok))
18:25:42 <SergeyLukjanov> I think that it'll be clear in sep-oct, because maybe it'll be better to use icehouse-1, icehouse-2 releases and etc.
18:26:14 <SergeyLukjanov> additionally, I'm proposing the roadmap style update
18:26:25 <SergeyLukjanov> here is a draft of it - https://wiki.openstack.org/wiki/Savanna/RoadmapNew
18:26:32 <SergeyLukjanov> (for only 0.3 section)
18:27:13 <SergeyLukjanov> the contents section will display some main goals and in each section we can add small description and links to bps
18:27:22 <SergeyLukjanov> any concerns?
18:27:57 <mattf> overkill imho. if we have roadmap items link to relevant BPs, we don't necessarily need to list out each sub bullet.
18:28:12 <jmaron> +1
18:28:30 <mattf> i'm a fan of keeping the roadmap as high level highlights, very lightweight
18:28:39 <SergeyLukjanov> I mean that we can have a description if it's needed and we'll a place to list links to bps
18:29:02 <rnirmal> I'd think just having the blueprints marked for a service should be more than enough
18:29:08 <rnirmal> service/series
18:29:15 <SergeyLukjanov> ok, sounds reasonable to keep it lightweight
18:29:34 <mattf> ex: Enhanced scalability through scale-out architecture (bp1) (bp2)
18:29:40 <SergeyLukjanov> so, just list bps under the each item
18:29:47 <mattf> if there are 5 bps, then have a bp to aggregate
18:30:05 <SergeyLukjanov> ok, lgtm
18:30:12 <SergeyLukjanov> any other comments / thoughts?
18:30:38 * mattf shakes
18:31:02 <SergeyLukjanov> #action aignatov to update edp-related part of roadmap (cleanup, add links to bps)
18:31:22 <SergeyLukjanov> #action slukjanov to update architecture-related part of roadmap (cleanup, add links to bps)
18:31:34 <aignatov_> ok. will do
18:32:15 <SergeyLukjanov> #info Update roadmap with links to bps, if there are 5 bps, then have a bp to aggregate [ex: Enhanced scalability through scale-out architecture (bp1) (bp2)]
18:32:32 <SergeyLukjanov> ok, next topic
18:32:32 <SergeyLukjanov> #topic Action items from the last meeting
18:32:40 <mattf> btw, 5 was arbitrary. use good judgment.
18:33:18 <SergeyLukjanov> 1. _crobertsrh create blueprint for EDP Horizon dashboard (since Robert is working on UI part)
18:33:50 <tmckayrh> crobertsrh, ^^
18:33:55 <SergeyLukjanov> 2. akuznetsov will rename the Job Source Component to Job Origin Component
18:34:01 <SergeyLukjanov> 2. tmckayrh will make a blueprint for an uncompiled source code management component
18:34:06 <SergeyLukjanov> 4. tmckayrh will update sequence diagrams and etherpad to show proper flow and the rename of Job Source Component to Job Origin Component
18:34:14 <crobertsrh> I did that...looking for link now
18:34:21 <tmckayrh> 3 and 4 done
18:34:24 <aignatov_> #link https://blueprints.launchpad.net/savanna/+spec/edp-savanna-dashboard-ui
18:34:33 <SergeyLukjanov> guys, if action items was completed, please ack it and publish links (if needed)
18:35:07 <aignatov_> my link was from crobertsrh
18:35:11 <tmckayrh> https://blueprints.launchpad.net/savanna/+spec/edp-job-build-component
18:35:32 <tmckayrh> https://wiki.openstack.org/wiki/Savanna/EDP_Sequences
18:35:38 <crobertsrh> thanks aignatov_
18:35:57 <SergeyLukjanov> akuznetsov?
18:36:43 <aignatov_> if we are talking about corresponding bp
18:36:46 <aignatov_> it's here
18:36:48 <tmckayrh> https://blueprints.launchpad.net/savanna/+spec/edp-job-origin-component
18:36:51 <aignatov_> #link https://blueprints.launchpad.net/savanna/+spec/edp-job-origin-component
18:36:57 <SergeyLukjanov> ok, thanks
18:37:04 <SergeyLukjanov> great, looks like all action items resolved
18:37:08 <akuznetsov> yes I renamed this blueprint and made correction
18:37:14 <tmckayrh> ah, I forgot the pound link.  Should I repaste?
18:37:36 <Nadya_> no
18:37:39 <SergeyLukjanov> yep
18:37:50 <tmckayrh> lol, which is it?
18:37:51 <aignatov_> no or yep? :)
18:37:54 <Nadya_> ^)
18:38:05 <tmckayrh> ok, I will repaste....
18:38:05 <SergeyLukjanov> tmckayrh, please, repost them with #link ...
18:38:18 <SergeyLukjanov> tmckayrh, thx, it's needed to add them to meeting minutes
18:38:19 <Nadya_> it is not needed to add #link if message contains http
18:38:49 <tmckayrh> #link https://blueprints.launchpad.net/savanna/+spec/edp-job-build-component
18:39:04 <tmckayrh> #link https://wiki.openstack.org/wiki/Savanna/EDP_Sequences
18:39:08 <tmckayrh> for sure then :)
18:39:15 <SergeyLukjanov> tmckayrh, thx!
18:39:18 <SergeyLukjanov> #topic General discussion
18:39:39 <Nadya_> may I begin?
18:39:44 <SergeyLukjanov> yes, sure!
18:39:57 <Nadya_> I have one question about oozie+hive. Is it the normal case to start hive as a separate service and  use it during oozie's workflow running? We have some conserns about it: it is not clear how to run  metastore server and is it really needed? Maybe someone has an expertise in it?
18:41:25 <Nadya_> I'm going to send the question on mail-list. but maybe someone is already here :)
18:41:31 <rnirmal> hmm not sure don't think I've ever tried it without the metastore
18:42:09 <aignatov_> Since Oozie already  has some Hive libs it may work witout separate hive service
18:42:17 <aignatov_> in my opinion)
18:42:51 <aignatov_> i may be wrong
18:42:58 <aignatov_> anyway we should check it
18:43:14 <rnirmal> so those are listed as optional components
18:43:45 <akuznetsov> possible if we deal we external data we should use a external metastore
18:43:46 <Nadya_> what is listed as optional?
18:43:55 <rnirmal> metastore server
18:44:08 <Nadya_> really? interesting...
18:44:34 <Nadya_> ok. Let's continue discussions in mailing list
18:44:43 <rnirmal> yep
18:46:00 <SergeyLukjanov> ok, are there any other questions to discuss?
18:46:12 <rnirmal> so I wanted to briefly talk about the current api
18:46:14 <mattf> #idea we should setup a Savanna PTL election
18:46:59 <mattf> obviously not official w/i openstack, but an elected representative for the savanna community
18:47:22 <mattf> the person should function as if they were an official openstack ptl, including attending tc meetings etc
18:47:27 <mattf> thoughts?
18:47:54 <SergeyLukjanov> mattf, is there any sense to make it before incubation?
18:48:36 <mattf> for one, well the incubation request needs to specify a ptl
18:49:00 <SergeyLukjanov> btw tc will be reelected soon and we'll not automatically contain all ptls
18:49:04 <mattf> we can also follow the standard OS process here and demonstrate our commitment and ability to fit into it
18:49:13 <SergeyLukjanov> (afaik in sep)
18:50:12 <Nadya_> Is it time to choose :)?
18:50:35 <Nadya_> or there will be a separate meeting?
18:50:51 <mattf> if we think it's a good idea. i'm happy to go off and make a proposal for how we'd go about it.
18:50:55 <IlyaE> +1 for following OpenStack process
18:51:18 <mattf> i've only lightly reviewed how it has happened in the past, but deciding now is probably not the way to go.
18:51:19 <IlyaE> I think this is a good idea
18:51:33 <SergeyLukjanov> mattf, we can follow the OS-style electing process
18:51:45 <mattf> SergeyLukjanov, that would be best
18:52:05 <SergeyLukjanov> mattf, I mail ttx about it
18:52:07 <mattf> is anyone already familiar with how that election process works?
18:52:13 <aignatov_> I like the idea to have ptl election
18:52:34 <rnirmal> nope but we can find out from newly incubated projects like trove
18:53:05 <rnirmal> mattf: if you're interested talk to hub_cap on #openstack-trove
18:53:07 <aignatov_> also we should have core team elecations
18:53:15 <aignatov_> *elections
18:53:22 <SergeyLukjanov> mattf, I read the doc about elections several days ago and mail ttx about it to ensure
18:53:27 <hub_cap> heyo
18:53:32 <IlyaE> https://wiki.openstack.org/wiki/Governance/TieBreaking
18:53:44 <hub_cap> feel free to chat w me mattf
18:53:55 <mattf> hub_cap, will do
18:54:04 <mattf> SergeyLukjanov, will yuo cc me on the ttx thread?
18:54:43 <SergeyLukjanov> mattf, ok
18:55:17 <mattf> sounds like no objections. i'll take the action to come back next week w/ a more formal proposal.
18:55:24 <SergeyLukjanov> hub_cap, please, could we talk about elections after the meeting?
18:55:27 <SergeyLukjanov> in some channel
18:55:36 <hub_cap> sure i can join your channel,
18:55:39 <hub_cap> just tell me where to go
18:55:42 <mattf> we're #savanna
18:56:18 <SergeyLukjanov> #action slukjanov to prepare ptl / core team elections proposals
18:56:55 <mattf> ?
18:57:11 <SergeyLukjanov> mattf, oops, missed your msg
18:57:23 <SergeyLukjanov> #action mattf, slukjanov to prepare ptl / core team elections proposals
18:57:31 <mattf> ok
18:57:48 <hub_cap> you can #undo things too
18:57:52 <hub_cap> if you make a mistake
18:58:04 <hub_cap> and it will remove them so you dont have > 1 of the same #action
18:58:14 <hub_cap> :D
18:58:19 <SergeyLukjanov> let's try it
18:58:19 <mattf> how how?
18:58:36 <SergeyLukjanov> hub_cap, could it be done twice?
18:58:52 <hub_cap> yes
18:58:53 <SergeyLukjanov> #undo
18:58:53 <openstack> Removing item from minutes: <ircmeeting.items.Action object at 0x24e7dd0>
18:58:54 <hub_cap> try it
18:58:56 <SergeyLukjanov> #undo
18:58:57 <openstack> Removing item from minutes: <ircmeeting.items.Action object at 0x24e7050>
18:59:01 <hub_cap> now redo
18:59:12 <SergeyLukjanov> #action mattf,slukjanov to prepare ptl / core team elections proposals
18:59:31 <mattf> SergeyLukjanov, imho, it's better if you just assist w/ the proposals
18:59:32 <rnirmal> nice that's nifty
18:59:36 <hub_cap> yar
19:00:23 <mattf> in any event, we've successfully consumed all the time for api discussion. sorry. continue that on #savanna?
19:00:50 <SergeyLukjanov> let's move discussions to #savanna channel
19:00:58 <mattf> +1
19:01:27 <rnirmal> that's fine :)
19:01:28 <SergeyLukjanov> #info JFYI you can always use openstack-dev@lists.openstack.org mailing lists and #savanna irc channel to find us and ask your questions
19:01:34 <SergeyLukjanov> #endmeeting