18:05:25 <SergeyLukjanov> #startmeeting savanna
18:05:27 <openstack> Meeting started Thu Dec 19 18:05:25 2013 UTC and is due to finish in 60 minutes.  The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:05:28 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
18:05:28 <mattf> Guest74889 isn't here i guest
18:05:31 <openstack> The meeting name has been set to 'savanna'
18:05:42 <SergeyLukjanov> #topic Agenda
18:06:00 <SergeyLukjanov> #link https://wiki.openstack.org/wiki/Meetings/SavannaAgenda
18:06:18 <SergeyLukjanov> #topic Action items from the last meeting
18:06:32 <SergeyLukjanov> my action item is still actual
18:06:52 <SergeyLukjanov> #action SergeyLukjanov to check that all blueprints created and ping guys to make them if not
18:06:57 <SergeyLukjanov> #action SergeyLukjanov add links to the blueprints to roadmap
18:07:03 <SergeyLukjanov> #topic News / updates
18:07:22 <SergeyLukjanov> folks, please
18:07:45 <SergeyLukjanov> #info next two meetings canceled - Dec 26, Jan 2
18:08:09 <dmitryme> I've started a thread in openstack-dev regarding unified guest agent
18:08:24 <aignatov> ok, as for me, this week I mostly work on heat integration, patch is merged already, it can work with Neutron, now working on adding anti affinity feature
18:08:24 <dmitryme> that didn't result in consesus
18:08:31 <mattf> update - erikb and i huddled about plugin policy. we agreed that having a minimum set of features available in a plugin is important to provide consistency across savanna deployments. plugin writers should be keeping that in mind. however, we agreed that until we start seeing more than just an HDP plugin, we don't truly need a firm policy.
18:08:34 <tmckay> I'm working on the java action addition
18:08:36 <aignatov> also today I found  bug https://bugs.launchpad.net/savanna/+bug/1262783
18:08:42 <dmitryme> quite contrary: there were many different opinions
18:08:46 <SergeyLukjanov> mattf, thx, I was writing the same :)
18:08:53 <crobertsrh> job-relaunch functionality is under review, should be pretty well set.  work to allow "mapReduce" type jobs is underway (UI side).  I'll be working on allowing HDFS data sources next (UI side now that api-side has been done).
18:08:54 <aignatov> fix is ready, testing., will send patch in hours
18:09:15 <dmitryme> now I implement PoC and hope we will move discussion further having an example on how agent could look like
18:09:25 <aignatov> tmckay: I saw your draft, will look in to more closer tomorrow, ok? :)
18:09:51 <tmckay> aignatov, no problem it's a work in progress.  Still a lot of holes to fill :)
18:10:18 <tmckay> We talked about changing "Jar" to "MapReduce" last week for EDP job types, that change is merged
18:10:32 <alazarev> I have found root cause for #1240511 ([EDP][Vanilla] Oozie process does not start from time to time), fix is commited
18:10:35 <aignatov> yep, thanks for this patch
18:11:03 <tmckay> alazarev, that's great!
18:11:15 <aignatov> alazarev, good job, I saw your one of your patheds merged into Oozie trunk, well done
18:11:29 <aignatov> *patches
18:11:44 <mattf> alazarev, have a pointer to ^^'s jira?
18:12:58 <aignatov> we'll include this patch into DIB elements, right? because right now we can't work with oozie and we should use stable releases
18:13:06 <alazarev> yeap, https://issues.apache.org/jira/browse/OOZIE-1647
18:13:33 <alazarev> it is not a root cause, but it hides real error
18:14:04 <mattf> alazarev, so that allows us to properly retry on error?
18:14:44 <alazarev> it was merged to trunk in 30 minutes, I didn't expect such speed from hadoop eco :)
18:14:51 <SergeyLukjanov> :)
18:14:56 * mattf smiles
18:15:22 <aignatov> mattf, actually no, right now andrew implemented workaround you provided at the summit time ;) https://review.openstack.org/#/c/62511/
18:15:32 <alazarev> mattf: Savanna doesn't wait until HDFS starts, it expects that "start datanode" is enough
18:15:44 <mattf> for the record, aignatov provided it, i just recorded it
18:15:58 <alazarev> mattf: I added loop to wait active HDFS
18:16:10 <mattf> alazarev, ack
18:16:25 <mattf> alazarev, well done on this!
18:17:08 <SergeyLukjanov> I think there are nothing to discuss in roadmap section, it blocked by my action items, will be done in next two weeks ;)
18:17:31 <SergeyLukjanov> reminder: icehouse-2 will be Jan 23
18:17:41 <aignatov> alazarev, don't you think we should add such wait method to catch list of active tasktrakers?
18:17:42 <alazarev> mattf: regarding swift support in hadoop, it seems that I don't have time to finish backport properly, will put patch as is with note about done and not done work
18:17:46 <mattf> PSA - i'll be out 24 dec -> 2 jan
18:18:11 <tmckay> me too ^^
18:18:12 <alazarev> mattf: I mean will put to hadoop JIRA
18:18:17 <mattf> alazarev, thank you, the hwx folks can help there too
18:18:40 <SergeyLukjanov> I'll be on vacation Dec 29 - Jan 12
18:18:49 <SergeyLukjanov> but I'll be available as always ;)
18:18:54 <SergeyLukjanov> at least each other day
18:19:15 <mattf> SergeyLukjanov, yeah, i'll probably have my laptop with me too. for shame.
18:19:19 <SergeyLukjanov> #topic General discussion
18:19:32 <SergeyLukjanov> mattf, :)
18:19:50 <SergeyLukjanov> mattf, do you have any thoughts about unified agents?
18:20:03 <SergeyLukjanov> there always tons of emails in ML :)
18:20:17 <mattf> SergeyLukjanov, i do, but i'm not caught up on the thread yet. so i'll hold my comments for the thread or #savanna
18:20:33 <alazarev> also, Mirantis has customer interested in intel plugin to Savanna, I'm going to take care of "IDH plugin basic implementation" patch which appeared in review for two times already
18:20:34 <SergeyLukjanov> Dmitry, could you please explain us current state of unified agents discussions?
18:21:04 <mattf> alazarev, will the plugin support EDP?
18:21:14 <ruhe> SergeyLukjanov, hehe, collapse thread of 100 emails in one message in IRC? :)
18:21:30 <mattf> ruhe, please!
18:21:38 <mattf> actually, make it a tweet
18:21:57 <dmitryme> SergeyLukjanov: there is huge diversity in opinions on several architectural items
18:22:03 <alazarev> mattf: current patch, as I see, doesn't support it
18:22:09 <dmitryme> that is the summary :-)
18:22:20 <mattf> alazarev, yeah, wondering if you'll make it support EDP
18:22:27 <mattf> dmitryme, lol
18:22:27 <alazarev> mattf: let's have something merged at least and will see
18:22:54 <mattf> alazarev, is it a goal to support EDP in the IDH plugin by the icehouse release?
18:23:13 <SergeyLukjanov> mattf, I hope yes
18:23:20 <mattf> (if so, i pipe down and just come back closer to release and bark)
18:23:43 <alazarev> mattf: the right answer I believe is "it depends"
18:24:11 <mattf> oh but that makes me ask why it depends on
18:24:18 <mattf> s/why/what
18:25:05 <alazarev> one of the conditions is activity of Intel itself
18:25:25 <mattf> are you signing up to maintain the plugin in savanna?
18:26:22 * mattf is happy to take this over to #savanna so we can hit other topics
18:26:49 <alazarev> they allocated engineer to drive IDH plugin… but he fails to joins this meeting two weeks already
18:27:02 <mattf> ok
18:27:03 <alazarev> so, I'm pessimistic on that
18:27:08 * mattf nods
18:27:35 <mattf> let's take it off to #savanna and free up the meeting
18:28:12 <alazarev> ok
18:28:36 <SergeyLukjanov> anything more to discuss today?
18:30:50 <SergeyLukjanov> ok, let's the todays meeting
18:30:57 <SergeyLukjanov> thank you guys
18:31:01 <SergeyLukjanov> see you in #savanna
18:31:05 <SergeyLukjanov> #endmeeting