18:07:07 #startmeeting savanna 18:07:08 Meeting started Thu Oct 17 18:07:07 2013 UTC and is due to finish in 60 minutes. The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:07:09 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 18:07:11 The meeting name has been set to 'savanna' 18:07:19 #help 18:07:33 #info Agenda - https://wiki.openstack.org/wiki/Meetings/SavannaAgenda 18:07:43 #topic Action items from the last meeting 18:08:06 the only action item from the last meeting is "all to find and fix gaps in the docs for 0.3 release" 18:08:15 and looks like it's done 18:08:22 btw I hope that it's done 18:08:35 #topic Savanna 0.3 release 18:08:52 we're ready to push the 0.3 tag today 18:09:04 all critical patches was landed 18:09:16 excellent 18:09:41 https://review.openstack.org/#/c/51208/ postponed to the next milestone due to the bug with transient clusters support on backend side 18:09:51 https://bugs.launchpad.net/savanna/+bug/1241126 18:10:07 I think that fix will be landed in the upcoming minor release 18:10:08 0.3.1 18:10:33 any objections for pushing 0.3 tag today? 18:11:17 I've just checked that all others features work - antyaffininty and cinder volumes, no objections from me 18:11:37 aignatov, great 18:11:48 I've been running jobs for a couple days, thing seem to be stable. 18:11:57 ok, so, I'll start pushing tags in an hour 18:12:13 let's move on 18:12:16 #topic News / updates 18:12:17 yeah, it seems all edp works as expected except trusts 18:12:30 folks, feel free to post updates here 18:12:43 the main update from me - 0.3 release :) 18:12:58 On the HWX side, we've been busy creating a patch for Quantum/Neutron w.out public ips necessary 18:13:17 this week I mostly concentrated on preparing docs, also composed a demo about edp 18:13:34 In addition, we're in the merge process of adding support for various HDP services (Oozie, Hive, etc.) This will eventually be backported to 0.3 18:13:55 ErikB, do you have any ETA in mind for Quantum/Neutron without public ips? 18:13:59 let me post a link to the my edp demo 18:14:54 #link https://docs.google.com/file/d/0B_AT3b7ftRKeNm9hSlhaTm1CYkE/edit?usp=sharing 18:15:06 ok, any more updates? 18:15:48 ruhe, we *should* be starting merge to master this week if all goes well, pending review, perhaps all wrapped up next week. 18:17:07 SergeyLukjanov, when do you plan to release 0.3.1? 18:17:33 ruhe, I'm thinking about doing it in 2-3 weeks 18:17:45 to have a release for the OS summit in HK 18:18:44 it'll be good to have at least transient clusters fully op. in it and EDP support in HDP plugin 18:18:44 ok 18:19:13 Hive support as well I think 18:19:24 in edp 18:19:34 yeah, good point, it'll be good to add it too 18:19:43 some UI and docs polish maybe too 18:20:41 ErikB, did you have any challeges in Hive deployment? 18:20:52 I'll create a milestone for it in launchpad today, please, create issues and blueprints to add them into the lp ml 18:21:19 did all savanna guys vote for design sessions topics? 18:21:44 I didn't. 18:21:52 we have a plenty of time. voting closes on oct22 18:21:58 Is there a link? 18:22:03 btw I'll start merging topics at Nov 22 right after the end of voting 18:22:10 Oct* 18:22:25 I didn't too, will do after meeting 18:22:25 tmckay, you should check your emai inboxl 18:22:28 tmckay, you should receive vote ticket in your registered email 18:22:38 okay :) 18:22:45 the subject is : "Poll: Savanna Topics for OpenStack Havana Design Summit" 18:23:08 all savanna contributors should receive free ATC pass to Hong Kong summit 18:23:22 nadya: John did most of the Hive integration, but one of the main concerns/issues he related was managing the service/component dependencies in a "user friendly" fashion (i.e. how does a user recognize that certain services are required for Hive deployment if they are selecting individual components?). 18:23:57 ok, let's move on 18:24:01 #topic Roadmap cleanup / update 18:24:11 #info https://wiki.openstack.org/wiki/Savanna/Roadmap 18:24:21 jmaron, that's a good subject for summit discussions. Heat might help this dependencies management 18:24:46 s/this/with 18:24:50 nothing to update in roadmap from mi side 18:25:12 ruhe, if I understand jmaron correctly, it is not about implementation, it is about UI 18:25:53 i.e. how we will present to the user, 'please turn on this service, if you want that one to work' 18:26:03 jmaron, thanks. I will ask John if it would be needed 18:26:20 #topic General discussion 18:26:37 as far as I recall jspiedel already wrote a letter about it in openstack-dev 18:26:53 we just didn't had time to think about it 18:27:01 ruhe: true. I think there is already an architecture discussion proposed, so it could be discussed there 18:27:27 dmitryme: true, he did 18:29:56 anything else to discuss today? 18:29:59 service dependencies can probably be discussed in proposed Heat session or New Architecture session 18:30:21 I'll merge sessions to fit 4 time slots 18:30:45 I hope that the most parts of proposals will be landed to the summit sessions 18:31:07 who is going to HK? :) 18:31:18 btw, i've read blogposts on Hortonworks site. reference Hadoop2 architecture with namenode HA requires ZooKeeper 18:31:42 that's a very tricky dependency :) 18:32:31 ruhe: haven't looked much at the 2.0 integration, but it's coming…. ;) 18:32:44 ruhe, yeah, especially isn virtual environment 18:34:02 * aignatov has moved 0.3 docs bp to implemented 18:34:57 i know it might be too early to discuss, but i'd like to hear, what you guys would like to implement during IceHouse? 18:34:58 aignatov, thx 18:35:06 that's a question to everyone 18:35:11 mattf, what's about fedora? 18:35:45 ruhe, lowercase 'h' in Icehouse 18:36:18 personally, I'd like to keep expanding edp -- different data/job sources (external swift, hdfs, gluster, others?) 18:36:33 Hadoop 2.0 support and +1 to tmckay 18:36:51 I think that some sort of monitoring support is in order in the UI. 18:36:58 +1 to tmckay 18:37:03 we also talked at one point about hooking savanna into build servers somehow... 18:37:22 +1 to Trevor + Sqoop 18:37:25 and, I would *love* to see better error reporting in horizon. "Status: Error" is not helpful. 18:38:14 oh, and "relaunch" of a job execution 18:38:16 in edp I'd like to expand job configurations and to support not only Hive, Pig and Jar 18:38:16 I hope that we'll be able to migrate to some common rest api framework with better exceptions handling 18:38:19 I think it would be useful. 18:38:30 tmckay: I just submitted a bug for relaunch of job-execution :) 18:38:35 +1 18:38:36 +1 to tmckay: be more nice with a user 18:39:02 we also talked about allowing user uploaded Oozie workflows. 18:39:08 for me, the main goal for the next milestone is to integrate with other OS projects and graduate from the incubation 18:39:10 enhanced UI experience (service/component dependencies, template editing) would be nice 18:39:29 also I'd like to see Savanna more scalable and resilient 18:39:41 +1 to tmacky and jmaron, there are a lot of areas to improve UI 18:39:57 dmitryme: +1, especially around large clusters 18:40:09 SergeyLukjanov, +1, there was a lot of talk at the incubation meetings of Savanna integrating with Heat, etc. Maybe if those projects don't have what Savanna needs, we can jump on and help them get there :) 18:40:54 SergeyLukyanov, yes, that's the highest priority for all of Savanna contributos 18:43:08 hmm, Savanna would be easier to package for Fedora than some of the hadoop stuff because its Python, not Java. I wonder how many unpackaged dependencies it has... 18:44:11 afaik, all dependencies have packages 18:44:41 ruhe, yeah 18:44:54 we're including Savanna in Fuel, didn't have any issues with dependency packages 18:51:23 is it time to fininsh? 18:51:38 yep 18:51:46 #info JFYI you can always use openstack-dev@lists.openstack.org mailing lists and #savanna irc channel to find us and ask your questions 18:51:49 #endmeeting