Wednesday, 2013-10-16

*** SergeyLukjanov has joined #savanna00:18
*** matsuhashi has joined #savanna00:20
*** akuznetsov has quit IRC00:24
*** SergeyLukjanov has quit IRC00:41
*** sacharya has joined #savanna00:57
*** akuznetsov has joined #savanna01:06
*** nosnos has joined #savanna01:11
*** tmckay has joined #savanna01:41
*** matsuhashi has quit IRC01:46
*** matsuhashi has joined #savanna01:47
*** akuznetsov has quit IRC01:48
*** matsuhas_ has joined #savanna01:49
*** matsuhashi has quit IRC01:49
*** tmckay has quit IRC03:08
*** _mattf has quit IRC04:40
*** akuznetsov has joined #savanna04:44
*** _mattf has joined #savanna04:47
*** sacharya has quit IRC05:05
*** dguitarbite has joined #savanna05:38
*** akuznetsov has quit IRC07:25
*** DinaBelova has joined #savanna07:32
*** dafter has joined #savanna07:50
*** tvb|afk has joined #savanna07:51
*** dafter has quit IRC07:55
*** akuznetsov has joined #savanna08:13
*** dmitryme has joined #savanna08:14
*** nprivalova has joined #savanna08:27
*** akuznetsov has quit IRC09:06
*** tvb|afk has quit IRC09:18
*** matsuhas_ has quit IRC09:19
*** matsuhas_ has joined #savanna09:19
*** akuznetsov has joined #savanna09:31
*** dafter has joined #savanna09:36
*** dafter has joined #savanna09:36
*** akuznetsov has quit IRC09:42
*** nprivalova has quit IRC09:45
*** nprivalova has joined #savanna09:50
*** DinaBelova has quit IRC10:14
*** nprivalova has quit IRC10:17
*** akuznetsov has joined #savanna10:21
*** nprivalova has joined #savanna10:50
*** DinaBelova has joined #savanna10:52
openstackgerritDmitry Mescheryakov proposed a change to openstack/savanna: Minor docs restructurization  https://review.openstack.org/5206111:00
*** dmitryme has quit IRC11:01
*** DinaBelova has quit IRC11:43
*** _crobertsrh is now known as crobertsrh12:00
*** nprivalova has quit IRC12:12
*** nprivalova has joined #savanna12:35
*** bogdando has quit IRC12:37
*** bogdando has joined #savanna12:40
*** nosnos has quit IRC12:55
*** nosnos has joined #savanna12:55
*** nosnos has quit IRC13:00
*** nprivalova is now known as nadya13:25
*** akuznetsov has quit IRC13:28
aignatovcrobertsrh, I think it's bug and a feature at the same time when user can give a new name for job-binary, but there is a bug if that new name is wrong and doesn't contain .jar at end.13:32
crobertsrhaignatov:  Right.  Perhaps just some extra documentation (especially within the UI) is the way to go.13:32
crobertsrhOr maybe some extra validation to be sure that an uploaded ".jar" file maintains a ".jar" when the user names it.13:34
aignatovAlso I think that we should implement a feature in the UI - to put the name of uploaded binary file to the name field in the UI13:35
aignatovif user wants he can change it of course13:36
*** rnirmal has joined #savanna13:37
crobertsrhThat is probably a good idea13:44
*** _mattf is now known as mattf13:55
*** mattf has quit IRC13:55
*** mattf has joined #savanna13:55
*** akuznetsov has joined #savanna13:56
*** SergeyLukjanov has joined #savanna14:07
*** tmckay has joined #savanna14:13
*** sacharya has joined #savanna14:23
*** dmitryme has joined #savanna14:29
aignatovtmckay, will you plan to continue work on https://review.openstack.org/#/c/51017/ ?14:36
aignatovрш14:36
aignatovhi14:36
tmckayaignatov, yes.  I thought, along with crobertsrh, I would try to run your demo job end to end through savanna.  So far, we both are getting some kind of classpath error with PigMain14:37
tmckayaignatov, but I can work on the doc instead and come back to it14:37
aignatovactually we have to fininsh docs before the release 0.314:38
aignatovrelease is tomorrow sfaik14:38
*** matsuhas_ has quit IRC14:38
aignatov*afaik14:38
*** matsuhashi has joined #savanna14:39
*** matsuhashi has joined #savanna14:40
tmckayaignatov, well, then I suppose I have to finish it today :)  Okay, otp now on a conference call but then I will do nothing but the edp section14:41
*** matsuhashi has quit IRC14:42
*** matsuhashi has joined #savanna14:42
aignatov btw, when I finish my doc section with rest api I will able to help you to debug edp14:44
*** SergeyLukjanov is now known as _SergeyLukjanov14:46
crobertsrhNo prob.  I have my job running on ubuntu....trying fedora image now.14:47
*** matsuhashi has quit IRC14:47
*** _SergeyLukjanov is now known as SergeyLukjanov14:50
*** sacharya has quit IRC14:51
tmckayaignatov, my plan for the EDP page at this point is to add simple definitions of all the object types and then a simple bullet point workflow.  Essentially text that more or less corresponds to your demo15:02
tmckaynothing to complicated.  Also, maybe a link to the REST api section15:02
*** SergeyLukjanov is now known as _SergeyLukjanov15:03
tmckayso, "this is a job_binary", "this is a job", "this is a datasource", "this is an execution" etc15:03
*** _SergeyLukjanov has quit IRC15:03
*** SergeyLukjanov has joined #savanna15:04
*** dmitryme has quit IRC15:04
tmckayaignatov, I'll probably mention too that every job in savanna is wrapped in Oozie currently15:05
aignatovtmckay, that's a good plan15:06
tmckayif we need to expand in 0.3.next, we can add more detail based on user feedback15:06
aignatovSergeyLukjanov, here?15:07
SergeyLukjanovaignatov, partially :)15:13
aignatovok, please read our above conversation, and will your ok with that plan?15:13
*** rnirmal has quit IRC15:13
aignatovabove means from 18:3515:13
SergeyLukjanovsounds ok15:16
SergeyLukjanovwill it be ready till the tomorrows evening?15:17
aignatovrest api yes15:17
openstackgerritA change was merged to openstack/savanna: Integration test improvements  https://review.openstack.org/5162515:17
tmckaySergeyLukjanov, I should be ready too.  Nothing else today until EDP doc is done :)15:17
aignatovdmitryme also will add some part about transient clusters and needed configs for trusts as well15:18
aignatovalso I think we should remove edp spi section15:18
aignatovtmkcay what so you think about removing edp spi page?15:19
aignatovso -> do15:19
*** SergeyLukjanov has quit IRC15:20
tmckayaignatov, I could agree with that.  I'm not familiar enough to know what goes on the spi page15:20
tmckayIf someone knows what to write, we could add it.  Or, we could put in a knowledge base or a wiki later.15:21
tmckayaignatov, I know we mentioned one thing the other day that should go there.  Maybe it's there, but really short.15:22
*** sacharya has joined #savanna15:26
aignatovtmckay, yes I remember something, actually spi meant which methods plugins should have to support edp15:28
aignatovsomething like that15:28
tmckayyes15:28
aignatovbut it seems nothing now15:28
aignatovonly hive get_hive_config_path, but hive is not working with edp now15:29
aignatovso botheng should go there15:29
tmckayaignatov, here is your comment from 10_815:33
tmckay11:57:30 AM) aignatov:  tmckay, at least we must have info about how EDP works with oozie in  code, for examle developers shoudl know that plugin must set  'Info''oozie'[url] in set_cluster_info15:33
tmckay(11:57:35 AM) aignatov: something like that15:33
tmckaythat's all I remember that was mentioned specifically15:33
aignatovindeed, yes, I just talked with dmitryme, I asked him to add this point to somewhere in docs :)15:35
aignatovbut you could add the same to spi page, eventually it will have some content :-)15:36
aignatovreally, plugin must do this to support edp so we should mention it somewhere15:38
tmckayThat could be the only content on the spi page for now.  I think that would be okay.  I don't know enough to write it, though -- someone else must write the text and I can review :)15:38
aignatov+115:52
*** SergeyLukjanov has joined #savanna15:53
*** nadya has quit IRC15:56
tmckayaignatov, will there be docs for the python-savannaclient, too?  It might be nice to link to that.16:11
tmckayaignatov, also, if you can add this to the top of the REST API 1.1 page I can link to it (just like the stuff Chad did)16:15
tmckaydiff --git a/doc/source/userdoc/rest_api_v1.1_EDP.rst b/doc/source/userdoc/rest_api_v1.1_EDP.rst16:15
tmckayindex 1beeab2..f7591dc 10064416:15
tmckay--- a/doc/source/userdoc/rest_api_v1.1_EDP.rst16:15
tmckay+++ b/doc/source/userdoc/rest_api_v1.1_EDP.rst16:15
tmckay@@ -1,3 +1,5 @@16:15
tmckay+.. _rest_api_v1.1_EDP:16:15
tmckay+16:15
tmckay Savanna REST API v1.1 (EDP)16:15
tmckay =============================16:15
*** dafter has quit IRC16:16
*** rnirmal has joined #savanna16:38
tmckayaignatov, crobertsrh, I just noticed on the demo that on the Create Job Binary page the help text on the right says "Select the type of your Data Source".  Should be Job Binary.16:43
tmckaynot sure if the demo reflects current checkin...16:43
*** mattf is now known as _mattf16:51
crobertsrhtmckay:  I think I recall seeing that at one point too.  I'm tweaking help text today, I can change that if it's still there.16:52
*** _mattf is now known as mattf16:52
tmckayack thanks16:52
*** dmitryme has joined #savanna17:04
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Adding help text to clarify the name field for job binaries  https://review.openstack.org/5216217:04
*** dmitryme has quit IRC17:19
*** DennyZhang has joined #savanna17:20
openstackgerritSergey Lukjanov proposed a change to openstack/savanna: Use python-savannaclient 0.3.rc4  https://review.openstack.org/5217017:30
openstackgerritSergey Lukjanov proposed a change to openstack/savanna-dashboard: Use python-savannaclient 0.3.rc4  https://review.openstack.org/5217117:31
*** dmitryme has joined #savanna17:32
*** akuznetsov has quit IRC17:34
*** akuznetsov has joined #savanna17:35
*** DennyZhang has quit IRC17:45
openstackgerritSergey Lukjanov proposed a change to openstack/savanna: Use python-savannaclient 0.3.rc4  https://review.openstack.org/5217017:58
*** nadya has joined #savanna17:58
openstackgerritA change was merged to openstack/savanna-dashboard: Use python-savannaclient 0.3.rc4  https://review.openstack.org/5217117:59
openstackgerritSergey Lukjanov proposed a change to openstack/savanna: Use python-savannaclient 0.3.rc4  https://review.openstack.org/5217018:03
*** akuznetsov has quit IRC18:04
*** akuznetsov has joined #savanna18:08
*** akuznetsov has quit IRC18:12
*** sacharya has quit IRC18:18
*** sacharya1 has joined #savanna18:18
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst  https://review.openstack.org/5101718:38
tmckayaignatov, SergeyLukjanov, crobertsrh, nadya okay here is my EDP doc content ^^ I have to proofread myself first but I wanted to post it ASAP :)18:39
tmckaythe links to other docs should work when it's all merged together (and REST has the label).  There is actually another way to refer to docs in Sphinx, I may try that -- in that case specific labels may not be needed.18:41
dmitrymeGreat job tmckay! By the way I've recently discovered that OpenStack infrastructure deploys docs from the patch set as drafts18:44
dmitrymehttp://docs-draft.openstack.org/17/51017/3/check/gate-savanna-docs/f4dfec5/doc/build/html/18:44
SergeyLukjanovhttp://docs-draft.openstack.org/17/51017/3/check/gate-savanna-docs/f4dfec5/doc/build/html/userdoc/edp.html18:44
SergeyLukjanov:)18:44
SergeyLukjanovtmckay, thank you18:44
dmitrymein case you guys didn't know about it18:44
SergeyLukjanovbtw jenkins posts link to the docs in comments18:44
tmckaydmitryme, thanks, I didn't know that.  I'll check it out.18:45
dmitrymethe link name is 'gate-savanna-docs'18:45
dmitryme(as addition to what Sergey said)18:45
tmckayhopefully I have not told lies about EDP :)18:48
tmckaybrb18:49
nadyatmckay, lloks ok :) not sure about Hive...19:02
tmckaydoes it not run?19:02
tmckayI got very close to a Pig run yesterday, but my devstack seems to be broken now, swift says it's full when I try to upload an image via glance.  Going to try again.19:03
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst  https://review.openstack.org/5101719:16
tmckaychanged :ref: to :doc: and deleted the second link to the specific edp section so we don't need special labels.19:18
openstackgerritA change was merged to openstack/savanna: Use python-savannaclient 0.3.rc4  https://review.openstack.org/5217019:21
openstackgerritTrevor McKay proposed a change to openstack/savanna: Remove the section label markups for EDP  https://review.openstack.org/5219019:26
*** nadya has quit IRC19:41
openstackgerritDmitry Mescheryakov proposed a change to openstack/savanna: Added Technical Considerations page for EDP  https://review.openstack.org/5219819:49
*** SergeyLukjanov is now known as _SergeyLukjanov20:06
*** _SergeyLukjanov has quit IRC20:06
*** SergeyLukjanov has joined #savanna20:08
*** aignatov has quit IRC20:11
*** aignatov has joined #savanna20:11
*** dmitryme has quit IRC20:21
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst  https://review.openstack.org/5101720:21
*** dmitryme has joined #savanna20:24
openstackgerritA change was merged to openstack/savanna: Minor docs restructurization  https://review.openstack.org/5206120:41
openstackgerritA change was merged to openstack/savanna: Remove the section label markups for EDP  https://review.openstack.org/5219020:44
*** dmitryme has quit IRC20:45
*** crobertsrh is now known as _crobertsrh21:05
*** tmckay has quit IRC21:14
*** SergeyLukjanov is now known as _SergeyLukjanov21:35
*** _SergeyLukjanov has quit IRC21:36
*** SergeyLukjanov has joined #savanna21:36
*** mattf is now known as _mattf21:42
*** sacharya1 has quit IRC21:55
*** _mattf is now known as mattf22:03
*** rnirmal has quit IRC22:16
openstackgerritSergey Lukjanov proposed a change to openstack/python-savannaclient: Add lower bound for the six dep  https://review.openstack.org/5223322:26
openstackgerritSergey Lukjanov proposed a change to openstack/savanna: Add lower bound for the six dep  https://review.openstack.org/5223422:26
openstackgerritA change was merged to openstack/python-savannaclient: Add lower bound for the six dep  https://review.openstack.org/5223322:40
*** ruhe has joined #savanna22:50
*** ruhe has quit IRC22:51
*** SergeyLukjanov is now known as _SergeyLukjanov22:52
*** _SergeyLukjanov is now known as SergeyLukjanov22:52
*** sacharya has joined #savanna23:29
openstackgerritA change was merged to openstack/savanna: Add lower bound for the six dep  https://review.openstack.org/5223423:29
*** SergeyLukjanov has quit IRC23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!