Friday, 2013-12-20

*** rnirmal has joined #savanna00:30
*** jcooley_ has quit IRC00:31
*** IlyaE has quit IRC00:35
*** IlyaE has joined #savanna00:47
*** jcooley_ has joined #savanna00:55
*** jcooley_ has quit IRC00:55
*** chris_m has quit IRC00:57
*** nosnos has joined #savanna01:04
openstackgerritMinkyung Maisy Kim proposed a change to openstack/python-savannaclient: Adding the ability to modify cluster templates  https://review.openstack.org/6192501:21
*** IlyaE has quit IRC01:24
openstackgerritMinkyung Maisy Kim proposed a change to openstack/python-savannaclient: Adding the ability to modify cluster templates  https://review.openstack.org/6192501:27
*** jcooley_ has joined #savanna01:27
*** IlyaE has joined #savanna01:29
openstackgerritAndrew Lazarev proposed a change to openstack/savanna: Minor refactoring of vanilla create cluster  https://review.openstack.org/6326201:45
openstackgerritAndrew Lazarev proposed a change to openstack/savanna: Wait for HDFS readiness after datanode services start  https://review.openstack.org/6296601:55
*** matsuhashi has joined #savanna01:58
*** IlyaE has quit IRC02:00
*** jcooley_ has quit IRC02:12
openstackgerritA change was merged to openstack/savanna-dashboard: Adding ability to relaunch jobs  https://review.openstack.org/6239802:19
*** jcooley_ has joined #savanna02:21
openstackgerritMina Park proposed a change to openstack/python-savannaclient: Adding the ability to modify node group templates  https://review.openstack.org/6227602:26
*** alazarev has quit IRC02:30
*** jcooley_ has quit IRC02:32
openstackgerritMina Park proposed a change to openstack/savanna-dashboard: Adding the ability to modify node group template  https://review.openstack.org/6194102:32
*** jcooley_ has joined #savanna02:32
*** jcooley_ has quit IRC02:37
*** jcooley_ has joined #savanna02:47
*** jdev789 has joined #savanna03:27
*** jdev789 has quit IRC03:30
*** IlyaE has joined #savanna04:18
*** IlyaE has quit IRC04:25
*** rnirmal has quit IRC04:40
*** jcooley_ has quit IRC04:48
*** jcooley_ has joined #savanna04:49
*** jcooley_ has quit IRC04:53
*** akuznetsov has joined #savanna04:53
*** SergeyLukjanov has joined #savanna05:29
*** jcooley_ has joined #savanna05:48
*** alazarev has joined #savanna06:12
*** SergeyLukjanov has quit IRC06:31
*** nosnos has quit IRC06:41
*** nosnos has joined #savanna06:42
*** alazarev has quit IRC06:46
*** nadya_ has joined #savanna06:50
*** akuznetsov has quit IRC07:02
*** nosnos_ has joined #savanna07:03
*** nosnos has quit IRC07:05
*** alazarev has joined #savanna07:05
openstackgerritAndrew Lazarev proposed a change to openstack/savanna: Adding IDH plugin basic implementation  https://review.openstack.org/6333707:06
*** NikitaKonovalov has joined #savanna07:07
*** nadya_ has quit IRC07:17
*** SergeyLukjanov has joined #savanna07:28
*** akuznetsov has joined #savanna07:29
*** akuznetsov has quit IRC07:49
*** akuznetsov has joined #savanna07:50
*** akuznetsov has quit IRC07:54
*** alazarev has quit IRC08:05
*** aignatov has joined #savanna08:11
*** DinaBelova has joined #savanna08:18
*** NikitaKonovalov has quit IRC08:25
*** NikitaKonovalov has joined #savanna08:25
*** akuznetsov has joined #savanna08:37
*** jcooley_ has quit IRC08:47
*** jcooley_ has joined #savanna08:48
*** jcooley_ has quit IRC08:48
*** jcooley_ has joined #savanna08:49
*** jcooley_ has quit IRC08:53
*** dmitryme has joined #savanna08:58
*** qwerty_nor has joined #savanna09:10
*** matsuhashi has quit IRC09:12
*** matsuhashi has joined #savanna09:12
*** matsuhashi has quit IRC09:16
*** matsuhashi has joined #savanna09:17
openstackgerritSergey Reshetnyak proposed a change to openstack/savanna: Extract common part of instances.py and instances_heat.py  https://review.openstack.org/6284209:18
*** nosnos_ has quit IRC09:19
*** DinaBelova has quit IRC09:23
*** SergeyLukjanov is now known as _SergeyLukjanov09:28
*** _SergeyLukjanov has quit IRC09:29
*** akuznetsov has quit IRC09:41
*** matsuhashi has quit IRC09:41
*** jcooley_ has joined #savanna09:46
*** SergeyLukjanov has joined #savanna09:53
openstackgerritAlexander Ignatov proposed a change to openstack/savanna: Added unit-tests to Heat engine  https://review.openstack.org/6276809:57
*** jcooley_ has quit IRC10:16
*** jcooley_ has joined #savanna10:16
*** akuznetsov has joined #savanna10:17
*** NikitaKonovalov has quit IRC10:27
*** jcooley_ has quit IRC10:49
*** NikitaKonovalov has joined #savanna10:49
openstackgerritSergey Reshetnyak proposed a change to openstack/savanna: Extract common part of instances.py and instances_heat.py  https://review.openstack.org/6284210:50
*** akuznetsov has quit IRC10:53
*** DinaBelova has joined #savanna11:10
*** SergeyLukjanov is now known as _SergeyLukjanov11:13
*** _SergeyLukjanov has quit IRC11:13
*** jcooley_ has joined #savanna11:16
*** akuznetsov has joined #savanna11:27
*** jcooley_ has quit IRC11:46
openstackgerritSergey Reshetnyak proposed a change to openstack/savanna: Extract common part of instances.py and instances_heat.py  https://review.openstack.org/6284211:49
*** ityaptin_ has quit IRC11:55
*** dmitryme has quit IRC12:01
*** SergeyLukjanov has joined #savanna12:03
*** SergeyLukjanov is now known as _SergeyLukjanov12:03
openstackgerritNikita Konovalov proposed a change to openstack/savanna-dashboard: Migrate to testr  https://review.openstack.org/6339012:04
*** _SergeyLukjanov has quit IRC12:05
*** SergeyLukjanov has joined #savanna12:09
*** dmitryme has joined #savanna12:16
openstackgerritDmitry Mescheryakov proposed a change to openstack/savanna: Properly catch timeout exception raised in thread  https://review.openstack.org/6339312:24
openstackgerritDmitry Mescheryakov proposed a change to openstack/savanna: Increase timeout for Ambari server setup  https://review.openstack.org/6339612:32
*** jcooley_ has joined #savanna12:34
*** DinaBelova has quit IRC12:41
*** NikitaKonovalov has quit IRC12:43
*** akuznetsov has quit IRC12:46
*** ruhe has joined #savanna12:49
*** jcooley_ has quit IRC12:52
*** NikitaKonovalov has joined #savanna13:01
*** akuznetsov has joined #savanna13:03
openstackgerritA change was merged to openstack/savanna-image-elements: Firstboot script modifications  https://review.openstack.org/6194513:18
*** jcooley_ has joined #savanna13:18
*** jdev789 has joined #savanna13:24
*** tmckay has quit IRC13:27
*** _crobertsrh is now known as crobertsrh13:28
openstackgerritA change was merged to openstack/savanna-image-elements: Add possibility to use local repositories  https://review.openstack.org/6235213:34
openstackgerritNikita Konovalov proposed a change to openstack/savanna-dashboard: Migrate to testr  https://review.openstack.org/6339013:41
*** aignatov has quit IRC13:43
*** aignatov has joined #savanna13:44
*** jcooley_ has quit IRC13:50
*** ruhe is now known as ruhe_13:53
*** ruhe_ is now known as ruhe13:53
*** NikitaKonovalov has quit IRC13:58
*** _mattf is now known as mattf14:00
mattfSergeyLukjanov, how do you want to handle changes in savannaclient that require changes in savanna-api?14:01
*** akuznetsov has quit IRC14:01
*** NikitaKonovalov has joined #savanna14:02
*** DinaBelova has joined #savanna14:06
*** SergeyLukjanov is now known as _SergeyLukjanov14:11
*** jdev789 has quit IRC14:12
*** _SergeyLukjanov has quit IRC14:12
*** NikitaKonovalov has quit IRC14:14
*** SergeyLukjanov has joined #savanna14:16
*** aignatov has quit IRC14:18
openstackgerritA change was merged to openstack/python-savannaclient: Adding the ability to modify cluster templates  https://review.openstack.org/6192514:18
openstackgerritA change was merged to openstack/python-savannaclient: Adding the ability to modify node group templates  https://review.openstack.org/6227614:18
mattfSergeyLukjanov, how do you want to handle changes in savannaclient that require changes in savanna-api?14:20
SergeyLukjanovmattf, hey14:20
SergeyLukjanovsuch changes won't break anything, savanna-api changes are near to be merged I hope, requires 1-2 more iterations14:20
SergeyLukjanovthe only place where we need merged code in savanna-api and released client is savanna-dashboard14:21
SergeyLukjanovI'm thinking about releasing next minor client version after updates will be fully implemented and merged14:22
mattfaren't we serialized tho? if the new savannaclient api call uses a feature not available in savanna-api, it'll break if savanna-api isn't released first14:22
SergeyLukjanovmattf, savanna client isn't depend on any version of savanna-api itself14:23
SergeyLukjanovit depends on api version14:23
mattfthere's no hard dep (requirements) between client and api, which is good. so here's where api versioning comes in, ultimately14:23
SergeyLukjanovand updates are only add new calls to the api14:24
SergeyLukjanovthat's good and will not break older client14:24
SergeyLukjanovand will not require api version bump14:24
mattfif folks are only using the most recent release, we need to make sure api goes out then client then dashboard14:24
mattfif folks are using a mix of releases (say old savanna, new client, new dashboard) they're on their own, imho14:25
SergeyLukjanovdoes you mean: icehouse-2 savanna with updates => 0.4.42 client release => savanna-dashboard icehouse-214:26
SergeyLukjanovor just icehouse-2 savanna release => the same14:26
SergeyLukjanovthe #2 looks ok for me14:26
*** DinaBelova has quit IRC14:27
mattfi mean that while we're in development it should be expected that people are using the most current release of projects14:27
*** DinaBelova has joined #savanna14:27
SergeyLukjanovyep14:28
mattfif we release client (and dashboard) that uses a new api call in savanna-api but we haven't yet released savanna-api that has that call, then the "always using most recent release" is safe variant is broken14:28
SergeyLukjanovso, #1 approach looks better14:29
SergeyLukjanovlike a safe variant you mentioned14:29
*** jcooley_ has joined #savanna14:29
mattf(fyi, i believe andrew gets some credit there too)14:30
mattfit means we gate the client merge on an api release that will provide the necessary new call14:31
*** NikitaKonovalov has joined #savanna14:32
mattfright now we might be violating the invariant14:32
SergeyLukjanovin fact currently we always need to release client before merging tests to savanna-api due to the dependency on client in tests14:32
mattfhey dmitry just called me a zealot, yay14:33
SergeyLukjanovmattf, yup, next time will wait on api14:33
mattfoh, tired eyes, not zealot, zealous14:34
* mattf needs a nap to go w/ his 4 hours of sleep14:34
SergeyLukjanov:)14:35
openstackgerritNikita Konovalov proposed a change to openstack/savanna-dashboard: Migrate to testr  https://review.openstack.org/6339014:35
*** alazarev has joined #savanna14:48
openstackgerritA change was merged to openstack/savanna: Minor refactoring of vanilla create cluster  https://review.openstack.org/6326214:48
*** tmckay has joined #savanna14:48
*** venza has quit IRC14:51
*** venza has joined #savanna14:53
*** mattf is now known as _mattf14:54
*** _mattf is now known as mattf14:54
*** tmckay has quit IRC14:54
*** tmckay has joined #savanna14:57
*** jcooley_ has quit IRC14:59
*** jcooley_ has joined #savanna15:01
*** rnirmal has joined #savanna15:09
*** IlyaE has joined #savanna15:10
*** ityaptin has joined #savanna15:11
*** IvanBerezovskiy has left #savanna15:19
*** NikitaKonovalov has quit IRC15:23
tmckaycrobertsrh, ping15:39
crobertsrhhello15:39
tmckayLooking at how to specify the "main-class" value for a java action execution.  For mapreduce jobs, we specify mapper/reducer classes as config parameters.15:40
tmckay<main-class> is its own tag, not a config property15:41
tmckayBut, I'm wondering if we just go ahead and include it in the config dictionary and then pull it out when the workflow.xml is generated15:41
tmckaycrobertsrh, but I think you mine the list of possible config parameters, right?  With config hints?15:42
tmckaySo maybe that's bogus.  The other alternative is for you to add a "main-class" input box if the job type is Java.  What do you think?15:42
crobertsrhYeah, the config hints tell us which sections to display (configs, params, args)15:42
tmckayoh, that's the other thing.  The java action will be the first one with "args"15:43
crobertsrhAdding a "main-class" input for "Java" job type is do-able.15:43
tmckayk, I think that's the best.  About args....15:43
tmckayThere won't be any content suggested for args, because they're general and openended, but we need an indicator that you should display an "add arg" button15:44
tmckay(or some widget)15:44
crobertsrhHmm, I think we already have something for args in the UI15:45
openstackgerritA change was merged to openstack/savanna: Increase timeout for Ambari server setup  https://review.openstack.org/6339615:46
crobertsrhYeah, for a Pig job right now, we have all 3 (config, params, args)15:46
tmckayokay.  Java will have configs and args, no params.  Just a heads up.15:47
tmckayquiet in here today15:47
crobertsrhThat should be ok15:47
*** tmckay has quit IRC16:00
*** tmckay has joined #savanna16:15
*** jcooley_ has quit IRC16:17
*** jcooley_ has joined #savanna16:18
*** DinaBelova has quit IRC16:21
*** alazarev has quit IRC16:39
*** SergeyLukjanov is now known as _SergeyLukjanov17:00
*** _SergeyLukjanov has quit IRC17:00
*** dmitryme has quit IRC17:06
*** ruhe has quit IRC17:15
*** ruhe has joined #savanna17:21
*** tmckay1 has joined #savanna17:24
*** tmckay has quit IRC17:24
*** ruhe has quit IRC17:42
*** alazarev has joined #savanna17:55
*** alazarev has quit IRC18:01
*** IlyaE has quit IRC18:18
*** SergeyLukjanov has joined #savanna18:34
*** ruhe has joined #savanna19:01
*** jcooley_ has quit IRC19:03
*** ruhe has quit IRC19:05
tmckay1crobertsrh, hmm, for Pig arg is a dictionary, for Java actions it's just a list19:07
*** tmckay1 is now known as tmckay19:07
crobertsrhI see, so something a little bit different19:08
crobertsrhargs, but in a different sense19:08
crobertsrhMaybe a new "type" then?19:09
crobertsrhOr, given a dict, you turn it into a list?19:10
crobertsrhthe dict would look a bit funny though19:10
crobertsrhprobably not optimal19:10
tmckayI wonder if there is a way to have a conditional property in an xml schema, or to validate against one of a number of schemas19:10
tmckayIf (Java) args is a list else it's a dict19:11
tmckayI initially added "args" as another component, forgetting that it was in the job_configs property19:12
*** IlyaE has joined #savanna19:16
tmckaycrobertsrh, oh yeah, "oneOf"19:16
tmckayI think I can say that args is either a dict or a list of strings19:16
crobertsrhAh, that rings a bell19:16
crobertsrhthere still needs to be a way for the UI to know which form of "args" it should build.19:17
tmckayby job_type, or better yet, something in config_hints19:20
* tmckay runs for coffee19:20
crobertsrhyes, configs_hints is what I was thinking of19:48
*** jdev789 has joined #savanna19:56
*** alazarev has joined #savanna20:06
*** jdev789 has quit IRC20:13
*** alazarev has quit IRC20:24
*** ityaptin has quit IRC20:25
*** ityaptin has joined #savanna20:26
*** mattf is now known as _mattf20:27
*** _mattf is now known as mattf20:28
*** jdev789 has joined #savanna20:29
*** jdev789 has quit IRC20:33
*** jdev789 has joined #savanna20:49
openstackgerritJonathan Maron proposed a change to openstack/savanna: Enable EDP on private neutron networks  https://review.openstack.org/6351720:55
*** jcooley_ has joined #savanna20:58
tmckaycrobertsrh, okay, I fixed up the schemas with "oneOf".  The only downside I see is that the JSON stuff replies with "blah is not valid under any of the given schemas" but doesn't tell you why it mismatched in each case21:07
tmckayWithout oneOf, the errors are more specific21:07
tmckayBut it's probably worth the trade off21:09
crobertsrhseems ok to me21:12
tmckayYou can see the schemas at https://review.openstack.org/#/c/6315621:13
tmckaywork in progress21:13
crobertsrhlooks simple enough :)21:26
tmckaydoh, I forgot the java_otps21:41
tmckayopts21:41
*** alazarev has joined #savanna21:46
*** jcooley_ has quit IRC21:48
*** jcooley_ has joined #savanna21:49
*** qwerty_nor has quit IRC21:56
*** SergeyLukjanov has quit IRC22:22
*** rnirmal has quit IRC22:44
*** crobertsrh is now known as _crobertsrh22:45
*** tmckay has quit IRC22:55
*** venza has quit IRC23:07
*** venza has joined #savanna23:09
*** venza has quit IRC23:17
*** venza has joined #savanna23:19

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!