Monday, 2014-02-03

*** matsuhashi has joined #savanna00:16
*** akuznetsov has quit IRC00:25
*** ylobankov has quit IRC00:25
*** akuznets_ has joined #savanna00:28
*** akuznetsov has joined #savanna00:28
*** jcooley_ has joined #savanna00:29
*** akuznets_ has quit IRC00:30
*** SergeyLukjanov has joined #savanna00:31
*** jcooley has quit IRC00:32
*** jcooley_ is now known as jcooley00:32
*** _mattf` has quit IRC00:32
*** _crobertsrh has quit IRC00:32
*** NikitaKonovalov_ has quit IRC00:32
*** SergeyLukjanov_a has quit IRC00:32
*** ylobankov1 has joined #savanna00:33
*** ylobankov1 has quit IRC00:37
*** matsuhashi has quit IRC00:38
*** _mattf has joined #savanna00:39
*** openstackgerrit has quit IRC00:41
*** NikitaKonovalov_ has joined #savanna00:44
*** NikitaKonovalov_ is now known as NikitaKonovalov00:44
*** akuznetsov has quit IRC00:56
*** SergeyLukjanov has quit IRC00:56
*** jcooley has quit IRC00:56
*** ityaptin has quit IRC00:56
*** bogdando has quit IRC00:56
*** NikitaKonovalov has quit IRC00:56
*** aignatov_ has quit IRC00:56
*** DinaBelova_ has quit IRC00:56
*** _mattf has quit IRC00:56
*** venza has quit IRC00:56
*** ChanServ has quit IRC00:56
*** NikitaKonovalov has joined #savanna01:03
*** SergeyLukjanov has joined #savanna01:03
*** jcooley has joined #savanna01:03
*** akuznetsov has joined #savanna01:03
*** ityaptin has joined #savanna01:03
*** bogdando has joined #savanna01:03
*** aignatov_ has joined #savanna01:03
*** DinaBelova_ has joined #savanna01:03
*** venza has joined #savanna01:03
*** ChanServ has joined #savanna01:03
*** wolfe.freenode.net sets mode: +o ChanServ01:03
*** NikitaKonovalov has quit IRC01:04
*** aignatov_ has quit IRC01:04
*** DinaBelova_ has quit IRC01:04
*** matsuhashi has joined #savanna01:08
*** ylobankov has joined #savanna01:12
*** aignatov has joined #savanna01:12
*** DinaBelo` has joined #savanna01:14
*** DinaBelo` is now known as DinaBelova01:14
*** aignatov has quit IRC01:14
*** DinaBelova has quit IRC01:18
*** matsuhashi is now known as 45PABAKC501:21
*** matsuhashi has joined #savanna01:21
*** _mattf` has joined #savanna01:21
*** aignatov_ has joined #savanna01:23
*** NikitaKonovalov_ has joined #savanna01:23
*** NikitaKonovalov_ is now known as NikitaKonovalov01:24
*** aignatov_ is now known as aignatov01:24
*** ylobankov has quit IRC01:24
*** 45PABAKC5 has quit IRC01:25
*** ylobankov has joined #savanna01:30
*** _mattf` has quit IRC01:32
*** _mattf` has joined #savanna01:32
*** crobertsrh has joined #savanna01:32
*** crobertsrh has quit IRC01:43
*** ylobankov has quit IRC01:43
*** akuznetsov has quit IRC01:47
*** nosnos has joined #savanna01:48
*** DinaBelova has joined #savanna01:48
*** akuznetsov has joined #savanna01:48
*** ylobankov has joined #savanna01:50
*** crobertsrh1 has joined #savanna01:53
*** crobertsrh1 has quit IRC01:53
*** nosnos has quit IRC01:53
*** DinaBelova has quit IRC01:53
*** akuznetsov has quit IRC01:53
*** nosnos has joined #savanna01:54
*** DinaBelova has joined #savanna01:54
*** akuznetsov has joined #savanna01:54
*** crobertsrh1 has joined #savanna01:55
*** crobertsrh1 has quit IRC01:56
*** ylobankov has quit IRC02:00
*** DinaBelova has quit IRC02:05
*** nosnos has quit IRC02:28
*** akuznetsov has quit IRC02:28
*** nosnos has joined #savanna02:34
*** akuznetsov has joined #savanna02:34
*** crobertsrh has joined #savanna02:41
*** akuznetsov has quit IRC03:19
*** aignatov has quit IRC04:09
*** NikitaKonovalov has quit IRC04:09
*** _mattf` has quit IRC04:17
*** crobertsrh has quit IRC04:22
*** crobertsrh has joined #savanna04:28
*** ylobankov has joined #savanna04:28
*** crobertsrh1 has joined #savanna04:34
*** crobertsrh has quit IRC04:34
*** nosnos has quit IRC04:42
*** nosnos has joined #savanna04:43
*** crobertsrh1 has quit IRC04:58
*** matsuhashi has quit IRC05:29
*** ylobankov has quit IRC05:29
*** nosnos has quit IRC05:36
*** nosnos_ has joined #savanna05:59
*** ylobankov has joined #savanna05:59
*** crobertsrh has joined #savanna05:59
*** ylobankov1 has joined #savanna06:06
*** matsuhas_ has joined #savanna06:09
*** ylobankov has quit IRC06:09
*** nosnos_ has quit IRC06:09
*** nosnos has joined #savanna06:15
*** ylobankov has joined #savanna06:16
*** ylobankov1 has quit IRC06:24
*** crobertsrh has quit IRC06:30
*** crobertsrh has joined #savanna06:33
*** matsuhashi has joined #savanna06:34
*** matsuhas_ has quit IRC06:35
*** matsuhashi has quit IRC06:43
*** crobertsrh has quit IRC06:43
*** crobertsrh1 has joined #savanna06:45
*** nosnos has quit IRC06:50
*** matsuhashi has joined #savanna06:50
*** nosnos_ has joined #savanna06:51
*** crobertsrh1 has quit IRC07:14
*** crobertsrh has joined #savanna07:14
*** crobertsrh has quit IRC07:33
*** nosnos_ has quit IRC07:33
*** matsuhashi has quit IRC07:33
*** SergeyLukjanov has quit IRC08:03
*** SergeyLukjanov has joined #savanna08:15
*** crobertsrh has joined #savanna08:22
*** nosnos_ has joined #savanna08:22
*** matsuhashi has joined #savanna08:22
*** ylobankov has quit IRC08:22
*** SergeyLukjanov has quit IRC08:23
*** ylobankov has joined #savanna08:30
*** ylobankov has quit IRC08:31
*** ylobankov has joined #savanna08:37
*** ylobankov has quit IRC08:54
*** ylobankov has joined #savanna08:56
*** crobertsrh has quit IRC09:04
*** nosnos_ has quit IRC09:04
*** matsuhashi has quit IRC09:05
*** matsuhas_ has joined #savanna09:05
*** nosnos has joined #savanna09:06
*** crobertsrh has joined #savanna09:06
*** IvanBerezovskiy has joined #savanna09:20
*** nosnos has quit IRC09:21
*** crobertsrh has quit IRC09:21
*** venza has quit IRC09:22
*** crobertsrh has joined #savanna09:42
*** _nadya_ has joined #savanna09:50
*** venza has joined #savanna10:05
*** venza has quit IRC10:05
*** venza has joined #savanna10:05
*** nosnos has joined #savanna10:05
*** nosnos_ has joined #savanna10:07
*** nosnos has quit IRC10:10
*** openstack has joined #savanna13:16
*** dmitryme has joined #savanna13:24
aignatovmattf, crobertsrh, tmckay hi, do not be scared when savanna-ci tells you nothing today!13:28
aignatovdatacenter guys've started upgrade our ci with new SSD drives :)13:29
mattfaignatov, i'm already scared!13:33
* mattf is also scarred13:33
mattfaignatov, i'd appreciate your input on the api - no ci needed there13:33
mattfaignatov, i left out the contentious pieces. i provided what i think we can all agree on.13:33
mattfi'd like to figure out the validations and config hints this week13:33
*** ylobankov has joined #savanna13:33
aignatovmattf, what validations checks do you mean?13:34
mattfaignatov, the config validation -- can this input be converted13:35
aignatovyou mean input from cluster and node group templates?13:37
*** akuznetsov has joined #savanna13:38
*** matsuhas_ has quit IRC13:39
mattfaignatov, i mean things like post_file('/plugins/<plugin_name>/<version>/convert-config/<name>') and get('/jobs/config-hints/<job_type>'). you had good suggestions on config-hints. i want us to codify them in the review13:49
mattfor a subsequent review13:49
aignatovgotcha!13:50
mattfi'll chat w/ SergeyLukjanov later about his implementation roadblock in front of the api agreement13:52
mattfhe's getting to enjoy fosdem now tho, eh? lucky guy13:53
*** mattf is now known as _mattf14:00
aignatovactually he is coming back right now:)14:03
*** dmitryme has quit IRC14:04
*** _mattf has quit IRC14:08
*** _mattf has joined #savanna14:08
*** nadya_ has joined #savanna14:12
*** akuznetsov has quit IRC14:12
*** akuznetsov has joined #savanna14:12
*** nadya__ has joined #savanna14:17
*** ylobankov1 has joined #savanna14:17
*** akuznets_ has joined #savanna14:20
*** nadya_ has quit IRC14:21
*** akuznetsov has quit IRC14:21
*** ylobankov has quit IRC14:21
*** nadya__ has quit IRC14:39
*** aignatov is now known as aignatov_14:42
*** DinaBelova is now known as DinaBelova_14:44
*** DinaBelova_ is now known as DinaBelova14:46
*** _mattf has quit IRC14:52
*** akuznets_ has quit IRC14:58
*** aignatov_ is now known as aignatov14:59
*** aignatov is now known as aignatov_15:02
*** nadya has joined #savanna15:05
*** akuznetsov has joined #savanna15:06
*** aignatov_ is now known as aignatov15:31
*** aignatov is now known as aignatov_15:37
*** nadya has quit IRC15:40
*** nadya has joined #savanna15:40
*** akuznetsov has quit IRC15:40
*** nadya has quit IRC15:41
*** akuznetsov has joined #savanna15:51
*** ChanServ has quit IRC15:57
*** _mattf has joined #savanna15:59
*** _mattf is now known as mattf15:59
mattffreenode melting down?16:00
*** ChanServ has joined #savanna16:21
*** wolfe.freenode.net sets mode: +o ChanServ16:21
*** aignatov_ is now known as aignatov16:30
*** mattf has quit IRC16:36
*** akuznetsov has quit IRC16:36
*** aignatov is now known as aignatov_16:43
*** mattf has joined #savanna17:00
*** akuznetsov has joined #savanna17:00
*** IlyaE has joined #savanna17:17
*** akuznetsov has quit IRC17:58
*** akuznetsov has joined #savanna17:58
*** akuznetsov has quit IRC17:58
*** nadya has joined #savanna18:16
*** tmckay has joined #savanna18:26
*** nadya has quit IRC18:48
*** mattf is now known as _mattf18:52
*** _mattf is now known as mattf18:53
*** ChanServ has quit IRC19:02
*** ChanServ has joined #savanna19:05
*** wolfe.freenode.net sets mode: +o ChanServ19:05
*** IlyaE has quit IRC19:06
*** IlyaE has joined #savanna19:30
*** qwerty_nor has joined #savanna19:32
*** openstackgerrit has joined #savanna19:43
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page  https://review.openstack.org/7012019:44
openstackgerritSergey Reshetnyak proposed a change to openstack/savanna: Add configuration integration test for IDH plugin  https://review.openstack.org/7081919:51
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Moving main_class and java_opts to configs  https://review.openstack.org/7081019:57
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add <streaming> tag generation to mapreduce workflow  https://review.openstack.org/6947720:03
openstackgerritTrevor McKay proposed a change to openstack/savanna: Extract configs beginning with "edp." from job_configs['configs']  https://review.openstack.org/6971220:05
openstackgerritTrevor McKay proposed a change to openstack/savanna: Generate streaming tag in mapreduce job  https://review.openstack.org/6972720:06
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add validation check for streaming elements on MapReduce without libs  https://review.openstack.org/6996020:06
openstackgerritTrevor McKay proposed a change to openstack/savanna: Move 'main_class' and 'java_opts' into edp.java configs  https://review.openstack.org/6998220:06
openstackgerritTrevor McKay proposed a change to openstack/savanna: Add integration test for streaming mapreduce  https://review.openstack.org/7082920:18
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page  https://review.openstack.org/7012020:38
*** tmckay has quit IRC20:47
*** tmckay has joined #savanna20:54
*** tmckay has quit IRC20:55
*** tmckay has joined #savanna20:56
openstackgerritChad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page  https://review.openstack.org/7012020:56
*** DinaBelova is now known as DinaBelova_20:56
*** tmckay has quit IRC21:16
*** tmckay has joined #savanna21:22
*** Jpeerindex has joined #savanna21:46
Jpeerindextmckay: how come all of these hdfs putting of jar files into hdfs.  I thought ooze could upload a jar into hdfs  for you  but maybe I'm mistaken21:50
tmckayJpeerindex, oozie has the <files> and <archives> tags, which can let you reference something already in hdfs on a long running cluster21:52
*** Jpeerindex is now known as jayunit10021:52
tmckay(we don't support that yet)21:52
jayunit100okay fixed my nick21:53
jayunit100okay, but can you give ooze a path to a local jar?21:53
tmckayjayunit100, but even when you run something from the oozie command line on a node, you have to put the stuff in hdfs first21:53
tmckaynot that I know of21:53
jayunit100and say : run this job --- it just seems like ooze should be smart enough to put stuff in HDFS for ITSELF.  you know what i mean?21:53
jayunit100yeah, i didn't know that21:54
jayunit100that sucks.21:54
tmckayyes, I know what you mean.  I haven't seen an example of that21:54
jayunit100'hadoop jar' does it for you :)21:54
tmckayThe tutorials have you putting stuff in hdfs first21:54
jayunit100yeah, sorry , my ooze is weak21:54
tmckaylol, maybe we should have just wrapped remote hadoop commands21:54
tmckayI can't say for absolute certain but I'm pretty sure you have to stage the files first.  The Oozie distributes them *from* hdfs to the local nodes where they actually run.21:55
*** crobertsrh is now known as _crobertsrh21:59
*** IlyaE has quit IRC22:04
jayunit100thats lame22:12
jayunit100so people normally upload jars into hdfs in SHELL scripts and THEN run submit ooze xml files?22:13
jayunit100ugh22:13
tmckayyes22:13
jayunit100maybe they should rename "ooze" to "poopy" ? tmckay22:14
tmckayjayunit100, I'm finding some posts that say it's possible but custom22:14
tmckay:)22:14
tmckaythere is apparently an oozie copy action...22:14
tmckaynot sure if that goes hdfs -> hdfs or something else.... looking.  You've piqued my interest22:15
tmckaysorry, FS action22:15
jayunit100gotcha22:21
jayunit100well, you'll find I'm good at distracting people to chase down some dumb idea that isn't relevant to the task at hand.22:21
*** tmckay has quit IRC22:24
*** tmckay has joined #savanna22:25
openstackgerritAndrew Lazarev proposed a change to openstack/savanna: Refactored unit tests structure  https://review.openstack.org/7021122:36
*** qwerty_nor has quit IRC23:21
*** IlyaE has joined #savanna23:33

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!