| *** matsuhashi has joined #savanna | 00:12 | |
| *** jvyas_ has joined #savanna | 00:29 | |
| jvyas_ | i wonder if distcp is gauranteed to always work between any two hadoop file systems | 00:30 |
|---|---|---|
| jvyas_ | savanna uses something like "distcp swift://mydata hdfs://mydata" <-- to do ETL into the savanna HDFS clusters, right ? | 00:30 |
| *** nosnos has joined #savanna | 00:33 | |
| jvyas_ | tmckay, ^^ if your around | 00:33 |
| *** nosnos_ has joined #savanna | 00:44 | |
| *** nosnos has quit IRC | 00:47 | |
| *** nosnos_ has quit IRC | 00:54 | |
| *** nosnos has joined #savanna | 00:54 | |
| *** IlyaE has quit IRC | 02:55 | |
| *** IlyaE has joined #savanna | 03:30 | |
| *** IlyaE has quit IRC | 04:17 | |
| *** IlyaE has joined #savanna | 04:44 | |
| *** IlyaE has quit IRC | 04:49 | |
| *** IlyaE has joined #savanna | 05:00 | |
| *** DinaBelova_ is now known as DinaBelova | 05:04 | |
| *** IlyaE has quit IRC | 05:06 | |
| *** IlyaE has joined #savanna | 05:53 | |
| *** nosnos_ has joined #savanna | 06:00 | |
| *** nosnos has quit IRC | 06:03 | |
| openstackgerrit | Jenkins proposed a change to openstack/savanna: Imported Translations from Transifex https://review.openstack.org/70918 | 06:08 |
| *** jcooley_ has joined #savanna | 06:26 | |
| *** matsuhashi has quit IRC | 06:33 | |
| *** matsuhashi has joined #savanna | 06:33 | |
| *** IlyaE_ has joined #savanna | 06:35 | |
| *** IlyaE has quit IRC | 06:38 | |
| *** jvyas_ has quit IRC | 06:38 | |
| *** IlyaE_ is now known as IlyaE | 06:39 | |
| *** jvyas_ has joined #savanna | 06:48 | |
| *** aignatov_ is now known as aignatov | 07:08 | |
| *** jcooley_ has quit IRC | 07:12 | |
| *** saju_m has joined #savanna | 07:12 | |
| *** akuznetsov has joined #savanna | 07:37 | |
| *** aignatov is now known as aignatov_ | 07:44 | |
| *** jcooley_ has joined #savanna | 07:48 | |
| *** akuznetsov has quit IRC | 07:54 | |
| *** jcooley_ has quit IRC | 07:56 | |
| *** IlyaE has quit IRC | 08:08 | |
| *** akuznetsov has joined #savanna | 08:13 | |
| *** tmckay has quit IRC | 08:30 | |
| *** aignatov_ is now known as aignatov | 08:45 | |
| *** aignatov is now known as aignatov_ | 10:13 | |
| *** jcooley_ has joined #savanna | 10:17 | |
| *** jcooley_ has quit IRC | 10:23 | |
| *** qwerty_nor has joined #savanna | 10:33 | |
| *** aignatov_ is now known as aignatov | 11:01 | |
| *** DinaBelova is now known as DinaBelova_ | 11:01 | |
| *** DinaBelova_ is now known as DinaBelova | 11:02 | |
| *** DinaBelova is now known as DinaBelova_ | 11:10 | |
| *** jcooley_ has joined #savanna | 11:13 | |
| *** jcooley_ has quit IRC | 11:19 | |
| *** nosnos_ has quit IRC | 11:30 | |
| *** tmckay has joined #savanna | 11:31 | |
| *** aignatov is now known as aignatov_ | 12:00 | |
| *** aignatov_ is now known as aignatov | 12:12 | |
| *** aignatov is now known as aignatov_ | 12:22 | |
| *** aignatov_ is now known as aignatov | 12:24 | |
| *** matsuhashi has quit IRC | 12:36 | |
| *** matsuhashi has joined #savanna | 12:36 | |
| *** DinaBelova_ is now known as DinaBelova | 12:38 | |
| *** matsuhashi has quit IRC | 12:41 | |
| *** DinaBelova is now known as DinaBelova_ | 12:52 | |
| *** DinaBelova_ is now known as DinaBelova | 12:55 | |
| *** DinaBelova is now known as DinaBelova_ | 12:55 | |
| *** DinaBelova_ is now known as DinaBelova | 13:01 | |
| *** DinaBelova is now known as DinaBelova_ | 13:10 | |
| *** ityaptin has quit IRC | 13:21 | |
| *** _crobertsrh is now known as crobertsrh | 13:34 | |
| *** ityaptin has joined #savanna | 13:41 | |
| *** saju_m has quit IRC | 13:41 | |
| openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page https://review.openstack.org/70120 | 13:47 |
| *** tmckay has left #savanna | 13:52 | |
| *** akuznetsov has quit IRC | 14:35 | |
| openstackgerrit | Daniele Venzano proposed a change to openstack/savanna-image-elements: Add an Hadoop CDH element https://review.openstack.org/69865 | 14:36 |
| *** dmitryme has joined #savanna | 14:45 | |
| *** jcooley_ has joined #savanna | 14:51 | |
| *** DinaBelova_ is now known as DinaBelova | 14:54 | |
| *** jcooley_ has quit IRC | 14:57 | |
| *** IlyaE has joined #savanna | 14:59 | |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Refactored unit tests structure https://review.openstack.org/70211 | 15:43 |
| *** jcooley_ has joined #savanna | 15:46 | |
| *** aignatov is now known as aignatov_ | 15:50 | |
| *** DinaBelova is now known as DinaBelova_ | 15:51 | |
| *** jcooley_ has quit IRC | 15:51 | |
| *** DinaBelova_ is now known as DinaBelova | 15:53 | |
| openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Intial Agent remote implementation https://review.openstack.org/71015 | 15:59 |
| openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Make remote pluggable https://review.openstack.org/68924 | 15:59 |
| openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Further preparation for transition to guest agent https://review.openstack.org/70107 | 15:59 |
| *** IlyaE has quit IRC | 16:05 | |
| *** jcooley_ has joined #savanna | 16:09 | |
| *** IvanBerezovskiy has left #savanna | 16:14 | |
| *** jvyas_ has quit IRC | 16:14 | |
| *** jvyas_ has joined #savanna | 16:16 | |
| *** IlyaE has joined #savanna | 16:34 | |
| openstackgerrit | Andrey Kurilin proposed a change to openstack/python-savannaclient: Adding missing entries in openstack-common.conf https://review.openstack.org/71021 | 16:34 |
| *** jcooley_ has quit IRC | 16:40 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 16:46 | |
| *** akuznetsov has joined #savanna | 16:56 | |
| *** akuznetsov has quit IRC | 17:00 | |
| *** akuznetsov has joined #savanna | 17:02 | |
| *** nadya has joined #savanna | 17:28 | |
| *** nadya is now known as Guest95141 | 17:28 | |
| *** jcooley_ has joined #savanna | 17:34 | |
| *** jcooley_ has quit IRC | 17:44 | |
| *** akuznetsov has quit IRC | 17:44 | |
| *** venza has quit IRC | 17:46 | |
| *** IlyaE has quit IRC | 17:46 | |
| *** venza_ has joined #savanna | 17:46 | |
| *** IlyaE has joined #savanna | 17:49 | |
| *** crobertsrh has quit IRC | 17:50 | |
| *** akuznetsov has joined #savanna | 17:50 | |
| *** akuznetsov has quit IRC | 17:51 | |
| *** Guest95141 has quit IRC | 17:53 | |
| *** akuznetsov has joined #savanna | 17:55 | |
| *** IlyaE has quit IRC | 17:56 | |
| jayunit100 | so, does anyone know much about how the internals of copy from SWIFT to HDFS is implemented in openstack? Is it just using distcp or something more specialized | 18:00 |
| *** dmitryme has quit IRC | 18:03 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov | 18:05 | |
| *** akuznetsov has quit IRC | 18:11 | |
| *** nadya has joined #savanna | 18:21 | |
| *** nadya is now known as Guest99724 | 18:22 | |
| *** jcooley_ has joined #savanna | 18:24 | |
| *** jcooley_ has quit IRC | 18:26 | |
| *** akuznetsov has joined #savanna | 18:28 | |
| *** akuznetsov has quit IRC | 18:29 | |
| openstackgerrit | A change was merged to openstack/savanna-dashboard: Adding object names to job-execution details page https://review.openstack.org/70120 | 18:33 |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add job-template-create to CLI https://review.openstack.org/69467 | 18:34 |
| *** akuznetsov has joined #savanna | 18:34 | |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add job-create to CLI https://review.openstack.org/69468 | 18:34 |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Map neutron_management_network to net_id in CLI https://review.openstack.org/69523 | 18:35 |
| *** akuznetsov has quit IRC | 18:35 | |
| *** akuznetsov has joined #savanna | 18:35 | |
| *** akuznetsov has quit IRC | 18:35 | |
| *** akuznetsov has joined #savanna | 18:35 | |
| *** akuznetsov has quit IRC | 18:36 | |
| *** akuznetsov has joined #savanna | 18:36 | |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add space to name for consistency https://review.openstack.org/70588 | 18:37 |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add --name option to appropriate show commands https://review.openstack.org/70595 | 18:41 |
| *** tmckay has joined #savanna | 18:42 | |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add --name option to appropriate delete commands https://review.openstack.org/70596 | 18:42 |
| *** Guest99724 has quit IRC | 18:42 | |
| *** akuznetsov has quit IRC | 18:42 | |
| *** jvyas_ has quit IRC | 18:45 | |
| *** IlyaE has joined #savanna | 18:50 | |
| *** jcooley_ has joined #savanna | 18:55 | |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add --name option to image unregister & tag cmds https://review.openstack.org/70597 | 18:57 |
| openstackgerrit | A change was merged to openstack/savanna-image-elements: Add an Hadoop CDH element https://review.openstack.org/69865 | 19:00 |
| *** crobertsrh has joined #savanna | 19:05 | |
| *** crobertsrh has left #savanna | 19:06 | |
| *** crobertsrh has joined #savanna | 19:06 | |
| *** jcooley_ has quit IRC | 19:17 | |
| *** nadya has joined #savanna | 19:19 | |
| *** nadya is now known as Guest29116 | 19:20 | |
| openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Moving main_class and java_opts to configs https://review.openstack.org/70810 | 19:31 |
| *** Guest29116 has quit IRC | 19:36 | |
| *** jcooley_ has joined #savanna | 19:36 | |
| *** dmitryme has joined #savanna | 19:36 | |
| jayunit100 | Can savanna run on any OS ? i think so but just confirming, i seen fedora and ubuntu, so i know those are covered. but is it pretty much automatic on any glance image | 19:37 |
| jayunit100 | ? | 19:37 |
| SergeyLukjanov | jayunit100, I'm running it on OS X | 19:37 |
| SergeyLukjanov | any *NIX I hope | 19:37 |
| jayunit100 | not host | 19:37 |
| jayunit100 | i mean, guests, the hadoop vms that savanna creates | 19:38 |
| SergeyLukjanov | jayunit100, oh | 19:38 |
| SergeyLukjanov | jayunit100, savanna uses ssh to control vm | 19:38 |
| SergeyLukjanov | and it depends on plugins too | 19:38 |
| dmitryme | jayunit: our current implementation expects bash to be installed | 19:38 |
| SergeyLukjanov | HDP is available only on specific OS | 19:38 |
| *** jcooley_ has quit IRC | 19:44 | |
| *** IlyaE has quit IRC | 19:47 | |
| *** jcooley_ has joined #savanna | 19:49 | |
| *** aignatov_ is now known as aignatov | 19:52 | |
| *** witlessb has joined #savanna | 19:53 | |
| openstackgerrit | A change was merged to openstack/savanna: Validation of job execution data should raise InvalidDataException https://review.openstack.org/69961 | 19:53 |
| witlessb | anyone has experience doing a dev setup using devstack+savanna? | 19:54 |
| mattf | i know crobertsrh has | 19:56 |
| mattf | i tend to do an install on a efw machines w/ rdo + packstack, then dev there | 19:57 |
| crobertsrh | witlessb: indeed I have | 19:57 |
| witlessb | crobertsrh: hey hey | 19:57 |
| crobertsrh | Let me guess...you just popped in to say how great it works and how easy it was? | 19:58 |
| witlessb | crobertsrh: yep | 19:58 |
| witlessb | :) | 19:58 |
| crobertsrh | awesome. good talk | 19:58 |
| witlessb | lol | 19:59 |
| witlessb | although savanna bit isn't quite working | 19:59 |
| crobertsrh | what are you seeing? | 19:59 |
| witlessb | I pretty much followed https://savanna.readthedocs.org/en/latest/devref/devstack.html (minus the vm bits) | 19:59 |
| witlessb | when I try to switch to savanna menu in the browser I get: | 20:00 |
| witlessb | ConnectionError at /savanna/ | 20:00 |
| witlessb | HTTPConnectionPool(host='192.168.42.102', port=8386): Max retries exceeded with url: /v1.1/1668d792fe8748b7bdc0554fa4928a73/clusters (Caused by <class 'socket.error'>: [Errno 111] Connection refused) | 20:00 |
| crobertsrh | Ok. is your savanna-api process running on that IP/port? | 20:01 |
| * witlessb checks | 20:01 | |
| witlessb | hmm. nothing is listening on that port | 20:02 |
| crobertsrh | Maybe check logs to see if savanna-api bailed out | 20:02 |
| crobertsrh | If the rest of your horizon dashboard is working, I'm guessing that the savanna-api process had "issues" | 20:02 |
| crobertsrh | And the fact that you can log in leads me to believe that it is working | 20:03 |
| *** jcooley_ has quit IRC | 20:03 | |
| witlessb | nods, I can poke around the rest of the ui without issues | 20:04 |
| witlessb | k, I'll go check the logs | 20:04 |
| witlessb | crobertsrh: ta ta | 20:04 |
| crobertsrh | good luck. let us know what you find. | 20:04 |
| witlessb | I shall! | 20:05 |
| crobertsrh | Especially if it was a mistake in the guide | 20:05 |
| *** jcooley_ has joined #savanna | 20:07 | |
| *** IlyaE has joined #savanna | 20:08 | |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/python-savannaclient: Changed base Resource class to prevent changing of passed arguments https://review.openstack.org/71086 | 20:16 |
| openstackgerrit | Andrey Kurilin proposed a change to openstack/python-savannaclient: Adding missing entries in openstack-common.conf https://review.openstack.org/71021 | 20:25 |
| mattf | aignatov, yt? | 20:37 |
| mattf | aignatov, i'm mulling over the implications of https://review.openstack.org/#/c/70340/ | 20:38 |
| aignatov | mattf, yep, but about asleep | 20:38 |
| mattf | ok, have a good night! | 20:39 |
| aignatov | mattf, I know the implications, most of old savannaclient-dependent apps like savannadashboard will not work with this patch | 20:41 |
| mattf | aignatov, you know i'm hesitant to break clients. do you see an option that we can keep compatibility? | 20:42 |
| mattf | btw, we need to keep track of these compat breaking changes and bump the client to 0.5 (not just 0.4.1 -> 0.4.2) | 20:42 |
| aignatov | I see the option - to allow users pass two parameters to the savannaclient __init__ - with old pattern and with new | 20:43 |
| mattf | fyi, our Client class needs some rationalizing, maybe even going to oslo apiclient | 20:45 |
| aignatov | I see, but all that blocks my development with integrating savanna resource to heat, because having current version of savannaclient in heat forces me to make bad code with unneeded workarounds | 20:47 |
| mattf | it's also a bunch of extra work | 20:48 |
| mattf | i attempted it a month+ back and it was major surgery on our client | 20:49 |
| aignatov | I didn't have a look at the oslo client yet, not known with that, sorry | 20:49 |
| mattf | aignatov, what's the change needed for client users? | 20:52 |
| aignatov | the change I made in https://review.openstack.org/#/c/70340/ all python-SOMEPROJECTclients use url pattern as http://HOST:PORT/VERSION/PROJECT_ID | 20:54 |
| openstackgerrit | A change was merged to openstack/savanna: Separated "tests for utils" and "utils for tests" in unit tests https://review.openstack.org/70025 | 20:55 |
| openstackgerrit | A change was merged to openstack/savanna: [Integration tests]Deleted unnecessary underscores https://review.openstack.org/70122 | 20:55 |
| openstackgerrit | A change was merged to openstack/savanna: Add <streaming> tag generation to mapreduce workflow https://review.openstack.org/69477 | 20:55 |
| mattf | aignatov, maybe i need to look at this more, but client's will now have to specify the project-id as part of their requests? | 20:55 |
| aignatov | also there is bug fixed when in the current code user passes parameters without savanna_url savannaclirnt still makes bad (not working at all) savanna_url because it adds extra /PROJECT_ID at the tail | 20:57 |
| aignatov | mattf, exactly | 20:57 |
| aignatov | it is needed because in case when user omits this parameter and savannaclient requests it in keystone then keystone returns url with /PROJECT_ID | 20:59 |
| aignatov | it's common approach for all openstacl clients | 20:59 |
| aignatov | as I understood it correctly | 20:59 |
| mattf | darn, cli uses project_name and dashboard uses project_id | 20:59 |
| aignatov | for the dashboard I've also made a patch https://review.openstack.org/#/c/70360/ | 21:01 |
| aignatov | which should be landed after merging the commit with savannaclient | 21:02 |
| aignatov | and release of new client | 21:02 |
| mattf | afaik we have 2 uses of the class, dashboard and cli | 21:02 |
| mattf | i'm happy to find a backward compat way to do this, but also ok breaking compat now while we're incubating | 21:03 |
| mattf | however, the python client version needs to bump to 0.5 | 21:03 |
| mattf | i can't tell you how frustrating it is for people to have API breakage in a "minor" (0.4.1 -> 0.4.2) update | 21:03 |
| mattf | i'll comment today, talk to you tomorrow | 21:04 |
| aignatov | ok,, agree with that, post a comment here | 21:04 |
| aignatov | there | 21:04 |
| mattf | nite! | 21:08 |
| *** aignatov is now known as aignatov_ | 21:15 | |
| witlessb | crobertsrh: if you are still here: it looks like stack.sh crashes during image uploading and never gets to starting savanna | 21:17 |
| witlessb | does that ring any bells? | 21:17 |
| crobertsrh | thinking about what I've seen | 21:18 |
| witlessb | it's http://download.cirros-cloud.net/0.3.1/cirros-0.3.1-x86_64-uec.tar.gz if that helps | 21:20 |
| crobertsrh | Is it failing to download that image? | 21:21 |
| witlessb | hmm. I'm not sure at which point it fails. it appears to be happening inside upload_image and with the image above | 21:23 |
| witlessb | wow. that's a pretty big function :| | 21:24 |
| crobertsrh | Hmm. I may have seen that before. Any failures in the nova services by any chance? | 21:26 |
| witlessb | lemme check | 21:28 |
| crobertsrh | is it failing on the glance image-upload command? | 21:29 |
| witlessb | nova seems to be ok | 21:29 |
| witlessb | trying to see where it fails exactly | 21:30 |
| crobertsrh | Maybe someone on #openstack-dev might be a better help on this one. | 21:30 |
| crobertsrh | or maybe #openstack | 21:30 |
| crobertsrh | I'm short on remedies at the moment | 21:30 |
| *** jcooley_ has quit IRC | 21:31 | |
| witlessb | crobertsrh: no worries; I'll try to track it down | 21:31 |
| witlessb | ty for help | 21:31 |
| crobertsrh | Ok. Good luck. Feel free to drop by here anytime. | 21:31 |
| *** DinaBelova is now known as DinaBelova_ | 21:32 | |
| *** mst89 has joined #savanna | 21:37 | |
| *** jayunit100 has quit IRC | 21:42 | |
| *** dmitryme has quit IRC | 21:50 | |
| *** mattf is now known as _mattf | 21:58 | |
| *** crobertsrh is now known as _crobertsrh | 22:04 | |
| *** jcooley_ has joined #savanna | 22:10 | |
| *** jcooley_ has quit IRC | 22:16 | |
| *** jcooley_ has joined #savanna | 22:17 | |
| *** _mattf is now known as mattf | 22:47 | |
| *** _crobertsrh has quit IRC | 22:47 | |
| *** qwerty_nor has quit IRC | 22:57 | |
| *** IlyaE has quit IRC | 23:06 | |
| *** ghenriks has joined #savanna | 23:41 | |
| *** ghenriks has quit IRC | 23:44 | |
| *** ghenriks has joined #savanna | 23:44 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!