Friday, 2013-09-27

*** kbroughton has joined #savanna00:17
*** matsuhashi has joined #savanna00:28
*** sacharya has joined #savanna00:37
*** nosnos has joined #savanna00:38
*** rnirmal has quit IRC00:39
*** sacharya has quit IRC01:50
*** sacharya has joined #savanna01:51
*** matsuhashi has quit IRC03:15
*** matsuhashi has joined #savanna03:56
*** sacharya1 has joined #savanna04:23
*** sacharya has quit IRC04:26
*** SergeyLukjanov has joined #savanna04:31
*** kbroughton has quit IRC05:10
*** akuznetsov has joined #savanna05:26
*** sacharya1 has quit IRC05:26
*** SergeyLukjanov has quit IRC05:29
*** SergeyLukjanov has joined #savanna05:42
*** SergeyLukjanov has quit IRC05:44
*** IlyaE has joined #savanna05:55
*** akuznetsov has quit IRC06:25
*** akuznetsov has joined #savanna06:26
*** NikitaKonovalov has joined #savanna06:28
*** akuznetsov has quit IRC06:48
openstackgerritSergey Reshetnyak proposed a change to stackforge/savanna: Add running hdfs operations from plugin specific user  https://review.openstack.org/4823207:36
*** dmitryme has joined #savanna07:41
*** SergeyLukjanov has joined #savanna07:53
*** macjack has joined #savanna08:09
*** SergeyLukjanov has quit IRC08:09
*** macjack has quit IRC08:10
openstackgerritIlya Tyaptin proposed a change to stackforge/savanna: Trusts for longrunning tasks  https://review.openstack.org/4470608:10
*** macjack has joined #savanna08:11
*** macjack has quit IRC08:12
*** SergeyLukjanov has joined #savanna08:13
*** gals has joined #savanna08:19
*** DinaBelova has joined #savanna08:22
*** DinaBelova has quit IRC08:43
*** NikitaKonovalov has quit IRC08:47
*** IlyaE has quit IRC08:49
*** dmitryme has quit IRC08:54
*** NikitaKonovalov has joined #savanna08:58
openstackgerritNikita Konovalov proposed a change to stackforge/python-savannaclient: Sync with dashboard  https://review.openstack.org/4845808:59
*** dmitryme has joined #savanna09:01
*** alazarev has joined #savanna09:16
openstackgerritNikita Konovalov proposed a change to stackforge/savanna-dashboard: Migrate to using python-savannaclient  https://review.openstack.org/4860709:16
openstackgerritNikolay Mahotkin proposed a change to stackforge/savanna-dashboard: Job configs based on job type  https://review.openstack.org/4829009:24
openstackgerritA change was merged to stackforge/python-savannaclient: Sync with dashboard  https://review.openstack.org/4845809:28
*** NikitaKonovalov has quit IRC09:30
*** dmitryme has quit IRC09:59
openstackgerritA change was merged to stackforge/savanna: Integration test refactoring  https://review.openstack.org/4392510:03
*** NikitaKonovalov has joined #savanna10:04
openstackgerritNikolay Mahotkin proposed a change to stackforge/savanna: Add /jobs/config-hints/<job_type> REST API call  https://review.openstack.org/4541910:04
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna-dashboard: Job Origins migrated to Jobs  https://review.openstack.org/4808110:04
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna-dashboard: Migrate to using python-savannaclient 0.3a1  https://review.openstack.org/4860710:04
*** dmitryme has joined #savanna10:07
*** NikitaKonovalov_ has joined #savanna10:11
*** NikitaKonovalov has quit IRC10:13
*** NikitaKonovalov_ is now known as NikitaKonovalov10:13
*** alazarev has quit IRC10:19
*** alazarev has joined #savanna10:20
*** NikitaKonovalov has quit IRC10:23
*** NikitaKonovalov has joined #savanna10:24
openstackgerritIlya Tyaptin proposed a change to stackforge/savanna: Trusts for longrunning tasks  https://review.openstack.org/4470610:30
*** DinaBelova has joined #savanna10:30
*** DinaBelova has quit IRC10:33
*** alazarev has quit IRC10:36
*** NikitaKonovalov has quit IRC10:37
*** esmute has quit IRC10:37
*** esmute has joined #savanna10:47
*** alazarev has joined #savanna10:48
*** matsuhashi has quit IRC10:52
*** alazarev has quit IRC10:54
*** kbroughton has joined #savanna11:00
*** alazarev has joined #savanna11:08
*** _mattf is now known as mattf11:25
openstackgerritNikolay Mahotkin proposed a change to stackforge/savanna: Add /jobs/config-hints/<job_type> REST API call  https://review.openstack.org/4541911:34
*** NikitaKonovalov has joined #savanna11:37
*** matsuhashi has joined #savanna11:44
*** NikitaKonovalov has quit IRC11:46
*** SergeyLukjanov has quit IRC11:55
*** alazarev has quit IRC12:01
*** matsuhashi has quit IRC12:01
*** alazarev has joined #savanna12:03
*** SergeyLukjanov has joined #savanna12:05
*** dmitryme has quit IRC12:05
*** matsuhashi has joined #savanna12:10
*** matsuhashi has quit IRC12:11
*** dmitryme has joined #savanna12:14
*** gals has quit IRC12:17
*** alazarev has quit IRC12:21
*** tmckay has quit IRC12:28
*** _crobertsrh is now known as crobertsrh12:29
*** matsuhashi has joined #savanna12:35
*** kbroughton has quit IRC12:52
*** kbroughton has joined #savanna12:55
*** alazarev has joined #savanna12:57
openstackgerritDmitry Mescheryakov proposed a change to stackforge/savanna: Implement threaded SSH for provisioning and Vanilla plugin  https://review.openstack.org/4864613:00
*** kbroughton has quit IRC13:07
*** nosnos has quit IRC13:15
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: Rename folder "integration_new" to "integration"  https://review.openstack.org/4865213:17
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: Migration to new integration tests  https://review.openstack.org/4865213:19
*** kbroughton has joined #savanna13:26
mattfany of you guys/gals know how to move the ephemeral instance storage location? i want it off my root partition.13:28
*** tmckay has joined #savanna13:38
crobertsrhQuestion:  For data sources, it looks like "Swift" is currently the only supported type.  Is that correct, or is someone working on additional types?13:48
aignatovhi crobertsrh, very good questio, yes it seems we have new one in draft13:51
aignatovhttps://review.openstack.org/#/c/47828/13:51
aignatovI've added you to watch this13:52
crobertsrhThanks13:52
aignatovif you want you can take it and check how it works, as I remebered from Renat it works on external HDFS13:53
aignatovi didn't check it yet13:53
SergeyLukjanovmattf, I've never tried to do it… are you using devstack?13:54
SergeyLukjanovI mean AIO installation?13:54
aignatovcrobertsrh, is Trevor working on this bp https://blueprints.launchpad.net/savanna/+spec/epd-job-origin-from-swift ?13:55
mattfSergeyLukjanov, i'm using an rdo havana install13:56
crobertsrhaignatov:  I believe that he is13:56
aignatovso i'm assigning it for him13:57
aignatovthanks13:57
crobertsrhaignatov:  I will take a look at it.  I'm about to do some work on the UI for data sources.  I will add HDFS as an option there (currently, we have a select box with only one option, which was odd.  That's what spawned my original question).13:58
aignatovI see13:58
aignatovanother question from me13:58
aignatovabout this https://blueprints.launchpad.net/savanna/+spec/epd-job-origin-from-database13:59
aignatovit seems it's already implemented13:59
crobertsrhYes, I think it is already implemented....checking to see if it has been merged.14:00
crobertsrhYes, looks like it has been merged, but wasn't really tagged with the blueprint.  https://review.openstack.org/#/c/46910/14:01
aignatovhmm, do anyone know how to attach patch to bp directly?14:04
aignatovI know ^)14:04
aignatov:)14:04
aignatovhust add a coment with link to patch)14:04
aignatov*just14:04
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: Migration to new integration tests  https://review.openstack.org/4865214:09
*** rnirmal has joined #savanna14:13
crobertsrhAnother question:  Is it ok for a UI change request to be set to depend on a savanna-api change request?  ie:  no problem with a dep across projects?14:18
SergeyLukjanovcrobertsrh, I don't know how to do it :(14:20
crobertsrhOk, no worries.  I just won't do "git review" until the api change is merged.14:20
SergeyLukjanovoh :)14:20
*** tmckay has quit IRC14:22
*** tmckay has joined #savanna14:31
openstackgerritA change was merged to stackforge/savanna-dashboard: Adding on-the-fly script creation  https://review.openstack.org/4804414:31
openstackgerritA change was merged to stackforge/savanna-dashboard: Removing swift-external from job binaries  https://review.openstack.org/4811414:32
*** matsuhashi has quit IRC14:51
openstackgerritA change was merged to stackforge/savanna: Add running hdfs operations from plugin specific user  https://review.openstack.org/4823214:56
aignatovtmckay, hi15:07
tmckayaignatov, hi15:07
*** dmitryme has quit IRC15:08
aignatovi think this bp https://blueprints.launchpad.net/savanna/+spec/edp-job-configs-params is already implemented15:08
aignatovam I correct?15:08
aignatovI see only Nadya's patch attached to this bp15:09
tmckaywell, I think it has changed15:09
aignatovhttps://review.openstack.org/4444215:09
tmckayJob's don't contain configs anymore, only job executions.  Jobs only point to binaries15:09
aignatovbut Nadya's patch talks us that it's partially implemented15:09
aignatovso, may we change it's status to Implemented or it's still beta available?15:12
aignatovwhat do you think?15:12
tmckayaignatov, if you look at https://review.openstack.org/44442, parts of it are superseded by https://review.openstack.org/#/c/48000/15:13
*** DinaBelova has joined #savanna15:13
aignatovoh, I see it, indeed15:13
tmckayI think it's implemented.  Jobs are configurable with configs, args, and params, that much is true.  But all config comes at execution time afaik, there is no way to store config for later use.15:14
aignatovagree15:14
aignatovI'll change it15:14
tmckayokay.15:14
aignatovam asking you and Chad about implemented bps ann bugs just to make sure that we didn't missing something)15:15
tmckaygood idea :)15:15
tmckayI lost what I had done for swift internals so far, but most of the time was "learning".  There was not much code yet, so I15:16
*** dmitryme has joined #savanna15:16
tmckayI'll reproduce it today and continue15:16
aignatovno problems, I'm also trying to dig deeper into edp to make full comprehension of this activity too :)15:19
*** IlyaE has joined #savanna15:21
crobertsrhtmckay, anyone else:  For data sources, any idea what the urls for swift and hdfs need to look like?  I'm working on the UI to provide "hints", but it's unclear to me what they need to be just based on looking at the validation code.15:34
tmckaycrobertsrh, I imagine data source swift url will be the same as for job binary... that is15:37
tmckayswift-internal://contain/object15:37
crobertsrhok, I'll go with that for now15:37
tmckay(container that is)15:37
crobertsrhhdfs should just be "hdfs://whatever"?15:37
tmckayfor internal, it means that it's local and keystone provides the endpoints, etc, and fills in the account information.  A full swift url is swift://host/account/container/object15:38
tmckaybut the client puts that stuff together15:38
tmckayhdfs, I am unsure...15:38
*** DinaBelova has quit IRC15:42
*** DinaBelova has joined #savanna15:49
tmckaycrobertsrh, fyi, based on the latest we won't support swift-external yet, but swift-external I believe means that we need all the information supplied by the user to acess the external, including an auth url if it's not the same, and a user name and password.15:51
crobertsrhok, that is good info15:51
tmckaycrobertsrh, I believe this stuff would be stored in the job-binary, along with the url.  We'll have to confirm with Nadya when she gets back though, I think details are a little fuzzy.15:51
crobertsrhok15:52
tmckaycroberts, fyi on the master branch the validation for data_source just has "credentials" as type "object" with no other validation16:03
tmckayfor job_binary, it has an "extra" field that may contain stuff for accessing binaries, assumably for externals16:04
tmckayso I think there still is some fuzz16:04
tmckayreboot...16:04
*** tmckay has quit IRC16:06
*** tmckay has joined #savanna16:19
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: Migration to new integration tests  https://review.openstack.org/4865216:32
*** dmitryme has quit IRC16:37
*** dmitryme has joined #savanna16:41
*** sacharya has joined #savanna16:48
*** DinaBelova has quit IRC17:00
*** SergeyLukjanov has quit IRC17:03
*** alazarev has quit IRC17:09
*** mattf is now known as _mattf17:15
tmckaydmitryme, aignatov, just fyi, crobertsrh repro'd the awful tox -e py27 test on his matching Lenovo T510 with the same dismal performance numbers writing to disk.17:16
tmckayas a side project, I am going to try to inject the Python profiler into the tox test and find out why it's so bad17:17
tmckaymaybe this weekend :)17:17
*** _mattf is now known as mattf17:27
*** _tstclair has quit IRC17:37
*** mattf is now known as _mattf17:45
*** SergeyLukjanov has joined #savanna17:50
*** _mattf is now known as mattf17:52
*** tmckay1 has joined #savanna17:54
*** DinaBelova has joined #savanna18:09
*** IlyaE has quit IRC19:01
openstackgerritChad Roberts proposed a change to stackforge/savanna-dashboard: Fixing data-source details view  https://review.openstack.org/4872519:10
openstackgerritChad Roberts proposed a change to stackforge/savanna-dashboard: Fixing data-source details view  https://review.openstack.org/4872519:12
*** DinaBelova has quit IRC19:17
openstackgerritChad Roberts proposed a change to stackforge/savanna-dashboard: Fixing job-binaries details page.  https://review.openstack.org/4872919:24
*** IlyaE has joined #savanna19:30
*** dmitryme has quit IRC19:37
openstackgerritChad Roberts proposed a change to stackforge/savanna-dashboard: Fixing job-binaries details page  https://review.openstack.org/4872919:56
*** tmckay has left #savanna19:57
*** SergeyLukjanov has quit IRC19:58
*** mattf is now known as _mattf19:59
*** tmckay1 is now known as tmckay20:03
*** crobertsrh is now known as _crobertsrh20:42
*** rnirmal has quit IRC21:11
*** tmckay has left #savanna21:30
*** IlyaE has quit IRC22:21
*** sacharya has left #savanna22:28

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!