Wednesday, 2013-08-28

*** sacharya has joined #savanna00:02
*** sacharya has quit IRC00:22
*** NikitaKonovalov has joined #savanna00:30
*** NikitaKonovalov has quit IRC00:35
*** dina_belova has joined #savanna00:41
*** dina_belova has quit IRC00:46
*** sacharya has joined #savanna00:58
*** NikitaKonovalov has joined #savanna01:31
*** NikitaKonovalov has quit IRC01:36
*** dina_belova has joined #savanna01:42
*** _mattf is now known as mattf01:43
*** dina_belova has quit IRC01:46
*** NikitaKonovalov has joined #savanna02:31
*** NikitaKonovalov has quit IRC02:36
*** dina_belova has joined #savanna02:42
*** dina_belova has quit IRC02:47
*** NikitaKonovalov has joined #savanna03:32
*** akuznetsov has joined #savanna03:33
*** sacharya has quit IRC03:35
*** NikitaKonovalov has quit IRC03:36
*** dina_belova has joined #savanna03:43
*** dina_belova has quit IRC03:48
*** akuznetsov has quit IRC04:14
*** NikitaKonovalov has joined #savanna04:33
*** NikitaKonovalov has quit IRC04:38
*** dina_belova has joined #savanna04:43
*** dina_belova has quit IRC04:47
*** akuznetsov has joined #savanna04:50
*** SergeyLukjanov has joined #savanna05:16
*** akuznetsov has quit IRC05:34
*** akuznetsov has joined #savanna05:34
*** akuznetsov has quit IRC05:41
*** dina_belova has joined #savanna05:44
*** dina_belova has quit IRC05:48
*** dmitryme has joined #savanna06:17
*** NikitaKonovalov has joined #savanna06:26
*** dina_belova has joined #savanna06:44
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Neutron support  https://review.openstack.org/4400106:45
*** dina_belova has quit IRC06:49
*** dina_belova has joined #savanna07:01
*** beginer has joined #savanna07:49
*** akuznetsov has joined #savanna08:01
*** ruhe has joined #savanna08:03
*** akuznetsov has quit IRC08:06
*** SergeyLukjanov has quit IRC08:24
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Neutron support  https://review.openstack.org/4400108:33
*** akuznetsov has joined #savanna08:45
*** dina_belova has quit IRC08:45
*** nprivalova has joined #savanna08:45
*** dina_belova has joined #savanna08:46
*** dina_belova has quit IRC08:50
*** dina_belova has joined #savanna08:53
*** NikitaKonovalov has quit IRC08:59
*** SergeyLukjanov has joined #savanna09:04
*** dina_belova has quit IRC09:12
*** dina_belova has joined #savanna09:13
*** dina_belova has quit IRC09:15
*** dina_belova has joined #savanna09:15
*** NikitaKonovalov has joined #savanna09:29
*** dina_belova has quit IRC09:36
*** dina_belova has joined #savanna09:36
*** NikitaKonovalov has quit IRC09:37
openstackgerritA change was merged to stackforge/savanna: Upgrade oslo and add periodic_task module  https://review.openstack.org/4373509:38
*** dina_belova has quit IRC09:40
*** NikitaKonovalov has joined #savanna09:43
*** SergeyLukjanov has quit IRC09:54
*** SergeyLukjanov has joined #savanna09:59
*** ruhe has quit IRC10:20
*** nprivalova has quit IRC10:25
openstackgerritIvan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors  https://review.openstack.org/4391610:35
openstackgerritIvan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors  https://review.openstack.org/4391610:36
*** ivan1 has joined #savanna10:40
*** dina_belova has joined #savanna10:47
*** dina_belova has quit IRC10:51
*** nprivalova has joined #savanna10:53
*** ruhe has joined #savanna11:00
*** dina_belova has joined #savanna11:04
openstackgerritIvan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors  https://review.openstack.org/4391611:07
*** NikitaKonovalov has quit IRC11:34
*** NikitaKonovalov has joined #savanna11:37
*** sacharya has joined #savanna11:41
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution  https://review.openstack.org/4347011:42
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Neutron support  https://review.openstack.org/4400111:46
openstackgerritIvan Berezovskiy proposed a change to stackforge/savanna-extra: Add diskimage-creating script, elements for mirrors  https://review.openstack.org/4391611:55
*** ruhe has quit IRC11:59
*** NikitaKonovalov has quit IRC12:04
openstackgerritAlexander Kuznetsov proposed a change to stackforge/python-savannaclient: Added support for Job Binaries and Job Executions API  https://review.openstack.org/4403812:05
*** nprivalova has quit IRC12:11
*** NikitaKonovalov has joined #savanna12:14
*** sacharya has quit IRC12:15
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: Get rid of pycrypto dep  https://review.openstack.org/4404012:19
*** dmitryme has quit IRC12:19
openstackgerritNikolay Mahotkin proposed a change to stackforge/savanna: Added hive workflow creator  https://review.openstack.org/4404112:20
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Neutron support  https://review.openstack.org/4400112:33
*** nprivalova has joined #savanna12:35
*** beginer has quit IRC12:42
*** ruhe has joined #savanna12:44
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution  https://review.openstack.org/4347012:45
*** dina_belova has quit IRC12:50
*** dmitryme has joined #savanna12:51
*** dina_belova has joined #savanna12:51
*** dina_belova has quit IRC12:55
*** SergeyLukjanov has quit IRC12:56
*** SergeyLukjanov has joined #savanna13:02
*** dina_belova has joined #savanna13:02
*** tmckay has quit IRC13:03
*** NikitaKonovalov has quit IRC13:18
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: Install configs to share/savanna from etc/savanna  https://review.openstack.org/4404913:22
*** ruhe has quit IRC13:23
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: Get rid of pycrypto dep  https://review.openstack.org/4404013:25
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring  https://review.openstack.org/4392513:26
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution  https://review.openstack.org/4347013:34
openstackgerritAlexander Kuznetsov proposed a change to stackforge/python-savannaclient: Added support for Job Binaries and Job Executions API  https://review.openstack.org/4403813:34
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution  https://review.openstack.org/4347013:39
openstackgerritAlexander Kuznetsov proposed a change to stackforge/python-savannaclient: Added support for Job Binaries and Job Executions API  https://review.openstack.org/4403813:44
*** sacharya has joined #savanna13:44
*** NikitaKonovalov has joined #savanna13:44
*** NikitaKonovalov has quit IRC13:45
*** NikitaKonovalov has joined #savanna13:46
*** dina_belova has quit IRC13:47
*** dina_belova has joined #savanna13:47
*** ruhe has joined #savanna13:51
*** dina_belova has quit IRC13:52
*** ruhe has quit IRC13:57
openstackgerritNikita Konovalov proposed a change to stackforge/savanna-dashboard: Neutron support  https://review.openstack.org/4405414:00
*** ruhe has joined #savanna14:01
openstackgerritVadim Rovachev proposed a change to stackforge/savanna: Added corrections to the documentation  https://review.openstack.org/4405514:01
*** ruhe has quit IRC14:04
*** tmckay has joined #savanna14:09
*** rnirmal has joined #savanna14:09
*** akuznetsov has quit IRC14:11
*** dina_belova has joined #savanna14:18
*** nprivalova has quit IRC14:19
*** dina_belova has quit IRC14:21
*** dina_belova has joined #savanna14:21
openstackgerritJonathan Maron proposed a change to stackforge/savanna: Enable the scaling up of nodes in a cluster  https://review.openstack.org/4353214:23
*** akuznetsov has joined #savanna14:25
openstackgerritNikita Konovalov proposed a change to stackforge/savanna-dashboard: Neutron support  https://review.openstack.org/4405414:26
*** NikitaKonovalov has quit IRC14:26
*** IlyaE has joined #savanna14:32
tmckaynprivalova, akuznetsov, I think I can make URLs for job binaries "normal", so that JobOrigin records can just list a URL.  "http://<savanna-host-port>/job-binaries/<id>/data" can retrieve raw data if we use "return data.encode('string_escape')" as the return result of the API function.  This gives the data back in the same form as it is received in job_binary_create.  From there, it can be copied, written to disk, etc.  What do you think?14:37
tmckayThat way, we don't need any special indicator for "internal db"14:38
openstackgerritA change was merged to stackforge/savanna: Install configs to share/savanna from etc/savanna  https://review.openstack.org/4404914:39
*** NikitaKonovalov has joined #savanna14:40
akuznetsovI think this is a good idea.14:40
openstackgerritA change was merged to stackforge/savanna: Add support of periodic tasks for edp needs  https://review.openstack.org/4362614:42
*** sacharya has quit IRC14:42
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added job execution after cluster start and operation for job execution  https://review.openstack.org/4347014:53
*** ruhe has joined #savanna14:58
tmckayakuznetsov, thanks15:00
tmckayI'll put up a CR soon with an addition to the job-binaries API15:01
*** nprivalova has joined #savanna15:02
tmckaynprivalova, hi, do you have scrollback handy?  If not I can repost a comment from a few minutes ago.15:04
tmckaybrb15:05
*** dina_belova has quit IRC15:06
*** dina_belova has joined #savanna15:07
nprivalovatmckay, hi!15:09
nprivalovatmckay, I'm ok with your idea15:10
*** dina_belova has quit IRC15:11
tmckaynprivalova, great, thanks.  I think it will simplify things15:11
*** sacharya has joined #savanna15:15
nprivalovatmckay, akuznetsov, crobertsrh, JFYI we'd like to have 3 main flows: mr, pig and hive. To make mr work we need to send configs through POST into job_execute. Our url is @rest.post('/jobs/<job_id>/execute/from/<input_id>/to/<output_id>/on/'15:22
nprivalova           '<cluster_id>') . Currently we don't use data from this request, but we should. So I'd like to starting on this part (adding additional field 'param' in JobExecution, validation e.g.). Besides it is needed not to breake transient cluster starting15:22
tmckaynprivalova, sounds good to me15:23
*** rnirmal has quit IRC15:23
*** rnirmal has joined #savanna15:24
*** NikitaKonovalov has quit IRC15:30
akuznetsovnprivalova agree15:31
openstackgerritSergey Reshetnyak proposed a change to stackforge/savanna: Fix "Broken Cinder Volume"  https://review.openstack.org/4407915:37
crobertsrhnprivalova:  That sounds reasonable to me (sorry, I didn't hear my "bing" when you messaged).15:42
openstackgerritVadim Rovachev proposed a change to stackforge/savanna: Integration tests refactoring  https://review.openstack.org/4408015:44
tmckayquestion to all, are there tests for the REST api itself?  I see tests for the conductor, but I am not aware of http tests.  Do they exist?15:44
*** sacharya has left #savanna15:45
*** sacharya has joined #savanna15:45
rnirmaltmckay: there's tests for api validation if that's what you are looking for.. don't think there's functional/unit http api tests15:46
tmckayrnirmal, I'm thinking of something that parses responses and makes sure they are of the correct form, and that expected errors are returned, etc.15:48
tmckayfor instance, we expect wrapped responses but that's easy to miss (unless someone has sharp eyes in a code review)15:49
ruheUT coverage is a subject for improvement. see http://jenkins.savanna.mirantis.com/job/gate-savanna-coverage/331/cobertura/?15:50
rnirmaltmckay: I see that would be good to add... I've added some as part of a bug fix https://github.com/stackforge/savanna/blob/master/savanna/tests/unit/service/validation/test_cluster_create_validation.py#L32815:50
rnirmalis that what you are thinking of ?15:51
*** ruhe has quit IRC15:52
*** ivan1 has left #savanna15:54
tmckayrnirmal, yes, that's pretty close I think.  The data looks like JSON -- it's just a level or two below the actual v10.py REST api, if I understand it correctly.15:54
rnirmalright it's passing in json.. but not invoking the rest api15:56
tmckayrnirmal, for that matter, we haven't added any edp service validation tests that I can see..15:56
tmckayall the tests are under the conductor.15:57
tmckayI wonder if there are appropriate tests to add to service validation15:57
tmckaymaybe something to swing back to15:57
rnirmalyeah there's definitely opportunities to add more tests15:57
rnirmaltmckay: like plugin validations?15:58
tmckayrnirmal, I'm not familiar with the plugin validations.  Essentially, it seems to me that we should be able to create automated tests for good/bad REST requests and ensure proper responses.  It feels like something is missing without it :)16:01
tmckayI have been living in the REST api for edp so it's on my mind ;-)16:02
tmckayso, I would acutally use httplib or urllib or some other wrapper and send requests all the way through, and examine the responses.16:04
rnirmaltmckay: yeah that would definitely be nice to have. I know nova used to have stubs for the wsgi layer16:06
rnirmalto make actual http requests and examine responses. It could also fall under the integration tests.. where nothing need to be mocked16:07
tmckayrnirmal, I'll make a note to add a bug (request for enhancement, some say) for this.16:08
rnirmal:) that would be a good addition to the tests16:09
*** akuznetsov has quit IRC16:12
*** dmitryme has quit IRC16:15
*** NikitaKonovalov has joined #savanna16:15
*** dina_belova has joined #savanna16:17
*** nprivalova has quit IRC16:19
*** dina_belova has quit IRC16:22
*** ruhe has joined #savanna16:33
*** dmitryme has joined #savanna16:33
*** SergeyLukjanov has quit IRC16:40
*** ruhe has quit IRC16:42
*** ruhe has joined #savanna16:42
*** NikitaKonovalov has quit IRC16:47
*** NikitaKonovalov has joined #savanna16:47
*** IlyaE has quit IRC16:52
*** dina_belova has joined #savanna16:54
*** ruhe has quit IRC16:59
* tmckay thinks "six" is a bad name for a compatibility lilbrary in Python16:59
tmckaycute, but bad16:59
*** mattf is now known as _mattf17:04
*** SergeyLukjanov has joined #savanna17:05
*** NikitaKonovalov has quit IRC17:10
*** ruhe has joined #savanna17:10
*** NikitaKonovalov has joined #savanna17:11
*** IlyaE has joined #savanna17:17
*** _mattf is now known as mattf17:23
openstackgerritA change was merged to stackforge/savanna: Enable the scaling up of nodes in a cluster  https://review.openstack.org/4353217:26
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: Integration test refactoring  https://review.openstack.org/4392517:34
*** ruhe has quit IRC17:37
*** dmitryme has quit IRC17:46
*** NikitaKonovalov has quit IRC17:46
*** NikitaKonovalov has joined #savanna17:47
*** NikitaKonovalov has quit IRC17:51
*** NikitaKonovalov has joined #savanna17:52
*** NikitaKonovalov has quit IRC17:55
*** NikitaKonovalov has joined #savanna17:56
*** NikitaKonovalov has quit IRC18:03
*** NikitaKonovalov has joined #savanna18:05
*** akuznetsov has joined #savanna18:09
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: Get rid of pycrypto dep  https://review.openstack.org/4404018:10
*** NikitaKonovalov has quit IRC18:21
*** IlyaE has quit IRC18:22
*** NikitaKonovalov has joined #savanna18:22
*** akuznetsov has quit IRC18:30
*** akuznetsov has joined #savanna18:32
*** openstack has joined #savanna18:46
*** dkoryavov has joined #savanna18:55
*** dkoryavov has left #savanna18:55
*** SergeyLukjanov has quit IRC18:58
*** SergeyLukjanov has joined #savanna18:59
*** IlyaE has joined #savanna19:04
*** akuznetsov has quit IRC19:17
*** IlyaE has quit IRC19:20
*** NikitaKonovalov has quit IRC19:26
*** dmitryme has joined #savanna19:36
*** IlyaE has joined #savanna19:38
*** mattf is now known as _mattf19:38
openstackgerritTrevor McKay proposed a change to stackforge/savanna: Extend JobBinary REST api to allow retrieval of raw data  https://review.openstack.org/4408819:39
*** dina_belova has quit IRC20:00
*** dina_belova has joined #savanna20:01
*** IlyaE has quit IRC20:01
*** SergeyLukjanov has quit IRC20:05
*** dina_belova has quit IRC20:05
*** NikitaKonovalov has joined #savanna20:27
*** NikitaKonovalov has quit IRC20:31
*** crobertsrh is now known as _crobertsrh20:50
*** dmitryme has quit IRC20:55
*** tmckay has quit IRC20:57
*** dina_belova has joined #savanna21:01
*** dina_belova has quit IRC21:05
*** dina_belova has joined #savanna21:11
*** dina_belova has quit IRC21:15
*** NikitaKonovalov has joined #savanna21:27
*** NikitaKonovalov has quit IRC21:32
*** sacharya has quit IRC21:41
*** dina_belova has joined #savanna22:12
*** dina_belova has quit IRC22:16
*** IlyaE has joined #savanna22:18
*** _mattf is now known as mattf22:19
*** NikitaKonovalov has joined #savanna22:27
*** NikitaKonovalov has quit IRC22:32
*** sacharya has joined #savanna22:53
*** dina_belova has joined #savanna23:12
*** dina_belova has quit IRC23:16
*** NikitaKonovalov has joined #savanna23:28
*** NikitaKonovalov has quit IRC23:32
*** sacharya has quit IRC23:43
*** rnirmal has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!