| *** matsuhashi has joined #savanna | 00:27 | |
| *** nosnos has joined #savanna | 00:34 | |
| *** SergeyLukjanov has joined #savanna | 01:58 | |
| *** SergeyLukjanov has quit IRC | 02:35 | |
| openstackgerrit | A change was merged to openstack/savanna-dashboard: Adding help text to clarify the name field for job binaries https://review.openstack.org/52162 | 03:00 |
|---|---|---|
| *** akuznetsov has joined #savanna | 04:15 | |
| *** akuznetsov has quit IRC | 05:08 | |
| *** sacharya has quit IRC | 05:12 | |
| *** DennyZhang has joined #savanna | 05:20 | |
| *** akuznetsov has joined #savanna | 05:27 | |
| *** DennyZhang has quit IRC | 05:31 | |
| *** DennyZhang has joined #savanna | 05:31 | |
| *** DennyZhang has quit IRC | 05:38 | |
| *** DennyZhang has joined #savanna | 05:38 | |
| *** DennyZhang has quit IRC | 05:57 | |
| *** akuznetsov has quit IRC | 06:11 | |
| *** nadya has joined #savanna | 06:14 | |
| *** dmitryme has joined #savanna | 06:26 | |
| *** nadya has quit IRC | 06:38 | |
| *** akuznetsov has joined #savanna | 06:38 | |
| openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Added Technical Considerations page for EDP https://review.openstack.org/52198 | 06:41 |
| *** akuznetsov has quit IRC | 06:43 | |
| *** dmitryme has quit IRC | 07:31 | |
| *** akuznetsov has joined #savanna | 07:40 | |
| *** dafter has joined #savanna | 07:53 | |
| *** dguitarbite has quit IRC | 08:09 | |
| *** nprivalova has joined #savanna | 08:15 | |
| *** akuznetsov has quit IRC | 08:47 | |
| *** dafter has quit IRC | 09:17 | |
| *** dafter has joined #savanna | 09:18 | |
| *** dafter has quit IRC | 09:19 | |
| *** dafter has joined #savanna | 09:31 | |
| *** dafter has quit IRC | 09:52 | |
| *** dafter has joined #savanna | 09:53 | |
| *** nprivalova is now known as nadya | 09:56 | |
| *** dafter has quit IRC | 09:57 | |
| *** dafter has joined #savanna | 09:57 | |
| *** dafter has quit IRC | 10:03 | |
| *** tvb|afk has joined #savanna | 10:06 | |
| *** tvb|afk has quit IRC | 10:06 | |
| *** tvb|afk has joined #savanna | 10:07 | |
| *** tvb|afk has quit IRC | 10:11 | |
| *** venza_ has joined #savanna | 10:12 | |
| *** venza_ is now known as venza | 10:14 | |
| *** nadya has quit IRC | 10:17 | |
| *** dafter has joined #savanna | 10:26 | |
| *** akuznetsov has joined #savanna | 10:30 | |
| *** nprivalova has joined #savanna | 10:42 | |
| *** matsuhashi has quit IRC | 10:44 | |
| *** matsuhashi has joined #savanna | 10:45 | |
| *** matsuhashi has quit IRC | 10:45 | |
| *** matsuhashi has joined #savanna | 10:46 | |
| *** matsuhashi has quit IRC | 10:46 | |
| *** matsuhashi has joined #savanna | 10:47 | |
| *** matsuhashi has quit IRC | 10:51 | |
| *** DinaBelova has joined #savanna | 11:02 | |
| openstackgerrit | A change was merged to openstack/savanna-extra: Add example edp jobs folder and pig example https://review.openstack.org/51892 | 11:10 |
| *** akuznetsov has quit IRC | 11:11 | |
| *** akuznetsov has joined #savanna | 11:31 | |
| openstackgerrit | Alexander Kuznetsov proposed a change to openstack/savanna-dashboard: Added transient cluster creation for job launch https://review.openstack.org/51208 | 11:38 |
| openstackgerrit | Alexander Kuznetsov proposed a change to openstack/savanna-dashboard: Added transient cluster creation for job launch https://review.openstack.org/51208 | 11:48 |
| *** nosnos has quit IRC | 11:48 | |
| *** nosnos has joined #savanna | 11:49 | |
| *** nosnos has quit IRC | 11:54 | |
| *** dmitryme has joined #savanna | 12:07 | |
| openstackgerrit | Dmitry Mescheryakov proposed a change to openstack/savanna: Refreshed sample config files https://review.openstack.org/52360 | 12:09 |
| *** dmitryme has quit IRC | 12:23 | |
| *** _crobertsrh is now known as crobertsrh | 12:25 | |
| *** DinaBelova has quit IRC | 12:34 | |
| *** DinaBelova has joined #savanna | 12:36 | |
| *** DinaBelova has quit IRC | 12:50 | |
| *** DinaBelova has joined #savanna | 12:51 | |
| *** DinaBelova has quit IRC | 13:03 | |
| *** sacharya has joined #savanna | 13:12 | |
| *** tmckay has joined #savanna | 13:23 | |
| *** tmckay has quit IRC | 13:25 | |
| *** tmckay has joined #savanna | 13:26 | |
| tmckay | nprivalova, I think I may have told an untruth in the edp doc :) Is this statement true? | 13:26 |
| tmckay | for Data Sources "The Swift service must be running on the Hadoop cluster where the MapReduce job is executing." | 13:27 |
| tmckay | For Job Binaries I said this: | 13:27 |
| tmckay | "Currently, the Swift service must be running as part of the same OpenStack installation where Savanna is running. " | 13:27 |
| nprivalova | the second statement is ok. Swift cannot be running on Hadoop cluster :) | 13:28 |
| tmckay | there is only 1 swift service, correct? We just have different URLs (swift-internal:// for jobs and swift:// accessed from MapReduce) | 13:28 |
| tmckay | right, I thought of this last night :) I'll fix. | 13:28 |
| tmckay | I have an aignatov comment to fix too | 13:29 |
| nprivalova | yes, only one swift. Maybe we should fix this difference in prefixes | 13:29 |
| tmckay | well, we need something to distinguish internal/external | 13:30 |
| tmckay | It could be a boolean, I suppose. external=true | 13:30 |
| tmckay | of course, for now we don't have external anyway, so we could just have "swift" and fix it later. But, probably too late for 0.3 :) | 13:31 |
| *** SergeyLukjanov has joined #savanna | 13:32 | |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 13:33 | |
| *** _SergeyLukjanov is now known as SergeyLukjanov | 13:33 | |
| tmckay | aignatov, hmm, dmitryme is not here. But, I could see adding the EDP Technical Considerations to the EDP page after the Workflow section. | 13:34 |
| aignatov | tmckay, hi, I just proposed that idea, not sure if I'm coorrect | 13:36 |
| tmckay | I just posted a comment, there is a way to have 1 page with multiple top-level headings so each section shows up in the TOC. | 13:37 |
| tmckay | The best of both worlds? | 13:37 |
| aignatov | I agree with your comments | 13:40 |
| aignatov | for dmitryme patch | 13:40 |
| tmckay | okay, I can put up two patch sets. I'll fix EDP as is and submit that, then I'll try pasting dmitryme stuff in | 13:41 |
| tmckay | if we don't like it I can undo it. | 13:42 |
| openstackgerrit | Ilya Tyaptin proposed a change to openstack/savanna: Fix bug with auth_token in trusts https://review.openstack.org/52391 | 13:44 |
| tmckay | nprivalova, so do we anticipate someday that EDP will be able to access jobs/data in a swift service located anywhere on the planet? | 13:45 |
| *** sacharya has quit IRC | 13:45 | |
| tmckay | swift.example.com/v1/account/container/object | 13:45 |
| nprivalova | tmckay, the thing is that it is theoretically possible :) | 13:45 |
| *** sacharya has joined #savanna | 13:46 | |
| tmckay | but for now, we are tied to something we can find through keystone, yes? | 13:46 |
| *** sacharya has quit IRC | 13:47 | |
| nprivalova | hmm, yes. We have keystone auth_url in core-site that's why we ask only username and password for swift. If user wants to work with internal swift he may tell all needed info for us: external_auth_url, username and password | 13:52 |
| nprivalova | *with external | 13:52 |
| tmckay | okay, thanks. can external_auth_url be specified in job configs? Not sure I've seen an example of that. | 13:54 |
| nprivalova | no, we do not have such a config for now | 13:54 |
| tmckay | aignatov, so for now, the main class for a jar job must always be in libs? Is there any point in putting anything in mains? | 14:05 |
| openstackgerrit | A change was merged to openstack/savanna: Fix bug with auth_token in trusts https://review.openstack.org/52391 | 14:05 |
| aignatov | tmckay, actually there is no flow in edp to support Jars with main classed, user always has to define Mapper and Reducer classse | 14:08 |
| aignatov | also we can put anything to mains but I don't imagin such flow how it'll be used in current edp :) | 14:09 |
| tmckay | okay. I'll make a note that for jars, users should not specify a main binary, only libs, and must specify mapper/reducer | 14:10 |
| openstackgerrit | A change was merged to openstack/savanna: Refreshed sample config files https://review.openstack.org/52360 | 14:14 |
| *** dafter has quit IRC | 14:23 | |
| *** dafter has joined #savanna | 14:23 | |
| *** dafter has joined #savanna | 14:23 | |
| *** sacharya has joined #savanna | 14:27 | |
| *** dafter has quit IRC | 14:28 | |
| *** rnirmal has joined #savanna | 14:30 | |
| *** mattf is now known as _mattf | 14:40 | |
| *** dafter has joined #savanna | 14:41 | |
| *** dafter has joined #savanna | 14:41 | |
| *** nprivalova is now known as nadya | 15:02 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 15:14 |
| * aignatov finishes my REST API 1.1 | 15:18 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 15:18 |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 15:21 |
| tmckay | brb, then I will try putting dmitryme technical content on the edp page | 15:22 |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna: Added REST API v1.1 section https://review.openstack.org/50946 | 15:24 |
| aignatov | tmckay, also I'm asking you to review again my https://review.openstack.org/50946 | 15:24 |
| * aignatov never wants to describe new APIs | 15:25 | |
| *** _mattf is now known as mattf | 15:32 | |
| openstackgerrit | A change was merged to openstack/savanna: Add content to userdoc/edp.rst https://review.openstack.org/51017 | 15:48 |
| *** dmitryme has joined #savanna | 15:48 | |
| tmckay | aignatov, sure :) Let me push up a new edp page first | 15:53 |
| tmckay | dmitryme, I am going to try appending your tech stuff to the EDP page and we can see how it looks. | 15:53 |
| tmckay | then decide | 15:53 |
| dmitryme | tmckay, yep ok, lets see how it looks | 15:54 |
| *** dafter has quit IRC | 15:58 | |
| *** akuznetsov has quit IRC | 15:58 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Include the EDP Technical Considerations page in the EDP page https://review.openstack.org/52441 | 16:04 |
| tmckay | dimtryme, aignatov, okay there it is ^^ | 16:04 |
| *** dafter has joined #savanna | 16:05 | |
| *** dafter has quit IRC | 16:06 | |
| *** dafter has joined #savanna | 16:06 | |
| *** sreshetnyak has joined #savanna | 16:09 | |
| *** sacharya has quit IRC | 16:09 | |
| dmitryme | tmckay, yep looks good to me | 16:10 |
| tmckay | cool | 16:10 |
| *** dafter has quit IRC | 16:11 | |
| *** DinaBelova has joined #savanna | 16:14 | |
| tmckay | aignatov, reviewed, I'll read it again :) I tried to move quickly (night time in Saratov :) ) | 16:22 |
| aignatov | tmckay. don't hurry, I'll work more becuase of checking is Savanna still support other features like cinder volumes and anty-affinity | 16:23 |
| tmckay | okay :) I have the release deadline in my mind, heh. | 16:24 |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Include the EDP Technical Considerations page in the EDP page https://review.openstack.org/52441 | 16:27 |
| tmckay | aignatov, just a technical question. do mapreduce.reduce.class and mapred.reducer.class do the same thing? Synonyms? Same for mapreduce.map and mapred.mapper? | 16:33 |
| aignatov | tmckay, I think yes, actually I never checked it, it depends on Hadoop API version, there are old and new apis in Hadoop. | 16:36 |
| aignatov | tmckay, regrding your comment about job configs during job launching - can I add example for pig job not for jar and about maper and reducer classes | 16:43 |
| aignatov | ? | 16:43 |
| tmckay | Sure, that sounds okay. mapper and reducer class parameters are only needed for jar, though, right? Will we say that again here? | 16:46 |
| *** DennyZhang has joined #savanna | 16:46 | |
| *** nadya has quit IRC | 16:52 | |
| *** DennyZhang has quit IRC | 16:57 | |
| *** DennyZhang has joined #savanna | 16:57 | |
| aignatov | right, only for Jar, don't want to explain in rest api samples, it's just a samples, experienced Hadoop user must know which parameteres he will use. | 17:01 |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna: Added REST API v1.1 section https://review.openstack.org/50946 | 17:03 |
| tmckay | k | 17:04 |
| *** sacharya has joined #savanna | 17:11 | |
| *** mattf is now known as _mattf | 17:13 | |
| tmckay | aignatov, okay, I think that's just about it! I don't see any more open reviews that need to be done | 17:14 |
| * tmckay grabs some coffee | 17:14 | |
| *** crobertsrh is now known as crobertsrh-lunch | 17:17 | |
| *** _mattf is now known as mattf | 17:22 | |
| *** akuznetsov has joined #savanna | 17:27 | |
| *** ruhe has joined #savanna | 17:28 | |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna: Added REST API v1.1 section https://review.openstack.org/50946 | 17:34 |
| *** SergeyLukjanov has quit IRC | 17:37 | |
| *** crobertsrh-lunch is now known as crobertsrh | 17:48 | |
| *** NikitaKonovalov has joined #savanna | 17:48 | |
| *** SergeyLukjanov has joined #savanna | 17:50 | |
| *** nadya has joined #savanna | 17:52 | |
| *** sacharya has quit IRC | 17:52 | |
| *** ruhe has quit IRC | 17:54 | |
| *** DennyZhang has quit IRC | 17:54 | |
| SergeyLukjanov | team meeting will be in #openstack-meeting-alt channel in 10 mins | 17:54 |
| *** alazarev has joined #savanna | 17:56 | |
| * tmckay rushes in to get a good seat | 17:56 | |
| nadya | Havana is released!! | 18:00 |
| tmckay | Havana, savanna, what next? | 18:00 |
| openstackgerrit | A change was merged to openstack/savanna: Include the EDP Technical Considerations page in the EDP page https://review.openstack.org/52441 | 18:00 |
| SergeyLukjanov | Icehouse | 18:00 |
| SergeyLukjanov | Icevanna :) | 18:00 |
| tmckay | lol | 18:00 |
| alazarev | Icanna | 18:01 |
| openstackgerrit | A change was merged to openstack/savanna: Added REST API v1.1 section https://review.openstack.org/50946 | 18:01 |
| *** sacharya has joined #savanna | 18:01 | |
| * tmckay has been so in to savanna today he didn't realize his corporate email client isn't running | 18:02 | |
| SergeyLukjanov | tmckay :) | 18:02 |
| *** ruhe has joined #savanna | 18:03 | |
| *** IlyaE has joined #savanna | 18:03 | |
| *** ylobankov has joined #savanna | 18:10 | |
| *** NikitaKonovalov has quit IRC | 18:11 | |
| *** nadya_ has joined #savanna | 18:12 | |
| *** NikitaKonovalov has joined #savanna | 18:13 | |
| *** nadya has quit IRC | 18:15 | |
| *** nadya_ is now known as nadya | 18:20 | |
| *** DinaBelova has quit IRC | 18:51 | |
| *** ylobankov has left #savanna | 18:54 | |
| *** ruhe has quit IRC | 19:07 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: Use release version of python-savannaclient https://review.openstack.org/52479 | 19:10 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna-dashboard: Use release version of python-savannaclient https://review.openstack.org/52480 | 19:11 |
| *** IlyaE has quit IRC | 19:33 | |
| *** ruhe has joined #savanna | 19:50 | |
| *** NikitaKonovalov has quit IRC | 19:50 | |
| *** mattf is now known as _mattf | 19:52 | |
| *** NikitaKonovalov has joined #savanna | 19:52 | |
| *** NikitaKonovalov has quit IRC | 19:53 | |
| *** IlyaE has joined #savanna | 19:56 | |
| *** alazarev has quit IRC | 20:02 | |
| *** nadya has quit IRC | 20:07 | |
| *** _mattf is now known as mattf | 20:12 | |
| *** dmitryme has quit IRC | 20:15 | |
| *** SergeyLukjanov has quit IRC | 20:15 | |
| *** nadya has joined #savanna | 20:15 | |
| *** nadya has quit IRC | 20:32 | |
| *** dmitryme has joined #savanna | 20:36 | |
| *** akuznetsov has quit IRC | 20:37 | |
| *** ruhe has quit IRC | 20:38 | |
| *** sreshetnyak has quit IRC | 20:53 | |
| *** sacharya has quit IRC | 20:59 | |
| *** crobertsrh is now known as _crobertsrh | 21:11 | |
| *** SergeyLukjanov has joined #savanna | 21:13 | |
| *** dmitryme has quit IRC | 21:22 | |
| *** mattf is now known as _mattf | 21:36 | |
| *** sacharya has joined #savanna | 21:40 | |
| *** aignatov_ has joined #savanna | 21:43 | |
| *** aignatov has quit IRC | 21:44 | |
| *** IlyaE has quit IRC | 21:47 | |
| *** _mattf is now known as mattf | 21:52 | |
| *** IlyaE has joined #savanna | 22:01 | |
| *** tmckay has quit IRC | 22:09 | |
| *** tmckay has joined #savanna | 22:30 | |
| openstackgerrit | A change was merged to openstack/savanna-dashboard: Use release version of python-savannaclient https://review.openstack.org/52480 | 23:36 |
| openstackgerrit | A change was merged to openstack/savanna: Use release version of python-savannaclient https://review.openstack.org/52479 | 23:37 |
| *** rnirmal has quit IRC | 23:57 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!