Thursday, 2014-02-13

*** qwerty_nor has quit IRC00:10
openstackgerritMatthew Farrellee proposed a change to openstack/savanna-image-elements: Add generic java element  https://review.openstack.org/7311100:37
openstackgerritMatthew Farrellee proposed a change to openstack/savanna-image-elements: Add generic ssh element  https://review.openstack.org/7311400:50
*** IlyaE has quit IRC01:17
*** xuhanp has joined #savanna01:39
*** nosnos has joined #savanna02:00
*** sballe_ has joined #savanna02:09
*** ghenriks has joined #savanna02:11
*** SergeyLukjanov has quit IRC02:13
*** aignatov_ has quit IRC02:13
*** DinaBelova_ has quit IRC02:14
*** SergeyLukjanov has joined #savanna02:15
*** NikitaKonovalov has quit IRC02:15
*** number80 has quit IRC02:15
*** ruhe has quit IRC02:15
*** nosnos_ has joined #savanna02:15
*** sballe has quit IRC02:19
*** _crobertsrh has quit IRC02:19
*** ghenriks_ has quit IRC02:19
*** nosnos has quit IRC02:22
*** bogdando has quit IRC02:22
*** aignatov_ has joined #savanna02:23
*** aignatov_ is now known as aignatov02:23
*** NikitaKonovalov_ has joined #savanna02:24
openstackgerritYongli He proposed a change to openstack/savanna: Use six.moves.urllib.parse instead of urlparse  https://review.openstack.org/7288302:24
*** NikitaKonovalov_ is now known as NikitaKonovalov02:26
*** DinaBelova_ has joined #savanna02:26
*** DinaBelova_ is now known as DinaBelova02:27
*** ruhe has joined #savanna02:27
*** coolsvap has quit IRC02:30
*** sballe_ has quit IRC02:32
*** ruhe has quit IRC02:32
*** NikitaKonovalov has quit IRC02:32
*** nosnos has joined #savanna02:32
*** nosnos_ has quit IRC02:33
*** aignatov has quit IRC02:34
*** DinaBelova has quit IRC02:35
*** NikitaKonovalov has joined #savanna02:38
*** ruhe has joined #savanna02:38
*** sballe has joined #savanna02:38
*** aignatov_ has joined #savanna02:39
*** aignatov_ is now known as aignatov02:40
*** DinaBelova_ has joined #savanna02:40
*** DinaBelova_ is now known as DinaBelova02:41
*** ochento has joined #savanna02:41
*** ochento is now known as number8002:44
*** number80 has quit IRC02:45
*** number80 has joined #savanna02:45
*** SergeyLukjanov2 has joined #savanna02:45
*** DinaBelova has quit IRC02:45
*** DinaBelova_ has joined #savanna02:47
*** DinaBelova_ is now known as DinaBelova02:47
*** sreshetn1ak has joined #savanna02:47
*** nosnos has quit IRC02:49
*** SergeyLukjanov has quit IRC02:49
*** xuhanp has quit IRC02:50
*** sreshetniak has quit IRC02:50
*** SergeyLukjanov2 is now known as SergeyLukjanov02:50
*** NikitaKonovalov_ has joined #savanna02:52
*** nosnos has joined #savanna02:56
*** NikitaKonovalov has quit IRC02:57
*** NikitaKonovalov_ is now known as NikitaKonovalov02:57
*** sreshetn1ak has quit IRC03:06
*** sreshetniak has joined #savanna03:07
*** bogdando has joined #savanna03:29
*** mattf has quit IRC03:29
*** mattf has joined #savanna03:29
*** IlyaE has joined #savanna04:05
*** penguinRaider has joined #savanna05:04
*** DinaBelova is now known as DinaBelova_05:15
*** IlyaE has quit IRC05:15
openstackgerritYongli He proposed a change to openstack/savanna: emove extraneous vim configuration comments  https://review.openstack.org/7315405:53
*** penguinRaider has quit IRC05:55
openstackgerritJenkins proposed a change to openstack/savanna: Imported Translations from Transifex  https://review.openstack.org/7091806:09
*** _nadya_ has joined #savanna06:41
*** akuznetsov has quit IRC06:58
*** akuznetsov has joined #savanna06:59
*** _nadya_ has quit IRC07:03
*** akuznetsov has quit IRC07:06
*** akuznetsov has joined #savanna07:10
*** IlyaE has joined #savanna07:22
*** IlyaE has quit IRC07:23
*** tnovacik has joined #savanna07:32
*** penguinRaider has joined #savanna07:57
*** IvanBerezovskiy has joined #savanna08:09
IvanBerezovskiymattf, ping08:10
*** akuznetsov has quit IRC08:12
*** aignatov has quit IRC08:15
*** openstackgerrit has quit IRC08:16
*** aignatov_ has joined #savanna08:17
*** aignatov_ is now known as aignatov08:17
*** bogdando has quit IRC08:38
*** bogdando has joined #savanna08:39
*** witlessb has joined #savanna08:50
*** saju_m has joined #savanna08:50
*** dmitryme has joined #savanna09:00
*** DinaBelova_ is now known as DinaBelova09:32
aignatovtmckay: SergeyLukjanov , yes, I wanted to start working on unit tests for savanna-client09:54
*** akuznetsov has joined #savanna10:14
*** tosky has joined #savanna10:44
*** qwerty_nor has joined #savanna11:07
*** skolekonov has joined #savanna11:47
mattfIvanBerezovskiy, pong12:04
IvanBerezovskiymattf, hi. I wanted to ask about all duplications :)12:06
IvanBerezovskiymattf, if you'll clean up them, it's ok12:06
mattfok. there are a few more in review atm. so it's best to clean up after.12:13
mattfaignatov, SergeyLukjanov, i'm gonna need your +2 swords on the java & ssh image element reviews12:14
aignatovmattf, it's on my queue12:14
SergeyLukjanovmattf, I'm on it12:16
*** jcooley has quit IRC12:17
mattfthanks guys12:19
SergeyLukjanovmattf, my +2 on both of them12:20
mattffyi, i'm going to miss all or most of the meeting today for a pt appt12:20
*** jcooley has joined #savanna12:20
SergeyLukjanovmattf, "pt appt"?12:23
SergeyLukjanovmattf, appt == application?12:23
mattfSergeyLukjanov, appt == appointment, pt = physical therapy -- my knee12:29
SergeyLukjanovmattf, oh, good luck12:29
mattfthx12:30
*** NikitaKonovalov is now known as NikitaKonovalov_12:43
*** sballe has quit IRC12:50
*** sballe has joined #savanna12:51
*** witlessb has quit IRC13:02
*** witlessb has joined #savanna13:03
*** NikitaKonovalov_ is now known as NikitaKonovalov13:05
*** nosnos has quit IRC13:10
*** dmitryme has quit IRC13:19
*** sballe has quit IRC13:29
*** sballe has joined #savanna13:29
*** daniil has joined #savanna13:37
*** dmitryme has joined #savanna13:39
*** crobertsrh has joined #savanna13:40
*** jmaron has joined #savanna14:10
*** dmitryme has quit IRC14:22
*** saju_m has quit IRC14:28
*** dmitryme has joined #savanna14:31
*** akuznetsov has quit IRC14:38
*** tnovacik has quit IRC14:43
*** akuznetsov has joined #savanna15:04
*** skolekonov has quit IRC15:07
*** crobertsrh has quit IRC15:18
*** akuznetsov has quit IRC15:19
*** akuznetsov has joined #savanna15:22
*** crobertsrh has joined #savanna15:32
*** IlyaE has joined #savanna15:33
*** openstackgerrit has joined #savanna15:47
*** IvanBerezovskiy has left #savanna15:54
*** aignatov is now known as aignatov_15:54
tmckayaignatov_, okay, I was doing forensics on something completely unrelated :)  I was going to read up on tempest...  And also, review the roadmap for EDP.  We should talk about unit tests, maybe at the meeting in a few hours16:03
* tmckay runs for a snack16:03
*** venza_ has quit IRC16:04
*** venza has joined #savanna16:05
*** saju_m has joined #savanna16:08
*** crobertsrh2 has joined #savanna16:16
*** crobertsrh2 has left #savanna16:17
*** alcabrera has joined #savanna16:19
alcabreraGood morning! :)16:20
alcabreraI'm looking for someone who might be interested in mentoring for GSoC 2014: https://wiki.openstack.org/wiki/GSoC201416:21
openstackgerritA change was merged to openstack/savanna: [IDH] Fixed cluster start without jobtracker service  https://review.openstack.org/7281716:24
openstackgerritA change was merged to openstack/savanna: Switch over to oslosphinx  https://review.openstack.org/7327516:24
*** IlyaE has quit IRC16:33
alcabreraboris-42_: hey! I noticed you listed yourself as a potential mentor for the Rally project. Do you know who is mentoring for Savannah?16:36
*** dmitryme has quit IRC16:52
*** DinaBelova is now known as DinaBelova_16:55
*** vkdrao has joined #savanna16:57
*** DinaBelova_ is now known as DinaBelova17:00
*** NikitaKonovalov is now known as NikitaKonovalov_17:00
*** ylobankov1 has joined #savanna17:04
*** ylobankov1 has left #savanna17:04
*** YaroslavLobanko1 has joined #savanna17:06
*** YaroslavLobanko1 has left #savanna17:07
*** alcabrera is now known as alcabrera|afk17:08
*** ylobankov1 has joined #savanna17:12
*** _nadya_ has joined #savanna17:23
*** alcabrera|afk is now known as alcabrera17:32
*** NikitaKonovalov_ is now known as NikitaKonovalov17:39
*** _nadya_ has quit IRC17:46
*** alazarev has joined #savanna17:54
*** mattf is now known as _mattf17:59
SergeyLukjanovhey folks18:01
SergeyLukjanovteam meeting begins18:01
*** ErikB has joined #savanna18:04
*** dmitryme has joined #savanna18:04
boris-42_alcabrera hi18:12
boris-42_alcabrera around?18:13
alcabreraboris-42_: hey!18:13
alcabrera:)18:13
*** _nadya_ has joined #savanna18:15
boris-42_alcabrera Idk actually probably SergeyLukjanov knows18:15
SergeyLukjanovI'm here18:15
SergeyLukjanovalcabrera, hey, what's up?18:16
boris-42_alcabrera who is the mentor For Savana?18:16
boris-42_SergeyLukjanov *** ^18:16
boris-42_savanna*18:16
SergeyLukjanovalcabrera, which kind of mentor are you looking for?18:16
boris-42_https://wiki.openstack.org/wiki/GSoC2014#Mentors18:16
boris-42_SergeyLukjanov ^18:16
boris-42_SergeyLukjanov there is in list of projects Savanna Project18:17
alcabrerathanks for looking into this, boris-42_, SergeyLukjanov!18:17
SergeyLukjanovboris-42_, heh, I don't how added savanna to the list18:17
SergeyLukjanovlet me think how can mentor18:17
alcabrerathere's one student who is already very interested in working with savanna as their gsoc project.18:18
alcabreraIt might be how savanna ended up on the list. :)18:18
SergeyLukjanovalcabrera, I think we can add me to the list as the Savanna PTL and I'll help to find the right person to mentor18:19
alcabreraSergeyLukjanov: thank you very much! I'll go ahead with that.18:20
SergeyLukjanovalcabrera, thx18:20
*** alcabrera has left #savanna18:23
*** akuznetsov has quit IRC18:44
*** IlyaE has joined #savanna18:47
*** IlyaE has quit IRC19:02
*** _nadya_ has quit IRC19:02
*** vkdrao has quit IRC19:08
*** NikitaKonovalov is now known as NikitaKonovalov_19:09
SergeyLukjanovcould anyone help me to make a list of valid options?19:09
*** NikitaKonovalov_ is now known as NikitaKonovalov19:11
*** tosky has quit IRC19:14
alazarevI can help19:14
alazarevHow do you plan to do that?19:15
SergeyLukjanovalazarev, please take all options from the etherpad19:15
SergeyLukjanovand remove from the list options that we're agreed to remove19:15
SergeyLukjanovyou can add the list to the end of this etherpad19:15
SergeyLukjanovalazarev, thx19:16
*** NikitaKonovalov is now known as NikitaKonovalov_19:18
*** IlyaE has joined #savanna19:32
alazarevSergeyLukjanov: I created the list19:32
alazarevcleared19:32
SergeyLukjanovalazarev, thx19:33
*** alazarev has quit IRC19:34
SergeyLukjanovalazarev and could you please add a list of good options one by line19:34
SergeyLukjanovoops, I don't want :(19:34
* SergeyLukjanov needs more volunteers, please19:34
*** NikitaKonovalov_ is now known as NikitaKonovalov19:42
witlessbSergeyLukjanov: what do you need help with?19:46
*** NikitaKonovalov is now known as NikitaKonovalov_19:47
openstackgerritDmitry Mescheryakov proposed a change to openstack/savanna: [DO NOT MERGE] Intial Agent remote implementation  https://review.openstack.org/7101519:48
*** dmitryme has quit IRC19:49
*** NikitaKonovalov_ is now known as NikitaKonovalov19:49
*** alazarev has joined #savanna19:50
*** ylobankov1 has left #savanna19:55
*** NikitaKonovalov is now known as NikitaKonovalov_19:59
*** NikitaKonovalov_ is now known as NikitaKonovalov20:00
*** qwerty_nor has quit IRC20:04
*** DinaBelova is now known as DinaBelova_20:05
*** boris-42_ has quit IRC20:07
SergeyLukjanovwitlessb, ooops, missed your message, thx, already done ;)20:07
*** DinaBelova_ is now known as DinaBelova20:08
*** _nadya_ has joined #savanna20:08
witlessbSergeyLukjanov: oh, snap :)20:10
tmckaySergeyLukjanov, so, EDP has added Java and streaming MapReduce.  Also it looks like Hive is being worked on.  Do we want to puruse anything additional for icehouse?20:11
* tmckay brb20:12
SergeyLukjanovtmckay, probably cover all of them with integration tests and write a great doc with examples about how to run jobs of all the types you listed?20:13
*** _nadya_ has quit IRC20:14
*** penguinRaider has quit IRC20:16
*** saju_m has quit IRC20:19
openstackgerritJonathan Maron proposed a change to openstack/savanna: Enable use of rootwrap for neutron private IP interactions  https://review.openstack.org/7339620:22
*** eanxgeek|log is now known as eanxgeek20:25
tmckaySergeyLukjanov, okay.  So we don't want to pursue new actions for icehouse at this point.  That's probably good.20:26
*** _mattf is now known as mattf20:27
SergeyLukjanovtmckay, I'm ok with new actions but it's optional IMO, we have enough new ones20:28
tmckayalright.  Just not sure if there is time to get something new in, with UI support (crobertsrh).  What's our freeze date for features?20:31
*** boris-42_ has joined #savanna20:34
*** crobertsrh has quit IRC20:36
openstackgerritRobert Nettleton proposed a change to openstack/savanna-image-elements: Adds Hortonworks Data Platform element to savanna-image-elements  https://review.openstack.org/7299420:37
*** crobertsrh has joined #savanna20:40
*** eanxgeek is now known as eanxgeek|log20:45
*** IlyaE has quit IRC20:46
mattfSergeyLukjanov, thanks for approving the swift:// -- i'm really interesting in having us do most of our api breakage before I releases20:47
mattfi have it in my head that we should be more stable starting w/ I -- the bar to breaking something should be very high20:48
mattfthat factors into my desire to have v2 for the entire J cycle to stabilize and migrate20:48
*** IlyaE has joined #savanna20:48
SergeyLukjanovmattf, we should really care about the API version that we'll name CURRENT (stable, default, name it as you wish) with J release20:51
SergeyLukjanovdue to the first integrated release20:51
SergeyLukjanovof course in case if we'll graduate20:51
*** penguinRaider has joined #savanna20:51
*** NikitaKonovalov is now known as NikitaKonovalov_20:51
mattfany chance we won't?20:52
SergeyLukjanovmattf, I don't think so20:52
SergeyLukjanovtmckay, agreed, it'll be several days before the i3, we'll have FFEs but we should not use them every day20:53
SergeyLukjanovtmckay, FFE == Feature Freeze Exceptoiin20:53
SergeyLukjanovtmckay, https://wiki.openstack.org/wiki/Icehouse_Release_Schedule20:53
SergeyLukjanovanyway, I think that master will be open for J in end of March20:53
*** NikitaKonovalov_ is now known as NikitaKonovalov20:54
tmckaySergeyLukjanov, ack.  and crobertsrh will be out next week.  Probably better chasing docs, bugs, and tests20:54
SergeyLukjanovtmckay, yup, I'd really love the idea to have a release with tons of tests, docs and all bugs fixed ;)20:54
tmckaylol, sounds great20:55
*** DinaBelova is now known as DinaBelova_21:10
*** NikitaKonovalov is now known as NikitaKonovalov_21:11
mattfmr nettleton around?21:15
mattfErikB, is sir nettleton around?21:16
*** witlessb has quit IRC21:16
mattfi need some chatter to get myself off the "ahh, don't create another diskimage-create.sh" soapbox21:17
openstackgerritJonathan Maron proposed a change to openstack/savanna: Enable use of rootwrap for neutron private IP interactions  https://review.openstack.org/7339621:18
jmaronmattf:  pinged nettleton.  should be joining21:22
*** bob_nettleton has joined #savanna21:22
bob_nettletonmattf, jmaron just mentioned you wanted to contact me?21:23
mattfbob_nettleton, yeah, let's chat diskimage-create.sh, so i can hop off my soapbox21:26
mattfi want one script that we use to generate images for savanna21:26
mattfi'm not exactly buying the complexity argument21:26
mattfbut i'm a reasonable person, or so that's what i tell myself21:26
mattfa long term goal i have for us is to be consistent across plugins. if we just had 3 base images (one ubuntu, one fedora, one centos/rhel) that all plugins could use we'd be in a great place21:27
mattfbut pragmatically that's not going to happen anytime soon, or ever21:27
*** witlessb has joined #savanna21:28
bob_nettletonmattf, my concern is that the single script will get too complex over time.  Every time I want to modify an element that the HDP images use, I'll have to modify that single script, forcing me to rebuild and retest every image generated by the script.  This will be time-consuming, and error-prone for sure.21:28
* mattf pauses rant21:28
mattfmy response is that it takes a village21:28
mattfwhile we have divergence in images, we'll all have to work on making sure the images we care about work21:29
bob_nettletonmattf, another issue is that not all distributions will support the same platforms.  For example: HDP only supports CentOS images for Savanna right now.  This may change, but I can't promise that there will be 3 base images eventually.  In addition, there are separate distribution versions, and we'd like to have separate images for each version.21:29
mattfi like your mentality on this tho. but i think you're setting a higher bar than you need to.21:29
mattfif you change the shared script, you should avoid breaking spark, but i wouldn't expect you to test all images work.21:30
mattfas a community we need to make sure all the images work21:30
bob_nettletonmattf, but how would I avoid breaking the spark-based images without testing them?  While I agree that the community plays a role in verifying the images, I'd like to at least make a best effort to ensure that the images I'm modifying are in good shape before committing them.21:31
bob_nettletonmattf, I do understand the desire to have a single script, but I'm conflicted about the maintenance issue for this.21:31
bob_nettletonmattf, would the bar just be that the other distribution's images generate?21:32
mattfthat's a reasonable bar21:32
mattfimho anyway21:33
mattfin fact that's a higher bar than we've been holding to so far. i'm pretty sure you can't generate working fedora images from an ubuntu box21:33
mattfand to date i don't think there have been any issues21:34
mattfideally what we'd have here is the ci generating images and using the savanna ci suite21:35
bob_nettletonmattf, I would imagine that the type of problem I'm describing would only recently be a possibility, since only recently have other distributions been added (cdh, now hdp, etc).21:35
mattfyup, i think any rough patches are about to hit us.21:35
mattfrelated - at some point we should stop generating hadoop 1.x images21:37
mattfwhile we could span the entire gambit of distro x platform, as a community we should have some recommended paths, and have those paths be what is output by diskimage-create.sh21:37
bob_nettletonmattf, until there's actually a CI checking this stuff, this could be a problem.  Regarding the 1.x stuff, I think that's something each distribution should decide on, since we'll never be able to get all three (or more) to be synced at the same time.21:38
mattfi'll take a good chunk of the heat for cross image breakage if the scripts are merged21:39
mattf(not too hard to do, since i often get a say in element modifications and can head things off in review)21:39
jmaronis the main advantage of one script that it's one script to build them all?21:42
mattfit gives us a single entry point into image creation, yes21:43
mattfthe spark plugin has already merged w/ into it21:43
jmaroncouldn't we modularize the script (top level script invokes distribution specific scripts) and address both of your concerns?21:44
mattfhaving a single script drives us to consistent use of dib21:45
mattfthe middle ground kinda steps on that21:45
mattfjmaron, btw, re quantum. everything is neutron from havana onward.21:46
SergeyLukjanovagreed with single script approach, it provides us an ability to make a CI with templates for building different images for different plugins21:47
bob_nettletonmattf, ok, while I'm definitely concerned about the single-script approach, I'm willing to give it a try.  I would ask that if we run into problems with changes to this script causing breakages, that we consider refactoring this as Jon mentioned (since then we could at least factor out the distribution-specific issues into separate scripts).21:48
bob_nettletonmattf, I'll work on merging my diskimage-builder-hdp.sh into the main diskimage-builder.sh script.  I do think that this will eventually become a maintenance problem, but am willing to try it.21:49
*** alazarev has quit IRC21:50
mattfbob_nettleton, you can smack me and i'll buy you a beer when it becomes a maintenance problem21:50
mattfbbiab21:51
*** mattf is now known as _mattf21:51
*** alazarev has joined #savanna21:51
bob_nettletonmattf, no smacking required, but a beer would be nice.  :)21:52
jmaronmattf:  I take it neutron became the defacto name with Havanna?  I can't find it anywhere in our grizzly install21:54
*** bob_nettleton has left #savanna21:59
*** IlyaE has quit IRC22:01
*** IlyaE has joined #savanna22:02
SergeyLukjanovjmaron, yup, it was quantum before rename22:02
jmaronhmm…would a 'pip install neutron' update the command set on the box to have the neutron variants?22:03
jmaronor am I going to hose our installation?  ;)22:03
SergeyLukjanovjmaron, I'm afraid that you'll kill your OpenStack22:07
jmaronok.  I guess I'll create a symbolic link on our installation and assume the neutron-rootwrap is the appropriate command22:08
*** sballe has quit IRC22:26
*** sballe has joined #savanna22:26
openstackgerritJonathan Maron proposed a change to openstack/savanna: Enable use of rootwrap for neutron private IP interactions  https://review.openstack.org/7339622:30
*** _nadya_ has joined #savanna23:15
*** _nadya_ has quit IRC23:19

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!