Monday, 2013-05-06

*** sacharya1 has joined #openstack-meeting-alt02:08
*** sacharya has quit IRC02:10
*** ErikB has joined #openstack-meeting-alt02:18
*** cp16net is now known as cp16net|away02:38
*** ErikB has quit IRC03:07
*** enigma1 has joined #openstack-meeting-alt03:21
*** enigma2 has joined #openstack-meeting-alt03:23
*** enigma1 has quit IRC03:23
*** sacharya has joined #openstack-meeting-alt04:04
*** sacharya1 has quit IRC04:05
*** cp16net|away is now known as cp16net04:11
*** HenryG has joined #openstack-meeting-alt04:18
*** enigma2 has quit IRC04:20
*** cp16net is now known as cp16net|away04:26
*** cp16net|away is now known as cp16net04:35
*** hartsocks has joined #openstack-meeting-alt04:35
*** hartsocks1 has quit IRC04:36
*** SergeyLukjanov has joined #openstack-meeting-alt04:42
*** glikson has joined #openstack-meeting-alt04:55
*** amyt has joined #openstack-meeting-alt05:04
*** glikson has quit IRC05:08
*** amyt has quit IRC05:11
*** amyt has joined #openstack-meeting-alt05:11
*** glikson has joined #openstack-meeting-alt05:15
*** sacharya has quit IRC05:21
*** glikson has quit IRC06:00
*** ewindisch has joined #openstack-meeting-alt06:09
*** ewindisch has quit IRC06:10
*** SergeyLukjanov has quit IRC06:22
*** SergeyLukjanov has joined #openstack-meeting-alt06:23
*** glikson has joined #openstack-meeting-alt06:27
*** glikson has quit IRC07:14
*** ewindisch has joined #openstack-meeting-alt07:18
*** glikson has joined #openstack-meeting-alt07:32
*** amyt has quit IRC07:46
*** amyt has joined #openstack-meeting-alt07:48
*** amyt has quit IRC07:52
*** ewindisch has quit IRC07:54
*** ewindisch has joined #openstack-meeting-alt08:07
*** ewindisch has quit IRC08:14
*** ewindisch has joined #openstack-meeting-alt08:17
*** ewindisch has quit IRC08:31
*** SergeyLukjanov has quit IRC08:38
*** bradjones|away has quit IRC09:01
*** bradjones|away has joined #openstack-meeting-alt09:09
*** SergeyLukjanov has joined #openstack-meeting-alt09:41
*** SergeyLukjanov has quit IRC10:07
*** ewindisch has joined #openstack-meeting-alt10:23
*** glikson has quit IRC10:46
*** glikson has joined #openstack-meeting-alt11:04
*** SergeyLukjanov has joined #openstack-meeting-alt11:11
*** glikson has quit IRC11:26
*** HenryG has quit IRC11:32
*** HenryG has joined #openstack-meeting-alt11:33
*** SergeyLukjanov has quit IRC11:41
*** ErikB has joined #openstack-meeting-alt11:43
*** ewindisch has quit IRC11:44
*** glikson has joined #openstack-meeting-alt11:46
*** ewindisch has joined #openstack-meeting-alt11:47
*** SergeyLukjanov has joined #openstack-meeting-alt11:48
*** SergeyLukjanov has quit IRC12:02
*** ErikB has quit IRC12:11
*** ewindisch has quit IRC12:26
*** ewindisch has joined #openstack-meeting-alt12:34
*** ewindisch has quit IRC12:40
*** jcru has joined #openstack-meeting-alt12:42
*** ErikB has joined #openstack-meeting-alt12:57
*** ErikB has quit IRC13:03
*** ewindisch has joined #openstack-meeting-alt13:03
*** SergeyLukjanov has joined #openstack-meeting-alt13:13
*** SergeyLukjanov has quit IRC14:04
*** SergeyLukjanov has joined #openstack-meeting-alt14:07
*** cloudchimp has joined #openstack-meeting-alt14:08
*** djohnstone has joined #openstack-meeting-alt14:10
*** thatsdone has joined #openstack-meeting-alt14:11
*** sacharya has joined #openstack-meeting-alt14:12
*** cp16net is now known as cp16net|away14:14
*** amyt has joined #openstack-meeting-alt14:19
*** amyt has quit IRC14:19
*** amyt has joined #openstack-meeting-alt14:19
*** sacharya has quit IRC14:24
*** enigma1 has joined #openstack-meeting-alt14:25
*** cp16net|away is now known as cp16net14:26
*** enigma2 has joined #openstack-meeting-alt14:27
*** sarob has joined #openstack-meeting-alt14:29
*** enigma1 has quit IRC14:30
*** dhellmann has joined #openstack-meeting-alt14:35
*** hub_cap has left #openstack-meeting-alt14:37
*** SergeyLukjanov has quit IRC14:44
*** SergeyLukjanov has joined #openstack-meeting-alt14:49
*** sarob has quit IRC14:50
*** sarob has joined #openstack-meeting-alt14:50
*** markwash has quit IRC14:51
*** sarob has quit IRC14:55
*** demorris has joined #openstack-meeting-alt14:55
*** sacharya has joined #openstack-meeting-alt15:00
*** ewindisch has quit IRC15:06
*** cloudchimp has quit IRC15:06
*** grapex has joined #openstack-meeting-alt15:12
*** cp16net is now known as cp16net|away15:15
*** cp16net|away is now known as cp16net15:16
*** hartsocks has quit IRC15:27
*** hartsocks has joined #openstack-meeting-alt15:29
*** dmitryme has joined #openstack-meeting-alt15:31
*** grapex has quit IRC15:34
*** sarob has joined #openstack-meeting-alt15:35
*** sarob_ has joined #openstack-meeting-alt15:36
*** bdpayne has joined #openstack-meeting-alt15:38
*** sarob has quit IRC15:40
*** jcru is now known as jcru|away15:42
*** cp16net is now known as cp16net|away15:44
*** dmitryme has quit IRC15:55
*** yamahata_ has joined #openstack-meeting-alt15:59
*** thatsdone has quit IRC15:59
*** demorris_ has joined #openstack-meeting-alt16:01
*** glikson has quit IRC16:02
*** demorris has quit IRC16:03
*** demorris_ is now known as demorris16:03
*** grapex has joined #openstack-meeting-alt16:06
*** jcru|away is now known as jcru16:10
*** grapex has quit IRC16:13
*** cp16net|away is now known as cp16net16:22
*** glikson has joined #openstack-meeting-alt16:22
*** cp16net is now known as cp16net|away16:42
*** esp1 has joined #openstack-meeting-alt16:44
*** esp1 has left #openstack-meeting-alt16:44
*** jcru is now known as jcru|away16:44
*** enigma2 has quit IRC16:53
*** stanlagun has joined #openstack-meeting-alt16:57
*** sarob_ has quit IRC17:00
*** markwash has joined #openstack-meeting-alt17:00
*** sergmelikyan has joined #openstack-meeting-alt17:03
*** SergeyLukjanov has quit IRC17:05
*** jgriffith has joined #openstack-meeting-alt17:11
*** sarob has joined #openstack-meeting-alt17:25
*** enigma1 has joined #openstack-meeting-alt17:26
*** enigma2 has joined #openstack-meeting-alt17:28
*** enigma1 has quit IRC17:31
*** SergeyLukjanov has joined #openstack-meeting-alt17:42
*** sarob has quit IRC17:43
*** sarob has joined #openstack-meeting-alt17:43
*** jcru|away is now known as jcru17:44
*** enigma2 has quit IRC17:46
*** enigma1 has joined #openstack-meeting-alt17:47
*** cp16net|away is now known as cp16net17:50
*** enigma2 has joined #openstack-meeting-alt17:50
*** dteselkin has joined #openstack-meeting-alt17:52
*** enigma1 has quit IRC17:53
sergmelikyan#startmeeting murano18:00
openstackMeeting started Mon May  6 18:00:46 2013 UTC.  The chair is sergmelikyan. Information about MeetBot at http://wiki.debian.org/MeetBot.18:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:00
*** openstack changes topic to " (Meeting topic: murano)"18:00
openstackThe meeting name has been set to 'murano'18:00
sergmelikyanWelcome to Murano Project community meeting18:00
sergmelikyanToday's agenda:18:01
sergmelikyan1) New team members introduction18:01
sergmelikyan2) Blueprints tracking18:01
sergmelikyan3) Transfer to StackForge infrastructure18:01
sergmelikyan4) Q&A18:01
sergmelikyan#topic New Team Members18:02
*** openstack changes topic to "New Team Members (Meeting topic: murano)"18:02
sergmelikyan#info Igor Yozhikov (igor_yozhikov) has joined to our team as deployment engineer. Igor is going to help us to extend capabilities of Murano Project in configuration management area, add new deployment scenarios and help us to build setup scripts for  Murano project18:05
*** tnurlyga has joined #openstack-meeting-alt18:05
sergmelikyan#topic Blueprints Tracking18:05
*** openstack changes topic to "Blueprints Tracking (Meeting topic: murano)"18:05
sergmelikyanCurrently we do not track any blueprints, we need some way to publish already existing blueprints and write new according to features from roadmap18:06
*** gokrokve has joined #openstack-meeting-alt18:07
sergmelikyanLaunchpad is one way to track our blueprints, but we can't rewrite our blueprints specially for publishing for now (it's lots of work). What about writing and publishing blueprints for new features as  main activity with top priority in this area?18:08
sergmelikyanBlueprints for already implemented features we can prepare and publish with some new changes within features.18:09
sergmelikyan?18:09
gokrokveYes. Lets publish upcoming features blueprints first. At least for first and second phases.18:10
*** dhellmann has quit IRC18:11
sergmelikyanany objections? Stan?18:11
sergmelikyan#idea we going to publish upcoming features blueprints first. Old features will receive bluprints with new changes within feature.18:12
stanlagunI agree with @gokrokve. Let's do it as soon as we would know what to publish18:12
sergmelikyan#action stanlagun, write and publish blueprint for ASP.NET Application Deployment feature18:13
sergmelikyan#action stanlagun, write and publish blueprint for IIS Cluster feature18:13
sergmelikyan#action sergmelikyan, write and publish blueprint for Session Handling and Deployments feature18:14
sergmelikyanOk, looks like we done with AI's for this topic. I missed something?18:14
sergmelikyanstanlagun, more detailed info about blueprints can be found at launchpad itself, and i will consult you about 'How to write blueprint' :D18:16
sergmelikyanstanlagun, gokrokve?18:16
stanlagunsergmelikyan: thanx18:16
gokrokveLooks good.18:16
sergmelikyanmoving on...18:16
sergmelikyan#topic Transfer to Stackforge18:16
*** openstack changes topic to "Transfer to Stackforge (Meeting topic: murano)"18:17
gokrokveIs it done?18:18
sergmelikyanOur changeset (https://review.openstack.org/27471) still not merged to master,  i have rebased it to HEAD as James suggested18:18
gokrokveWe plan to do this last week.18:18
gokrokveOk.18:18
sergmelikyanIt's look pretty good actually (according to words from reviewers team), but master branch moved forward since commiting and rebase was required18:19
sergmelikyan#topic Q&A18:20
*** openstack changes topic to "Q&A (Meeting topic: murano)"18:20
sergmelikyanLet18:20
*** vipul is now known as vipul|away18:21
sergmelikyanLet's try to answer some questions :) Maybe there are some after announcement :)18:21
sergmelikyanTill the next week! We always available at #murano channel and via mailing list murano-all@lists.launchpad.net18:29
sergmelikyan#endmeeting murano18:29
*** openstack changes topic to "OpenStack meetings (alternate) || Development in #openstack-dev || Help in #openstack"18:29
openstackMeeting ended Mon May  6 18:29:54 2013 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:29
openstackMinutes:        http://eavesdrop.openstack.org/meetings/murano/2013/murano.2013-05-06-18.00.html18:29
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/murano/2013/murano.2013-05-06-18.00.txt18:29
openstackLog:            http://eavesdrop.openstack.org/meetings/murano/2013/murano.2013-05-06-18.00.log.html18:29
*** vipul|away is now known as vipul18:34
*** tnurlyga has quit IRC18:35
*** glikson has quit IRC18:38
*** sirushti has joined #openstack-meeting-alt18:43
*** vipul is now known as vipul|away18:51
*** vipul|away is now known as vipul19:06
*** vipul is now known as vipul|away19:06
*** sarob has quit IRC19:10
*** ewindisch has joined #openstack-meeting-alt19:24
*** dhellmann has joined #openstack-meeting-alt19:24
*** cp16net is now known as cp16net|away19:34
*** dteselkin has quit IRC19:35
*** cp16net|away is now known as cp16net19:37
*** jbresnah has joined #openstack-meeting-alt19:54
*** vipul|away is now known as vipul19:57
*** sarob has joined #openstack-meeting-alt19:58
*** markwash has quit IRC19:58
jbresnahAre those interested in the transfer service meeting around?20:01
ameadeack20:01
*** markwash has joined #openstack-meeting-alt20:01
jbresnah#startmeeting transfer-service20:01
openstackMeeting started Mon May  6 20:01:51 2013 UTC.  The chair is jbresnah. Information about MeetBot at http://wiki.debian.org/MeetBot.20:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:01
*** openstack changes topic to " (Meeting topic: transfer-service)"20:01
openstackThe meeting name has been set to 'transfer_service'20:01
jbresnahameade is here, anyone else ready?20:02
markwasho/20:02
*** gokrokve has quit IRC20:02
jbresnahiccha, nikhil, rosmaita?20:02
*** sarob has quit IRC20:02
nikhilack20:02
iccha__hey jbresnah20:02
jbresnahexcelent20:03
*** sarob has joined #openstack-meeting-alt20:03
jbresnahok20:03
jbresnahi emailed out the agenda20:03
jbresnahThe first thing is a quick introduction to the idea20:03
jbresnahit is largely documented elsewhere20:04
jbresnahhttps://blueprints.launchpad.net/glance/+spec/image-transfer-service20:04
jbresnahand there are many links there20:04
jbresnahThe main idea is to have a service that handles data transfer as a first class problem20:05
jbresnahin the current state of OS trasnfers is a sort of second class operation of storage20:05
jbresnahthere is not end to end management20:05
jbresnahthis would look to solve that20:05
jbresnahhttp://tropicaldevel.files.wordpress.com/2013/04/the_wild_west.png20:05
jbresnahversus20:06
jbresnahhttp://tropicaldevel.files.wordpress.com/2013/04/tamed_west.png20:06
jbresnahsort of show the idea20:06
jbresnahare people generally familiar with the links in the blue print?20:06
ameadei've read through them20:07
jbresnahcool20:07
jbresnahand we had a meeting at the summit on the topic20:07
jbresnahiccha, ameade, nikhil, and rosmaita were all there20:07
nikhiljbresnah: i like your diagram20:07
jbresnahon use case i want to state really quick came up from the earlier meeting about cloning20:08
nikhilread through most of your use cases, looks pretty solid20:08
nikhilhoping everyone else adds stuff too20:08
jbresnahin that we outlined the need for the a glance to glance transfer of an image with its metadata20:08
nikhiljbresnah: +120:08
jbresnahto close to other regions20:08
jbresnahi see this servicing fitting in there like this:20:08
jbresnahan async worker would call out to it to handle the transfer from storage system to storage system20:08
jbresnahinstead of having glance try to handle that work load itself20:09
jbresnahonce that worker was notified by the transfer service of completion it would continue to its next job of updating metadata etc20:09
jbresnahdoes that make sense as a use case?20:09
iccha__yeah makes sense20:10
ameadehow would the notification happen?20:10
jbresnahright, i am not sure about that just yet20:11
jbresnahwhat i have outlined right now is poll based20:11
nikhiljbresnah: ameade guess in that particular case notification is handed over to glance?20:11
jbresnahsomething like that20:11
ameadeah ok20:11
jbresnahwhich goes into the next agenda point20:11
jbresnahfeedback20:11
iccha__https://blueprints.launchpad.net/glance/+spec/async-glance-workers ?20:11
jbresnahany thoughts, specific or general?20:11
nikhiljbresnah: do you feel the need for managing transfers20:11
nikhiljust an extension to what ameade was saying20:12
nikhilrosmaita: and I were discussing a bit on the async workers20:12
jbresnahwhat do you mean by manage?20:12
nikhiland it kinda makes sense to have a queue based system for that20:12
jbresnahi think the trasnfer should be managed by a service that makes sure it properly completes and does not over/under consume its provisioned resources20:12
nikhilif you'r polling then we need a managed state of the transfer20:12
jbresnahah, ok20:13
jbresnahso from glance20:13
nikhilsomething like qonos20:13
jbresnahglance would be a client to this service20:13
nikhilhttps://github.com/rackspace-titan/qonos20:13
jbresnahan async worker could poll20:13
jbresnahor there could be some contact point back (like a tempurl) for completion notification20:13
ameadecallbacks would be nice but nothing really has that tech in place20:14
jbresnahi would prefer that there is an PI boundry between this service and glance20:14
jbresnah*A*PI20:14
jbresnahi would not like them to share a messaging queue, for example20:15
nikhilah20:15
jbresnahtho i am open to discuss that20:15
iccha__yes we want it to be indepedent from glance20:15
jbresnahiccha: I agree20:15
nikhiljbresnah: i think that would be good to keep this as independent as possible20:15
jbresnahok cool20:15
nikhillike APIs20:16
jbresnahso on that point... should this effort be part of the glance project?  in the summit unconference we decided that it should be its own new project20:16
jbresnahand hope for incubation20:16
jbresnahany new thoughts there?20:16
markwashso, how would the transfer service affect how clients work with openstack20:16
jbresnahmarkwash: any thoughts?20:16
nikhil+1 for new20:16
markwashlike, clients that want to upload data to glance or swift20:16
nikhilmarkwash: which client?20:17
jbresnahmarkwash: well, i think backward compat will be there20:17
markwashsure, but with the new approach, how would it work?20:17
jbresnahmarkwash: so the traditional means would still happen20:17
jbresnahright, so i have a use case for that20:17
jbresnahgetting it...20:17
jbresnahhttps://etherpad.openstack.org/transfer_workflow20:18
jbresnahbasic download sort of covers that20:18
jbresnahthe idea would be that a user would form a fileurl20:18
jbresnahand find a transfer service that can deal with such a url20:18
rosmaita(don't want to interrupt, i have a thought about where this project should live, will share later)20:18
jbresnahand then contact the store that galnce is using to get a url, and find a transfer service for it20:18
jbresnahso a 4 tuple is needed20:19
jbresnahsource url, source service, dest url, dest service20:19
jbresnahsource service can == dest service20:19
jbresnahin which case it ultimately looks like the service is doing a managed 2 party up/download20:19
jbresnahdoes that make sense?20:19
jbresnahrosmaita: please tell!20:20
jbresnahmarkwash: does that sound too heavy weight?20:20
rosmaitawell, this is from our qonos experience ...20:20
rosmaitaoslo is not appropriate because you want a service not a lib20:21
markwashit sounds kinda heavy, I'm wondering about "killer" use cases20:21
rosmaitabut an incubator project is going to be a pain to manage20:21
nikhiljbresnah: we prolly won't need  source url for upload and dst for download? (wanna make sure we'r on the same page)20:21
rosmaitaif you could find a nice PTL, you could incubate the project in, say, i don't know, glance20:21
rosmaitado the engineering so it can easily be detached20:21
rosmaitabut build it in glance20:22
markwashI'd have to go to the TC about that probably20:22
rosmaitathat way it will get into the community earlier20:22
markwashI don't think I have the power to redefine the scope of glance20:22
jbresnahrosmaita: so devel under glance with the intent to break away?20:22
jbresnahrosmaita: that was what was discuss for keystone and quotas IIRC20:22
rosmaitamarkwash: that would be ok, there needs to be a place for small projects to incubate20:23
jbresnahmarkwash, nikhil: I am not forgetting about the killer use case thread btw20:23
rosmaitaso maybe a new "project" project, i don't know20:23
jbresnahrosmaita: here is my take on that: pragmatically I am completely fine with that20:23
rosmaitabut if john does glance-useful stuff to start with, it would make sense to start dev in glance20:23
jbresnahhowever, to me it shows that the incubation process might be broken20:23
rosmaitajbreshah: yes, depends where you want to put your efforts now, fix incubation process or get started on xfer service20:24
jbresnahrosmaita: I guess that is a good point.  at first it is all glance useful stuff20:24
jbresnahheh20:24
rosmaitai think so, this is a markwash call, though20:24
* jbresnah would prefer to not fix incubation ;-)20:24
jbresnahmarkwash: ok lets get back to killer use case20:25
nikhiljbresnah: to me it sounds like whether we want to tie this closely to glance xfer or find storage xfer use cases in general20:25
jbresnahmarkwash: or first use case20:25
jbresnahwhat about that cloning issue?20:25
jbresnahit is sort of the perfect starting point20:25
jbresnahbecause it is by nature a 3rd party transfer20:25
jbresnahthe client says to glance 'trasnfer this image from you, to another glance'20:25
jbresnahand then it leaves20:25
jbresnahfor glance to do that right it needs to monitor the trasnfer, restart where needed, verify success etc etc20:26
jbresnahall these things are what this transfer service wants to do20:26
jbresnah*and*20:26
jbresnahin the case of the science community20:26
jbresnahthat wants 1 upload and then a broadcast of the image to many clouds20:26
jbresnahyou may even want to negotation protocol (bit torrent, some wide area, etc)20:27
jbresnahso that cloning case is really a great starting point for this20:27
jbresnahthoughts?20:27
*** esheffield has joined #openstack-meeting-alt20:27
iccha__i know it is difficult to find places for smaller projects, but i am not a 10020:28
iccha__% convinced that it should belong to glance20:28
nikhili'm not sure where glance is heading, though from a HPC perpective and the use case that you just linked it makes sense to abstract out the transfer based on the deployer needs20:28
ameadecloning case makes sense to me, esp if we are starting in glance20:28
jbresnahnikhil: well hpc is one example20:28
nikhiljbresnah: esp when doing multi day longing transfers20:28
jbresnahin every cloning case there is a trasnfer20:28
jbresnahthat should be managed properly20:28
ameadethe generic service doesnt belong in glance but if we are only doing glance use cases at first then it makes sense20:28
jbresnahameade: that is what i am pitching20:29
iccha__how heavy would it end up being?20:29
jbresnahameade: Well put20:29
jbresnahiccha: I am hoping to make it modular20:29
jbresnahso a first cut would have single set of plug ins20:29
jbresnahto address that use case20:29
markwashI'm just seeing a lot of alternatives to the transfer service for each "killer" use case I can come up with20:29
jbresnahmarkwash: ex?20:29
markwashso for example, efficiency by having the two endpoints talking directly to each other20:30
markwashthat's what the expose-locations thing is about20:30
jbresnahsure... but i would argue that is the trasnfer service case where source service == dest service20:30
jbresnahin tat case it would effectively be a managed wget20:31
jbresnahor some such20:31
jbresnahwhere the client can walk away and check back later20:31
jbresnah...doesnt have to have full privaledegs20:31
jbresnah...doesnt have to baby sit/restart on failure20:31
jbresnahetc20:31
jbresnaheffectively, the way to think of this transfer service is something that wraps a client to make sure it does the trasnfer right20:32
markwashI don't completely follow src service == dest service20:32
jbresnahthe rest is an implementaion detail20:32
jbresnahi could say to a single transfer service 'download http://xxxx to file://yyyy'20:32
jbresnahand it would manage that transfer20:33
jbresnahdoes that make sense?20:33
markwashyeah20:33
jbresnahi see those as the first use cases20:33
jbresnahtake the arch where nova-compute nodes mount a SAN for instance storage20:34
jbresnahand 1 machine is dedicated for transfering images to it20:34
jbresnahthat machine could do what i said above20:34
jbresnahonly it has a global pitcure so it can schedule them nicely20:34
jbresnahand make sure the restart on error20:34
jbresnahetc20:34
markwashso suppose I'm doing "transfer swift://region1/foo/bar swift://region2/foo/bar"20:34
nikhiljbresnah: i think you could extend it a bit here and say20:34
*** ashwini has joined #openstack-meeting-alt20:34
ameadecan we talk more about how this would be implemented within glance for the cloning use case? so that it's clear and we could maybe agree on it20:35
markwashI'm guessing in the ideal case I'd want the transfer to be happening directly between nodes on the rings of each swift deployment20:35
nikhilif you want to transfer http:xxx to list[url1, url2, url3 ...]20:35
jbresnahameade: i think that is a good idea20:35
jbresnahpushing on that use case might make the most sense for clarity20:35
ameadejust think that if we do that we can get started too20:35
jbresnahmarkwash: probably yes20:35
nikhilameade: guess the dialogue is whether it should be in glance or not20:36
jbresnahameade: good point20:36
nikhilfrom what i see in markwash's concern20:36
jbresnahnikhil: true, and that is a practical use case at hand20:36
jbresnahmarkwash: so, if we talk about that use case20:36
jbresnahmarkwash: and how we would acco,mplish it within glance20:36
jbresnahi agrue that the glance code would look a lot like an image trasnfer service20:36
jbresnah(especially if you let me write it hehehe)20:37
* markwash is unfortunately a bit distracted at the moment20:37
ameadeyeah we have to implement it somehow, we would just do it with the fact it could eventually break out into the transfer service in the future20:37
markwashcan we start this out as an apache-licensed (2.0) open source project on its own?20:37
jbresnahmarkwash: i am open to anything20:38
markwashand then look at optionally using it in glance?20:38
jbresnahmarkwash: but naother apporach is to start working on the cloning case, with this in mind20:38
jbresnahand see how much sense it makes to break it out20:38
rosmaita+1 cloning20:38
jbresnahcause really... if we work on this and the cloning case at the same time, there will be work overlap20:38
ameade+1 that work has to be done anyways20:38
jbresnahright20:38
jbresnahi think that is the most efficient way to spend time20:39
jbresnahit has the downside that ineviitably it will be more tightly married to glance then is idea20:39
nikhiljbresnah: +1 to cloning20:39
jbresnahiccha: do you have thoughts there?20:39
markwashisn't this just an optimization to the cloning work?20:39
jbresnahi would say a generalization20:39
markwashits just a different way of saying "download image X" on the target service20:39
jbresnahwith the potential for a lot of optimization20:39
ameadethis thought guides the impl20:40
nikhilwe need a cloning data transfer management anyhu20:40
jbresnahmarkwash: i can see looking at it that way sure20:40
iccha__if we are going the glance route, i would like to be as modular as possible.. a separate node, etc because currently glance nodes designed to be more lightweight etc..20:40
jbresnahespecially when coupled with the direct_url business20:40
jbresnahiccha: agreed20:40
jbresnahmarkwash: what you are sayibn gis true.  any effective use case we could come up with could also be solved with a combination of cloning and direct_url exposure20:41
jbresnahi think anyway20:41
markwashperhaps I'm just being a bit dense (and I'm happy if people want to try to enlighten me as forcefully as necessary)20:41
jbresnahbut... that would be a way to work around functionality instead of supporting it in a first class way, IMHO20:42
markwashbut I feel a bit like this is trading a bird in the hand for a bird in the bush20:42
markwashwrt the cloning work20:42
jbresnahmarkwash: can you explain a bit more?20:42
ameadewell lets say we did the cloning work seperate20:42
ameadethen the first step for this service could be transforming that work into the service20:42
markwashbird in hand -> the blueprint and design approach we discussed in the previous meeting20:42
markwashfor cloning20:42
markwashwe have a pretty low level view the design for that, which means there's more certainty and more momentum20:43
nikhilmarkwash: we need a service to handle data transfer anyway20:43
markwashnikhil: the current plan involves glance as that service20:43
markwashfor the cloning use case20:44
jbresnahmarkwash: async workers too?20:44
markwashso maybe I need to think more about the "first class" approach to using this20:44
jbresnahmarkwash: so it is fair point to say that the cloning effort could be done faster and with less architectural high mindedness if we just do it20:44
iccha__the transfer service is a bit different from cloning blueprint, it is solving a different problem20:44
jbresnahmarkwash: but it is also fair to say that there will be a ton of overlap in code20:44
markwashwould you just say "transfer glance://region1/abcd glance://region2/" ?20:45
*** enigma2 has quit IRC20:45
nikhiliccha__: just abstraction in teh initial phase, no?20:45
jbresnahiccha: agreed.  but the cloning work shares overlap of a subset of what it is solving20:45
markwashbut I can also support the current cloning plan with just eventlet threads running on existing glance api nodes20:45
jbresnahiccha: IOW if the xfer service existed, the cloning work could be more easily done by just using it.20:45
iccha__what was decided in cloning meeting? the stores transfer content to each other?20:46
jbresnahmarkwash: ummm20:46
jbresnahmarkwash: you can20:46
jbresnahmarkwash: but you will need to deal with failures20:46
markwashiccha__: that would just be an optimization, normal case is glance2glance20:46
jbresnahmarkwash: overlaoding the NIC of those api nodes20:46
jbresnahetc20:46
nikhilmarkwash: you sure you wanna run multiple threads on glance api nodes for public API glance nodes?20:47
markwashjbresnah: I agree its not ideal, but if you're just testing or at a small scale, it works fine20:47
markwashnikhil: I definitely do *not* want to do that20:47
jbresnahmarkwash: if this were done inside of the cloning work, i think the results would be the same, only there would be more points of abstraction etc that would seem not needed to just the cloning work20:47
markwashbut some folks with small scale might20:47
markwashand would enjoy not having to deploy new components20:47
nikhilhmm20:47
ameademy concern is that this logic gets all over the inside of glance and is a nightmare to move towards this service20:47
jbresnahthe service could share process space with api and still have good points of abstraction at first20:48
markwashameade: its really easy though20:48
ameademarkwash: until we add a million patches for error cases20:48
nikhilmarkwash: guess the basic question is which is more flexibly for scale? scale up and scale down?20:48
jbresnahameade: i would worry about that too20:48
markwashif you want the xfer service to do the data transfer, you just use it instead of a manual download and upload20:48
markwashif you want the xfer service to do both data and metadata, then you just work completely outside the clone code as we discussed it earlier20:49
nikhilmarkwash: agree20:49
jbresnahmarkwash: i want to get a consise feel for your concern20:49
markwashnikhil: its not about scale up or down here. . the lightweight eventlet one would never scale up20:49
markwashnikhil: when you want to scale up, you would select a different async processing driver20:50
jbresnahmarkwash: you are worried that the code does not belong in glance as starting point.  or you think cloning should not use it at all?20:50
markwashI think if this existed, it would make sense to do cloning using it20:50
jbresnahmarkwash: Ideally i would like to get consensus on having cloning be a good first use case20:50
jbresnahbe it where the code initially lives or not20:50
jbresnah| 3) Consensus on a basic use case (fully documented and approved later)20:51
jbresnahfrom my optimistic set of goals20:51
jbresnah4) Consensus on part of Glance or a new project20:51
ameade+1, we have 10 min to know our next steps20:51
jbresnahcan we get a vote on #3?20:51
markwashagain, maybe I'm just being dense, but I want to understand the advantages more before we go all in on the xfer service as a blocker for cloning20:51
jbresnahoh, not a blocker20:52
jbresnahthe other way around20:52
jbresnahi would like to use the cloning use case as a way to show the benefits of xfer20:52
jbresnahnot block it20:52
markwashso then cloning has to come first, because I don't want to say "you can't have cloning unless you deploy a transfer service component"20:53
jbresnahso, perhaps a quick impl with less features could be done20:53
*** flaper87 has joined #openstack-meeting-alt20:53
jbresnahmarkwash: i understand that concern20:53
flaper87I guess I got here late20:53
nikhilso we'r doing both then?20:53
flaper87:(20:53
flaper87sorry20:53
nikhilsmall impl for cloning and xfer service20:53
iccha__i see markwash's concerns about overloading glance with responsibility of data transfer. it is agreed that cloning can be enhanced by data transfer service, but i guess markwash would not like it to be dependent on it20:54
nikhilbecause, i really don't want something to block cloning, please20:54
jbresnahmarkwash: so the worry is that if cloning is the main use case, then you worry its effort will be delayed?20:54
* jbresnah nod iccha20:54
ameadejbresnah: what was the other potential starting point?20:54
markwashjbresnah: yes, because I don't know what saying "cloning == xfer service" does to our previous cloning plans20:54
jbresnahthe nova compute case where nodes mount a SANs20:54
jbresnahi find it less compeling because cloning seems so perfect for me20:55
jbresnahbut it still has legs20:55
markwashwhat about region-to-region swift transfers. . is that a possible first use case?20:55
jbresnahespecialy when talking about a boot of 1000s of instances20:55
nikhilmarkwash: +120:55
jbresnahmarkwash: isn't that cloning?20:55
nikhiljbresnah: i like markwash's use case20:55
nikhilyes but store level20:55
markwashjbresnah: I don't think so?20:55
nikhiland not blocking glance cloning20:55
markwashjbresnah: suppose I am running something other than swift as my store20:56
jbresnahswift to swift + import/export == cloning?20:56
jbresnahmarkwash: ok, i can see that20:57
iccha__3 minutes20:57
markwashthe way we talked earlier, I thought cloning was a glance to glance kind of thing20:57
jbresnahmarkwash: we may have to table this...20:57
jbresnah#3 and #420:57
* markwash is remembering quotes from requiem for a dream20:57
jbresnahouch20:57
jbresnahi hate remebering that movie20:57
jbresnahi curl up into a fetal position and cry20:57
markwashme too20:57
jbresnahgreat movie, but ... wow20:57
jbresnahanyway20:58
jbresnah| 1) A list of concerns to be addressed (either at the end or in the future).20:58
jbresnahi think i can pull a bunch of those from the transcript20:58
jbresnah| 2) A list of parties interested in working on this (not a time commitment)20:58
jbresnahhow about that part20:58
jbresnahwhat is the general interest level20:58
ameadejbresnah: what if the transfer service started off seperate as a way to replace the image upload handler code in nova?20:58
jbresnahcoding, designing, reviewing, etc?20:58
jbresnahameade: hmmm20:58
jbresnahameade: that makes sense20:59
nikhiljbresnah: markwash have we decided to keep it separate from glance or in it?20:59
jbresnahameade: and download20:59
jbresnahsomething specific like that is good20:59
ameadejbresnah: yeah very easily20:59
jbresnahi recall we talked about that briefly once20:59
markwashnikhil: I'd like for it to start seperately from glance20:59
ameadejbresnah: yeah really early on20:59
jbresnahnod20:59
jbresnahok20:59
jbresnahso it looks like, separate from glance21:00
jbresnahvotes?21:00
nikhilworks for me21:00
iccha__i like the idea of store to store transfer going first so it be used in image cloning if needed sooner21:00
nikhil+121:00
* flaper87 will comment later21:00
jbresnahiccha, i like that21:00
nikhilcan we do #vote or something?21:00
jbresnahoh right, sorry21:00
jbresnahummm how do i do that?21:00
nikhilnot sure21:00
* markwash doesn't know either. . . 21:00
flaper87jbresnah: #startvote21:01
jbresnah#startvote outside of glance21:01
openstackUnable to parse vote topic and options.21:01
jbresnah#startvote own_project21:01
openstackUnable to parse vote topic and options.21:01
flaper87jbresnah: #startvote Should we vote now? Yes, No, Maybe21:01
flaper87#link http://ci.openstack.org/meetbot.html21:01
flaper87:)21:01
nikhil#vote Yes21:02
markwash#vote maybe21:02
* markwash giggles21:02
flaper87jbresnah: has to start the vote :D21:02
jbresnahheh21:02
iccha__#vote yes21:02
*** markwash has left #openstack-meeting-alt21:02
westmaasbold move21:03
jbresnah#startvote Should the transfer service be its own project? Yes, No,  Maybe21:03
openstackBegin voting on: Should the transfer service be its own project? Valid vote options are Yes, No, Maybe.21:03
openstackVote using '#vote OPTION'. Only your last vote counts.21:03
*** markwash has joined #openstack-meeting-alt21:03
nikhil#vote yes21:03
ameade#vote apathetic21:03
openstackameade: apathetic is not a valid option. Valid options are Yes, No, Maybe.21:03
nikhillol21:03
flaper87#vote yes21:03
ameade#vote apathetic21:03
openstackameade: apathetic is not a valid option. Valid options are Yes, No, Maybe.21:03
jbresnahameade maybe will be apathetic for now21:03
markwashwhat was the vote again? sorry, user error21:04
jbresnah#vote maybe21:04
nikhil#vote ameade21:04
openstacknikhil: ameade is not a valid option. Valid options are Yes, No, Maybe.21:04
ameade#vote maybe21:04
jbresnahmarkwash: ? I am pretty sure you are a yes....21:04
nikhilwe'r voting on Should the transfer service be its own project?21:04
markwashI accidentally left the room right when you said "startvote"21:04
nikhilbtw21:04
markwash#vote yes21:04
nikhilmarkwash: ^^21:04
jbresnahFor next steps i will type up the two potential use cases and et a vote on them21:05
flaper87jbresnah: you have to call #endvote now21:05
jbresnah#action jbresnah doc up cloning and simple nova-compute up/down use cases21:05
jbresnah#endvote21:05
openstackVoted on "Should the transfer service be its own project?" Results are21:05
openstackMaybe (2): ameade, jbresnah21:05
openstackYes (3): nikhil, markwash, flaper8721:05
nikhilwhere's iccha__ ?21:05
markwashI want to say, we can look at bringing it into glance after its been on its own for a while too21:05
jbresnahcool21:06
markwashas a way to unbreak the incubation process (if necessary and expedient)21:06
iccha__i am here i guess i voted before it started21:06
flaper87markwash: +121:06
jbresnah+121:06
jbresnahmarkwash: that makes sense21:06
flaper8723:02:32    iccha__ | #vote yes21:06
iccha__+121:06
nikhilso 4 yes-es21:06
jbresnahso, ho about a quick statement of interest in the project?21:06
nikhili just want some tangible outcome21:06
* markwash isn't sure how something necessary wouldn't be expedient, but hopes nobody noticed21:06
nikhilelse i'd voted maybe21:06
jbresnah| 2) A list of parties interested in working on this (not a time commitment)21:07
nikhiljbresnah: interested21:07
flaper87jbresnah: me21:07
jbresnahin terms of design, coding, peripheral, etc21:07
jbresnahor just 'interested' works too21:07
ameadeinterested21:07
iccha__interested21:07
jbresnahmight be hard to say at this point21:07
markwashjbresnah: me, especially to get an early high level view of the project and where you'd want it to go21:07
nikhildesign, coding for sure21:07
jbresnahgreat!21:08
jbresnahok i think we can call it21:08
jbresnah8 minutes over21:08
ameadejbresnah: lemme know if you wanna talk more about the image upload code21:08
nikhilnice meeting!21:08
jbresnahmarkwash: let me know if you ever have questions or a good idea on how to transfer some thoughts etc21:08
jbresnahnd ameade21:08
ameadenikhil: it was very kind21:08
jbresnahameade: i definitely will21:09
jbresnahameade: and probably soon21:09
nikhil:)21:09
ameadejbresnah: cool, the more i think about it the more it makes sense21:09
jbresnahnikhil: thanks!21:09
nikhilthanks too!21:09
jbresnah#endmeeting21:09
*** openstack changes topic to "OpenStack meetings (alternate) || Development in #openstack-dev || Help in #openstack"21:09
openstackMeeting ended Mon May  6 21:09:53 2013 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:09
openstackMinutes:        http://eavesdrop.openstack.org/meetings/transfer_service/2013/transfer_service.2013-05-06-20.01.html21:09
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/transfer_service/2013/transfer_service.2013-05-06-20.01.txt21:09
openstackLog:            http://eavesdrop.openstack.org/meetings/transfer_service/2013/transfer_service.2013-05-06-20.01.log.html21:09
*** ewindisch has quit IRC21:13
*** flaper87 has left #openstack-meeting-alt21:14
*** ewindisch has joined #openstack-meeting-alt21:15
*** ewindisch has quit IRC21:34
*** djohnstone has quit IRC21:34
*** demorris has quit IRC21:43
*** sacharya has quit IRC21:43
*** RajeshMohan has quit IRC21:53
*** RajeshMohan has joined #openstack-meeting-alt21:53
*** RajeshMohan has quit IRC21:59
*** RajeshMohan has joined #openstack-meeting-alt21:59
*** RajeshMohan has quit IRC21:59
*** RajeshMohan has joined #openstack-meeting-alt22:00
*** lifeless has quit IRC22:20
*** SergeyLukjanov has quit IRC22:21
*** amyt has quit IRC22:26
*** ashwini has quit IRC22:30
*** vipul is now known as vipul|away22:33
*** vipul|away is now known as vipul22:34
*** enigma1 has joined #openstack-meeting-alt22:37
*** enigma2 has joined #openstack-meeting-alt22:40
*** enigma1 has quit IRC22:40
*** jcru has quit IRC22:41
*** bdpayne has quit IRC23:00
*** bdpayne has joined #openstack-meeting-alt23:01
*** esheffield has quit IRC23:07
*** lifeless has joined #openstack-meeting-alt23:08
*** sacharya has joined #openstack-meeting-alt23:09
*** markwash has quit IRC23:28
*** lifeless has quit IRC23:35

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!