Tuesday, 2013-02-19

*** cloudchimp has quit IRC00:23
*** amyt has quit IRC00:31
*** grapex has quit IRC00:38
*** amyt has joined #openstack-meeting-alt00:50
*** rnirmal has quit IRC00:50
*** sacharya has joined #openstack-meeting-alt00:52
*** imsplitbit has quit IRC01:15
*** bdpayne has quit IRC01:26
*** cloudchimp has joined #openstack-meeting-alt02:07
*** amyt has quit IRC02:07
*** amyt has joined #openstack-meeting-alt02:08
*** cloudchimp has quit IRC02:12
*** amyt has quit IRC02:12
*** amyt has joined #openstack-meeting-alt02:13
*** sacharya1 has joined #openstack-meeting-alt02:19
*** amyt has quit IRC02:21
*** amyt has joined #openstack-meeting-alt02:21
*** sacharya has quit IRC02:22
*** cloudchimp has joined #openstack-meeting-alt02:27
*** bdpayne has joined #openstack-meeting-alt02:42
*** imsplitbit has joined #openstack-meeting-alt02:50
*** vipul is now known as vipul|away02:52
*** bdpayne has quit IRC03:02
*** vipul|away is now known as vipul03:08
*** cloudchimp has quit IRC03:43
*** yamahata_ has joined #openstack-meeting-alt03:49
*** imsplitbit has quit IRC03:49
*** bdpayne has joined #openstack-meeting-alt04:14
*** bdpayne has quit IRC04:46
*** bdpayne has joined #openstack-meeting-alt05:30
*** sacharya1 has quit IRC05:46
*** bdpayne has quit IRC06:08
*** bdpayne has joined #openstack-meeting-alt06:26
*** bdpayne has quit IRC07:18
*** amyt has quit IRC09:56
*** dhellmann has joined #openstack-meeting-alt11:34
*** dhellmann has quit IRC13:55
*** imsplitbit has joined #openstack-meeting-alt14:35
*** amyt has joined #openstack-meeting-alt15:02
*** dhellmann has joined #openstack-meeting-alt15:04
*** cloudchimp has joined #openstack-meeting-alt15:05
*** djohnstone has joined #openstack-meeting-alt15:18
*** sacharya has joined #openstack-meeting-alt15:23
*** grapex has joined #openstack-meeting-alt15:24
*** grapex has quit IRC15:25
*** grapex has joined #openstack-meeting-alt15:26
*** amyt has quit IRC15:30
*** amyt has joined #openstack-meeting-alt15:32
*** cp16net is now known as cp16net|away15:32
*** cp16net|away is now known as cp16net15:32
*** sacharya has quit IRC15:33
*** rnirmal has joined #openstack-meeting-alt15:33
*** cp16net is now known as cp16net|away15:45
*** esp has joined #openstack-meeting-alt15:49
*** amyt has quit IRC16:05
*** amyt has joined #openstack-meeting-alt16:05
*** cp16net|away is now known as cp16net16:12
*** bdpayne has joined #openstack-meeting-alt16:12
*** sacharya has joined #openstack-meeting-alt16:18
*** grapex has quit IRC16:32
*** grapex has joined #openstack-meeting-alt16:33
*** grapex has quit IRC16:35
*** grapex has joined #openstack-meeting-alt16:35
*** esp has joined #openstack-meeting-alt16:59
*** esp has left #openstack-meeting-alt17:00
*** heckj has joined #openstack-meeting-alt17:15
*** dhellmann is now known as dhellmann-afk17:46
*** cp16net is now known as cp16net|away18:56
*** cp16net|away is now known as cp16net18:56
*** imsplitbit has quit IRC19:06
*** sacharya has quit IRC19:08
*** sacharya has joined #openstack-meeting-alt19:14
*** cp16net is now known as cp16net|away19:33
*** cp16net|away is now known as cp16net19:42
*** imsplitbit has joined #openstack-meeting-alt20:12
*** dhellmann-afk is now known as dhellmann20:23
*** amyt has quit IRC20:36
*** amyt has joined #openstack-meeting-alt20:36
*** cp16net is now known as cp16net|away21:45
*** rnirmal has quit IRC21:47
*** yidclare has joined #openstack-meeting-alt21:53
*** esp has joined #openstack-meeting-alt21:58
*** hub_cap has joined #openstack-meeting-alt21:59
hub_caphai21:59
*** SlickNik has joined #openstack-meeting-alt21:59
hub_cap#startmeeting reddwarf22:00
openstackMeeting started Tue Feb 19 22:00:03 2013 UTC.  The chair is hub_cap. Information about MeetBot at http://wiki.debian.org/MeetBot.22:00
*** SlickNik has left #openstack-meeting-alt22:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.22:00
*** openstack changes topic to " (Meeting topic: reddwarf)"22:00
vipulsup22:00
openstackThe meeting name has been set to 'reddwarf'22:00
*** cp16net|away is now known as cp16net22:00
*** datsun180b has joined #openstack-meeting-alt22:00
*** robertmyers has joined #openstack-meeting-alt22:00
*** kagan has joined #openstack-meeting-alt22:00
*** jcru has joined #openstack-meeting-alt22:00
hub_cap#link https://wiki.openstack.org/wiki/Meetings/RedDwarfMeeting22:00
cp16network22:00
hub_cap#link http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-02-12-22.00.html22:00
robertmyershello22:00
*** demorris has joined #openstack-meeting-alt22:00
*** SlickNik has joined #openstack-meeting-alt22:00
hub_capok time to chill for a sec to let people come in22:00
SlickNikwoot22:01
annashengood afternoon22:01
grapexhai22:01
* hub_cap creates some dummy BPs22:02
clarkbbefore I forget I want to point out that the reason python-reddwarfclient dependencies pull in the old version is a pypi mirror somewhere has that version cached. you can recreate with `pip install -M -U python-reddwarfclient`22:02
datsun180bhowdy22:02
espnice.  thx clarkb!22:02
vipulclarkb: how can we get jenkins to do this?22:03
datsun180boh, thank you. did someone already ask you about that today?22:03
hub_capwhisper sweet nothings into jenkins ear vipul22:03
clarkbdatsun180b: no not yet22:03
clarkbone work around is to pin the dependency on the 0.1.1 version in your pip-requires22:03
clarkbthen when the mirrors stop caching the old stuff you can remove that pin22:03
grapexThat seems doable22:03
hub_capthat makes sense22:04
grapexCurrently we submit Reddwarf changes that we know will fail anyway until client gets merged in, so that wouldn't be much worse in the short term22:04
hub_capokey lets get to the meeting topics22:04
hub_cap#topic Update to Action items22:04
*** openstack changes topic to "Update to Action items (Meeting topic: reddwarf)"22:04
hub_capive created 2 blueprints in each of our 3 repos just fyi. feel free to use them vipul & co22:05
vipulhub_cap: tnx22:05
SlickNikokay, thanks…22:05
kaganwas one/two of those for percona ?22:05
hub_capkagan: they just say dummybpX22:05
hub_capfeel fre to rename them22:05
vipulkagan: i see you're using your real name now22:05
kaganand that's how i find them? by name ?22:05
kaganyep22:05
SlickNikI've updated the wiki clarifying that we're implementing sec-groups as extensions to reddwarf.22:06
hub_caphttps://blueprints.launchpad.net/reddwarf-integration22:06
kaganwasn't that different to begin with. more a decoration than a nick ...22:06
hub_capu can see them there22:06
SlickNik#link https://wiki.openstack.org/wiki/Reddwarf-security-groups22:06
kaganok22:06
SlickNikWas just in the process of updating the blueprint as well.22:06
hub_capnice SlickNik, /aside, i love the new wiki format22:06
vipul#agreed22:07
SlickNikYeah, I was wondering what happened and noticed that the wiki level'ed up. :)22:07
hub_capit ate a mushroom22:07
cp16netword!22:07
hub_caphmmmm next one, hub_cap needs to not be so lame..... i didnt accomplish this one22:07
hub_capps ive updated the rate-limits BP but forgot ot update quotas, ill do that during the meeting22:08
hub_capSlickNik: i see youve added stevedore to the possibilities in that BP, have u looked @ yet?22:08
SlickNikI started looking into stevedore to see how we can use them for extensions, still figuring things out there.22:08
hub_capthe filter scheduler in cinder is a good starting point22:08
espnp.  the rate limts one still needs to be blessed22:08
hub_capall of the filters are extension points22:08
SlickNikSo not complete, and will action myself to continue on that.22:08
hub_capesp: ill bless it now22:08
SlickNik#action SlickNik still looking at stevedore for entry points to extensions/ https://github.com/dreamhost/stevedore22:09
hub_capesp: done22:09
espthx.  I do have a question for you and the group on this but we can circle back on it after the agenda.22:09
hub_capSlickNik: https://github.com/openstack/cinder/blob/master/cinder/openstack/common/scheduler/filter.py22:09
hub_capthats where its imported22:09
hub_capesp: okey22:10
SlickNikthx hub_cap22:10
hub_capso as for teh api markdown. im starting it tomorrow. its my task now that im done w/ cinder multi volume22:10
vipulhub_cap: is this supposed to give us more of selective extensions?22:10
vipulas oppsoed to all/nothng22:10
hub_capvipul: ya22:10
hub_capu can define them in the egg22:11
cp16netif i havnt said it enough... great job hub_cap22:11
hub_caplulz cp16net22:11
hub_capif anyone is interested (https://github.com/openstack/cinder/commit/6c708d12f58eb20fce6733f1f6fd08d978570775)22:11
SlickNikvipul: yeah, that's the idea.22:11
SlickNik#info http://stevedore.readthedocs.org/en/latest/22:11
vipulooh multi volumes22:11
vipulshiny22:11
SlickNiknice!22:12
hub_capyup vipul, and its done. so im working on the markdown for the api, as of tomrrow morning22:12
hub_capi guess "as of tomorrow" doesnt make sense22:12
vipulwhat's the usecase fo multi-volumes in redwarf?22:12
vipulor is this just a tangentential thing22:12
hub_capwell..22:13
hub_capu can have different backends for different service types, high iops for users who need it, etc..22:13
hub_capsomewhat tangental but its leveragable22:13
hub_capSlickNik: hows that automated fandangled reddwarf client22:14
vipulk i shoulud probably read bp22:14
SlickNikI've acquired dkehn's vm-gate task, so I'm still looking at that and the python-reddwarfclient packaging tasks22:14
hub_capsounds like a RPG22:14
SlickNikheh, well, still work in progress.22:14
hub_capman, done w/ the action items!!22:14
hub_cap#topic Quotas / Limits Updates22:15
*** openstack changes topic to "Quotas / Limits Updates (Meeting topic: reddwarf)"22:15
hub_caplets start w/ quotas22:15
SlickNik#action SlickNik looking into vm-gate and release of python-reddwarfclient22:15
*** demorris has left #openstack-meeting-alt22:15
*** demorris has joined #openstack-meeting-alt22:15
vipulEsmute ^^22:16
hub_capps i will be proposing some /limits calls in teh markdown so yall can say yes/no to them once i push them for review22:16
hub_capitll be a bit nicer than seeing htem in the BPs22:16
Esmutei have modified the rd client to update quota info for a tenant22:17
vipulwiki's a godo place for now too22:17
demorrishub_cap: where is the markdown going to live? I know you mentioned it earlier22:17
Esmutesure hub_cap.. ill review it with esp22:18
Esmutein the client, the /quotas will also give you the absolute limits... but that call is admin only22:19
hub_cap#link https://github.com/stackforge/database-api22:19
hub_capdemorris: ^ ^22:19
hub_capEsmute: ill be sure to add that to the api doc22:19
Esmuteso i have a submitted a patch for the quota stuff.. will be adding an integration tests to it and resubmit some times today22:20
grapexhub_cap: Any update from Mike A. on his work for that repo?22:20
vipulhub_cap: what's the process for going from that repo to actual public facing docs22:20
hub_capnope grapex :( but thats my fault for not asking22:20
hub_capvipul: there is some magic stuff the doc team has built for that22:20
hub_capnot sure exactly22:20
vipulare we 'non-core' going to be able to leverage the same?22:21
hub_capbut id prefer starting at the repo instead of wiki, mainly cuz anyone can propose, and only core can commit22:21
hub_capvipul: u are core :)22:21
vipuli mean reddwarf is not core22:21
vipulAlso, tehre will be some APIs that are WIP, as part of a BP or something, how do we manage what gets into that repo.. should it be stuff already available22:22
vipulmaybe this should be part of the api specs topic22:22
hub_capvipul: ya we can talk about that in a few, but the thought is to ahve the api spec'd out in the next wk or two w/ everything22:23
vipulok.22:23
hub_capbut ya lets chat it up during that, Esmute are u fin?22:23
Esmutefin?22:23
Esmutefinished.. ahh ok22:23
hub_caphttp://en.wiktionary.org/wiki/fin#French22:23
Esmuteyes.22:23
hub_capsweet, now rate limits esp22:24
espk22:24
hub_capps looking forward to the quotas stuff Esmute22:24
espwell I just had one bit to clarify22:24
espthe current implementation in progress makes use of the same code as nova's limit controller22:24
esp#link http://api.openstack.org/api-ref.html22:25
espit was mentioned (and we stumbled upon) usedlimits last week22:25
hub_capyup22:25
hub_cap#link https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/contrib/used_limits.py22:26
espis it cool to go with /limits for now?  I'm not sure we have all the info from the absolute limits to do /userlimits22:26
espsorry usedlimits22:26
hub_capesp: it _is_ the same22:26
hub_capthe used limits extension just puts extra things into /limits22:26
hub_caphttps://github.com/openstack/nova/blob/master/nova/api/openstack/compute/contrib/used_limits.py#L8222:26
vipulesp: do you mean we don't ahve enough from the quotas impl to get those values?22:26
espok, for some reason I thought there was more info in usedlimits22:26
espvipul: yeah22:27
hub_capthere is esp22:27
hub_caphttps://github.com/openstack/nova/blob/master/nova/api/openstack/compute/contrib/used_limits.py#L5622:27
Esmutewith values are you refering too specifically?22:27
vipulesp:  Esmute will provide that to you22:27
hub_capbut the extension just uses /limits22:27
espk, sounds like I need to talk with Esmute :)22:28
Esmutei can provide quota limits and usages information22:28
*** kmansel has joined #openstack-meeting-alt22:28
espthx22:28
hub_capcool22:28
Esmutei can show you how and where to get them22:28
vipulhub_cap: we're not doing it as ext. right?22:28
vipuljust part of the core call22:28
hub_capya i think so22:28
hub_capit makes more sense22:28
vipulyea, might as well22:28
espyeah it's right in there with the other core api calls at the moment22:28
hub_capdef. im assuming itll eventully meld together in nova22:28
hub_capbut they have more extensions than actual calls :P22:29
hub_capesp: done?22:29
vipulesp: yea you should be good to go to implement that with Esmute's changes22:29
espyes sir22:29
hub_capawesome. ill be pinging both esp and Esmute this wk for api feedback22:29
hub_cap#topic Percona Image Updates22:30
*** openstack changes topic to "Percona Image Updates (Meeting topic: reddwarf)"22:30
hub_capkagan: tag yer it22:30
kaganhi22:30
kaganso, we have it working, pretty much22:30
hub_capvery nice22:30
kaganit still runs slower (coming up) compared to Oracle's mysql22:30
kaganand also, there are some loose ends i'd like to go over before submitting to review22:30
kagani think i'll have something checked in for review today22:31
vipulsweet! got the resize fixed?22:31
hub_capNICE22:31
kaganwe also have some int tests failing, but i think the tests are bad22:31
hub_captests are bad?22:31
kaganwell, for example, the resize test22:32
kaganit "waits" for status to change from "resize" to "done" (or running or something like that)22:32
kaganbut it seems that as part of regular flow, between resizing and up it goes through status "down" for a while.22:32
hub_capso nova does those things22:32
grapex"down"?22:32
grapexDo you mean SHUTDOWN?22:32
vipulshutdown22:32
kaganyep22:33
grapexIt shouldn't do that22:33
hub_capif for some reason the percona image does something different, i seriuosly doubt that its a bad test :)22:33
grapexIf it does, the code has been changed.22:33
kagani'm not sure mysql doenst do that22:33
kagan it's just being done in 3 seconds or so22:33
hub_capor it also could mean nova has changed22:33
kagancompared to 2 minutes with percona22:33
cp16neti thought i remember someone saying they added a mysql stop22:33
grapexThe Reddwarf task ID is set to "resize", so during the entire resize operation it reports the status as "RESIZE" despite what the resources are doing.22:33
kaganso i think the test just doesn't' catch it22:33
hub_capwoah, 2 min for a restart... craaaazzyyyyy22:33
kaganyou'd never guess why ....22:33
*** flaper87 has joined #openstack-meeting-alt22:34
vipulyea, i think the startup differences may be exposing these states22:34
kaganit's 4 executions fof "see"22:34
*** flaper87 has left #openstack-meeting-alt22:34
vipul'sed'22:34
kaganof "see"22:34
kagandamn .. it "fixes" my typos ...22:34
vipulheh22:34
hub_capkagan: so yer saying22:34
* cp16net confused22:34
kagani write sed every time ...22:34
hub_capthre is a race condition that we never saw w/ the oracle mysql22:34
kagani think so. not sure.22:34
hub_capsince it boots up so quickly22:34
kaganit seems that this is regular flow22:34
grapexIf this for the happy path?22:35
hub_capbut since the guest sees percona mysql as down for 2 minutes it reports the status as such22:35
kaganso i think mysql goes through "shutdown" for several seconds22:35
kagani guess ...22:35
hub_capkagan: a resize does restart mysql22:35
hub_capit has to for the new settings22:35
kagani know22:35
hub_capbut yer seeing a condition where the guest says its not in resize, but in shutdown22:35
kaganbut the code in the test is weird there22:35
cp16netis this for create?22:35
vipulcp16net: resize22:35
cp16netoh ok22:36
kaganyes, for a while. then it comes up again22:36
cp16netso if you stop mysql it will report as shutdown22:36
vipulhub_cap: is it possible that the heartbeat thread see's it as down22:36
hub_capcorrect22:36
SlickNikcp16net: the mysql stop was for the restart tests, not resize, IIRC.22:36
hub_capthats what im getting at vipul22:36
hub_caplets take this offline. it seems as if we have a potential race condition we need to account for in the guest22:36
hub_capkagan: talk to grapex tomorrow about. it he can help22:37
hub_caplol period misplacement22:37
vipulRECAP: resize restarts myslq.. since percona is slow to start up... heartbeat sets guest state as shutdown.. which invalidates the test22:37
grapexProbably the reference guest is behaving differently from Sneaky Pete.22:37
hub_capyuup vipul22:37
hub_caplets offline it and kagan and grapex can interface later22:37
kaganok22:37
hub_capbut good work kagan looking forward22:37
kaganthanks22:38
datsun180bThat's what I'm thinking, in the neighborhood of dbaas.py:65822:38
vipulI think we should amend the test to look for either state22:38
hub_capanything else wrt percona kagan?22:38
hub_capvipul: or amend the guest to _not_ report shutdown during a resize22:38
kagandon't think so. any more questions ?22:38
hub_capnope im good kagan22:38
vipulhub_cap: yea let's discuss that in #reddwarf later22:38
hub_capexactly vipul22:38
hub_cap#topic Snapshots Blueprint Feedback22:38
*** openstack changes topic to "Snapshots Blueprint Feedback (Meeting topic: reddwarf)"22:38
hub_capcan someone linke the bp?22:39
vipul#action kagan to socialize fixing resize test or heartbeat thread for the ocrrect state22:39
hub_capi know demorris and vipul have chatted on this22:39
vipul#link https://blueprints.launchpad.net/reddwarf/+spec/consistent-snapshots22:39
hub_capvipul: thx for that action. good call22:39
SlickNik#link https://wiki.openstack.org/wiki/Snapshot-design22:39
vipulcool SlickNik beat me to the second link22:39
hub_caphehe, i havent had a ton of time to read up on it yet22:40
vipuldkehn's done a good job outlining the fix..22:40
hub_cap#action hub_cap read https://blueprints.launchpad.net/reddwarf/+spec/consistent-snapshots22:40
vipullike the wiki write up for it.. very consise22:40
vipuldemorris added the API this morning22:40
hub_capvery nice on the pluggable interface design tho22:40
demorrisyep, love the pluggable design piece22:40
hub_capvipul: im assuming u havent had a ton of time to look into it? or have ya22:40
hub_cap<3<3 pluggable22:40
SlickNikYea, I'm still making my way through it, but so far so good.22:41
vipuli have some.. but not completely22:41
demorrisvipul: you had some comments on the use of a locationRef for the location of the snaps in Swift22:41
vipulhowever it looks a lot like what we had in our fok22:41
vipulfork22:41
hub_capsuper22:41
vipuldemorris: yes, i don't know if location of the snapshot.. where it's stored should be exposed22:41
vipulso if you expose it.. it means you would likely have to expose the swift endpoint..22:42
grapexvipul: Agreed.22:42
demorriswould you expect a snapshot to be portable?22:42
vipuland you may not be using swift as a location22:42
vipulBUT...22:42
vipulif we put the snapshot in the user's tenant's container.. then they'd see it anyway22:42
hub_capand probably delete it on accident :P22:43
vipuldemorris: not by the user.. that's up for discussion i guess22:43
vipuldemorris mentioned that delete would have to be reconciled by reddwarf22:43
grapexhub_cap: Not if we name the container "PLZ_NO_DELETE"22:43
SlickNiklol@grapex22:43
hub_capgrapex: thats the plan!! hidden_dont_look_here22:43
demorrisvipul: well i saw that in the DB design22:43
vipultoo bad swift doesn't have hidden containers22:44
vipuland nova doesn't have hidden instances22:44
demorristhere was a "deleted" column22:44
vipuldemorris.. that would be for user api delete22:44
demorristhat said 0 or 1, seemed to indicate it was there to store information on if the snap went missing in Swift22:44
vipulnot behind the scenes delete.. so we could account for both if we need to22:44
hub_capvipul: vishy has already said he would welcome "managed vms" in nova22:44
demorrisvipul: i see22:44
vipulhub_cap: yea we need to file the BP on that one22:45
vipulSo.. i'm open to either implemenation.. location visible or not22:45
hub_capyup ive mentioned it at like 3 summits :P but never worked on it22:45
SlickNik"managed vms"?22:45
vipulor 'hidden vms'22:45
hub_capvms that a user cannot modify but are on their account22:45
hub_capi dont like hidden22:45
vipulso we can create them on behalf of customer and they don't see them on a 'nova list'22:45
SlickNikah, I see.22:46
hub_capthey should be able to see them imho, but not touch them22:46
hub_capif im payin for em, i wanna be able to see em22:46
hub_cap:D22:46
vipulhub_cap: yea i could live with that22:46
demorrisI guess my thought was that a user "may" want to get at their snapshot directly in Swift, if they wanted to port it somewhere either within the DC or out somewhere else22:46
vipuldemorris: but we may consider encrypting or something.. not sure if they'd be useful...22:46
demorrisso providing a locationRef, simplifies knowing where it is22:46
vipuldemorris: but we do need to think about portability22:46
hub_capya cuz the system wont know about it w/o some sort of import_snapshot22:47
hub_capto link up the moved snap from somewhere else in the DC as per your point demorris22:47
demorrisyeah, I would think you want to have optional encryption, and potentially for a user to specify their keys (if you go that route)…then they have the keys so if its encrypted they can decrypt22:47
cp16netcan i download my snapshot and run it in my dc?22:47
vipuldemorris: yea that would work well.. just another set of APIs though22:47
hub_capcp16net: thast what morris wants, and i think thas a good idea22:47
hub_capid say lets go easy route for v122:48
vipulhub_cap: so we need to scope this down22:48
cp16netmakes things very portable22:48
demorrisI think that should be supported, we don't want to lock data in22:48
vipuli think maybe for v1 we take out portability?22:48
hub_capya i can live w/ that22:48
hub_capsnaps themselves will be a lot of work22:48
demorriswell I would say we are not taking it out, but it would be making it harder22:48
hub_capseems like a addd on22:48
grapexMake it optional but not required by the spec?22:48
vipulwe can still leave location in... and they may be able to delete behind our back22:48
hub_caphell vipul htey can do that w/o a location :)22:49
vipulheh yea22:49
demorrisyeah, if you use the customers Swift account, the chance of accidental deletion is always there22:49
hub_capso lets think aobut it this way22:49
hub_cap_adding_ to the api doesnt require version updates22:49
hub_cap_removing_ does22:49
hub_capif we are unsure for now, lets leave it out and add it on as we flesh out the details22:49
vipulright.. hide location for now then22:49
demorrisk22:49
SlickNiksounds good.22:50
cp16netthats true for many things tho demorris22:50
hub_capi do think its a good idea tho22:50
hub_capbut a bit too much implication-wise for now22:50
*** jcru is now known as jcru|away22:50
*** jcru|away is now known as jcru22:50
vipulanother thought22:50
cp16netwould be really nice for off 'site' backup22:50
vipulwhat if the user that makes a call to Reddwarf doesn't ahve Swift role22:50
hub_capcp16net: def22:50
hub_capvipul: snapshots fail w/ a useful error message :)22:51
vipulhub_cap: alright.. that would work22:51
hub_capwe should do a HEAD on the container we decide to use b4 we do a snap22:51
hub_capfrom the api/taskmanager22:51
cp16nethow about http code 418?22:51
hub_capitll validate the container exists22:51
hub_capis that teapot cp16net?22:51
cp16net"i'm a teapot"22:51
vipulcp16net: lol22:51
cp16net:)22:51
* hub_cap shakes head at cp16net22:51
hub_capok do we feel good wrt snapshots for now?22:52
demorrishow do y'all expect restoring snapshots to work?  My take is that any restore of a snapshot goes into a new instance…not an existing instance.  To remove the chance of a customer blowing away portions of data on their instance…22:52
vipul#action vipul to update snapshots design to call out swift role required, and behind the back deletes22:52
vipuldemorris: that's my thought as well, only supported on 'create'22:52
hub_capdemorris: that sounds reasonable, vipul and co, thoughts?22:52
demorrisi.e. we support create instance from snapshot22:53
demorrisbut not import to existing instance22:53
vipulyep, no other form of restore22:53
hub_cap#agreed22:53
hub_capdemorris: i think i saw that in the api, correct?22:53
SlickNikI think that's reasonable for a v1.22:53
demorrishub_cap: correct22:53
demorrisany issues around the "statusDetails" in the API?22:53
vipuldemorris: it makes some sense, since a DELETED could have happned in multiple ways22:54
demorrisit was called notes in the DB design, I changed it…that can be used to display any details on the status…FAILED, DELETED, RUNNING, etc…22:54
vipulbut.. i don't know if we _need_ to have it22:54
vipuland if we have it, does it belong in API response22:54
vipuldo we have precedence for it in other 'statuses'?22:55
demorriswould be hard to have it in the response since its async22:55
vipuli guess service_statuses does22:55
cp16nethow will the customer be able to see that the isntance they just created is tied to the snapshot or does that matter?22:55
hub_capi htink our precedence is that we have terrible responses if async things fail22:55
hub_capmaybe we shouldnt try to shoehorn that into snaps22:55
vipulcp16net: I don't know that matters.. since it's only a point in time that they are linked22:56
hub_capand make it inependent to work for any async/status22:56
demorrisi will ALWAYS be pro fields like this, because it allows us to actually tell the user what happened22:56
cp16netok just curious22:56
demorrisinstead of having them scratch their head and hit submit a few more times :)22:56
hub_capdemorris: sure but wouldnt u be pro "give me a way to do it for any async call"22:56
grapexI agree... I really hate how the resize status stuff works. There's no way to know if the job failed except if the flavor doesn't change.22:56
hub_capit shoudl be generic enough to use for any of the cast's22:56
hub_capid say lets put a note that we need to make that generic and file a separate BP22:57
demorrisyes, but I don't want y'all to take on the overhead of building out an async model right now22:57
hub_capdemorris: id rather build that then hack it and have to change it22:57
demorrishub_cap: can you build it in a week?22:57
vipulhub_cap: so i'm hearing that we leave it out of the snapshots impl22:57
demorris:)22:57
hub_capdemorris: of course not22:57
vipuland come back around22:57
grapexdemorris: Where did you want statusDetails to appear again?22:57
hub_capvipul: i think so, its a great idea but i feel like itd be a hack on snapshots and wont go anywhere22:58
demorrisgrapex: check List snapshots in the spec22:58
SlickNikgrapex: in the API responses, methinks.22:58
vipulhub_cap: Yes, i am good with that..22:58
vipulsince it seems to encompass more than snapshots22:58
hub_capcorrect vipul22:58
hub_capso the main reason im against22:59
grapexI think having status details per snapshot is ok-22:59
vipul#action hub_cap, grapex to file blueprint on detailed status messages for async operations22:59
hub_capis that if we have to alter in any way we have to rev the api22:59
grapexbecause like I think has been mentioned, we could query swift and see if the underlying object was deleted as well as provide status on the back up process22:59
robertmyersrespond with 202 accepted22:59
vipul#action vipul to remove status Detail from snapshots API/impl22:59
robertmyerswith a link to the status url23:00
grapexSo we already have task description in the Reddwarf API23:00
*** esp has quit IRC23:00
*** esp has joined #openstack-meeting-alt23:00
grapexthe MGMT api returns it. But all we can really do is show things like if something went wrong in the build process23:00
grapexLike for resizes, we can't make use of it for various reasons - it can't represent a unique thread of execution in the scheme of things, just a resource23:01
hub_capgrapex: i agree its someting we need, we should focus resources on it. its been a pain point for a VERY long time23:01
grapexso for the snapshots resource, when you provision it I can see we could add info there.23:02
cp16net#AGREE23:02
* hub_cap hears grapex feverishly typing23:02
grapexIf we need to store status during operations like restore or something else I can't think of atm it won't work, because once the resource is prov'd status's duty is just to report the state of the resource and not the success of some job23:02
grapexI'm just saying, having a statusDetails are ok, because we do it provisioning Reddwarf instances now.23:03
grapexIt only works for the provisioning process.23:03
* vipul wishes we had phone meetings23:03
hub_capvipul: bah23:04
demorrisdemorris: agrees23:04
grapexhub_cap: Well they say that brevity is the location from which originates the quickness of the mind.23:04
hub_capwishes everyone could type 120wpm23:04
vipullol23:04
demorrisi get lost in here too easily23:04
vipulok i think this needs further discussioni23:04
vipuli'm lost as well23:04
hub_cap#agreed23:04
vipuli'm going to try to set up a phone meeting23:04
vipulfor this week23:04
hub_cap#action continue discussion on statusDetails23:05
vipulto go over snapshot details23:05
hub_capokey23:05
demorriswhat I heard was we are going to remove statusDetails in favor of a more defined model for checking on details of async calls23:05
grapexI agree generally with hub_caps point, I'm just not sure it applies to *this* feature. Anyway, lets table it for now.23:05
hub_capdemorris: correct, i think :)23:06
vipulyea this seems like a wider topic than snapshots.. so we could go either way... figure out a way to get this implemented for snapshots23:06
hub_capyup23:06
demorriswe can still have it in the database and then optionally add it to the API as we learn more…additive okay, contract changes bad23:06
hub_capdemorris: correct23:06
hub_capid rather go w/ less for now and add stuff23:06
vipulok... btw.. someone was going to post a state diagram for RD states23:07
vipulrobermeyers ^?23:07
vipulrobertmeyers23:07
robertmyersnot I23:07
hub_cap#link http://s3-2.kiva.org/img/w800/196261.jpg23:07
grapexLOL!23:07
cp16netlol23:07
vipulheh23:07
grapexThat's what I was thinking23:07
cp16netis that bubble gum?23:07
jcruvipul: I wasn't able to find one23:08
hub_capcp16net: im sad for u23:08
hub_capflying spaghetti monster23:08
SlickNikFSM23:08
vipuljcru: ah ok, there is a lot of shit going in there...23:08
jcruhah23:08
esphub_cap: I had spaghetti for lunch!23:08
hub_capesp: flying?23:08
vipulwith eyes?23:09
hub_capso we need to do that, i agree. ill start it if no one else is on it23:09
espno, but a lot of it did end up on my shirt.23:09
hub_caphaha23:09
demorrisdone with snaps?23:09
jcruhub_cap: I can work on it23:09
hub_capdemorris: aye23:09
vipulhub_cap: probably makes sense someone from rax23:09
hub_capjcru: cool23:09
SlickNikFSM = Flying Spaghetti Monster = Finite State Machine...23:09
hub_cap#action jcru to work on a FSM (finite state machine)23:09
hub_caplol i thought the same thing SlickNik just now23:09
jcrulol23:09
hub_capu beat me to it23:09
hub_capmoving on?23:10
vipulyea, i'll set up a follow up meeting (if we still tink it's necessary)23:10
hub_capill keep the next section short since not much has happened23:10
hub_capvipul: i say lets try to discuss in chat23:10
hub_capand if it no workie lets talk about it23:10
hub_capill chat w/ the team here23:10
cp16netwere you talking about something like this? https://github.com/cp16net/reddwarf-integration/blob/6f672c3201e00f1b3241e25ce9c33b5881a24ec6/tests/graphics/reddwarf-overview.gv.jpeg23:10
vipulhub_cap: kk23:10
vipulcp16net: that's more of a component diagram23:11
hub_capcp16net:  more like resize->stopped23:11
hub_capbad example of course :P23:11
vipulright.. what states should instance be in when we do resize.. or whatever23:11
cp16netroger23:11
hub_capbut we coudl build w/ viz23:12
hub_cap#topic API Spec General Update23:12
*** openstack changes topic to "API Spec General Update (Meeting topic: reddwarf)"23:12
hub_capso im working on this starting tomorrow. will set up all the docs we have + snaps, limits, and anything else that is already in flight or in a BP23:12
hub_capill push as a work in progress review to gerrit so that everyone can see23:12
demorrishub_cap: there is probably stuff that is not in BP's that need to be in the spec23:13
vipulok, i think i need some info on what goes there..23:13
hub_capdemorris: def23:13
vipulstuff that's part of BP process goes into this repo?23:13
vipulor just the actual implemented v1.x api23:13
hub_caphttps://github.com/openstack/identity-api/blob/master/openstack-identity-api/src/markdown/identity-api-v3.md23:13
hub_capvipul: essentially we need to (as a collective group) define the api23:14
hub_capand then each developer will implement pieces of it23:14
demorrisone I think that is not there is maintenance windows23:14
grapexhub_cap: How do these .md files relate to the docbook files?23:14
hub_capand of course we will find small things that need changing23:14
hub_capgrapex: im not sure exactly23:14
vipulhub_cap: i think similar question.. are we going to be visible in api.openstack.org23:15
hub_capbut thats the way the api guys are working on it _today_23:15
vipulif not there, then where23:15
hub_capvipul: we can work that out i think23:15
hub_capmaybe stackforge can host a api.stackforge.org23:15
grapexhub_cap: Cool, I don't mind .md files.23:15
hub_capto mirror what openstack is doing wrt the api docs23:16
vipulalso do we need to wadl in addition to md?23:16
cp16net40423:16
vipulor is there some auto generation happening23:16
hub_capcp16net: lol likely23:16
demorrishub_cap: I will add a BP for this - As a Reddwarf User, I need to the ability to manage MySQL version updates, so that I can minimize unplanned downtime and plan accordingly for my production application environments.23:16
hub_capvipul: the auto gen will hapeen from the wadl23:16
hub_capdemorris: plz do23:16
demorrisessentially we add an attribute for - "maintenanceWindow":"2012-03-28T21:30Z/2012-03-28T22:00Z"23:16
hub_capso yes we will need to impl the wadl as a part of all this, but the markdown is the fastest way to get things working23:16
hub_capand i thnk thats why the teams have done this23:17
hub_capget it up, get it reviewed23:17
hub_capwait im wrong23:17
hub_capthe wadl are autogen'd now via that fancy fandangled python api23:17
demorrisit ties in to the versions-types BP i submitted23:17
hub_caphonestly its in flux, and these are good questions that need answering, and i dont have the answer23:18
vipuldemorris: do you report oracles vs percona in type?23:18
hub_capbut we need something that only a few people can commit to, in the repo, and markdown works very well w/ github23:18
hub_capso im assumign thats why they went that route23:18
hub_capvipul: i think thats part of the BP23:18
vipulhub_cap: ok, i think once you put in a framework things will fall into place23:18
*** robertmyers has left #openstack-meeting-alt23:19
hub_capor at least shake out a bit more vipul ;)23:19
demorrisyeah, check here - https://wiki.openstack.org/wiki/Reddwarf-versions-types23:19
vipulboth good things23:19
hub_capbut its good to get something up to chat about / implement23:19
hub_capdef23:19
demorristhere is a name / version attribute that lets you distinguish23:19
grapexhub_cap: Does the wadl live with the doc repo?23:20
demorrisa name would be a DB type + Major Version (Percona / Maria / MySQL , etc.)23:20
grapexOr is it an artifact of some build process?23:20
hub_capgrapex: best of my knowledge the wadl is generated23:20
*** imsplitbit has quit IRC23:20
hub_capbut i cant answer definitively23:20
vipuldemorris: Ok, making sense now23:20
demorrisvipul: we can tweak if needed23:20
vipuli think Percona should be a separate type, agree?23:21
demorrisYeah, it would be like "Percona 5.5"23:21
vipulOk, cool.23:21
demorrisor whatever it is you are using, will be up to provider to specify23:21
demorristhen versions is used for minor versions23:21
hub_capim assuming we have migrated topics23:21
vipulheh23:22
vipulyes23:22
demorriswhoops23:22
demorrisback on API spec23:22
demorrisanother BP coming will be my.cnf's23:22
vipullots of interesting things to discuss.. can't contain ourselves23:22
demorrisexpect to see that in the next week23:22
vipulw00t demorris23:22
demorrisand hub_cap will roll that in the API spec23:22
demorriswill be lots to review and discuss23:22
demorrisbut all good things!23:23
hub_cap#topic open discussion23:23
*** openstack changes topic to "open discussion (Meeting topic: reddwarf)"23:23
demorris#forwardprogress23:23
vipul#agreed23:23
hub_capdemorris: http 50123:23
vipulstill waiting on that vm-gate review to _get reviewed_23:23
hub_capsweet tho, progress!!23:23
vipulhub_cap we want to gate both rd-int and rd repos with that correct?23:24
demorrisalright, I need to run, thanks guys, i just might start showing up at these more often!23:24
hub_capvipul: def23:24
hub_capdemorris: <3 for participating23:24
demorrishub_cap: :)23:24
SlickNikYeah, I noticed that there are some whitespace issues like extra tabs/spaces that I'm going to clean up with that vm-gate review. I'll re-ping Openstack CI folks once I'm done with that.23:25
vipulOh another though.. us core reviewers have been slacking23:25
hub_cap#agreed23:25
vipulthere's a ton of stuff.. let's try to get it pushed through23:25
hub_capme especially23:25
hub_capother teams have done review days23:25
hub_capand other other teams have done 1 hr per day23:25
*** sacharya has quit IRC23:26
vipulwe probably should try to get something like that in our schedule23:26
grapexMe too... I've been busy with some stuff here lately and haven't been paying close enough attention. Sorry if this impeded anyone.23:26
hub_capother thing to note, if u have a work in progress, mark it as such via that fancy button23:26
SlickNikSame here, got busy with stuff and the emails kept piling. Will pay closer attn. to stuff in the pipeline.23:26
hub_caphttps://review.openstack.org/#/c/21989/ <-- example23:26
hub_capit will make it easier for us to not let WIP's slip in23:27
vipulesp ^23:27
grapexIt'd be nice if watched changes kept the work in progress items at the top of the list.23:27
hub_capit labels them tho at least23:28
grapexTrue.23:28
hub_caplike [work in progress]23:28
vipulthere deosn't seem to be an ordering23:28
hub_capesp: WIP your commit23:28
grapexI shouldn't complain, Gerrit's been a very enjoyable experience.23:28
vipuljust what you looked at last goes to top23:28
hub_capthere is vipul23:28
hub_capits the order at what u looked at23:28
hub_capexactly23:28
SlickNikyep23:28
*** demorris has quit IRC23:28
hub_capgrapex: def its nice23:28
hub_caphttps://review.openstack.org/#/q/is:watched+status:open,n,z23:28
hub_capthere is a good bit of changes to be pushed thru. lets get awn it23:29
vipulyep23:29
vipulonly 30 mins over23:29
vipul:)23:29
vipuli think we can wrap it up?23:29
*** amyt has quit IRC23:30
SlickNikNothing else from my side.23:30
SlickNikI think that's a go.23:30
*** amyt has joined #openstack-meeting-alt23:30
hub_capokey let wrap23:30
hub_cap#endmeeting23:31
*** openstack changes topic to "OpenStack meetings (alternate) || Development in #openstack-dev || Help in #openstack"23:31
openstackMeeting ended Tue Feb 19 23:31:02 2013 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)23:31
openstackMinutes:        http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-02-19-22.00.html23:31
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-02-19-22.00.txt23:31
openstackLog:            http://eavesdrop.openstack.org/meetings/reddwarf/2013/reddwarf.2013-02-19-22.00.log.html23:31
*** esp has left #openstack-meeting-alt23:32
*** hub_cap has left #openstack-meeting-alt23:33
*** djohnstone has quit IRC23:33
*** cloudchimp has quit IRC23:34
*** jcru has quit IRC23:35
*** kagan has quit IRC23:38

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!