21:01:35 #startmeeting project 21:01:36 Meeting started Tue Mar 25 21:01:35 2014 UTC and is due to finish in 60 minutes. The chair is ttx. Information about MeetBot at http://wiki.debian.org/MeetBot. 21:01:37 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 21:01:39 The meeting name has been set to 'project' 21:01:46 ttx, yup 21:01:50 Agenda: 21:01:51 #link http://wiki.openstack.org/Meetings/ProjectMeeting 21:01:51 ttx, it helps ;) 21:02:01 SergeyLukjanov: that calls for a cron script 21:02:07 \o 21:02:19 #topic Progress towards RC1s 21:02:55 We are slowly making progress to wards the first release candidates 21:02:59 hi ttx 21:03:09 Let me list the ETAs 21:03:16 ttx we have one more we put in trove, fyi 21:03:19 #info Keystone expected tomorrow 21:03:43 #info Trove also expected tomorrow 21:03:52 #info Cinder, Glance expected Thursday 21:03:56 maybe thr ttx ;) 21:04:13 #info Nova, Ceilometer expected Friday 21:04:29 #info Neutron, Swift, Horizon expected early next week 21:04:38 and heat 21:04:54 #info Heat also expected early next week 21:05:08 I think I have everyone 21:05:43 That also doubles as dates we expect to open Juno development on 21:05:56 and un-feature-freeze the frozen projects 21:06:32 Then if new release-critical issues are found we open RC windows and spin new release candidates 21:06:41 ...until release day 21:06:56 using backports from master to milestone-proposed? 21:07:03 dolphm: exactly 21:07:33 That's why it's important to nail the release-critical bugs now. After, it's more painful to do so with backports and reviewers distracted by Juno 21:07:52 (nothing impossible, just more painful) 21:08:05 Questions on that ? 21:08:08 ++ everyone is chomping at the bit to land changes for juno 21:08:23 understatement :) 21:08:41 #topic Dependency freeze 21:08:47 #link http://lists.openstack.org/pipermail/openstack-dev/2014-March/030729.html 21:08:58 In summary we'll soft-freeze openstack/requirements changes to master until we cut all the RC1s 21:09:08 At which point we'll cut a milestone-proposed branch there for release branches to consume 21:09:23 We are cleaning up the requirements-core group and will make sure the core reviewers are aware of this policy 21:09:32 yeh, I think everything that we need for the release besides the saraha client change is in 21:09:50 so I'd recommend no other changes at this point unless there is an rc bug they are attached to 21:10:14 yes, will send an email about this early tomorrow to requirements-core 21:10:27 Questions on that ? 21:10:52 i haven't gotten a clear understand of how this affects dependencies ON clients 21:11:11 specifically, horizon's dependency on a minimum keystoneclient version? 21:11:26 dolphm: that should be frozen at this point 21:11:32 unless it's an rc bug 21:11:44 i believe there's an RC bug for this issue 21:11:52 dolphm: I think david-lyle un-RCed it 21:12:03 the change password thing ? 21:12:05 regardless, it'd be an exception if we release a keystoneclient tomorrow (0.7.0) and horizon wanted to require it? 21:12:10 ttx: yes 21:12:13 dolphm: yes 21:12:18 dolphm: I would consider that an exception yes 21:12:20 because that forces the new version on everyone 21:12:25 ttx: i think the RC target got restored this afternoon 21:12:41 we must just weigh the benefits with the drawbacks, and make sure packagers are aware of it 21:12:49 dolphm: hah! 21:12:58 things happen while I have dinner 21:13:18 dolphm: so the minimum client issue is something we need a better story on 21:13:23 #link https://bugs.launchpad.net/horizon/+bug/1239757 21:13:24 Launchpad bug 1239757 in python-keystoneclient "Let users update their own password with Identity API v3" [Wishlist,Fix committed] 21:13:26 ttx: the sun never sets on openstack 21:13:31 sdague: ++ 21:13:37 because it seems like every time there is a client bump, everyone wants to pull up min version 21:13:45 even if it will work perfectly fine with the old version 21:13:53 or as fine as it used to, with known bugs 21:14:08 sdague: in that case it probably wouldn't, but agree on the general case 21:14:28 sure so this is a major bump 21:14:32 this is the first time we do this freeze, so there may be some rough edges and dark areas left 21:14:41 sdague: generally, i assume the community wants to consume new client features across projects, right? 21:14:55 dolphm: sure, but you can let users upgrade 21:15:05 we don't dump the min on sqla every time a new release comes out 21:15:07 sdague: they want to rely on a new feature of the client and expose it -- it's even arguably a feature 21:15:18 sdague: which is why I supported un-RCing it 21:15:22 conversely, i could see keystoneclient wanting to *push* new features to be consumed by other projects (say, a new implementation of something under the hood) 21:15:25 ttx: relying on a new feature is a different thing 21:15:37 and actually something we shouldn't be doing at this point in the cycle 21:15:40 that said it's really a gap with some security impact 21:15:52 so it's a bit grey 21:15:55 david-lyle: around ? 21:16:11 this would be nice functionality to have in Horizon for Icehouse, but we've supported keystone v3 since Havana without it 21:16:15 ttx: i'd like to understand the less-gray area first :) 21:16:43 david-lyle: would you consider it a new feature ? 21:16:56 i mean, keystoneclient 0.7.0 is coming this week whether horizon requires it or not 21:17:05 it's a descrepency between v2.0 and v3 21:17:09 ttx: technically, it's restoring a feature that was available in grizzly 21:17:19 dolphm: and it will contain a security fix that everyone will want to have anyway 21:17:29 ttx: ++ 21:17:36 so in that case the min dep bump might be warranted for security reasons 21:17:47 but we won't enable it without bumping the required client version 21:18:07 david-lyle: and there is no way to conditionally support it? 21:18:15 I think in that case we'll just accept the bump, but it's a bit of a special case (new version to close a CVE) 21:18:21 if keystoneclient.__version__ > (0, 7) ? 21:18:23 david-lyle: are you checking the version of the installed client to see whether to enable it, or are you removing the code if the version doesn't go up? 21:18:30 dolphm: yeh 21:18:56 we have the functionality blocked now, would reenable 21:19:29 we could add such a check if that's what it comes down to 21:20:32 anyway, let's move on. By thursday everything should be clearer there 21:20:57 dolphm: let's try this and come up with updated rules once we're done 21:21:02 ttx: ack 21:21:10 #topic keystone v3 and plans for v2 (and how that affects other projects) 21:21:15 russellb: floor is yours 21:21:37 ah yes 21:21:46 so there was confusion in our last nova meeting, so i figured i'd bring it up here 21:21:55 i was able to catch up with dolphm a bit async from that 21:22:10 but basically, there was confusion about the lifecycle of the keystone APIs and what it meant for projects like nova 21:22:24 v2 deprecated? if so, what does that mean for other projects, as well as deployers? 21:22:28 is that written out anywhere? 21:22:59 basically hoping dolphm can provide some clarity on what keystone folks have been thinking on this topic 21:23:00 I share these concerns 21:23:31 so, i think most of our strategy has gone undocumented so far, but our highest goal is to not break everyone :) 21:23:32 I'm concerned v2 is deprecated but v3 support is minimal 21:23:46 david-lyle: similar concerns 21:23:59 especially as it moves us from something we test a ton in the gate 21:24:00 i have a general bad feeling toward ever calling something deprecated unless you have a very specific timeline defined for when it can go away 21:24:05 at russellb's suggestion, i filed https://blueprints.launchpad.net/keystone/+spec/document-v2-to-v3-transition to follow up on that early in juno so we have something to share & talk about 21:24:12 being unsupported, and something we only test a little being official 21:24:26 sdague: deprecated != unsupported 21:24:28 fwiw, heat is fully on v3 21:24:43 dolphm: is it "frozen" then? 21:24:47 sdague: i consider v2 to be fully supported, and will continue to be fully supported until it's removed -- likely in pieces 21:24:49 stevebaker: in the default domain only, I assume? 21:24:56 frozen different than deprecated to me 21:25:00 sends a different message 21:25:02 dhellmann: save for serious issues, yes 21:25:20 russellb: right, I thought this might be a word-choice issue 21:25:41 dhellmann: yeah, sounds like it could be ... 21:25:41 russellb: we freeze v3 at milestone 2 every cycle as well... so i agree 21:25:44 david-lyle: sort of, we also have a special domain and create a project per stack, and a user per (some) resources 21:26:04 dolphm: maybe frozen isn't quite right either -- you're just not adding new features to v2? 21:26:11 so, 1) v2 still fully supported, 2) no timeline yet for when v2 would go away 21:26:13 is that correct? 21:26:18 dhellmann: correct 21:26:40 I would call that "normal". Why is it marked as deprecated? 21:26:46 heh 21:26:54 russellb, isn't the typical nomenclature, deprecated -> obsoleted -> removed? 21:27:14 we typically use "deprecated" to mean that it has been replaced and is scheduled to go away 21:27:17 russellb: 1) correct 2) one of our motivations for deprecating v2 in icehouse was that A) v3 has parity with v2, B) that gives us two full releases until we have the option to *start* removing unused bits 21:27:39 russellb: Deprecated: v2 API is deprecated as of Icehouse in favor of v3 API and may be removed in K. 21:27:43 http://logs.openstack.org/55/82255/4/gate/gate-tempest-dsvm-full/b819624/logs/screen-key.txt.gz?level=WARNING 21:27:49 i don't see how it could be called deprecated when the majority of openstack itself doesn't use the new thing yet 21:27:52 i expect things like public-facing auth to be supported in some capacity for quite a while, even if under the hood it's just middleware rewriting requests for the v3 app 21:28:25 just all sounds premature i guess 21:28:27 and confusing 21:28:39 dolphm: is marking it deprecated more a way to encourage projects to start moving away from it, rather than indicate that projects have already done so? 21:28:50 devananda: ++ 21:29:06 i think that disticntion is confusing some people, since AIUI, nova uses the latter terminology 21:29:06 fwiw, i consider the primary burden of that move to be on keystone itself 21:29:08 dolphm: I think there are other ways to encourage openstack projects to move away from it 21:29:10 I think that is backwards 21:29:10 i don't think a stick is helpful here 21:29:12 russellb: agree 21:29:24 deprecation is more for users we don't control 21:29:36 not for projects we can encourage to move internally 21:29:47 russellb: fwiw, keystoneclient 0.7.0 will finally let us start replacing code in other clients/services with much less code that will likely be accepted by those projects :) 21:30:02 I think we should have a cross-project workshop on aligning to latest versions of APIs internally 21:30:14 ISTR other projects also being hit 21:30:19 so i think most people think of the status of the API as you describe it as not actually deprecated 21:30:30 and we shouldn't call it that until we have a specific timeline for when *external* users will be affected 21:30:36 stevebaker: can heat not use v2 due to a need for domains? or roles? 21:30:36 including a clear timeline and migration plan for them 21:30:49 well the current deprecation does state "may be removed in K" 21:30:54 so that's pretty specific 21:30:54 stevebaker: and how does heat use v3 when nova doesn't? 21:31:20 perhaps we remove that part of the deprecation message at least? 21:31:23 annegentle: you can use v2 and v3 concurrently 21:31:35 horizon had to back from having v3 as the default because of lack of cross service support 21:31:38 lifeless: so it's a matter of service catalog config? 21:31:43 annegentle: heat needs domains to let non-admins use waitconditions 21:31:45 lifeless: only the v3 logic that was from v2 21:31:49 annegentle: yes, list both. 21:31:55 dolphm: I tend to agree with russellb on that one. Would rather remove the deprecation message and then advocate for v2->v3 moves at Juno design summit 21:32:20 then deprecate when you want users of the Api (not internal services) to move on 21:32:37 at least until the official clients get support 21:32:55 ttx: on that note, what v2 *doesn't* have yet, is a way to advertise it's deprecated status to api end users -- i consider that a potential blocker to removing support later on that needs to be seriously considered 21:32:56 for example, a deprecated HTTP header in responses 21:32:56 all the deprecation advertising we're doing is really only within the openstack community, and for deployers 21:33:00 largely a terminology / communication issue 21:33:00 different uses of the terminology has caused some confusion here i think 21:33:00 annegentle: we need it for domains. There is a v2 shim which has the old limitation of requiring the stack launching user to be an admin 21:33:00 require it? 21:33:00 or can use it? 21:33:00 i think we've failed at some coordination here for some project(s) to require it, and others to not support it at all 21:33:17 (lots of sudden IRC lag for me) 21:33:22 dolphm: same here 21:33:22 dolphm: same here 21:33:28 echo, too 21:34:01 dolphm: does any API have a way to advertise its deprecated status? 21:34:03 stevebaker: lifeless: thanks, that's helpful 21:34:04 annegentle: the credentials we use in the non-default domain are only for a very few heat API operations (for nova server -> heat communication) 21:34:12 dolphm: if it's not targeted to users, should we remove that deprecation message ? 21:34:19 you can't use non-default domain users with services that don't support v3 21:34:38 dolphm: yes I think the user-facing communication needs to not mention deprecation 21:34:42 dhellmann: i've seen proposals to alert clients at runtime, but haven't worked with anything functional myself 21:35:04 dolphm: ok, I wasn't sure if you were worried about following some sort of precedent 21:35:25 david-lyle: everything openstack should absolutely move to v3. But marking it deprecated for openstack admins to see won't really make that happen 21:35:31 dolphm: I do like the idea of communicating with the client somehow, fwiw 21:35:40 ttx: i think that's the crux of this conversation 21:35:49 ttx: playing devils advocate here, why should we adopt keystone v3? 21:36:02 jogo: because users like things like domains ? 21:36:04 my argument is, you can't really use v3 fully so to mark v2.0 deprecated is flat wrong 21:36:08 what benifits does it provide? (re: incentive vs stick) 21:36:26 jogo, trusts support 21:36:30 ttx: the deprecation message is still relevant... and i don't think it's doing any harm. the choice of language in it was fairly careful as well (*may* be removed) 21:36:34 (not related to domains) 21:36:40 ttx: what about the hierarchial militancy? thats what I want 21:36:53 SergeyLukjanov, trusts are in V2. 21:36:54 dhellmann: i'd love to have a precedent to follow, if there's a good one :-/ 21:36:56 dolphm: how often does the deprecation message show up in logs? 21:37:05 morganfainberg, oops 21:37:06 dhellmann: should be once 21:37:11 jogo: so move from v2 directly to v4 bypassing v3? 21:37:15 dolphm: no, but the sdk team might want to collaborate on setting up a protocol 21:37:16 dolphm: maybe "deprecated" is an overloaded term in that message 21:37:16 dolphm: thoughts on all this? willing to drop the deprecation title for now to avoid the mass confusion? 21:37:24 * russellb curses irc lag 21:37:27 dhellmann: that'd be great 21:37:29 I bring this up becasue of the recent nova v3 discussion -- where we had trouble coming up with a strong reason to make a major API rev 21:37:36 dhellmann: also great for a cross-project workshop :) 21:37:44 dolphm: +1 21:37:47 +1 21:37:52 dhellmann: one on API versions ? 21:37:54 * dhellmann is looking forward to cross-project day in atlanta 21:37:58 in general ? 21:38:02 dhellmann, ++ 21:38:03 ttx: on advertising api version deprecation 21:38:11 russellb: ttx: is there a better choice of words than "deprecated"? 21:38:13 and what deprecation means? :) 21:38:17 "pending deprecation"? 21:38:22 i don't think it's actually deprecated based on the discussion 21:38:29 +1 for on API version deprecation in general 21:38:30 it's a fully supported thing even if you're not adding stuff 21:38:39 we just have work to do across openstack to migrate to it 21:38:45 yeah, it really seems like it's "stable" and we're still doing v3 development 21:38:46 dhellmann: file while you think about it 21:39:06 dolphm: "we are migrating away" ? 21:39:07 ttx: I'll leave that to dolphm, I don't want to run that session :-) 21:39:24 dhellmann, i would classify v3 as stable, it is receiving new features, but it's not being broken. 21:39:30 it's almost 11pm here don't expect me to get creative 21:39:37 dhellmann, stable, deprecated, etc all overloaded terms at this point 21:39:47 and once *that* is done, we can talk deprecation 21:39:47 deprecation means people outside of openstack itself have to take some action 21:39:47 some migration path 21:39:47 and i don't think we're quite at that point yet right? 21:39:47 i'm a little sore on marking things deprecated without a schedule to actually remove, i guess 21:39:48 if there's a summit session on this, i'd like to start by defining "deprecated" :) 21:39:48 morganfainberg: true 21:40:01 russellb: ++ 21:40:04 russellb: ++ 21:40:15 but a schedule was given, right? K? 21:40:25 dhellmann: heh yup 21:40:26 dhellmann: was it? 21:40:29 the question is, is that a real schedule because the other projects are going to be ready? 21:40:31 dhellmann, that is the default, it would be easy to change that. 21:40:34 dhellmann: havana shipped v2 and v3 side by side, both being labeled as "stable" (grizzly may have too) 21:40:38 dhellmann, (default is +2) 21:40:56 ttx "Deprecated: v2 API is deprecated as of Icehouse in favor of v3 API and may be removed in K." 21:41:05 basically, the deprecation mechanism woirks for end user migration, not so well for internal API migration 21:41:05 http://logs.openstack.org/55/82255/4/gate/gate-tempest-dsvm-full/b819624/logs/screen-key.txt.gz?level=WARNING 21:41:12 ok well step back, we need to remove that schedule 21:41:12 because if stuff isn't migrated, that's unreasonable 21:41:12 IMO 21:41:28 it sounds like what we're asking is for the keystone team to *not* deprecate the V2 API until the rest of us are consuming it 21:41:39 and so we need to see about making *that* a priority 21:41:40 internal API migration has to happen prior to user-side deprecation 21:41:42 dhellmann russellb: ++ 21:41:52 that is the model glance is taking as well 21:42:03 they are deprecating old API after nova switches over 21:42:07 i was just trying to word that well 21:42:15 seems odd for keystone to set a schedule before other projects have migrated 21:42:16 * markwash nods 21:42:28 devananda: hence the "may" 21:42:46 devananda: because they have no real control over that 21:42:49 the deprecation message is telling users "you need to migrate by K becayse we may remove it" 21:42:58 which is why I think internal API migration has to happen prior to user-side deprecation 21:43:03 dhellmann, i lied, can't remove the "removed in" part, need to update oslo-incubator for that. 21:43:06 dhellmann, sorry. 21:43:20 because otherwise you just can't have a realistic schedule 21:43:30 dhellmann, easy fix in either case. 21:43:38 morganfainberg: we can update the incubator :-) 21:43:55 dhellmann, yesh. 21:43:56 russellb: looks like you could argue that in a thread, I'm pretty sure there will be suggestions of alternate wording there 21:44:09 russellb: it's kind of urgent though since keystone was about to tag RC1 tomorrow 21:44:40 markwash: your input for how you do glance will be wanted on that thread -- consistency is good 21:44:58 sounds fair 21:44:59 morganfainberg: I'd even consider a concurrent change, rather than changing the incubator and then syncing 21:45:08 dhellmann, ++ 21:45:23 dhellmann, was going to recommend that for ease of getting this through for RC. 21:45:25 russellb: is K* not a reasonable schedule? 21:45:27 * dolphm is about to give up due to IRC lag 21:45:31 morganfainberg: just mention it in the commit message 21:45:37 i think a documented migration plan + implementation of replacement across openstack is a prerequisite to setting that timeline 21:45:46 russellb: +1 21:45:47 dolphm: its not reasonable to spam operator logs for a year 21:45:51 russellb: +1 21:45:54 in that vain I'm a bit concerned about running "both v2 and v3 in the catalog" since that seems. . inconsistent with what glance is doing. . but that's a different can of worms 21:45:59 dolphm: whether the timeframe is reasonable is entirely separate 21:46:01 Hopefully we'll get better at communicating cross-project priorities -- classic deprecation mechanism is not the way to push internal API migrations imho 21:46:13 and maybe I'm confused 21:46:54 russellb: continue on ML thread ? 21:47:25 ah, we lost russell 21:47:35 ok, let's quickly move on 21:48:00 ttx: that reminds me, I do have something to mention quickly when we get to open discussion 21:48:08 #action russellb to quickly start a thread on keystone v2 deprecation 21:48:17 quick let's action russellb and dolphm on plenty of things 21:48:26 ttx ++ 21:48:30 as lonas the bot is on my side of the split 21:48:41 arh, he's back 21:48:54 russellb: fyi #action russellb to quickly start a thread on keystone v2 deprecation 21:49:09 #topic Red Flag District / Blocked blueprints 21:49:22 Any other inter-project blocked work that this meeting could help unblock ? 21:49:30 is anyone waiting on anything to land in oslo-incubator? 21:49:37 that's a good one 21:49:48 * russellb stabs IRC 21:49:52 I got the action 21:51:01 dolphm: fwiw we moved to next topic, russell will start a thread asap to continue the discussion 21:51:23 netsplit rt: Any other inter-project blocked work that this meeting could help unblock ? 21:51:41 netsplit rt: is anyone waiting on anything to land in oslo-incubator? 21:51:42 esp. oslo-incubator changes 21:51:58 Looks like not 21:52:01 dhellmann: https://review.openstack.org/#/c/82675/ 21:52:07 just responded to your comment as well 21:52:15 jogo: did you get the oslo.messaging log=INFO patches around? 21:52:17 jogo: ack 21:52:26 I think we got our oslo-db utf8 stuff in, so glance is good AFAICT 21:52:54 jogo: +2 and sent to the rest of oslo-core for review 21:53:11 sdague: nova landed, cinder and ceilo are pending .. neutron doesn't use oslo.messaging yet 21:53:16 Oh, makes me think 21:53:16 ok 21:53:18 dhellmann: thank you 21:53:35 All: don't forget to sync relatively recent translations before cutting RC1s 21:53:41 heat not using oslo.messaging yet 21:54:42 dolphm: do you have translations merges in keystone ? 21:54:50 so I am a bit concerned about ceilometer's polling of APIs ( http://openstack-in-production.blogspot.com/2014/03/cern-cloud-architecture-update-for.html ) 21:55:27 dolphm: answering my own quetsion: https://review.openstack.org/#/c/78525/ 21:56:30 jogo: maybe that would make a valid bug to bring to ceilo folks attention 21:56:40 jogo: not sure it's been turned into a bug yet though 21:56:42 ttx: +1 21:56:47 * jogo files a bug 21:57:04 jogo: ping jd__ when done and start discussion there ? 21:57:17 it's not completely too late yet :) 21:57:27 * ttx quickly moves on 21:57:28 #topic Incubated projects 21:57:29 honestly, I think it's too late to work on that for release :) 21:57:34 o/ 21:57:39 re sahara https://launchpad.net/sahara/+milestone/icehouse-rc1 21:57:41 devananda, SergeyLukjanov, kgriffs: o/ 21:57:54 renaming finished, we'll be ready for rc1 next week 21:58:00 you still have a couple weeks before you really need to cut RC1s 21:58:09 but as always the sooner the better 21:58:28 ttx, yup, I think next week should be ok, Thu is the plan 21:58:37 ttx, Apr 3 21:58:39 just ping me when you want them 21:58:46 i'll be around 21:58:49 ttx, yup, thank you 21:58:53 #topic Open discussion 21:59:00 anything anyone? 21:59:08 I plan to send a message to the ML tomorrow about the plan for oslo library releases in juno 21:59:12 #link https://wiki.openstack.org/wiki/Oslo/JunoGraduationPlans 22:00:14 dhellmann, sounds interesting 22:00:17 wow more complex than I'd have thought :) 22:00:45 there are still some issues to resolve about alpha releases, but I think we have everything else worked out 22:00:47 dhellmann: sounds good (the message) 22:00:51 ttx, ++ 22:00:54 ttx: we are close on rc1, have one more bug that I am checking on 22:00:59 it may slip to juno 22:01:10 kgriffs: you have plenty of time, your callreally 22:01:17 ok, we need to clear the room 22:01:28 thanks everyone! 22:01:35 #endmeeting