20:00:19 #startmeeting heat 20:00:20 Meeting started Wed Aug 28 20:00:19 2013 UTC and is due to finish in 60 minutes. The chair is zaneb. Information about MeetBot at http://wiki.debian.org/MeetBot. 20:00:21 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 20:00:23 The meeting name has been set to 'heat' 20:00:34 o/ 20:00:38 evening all 20:00:40 o/ 20:00:40 yop 20:00:47 Hello! 20:00:57 o/ 20:01:06 o/ 20:01:15 shardy can't make it this evening, so y'all are stuck with me again ;) 20:01:16 hello everyone 20:02:26 hey 20:02:34 ok, I think that qualifies as a quorum 20:02:39 o/ 20:02:43 hello! 20:02:44 #link https://wiki.openstack.org/wiki/Meetings/HeatAgenda 20:02:47 #topic Review last week's actions 20:02:51 o/ 20:03:01 #link http://eavesdrop.openstack.org/meetings/heat/2013/heat.2013-08-21-20.01.html 20:03:10 only one, shardy to post mission statement, again 20:03:16 that actually happened! 20:03:18 woohoo! 20:03:23 finally :) 20:03:43 let's call that success, unless anybody wants to bikeshed some more ;) 20:04:04 isn't that what meetings are for? 20:04:07 #topic Reminder re FeatureProposalFreeze 20:04:18 #link https://wiki.openstack.org/wiki/FeatureProposalFreeze 20:04:39 hopefully y'all have proposed your features 20:04:43 that seemed to go well 20:04:46 came and gone no? 20:04:52 SpamapS: yep 20:05:06 when is feature freeze? 20:05:08 * zaneb suspects copy-and-paste fail on the agenda here ;) 20:05:26 stevebaker: 4th September 20:05:31 am I in a time machine? 20:05:34 #link https://wiki.openstack.org/wiki/Havana_Release_Schedule 20:05:55 so, good job everybody 20:06:13 so features still being reviewed after the 4th need explicit exceptions? 20:06:17 and it looks like we don't have a huge review backlog, so we should be in good shape for feature freeze 20:06:39 stevebaker: well, havana-3 release is on the 6th 20:06:51 so there shouldn't really be any _features_ going in after that 20:07:35 review queue looks about as long as always 20:07:44 #link https://review.openstack.org/#/q/status:open+project:openstack/heat,n,z 20:07:44 I'm trying to help :) 20:07:44 Do we have features which are racing to land? 20:08:01 good question 20:08:06 yeah it'd be nice if I could filter gerrit by feature vs bugfix 20:08:08 #topic h3 blueprint status 20:08:15 my review queue alarm threshold is "does it scroll?" 20:08:31 https://launchpad.net/heat/+milestone/havana-3 20:08:32 zaneb, http://status.openstack.org/reviews/#heat 20:08:32 stevebaker: it's been scrolling for quite a while though ;) 20:08:36 jasond is multi-engine stuff a feature or bug? 20:08:54 kebray: yes! 20:08:57 looks like all targetted BP's are in review 20:09:00 asalkeld: ooh, fancy :) 20:09:17 kebray: we decided it was a BP since the original commit was reverted 20:09:32 ah there we go 20:09:49 reviews on this are lacking https://review.openstack.org/#/c/43205/ 20:09:54 ok.. so, zaneb, we're racing a bit on the multi-engine one. I think jasond has it under control though.. it's down to more tests I believe. 20:10:09 ok, thanks for the info 20:10:42 #link https://launchpad.net/heat/+milestone/havana-3 20:11:14 trusts and multi-engine are the two diciest, I think 20:11:33 but I'm reasonably confident 20:11:49 I want trusts... if help is needed, let me know and I can see what resources we can spare to help the effort. 20:12:11 kebray: reviews would be good 20:12:16 k. 20:12:31 kebray: we all want trusts ;) I think shardy has got it to the point where it's not going to be lack of resources causing a problem 20:12:39 it will be random stuff out of left field 20:12:49 yes +1 on trusts :) 20:13:02 zaneb: that's what I thought... and I figure throwing more people at the problem would actually slow it down. so, also happy to stay out of the way :-) 20:13:11 after studiously ignoring reviews for a few days to get the update stuff posted, my plan is to focus on reviews for the next few days 20:13:23 but, stevebaker comment on reviews is appropriate. we'll try to help with that. 20:13:42 the gate will be crazy next week, so if everybody can try to get the review backlog down that would be very helpful 20:14:21 also can we stick to looking for bugs in the reviews 20:14:38 hm? 20:14:42 uploading new patches is very time expensive 20:15:02 yeah, y'all would be surprised about how little anybody will care about typos in hte commit message a year from now ;) 20:15:43 radix, just saying very little value in fixing nits 20:15:44 s/hte/the/ 20:15:44 #topic Single Config file? 20:15:44 asalkeld: you have the floor 20:15:46 the commit message is the most important part of the change 20:15:53 haah 20:16:11 so the change for the single config is in 20:16:23 so little to motivate for now 20:16:38 but to let you know we are moving to a single heat.conf 20:16:49 I'll do the devstack change 20:17:02 the docs still need updated, right? 20:17:02 yay 20:17:03 then kill the old heat-<>.conf's 20:17:11 radix, yes 20:17:16 good point 20:17:35 that's all from me 20:17:42 asalkeld: so the devstack change will start with heat.conf.sample and customize? 20:17:48 yip 20:17:55 sweet 20:18:02 is devstack broken atm with master/ 20:18:15 not for me 20:18:18 sounds good, I guess the question was answered in the affirmative ;) 20:18:18 really 20:18:47 I have some environment and template patches for devstack 20:18:49 you can always run heat standalone against some other cloud 20:18:51 yes it is broken 20:18:57 not sure if they have made it in 20:18:58 #info we will move to a single config file and remove the legacy configs 20:19:22 https://review.openstack.org/#/c/43631/ 20:19:45 that not being in might be causing issues 20:20:41 yes, we'll be needing that 20:20:49 zaneb: asalked: is there a doc/link to learn more about single config? 20:21:03 wait when are the legacy configs being removed? 20:21:08 "icehouse" right? 20:21:09 no, what do you need? 20:21:28 SpamapS, we still support them 20:21:34 ok, just examples. 20:21:44 just removing the examples from master 20:21:46 ya 20:21:56 roger, nothing to see here, move along 20:22:14 zaneb, SpamapS 's next topic... 20:22:24 :) 20:23:10 #topic moving rackspace cloud server specific resources out of heat tree 20:23:10 so, can I just redefine something here? 20:23:10 in-repo = in openstack/heat git repo 20:23:15 in-tree = under heat/engine/resources 20:23:39 so, SpamapS, what we're talking here is moving out of the repo? 20:23:52 or into a contrib dir 20:23:58 Ok, I think they should be out of the repo, in the direct control of rackspace-cloud-interested people. 20:24:04 well what really matters is what the rackers want 20:24:08 because I was under the impression we agreed to have it under /contrib, and then when it landed it was in-tree 20:24:18 and I don't know what happened there 20:24:20 I think the rackers are looking to us, heat-core, for guidance. 20:24:23 miscommunication? 20:24:48 hello rackers, what do you want... 20:24:51 contrib still carries the problem that rackspace public cloud does not follow the openstack release cadence. 20:25:03 ping kebray 20:25:07 SpamapS: fair point 20:25:11 From the Racker perspective, we want wants best for the project and all parties who want to contribute in a similar manner... 20:25:29 This isn't like a driver in the kernel where it is there to support pieces of hardware that are "out there". 20:25:38 there's an obvious advantage to us if our resources get tested as part of CI, as a change to a base resource could affect our resources... but, we also understand not everyone may be able to contribute a fix to our resources. 20:25:53 SpamapS: but then again, having them out of tree requires us to be more disciplined about the interface to plugins 20:26:01 s/what's/wants 20:26:03 I am not stressed it being there 20:26:06 The rackspace public cloud is a special snowflake and will always be that way as long as it is not conformant with the rest of OpenStack. 20:26:16 hmm, do the rackspace resource tests actually get run in CI? aren't they protected by a "if pyrax is available" clause? 20:26:22 for now I would prefer to have no discipline about our plugin interface 20:26:41 zaneb: that much discipline will only help adoption of Heat and grow the ecosystem around Heat. 20:26:54 I think that is a strong point of somewhen in tree stevebaker 20:27:09 stevebaker: too long. "I would prefer to have no discipline." <- better 20:27:21 I just wonder about the priority that will be given to heat bugs that break plugins 20:27:23 radix: yeah, no pyrax, no testing 20:27:56 actually hm 20:27:58 SpamapS: actually 20:28:00 hehe :) 20:28:11 I just saw the tests force the registration of the resource so it can be tested. 20:28:24 yeah and they just side-step the pyrax calls. 20:28:33 what about resources like Trove? they should remain in-tree, no? 20:28:35 kebray: nobody is saying you can't be in stackforge of course. :) 20:28:39 (that's probably what neutron tests should do too... therve has been writing the tests so they skip if neutronclient isn't available even if neutronclient isn't really used) 20:28:44 kebray: absolutely 20:28:50 SpamapS: we still run unit tests without pyrax 20:28:59 we completely mock out pyrax 20:29:01 Any resource that is implementing an OpenStack API should be in-tree. 20:29:03 kebray: yes, as long as it uses regular keystone 20:29:19 SpamapS. Understood.. I feel I understand the arguments on both sides... so, I'm pretty neutral on this. 20:29:36 I feel like the contrib idea is a good middle road 20:29:43 for my part I would still at least like to see it moved to /contrib 20:29:52 +1 for contrib 20:29:57 as a packager, I really don't feel it belongs where it is 20:29:58 sure 20:30:01 +1 for /contrib 20:30:07 We hope the RS Cloud Server resources goes away soon.. we're working internally to converge compatibility such that the generic nova server resource is sufficient. 20:30:19 I feel like we are holding the rax developers back, and they are putting code in front of us that has almost nothing to do with Heat's core mission (whether you like the one we all came up with, or Robert Collins succinct one) 20:30:24 who wants an action to move it? 20:30:29 kebray, cool 20:30:38 kebray: i home when native nova server lands you can switch to subclassing that? 20:30:53 zaneb: you can give it to me 20:30:56 Load Balancer is another issue though. I think HP and other vendors will have similar one off special implementations potentially. 20:31:10 kebray: even more reason to get them out of the repo and into a place that can just be shut down when the unicorns are finally harnessed. ;) 20:31:16 #action andrew_plunk to move Rackspace resources to /contrib directory 20:31:22 SpamapS I don't disagree. 20:31:23 SpamapS: i like getting feedback from the core devs 20:31:39 kebray: HP's LBaaS is a published API (Atlas) IIRC. 20:32:21 when something is clearly up to us, the core devs can just approve based on votes from other rackers 20:32:32 so, on the in-repo/out-of-repo question, I'm relaxed. If the current situation is not working for Rackspace folks, feel free to move it. And if it is, I'm not worried about leaving it in /contrib 20:32:40 jasond: thats a fair counter-argument.. resources are still a bit mysterious and core devs can help make them better. 20:32:57 if it's in /contrib, will it get CI? 20:33:20 radix, as long as you have tests 20:33:22 radix: I'm sure there's a way to arrange it so it will 20:33:22 It would be harder to test them from contrib 20:33:34 I'm kind of "meh" on contrib 20:33:41 heat/engine/resources/rackspace == contrib in my mind. 20:34:08 SpamapS: I don't know about Debian, but that's just a PITA to package in an RPM 20:34:15 looks like we have come full circle 20:34:30 you can have multiple repos in heat, and contrib could be its own repo, and it could still have CI. 20:35:04 Is there a way to have contrib (or heat/engine/resources/rackspace be "optional" on test gates? Maybe adrian_otto's suggestion accounts for that. 20:35:08 SpamapS: except contrib/rackspace could have its own heat tree (engine, api, etc..) 20:35:22 Ok lets take a step back from the ideas on how. Am I in a minority in suggesting that these resources should be out of the repo/tree? 20:35:50 I don't mind either way 20:35:53 zaneb: no its not hard with Debian, but it is far less automatic than just "let setup.py do its thing" 20:35:55 SpamapS I know that RandallBurt's vote is with you 20:35:56 * zaneb is not taking a side 20:35:57 I'm neutral. 20:36:01 then let's KISS 20:36:19 Yeah, if its just me and Randall who care.. leave them be. 20:36:22 if having htem in tree is not causing objections, then let's revisit it once there is an objection to field. 20:36:54 I think we already worked around the test gate concern, right kebray? 20:37:13 My objection mainly pertains to the fact that by having them in-tree we raise the barrier for other projects who want to write custom resources.. as it is not obvious _at all_ how to do that and not be in-tree. 20:37:34 adrian_otto issue is if someone makes change to base resource and RS resource tests break, is that gating that change until someone fixes the RS resource? 20:37:39 SpamapS: that can be documented 20:37:56 SpamapS: true, but we weren't exactly fighting them off before either ;) 20:38:26 andrew_plunk: that *is* documented https://wiki.openstack.org/wiki/Heat/Plugins 20:38:27 SpamapS: we'd need to decide that our resource interface was going to have proper change control before encouraging that though 20:38:31 zaneb: An ecosystem starts with one user though.. and we have done the one in a special way that we will likely never do again. 20:38:35 SpamapS: does moving them to contrib not address your main objection? 20:39:17 contrib is stuff that does not get tested, right? 20:39:18 there is just a plugins_dir config option isn't there 20:39:24 kebray: moving them to contrib would make it more obvious, but would we accept a resource to control vagrant, or CloudStack, in contrib? 20:39:30 and it's use-at-your-own-risk 20:39:48 adrian_otto: I think we'd want to keep testing it 20:39:59 then it should probably be in your tree 20:40:03 SpamapS: I would 20:40:15 if you are supporting it, then treat it as such 20:40:16 Keeping these resources in the repo helps with collaboration outside of any specific company. Everyone gets visibility to Rackspace specific code and the converse 20:40:23 if it's unsupported, then it's contrib, right? 20:40:28 SpamapS I would be ok with it for now until we find a concrete objection. 20:41:06 Mmk, if we would, and we'd be happy with the review load being centralized, then we should push to move resources out of tree en masse eventually. 20:41:29 But for now, nothing is broken, and nobody is stifled, so I suggest we move on. 20:41:54 SpamapS: is this worth a mailing list post? 20:42:01 but to repeat kebray's comment, if it aids the project, we will not object to moving them elsewhere 20:42:02 seems like this is a long-form argument ;) 20:42:05 I agree it some point it will happen.. if enough special contribs are there, centralized review from core team will become difficult in the long run. But, it's still early.. we don't have many yet, so there's benefit to collaborating on the reviews. 20:42:39 adrian_otto, correct. I don't object to moving them out. I defer to the core team's recommendation. 20:43:15 ok 20:43:16 #topic Open discussion 20:43:19 have at it 20:43:39 is there a way to schedule/plan individual meetings at the summit? like, things that aren't talks 20:43:56 radix: yes, the design summit 20:43:58 is there a documented plan somewhere around native heat tools to replace heat-cfn, and overlap with what cloud-init provides? 20:44:18 radix: that is the entire point of the design summit. :) the talks were an after thought :) 20:44:22 radix: that hasn't been organised yet though 20:44:33 kebray: yes, .. blueprint native-in-instance-tools 20:44:53 kebray: I'll propose a design summit session for that 20:44:56 SpamapS does that address the overlap in functionality with cloud-init? I may just need to reread it. 20:45:01 stevebaker: awesome! 20:45:10 zaneb: wait, is the "design summit" something different from what is happening in HK? 20:45:11 kebray: there are 3 sub-blueprints 20:45:21 kebray: and there is no overlap.. cloud-init != a config management tool. :) 20:45:24 radix: it's a separate track 20:45:33 stevebaker: can you also propose the design summit happen in a place that isn't so expensive to travel to? I'd love to send more people :-) 20:45:39 radix: but don't worry, it'll be in Hong Kong ;) 20:45:43 hehe, ok 20:45:48 kebray: though for the bootstrap-config tool... it might work out :) 20:45:54 kebray: heh 20:46:05 SpamapS I know cloud-init isn't config management. I guess my knowledge of cnf tools is lacking. I'll read up on that :-) 20:46:26 ansible as a service? 20:46:38 ansible as a metadata snippet? 20:46:40 aaas is a horrible, horrible name 20:46:51 :) 20:47:02 * stevebaker drops the kids off at the school 20:47:18 radix: it's basically a bunch of rooms that are essentially developer-only design sessions. Official/incubated projects get allocated time. It'll be organised shortly. 20:47:25 I'm going to ansiblefest. I'm actually very interested in the convergence of the configuration tools with orchestration.. they are moving into orchestration, and some people think orchestration engine should solve config management (don't want to debate that now thought). 20:47:33 zaneb: okay, cool 20:47:44 zaneb: even though I'm not going to be there :( I want to propose some discussions 20:48:08 kebray: I may join you there. 20:48:11 kebray, it would be nice to support ansible/salt 20:48:21 fwiw, I don't think many of us Rackspace devs will be at the summit :-( 20:48:34 :( 20:48:41 :( 20:48:48 kebray: that's disappointing 20:48:48 heat summit in kebray's garage 20:48:49 asalkeld feel free to take up a collection :-) 20:48:57 kebray: are you _asking_ us to kidnap your devs and take them to HK? ;) 20:49:11 SpamapS: fine by me :-) 20:49:11 I don't know if you can kidnap the willing 20:49:13 * asalkeld not rolling in cash 20:49:34 I will represent radix 20:49:36 I know therve and adrian_otto are going to be there, not sure who else 20:49:37 Anyway, we'll figure out how to contribute. We like working with you all :-) 20:50:46 ok, there no *law* that says we have to go the full hour ;) 20:50:57 w00t 20:50:58 so if we're done here I'll wrap it up 20:51:03 coffee time 20:51:04 re ansible and salt.. we already integrate well with both of them, anything new would be syntactic sugar to make federating our instances into a salt/ansible grouping easier. 20:51:06 SpamapS asalkeld I'd love to review more of ya'lls thoughts on config management, Salt/Ansible, orchestration, etc. 20:51:19 kebray: we can chat about it in #heat after if you have time. 20:51:28 Ok. 20:51:31 zaneb: please yes lets wrap 20:51:36 ok 20:51:40 #endmeeting