16:00:04 #startmeeting containers 16:00:05 Meeting started Tue Nov 10 16:00:04 2015 UTC and is due to finish in 60 minutes. The chair is adrian_otto. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:06 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:09 The meeting name has been set to 'containers' 16:00:14 #link https://wiki.openstack.org/wiki/Meetings/Containers#Agenda_for_2015-11-10_1600_UTC Our Agenda 16:00:26 #topic Roll Call 16:00:29 o/ 16:00:29 Adrian Otto 16:00:30 o/ 16:00:35 o/ 16:00:36 o/ 16:00:36 murali allada 16:00:37 o/ 16:00:41 o/ 16:00:44 hi /o 16:00:48 o/ 16:00:50 o/ 16:01:21 o/ 16:01:22 hello vilobhmm, Drago, hongbin, wanghua, muralia1, rlrossit, rpothier, Kennan, and juggler 16:01:29 hi 16:01:31 hi all 16:01:44 hi 16:01:47 hello adrian_otto, hello all 16:01:52 hello sew2, jasonsb 16:01:54 hi all 16:01:59 hi 16:02:25 hello all 16:03:02 #topic Announcements 16:03:10 any announcements form team members? 16:03:46 o/ 16:04:19 s/form/from/ 16:04:23 ok, on to action items. 16:04:48 #topic Review Action Items 16:04:49 (none) 16:05:04 #topic Blueprint/Bug Review 16:05:18 hi adrian_otto 16:05:20 so this week I will be arranging all our BP's for Mitaka release 16:05:23 it seems have a review action 16:05:36 hi Kennan, which should we look at together? 16:05:59 Add filters support to api https://review.openstack.org/#/c/239362/ 16:06:04 I'm seeking input from the team for essential BP's for this release cycle 16:06:04 I have one 16:06:07 this is review from wanghua 16:06:07 Yes 16:06:32 that one need to implyment on api micro-verison 16:06:39 ok, Kennan, thanks for raising that. Let's get to that one in just a moment. 16:06:56 we'll touch base quickly on blueprints first 16:07:06 sure 16:07:42 so the question I'd like everyone's help with is what bp's should be marked as Essential, and tracked every week in our team meetings through completion. 16:08:11 if you have ones that you think should be marked in that way, you are welcome to set them accordingly, or identify them for me, and I can set them. 16:08:50 I think we need to identify a list of Mitaka first 16:08:51 normally we have our subteams report back, and they tend to hold the highest priority items 16:09:04 come to think of it, I did that out of order this time. 16:09:15 should we put them here? or just set the approver as you adrian_otto. 16:09:39 Correction: I think we need to identify a list of BPs for Mitaka first 16:09:49 hongbin: fair enough. So if you have BP's that you are sure should be included in Mitaka, mark me as the approver, and we'll get those scoped over the next few days. 16:09:50 I would suggest that we create an etherpad to tracking them. 16:10:04 eliqiao: ok, I'll make one now One moment. 16:11:06 do we set all Mitaka bps in this meeting ? 16:11:13 #link https://etherpad.openstack.org/p/mitaka-magnum-planning Magnum Mitaka Planning 16:11:24 no, this will not be a final list today 16:11:36 this is a way for us to share input as a team early in the cycle 16:13:20 great, so we have that kicked off. You are welcome to add to that bp after we conclude today as well, and we can true it up next time we meet. 16:13:30 hi all 16:14:05 let's go to subteam updates in the mean time, and I'll come back to reviews/bugs after that so we can discuss https://review.openstack.org/239362 16:14:19 hi rods 16:15:41 daneyon is not here, so I might skip "Container Networking Subteam Update" 16:16:20 we did not hold a meeting on Thursday due to confusion between UTC and local time after our recent DST shift 16:16:28 we can revisit that next time 16:16:43 bradjones|away: seems away 16:16:50 anyone have an update for "Magnum UI Subteam Update" 16:16:51 ? 16:18:47 ok, looks like our planning etherpad is taking form, so let's discuss reviews. 16:18:57 Kennan, you're up for this one: 16:18:59 #link https://review.openstack.org/239362 16:19:18 or that was wanghua's 16:19:27 hi adrian_otto 16:19:32 it is a change from wanghua 16:19:47 he implements feature to allow magnum cli add filters part 16:20:08 the filters mainly work for magnum db objects ,like pod, service etc. 16:20:13 I think we need this change. 16:20:35 but another feature vilobhmm 16:20:46 but I am thinking about if it should be implymented based on micro-version(since we have supported it) 16:20:47 I see in the comments that you have a concern about the impact on another contribution: 16:20:49 #link https://review.openstack.org/213368 16:20:58 implements now is native tool retrieve directly from backends 16:21:23 which can make db features override the two seems conflict to me 16:22:06 so the basic question boils down to…do we need to have the information for k8s objects stored in db or fetch directly from k8s backend 16:22:21 I think we need store pod, service in db, too 16:22:34 fetch directly from k8s backend - https://review.openstack.org/#/c/213368/ 16:22:48 information for k8s objects stored in db - https://review.openstack.org/239362 16:22:50 vilobhmm: our intent was to have a single source of truth, rather than dealing with synchronization 16:23:00 adrian_otto : agree 16:23:03 is there a reason this is not practical? 16:23:53 adrian_otto: +1, we agreed don't keep kub state in magnum 16:24:09 eghobo : +1 16:24:16 +1 16:24:21 adrian_otto: if that case, seems db filter feaure not needed 16:24:34 in general, we should not, but that guidance should not be absolute if there is a very good reason why we should be mirroring something in magnum 16:24:45 +1 16:25:11 so let's view that as a preference to keep only one copy of relevant state, but to be willing to duplicate it when justified 16:25:37 so that's what I'm probing for now 16:25:43 adrian_otto: sorry I was late, but what is the reason? 16:25:55 we have not identified one yet 16:25:55 If we don't store some k8s infos in db, the user need to give the bay to show the pod, like magnum pod-show pod-id bay-id 16:26:05 I think it is wired. 16:26:23 sorry disagree 16:26:27 wanghua : but why is that weird ? 16:26:35 ok, good. that's what this discussion is for! 16:26:37 in kubctl you have to provide pod name 16:27:06 i think user need to do two commands 16:27:07 but we should know which bay the pod belongs to 16:27:53 magnun get pods bayid and magnun show pod pod_name bayid 16:28:26 wanghua: it's correct but user can have many bays 16:28:39 and many pods with the same name 16:28:59 yes, but pod-id is unique 16:29:00 in k8s you just have a single pod list. In magnum, there are multiple lists (by bay) 16:29:36 seems k8s use namespace to separate resources 16:29:47 Kennan : yup 16:29:59 adrian_otto: yes, I and I think we should require bayid everywhere 16:30:02 Kennan: Yes 16:30:44 Kennan: typical usecase for namespace for example is environment: PROD, DEV, QA 16:30:46 eghobo: sounds like a candidate to turn into a BP: require bayid everywhere 16:30:58 if the concern is simplifying the client… we do have a possible optimization we could make. We could allow the client to fetch the bay_id from a shell env variable. That way the user could set that, and not have to supply it for every command as long as it is set. 16:31:19 hongbin : its already in progress 16:31:27 adrian_otto: +1 16:31:41 What about call from API? 16:31:47 REST API 16:31:48 adrian_otto: +1 16:31:55 adrian_otto : +1 16:31:57 Tango: in that case it could be placed into the context by the user 16:31:58 Yes, the environmental variables approach sound good. 16:32:07 wanghua: do you have other comments for that ? I think most of your patch fetch info from db part 16:32:16 but for API usage I think it's better simply to require the bay-id 16:32:29 Tango : API receives both bay_identifier and pod identifier and then makes call to conductor to fetch entries from k8s endpoint 16:32:44 If we can automatically fetch the bay id, I think it is ok 16:33:16 wanghua: let's be careful to try to keep the API implementation as stateless as we reasonably can 16:33:18 vilobhmm: thanks 16:33:33 wanghua: could you elaborate about it? 16:33:35 let's not have "magic" in the API 16:33:44 adrian_otto : +1 16:33:47 ok. it seems your bp can be dropped if vilobhmm can implements his bp(fetch from k8s backends) 16:33:52 and not hold server side state that will not scale out efficiently 16:34:01 stateless api r better 16:34:49 Kennan: I will drop my bp 16:34:59 ok, so are we at a consensus point now? 16:35:51 I am ok if finally fetch from k8s endpoints performance not bad. of course, it needs more test :0 16:36:02 let's mark the direction in the respective Gerrit reviews to offer guidance to reviewers 16:36:43 Kennan: that would be a reasonable justification for mirroring data in Magnum, of we are unable to overcome performance constraints. 16:36:53 s/of/if/ 16:36:58 Kennan: performance should be fine, Kub folks are very religious about keeping response time under 1 sec ;) 16:37:33 as long as we are only making a single connection to k8s to fetch what we need, then performance is unlikely to inhibit us 16:37:39 adrian_otto, Kennan : I tried my chnages in devstack for obj-from-bay for rc…and I could not see considerable difference http://paste.openstack.org/show/478215/ I can time the request and update the review with before and after for close inspection 16:37:48 if we need to make a whole bunch of requests, then we may need to revisit the approach 16:38:17 adrian_otto : we are making a single connection 16:38:22 thanks vilobhmm 16:38:24 wanghua thanks for your previous work, I raise your review here just because vilobhmm bp have some conflicts with your bp. :) 16:38:46 ok, are we all happy with this for now? 16:38:58 +1 16:39:02 +1 16:39:06 +1 16:39:11 +1 16:39:11 +1 16:39:20 great. 16:39:43 so we have time to look at other work together as a team before we proceed to Open Discussion 16:40:02 anyone have bugs/reviews/bp's to raise for team discussion today? 16:40:05 +1 16:40:23 adrian_otto: I have issue to create bay on gate. 16:40:34 I have one question about this big renames https://review.openstack.org/#/c/243413/ 16:40:46 I have one to discuss (after eliqiao ) 16:40:49 eghobo: +1 16:40:53 can somebody provide reason? 16:41:00 ok, let's take eliqiao first. Please elaborate. 16:41:07 okay. 16:41:41 adrian_otto: 1 for swarm functional testing, bay created failed on gate, debuged into it , found vm failed to start docker service. 16:42:04 eliqiao : do you have a link for the failure ? 16:42:05 ok 16:42:14 Can it work in your local env 16:42:19 #link https://review.openstack.org/#/c/226125/ 16:42:24 thanks! 16:42:27 eliqiao: check volume config 16:42:33 wanghua: yeah, it works on my local setup. 16:42:45 perhaps the available storage is to small? 16:42:51 s/to/too/ 16:43:22 Yes, I would suggest to ture the cinder volume into 5G and tried again 16:43:23 I find that the gate may fail even if your patch is ok sometimes. 16:43:38 the docker serivce log #link http://logs.openstack.org/25/226125/27/check/gate-functional-dsvm-magnum-k8s/125998a/logs/bay_nodes/172.24.5.6/docker.txt.gz 16:44:08 ok, so let's take that one to #openstack-contaienrs after the team meeting to help understand the cause 16:44:20 ok. 16:44:34 I have one to disuss 16:44:43 adrian_otto: I have one more thing to talk about. https://review.openstack.org/#/c/232152 16:44:47 #link https://review.openstack.org/243413 Renamed the heat-kubernetes and heat-mesos 16:44:50 adrian_otto: I think Magnum has a liberty release? Then this review is wrong https://review.openstack.org/#/c/242068/ 16:44:56 eliqiao: you had remarks on this one? 16:45:06 eliqiao: I suspect it was because volume size 16:45:23 in our jenkins default volume size is 1GB ? 16:45:26 eliqiao: Daneyon had similar problem, just check it's really latest fedora 5 16:45:32 okay, thanks guys, will try to make volume size bigger. 16:45:37 hongbin: we do have a beta, but I need to release that as a final 16:45:46 for k8s the docker storage has mini requirements 2GB 16:45:47 adrian_otto: ack 16:46:01 you can set 4GB if jenknis have enough storage 16:46:04 we had a couple of patches backported on that branch that need to be included.Renamed the heat-kubernetes and heat-mesos 16:46:14 s/Renamed the heat-kubernetes and heat-mesos// 16:46:44 adrian_otto: I don't find any good reason to rename it 16:47:07 heat-kubernetes, heat-mesos, docker-swarm 16:47:21 is Shravya Gaddam present today? 16:47:21 I think we should add heat to all, or not to all 16:47:50 This bug is proposed by me... 16:48:08 ok, it is a heat template 16:48:10 seems heat-docker-swarm ? if consider consistence 16:48:15 which is why that's in the filename 16:48:39 or heat-dockerswarm 16:48:57 but all of this came from one thing... 16:48:57 They are all under templates dir. So they must be a template. 16:49:04 the heat-kubernetes project name 16:49:17 wanghua: agreed. whether "heat" stays or is removed, it'd be nice to remove "docker" and shorten docker-swarm to "swarm". In this way, each of the COEs are one word references. 16:49:20 it probably would have made sense to call that "kebernetes" to begin with 16:49:43 and others with heat- in the name are attempt to confirm with that name scheme 16:49:58 i think it's better remove heat prefix, because we have even diskbuilder elements inside 16:50:11 We only use heat, no other methods. 16:50:27 So I think it is not necessary to add heat in the name 16:50:44 eghobo: I do agree, and as long as this change is not disruptive I don't see a reason to oppose it. 16:50:50 Make sense 16:51:10 did you mean kubernetes not kebernetes above? :) 16:51:10 My concerns is if the renaming will affect the git history 16:51:10 +1 16:51:33 hongbin: this is done with a git rename, so that should not wipe history. 16:51:48 but it could cause other patches to need a rebase 16:52:09 I am with rename, as both seems readable for me 16:52:14 so it could slow down merge of work on code within these directories 16:52:42 I'll open up for Open Discussion now 16:52:52 #topic #open-discussion 16:53:02 adrian_otto : IMHO security was a priority in liberty (with TLS and other imp features that went in for liberty) do we have something of that sort which we are planning for mitaka ? 16:53:31 seemed that we have a lose consensus to support the rename proposed in https://review.openstack.org/243413 16:53:33 asking this so that we can align the blueprints in that direction 16:53:39 s/lose/loose/ 16:54:05 I am OK for the rename. 16:54:17 +1 on rename 16:54:18 +1 from me to.. 16:54:20 vilobhmm: yes. We held a design session on that topic, and decided we'd like to see further progression there. 16:54:39 yes - +1 on rename. It would be good to consider removing "docker", too. 16:54:48 resolving issues with Barbican and allowing for secret storage through an abstraction 16:54:55 or put "apache" in front of mesos... 16:55:05 seems native featch from backend need to use TLS related vilobhmm: if I get it correctly 16:55:16 leecalcote: nah, one word is fine 16:55:41 +1 for the rename 16:55:44 adrian_otto : thanks! Kennan : Yes it will 16:55:46 vilobhmm: we really dislike having passwords in our configuration files, and would really like to avoid that. 16:56:13 so any approach that would free us from that requirement would be welcome 16:56:22 +1 for rename, but with proper explanation why in commit message ;) 16:56:39 adrian_otto some passwords like tenant password seems in other openstack projects ? 16:56:45 adrian_otto : sure 16:57:03 Kennan: no, like the magnum API password on the bay nodes 16:57:18 Kennan: +1, we need to remove passwords 16:57:42 so the entire subject of credentials management is something I'd like to mature in Magnum 16:57:51 agree eghobo...it seems https://bugs.launchpad.net/magnum/+bug/1514682 could have just a tiny bit more detail about why it's being renamed 16:57:51 Launchpad bug 1514682 in Magnum "Rename heat-kubernetes to kubernetes, heat-mesos to mesos" [Undecided,In progress] - Assigned to Hua Wang (humble00) 16:58:26 we have just a minute remaining, so let's wrap up 16:58:35 adrian_otto: ok I need check other core projects, seems only we use barbican, so we remove them ? 16:58:46 oh, I forgot 16:59:03 I will be traveling next week, and would like help to chair the meeting 16:59:08 contact me if you can help 16:59:25 50% chance I can attend next week 16:59:27 adrian_otto: I can chair the meeting 16:59:36 thanks hongbin! 16:59:49 awesome h 17:00:02 adrian_otto: I checked nova related config still use password in text 17:00:04 our next team meeting is 2015-11-17 at 1600 UTC. Hongbin will chair. Thanks!! 17:00:12 ok it maybe barbican related 17:00:13 #endmeeting