17:00:05 #startmeeting third-party 17:00:06 Meeting started Tue Jul 7 17:00:05 2015 UTC and is due to finish in 60 minutes. The chair is asselin. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:00:07 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 17:00:10 The meeting name has been set to 'third_party' 17:00:31 hi, who's here for 3rd party ci working group meeting? 17:00:54 o/ 17:01:09 hi mmedvede 17:02:14 hey 17:02:46 hi patrickeast 17:04:02 #link agenda https://wiki.openstack.org/wiki/Meetings/ThirdParty#7.2F7.2F15_1700_UTC 17:04:16 we have two topics 17:04:56 #topic Common CI virtual sprint preparation 17:05:28 #info virtual sprint is tomorrow 17:05:37 we got common-zuul done last week. 17:05:57 have either of you switched to using it? 17:06:28 I did 17:06:44 not yet 17:06:46 Although I still have to use a couple of patches on top of it 17:06:51 mmedvede, cool 17:07:04 mmedvede, can you elaborate? 17:08:00 asselin: sure. We need to have ability to specify project config revision 17:08:19 asselin: this is the patch I need: 17:08:22 #link https://review.openstack.org/#/c/198546/ 17:08:55 mmedvede, cool yeah will take a look today 17:09:12 mmedvede, we should have something like that for each of the components 17:09:19 asselin: it also seems that project revision passthrough should be added to the rest of downstream puppet modules 17:09:25 +1 17:09:27 mmedvede, +1 17:10:04 In a similar note, zuul_scheduler does not have revision parameter for zuul repo 17:10:20 I might submit the patches during sprint 17:10:37 mmedvede, yes 17:11:18 mmedvede, I do want to focus on the remaining components for the sprint. 17:11:39 mmedvede, currently that's nodepool and JJB 17:12:04 asselin: question - are we going to keep "thinning out" system config more after sprint? E.g. we still have to maintain some copies of system-config code. 17:12:34 mmedvede, which parts of system config do you still need? 17:13:09 mmedvede, the goal of the sprint is so that 3rd party ci can be setup w/ as little of system-config as possible.... 17:13:56 mmedvede, also the scope of the sprint is to focus on the spec:http://specs.openstack.org/openstack-infra/infra-specs/specs/openstackci.html 17:14:23 One example is system-config/modules/openstack_project/manifest/jenkins.pp still has jjb. But I guess that what you meant above by concentrating on JJB 17:14:24 things like gerrit, etc. would be done in a new spec/phase 3 17:15:00 *phase 2 17:15:40 #link this patch should be used for JJB https://review.openstack.org/#/c/184919/ 17:16:51 asselin: ok, makes sense. The current spec does not have all the tasks that need to happen, and more refactoring of system-config would be done. 17:17:10 mmedvede, what task needs to be added? 17:17:31 #link common-ci tasks: https://storyboard.openstack.org/#!/story/2000101 17:17:35 sorry for having so many questions. I feel that if I reviewed more patches I would be more in-the-loop 17:17:48 mmedvede, no problem, ask away 17:18:57 mmedvede, would like to identify missing pieces sooner than later 17:18:59 asselin: the "masterless puppet" task - can you elaborate what it involves? 17:19:57 mmedvede, the idea is to be able to setup a 3rd party ci system on a single node. This would be the starting point for new 3rd party folks...the glue that ties everything together 17:21:12 asselin: this might answer my next question 17:21:37 I did not know what we were supposed to use in place of system-config to glues things together 17:22:04 mmedvede, so basically a verion of this that can be customized by each vendor: https://github.com/rasselin/os-ext-testing/blob/master/puppet/modules/os_ext_testing/manifests/master.pp or https://github.com/openstack-infra/system-config/blob/master/manifests/site.pp 17:23:36 I proposed masterless as I think that is simpler to setup 17:23:53 mmedvede, do you agree? 17:25:06 asselin: I agree that masterless is easier to setup. But I am not sure how that would translate into ease of use, as long as upstream modules still utilize master and hiera. But I honestly did not look into it. 17:25:45 asselin: For example, I am utilizing hiera encryption on master, so I can store my hiera in the same repo as everything else 17:27:14 mmedvede, yes, I think that would be a good direction: masterless puppet, with the ability to set module versions (pin for stabilty) and use encrypted heira 17:28:57 mmedvede, do you think that would work? good compromise for ease of installation, use, and maintanability? 17:30:18 asselin: I need to understand how hiera works without master. When you have master, you have single point where you need to maintain encryption keys. 17:32:00 mmedvede, when you use a puppet master, how are the encryption keys stored? 17:32:17 asselin: it is hard to know if it would work without seeing it work :) So I definitely support the direction 17:32:48 asselin: puppet-master creates private key to use specifically for hiera encryption 17:33:15 asselin: this key is only kept on master, and optionally backed up by hand 17:33:18 mmedvede, ok, I see 17:33:50 asselin: so then you can use public key to encrypt hiera, and only master would be able to use it 17:35:36 mmedvede, so more investigation is needed 17:36:48 mmedvede, let's see how far we can get in the sprint. If we can get basics wokring, I would consider that a success. We can always improve from there. 17:37:24 asselin: I think simplicity wins over having master. +1 17:38:11 mmedvede, sounds like you're willing to help out with that part during the sprint? 17:39:08 I am willing :) I took logstash task though 17:39:26 mmedvede, oh really, great! didn't see that 17:39:56 logstash it is low priority. So let me know if you think I can help somewhere else 17:40:20 mmedvede, it's not essential, but certainly very valuable 17:40:40 great then :) 17:40:56 same here asselin, willing to help but don know where to start 17:41:00 mmedvede, I'll let you pick, you can do both :). 17:41:10 hi rfolco 17:41:58 rfolco, you can help out where your interests are. you work with mmedvede right? 17:42:23 asselin, yes, correct. Tasks look big, maybe we can break into smaller sub-tasks ? 17:42:39 ok I see...you each took on half of the logstash/kibana 17:42:59 rfolco, storyboard isn't that great for sub-tasks 17:43:12 rfolco, so I kept them high-level 17:43:17 I see 17:43:39 We can probably split them as we go if needed, in the etherpad 17:43:51 mmedvede, yeah 17:43:56 #link https://etherpad.openstack.org/p/common-ci-sprint 17:45:30 ok, anything else? otherwise we should change to topic #2 17:45:42 nope, thanks asselin 17:46:28 rfolco, mmedvede I think it's fine you work together on logstash. I'll pick up the masterless puppet task if noone else wants it :) 17:47:10 sounds good to me 17:47:14 #topic Spec to have infra host scoreboard (krtaylor) 17:47:58 I think krtaylor is out this week. anyone have any updates to issues to discuss? 17:48:19 #link scoreboard spec https://review.openstack.org/#/c/194437/ 17:48:31 patrickeast, you still around? 17:48:37 There is some questions about new spec relation to the old dashboard 17:48:46 asselin: yea mostly 17:48:54 * patrickeast catching up on scrollback 17:49:29 ah yea, so i’m not sure what we need to do to get that spec moving 17:49:48 jogo has proposed a pretty cool alternative too 17:49:55 link? 17:50:07 its in the review 17:50:10 sec 17:50:16 http://jogo.github.io/lastcomment/ 17:50:24 the lastcomment serves different purpose though 17:50:28 #link http://jogo.github.io/lastcomment/ 17:50:29 yea 17:50:38 maybe more complimentary to the scoreboard 17:50:50 +1 on complimentary, not alternative 17:52:22 to move forward, we can add to the infra meeting agenda 17:52:37 Intention of the spec needs to be made clearer, so there is not confusion that it tries to replace the dashboard spec 17:52:38 not sure if today is too late 17:52:58 we can add it, and perhaps get votes by next week 17:57:05 so it is ready to add to agenda? or should we iterate one more time? 17:57:29 asselin: the comments need to be addressed first 17:58:17 jhesketh's comments? he -1 and rollcall +1...not sure what that means 17:58:43 yes, I was referring to jhesketh comments 17:59:37 #topic open discussion 17:59:54 asselin: thank you for leading the meeting today! 18:00:09 thanks...see you all tomorrow! 18:00:15 #end-meeting 18:00:17 cya 18:00:21 #endmeeting