18:00:20 #startmeeting third-party 18:00:20 Meeting started Mon Aug 25 18:00:20 2014 UTC and is due to finish in 60 minutes. The chair is anteaya. Information about MeetBot at http://wiki.debian.org/MeetBot. 18:00:21 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 18:00:23 The meeting name has been set to 'third_party' 18:00:29 and we're off 18:00:36 who's here? 18:00:38 o/ 18:00:40 hi 18:00:44 o/ 18:00:45 hi 18:00:45 anteaya, is punctual! 18:00:50 o/ 18:01:02 hi 18:01:11 welcome everyone 18:01:14 krtaylor: I do try 18:01:20 hi anteaya 18:01:32 #topic Welcome & Reminder of OpenStack Mission 18:01:45 #info The OpenStack Open Source Cloud Mission: to produce the ubiquitous Open Source Cloud Computing platform that will meet the needs of public and private clouds regardless of size, by being simple to implement and massively scalable. 18:01:50 o/ 18:02:04 the mission is the reason we are all here, for those who are new or like the reminder 18:02:15 here is our agenda 18:02:19 #link https://wiki.openstack.org/wiki/Meetings/ThirdParty#Agenda_for_next_meeting 18:02:34 #topic Review of previous week's open action items 18:02:51 we had some 18:02:56 #info third party team to review https://review.openstack.org/#/c/99990/ 18:02:57 o? 18:03:00 aloha 18:03:01 o/ 18:03:11 we still can stand some more eyes on that one 18:03:28 that is the infra-spec that will outline all the puppet module work 18:03:42 making it easier for folks to consume the infra tooling 18:03:53 o/ 18:03:56 so it gets another action item 18:04:02 #action third party team to review https://review.openstack.org/#/c/99990/ 18:04:12 next one 18:04:12 o/ 18:04:16 #info anteaya to offer joa's work as config patches with joa as co-author by next meeting 18:04:20 I didn't do that 18:04:22 bad me 18:04:27 for next week again 18:04:30 #action anteaya to offer joa's work as config patches with joa as co-author by next meeting 18:04:43 #info asselin to ask infra about zuul configration to filter patches 18:04:54 that was in relation to the next item 18:05:05 #info asselin to reply to http://lists.openstack.org/pipermail/openstack-dev/2014-August/043392.html with what he learns 18:05:09 yes, fungi replied to the e-mail 18:05:14 great 18:05:23 well thanks for stepping up to the task anyway 18:05:27 I'm grateful 18:05:41 was fungi's email helpful to answering your questions as well, asselin? 18:05:47 yes, always 18:05:52 great 18:06:15 * fungi is pleased to be of some help 18:06:18 that's it for last weeks action items 18:06:21 thanks fungi 18:06:27 #topic Announcements 18:06:37 #info Use the ThirdPartySystems wiki page to notify changes in status 18:06:46 #link https://wiki.openstack.org/wiki/ThirdPartySystems 18:06:54 let's take a peek shall we? 18:07:09 I tried and tried to get an individual cell to change color 18:07:15 do you see the fourth bulled point? 18:07:38 but there is a workaround 18:07:45 does anyone not understand how to change your cell colour and icon if you need to notify others of a change in status? 18:08:00 krtaylor: the cell has a changed background colour 18:08:28 anteaya, what we discussed was to show red/yellow/green 18:08:36 but this does show that a system is down 18:08:42 #link https://wiki.openstack.org/wiki/Template:ThirdPartySystemTableEntryDown 18:08:49 I'd still like to be able to pass color to the template 18:08:53 but it discards it 18:09:03 krtaylor: play away with templates and colours if you want 18:09:25 anteaya, I have read and tried just about everything 18:09:32 I need a guru at this point 18:09:37 that line in that template successfully colours the background 18:09:40 does it not? 18:09:44 * anteaya refreshes 18:09:56 until we geta status dashboard, I think it is more effort than it is worth 18:10:07 okay 18:10:11 so for everyone else 18:10:13 yes, it is a suitable workaround 18:10:36 do you understand how to communicate that your ci is down for whatever reason by reading bullet point four on the wikipage? 18:10:54 btw I interpret silence as no with this group 18:11:06 you is everyone in this case, right? 18:11:10 yes, got it, can we use it if it is reporting failures due to setup issues 18:11:21 krtaylor: yes you == everyone 18:11:42 yes, understood 18:11:50 yes, looks straight forward 18:11:52 daya_k: yes, or actually if you have turned off your ci account because it is reporting failures due to setup issues 18:12:02 bmwiedemann dougwig great thanks 18:12:22 if your system is failing to build, turn it off, and update the wikipage to say your system is off 18:12:37 anteaya: ok thanks 18:12:51 if your system is failing to build and you don't turn it off, infra will turn it off which is tougher for you to get it turned back on 18:12:58 daya_k: great thanks 18:13:18 please spread the word and help others use this feature as intended 18:13:31 one way to 'turn off' is to use the silent pipeline: http://lists.openstack.org/pipermail/openstack-dev/2014-August/043876.html 18:13:32 anteaya : will this be done even if we dont vote, our system reports 0 on failure, and +1 on success 18:13:34 I just did to show a real example 18:13:47 this way you're is still 'on', but just not reporting to gerrit 18:14:02 asselin: thanks, saw that note earlier, thats a good idea 18:14:23 fungi: did you want third party ci to use the silent pipeline? 18:14:27 fungi: this is news to me 18:14:33 fungi: care to clarify? 18:14:49 for us third-party people, it's probably simpler to comment out the success/failure clauses on our check pipelines and reload zuul, than two have multiple pipelines. 18:14:58 anteaya: why would i/we care if a third party uses the silent pipeline on their zuul server to prevent them from commenting on changes? 18:14:59 daya_k: any system that is failing to build due to set up issues should be turned off 18:15:00 /two/to/ 18:15:22 daya_k: you should use teh sandbox repo to test unstable systems until your system can build reliably 18:15:34 anteaya: jobs in a silent pipeline in zuul won't add comments to gerrit changes 18:15:36 fungi: "on their zuul server" 18:15:41 fungi: great, thank you 18:15:49 dougwig, the advantage of the silient pipeline is you can 'turn off' only those jobs that are unstable. the others that are working can continue. 18:15:59 sure, but i only have one job. :) 18:15:59 anteaya: sounds good 18:16:25 asselin: yes as long as your system is not creating noise by commenting on gerrit patches, use what works 18:16:33 we recommend the sandbox repo 18:16:45 well, to "turn off" a job you just remove it from the layout entirely. moving it to the silent pipeline allows you to keep running it and generating logs but keeps it from reporting into gerrit 18:17:02 if you do other things, ensure there is no ramifications on our gerrit 18:17:07 which can be helpful for debugging, depending on your needs 18:17:09 ok, silent pipeline is a nice tool in the toolbox for 3rd party ci folks. 18:17:22 which as fungi points out, is the case with the silent pipeline 18:17:38 great 18:17:41 more here? 18:17:57 next 18:18:04 #info We have two new mailing lists, please subscribe (anteaya) 18:18:21 #link http://lists.openstack.org/cgi-bin/mailman/listinfo/third-party-request 18:18:33 #link http://lists.openstack.org/cgi-bin/mailman/listinfo/third-party-announce 18:18:52 so in order to reduce noise in other areas these two new mailing lists have been created 18:18:59 please subscribe to both 18:19:17 why would non-infra need to be subscribed to -request? 18:19:18 they are new and I have never admined an email list before so I have to learn 18:19:23 I will make mistakes 18:19:38 hopefully in a week or so I will get the hang of it 18:19:55 dougwig: don't you want to be able to help out where you are able? 18:20:31 i'm talking in general. note that i asked that before you clarified. 18:20:33 like in being able to interact with a new account requester to ensure the request is accurate and perhaps invite them to the third party meeting? 18:20:45 dougwig: noted 18:21:14 I am hoping that this group becomes self-sustaining and I can move onto other things eventually 18:21:25 I am trying to train you to lead 18:21:38 the group of you 18:21:53 my wish is for you to be able to not need me at some point 18:21:58 and you can self govern 18:22:11 so mailing lists 18:22:13 questions? 18:22:16 anteaya, we will always need you :) 18:22:30 oh don't say that 18:22:35 I am so replaceable 18:22:35 hehheh 18:22:36 for always < 50y 18:22:47 it is nece to be welcomed but I don't like being needed 18:22:57 so next topic 18:23:02 #topic OpenStack Program items 18:23:14 #info Update from Cinder Mid-Cycle Meet-up (jungleboyj) 18:23:19 jungleboyj: you're up 18:23:29 anteaya: Ok. 18:23:54 So, we had our mid-cycle meet-up two weeks ago in Ft. Collins, CO. 18:24:08 Was our first as a Cinder group f2f . 18:24:24 Ended up being very valuable. https://etherpad.openstack.org/p/cinder-meetup-summer-2014 18:24:37 #link https://etherpad.openstack.org/p/cinder-meetup-summer-2014 18:24:53 We had anteaya there and her assistance with CI and process items was great. 18:25:10 you are too kind 18:25:42 Big takeaways were the fact that there are issues with getting CI running on Fibre Channel storage that non-storage people may not have been aware of. 18:25:51 yes 18:26:01 We are working that, but it may take a little longer to get those systems running CI. 18:26:27 as long as folks are keeping in touch with you or DuncanT on that 18:26:28 The fact that we would like to get something of a results dashboard going to show how CI's are running over time. 18:26:57 anteaya: We should be good there. I am one of the ones effected. 18:26:57 #link https://review.openstack.org/#/c/114315/ 18:27:14 that is the creation of the repo we discussed, it is waiting on a new patchset from me 18:27:20 jungleboyj: great 18:27:43 the above patchset creates a new repo for a dashboard for ci 18:27:47 Was also a good opportunity for each CI group to share our different approaches to getting CI setup. I think that was hepful. 18:28:03 the code needs some work but it is a start 18:28:09 jungleboyj: agreed 18:28:23 jungleboyj: any code urls from that yet? 18:28:34 I think that pretty much covers the highlights. 18:28:40 jungleboyj: great 18:28:47 code urls from what? 18:29:01 jungleboyj: from folks going to share their tools and approaches 18:29:15 I know DuncanT had some ideas and thingee had some thoughts 18:29:32 have they shared code yet ready for more eyes yet? 18:29:34 Oh, yes, DuncanT has a KISS set of scripts for CI. 18:29:39 great 18:29:50 let us know when he is ready to share 18:30:08 anything else then? 18:30:17 He shared this at last week's Cinder meeting: https://github.com/Funcan/kiss-ci 18:30:36 #link https://github.com/Funcan/kiss-ci 18:30:40 jungleboyj: great thank you 18:30:48 He said comments are welcome. Or do with it as you need. :-) 18:31:05 so take a look, it isn't supported by infra just be aware 18:31:08 jungleboyj: thank you 18:31:14 there are several other attempts to simplify CI as well 18:31:15 anteaya: You are welcome. 18:31:20 :D 18:31:21 I've some updates from JohnGriffith that should make them better, I'm just working on merging them in 18:31:30 I have noted them in past meeting logs 18:31:31 DuncanT: thanks for the update 18:31:31 DuncanT: +2 18:31:50 krtaylor: perhaps I have missed them 18:32:12 more here or move on? 18:32:21 * krtaylor goes to find them 18:32:24 kk 18:32:28 * anteaya waits 18:32:36 np, move forward 18:32:41 okay moving on 18:32:46 #topic Deadlines & Deprecations 18:33:11 so cinder, jungleboyj DuncanT any deadlines or depreactions to discuss? 18:33:35 DuncanT: I defer to you. Have you started sending out nasty grams ? 18:34:02 while we wait for DuncanT's reply, Neutron mestery same question 18:34:18 mestery: deadlines or deprecations from Neutron to discuss? 18:34:18 No, they're on hold pending a satisfactory set of docs 18:34:28 DuncanT: very good, keep us informed 18:34:41 anyone representing Nova today? 18:35:10 salv-orlando: if mestery is tied up, anything you know of for deadlines and deprecations from Neutron? 18:35:33 anteaya: for plugins and drivers? 18:35:38 salv-orlando: yes 18:35:46 * salv-orlando one sec 18:35:51 * anteaya waits 18:36:01 anteaya: No deadlines, deprecations are already announced: 18:36:15 anteaya: Mellanox plugin, Ryu Plugin, and Cisco Nexus sub-plugin are deprecated in Juno 18:36:24 mestery: great thanks 18:36:31 anteaya: Sure! 18:36:34 and a link to that announcement? 18:36:36 thanks mestery I did not have the list at hands 18:36:37 for the logs? 18:36:47 salv-orlando: thanks for looking anyway 18:36:48 anteaya: Getting it ... 18:36:52 mestery: thanks 18:37:09 any other OpenStack program represented today that I haven't mentioned? 18:37:28 #link http://lists.openstack.org/pipermail/openstack-dev/2014-August/042790.html Ryu Plugin Deprecation 18:38:12 #link http://lists.openstack.org/pipermail/openstack-dev/2014-August/043559.html Mellanox Plugin Deprecation 18:38:15 great thank you 18:39:00 * anteaya waits for one more link 18:39:19 #link http://lists.openstack.org/pipermail/openstack-dev/2014-August/042765.html Cisco Plugin Deprecation 18:39:21 anteaya: Done :) 18:39:24 thanks 18:39:30 next topic 18:39:36 #topic Highlighting a Program or Gerrit Account 18:39:50 #info How to vote when blocked by un-merged fixes or HW-enabling commits (dane_leblanc) 18:39:56 dane_leblanc: your floor 18:40:00 Thanks! 18:40:10 I don't know if this was discussed before 18:40:20 * mestery listens in here. 18:40:22 don't worry charge ahead 18:40:26 But I was wondering if there's a prescribed way to handle the corner case 18:40:38 please describe the corner case 18:40:44 Where our CI is blocked on a critical bug which is not yet merged 18:40:45 so far I am not understanding 18:40:52 do we have an example? 18:40:58 Or it could be that we have a plugin just being introduced 18:41:08 and the HW-enablement commits have not been merged 18:41:16 what is HW- 18:41:37 In this case, any change sets outside of the changes with these enablements (or fixes) will fail in the CI 18:41:46 HW is a switch,let's say 18:41:47 (hardware) 18:41:53 ah okay thanks 18:41:59 Sorry for the acronym 18:42:00 * anteaya hates acronyms 18:42:03 np 18:42:05 AHA 18:42:22 So, the question is how to vote on the other change sets which we know would fail 18:42:23 * dougwig ducks 18:42:39 dane_leblanc: so is this a dependency issue? 18:42:53 as in a patch is dependent on another patch? 18:43:07 Yes, dependency on a fix, 18:43:19 is carl_baldwin around? 18:43:20 anteaya: but every patch is dependent on the one fix 18:43:31 But there's no way we can make every patch dependent 18:43:36 bmwiedemann: yes, that is what I am hearing 18:43:49 anteaya: I’m around 18:43:50 dane_leblanc: do we have an example of this in action? 18:43:52 So we would like to abstain from voting 18:43:54 * carl_baldwin goes to read context 18:43:56 carl_baldwin: great, thanks 18:44:13 carl_baldwin: do you remember at sprint we discussed a testing system you had internally 18:44:16 Yes, 1 example is a plugin we're just introducing 18:44:38 carl_baldwin: where there was a spider web of patches that your system had to pull in in the right order to test everything 18:44:46 carl_baldwin: do you recall that chat? 18:44:54 anteaya: Yes, I recall that chat. 18:45:12 carl_baldwin: you were going to try to make that available to the public 18:45:19 DVR was implemented in a non-linear chain of dependencies. 18:45:22 carl_baldwin: what is the status on that direction 18:45:39 dane_leblanc: do you have a url for your plugin you are introducing? 18:45:43 But won't this be frought with merge conflicts, if we're doing this on every patch? 18:45:57 dane_leblanc: I can't answer that question 18:46:04 an example (forward search for 'only relevant pre-merge'): https://github.com/dougwig/neutron-thirdparty-ci/blob/master/ci-slave-post-devstackin a more complicated change, there might be common files edited, which would lead to merge madness. 18:46:10 anteaya: I have not made any progress on making that public. However, the script I hacked out *seemed* to work well and anyone is welcome to it. 18:46:13 dane_leblanc: I need to see something as an example 18:46:21 borked the link: https://github.com/dougwig/neutron-thirdparty-ci/blob/master/ci-slave-post-devstack 18:46:36 An example is the plugin for our APIC controller hardware 18:46:40 carl_baldwin: have you a url for that code? (and have you licenced it?) 18:46:52 The CI testbed includes this hardware 18:47:00 anteaya: No, neither yet. 18:47:04 #link https://github.com/dougwig/neutron-thirdparty-ci/blob/master/ci-slave-post-devstack 18:47:13 But the hardware won't work without initial commits which have not been approved and merged 18:47:17 carl_baldwin: okay, do update me when you are able 18:47:21 carl_baldwin: thanks 18:47:43 We need to keep testing the initial commits as their being reviewed 18:47:54 dane_leblanc: do you have the url for the initial commits for this plugin? 18:47:56 But all other patches will fail because they don't contain our initial commits 18:48:37 https://review.openstack.org/#/c/111431/ 18:48:52 #link https://review.openstack.org/#/c/111431/ 18:48:55 dane_leblanc: thanks 18:49:02 https://review.openstack.org/#/c/111432/ 18:49:08 There are 3 others 18:49:26 the commit message says enhancements 18:49:37 is this the inital commit for a driver? 18:49:41 * anteaya is confused 18:49:49 Ah, sorry 18:49:56 I'm confusing 2 situations 18:50:04 let's stay with one plesae 18:50:10 2 different plugins, but similar issue 18:50:11 I'm having a hard enough time with one 18:50:16 With APIC 18:50:25 let's select an example and walk through it 18:50:28 (same one we've been disussing) 18:50:40 what is APIC? 18:50:46 #link https://review.openstack.org/#/c/111432/ 18:50:47 There is a bug where all patch sets out of this list will cause leakage 18:50:54 In our hardware in the CI 18:51:06 is there a fix for the bug? 18:52:13 It's not a fix per se, but the new set of enhancements are the only way of being compatible with the new APIC that's in the CI 18:52:42 The APIC was updated recently, and old plugin code is incompatible 18:52:44 okay I think we have moved from the generality of third party to the specifics of this situation 18:53:03 * anteaya still doesn't know what APIC stands for, but is willing to move on 18:53:03 But this is a general situatoin. 18:53:14 anyone else had this situation? 18:53:15 anteaya: a special computer chip 18:53:20 show of hands will work 18:53:23 bmwiedemann: thanks 18:53:25 anteaya: sort of. 18:53:32 kevinbenton: thanks for speaking up 18:53:35 anyone else? 18:53:46 i did, but it was a trivial case, and easily worked around. 18:53:55 APIC = Application Policy Infrastrucure Controller 18:53:55 okay let's dig in 18:54:08 kevinbenton: what did you do when faced with this? 18:54:13 anteaya, there's a more general case which other people might see 18:54:24 dane_leblanc: do expand on that point 18:54:39 Let's say someone is introducing a new plugin 18:54:41 anteaya: i mentioned this on the mailing list, but we have a script that checks for certain conditions before voting 18:54:44 For some new hardware 18:55:00 kevinbenton: is your script available to others? 18:55:00 When we first start up the CI for this new plugin 18:55:03 anteaya: so we don’t vote if a patch is known to be broken with our CI for some reason 18:55:18 anteaya: no, it’s a really hacky bash script right now that checks for certain files, commit IDs, etc 18:55:38 kevinbenton: it sounds like a helpful concept, hacky though it might be 18:55:56 kevinbenton: are you willing to have it on stackforge so that others may use it and offer patches? 18:56:32 anteaya: possibly, but i wouldn’t be able to get to it for a couple of weeks 18:56:45 Is not voting the best choice, versus a "SKIPPED" vote? 18:56:52 anteaya: the patch alone doesn’t make much sense, i would want to document how our CI works to see how it’s called 18:57:08 kevinbenton: if you are able to make the script available by public url, I can write the patch that creates the repo 18:57:19 kevinbenton: that is fair 18:57:28 dane_leblanc: a good question 18:57:33 what do others think? 18:57:34 "SKIPPED" might be more transparent, saying that "we see your patch, but can't test it now" 18:57:37 dane_leblanc: skipped 18:57:56 one vote for skipped, anyone else? 18:58:01 skipped 18:58:13 any other opinions here? 18:58:21 It would be good to have kevinbenton's solution on the wiki page for how to do CI 18:58:25 as a hint 18:58:43 yes, being able to see this as an option would be good 18:58:50 I was stuck on how to do this in a zuul/jenkins setup 18:58:55 dane_leblanc: i’m not sure how well it integrates with the zuul approach though 18:59:01 moving to Open Discussion 18:59:03 Right 18:59:12 The zuul/jenkins needs a different solution 18:59:18 #topic Open Discussion 18:59:24 40 seconds 18:59:33 anyone with anything? 18:59:46 okay, great meeting everyone 18:59:47 has anyone gotten swift upload to work from zuul.conf settings? 19:00:02 wow not a lot of Open Discussion time 19:00:09 not today, no 19:00:12 lol :) 19:00:18 be sure to put agenda items on the agenda 19:00:23 time to wrap up 19:00:25 np, i will bring up on other forums 19:00:31 thanks everyone, see you next week 19:00:34 #endmeeting