08:00:02 #startmeeting third-party 08:00:03 Meeting started Tue Mar 31 08:00:02 2015 UTC and is due to finish in 60 minutes. The chair is anteaya. Information about MeetBot at http://wiki.debian.org/MeetBot. 08:00:04 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 08:00:06 The meeting name has been set to 'third_party' 08:00:21 raise your hand if you are here for the third party meeting 08:00:50 Hi 08:00:55 hello lennyb 08:01:02 nice to see you 08:01:21 how are you today? 08:01:37 you too. It looks like only you and me again :) 08:01:44 it happens 08:01:56 how are you doing at responding to the email thread? 08:02:06 I don't think i have seen your response yet 08:02:43 I found a great feature in outlook - 'time zones' for setting recursive meetings with no effect of local summer/winter time. 08:02:55 well that is great 08:03:08 I'm glad you found something that works for you 08:03:50 Regarding email, I did not respond yet, since we had some issues with showing html reports (it was shown as plain text ) and recent Nova failures that I am fixing. 08:05:23 okay 08:05:35 what is wrong with plain text reports for now? 08:06:51 now it works as html according to community policy and jogo's comment 08:07:47 where is the community policy that it has to be in html? 08:08:01 and where is jogo's comment to that effect 08:08:16 if people are saying that your logs have to be in html that is news to me 08:08:27 and would like to see where you have seen that stated 08:08:36 you have to have logs, yes 08:09:01 the closer they are to what jenkins provides, the better it is for everyone concerned, yes 08:09:17 they have to be in html? I haven't seen that anywhere 08:09:38 "I couldn't find the equivalent of: http://logs.openstack.org/68/135768/9/check/check-tempest-dsvm-full/f6c95de/logs/testr_results.html.gz" 08:10:01 testr_results 08:10:22 had you provided the output of testr_results in any format? 08:10:42 This is his quote and my understanding of it. The link he opens as html, our ones were shown as plain text 08:10:49 that wasn't a request for html that was a request for testr_results output 08:11:09 had you shown testr_results prior to his comment? 08:12:22 yes, but was also not in root folder. so it's fixed now 08:12:37 can I see a link to one of your runs 08:12:44 and we can look at your logs 08:15:14 1sec 08:16:23 I done have runs after the fix, yet. This is before the fix. http://144.76.193.39/ci-artifacts/Check-MLNX-Nova-ML2-Sriov-driver_20150318_1650/ 08:16:57 okay 08:17:13 can we agree that http://144.76.193.39/ci-artifacts/Check-MLNX-Nova-ML2-Sriov-driver_20150318_1650/console.html.gz is useless in its current format? 08:18:37 #link http://imgur.com/6MXyRQ4 08:18:39 yes. will be fixed as well 08:18:43 is what I see 08:19:58 testr_results is the only log that does seem readable: http://144.76.193.39/ci-artifacts/Check-MLNX-Nova-ML2-Sriov-driver_20150318_1650/logs/testr_results.html.gz 08:20:16 it doesn't provide much information but the format is readable 08:20:53 It was smoke run with 2 tests 08:20:57 yes 08:20:59 I see that 08:21:12 so you have a ways to go, yes? 08:21:49 so personally right now, I wouldn't be supportive of you leaving comments anywhere but on a sandbox repo 08:22:03 I believe so. 08:22:10 because the artifacts you are providing are not useful for anyone 08:22:12 okay good 08:22:21 so going forward, use your judgement 08:22:37 if you can't read what you provide, chances are noone else can either 08:23:01 does that make sense? 08:23:45 so here is my question 08:23:56 mellanox is leaving comments on other repos, right? 08:24:15 their logs must be in some kind of readable shape, I am assuming 08:24:27 why are you on your own with this? 08:24:27 yes, neutron and cinder 08:24:42 why isn't anyone at mellanox helping you get your logs in shape 08:24:58 certainly someone at mellanox must have figured out log formatting by now 08:25:06 why aren't they supporting you? 08:25:17 I am not on my own, I am just the one who represents Mellanox CI 08:26:33 http://144.76.193.39/ci-artifacts/143297/30/Check-MLNX-Neutron-ML2-driver/ 08:26:49 and this is from a neutron patch 08:26:57 and the logs are in terrible shape 08:27:16 I see, It will be fixed a.s.a.p as well 08:27:16 Mellanox CI is commenting and leaving this on Neutron patches 08:27:21 how? 08:27:38 is there anyone at Mellanox that has figured out log formatting? 08:28:01 this was Kyle's and my concern we outlined on the third-party-announce mailing list thread 08:28:16 Mellanox CI is the account that comments on Neutron patches 08:28:24 you are just learning, which is fine 08:28:29 everyone has to learn 08:29:02 but this CI has voting privledges in Neutron 08:29:08 do you understand what that means? 08:29:41 can you understand our concerns here? 08:29:41 as I said it will be fixed. 08:29:56 can you understand our concerns? 08:31:01 yes, I do understand your concern, We are very responsive on every issue of Mellanox CI failure 08:31:50 do you understand that you are new 08:32:31 and that the reason we don't start off with systems voting right away anymore is that we have seen the mistakes that new people make when they are learning how to operate a ci system? 08:32:49 this is for your protection as much as for neutron's 08:32:54 yes, I understand and I do have full support of Mellanox team. 08:33:16 how can they leave a new person solely responsible for a voting ci system? 08:33:43 at the very least you should request yourself that for neutron voting permissions be removed until you learn what you are doing 08:34:21 if anythign this will be seen as a very responsible move on your part 08:35:23 this isn't your fault 08:35:41 ci operators are routinely expected to accomplish tasks that they have no idea how to do 08:35:50 but this approach has a cost 08:35:53 and you pay it 08:35:58 and so does the community 08:36:12 whereas management just thinks it is your fault 08:36:32 it is far better to be honest with yourself, and with us 08:36:58 and have the permissions on the account set in such a way that the operator is cognizant of the ramifications of their actions 08:37:05 and new people just aren't 08:37:44 hence we learned to restrict accounts run by new ci operators 08:37:51 which usually is new ci accounts 08:38:12 I don't know if I have other examples of a running ci account that is just handed off to a new person 08:41:26 As I said, I have enough experience in the field and enough support of the team and of the community ( as I see ) to continue running our CIs. logs will be fixed. Nova CI will be updated and appropriate email will be sent to the list 08:41:53 I don't know as you heard anything I said 08:41:55 sigh 08:42:05 I guess we just have to do this the hard way 08:43:29 as you see fit 08:43:46 anything else I can help you with today? 08:51:26 anteaya, we are currently disabling all our CIs untill this formatting issue is solved. 08:51:39 lennyb: good call 08:51:44 thanks for listening 08:52:03 can you update your system on this page: https://wiki.openstack.org/wiki/ThirdPartySystems 08:52:08 #link https://wiki.openstack.org/wiki/ThirdPartySystems 08:52:12 and this 08:52:20 #link https://wiki.openstack.org/wiki/ThirdPartySystems/Mellanox_CI 08:52:28 with your current status please? 08:52:34 thank you so much 08:52:37 I'm grateful 08:53:35 if you are around in a few hours I suggest pinging asselin, he is active in the cinder channel and in the infra channel 08:53:54 asselin he may have some suggestions about how you can get a readable format in your logs 08:54:26 he is on pacific time so should be around in 7 hours 08:54:35 this issue was caused yesterday, when I added html support to the server that stores our logs. 08:54:58 ah 08:55:08 okay that is making more sense now, thank you 08:55:25 I personally have never seen this issue before 08:55:41 but check with asselin or perhaps patrickeast 08:55:49 one of them might have seen it previously 08:55:55 thanks for being proactive 08:55:58 I appreciate it 08:55:58 the logs are ok, just trying to show plain txt as html. it has nothing to do with CI itself. 08:56:05 right I know 08:56:21 but artifacts that are useful is important 08:57:02 and being proactive in ensuring what you provide is consumable goes a long way to folks recognizing that you take responsiblity for your actions 08:57:12 which translates to how they view your entire system 08:57:14 so thank you 08:57:59 I know. Thanks for the meeting, tips and guidance 08:58:20 thanks for showing up 08:58:30 showing up is really _my_ only requirement 08:58:38 anything else can be learned 08:58:46 but you can't learn it if you don't show up 08:58:48 so thanks 08:58:56 and yeah looks like we are at the end 08:59:06 see you next week, I hope, lennyb 08:59:22 #endmeeting