15:02:28 #startmeeting neutron_l3 15:02:29 Meeting started Thu Jan 17 15:02:28 2019 UTC and is due to finish in 60 minutes. The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:30 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:32 The meeting name has been set to 'neutron_l3' 15:02:37 o/ 15:02:50 mlavalle: hi, didn't expect you :) 15:02:52 hi 15:03:01 I'm glad to be back 15:03:09 I'll let you driver, though 15:03:15 #chair mlavalle 15:03:16 Current chairs: haleyb mlavalle 15:04:09 #Announcements 15:04:24 #topic Announcements 15:05:13 hi haleyb and mlavalle 15:05:39 xubozhang: hi 15:05:47 S2 milestone was last week 15:06:51 mlavalle: did we do a release? 15:07:02 we are going to release this week 15:07:09 amotoki is working on that 15:07:20 we are releasing Neutron and the stadium projects 15:07:55 from now on, when we release Neutron, we will release toegther with the stadium 15:07:55 ack. So we are in S3 which ends first week of March 15:07:58 I am preparing it but neutron-fwaas is broken due to oslo.privsep so I am waiting for the fix a bit 15:08:12 amotoki: ack. thanks for the update 15:08:15 neutron is broken from oslo.privsep still too 15:08:41 we should probably wait until https://review.openstack.org/#/c/631275/ merges 15:08:42 mlavalle: so maybe we can also wait for this fix/workaround for pyroute2 issue? 15:08:49 amotoki: didn't mean to rush you ;-) 15:09:03 slaweq: there is no rush, so yes, it makes sense 15:09:07 amotoki: ^^^^ 15:09:09 thx 15:09:18 thanks 15:09:22 this is patch https://review.openstack.org/#/c/631275/3 15:09:47 o/ 15:10:03 it is in the gate right now 15:10:30 so we this we don't need to go back in privsep vesion, right? 15:11:05 mlavalle: yes, I hope so 15:11:13 Great! 15:11:23 +1 15:11:44 right, and ralonsoh is continuing the investigation into where the actual issue is 15:11:44 but we will still need some fix in privsep/pyroute2 to make possible work with many threads in privsep 15:11:52 haleyb: exactly :) 15:12:05 but I saw also that bnemec was looking into this today 15:12:12 so maybe he will help us too :) 15:12:40 so, are we going to unblock the gate after 631275 merges? 15:12:52 mlavalle: yep, I really hope so 15:13:06 Cool 15:13:08 mlavalle: I tested it 4 times and I didn't saw any error from pyroute2 15:13:13 Previous privsep seems also has the pyroute2 issue: https://review.openstack.org/#/c/630516/ 15:13:18 Thanks! 15:13:33 That's slaweq's test patch. 15:14:55 liuyulong: did You saw this "Bad file descriptor" error in jobs on this patch too? 15:17:16 No, just a quick look, and it has that SSHTimeout and "During handling of the above exception, another exception occurred: 15:17:16 ". 15:17:48 Something similar to the Bug Description. 15:18:35 +1 for that quick fix, a lot of patches will need to rebase on it. 15:18:53 liuyulong: if You are talking about this http://logs.openstack.org/16/630516/6/check/neutron-tempest-plugin-dvr-multinode-scenario/09e8735/compute1/logs/screen-q-l3.txt.gz?level=ERROR#_Jan_16_13_28_16_714173 it comes from rootwrap so it's not the same thing 15:20:54 They are all pointing to the same bug 1811515? Or maybe I'm missing something. 15:20:59 bug 1811515 in neutron "SSH to FIP fails in CI jobs" [Critical,In progress] https://launchpad.net/bugs/1811515 - Assigned to Slawek Kaplonski (slaweq) 15:21:44 in fact this bug's title is maybe wrong as finally it was related to issue with pyroute2 15:21:50 I will update bug title there 15:22:01 yeah, the title is a little misleading 15:22:11 and we should then check again this dvr multinode job logs and open new bug for it 15:22:13 it was originally meant as a catch all thing 15:22:24 mlavalle: yes, my bad 15:22:26 sorry 15:22:31 I will update it now 15:22:45 slaweq: no problem. at the moment we din't know the specific nature of the issue 15:23:05 so it made sense at that point in time 15:23:11 mlavalle: yes, that is why I did it :) 15:25:10 slaweq: do I have permission from El Comandante to go back and work on the trunks / dvr bug? 15:25:22 mlavalle: LOL, always :) 15:25:53 you slapped me pretty hard on the wrists last CI meeting ;-) 15:26:05 just kidding 15:26:07 really? :) 15:26:15 for sure I can do it harder :P 15:26:32 LOL 15:26:53 should we move to Bugs then ? 15:27:02 let mne make a personal announcement 15:27:30 some of you already know that I am leaving my current employer, Huawei 15:27:54 my last day is the 25th. I am joining Oath / Verizon on the 28th 15:28:12 COngratulations! 15:28:23 Congratulations! 15:28:25 This shouldn't have any impact on my community involvement 15:28:30 Congrats mlavalle and good luck in new company :) 15:28:41 congrats! 15:28:47 so, no, you can not cheer that you are getting rid of me ;-) 15:29:00 Thanks everybody 15:29:04 \o/ 15:29:18 I've worked for 2 companies that are now part of Verizon, AOL and MCI. Lots of good people there. 15:29:18 Congrats mlavalle ! and we would never cheer :) 15:29:29 thanks 15:29:33 let's move on 15:29:42 #topic Bugs 15:30:35 one new bug this week 15:30:38 https://bugs.launchpad.net/neutron/+bug/1811166 15:30:45 Launchpad bug 1811166 in neutron "[RFE] Enforce router admin_state_up=False before distributed update" [Wishlist,New] - Assigned to Matt Welch (mattw4) 15:31:45 mlavalle: looks like we'll get to it at drivers? 15:32:21 yes, I need to revisit it 15:32:40 I do my triaging for that meeting Thursday afternoon 15:32:54 it is my radar screen, though 15:33:07 there was a bug fix i'm remembering 15:34:43 https://review.openstack.org/#/c/625134/ this one 15:34:56 yes, had just found it 15:35:36 so it was from the StarlingX people it looks 15:36:53 thanks for digging that 15:37:24 there was another L3 bug filed just yesterday 15:37:31 https://bugs.launchpad.net/neutron/+bug/1812118 15:37:34 Launchpad bug 1812118 in neutron "Neutron doesn't allow to update router external subnets" [Undecided,New] 15:38:00 i have not triaged, but the comment in it looks familiar 15:38:10 or maybe not 15:38:50 i also don't know why all those tags were added 15:40:07 so either njohnston (mr bugs this week) or myself will triage/confirm 15:40:31 yes I was just reading that one 15:41:29 going to try to reproduce it 15:41:43 njohnston: ack, thanks 15:42:49 there was one older bug 15:42:51 https://bugs.launchpad.net/neutron/+bug/1806770 15:42:57 Launchpad bug 1806770 in neutron "DHCP Agent should not release DHCP lease when client ID is not set on port" [Medium,In progress] - Assigned to Arjun Baindur (abaindur) 15:43:00 https://review.openstack.org/#/c/622634/ 15:43:23 oops, https://review.openstack.org/#/c/623066/ 15:43:51 i haven't seen an update, so will just work on this myself 15:44:33 thanks haleyb for picking that one up 15:44:33 there's been a few dhcp fixes recently so the code is somewhat fresh in my head 15:45:30 https://bugs.launchpad.net/neutron/+bug/1811639 15:45:37 https://review.openstack.org/#/c/630297/ 15:45:38 Launchpad bug 1811639 in neutron "virtual machine cannot get DHCP (DHCPv6) lease for IPV6 due to packet has no checksum." [Medium,In progress] - Assigned to Bence Romsics (bence-romsics) 15:46:09 bence sent a fix already, just stuck due to check queue failures 15:47:12 any other bugs to discuss? 15:47:53 not from me 15:47:54 #topic Open Discussion 15:48:27 xubozhang: since you joined, did you want to discuss your DVR change? i can find a link 15:48:38 yes 15:48:56 https://review.openstack.org/#/c/472289/ 15:49:17 i got failure in grenade-py3 15:49:30 what is it? and can i run it locally? 15:50:19 xubozhang: It should say it in the logs what tests it's running 15:50:25 also error in neutron-tempest-dvr 15:51:24 xubozhang: i looks like it can't connect to the floating IP? 15:51:46 the dvr test is a ssh timeout 15:51:58 http://logs.openstack.org/89/472289/16/check/neutron-tempest-dvr/32fad73/testr_results.html.gz 15:52:27 ok, can i run these locally tests? 15:52:37 yup 15:53:00 Command to run is in the log, it might just need a recheck 15:53:10 http://logs.openstack.org/89/472289/16/check/neutron-grenade/fce96e3/job-output.txt.gz#_2019-01-17_01_10_41_459305 15:54:00 ok thanks david 15:54:28 xubozhang: how comfortable do you feel digging into check queue logs? 15:55:41 not much 15:56:34 mhhh, that's what I thought. Maybe there is previous summits presentation that talks about that 15:56:47 I'll do some digging 15:57:10 ok thanks 15:57:23 Actually just on the topic of ovs-dvr, can we get some eyes on the Agent refactor? Just want to make sure we aren't doing anything too insane! https://review.openstack.org/#/c/528336 15:57:56 can you ping me Monday morning xubozhang? if I don't find anything, I'll give you a brief tutorial 15:58:11 davidsha: ack 15:58:34 mlavalle: thanks! 15:58:37 mlavalle, sure. what is your time zone? 15:59:00 and maybe we need a guide in the docs for new contributors on how to dig in the job results / logs 15:59:18 I'll try to put something together 15:59:29 anything else, we've got 1 minute 15:59:35 xubozhang: I'm in Texas, two hours ahead you 15:59:42 ok 15:59:42 US central 15:59:57 I'm done 16:00:11 same, thanks! 16:00:17 #endmeeting