14:00:12 <slaweq> #startmeeting networking
14:00:13 <openstack> Meeting started Tue Jun 16 14:00:12 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:00:14 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:00:16 <openstack> The meeting name has been set to 'networking'
14:00:18 <slaweq> hi
14:00:20 <mlavalle> o/
14:00:26 <njohnston> o/
14:00:26 <lajoskatona> o/
14:00:55 <rubasov> hi
14:01:21 <bcafarel> o/
14:01:24 <amotoki> o/
14:01:46 <slaweq> lets start
14:01:46 <slaweq> #topic Announcements
14:01:55 <slaweq> Just few announcements for today from me
14:02:08 <slaweq> 1. We are in Victoria-1 milestone's week now
14:02:30 <ralonsoh> hi
14:02:44 <mjozefcz> Hey!
14:03:25 <slaweq> and we have couple of not reviewed specs, see https://review.opendev.org/#/q/project:openstack/neutron-specs+status:open
14:03:54 <slaweq> so I want to ask team to take a look at those specs and review (some of) them this week :)
14:04:26 <slaweq> ok, next one
14:04:28 <slaweq> Victoria PTG
14:04:39 <slaweq> My summary http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015368.html
14:04:51 <slaweq> if You think I missed something, please add to this thread
14:05:17 <ralonsoh> good summary, thanks slaweq!
14:05:26 <slaweq> if You want to discuss more about any topics from this thread, please start new thread for that
14:05:43 <bcafarel> it was pretty extensive summary indeed
14:06:03 <slaweq> thx
14:06:09 <slaweq> next one
14:06:10 <slaweq> I proposed today to retire neutron-fwaas (master): http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015472.html
14:06:39 <slaweq> amotoki reminded me that I should also abandon opened patches for those projects, so I will do that today
14:07:13 <slaweq> and that's all announcements from my side for today
14:07:23 <slaweq> anything else do You have to share with the team?
14:07:52 <mjozefcz> thanks for the summary slaweq
14:08:04 <bcafarel> for v-1 also take a look at open neutron-lib patches,  there is release request at https://review.opendev.org/#/c/735687/ - it would be nice to have some of these new constants available in a release
14:08:49 <slaweq> bcafarel++ thx, I will check opened neutron-lib patches today
14:08:55 <mjozefcz> oh yes, there is one required for OVN: https://review.opendev.org/#/c/732141/
14:09:07 <mjozefcz> its about distributed service ports
14:09:44 <slaweq> mjozefcz: that one I would like haleyb to check as he had some concerns there
14:10:00 <haleyb> hi, it's on my list :)
14:10:06 <mjozefcz> haleyb, :) thanks
14:10:31 <slaweq> haleyb: thx
14:10:52 <slaweq> ok, I think we can move on
14:10:54 <slaweq> #topic Blueprints
14:11:05 <slaweq> Blueprints for Victoria-1: https://launchpad.net/neutron/+milestone/victoria-1
14:11:17 <slaweq> I have only small update about https://blueprints.launchpad.net/neutron/+spec/default-dns-zone-per-tenant
14:11:36 <slaweq> I proposed patch https://review.opendev.org/#/c/735733/ with new shim API extension
14:11:48 <slaweq> I still have to finish tempest test which is failing
14:12:57 <slaweq> any other updates about BPs?
14:13:22 <slaweq> rubasov: I will also try to review Your metadata IPv6 patches this or next week
14:13:30 <slaweq> rubasov: I didn't forget about that one :)
14:13:37 <rubasov> slaweq: thank you in advance
14:14:00 <rubasov> slaweq: while it's marked WIP, it's actually reviewable I think
14:14:18 <rubasov> rubasov: just forgot to clean up a failing test and remove the WIP
14:15:03 <slaweq> thx rubasov
14:15:49 <slaweq> ok, so I guess there is no other updates today
14:15:52 <slaweq> and we can move on
14:16:04 <slaweq> #topic Community Goals
14:16:19 <slaweq> I added new goal to our list
14:16:25 <slaweq> "Migrate CI/CD jobs to new Ubuntu LTS Focal "
14:16:44 <slaweq> goal description is at https://governance.openstack.org/tc/goals/selected/victoria/migrate-ci-cd-jobs-to-ubuntu-focal.html
14:17:00 <slaweq> I think we can start with some basic jobs firts to see how it will work
14:17:08 <slaweq> is there any volunteer for that maybe?
14:17:35 <ralonsoh> slaweq, I can try this week
14:17:58 <slaweq> ralonsoh: thx a lot
14:18:22 <bcafarel> interested too, though I think we should also see some results soon from "default" job configurations no?
14:18:43 <slaweq> bcafarel: I think so, but I'm not sure what exact gmann's plans are for that
14:19:18 <njohnston> I think gmann will be getting started soon
14:19:24 <lajoskatona> bcafarel: you mean this patch: https://review.opendev.org/731207 ?
14:19:32 <bcafarel> he posted a plan last week I think (let me find it)
14:19:44 <gmann> we are hitting one nova bug for that
14:19:47 <ralonsoh> yes, this patch I think so
14:19:48 <bcafarel> lajoskatona: looks like it indeed :)
14:20:00 <ralonsoh> gmann, thanks for the info
14:20:07 <ralonsoh> do you have a link for this bug?
14:20:10 <gmann> which is kind of blocking for devstack base job to be ready for testing but I will prepare some plan this week end
14:20:14 <ralonsoh> (just to track it)
14:20:22 <njohnston> I was on vacation last week, I will update this to also test it out https://review.opendev.org/#/c/734304/
14:20:37 <slaweq> nice
14:20:56 <gmann> #link https://bugs.launchpad.net/nova/+bug/1882521
14:20:56 <openstack> Launchpad bug 1882521 in OpenStack Compute (nova) "Failing device detachments on Focal" [Undecided,New]
14:20:57 <slaweq> so it seems that it works, at least in some basic scenarios :)
14:21:00 <gmann> ralonsoh: ^^
14:21:06 <ralonsoh> gmann, thanks!
14:21:43 <gmann> this is devstack base job preparation, with all base pacthes - https://review.opendev.org/#/c/731207/
14:22:08 <slaweq> thx gmann and lajoskatona for links :)
14:22:16 <mjozefcz> gmann, thanks
14:22:32 <slaweq> njohnston: and thx for test with functional/fullstack jobs
14:24:00 <slaweq> ok, so I think we can move on now
14:24:05 <slaweq> next topic is
14:24:11 <slaweq> #topic Bugs
14:24:19 <slaweq> jlibosva was our bug deputy last week
14:24:29 <jlibosva> o/
14:24:30 <slaweq> his summary is at http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015442.html
14:24:58 <jlibosva> there were three bugs that I was not able to triage, so it needs some extra eyes
14:25:08 <jlibosva> https://bugs.launchpad.net/neutron/+bug/1883288
14:25:08 <openstack> Launchpad bug 1883288 in neutron "Improper routing between private networks" [Undecided,New]
14:25:13 <jlibosva> https://bugs.launchpad.net/neutron/+bug/1882860
14:25:13 <openstack> Launchpad bug 1882860 in neutron "after FIP is assigned vm lost network connection" [Undecided,Incomplete]
14:25:17 <jlibosva> https://bugs.launchpad.net/neutron/+bug/1882873
14:25:18 <openstack> Launchpad bug 1882873 in neutron "internal server error on updating no-gateway on the dhcpv6 subnet" [Undecided,Incomplete]
14:25:54 <jlibosva> just wanted to bring those three to your attention
14:26:57 <slaweq> thx jlibosva
14:27:08 <slaweq> I asked for some more details in https://bugs.launchpad.net/neutron/+bug/1882873 already
14:27:08 <openstack> Launchpad bug 1882873 in neutron "internal server error on updating no-gateway on the dhcpv6 subnet" [Undecided,Incomplete]
14:27:33 <slaweq> and also I wanted to talk a bit about https://bugs.launchpad.net/neutron/+bug/1883071 (also from last week)
14:27:33 <openstack> Launchpad bug 1883071 in neutron "Fix flows l2 population related on br-tun being cleaned after RabbitMQ cluster has experienced a network partition" [High,In progress] - Assigned to gao yu (gaoyublack)
14:28:19 <slaweq> the problem there is (IIUC) that when neutron-ovs-agent is restarted and there is also rabbitmq issue, there may be some flows removed and data plane down
14:28:47 <slaweq> but I'm not really sure how far we should go with fix in neutron if the root cause of the issue is broken rabbitmq
14:30:07 <ralonsoh> agree with this. I also think https://review.opendev.org/#/c/735525/ could not be the solution for this problem
14:30:18 <ralonsoh> leaving stale flows in the OVS when restarting
14:30:35 <slaweq> ralonsoh: exactly, that's my concern too
14:30:46 <slaweq> but I wanted to discuss that with all of You here
14:31:18 <ralonsoh> I think gao should investigate this rabbitmq problem first
14:31:34 <ralonsoh> and find the root cause of this issue
14:32:19 <lajoskatona> that is a typical architectural issue, where to fix such problems, and typical deployer don't want to consider to do it in the right place :-)
14:32:22 <slaweq> ralonsoh: yes, and not restart neutron-ovs agent when there is rabbitmq issue in the cloud
14:32:34 <lajoskatona> -^ I "heard" about such issues....
14:33:28 <slaweq> right
14:34:04 <slaweq> so please take a look into the LP and proposed patch and write Your comments there if You have any thoughts about it :)
14:34:11 <slaweq> I will do it also today
14:35:51 <slaweq> from other things related to bugs and gate failures we have issue with ovn jobs: https://bugs.launchpad.net/neutron/+bug/1883601
14:35:51 <openstack> Launchpad bug 1883601 in neutron "ovn based neutron gate jobs failing 100% of times" [Critical,In progress] - Assigned to Jakub Libosvar (libosvar)
14:35:59 <slaweq> and it should be fixed with patch https://review.opendev.org/#/c/735799/
14:36:22 <slaweq> thx jlibosva and mjozefcz for quick fix for that
14:36:37 <mjozefcz> looks like ovn-related voting jobs are green :)
14:36:38 <slaweq> and we also have this issue with uwsgi in grenade jobs
14:36:56 <bcafarel> and all stable branches
14:36:58 <slaweq> but I'm not sure if that is already solved or still in progress
14:37:16 <slaweq> bcafarel: stable branches are impacted by uwsgi issue, right?
14:37:27 <slaweq> or there is yet another problem there?
14:37:50 <bcafarel> slaweq: yes I saw uwsgi failure in a pending pike backport
14:38:13 <slaweq> bcafarel: so I think that the same problem is causing failures in grenade jobs
14:38:17 <bcafarel> https://review.opendev.org/#/c/735523/ seems to be in good shape for ussuri then to see how everything is fixed in older
14:39:15 <slaweq> but neutron-grenade-multinode job failed on this patch :/
14:39:26 <slaweq> so yet another recheck
14:39:35 <bcafarel> hmm
14:39:46 <bcafarel> actually they may need to merge them backwards no?
14:40:06 <bcafarel> to get ussuri patch with grenade you need working train (and etc)
14:40:10 <mjozefcz> yes
14:40:15 <slaweq> I'm not sure, but this grenade job failed only due to one failed test (nova scheduling)
14:41:09 <bcafarel> sigh ok hopefully it will be merged tomorrow :)
14:41:15 <slaweq> yes
14:41:32 <slaweq> so for now there is no need to recheck Your patches - it will for sure be -1 from zuul :/
14:41:39 <slaweq> until those 2 issues will be fixed
14:42:09 <slaweq> ok, that's all about bugs from me today
14:42:15 <slaweq> this week our bug deputy is bcafarel
14:42:35 <slaweq> and please check https://wiki.openstack.org/wiki/Network/Meetings#Bug_deputy as we just started new round :)
14:43:21 <bcafarel> at least next week's deputy is aware I think :)
14:43:33 <slaweq> I will send him reminder :P
14:44:11 <slaweq> and that
14:44:14 <slaweq> that
14:44:22 <slaweq> *that's basically all from me for today
14:44:40 <slaweq> anything else You want to discuss today? or if not we can finish meeting earlier
14:46:18 <slaweq> ok, so I guess that this silence means "no" :)
14:46:24 <bcafarel> I think so yep!
14:46:26 <slaweq> thx for attending the meeting
14:46:34 <ralonsoh> bye
14:46:38 <slaweq> and see You all online
14:46:38 <bcafarel> o/
14:46:40 <slaweq> o/
14:46:41 <mlavalle> o/
14:46:42 <slaweq> #endmeeting