| *** yamamoto has joined #openstack-meeting | 00:02 | |
| *** brinzhang has joined #openstack-meeting | 00:03 | |
| *** iyamahat has joined #openstack-meeting | 00:05 | |
| *** brinzhang_ has quit IRC | 00:06 | |
| *** iyamahat has quit IRC | 00:11 | |
| *** _hemna has joined #openstack-meeting | 00:15 | |
| *** ianychoi has quit IRC | 00:18 | |
| *** bbowen has quit IRC | 00:19 | |
| *** bbowen has joined #openstack-meeting | 00:19 | |
| *** ianychoi has joined #openstack-meeting | 00:20 | |
| *** iyamahat has joined #openstack-meeting | 00:21 | |
| *** martial has quit IRC | 00:22 | |
| *** gyee has quit IRC | 00:31 | |
| *** iyamahat has quit IRC | 00:36 | |
| *** mattw4 has quit IRC | 00:37 | |
| *** tetsuro has joined #openstack-meeting | 00:40 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:52 | |
| *** jamesmcarthur has quit IRC | 00:58 | |
| *** Liang__ has joined #openstack-meeting | 00:59 | |
| *** ricolin has joined #openstack-meeting | 00:59 | |
| *** yamamoto has quit IRC | 01:04 | |
| *** igordc has quit IRC | 01:04 | |
| *** _hemna has quit IRC | 01:14 | |
| *** eharney has quit IRC | 01:15 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:20 | |
| *** ayoung has quit IRC | 01:21 | |
| *** hongbin has joined #openstack-meeting | 01:29 | |
| *** hongbin_ has joined #openstack-meeting | 01:32 | |
| *** hongbin has quit IRC | 01:33 | |
| *** _erlon_ has quit IRC | 02:05 | |
| *** hongbin_ has quit IRC | 02:06 | |
| *** brinzhang_ has joined #openstack-meeting | 02:08 | |
| *** yamamoto has joined #openstack-meeting | 02:11 | |
| *** brinzhang has quit IRC | 02:12 | |
| *** jamesmcarthur has quit IRC | 02:16 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:17 | |
| *** jamesmcarthur has quit IRC | 02:21 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:22 | |
| *** hongbin has joined #openstack-meeting | 02:23 | |
| *** jamesmcarthur has quit IRC | 02:24 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:24 | |
| *** tetsuro has quit IRC | 02:29 | |
| *** jamesmcarthur has quit IRC | 02:32 | |
| *** dklyle has quit IRC | 02:34 | |
| *** david-lyle has joined #openstack-meeting | 02:35 | |
| *** diablo_rojo has joined #openstack-meeting | 02:36 | |
| *** diablo_rojo has quit IRC | 02:58 | |
| *** tetsuro has joined #openstack-meeting | 03:01 | |
| *** tetsuro_ has joined #openstack-meeting | 03:06 | |
| *** tetsuro has quit IRC | 03:08 | |
| *** tetsuro_ has quit IRC | 03:11 | |
| *** mattw4 has joined #openstack-meeting | 03:21 | |
| *** psachin has joined #openstack-meeting | 03:31 | |
| *** dviroel has quit IRC | 03:33 | |
| *** hongbin has quit IRC | 03:33 | |
| *** mattw4 has quit IRC | 03:37 | |
| *** mattw4 has joined #openstack-meeting | 03:43 | |
| *** hongbin has joined #openstack-meeting | 03:47 | |
| *** armax has quit IRC | 03:50 | |
| *** mattw4 has quit IRC | 03:51 | |
| *** whoami-rajat has joined #openstack-meeting | 03:52 | |
| *** igordc has joined #openstack-meeting | 03:58 | |
| *** igordc has quit IRC | 04:01 | |
| *** hongbin has quit IRC | 04:06 | |
| *** apetrich has quit IRC | 04:20 | |
| *** pcaruana has joined #openstack-meeting | 04:27 | |
| *** shubham_potale has left #openstack-meeting | 04:33 | |
| *** tetsuro has joined #openstack-meeting | 04:35 | |
| *** brault has joined #openstack-meeting | 04:36 | |
| *** brault has quit IRC | 04:37 | |
| *** jaypipes has joined #openstack-meeting | 04:49 | |
| *** Luzi has joined #openstack-meeting | 04:55 | |
| *** tetsuro has quit IRC | 04:58 | |
| *** pcaruana has quit IRC | 05:12 | |
| *** boxiang has joined #openstack-meeting | 05:25 | |
| *** pcaruana has joined #openstack-meeting | 05:25 | |
| *** kopecmartin|off is now known as kopecmartin | 06:11 | |
| *** baojg has joined #openstack-meeting | 06:26 | |
| *** baojg has quit IRC | 06:27 | |
| *** tetsuro has joined #openstack-meeting | 06:28 | |
| *** baojg has joined #openstack-meeting | 06:28 | |
| *** jawad_axd has joined #openstack-meeting | 06:29 | |
| *** rsimai has joined #openstack-meeting | 06:44 | |
| *** brinzhang has joined #openstack-meeting | 06:48 | |
| *** tetsuro has quit IRC | 06:54 | |
| *** nnsingh has quit IRC | 07:01 | |
| *** rcernin has quit IRC | 07:04 | |
| *** tesseract has joined #openstack-meeting | 07:05 | |
| *** slaweq has joined #openstack-meeting | 07:10 | |
| *** _hemna has joined #openstack-meeting | 07:12 | |
| *** _pewp_ has quit IRC | 07:12 | |
| *** _pewp_ has joined #openstack-meeting | 07:13 | |
| *** _hemna has quit IRC | 07:16 | |
| *** dmacpher has joined #openstack-meeting | 07:21 | |
| *** ttsiouts has joined #openstack-meeting | 07:25 | |
| *** brault has joined #openstack-meeting | 07:30 | |
| *** brault has quit IRC | 07:30 | |
| *** tssurya has joined #openstack-meeting | 07:39 | |
| *** ttsiouts has quit IRC | 07:43 | |
| *** ttsiouts has joined #openstack-meeting | 07:44 | |
| *** ttsiouts has quit IRC | 07:48 | |
| *** ralonsoh has joined #openstack-meeting | 07:53 | |
| *** e0ne has joined #openstack-meeting | 07:58 | |
| *** belmoreira has joined #openstack-meeting | 07:59 | |
| *** apetrich has joined #openstack-meeting | 08:05 | |
| *** imsurit has joined #openstack-meeting | 08:17 | |
| *** ttsiouts has joined #openstack-meeting | 08:18 | |
| *** priteau has joined #openstack-meeting | 08:19 | |
| *** tetsuro has joined #openstack-meeting | 08:30 | |
| *** belmoreira has quit IRC | 08:34 | |
| *** imsurit_ofc has joined #openstack-meeting | 08:41 | |
| *** tetsuro has quit IRC | 08:42 | |
| *** priteau has quit IRC | 08:43 | |
| *** imsurit has quit IRC | 08:43 | |
| *** priteau has joined #openstack-meeting | 08:44 | |
| *** priteau has quit IRC | 08:44 | |
| *** imsurit_ofc has quit IRC | 08:46 | |
| *** altlogbot_3 has quit IRC | 08:51 | |
| *** irclogbot_2 has quit IRC | 08:51 | |
| *** altlogbot_0 has joined #openstack-meeting | 08:52 | |
| *** irclogbot_2 has joined #openstack-meeting | 08:52 | |
| *** belmoreira has joined #openstack-meeting | 09:06 | |
| *** lpetrut has joined #openstack-meeting | 09:07 | |
| *** ttsiouts has quit IRC | 09:21 | |
| *** ttsiouts has joined #openstack-meeting | 09:22 | |
| *** Liang__ has quit IRC | 09:25 | |
| *** ttsiouts has quit IRC | 09:27 | |
| *** priteau has joined #openstack-meeting | 09:31 | |
| *** ttsiouts has joined #openstack-meeting | 09:32 | |
| *** boxiang has quit IRC | 09:42 | |
| *** lpetrut has quit IRC | 09:47 | |
| *** jamesmcarthur has joined #openstack-meeting | 09:49 | |
| *** yamamoto has quit IRC | 09:51 | |
| *** apetrich has quit IRC | 09:56 | |
| *** jamesmcarthur has quit IRC | 09:58 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 09:58 | |
| *** trident has quit IRC | 10:06 | |
| *** trident has joined #openstack-meeting | 10:08 | |
| *** lpetrut has joined #openstack-meeting | 10:09 | |
| *** ttsiouts has quit IRC | 10:09 | |
| *** ttsiouts has joined #openstack-meeting | 10:10 | |
| *** brinzhang has quit IRC | 10:10 | |
| *** jamesmcarthur_ has quit IRC | 10:11 | |
| *** yamamoto has joined #openstack-meeting | 10:13 | |
| *** ttsiouts has quit IRC | 10:14 | |
| *** boxiang has joined #openstack-meeting | 10:18 | |
| *** carloss has joined #openstack-meeting | 10:49 | |
| *** ttsiouts has joined #openstack-meeting | 10:59 | |
| *** yamamoto has quit IRC | 11:07 | |
| *** boxiang has quit IRC | 11:10 | |
| *** boxiang has joined #openstack-meeting | 11:11 | |
| *** yamamoto has joined #openstack-meeting | 11:14 | |
| *** Lucas_Gray has joined #openstack-meeting | 11:15 | |
| *** yamamoto has quit IRC | 11:15 | |
| *** yamamoto has joined #openstack-meeting | 11:17 | |
| *** Lucas_Gray has quit IRC | 11:21 | |
| *** Lucas_Gray has joined #openstack-meeting | 11:24 | |
| *** bdperkin has quit IRC | 11:32 | |
| *** irclogbot_2 has quit IRC | 11:33 | |
| *** raildo has joined #openstack-meeting | 11:34 | |
| *** belmoreira has quit IRC | 11:34 | |
| *** irclogbot_2 has joined #openstack-meeting | 11:35 | |
| *** bdperkin has joined #openstack-meeting | 11:38 | |
| *** yamamoto has quit IRC | 11:42 | |
| *** belmoreira has joined #openstack-meeting | 11:46 | |
| *** apetrich has joined #openstack-meeting | 11:49 | |
| *** yamamoto has joined #openstack-meeting | 11:55 | |
| *** yamamoto has quit IRC | 11:55 | |
| *** yamamoto has joined #openstack-meeting | 12:10 | |
| *** yamamoto has quit IRC | 12:14 | |
| *** dviroel has joined #openstack-meeting | 12:20 | |
| *** yamamoto has joined #openstack-meeting | 12:21 | |
| *** mriedem has joined #openstack-meeting | 12:35 | |
| *** ttsiouts has quit IRC | 12:36 | |
| *** ttsiouts has joined #openstack-meeting | 12:36 | |
| *** ttsiouts has quit IRC | 12:41 | |
| *** yamamoto has quit IRC | 12:43 | |
| *** yamamoto has joined #openstack-meeting | 12:44 | |
| *** coreycb has quit IRC | 12:45 | |
| *** coreycb has joined #openstack-meeting | 12:47 | |
| *** eharney has joined #openstack-meeting | 12:49 | |
| *** belmoreira has quit IRC | 12:54 | |
| *** liuyulong has joined #openstack-meeting | 12:56 | |
| *** e0ne has quit IRC | 12:57 | |
| *** e0ne has joined #openstack-meeting | 12:57 | |
| *** yamamoto has quit IRC | 13:01 | |
| *** jawad_axd has quit IRC | 13:01 | |
| *** ttsiouts has joined #openstack-meeting | 13:12 | |
| *** artom has quit IRC | 13:25 | |
| *** yamamoto has joined #openstack-meeting | 13:28 | |
| *** ttsiouts has quit IRC | 13:28 | |
| *** ttsiouts has joined #openstack-meeting | 13:29 | |
| *** ttsiouts has quit IRC | 13:33 | |
| *** brault has joined #openstack-meeting | 13:39 | |
| *** liuyulong has quit IRC | 13:41 | |
| *** enriquetaso has joined #openstack-meeting | 13:42 | |
| *** ttsiouts has joined #openstack-meeting | 13:45 | |
| *** apetrich has quit IRC | 13:47 | |
| *** ayoung has joined #openstack-meeting | 13:52 | |
| *** yamamoto has quit IRC | 13:53 | |
| *** armax has joined #openstack-meeting | 13:54 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:55 | |
| *** liuyulong has joined #openstack-meeting | 13:55 | |
| liuyulong | test | 13:55 |
|---|---|---|
| liuyulong | test | 13:56 |
| *** apetrich has joined #openstack-meeting | 13:56 | |
| liuyulong | #startmeeting neutron_l3 | 14:00 |
| openstack | Meeting started Wed Jul 24 14:00:04 2019 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:00 | |
| openstack | The meeting name has been set to 'neutron_l3' | 14:00 |
| *** belmoreira has joined #openstack-meeting | 14:00 | |
| slaweq | hi | 14:00 |
| liuyulong | hi | 14:02 |
| liuyulong | #topic Announcements | 14:02 |
| *** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:02 | |
| njohnston | o/ | 14:02 |
| *** liuyulong_ has joined #openstack-meeting | 14:03 | |
| liuyulong_ | Any announcements? | 14:06 |
| liuyulong_ | OK, let's move on. | 14:06 |
| liuyulong_ | #topic Bugs | 14:06 |
| *** liuyulong has quit IRC | 14:06 | |
| *** liuyulong_ is now known as liuyulong | 14:06 | |
| liuyulong | #topic Bugs | 14:07 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:07 | |
| *** wwriverrat has joined #openstack-meeting | 14:07 | |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007952.html | 14:07 |
| liuyulong | Hongbin was our bug deputy last week, thanks. | 14:07 |
| liuyulong | IMO, it is a quiet week for L3, (we are in neutron_l3 meeting) : ) | 14:07 |
| *** brault has quit IRC | 14:07 | |
| liuyulong | So today, I will re-raise some old bugs. And I've reset some bugs with a higher level, because it has been submitted for a really long time. | 14:08 |
| liuyulong | (Maybe I should change the bug level more higher if it still does not have much activities. LOL) | 14:08 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1826695 | 14:09 |
| openstack | liuyulong: Error: Could not gather data from Launchpad for bug #1826695 (https://launchpad.net/bugs/1826695). The error has been logged | 14:09 |
| liuyulong | What happened? | 14:09 |
| liuyulong | The bug title is "[L3][QoS] cache does not removed when router is down or deleted" | 14:10 |
| liuyulong | The fix is here: | 14:10 |
| liuyulong | https://review.opendev.org/#/c/656105/ | 14:10 |
| slaweq | I would say opposite - if bug is there for long time and nobody really cares about it, we should IMO decrease its priority :) | 14:10 |
| *** liuyulong_ has joined #openstack-meeting | 14:10 | |
| * njohnston thinks Launchpad is having issues | 14:11 | |
| ralonsoh | njohnston, I can't load anything | 14:12 |
| liuyulong | slaweq, until someday nobody care about the entire project? LOL | 14:12 |
| slaweq | liuyulong: who knows :) | 14:13 |
| liuyulong | Next | 14:13 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1811352 | 14:14 |
| openstack | liuyulong: Error: Could not gather data from Launchpad for bug #1811352 (https://launchpad.net/bugs/1811352). The error has been logged | 14:14 |
| *** Luzi has quit IRC | 14:14 | |
| liuyulong | openstack, all right, I know! | 14:14 |
| liuyulong | We need this for Shanghai related topic: | 14:14 |
| liuyulong | https://review.opendev.org/#/c/650062/ | 14:14 |
| liuyulong | The CLI patch is here ^^ | 14:14 |
| liuyulong | The progress is a bit slow. All OSC core reviewers has been added to that patch. : ( | 14:17 |
| * tidwellr wanders in late and lurks | 14:17 | |
| *** lennyb has quit IRC | 14:18 | |
| liuyulong | But it's OK, we can tag it locally and install it for the demo. | 14:18 |
| liuyulong | Next one: #link https://bugs.launchpad.net/neutron/+bug/1609217 | 14:18 |
| openstack | liuyulong: Error: Could not gather data from Launchpad for bug #1609217 (https://launchpad.net/bugs/1609217). The error has been logged | 14:18 |
| slaweq | liuyulong: do You have any presentation about port forwarding in Shanghai? | 14:19 |
| liuyulong | This is really an old one, the title is "DVR: dvr router ns should not exist in scheduled DHCP agent nodes" | 14:19 |
| liuyulong | The fix is here, it adds a new config for cloud deployment: https://review.opendev.org/#/c/364793/ | 14:19 |
| liuyulong | slaweq, yes, mlavalle submitted a topic. | 14:20 |
| slaweq | good to know :) | 14:20 |
| slaweq | thx for info | 14:20 |
| liuyulong | I will not repeat the reason of the fix, if you are interested in this bug, this will be the full scenarios I added before: | 14:21 |
| liuyulong | https://review.opendev.org/#/c/364793/3//COMMIT_MSG | 14:21 |
| liuyulong | It makes large scale deployment really happy. | 14:21 |
| liuyulong | Next | 14:22 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1813787 | 14:22 |
| openstack | liuyulong: Error: Could not gather data from Launchpad for bug #1813787 (https://launchpad.net/bugs/1813787). The error has been logged | 14:22 |
| liuyulong | The bug title is "[L3] DVR router in compute node was not up but nova port needs its functionality" | 14:23 |
| liuyulong | The main fix is here: https://review.opendev.org/#/c/633871/ | 14:23 |
| liuyulong | We already have some related fix, but not aim to the root cause. This one is one approach. | 14:24 |
| liuyulong | We have run such code locally for a long time. It acts good. | 14:24 |
| liuyulong | Next #link https://bugs.launchpad.net/neutron/+bug/1825152 | 14:25 |
| openstack | liuyulong: Error: Could not gather data from Launchpad for bug #1825152 (https://launchpad.net/bugs/1825152). The error has been logged | 14:25 |
| *** jamesmcarthur has quit IRC | 14:25 | |
| *** ayoung has quit IRC | 14:25 | |
| liuyulong | The title is "[scale issue] the root rootwrap deamon causes l3 agent router procssing very very slow" | 14:25 |
| liuyulong | These two config options really hurt the performance: `use_helper_for_ns_read=` and `root_helper_daemon=`. | 14:26 |
| liuyulong | The fix https://review.opendev.org/#/c/653378/ just set it to False by default, since we should set the more proper value for the widely used distro. | 14:26 |
| slaweq | about this one I still don't agree that we should change default value which can possibly break some deployments during upgrade | 14:27 |
| liuyulong | Yes, another large scale issue. And we also have a nice performance improvement locally. | 14:27 |
| slaweq | IMO this should be well documented what to do to potentially improve performance here | 14:28 |
| slaweq | but IMO changing default value isn't good solution | 14:28 |
| *** mriedem has quit IRC | 14:29 | |
| ralonsoh | slaweq, that's the point, this is a potential issue in some environments | 14:29 |
| liuyulong | slaweq, thanks for the advice | 14:29 |
| liuyulong | I will update the doc | 14:30 |
| slaweq | thx | 14:30 |
| liuyulong | But may I know the real distro which rely on this? XEN? | 14:30 |
| ralonsoh | not only XEN but environments where the user can't access to the namespaces | 14:31 |
| liuyulong | OK, last one | 14:31 |
| *** mattw4 has joined #openstack-meeting | 14:31 | |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1828494 | 14:32 |
| openstack | liuyulong: Error: Could not gather data from Launchpad for bug #1828494 (https://launchpad.net/bugs/1828494). The error has been logged | 14:32 |
| slaweq | liuyulong: TBH I don't know - maybe if You want to change default value You can start thread on ML to ask other operators/distro maintainers who can potentially be hurt by this change and maybe we can change it in the future | 14:32 |
| liuyulong | The title is "[RFE][L3] l3-agent should have its capacity" | 14:32 |
| liuyulong | It is a RFE | 14:32 |
| liuyulong | slaweq, OK, thank you : ) | 14:33 |
| liuyulong | The spec "L3 agent capacity and scheduling" | 14:33 |
| liuyulong | https://review.opendev.org/#/c/658451/ | 14:33 |
| slaweq | this needs to be discussed by drivers team first | 14:34 |
| liuyulong | And the ready to review code: | 14:34 |
| liuyulong | https://review.opendev.org/#/c/661492/ | 14:34 |
| liuyulong | slaweq, yes | 14:34 |
| *** zaneb has joined #openstack-meeting | 14:35 | |
| slaweq | but I'm also not sure if this is good idea | 14:35 |
| liuyulong | But I do not get a slot in amlost 3 months. : ) | 14:35 |
| slaweq | it sounds for me a bit like implementing placement in neutron | 14:35 |
| ralonsoh | I had the same impression | 14:35 |
| liuyulong | slaweq, why? | 14:36 |
| ralonsoh | all resource tracking should be done in the placemente | 14:36 |
| ralonsoh | not in the projects | 14:36 |
| ralonsoh | to centralize the information | 14:36 |
| slaweq | liuyulong: because generally placement is used to get reports about resources, track usage and propose candidates for place new services based on some criteria | 14:36 |
| ralonsoh | for example: the router BW | 14:36 |
| slaweq | I can understand that You want to do something in easiest and fastest possible way but IMO it's not good idea - maybe we should instead try to integrate this with placement | 14:37 |
| slaweq | and don't get me wrong - I'm just asking questions to think about it :) | 14:38 |
| liuyulong | That just make things complicated. Nova scheduler already hurt by it from our colleagues complaints | 14:38 |
| ralonsoh | this is not nova sheduler | 14:38 |
| ralonsoh | actually nova scheduler is being deprecated | 14:39 |
| liuyulong | I mean nova scheduler has been hurt by placement... | 14:39 |
| slaweq | also, it's not trivial thing to report resources and decide how many bandwidth You have available | 14:39 |
| liuyulong | It makes nova team refactor and refactor | 14:39 |
| slaweq | one host can be connected to various physical networks | 14:39 |
| slaweq | You can have router which will later have interfaces on networks which uses different physical nets | 14:40 |
| liuyulong | slaweq, yes, this is a good point, and can be easy to implement | 14:40 |
| slaweq | how You want to choose this bandwidth during router creation? | 14:40 |
| liuyulong | This is scheduler mechanism for router, yes | 14:41 |
| *** psachin has quit IRC | 14:41 | |
| *** dmacpher has quit IRC | 14:41 | |
| *** belmoreira has quit IRC | 14:42 | |
| liuyulong | random chice, and minimum quantity scheduling, is not as good as enough | 14:42 |
| *** ricolin_ has joined #openstack-meeting | 14:42 | |
| slaweq | I will read this spec once again in this week | 14:42 |
| slaweq | and will write my comments there | 14:42 |
| liuyulong | You can not say your L3 agent has an unlimited capacity | 14:43 |
| slaweq | but IMO there is many cases there which may be hard to deal with | 14:43 |
| liuyulong | But you have no way to prevent the router creating on that, until someday, boom... | 14:43 |
| slaweq | also if You want this rfe to be discussed in drivers meeting, please ping mlavalle about that | 14:43 |
| liuyulong | Your host die, and your custom complaints again, : ) | 14:44 |
| *** ricolin has quit IRC | 14:45 | |
| *** david-lyle is now known as dklyle | 14:45 | |
| slaweq | but with this change You will end up with no space on network nodes where there will be many routers which are doing nothing | 14:45 |
| slaweq | and your customer will complain due to error while creation of router :) | 14:45 |
| liuyulong | An none-exist resource error is easy to explain. | 14:46 |
| liuyulong | An data-plane down means you may pay money for it. | 14:46 |
| slaweq | so You can use https://github.com/openstack/neutron/blob/master/neutron/scheduler/l3_agent_scheduler.py#L346 now and monitor number of routers on each L3 agent | 14:47 |
| slaweq | or propose new scheduler which would have simply configured max number of routers on it - without reporting bandwidth and things like that | 14:47 |
| *** belmoreira has joined #openstack-meeting | 14:47 | |
| liuyulong | API error and host-down are totally a different level. | 14:47 |
| slaweq | yes, so why not just new simply scheduler with limited number of routers per agent? | 14:49 |
| *** bobh has joined #openstack-meeting | 14:49 | |
| *** igordc has joined #openstack-meeting | 14:49 | |
| *** belmoreira has quit IRC | 14:50 | |
| liuyulong | slaweq, I considered it once, it is a bit simple and rough, it is not facing the real capacity: NIC bandwidth. | 14:50 |
| slaweq | but You may have many NICs on network node | 14:50 |
| slaweq | and router can consume bandwidth from each of them | 14:51 |
| slaweq | how You want to know which bandwidth it will consume? | 14:51 |
| *** mattw4 has quit IRC | 14:51 | |
| slaweq | next question: what about L3 HA? | 14:51 |
| *** artom has joined #openstack-meeting | 14:52 | |
| slaweq | from which agent You will then "consume" this bandwidth? | 14:52 |
| *** jbadiapa has quit IRC | 14:52 | |
| liuyulong | slaweq, all routers will have to schedule | 14:52 |
| liuyulong | so the bandwidth_ratio will have its value. | 14:53 |
| *** belmoreira has joined #openstack-meeting | 14:53 | |
| slaweq | another question - what about dvr routers? what this "bandwidth" attribute will mean for them? | 14:54 |
| liuyulong | It means, if a HA router needs two nodes with 10Mbps, the scheduler will find two l3-agents for it with 10Mbps free bandwidth. | 14:54 |
| slaweq | I will go throug this spec once again this week and will write those questions there for further discussion | 14:54 |
| slaweq | 10 Mbits per interface? for all interfaces? on specific physical segment? or all physical segments? | 14:55 |
| slaweq | also what about other resources? like memory for example? | 14:56 |
| liuyulong | router can only have one external gateway, so this one. | 14:56 |
| slaweq | but router can also not have any external gateway - what about them? | 14:57 |
| *** belmoreira has quit IRC | 14:57 | |
| wwriverrat | brief status update for (if time allows): multiple segments per host WIP | 14:58 |
| liuyulong | wwriverrat, go ahead | 14:59 |
| wwriverrat | For status on https://review.opendev.org/#/c/623115 | 14:59 |
| wwriverrat | Re-working WIP patch to have a check method on base classes: `supports_multi_segments_per_host` (False by default). For LinuxBridge implementations it would return True. | 14:59 |
| wwriverrat | When False, takes data from old self.network_map[network_id]. When true, it gives all from self.segments for that network_id. Naturally code may have to either handle single segment or list of segments. | 14:59 |
| wwriverrat | The code I was working before spread too far and wide. If other drivers suffer same problem, they can implement supports_multi_segments_per_host too. | 14:59 |
| liuyulong | slaweq, please add your question to the patch, I will reply it. | 14:59 |
| liuyulong | Time is up. | 14:59 |
| ralonsoh | maybe next time we can talk about #link https://bugs.launchpad.net/neutron/+bug/1837635 | 15:00 |
| openstack | Launchpad bug 1837635 in neutron "HA router state change from "standby" to "master" should be delayed" [Undecided,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 15:00 |
| slaweq | liuyulong: sure | 15:00 |
| liuyulong | #endmeeting | 15:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:00 | |
| openstack | Meeting ended Wed Jul 24 15:00:00 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-07-24-14.00.html | 15:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-07-24-14.00.txt | 15:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2019/neutron_l3.2019-07-24-14.00.log.html | 15:00 |
| slaweq | and sorry for taking so much time for this one rfe :) | 15:00 |
| tidwellr | liuyulong: I owe you a review on that spec..... | 15:00 |
| *** mattw4 has joined #openstack-meeting | 15:00 | |
| *** belmoreira has joined #openstack-meeting | 15:00 | |
| slaweq | o/ | 15:01 |
| liuyulong | I once just want one a quick through of the meeting, you experts do not allow me, haha | 15:01 |
| *** ricolin_ is now known as ricolin | 15:02 | |
| *** liuyulong_ has quit IRC | 15:02 | |
| *** liuyulong has quit IRC | 15:02 | |
| *** jbadiapa has joined #openstack-meeting | 15:06 | |
| *** mriedem has joined #openstack-meeting | 15:09 | |
| *** tosky has joined #openstack-meeting | 15:11 | |
| *** yamamoto has joined #openstack-meeting | 15:13 | |
| *** gyee has joined #openstack-meeting | 15:13 | |
| *** iyamahat has joined #openstack-meeting | 15:14 | |
| *** ayoung has joined #openstack-meeting | 15:14 | |
| *** zhengMa has joined #openstack-meeting | 15:22 | |
| *** yamamoto has quit IRC | 15:24 | |
| *** belmoreira has quit IRC | 15:25 | |
| *** ttsiouts has quit IRC | 15:28 | |
| *** ttsiouts has joined #openstack-meeting | 15:29 | |
| *** ayoung has quit IRC | 15:32 | |
| *** tssurya has quit IRC | 15:32 | |
| *** ttsiouts has quit IRC | 15:34 | |
| *** hongbin has joined #openstack-meeting | 15:36 | |
| *** diablo_rojo has joined #openstack-meeting | 15:39 | |
| *** hongbin has quit IRC | 15:42 | |
| *** hongbin has joined #openstack-meeting | 15:42 | |
| *** hongbin has quit IRC | 15:43 | |
| *** hongbin has joined #openstack-meeting | 15:44 | |
| *** mattw4 has quit IRC | 15:44 | |
| *** mattw4 has joined #openstack-meeting | 15:44 | |
| *** davidsha has joined #openstack-meeting | 15:45 | |
| *** mattw4 has quit IRC | 15:49 | |
| *** boxiang has quit IRC | 15:50 | |
| *** rosmaita has joined #openstack-meeting | 15:50 | |
| *** boxiang has joined #openstack-meeting | 15:50 | |
| *** Liang__ has joined #openstack-meeting | 15:54 | |
| *** Liang__ is now known as LiangFang | 15:59 | |
| jungleboyj | #startmeeting Cinder | 16:00 |
| openstack | Meeting started Wed Jul 24 16:00:30 2019 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: Cinder)" | 16:00 | |
| openstack | The meeting name has been set to 'cinder' | 16:00 |
| davidsha | Hey | 16:00 |
| geguileo | hi! o/ | 16:00 |
| jungleboyj | Courtesy ping: jungleboyj whoami-rajat rajinir lseki carloss pots woojay erlon geguileo eharney rosmaita enriquetaso e0ne smcginnis davidsha walshh_ xyang hemna _hemna tosky | 16:00 |
| whoami-rajat | Hi | 16:01 |
| enriquetaso | o/ | 16:01 |
| eharney | hi | 16:01 |
| xyang | hi | 16:01 |
| e0ne | hi | 16:01 |
| jungleboyj | @! | 16:01 |
| _pewp_ | jungleboyj (=ﾟωﾟ)ﾉ | 16:01 |
| pots | o/ | 16:01 |
| rosmaita | o/ | 16:01 |
| e0ne | #link https://etherpad.openstack.org/p/cinder-train-meetings | 16:01 |
| walshh_ | hi | 16:02 |
| * smcginnis is here but not really | 16:02 | |
| jungleboyj | smcginnis: NOOOOO! You must be here. ;-) | 16:02 |
| * jungleboyj is lost without ShadowPTL | 16:03 | |
| smcginnis | hah! | 16:03 |
| jungleboyj | :-) | 16:03 |
| * jungleboyj defers to rosmaita Instead | 16:03 | |
| *** thgcorrea has joined #openstack-meeting | 16:03 | |
| jungleboyj | Ok. Quite a few things to get to today. | 16:04 |
| rosmaita | that won't do you any good | 16:04 |
| jungleboyj | :-p | 16:04 |
| jungleboyj | So, reminder that Train Milestone 2 is this week. | 16:04 |
| jungleboyj | #link https://releases.openstack.org/train/schedule.html | 16:05 |
| jungleboyj | That means that I will start looking at CI runs to see if they are running Pyton3. | 16:05 |
| e0ne | this week == tomorrow | 16:05 |
| smcginnis | e0ne: ;) | 16:05 |
| jungleboyj | e0ne: ++ | 16:05 |
| *** brault has joined #openstack-meeting | 16:06 | |
| jungleboyj | Any questions about those two questions? | 16:06 |
| jungleboyj | Two items... | 16:07 |
| jungleboyj | Take that as a no. | 16:07 |
| jungleboyj | Cinder Mid-Cycle Topics ... Please take a look at the etherpad. | 16:07 |
| jungleboyj | #link https://etherpad.openstack.org/p/cinder-train-mid-cycle-planning | 16:07 |
| jungleboyj | Please add topics there so that we can make sure to have a productive mid-cycle. | 16:08 |
| jungleboyj | #topic Spec: Leverage compression hardware accelerator | 16:09 |
| *** openstack changes topic to "Spec: Leverage compression hardware accelerator (Meeting topic: Cinder)" | 16:09 | |
| LiangFang | hi | 16:09 |
| LiangFang | thanks jungleboyj and rosmaita to give +2 | 16:10 |
| jungleboyj | So, my comments have bee addressed. I think we just need Eric to sign off. | 16:10 |
| jungleboyj | eharney: ^^ | 16:10 |
| eharney | i haven't caught up with the last round of discussion between LiangFang and Brian on this one | 16:10 |
| *** brault has quit IRC | 16:11 | |
| jungleboyj | Ok. If you can take a look that would be good. rosmaita gave a _2 | 16:11 |
| jungleboyj | +2 | 16:11 |
| rosmaita | it was software fallback if no accelerator, and a config option about whether to allow any compression or not | 16:11 |
| jungleboyj | rosmaita: Good. | 16:12 |
| eharney | sounds good | 16:12 |
| jungleboyj | LiangFang: Anything else to address? | 16:12 |
| *** diablo_rojo has quit IRC | 16:12 | |
| LiangFang | rosmaita ask me about nova impact last week | 16:13 |
| LiangFang | zhengMa has implement the code, and it seems no impact | 16:13 |
| *** pcaruana has quit IRC | 16:13 | |
| rosmaita | that's good | 16:14 |
| LiangFang | he have successfully created VM using container format 'compressed' | 16:14 |
| rosmaita | that's surprising, but ok | 16:14 |
| jungleboyj | rosmaita: Surprising ? | 16:15 |
| rosmaita | yeah, nova had to know to decompress the image before trying to use it | 16:15 |
| rosmaita | thought it might just fail with unsupported format or something | 16:16 |
| LiangFang | when cinder download image, cinder know the image container format | 16:16 |
| LiangFang | so cinder help to decompressed it | 16:16 |
| LiangFang | so what nova get is a compressed volume | 16:17 |
| rosmaita | ok, so it was a boot from volume VM | 16:17 |
| LiangFang | yes | 16:17 |
| rosmaita | we need to check what happens if you try to just boot from image the normal way with container_format == 'compressed' | 16:17 |
| smcginnis | What about when Nova doesn't use a Cinder volume? | 16:17 |
| rosmaita | what smcginnis said | 16:18 |
| rosmaita | because you know some user will try to use this the wrong way | 16:18 |
| jungleboyj | rosmaita: ++ | 16:19 |
| rosmaita | i am thinking nova will fail gracefully, we just want to verify that | 16:19 |
| rosmaita | so to be clear, we aren't expecting you to implement boot from compressed image in nova | 16:19 |
| LiangFang | oh, has not verified this yet | 16:19 |
| rosmaita | just want to make sure nothing breaks badly | 16:19 |
| jungleboyj | rosmaita: Any other concerns there? | 16:20 |
| rosmaita | no, that's all | 16:21 |
| jungleboyj | Ok. So, I think we just need eharney to review. | 16:21 |
| rosmaita | it's not really a problem with the spec, just a courtesy check on behalf of nova | 16:21 |
| LiangFang | thanks | 16:21 |
| LiangFang | we will check as soon as possible | 16:22 |
| jungleboyj | #topic Status and Zuul v3 porting of the remaining legacy Zuul jobs | 16:22 |
| *** openstack changes topic to "Status and Zuul v3 porting of the remaining legacy Zuul jobs (Meeting topic: Cinder)" | 16:22 | |
| tosky | hi! | 16:22 |
| jungleboyj | Hi. | 16:22 |
| tosky | do you want to me to show what I found out so far, or should I add some notes to the etherpad and then we can discuss about them? | 16:22 |
| *** ricolin has quit IRC | 16:23 | |
| smcginnis | Etherpad link? | 16:23 |
| tosky | to the etherpad of the meeting, I mean, unless you prefer a separate document | 16:23 |
| *** ayoung has joined #openstack-meeting | 16:23 | |
| jungleboyj | Go ahead and share. | 16:23 |
| tosky | sorry for the initial mess, I think it should be readable now on https://etherpad.openstack.org/p/cinder-train-meetings | 16:26 |
| jungleboyj | Ok. Anything that you need to highlight. | 16:26 |
| tosky | first, if there is anything which I don't know and that I should consider :) like some important non-documented reasons about some design decisions from that past that I should consider | 16:27 |
| tosky | second, there are a few open questions (namely, whether I can go forward with replacing the LIO jobs with its already native counterpart from cinder-tempest-plugin, and other small architectural questions) | 16:28 |
| tosky | (like whether it's fine to nuke the zeromq job from all existing branches) | 16:29 |
| smcginnis | I think so. As far as I understand, the ZMQ stuff is all dead. | 16:29 |
| jungleboyj | Ok. Trying to understand all this. Didn't know about this effort. | 16:29 |
| eharney | replacing the LIO jobs should be fine as long as we end up with something that runs the same configuration and tests somewhere (LIO, Barbican, and maybe one other thing that's turned on in there that i forget) | 16:29 |
| tosky | eharney: and that's the point; if you check the cinder-tempest-plugin-lvm-lio, is basically doing that already | 16:30 |
| eharney | right | 16:30 |
| tosky | the blacklist is a bit different and it lacks the cinderlib tests, but those are easy to fix | 16:30 |
| smcginnis | jungleboyj: Infra has stated the support for those legacy jobs will be going away. Not sure on timeframe, but we need to get updated to Zuul v3 native jobs as soon as we can. | 16:31 |
| jungleboyj | smcginnis: Ah, I see. | 16:31 |
| e0ne | smcginnis: thanks for this update! | 16:31 |
| tosky | also, the native jobs are easier to deal with; there is no more devstack-gate in between, and in my experience modifying them is easier | 16:32 |
| smcginnis | ++ | 16:32 |
| e0ne | tosky: +1 | 16:32 |
| tosky | of course there are many questions to digest but we can talk about this anytime; I'm now hanging around on #openstack-cinder too, so feel free to ping me anytime I'm connected (and/or comment on the reviews) | 16:33 |
| jungleboyj | tosky: Sounds good. | 16:34 |
| smcginnis | Thanks for looking at that tosky | 16:34 |
| jungleboyj | smcginnis: ++ | 16:34 |
| jungleboyj | tosky: Is there anything else you need from us right now? | 16:34 |
| tosky | no, I guess I have a general "go on, let's figure out the details", so that's fine, thanks! | 16:34 |
| jungleboyj | tosky: Ok great. Thank you for working on this. | 16:34 |
| jungleboyj | Ok if we move on? | 16:35 |
| jungleboyj | Take that as a yes. | 16:36 |
| tosky | yep | 16:36 |
| *** mszwed_ has joined #openstack-meeting | 16:36 | |
| jungleboyj | #topic stable branches release update | 16:37 |
| *** openstack changes topic to "stable branches release update (Meeting topic: Cinder)" | 16:37 | |
| jungleboyj | rosmaita: All your's. | 16:37 |
| rosmaita | there was a discussion yesterday among most of the cinder stable-maint cores in #openstack-cinder about the holdup releasing cinder stable/rocky (and hence stable/queens) | 16:37 |
| rosmaita | #link http://eavesdrop.openstack.org/irclogs/%23openstack-cinder/%23openstack-cinder.2019-07-23.log.html#t2019-07-23T16:50:35 | 16:37 |
| rosmaita | the tl;dr is we agreed to revert the patch declaring multiattach support for HPE MSA from stable/rocky | 16:37 |
| rosmaita | i restored mriedem's reversion patch | 16:37 |
| rosmaita | #link https://review.opendev.org/#/c/670086/ | 16:37 |
| rosmaita | but the commit message is kind of hyperbolic, particularly the part about no 3rd party CI running on the dothill driver | 16:37 |
| rosmaita | (there is CI, it's just run on subclasses of the driver) | 16:37 |
| rosmaita | i don't know how much the commit message matters, TBH | 16:38 |
| rosmaita | but i do know that we (the cinder team) tend to be a bit un-conservative with respect to what we consider to be appropriate driver backports | 16:38 |
| *** ayoung has quit IRC | 16:38 | |
| rosmaita | and in fact, we're not rejecting the backport because it could be considered to be adding a feature | 16:38 |
| rosmaita | but because further testing has indicated that multiattach isn't working for that driver | 16:38 |
| rosmaita | like i said, i don't know if anyone pays attention to commit messages | 16:38 |
| rosmaita | but it might give us more flexibility in the future if it's more accurate in this case | 16:38 |
| rosmaita | (this is where i stop to see if anyone has a comment) | 16:38 |
| e0ne | I think that drivers code should follow the same policy as the rest of cinder: no features backports | 16:39 |
| e0ne | with some exceptions when we need to introduce some config option to fix some bug :( | 16:39 |
| pots | i think the comment about the 3rd party CI was referring to whether the specific multiattach tests were being run correctly, which was a fair criticism. | 16:40 |
| rosmaita | ok, maybe i am being too sensitive | 16:41 |
| jungleboyj | pots: Right. | 16:41 |
| e0ne | afaik, we don't have a good 3rd-party CI coverage for stable branches | 16:41 |
| e0ne | it would be great if I'm wrong here | 16:42 |
| jungleboyj | rosmaita: I think we would find most people haven't added the multi-attach tests. | 16:42 |
| jungleboyj | Probably something we should check into. | 16:42 |
| rosmaita | they don't seem to be running on a lot of drivers | 16:42 |
| jungleboyj | e0ne: There is also that. | 16:42 |
| jungleboyj | We don't have that as a requirement though. | 16:42 |
| rosmaita | ok, i withdraw my comment about the commit message | 16:42 |
| jungleboyj | :-) | 16:42 |
| *** diablo_rojo has joined #openstack-meeting | 16:43 | |
| rosmaita | but i will need a stable core to +2 the revert so i can update the release patch | 16:43 |
| jungleboyj | rosmaita: Patch? | 16:43 |
| rosmaita | #link https://review.opendev.org/#/c/670086/ | 16:43 |
| rosmaita | ok, that's all from me | 16:44 |
| jungleboyj | Ok, yeah, the commit message isn't really accurate anymore here. I will update that and then we can get that patch in. | 16:44 |
| jungleboyj | rosmaita: Make sense? | 16:44 |
| smcginnis | Makes sense to me. | 16:45 |
| rosmaita | ok | 16:45 |
| jungleboyj | Okie dokie. Will do that after the meeting. | 16:45 |
| jungleboyj | Ok. So now we can move on. | 16:45 |
| *** mattw4 has joined #openstack-meeting | 16:46 | |
| jungleboyj | #link https://review.opendev.org/#/c/523659/21 | 16:46 |
| jungleboyj | A few comments have been addressed by the Infortrend driver. | 16:46 |
| * e0ne is waiting for geguileo's review | 16:46 | |
| geguileo | e0ne: on which patch? | 16:46 |
| jungleboyj | I think it is ok to me, the reamaining issue, if there is one, could be fixed with a follow-up. | 16:47 |
| e0ne | geguileo: actually, you did it already for my spec. thanks! | 16:47 |
| geguileo | e0ne: yeah, I just did that review XD | 16:47 |
| jungleboyj | We have discussion around the Seagate driver earlier this week: | 16:47 |
| jungleboyj | #link https://review.opendev.org/#/c/671195/ | 16:48 |
| jungleboyj | I think that we can let this slip a bit as it is a rename and pots has other patches to backport first. | 16:48 |
| jungleboyj | Doesn't anyone have an issue with that? | 16:48 |
| smcginnis | Yeah, I don't see that as a new driver. | 16:48 |
| jungleboyj | smcginnis: Ok. Good you agree there given I am kind-of close to that one. ;-) | 16:49 |
| jungleboyj | I see that the MacroSan driver was added into the list. | 16:49 |
| smcginnis | It really is just a rebrand. DotHill is gone, it is now Seagate. It makes sense to get that updated to show that. | 16:49 |
| whoami-rajat | jungleboyj: yep, i added it | 16:49 |
| jungleboyj | Cool. | 16:49 |
| jungleboyj | whoami-rajat: So, it has a -2 from eharney | 16:50 |
| whoami-rajat | jungleboyj: the maintainer keeps querying about reviews almost everyday and updates the patch regularly | 16:50 |
| whoami-rajat | jungleboyj: it's an old -2 | 16:50 |
| smcginnis | I haven't looked. Have they gone through the new driver checklist and addressed everything? Is there CI reporting now? | 16:51 |
| jungleboyj | Ok. I guess I had missed those pings. | 16:51 |
| smcginnis | Last I looked it was quite a way off. | 16:51 |
| jungleboyj | Yeah, I don't see a CI reporting. | 16:51 |
| whoami-rajat | smcginnis: they've turned off the CI reporting quite for a while now, but it has been reporting on other patches, need to report on this one too. | 16:51 |
| whoami-rajat | smcginnis: seemingly, the driver checklist has been addressed (as i checked last, maybe i missed something) | 16:52 |
| smcginnis | If it's the deadline and there hasn't been CI reporting on the new driver and other patches for at least several days, that's concerning. | 16:52 |
| jungleboyj | smcginnis: ++ | 16:53 |
| whoami-rajat | smcginnis: yea it is | 16:53 |
| jungleboyj | So, I am concerned about trying to get that one through. | 16:54 |
| smcginnis | Folks should review it and put specific issues/concerns on the review so they know what and why. | 16:55 |
| *** Lucas_Gray has quit IRC | 16:55 | |
| jungleboyj | I also haven't followed that one. .... So, I defer to those who have looked at it/followed it. | 16:55 |
| jungleboyj | Let me take a look at that driver and we can follow up in the channel after the meeting. | 16:56 |
| jungleboyj | eharney: Says he fixed his volume rekey spec. I think I am good with getting that in. | 16:57 |
| jungleboyj | #topic Final run-through of open patches for milestone-2 | 16:57 |
| *** openstack changes topic to "Final run-through of open patches for milestone-2 (Meeting topic: Cinder)" | 16:57 | |
| jungleboyj | e0ne: geguileo Has comments on your spec. | 16:58 |
| jungleboyj | #link https://review.opendev.org/#/c/556529/ | 16:58 |
| jungleboyj | Can we get eyes on the encryption one and see if we can merge that: https://review.opendev.org/#/c/608663/ | 16:58 |
| jungleboyj | Not sure if there is more discussion on those specs. | 16:59 |
| jungleboyj | Just please review and respond to comments please. | 16:59 |
| jungleboyj | Ok. That is all our time for today. | 17:00 |
| smcginnis | \o | 17:00 |
| jungleboyj | Thanks for joining the meeting. | 17:00 |
| whoami-rajat | Thanks! | 17:00 |
| jungleboyj | Talk to you all next week. | 17:00 |
| geguileo | thanks! | 17:00 |
| jungleboyj | #endmeeting | 17:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:00 | |
| openstack | Meeting ended Wed Jul 24 17:00:48 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-07-24-16.00.html | 17:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-07-24-16.00.txt | 17:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2019/cinder.2019-07-24-16.00.log.html | 17:00 |
| davidsha | Thanks! | 17:01 |
| *** davidsha has quit IRC | 17:01 | |
| *** mszwed_ has quit IRC | 17:01 | |
| *** rosmaita has left #openstack-meeting | 17:01 | |
| *** tosky has left #openstack-meeting | 17:02 | |
| *** mmethot_ is now known as mmethot | 17:02 | |
| *** zhengMa has quit IRC | 17:03 | |
| *** ayoung has joined #openstack-meeting | 17:05 | |
| *** LiangFang has quit IRC | 17:12 | |
| *** igordc has quit IRC | 17:16 | |
| *** igordc has joined #openstack-meeting | 17:17 | |
| *** ayoung has quit IRC | 17:27 | |
| *** igordc has quit IRC | 17:27 | |
| *** ayoung has joined #openstack-meeting | 17:30 | |
| *** priteau has quit IRC | 17:30 | |
| *** e0ne has quit IRC | 17:37 | |
| *** ayoung has quit IRC | 17:37 | |
| *** ayoung has joined #openstack-meeting | 17:38 | |
| *** ekcs has joined #openstack-meeting | 17:39 | |
| *** pcaruana has joined #openstack-meeting | 17:41 | |
| *** bobh has quit IRC | 17:42 | |
| *** ralonsoh has quit IRC | 17:55 | |
| *** igordc has joined #openstack-meeting | 18:01 | |
| *** diablo_rojo has quit IRC | 18:02 | |
| *** gary_perkins_ has quit IRC | 18:19 | |
| *** gary_perkins has joined #openstack-meeting | 18:20 | |
| *** panda has quit IRC | 18:25 | |
| *** ayoung has quit IRC | 18:29 | |
| *** panda has joined #openstack-meeting | 18:33 | |
| *** bdperkin has quit IRC | 18:39 | |
| *** tesseract has quit IRC | 18:49 | |
| *** lpetrut has quit IRC | 18:50 | |
| *** diablo_rojo has joined #openstack-meeting | 18:51 | |
| *** ayoung has joined #openstack-meeting | 18:56 | |
| *** thgcorrea has quit IRC | 19:03 | |
| *** bobh has joined #openstack-meeting | 19:07 | |
| *** kopecmartin is now known as kopecmartin|offf | 19:13 | |
| diablo_rojo | No storyboard meeting this week! Join us in #storyboard if you have questions/comments | 19:19 |
| *** ayoung has quit IRC | 19:25 | |
| *** e0ne has joined #openstack-meeting | 19:25 | |
| *** vishalmanchanda has quit IRC | 19:32 | |
| *** priteau has joined #openstack-meeting | 19:40 | |
| *** e0ne has quit IRC | 19:46 | |
| *** e0ne has joined #openstack-meeting | 19:57 | |
| *** priteau has quit IRC | 20:02 | |
| *** eharney has quit IRC | 20:05 | |
| *** e0ne has quit IRC | 20:19 | |
| *** bobh has quit IRC | 20:28 | |
| *** bobh has joined #openstack-meeting | 20:30 | |
| *** ayoung has joined #openstack-meeting | 20:35 | |
| *** panda has quit IRC | 20:35 | |
| *** panda has joined #openstack-meeting | 20:37 | |
| *** bobh has quit IRC | 20:39 | |
| *** hemna has quit IRC | 20:50 | |
| *** hemna has joined #openstack-meeting | 20:50 | |
| *** eharney has joined #openstack-meeting | 20:56 | |
| timburke | #startmeeting swift | 21:00 |
| openstack | Meeting started Wed Jul 24 21:00:02 2019 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| kota_ | o/ | 21:00 |
| *** patchbot has joined #openstack-meeting | 21:00 | |
| mattoliverau | o/ | 21:00 |
| rledisez | o/ | 21:01 |
| *** tdasilva_ has joined #openstack-meeting | 21:01 | |
| *** tdasilva_ is now known as tdasilva | 21:01 | |
| timburke | agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:02 |
| timburke | sorry, i haven't updated it -- but i think we're mostly following up on things anyway | 21:02 |
| timburke | #topic shanghai | 21:03 |
| *** openstack changes topic to "shanghai (Meeting topic: swift)" | 21:03 | |
| timburke | reminder that that's a thing. you should've gotten discount codes recently | 21:03 |
| clayg | o/ | 21:03 |
| rledisez | got it | 21:03 |
| *** zaitcev has joined #openstack-meeting | 21:04 | |
| *** e0ne has joined #openstack-meeting | 21:04 | |
| kota_ | oh really? | 21:04 |
| timburke | i don't need the topics fully fleshed out or anything, but it'll be good to get the foundation a rough headcount to expect | 21:04 |
| clayg | is anyone besides tim going *for sure* at this point? | 21:04 |
| timburke | kota_, maybe it'll arrive in the next day or two | 21:04 |
| kota_ | timburke: ok | 21:04 |
| *** pcaruana has quit IRC | 21:05 | |
| timburke | i know they often have to stagger these things so they don't immediately get blackholed as spam | 21:05 |
| kota_ | ah... i have to check older e-mail box too. | 21:05 |
| clayg | mine was titled "Invitation & Discount Registration to Open Infrastructure Summit Shanghai" and it came from summitreg@openstack.org - but it looks like they used e2ma.net as the mass mailing service | 21:05 |
| mattoliverau | Yeah, I got it during the night, Ie I saw it in my email this morning | 21:05 |
| rledisez | clayg: alecuyer and I are still expecting to go, no formal confirmation yet | 21:05 |
| kota_ | I'll check that today. thanks good info. | 21:06 |
| timburke | i still need to write an email to the mailing list to extend an invitation to not-you-guys and try to get a feel for the onboarding vs design/discussion split | 21:06 |
| timburke | #topic release | 21:07 |
| *** openstack changes topic to "release (Meeting topic: swift)" | 21:07 | |
| timburke | we've got a 2.22.0 release out! it's got some py3 support! | 21:07 |
| clayg | 🥳 | 21:08 |
| timburke | #link http://lists.openstack.org/pipermail/release-announce/2019-July/007429.html | 21:08 |
| zaitcev | Some? | 21:08 |
| timburke | zaitcev, probe tests don't pass. i found a few (mostly small?) issues when writing https://review.opendev.org/#/c/671333/ | 21:09 |
| patchbot | patch 671333 - swift - py3: (mostly) port probe tests - 2 patch sets | 21:09 |
| timburke | but we can get to that in a sec ;-) | 21:10 |
| timburke | there's a bunch of *other* great stuff, too, though! which is kind of amazing | 21:11 |
| timburke | configurable, anonymizable logs! | 21:11 |
| timburke | docker image! | 21:11 |
| timburke | continuous improvements to a variety of subsystems! | 21:12 |
| timburke | thank you all so much for helping to make this the best Swift yet :-D | 21:12 |
| mattoliverau | \o/ | 21:12 |
| timburke | shortly after that went in, i approved a few patches that i wanted to wait until after the release | 21:13 |
| clayg | best swift evar! | 21:13 |
| timburke | p 665758, p 657034, p 669511 in particular | 21:14 |
| patchbot | https://review.opendev.org/#/c/665758/ - swift - Bump up our minimum eventlet version (MERGED) - 4 patch sets | 21:14 |
| patchbot | https://review.opendev.org/#/c/657034/ - swift - Make py36 job voting (MERGED) - 1 patch set | 21:14 |
| patchbot | https://review.opendev.org/#/c/669511/ - swift - Add Python 3 Train unit tests (MERGED) - 1 patch set | 21:14 |
| *** ayoung has quit IRC | 21:15 | |
| timburke | on to other updates! | 21:15 |
| timburke | #topic py3 | 21:15 |
| *** openstack changes topic to "py3 (Meeting topic: swift)" | 21:15 | |
| tdasilva | timburke: you also proposed to devstack to start running swift under py3!!! | 21:15 |
| timburke | yup! p 670353 has one +2, waiting for final approval | 21:16 |
| patchbot | https://review.opendev.org/#/c/670353/ - devstack - Remove Swift from default DISABLED_PYTHON3_PACKAGES - 1 patch set | 21:16 |
| timburke | which will unblock p 671554 -- bringing back tempest tests | 21:17 |
| patchbot | https://review.opendev.org/#/c/671554/ - swift - Add integrated gate tempest and grenade job - 3 patch sets | 21:17 |
| timburke | (py3 support wasn't really the blocker there, i don't think -- but it was certainly a nice-to-have) | 21:17 |
| *** artom has quit IRC | 21:17 | |
| clayg | @timburke that does change how the func tests get started? | 21:18 |
| clayg | i only ask cause... we still run them under py2, right? | 21:18 |
| *** mattw4 has quit IRC | 21:18 | |
| timburke | clayg, no -- it just runs another set of independently-developed func tests | 21:18 |
| timburke | there are a bunch of places where we still need to port the func tests themselves to be able to run in-process py3 func tests | 21:19 |
| timburke | but i realized that, since we now run *all func tests* (under py2) against services running py3, the next-most-valuable testing is (or, seems to me to be) probe! | 21:20 |
| timburke | leading to p 671554 | 21:21 |
| patchbot | https://review.opendev.org/#/c/671554/ - swift - Add integrated gate tempest and grenade job - 3 patch sets | 21:21 |
| timburke | er.. | 21:21 |
| timburke | #undo | 21:21 |
| openstack | Removing item from minutes: #link https://review.opendev.org/#/c/671554/ | 21:21 |
| timburke | bah. whatever. | 21:21 |
| timburke | wrong bot | 21:21 |
| timburke | p 671333 | 21:21 |
| patchbot | https://review.opendev.org/#/c/671333/ - swift - py3: (mostly) port probe tests - 2 patch sets | 21:21 |
| timburke | that kicked out p 671167 p 670932 p 670933 and p 671168 | 21:22 |
| patchbot | https://review.opendev.org/#/c/671167/ - swift - py3: fix up listings on sharded containers - 1 patch set | 21:22 |
| patchbot | https://review.opendev.org/#/c/670932/ - swift - py3: fix up swift-orphans - 1 patch set | 21:22 |
| patchbot | https://review.opendev.org/#/c/670933/ - swift - py3: fix object-replicator rsync output parsing - 2 patch sets | 21:22 |
| patchbot | https://review.opendev.org/#/c/671168/ - swift - Fix up errno checking (MERGED) - 1 patch set | 21:22 |
| timburke | and that last one's even merged already! thanks tdasilva :-) | 21:22 |
| tdasilva | o/ | 21:24 |
| timburke | that's about what i've got for py3. of course, reviewing any of those or the already-written py3 func test changes would be tremendously helpful | 21:24 |
| timburke | as would writing new patches to port other func tests -- in particular, the s3api tests seemed hairy (FWIW) | 21:25 |
| kota_ | :/ | 21:25 |
| *** zaneb has quit IRC | 21:25 | |
| zaitcev | So | 21:26 |
| timburke | i seem to recall running into some issue with boto and eventlet interactions leading to a recursion problem in down in stdlib's ssl... even though i wasn't using https :-( | 21:26 |
| zaitcev | I still have the problem with duplicate keys even on all-py3 cluster. | 21:26 |
| zaitcev | metatest.txt: "X-Account-Meta-Uni\u00e0\u00b8\u0092": ["1", "1563926869.20886"], | 21:27 |
| zaitcev | metatest.txt: "X-Account-Meta-Uni\u0e12": ["1", "1563407142.42696"], | 21:27 |
| kota_ | curious | 21:27 |
| zaitcev | Unfortunately, it was a dirty experiment. I realized that I left a handoff db intact when I purged the meta with UPDATE account_stat SET metadata = ''; | 21:28 |
| timburke | oh, interesting... so you tried clearing everything out and running functests again, and it showed up again? | 21:28 |
| zaitcev | re-trying now | 21:29 |
| timburke | i still want to figure out what's going on there -- zaitcev, can we work on that after the meeting? | 21:29 |
| zaitcev | see, the timestamps are different now. So native is old, and the latin-1 is new, re-introduced by functests. I think it's a bad idea to store latin-1, actually... It's incompatible with py2 for sure. | 21:30 |
| *** e0ne has quit IRC | 21:30 | |
| timburke | i agree -- the wsgi-fied string is no good | 21:31 |
| *** mattw4 has joined #openstack-meeting | 21:31 | |
| timburke | let's keep moving for now | 21:32 |
| timburke | #topic lots of small files | 21:32 |
| zaitcev | I didn't have this problem with objects thus far. | 21:32 |
| *** openstack changes topic to "lots of small files (Meeting topic: swift)" | 21:32 | |
| zaitcev | ok | 21:32 |
| timburke | rledisez, kota_ anything new to report? | 21:32 |
| kota_ | sorry nothing new for me | 21:33 |
| timburke | that's fine! i just want to check in :-) | 21:33 |
| rledisez | timburke: not as I know. alecuyer is now off for 3 weeks | 21:33 |
| timburke | 👍 | 21:34 |
| timburke | #topic auto sharding | 21:34 |
| *** openstack changes topic to "auto sharding (Meeting topic: swift)" | 21:34 | |
| timburke | mattoliverau, i saw you rebased | 21:34 |
| mattoliverau | yeah | 21:35 |
| mattoliverau | I rebased the patch chain off the new ring info patch | 21:35 |
| mattoliverau | I've also been working on the sharder a bit more. | 21:35 |
| clayg | i think i missed the ring info patch - is it amazing!? | 21:36 |
| timburke | p 670673 | 21:36 |
| patchbot | https://review.opendev.org/#/c/670673/ - swift - ring: Track more properties of the ring - 3 patch sets | 21:36 |
| timburke | mattoliverau, need anything from us? or just reviews? ;-) | 21:36 |
| mattoliverau | Trying out the idea of when the scanner has scanned and checked that they are still the scanner, instead of just writing the shard ranges to their DB. It tries to UPDATE the shard ranges to the other primaries, if any succeed, it's safe to write locally. | 21:37 |
| mattoliverau | that way we always have at least 2 shard ranges out there. | 21:37 |
| mattoliverau | not 100% convinced, but thought about it yest to giving it a whirl. | 21:37 |
| timburke | interesting... | 21:38 |
| timburke | i'll try to take a look. not sure i can get to it this week though | 21:38 |
| timburke | #topic symlinks and versioning | 21:38 |
| *** openstack changes topic to "symlinks and versioning (Meeting topic: swift)" | 21:38 | |
| mattoliverau | I wanted to write down then replicate and then roll back (potentually if all failed) but you don't know if replication has happened in between. | 21:38 |
| timburke | #undo | 21:39 |
| mattoliverau | nps | 21:39 |
| openstack | Removing item from minutes: #topic symlinks and versioning | 21:39 |
| *** e0ne has joined #openstack-meeting | 21:39 | |
| mattoliverau | like I said, just thinking out loud and in code.. not 100% convinced :P | 21:39 |
| mattoliverau | I'll push up what I have today (I was meant to last night but forgot) | 21:39 |
| mattoliverau | now you can move on :P | 21:39 |
| clayg | p 633094 was done, but tdasilva was asking if we could figure out how to use x-etag-is-at headers on put to make hardlinks to slo's use the slo quoted etag instead of the manifest etag... | 21:40 |
| patchbot | https://review.opendev.org/#/c/633094/ - swift - Allow "harder" symlinks - 16 patch sets | 21:40 |
| timburke | heh, yeah -- i'm still torn, too. i'm not sure that non-leader should be the first one responsible for owning shard ranges... | 21:40 |
| timburke | #topic symlinks and versioning | 21:40 |
| *** openstack changes topic to "symlinks and versioning (Meeting topic: swift)" | 21:40 | |
| clayg | i started to rework the versions one on the assumption that hardlink target etag should be the manifest etag and while I mostly got that "working" there's still some knowledge about slo bleeding into versionsing 😞 | 21:41 |
| clayg | meanwhile I need to freshen up my s3-versions patch ontop of all this | 21:41 |
| clayg | so ... it's all pretty shaky | 21:41 |
| clayg | but also unfortunately pretty serialized - so I'll keep chugging and let ya'll good folks know when I think it's done, or closer, or I need a review or something | 21:42 |
| timburke | it's hard making sure that 3 dramatically different features all work together the "right" way | 21:42 |
| kota_ | thx for working s3 versioning! | 21:42 |
| timburke | thanks for working to make it all reasonable for the rest of us! | 21:42 |
| tdasilva | clayg: any way we can help atm? | 21:42 |
| clayg | yeah last week the subject of versinsing and object expiration came up? | 21:42 |
| clayg | basically we don't know how it really interacts and how symlinks will change that - or how it *should* work | 21:43 |
| *** brault has joined #openstack-meeting | 21:43 | |
| clayg | we thought maybe we should look at s3 bucket policies for versioned buckets and their expiration features to get an idea of what we would aim to support as s minimum subset | 21:43 |
| clayg | but I haven't done that - so someone could think about that | 21:44 |
| clayg | ^ tdasilva | 21:44 |
| clayg | but other than that, nothing I can think of | 21:44 |
| *** brault has quit IRC | 21:44 | |
| *** brault has joined #openstack-meeting | 21:44 | |
| tdasilva | fwiw, aws states that for s3 buckets can't have versioning and expiration policy together | 21:45 |
| tdasilva | gotta pick one or the other | 21:45 |
| timburke | interesting | 21:45 |
| timburke | but they have a way to expire old versions, no? | 21:46 |
| clayg | tdasilva: rly? do you have that reference handy - it's possible I don't understand which features those words map too | 21:46 |
| *** e0ne has quit IRC | 21:46 | |
| tdasilva | "You can use the Object Expiration feature on buckets that are stored using Standard or Reduced Redundancy Storage. You cannot, however, use it in conjunction with S3 Versioning (this is, as they say, for your own protection). You will have to delete all expiration rules for the bucket before enabling versioning on that bucket." | 21:47 |
| tdasilva | got it from here: https://aws.amazon.com/blogs/aws/amazon-s3-object-expiration/ | 21:47 |
| clayg | thanks! | 21:47 |
| tdasilva | but just noticed it's from 2011, maybe it has changed??? | 21:47 |
| tdasilva | i'll try it out tomorow | 21:47 |
| timburke | tdasilva, would you be able to get a summary of the state of policies and versioning (and any other relevant features) for next week? or just to drop in channel in the next day or two? | 21:48 |
| tdasilva | timburke: yep! | 21:48 |
| timburke | cool. i've got one more topic i'd like to bring up... | 21:48 |
| timburke | #topic 404s from handoffs | 21:48 |
| *** openstack changes topic to "404s from handoffs (Meeting topic: swift)" | 21:48 | |
| timburke | so i still need to write up a good bug to go with my patch, but... | 21:49 |
| timburke | #link https://review.opendev.org/#/c/672186/ | 21:49 |
| patchbot | patch 672186 - swift - Ignore 404s from handoffs for objects when calcula... - 4 patch sets | 21:49 |
| timburke | i had some complaints about an EC object not turning up | 21:50 |
| timburke | and it looked like we found some frags but not enough to reconstruct | 21:50 |
| timburke | so the proxy dug into handoffs and found a quorum's worth of 404s | 21:50 |
| timburke | this is somewhat related to https://bugs.launchpad.net/swift/+bug/1833612 but at the object level | 21:51 |
| openstack | Launchpad bug 1833612 in OpenStack Object Storage (swift) "Overloaded container can get erroneously cached as 404" [Undecided,Fix released] | 21:51 |
| timburke | but it looks like we have some pretty solid tests that explore the behavior and decided on 404 over 503 | 21:53 |
| mattoliverau | oh, so where there enough frags out there to reconstruct? | 21:55 |
| mattoliverau | and 404s just got quorum first? | 21:55 |
| timburke | if the servers weren't overloaded, yes | 21:56 |
| mattoliverau | just making sure :P | 21:57 |
| timburke | see https://github.com/openstack/swift/blob/2.22.0/test/unit/proxy/controllers/test_obj.py#L2118-L2150 for one of the tests i had to change (iirc) | 21:58 |
| timburke | we find frags, they're marked durable, but we go with a 404 ATM | 21:58 |
| timburke | i feel like i'm dramatically changing the way eventual consistency currently works for swift | 21:59 |
| timburke | please take a look at the patch if you get a chance | 21:59 |
| timburke | i'm afraid i let us run a bit long | 21:59 |
| notmyname | timburke: link the etherpad too | 21:59 |
| notmyname | #link https://etherpad.openstack.org/p/swift-fail-responses | 21:59 |
| kota_ | notmyname: ! | 21:59 |
| notmyname | kota_: !! | 22:00 |
| timburke | :-) thanks notmyname | 22:00 |
| timburke | but now we really *are* at time | 22:00 |
| timburke | #endmeeting | 22:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:00 | |
| openstack | Meeting ended Wed Jul 24 22:00:21 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-07-24-21.00.html | 22:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-07-24-21.00.txt | 22:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2019/swift.2019-07-24-21.00.log.html | 22:00 |
| *** patchbot has left #openstack-meeting | 22:00 | |
| *** zaitcev has left #openstack-meeting | 22:01 | |
| *** mattw4 has quit IRC | 22:12 | |
| *** mattw4 has joined #openstack-meeting | 22:16 | |
| *** slaweq has quit IRC | 22:45 | |
| *** iyamahat has quit IRC | 22:56 | |
| *** slaweq has joined #openstack-meeting | 23:11 | |
| *** carloss has quit IRC | 23:15 | |
| *** slaweq has quit IRC | 23:15 | |
| *** hongbin has quit IRC | 23:18 | |
| *** rcernin has joined #openstack-meeting | 23:30 | |
| *** iyamahat has joined #openstack-meeting | 23:38 | |
| *** mattw4 has quit IRC | 23:44 | |
| *** diablo_rojo has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!