| *** Liang__ has joined #openstack-meeting | 00:04 | |
| *** igordc has quit IRC | 00:06 | |
| *** slaweq has joined #openstack-meeting | 00:11 | |
| *** slaweq has quit IRC | 00:15 | |
| *** jmasud has quit IRC | 00:26 | |
| *** jmasud has joined #openstack-meeting | 00:28 | |
| *** maohongbo1 has joined #openstack-meeting | 00:31 | |
| *** maohongbo has quit IRC | 00:31 | |
| *** maohongbo1 is now known as maohongbo | 00:31 | |
| *** jmasud has quit IRC | 00:40 | |
| *** Liang__ has quit IRC | 00:46 | |
| *** Liang__ has joined #openstack-meeting | 00:48 | |
| *** epei has joined #openstack-meeting | 00:56 | |
| *** epei has quit IRC | 01:01 | |
| *** brinzhang has quit IRC | 01:02 | |
| *** brinzhang has joined #openstack-meeting | 01:02 | |
| *** zhangchi has joined #openstack-meeting | 01:06 | |
| zhangchi | #startmeeting tricircle | 01:07 |
|---|---|---|
| openstack | Meeting started Wed Feb 19 01:07:33 2020 UTC and is due to finish in 60 minutes. The chair is zhangchi. Information about MeetBot at http://wiki.debian.org/MeetBot. | 01:07 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 01:07 |
| *** openstack changes topic to " (Meeting topic: tricircle)" | 01:07 | |
| openstack | The meeting name has been set to 'tricircle' | 01:07 |
| *** slaweq has joined #openstack-meeting | 01:11 | |
| zhangchi | Moring All Welcome to tricircle bi-weekly meeting | 01:11 |
| *** slaweq has quit IRC | 01:15 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:17 | |
| *** jamesmcarthur has quit IRC | 01:39 | |
| *** jmasud has joined #openstack-meeting | 01:49 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:51 | |
| *** yamamoto has joined #openstack-meeting | 01:53 | |
| *** yamamoto has quit IRC | 01:53 | |
| zhangchi | #link https://etherpad.openstack.org/p/tricircle-ussuri-plan | 01:55 |
| zhangchi | Other Issuses please contact my IRC | 01:57 |
| zhangchi | #endmeeting | 01:57 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 01:57 | |
| openstack | Meeting ended Wed Feb 19 01:57:15 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 01:57 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/tricircle/2020/tricircle.2020-02-19-01.07.html | 01:57 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/tricircle/2020/tricircle.2020-02-19-01.07.txt | 01:57 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/tricircle/2020/tricircle.2020-02-19-01.07.log.html | 01:57 |
| *** yamamoto has joined #openstack-meeting | 01:57 | |
| *** jamesmcarthur has quit IRC | 02:01 | |
| *** zhangchi has quit IRC | 02:02 | |
| *** slaweq has joined #openstack-meeting | 02:11 | |
| *** ociuhandu has joined #openstack-meeting | 02:13 | |
| *** yamamoto has quit IRC | 02:15 | |
| *** slaweq has quit IRC | 02:16 | |
| *** yamamoto has joined #openstack-meeting | 02:16 | |
| *** ociuhandu has quit IRC | 02:17 | |
| *** Roamer` has quit IRC | 02:36 | |
| *** yamamoto has quit IRC | 02:38 | |
| *** yamamoto has joined #openstack-meeting | 02:42 | |
| *** larainema has joined #openstack-meeting | 02:42 | |
| *** yamamoto has quit IRC | 02:43 | |
| *** JangwonLee_ has joined #openstack-meeting | 02:44 | |
| *** hyunsikyang__ has joined #openstack-meeting | 02:44 | |
| *** yamamoto has joined #openstack-meeting | 02:45 | |
| *** JangwonLee has quit IRC | 02:46 | |
| *** hyunsikyang has quit IRC | 02:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 02:48 | |
| *** yamamoto has quit IRC | 02:49 | |
| *** hongbin has joined #openstack-meeting | 02:53 | |
| *** slaweq has joined #openstack-meeting | 03:11 | |
| *** slaweq has quit IRC | 03:16 | |
| *** yamamoto has joined #openstack-meeting | 03:21 | |
| *** hongbin has quit IRC | 03:23 | |
| *** jamesmcarthur has quit IRC | 03:26 | |
| *** psachin has joined #openstack-meeting | 03:35 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:48 | |
| *** enriquetaso has joined #openstack-meeting | 03:49 | |
| *** artom has quit IRC | 04:05 | |
| *** dmacpher has joined #openstack-meeting | 04:10 | |
| *** slaweq has joined #openstack-meeting | 04:11 | |
| *** jmasud has quit IRC | 04:12 | |
| *** jmasud has joined #openstack-meeting | 04:14 | |
| *** slaweq has quit IRC | 04:16 | |
| *** gyee has quit IRC | 04:20 | |
| *** lbragstad has quit IRC | 04:22 | |
| *** yamamoto has quit IRC | 04:36 | |
| *** enriquetaso has quit IRC | 04:42 | |
| *** vishalmanchanda has joined #openstack-meeting | 04:54 | |
| *** jamesmcarthur has quit IRC | 04:58 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:59 | |
| *** macz_ has quit IRC | 05:00 | |
| *** masahito has joined #openstack-meeting | 05:03 | |
| *** yamamoto has joined #openstack-meeting | 05:07 | |
| *** jamesmcarthur has quit IRC | 05:07 | |
| *** masahito has quit IRC | 05:08 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:10 | |
| *** slaweq has joined #openstack-meeting | 05:11 | |
| *** yamamoto has quit IRC | 05:12 | |
| *** yamamoto has joined #openstack-meeting | 05:15 | |
| *** slaweq has quit IRC | 05:16 | |
| *** masahito has joined #openstack-meeting | 05:19 | |
| *** masahito has quit IRC | 05:20 | |
| *** jamesmcarthur has quit IRC | 05:22 | |
| *** epei has joined #openstack-meeting | 05:22 | |
| *** masahito has joined #openstack-meeting | 05:25 | |
| *** epei has quit IRC | 05:27 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:28 | |
| *** jamesmcarthur has quit IRC | 05:32 | |
| *** links has joined #openstack-meeting | 05:35 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:08 | |
| *** slaweq has joined #openstack-meeting | 06:11 | |
| *** jamesmcarthur has quit IRC | 06:14 | |
| *** slaweq has quit IRC | 06:15 | |
| *** hongbin has joined #openstack-meeting | 06:23 | |
| *** hongbin has quit IRC | 06:28 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:30 | |
| *** brinzhang has quit IRC | 06:30 | |
| *** lajoskatona has joined #openstack-meeting | 06:31 | |
| *** brinzhang has joined #openstack-meeting | 06:31 | |
| *** masahito has quit IRC | 06:34 | |
| *** jamesmcarthur has quit IRC | 06:35 | |
| *** maohongbo1 has joined #openstack-meeting | 06:35 | |
| *** maohongbo has quit IRC | 06:37 | |
| *** maohongbo1 is now known as maohongbo | 06:37 | |
| *** yamamoto has quit IRC | 06:39 | |
| *** yamamoto has joined #openstack-meeting | 06:41 | |
| *** lajoskatona has left #openstack-meeting | 06:50 | |
| *** masahito has joined #openstack-meeting | 06:55 | |
| *** Lucas_Gray has joined #openstack-meeting | 06:58 | |
| *** openstack has joined #openstack-meeting | 07:18 | |
| *** ChanServ sets mode: +o openstack | 07:18 | |
| *** Lucas_Gray has quit IRC | 07:20 | |
| *** openstack has joined #openstack-meeting | 07:42 | |
| *** ChanServ sets mode: +o openstack | 07:42 | |
| *** maciejjozefczyk has joined #openstack-meeting | 07:47 | |
| *** slaweq has joined #openstack-meeting | 07:51 | |
| *** Lucas_Gray has quit IRC | 07:55 | |
| *** Lucas_Gray has joined #openstack-meeting | 07:57 | |
| *** tesseract has joined #openstack-meeting | 08:07 | |
| *** tetsuro has joined #openstack-meeting | 08:12 | |
| *** jmasud has quit IRC | 08:13 | |
| *** tetsuro__ has joined #openstack-meeting | 08:13 | |
| *** jmasud has joined #openstack-meeting | 08:14 | |
| *** tetsuro_ has quit IRC | 08:14 | |
| *** tetsuro has quit IRC | 08:16 | |
| *** tetsuro has joined #openstack-meeting | 08:17 | |
| *** yamamoto has quit IRC | 08:18 | |
| *** tetsuro__ has quit IRC | 08:21 | |
| *** mattia has quit IRC | 08:23 | |
| *** links has quit IRC | 08:24 | |
| *** takamatsu has quit IRC | 08:27 | |
| *** maohongbo has quit IRC | 08:30 | |
| *** maohongbo has joined #openstack-meeting | 08:30 | |
| *** jamesmcarthur has joined #openstack-meeting | 08:31 | |
| *** viks___ has quit IRC | 08:34 | |
| *** arne_wiebalck has quit IRC | 08:36 | |
| *** jamesmcarthur has quit IRC | 08:36 | |
| *** vishalmanchanda has quit IRC | 08:36 | |
| *** arne_wiebalck has joined #openstack-meeting | 08:37 | |
| *** vishalmanchanda has joined #openstack-meeting | 08:37 | |
| *** rpittau|afk is now known as rpittau | 08:37 | |
| *** yamamoto has joined #openstack-meeting | 08:53 | |
| *** ralonsoh has joined #openstack-meeting | 08:54 | |
| *** yamamoto has quit IRC | 08:58 | |
| *** lucasagomes has joined #openstack-meeting | 08:58 | |
| *** Lucas_Gray has quit IRC | 09:00 | |
| *** dougsz has joined #openstack-meeting | 09:00 | |
| *** links has joined #openstack-meeting | 09:01 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:07 | |
| *** ociuhandu has joined #openstack-meeting | 09:08 | |
| *** tetsuro_ has joined #openstack-meeting | 09:09 | |
| *** tetsuro has quit IRC | 09:09 | |
| *** viks___ has joined #openstack-meeting | 09:11 | |
| *** tetsuro has joined #openstack-meeting | 09:21 | |
| *** ociuhandu has quit IRC | 09:25 | |
| *** tetsuro_ has quit IRC | 09:25 | |
| *** ociuhandu has joined #openstack-meeting | 09:27 | |
| *** tetsuro has quit IRC | 09:27 | |
| *** masahito_ has joined #openstack-meeting | 09:30 | |
| *** masahito has quit IRC | 09:30 | |
| *** yamamoto has joined #openstack-meeting | 09:34 | |
| *** yamamoto has quit IRC | 09:37 | |
| *** e0ne has joined #openstack-meeting | 09:41 | |
| *** ociuhandu has quit IRC | 10:03 | |
| *** masahito has joined #openstack-meeting | 10:12 | |
| *** masahito_ has quit IRC | 10:12 | |
| *** masahito has quit IRC | 10:34 | |
| *** Lucas_Gray has quit IRC | 10:34 | |
| *** Lucas_Gray has joined #openstack-meeting | 10:38 | |
| *** yamamoto has joined #openstack-meeting | 10:51 | |
| *** yamamoto has quit IRC | 10:52 | |
| *** hyunsikyang has joined #openstack-meeting | 10:52 | |
| *** Lucas_Gray has quit IRC | 10:55 | |
| *** hyunsikyang__ has quit IRC | 10:55 | |
| *** hyunsikyang__ has joined #openstack-meeting | 10:56 | |
| *** hyunsikyang has quit IRC | 10:56 | |
| *** Lucas_Gray has joined #openstack-meeting | 10:58 | |
| *** slaweq has quit IRC | 11:06 | |
| *** yamamoto has joined #openstack-meeting | 11:09 | |
| *** slaweq has joined #openstack-meeting | 11:11 | |
| *** yamamoto has quit IRC | 11:13 | |
| *** maciejjozefczyk_ has joined #openstack-meeting | 11:13 | |
| *** maciejjozefczyk has quit IRC | 11:14 | |
| *** maciejjozefczyk_ has quit IRC | 11:14 | |
| *** maciejjozefczyk_ has joined #openstack-meeting | 11:14 | |
| *** epei has joined #openstack-meeting | 11:21 | |
| *** epei has quit IRC | 11:26 | |
| *** slaweq has quit IRC | 11:32 | |
| *** takamatsu has joined #openstack-meeting | 11:32 | |
| *** slaweq has joined #openstack-meeting | 11:34 | |
| *** rpittau is now known as rpittau|bbl | 11:40 | |
| *** raildo has joined #openstack-meeting | 11:42 | |
| *** yamamoto has joined #openstack-meeting | 11:59 | |
| *** Lucas_Gray has quit IRC | 12:02 | |
| *** takamatsu has quit IRC | 12:08 | |
| *** ociuhandu has joined #openstack-meeting | 12:10 | |
| *** ociuhandu has quit IRC | 12:11 | |
| *** jmasud has quit IRC | 12:11 | |
| *** ociuhandu has joined #openstack-meeting | 12:12 | |
| *** dmacpher has quit IRC | 12:12 | |
| *** dmacpher has joined #openstack-meeting | 12:13 | |
| *** takamatsu has joined #openstack-meeting | 12:13 | |
| *** jmasud has joined #openstack-meeting | 12:14 | |
| *** ociuhandu has quit IRC | 12:16 | |
| *** rfolco has joined #openstack-meeting | 12:18 | |
| *** Lucas_Gray has joined #openstack-meeting | 12:24 | |
| *** dmacpher has quit IRC | 12:27 | |
| *** dmacpher has joined #openstack-meeting | 12:27 | |
| *** rcernin has quit IRC | 12:37 | |
| *** rh-jelabarre has joined #openstack-meeting | 12:50 | |
| *** b3nt_pin has joined #openstack-meeting | 12:51 | |
| *** brinzhang_ has joined #openstack-meeting | 12:53 | |
| *** yamamoto has quit IRC | 12:53 | |
| *** brinzhang has quit IRC | 12:56 | |
| *** ysandeep is now known as ysandeep|away | 12:57 | |
| *** b3nt_pin is now known as beagles | 13:01 | |
| *** rpittau|bbl is now known as rpittau | 13:02 | |
| *** yamamoto has joined #openstack-meeting | 13:15 | |
| *** ykatabam has quit IRC | 13:16 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:17 | |
| *** ociuhandu has joined #openstack-meeting | 13:23 | |
| *** liuyulong has joined #openstack-meeting | 13:29 | |
| *** jamesmcarthur has quit IRC | 13:36 | |
| *** enriquetaso has joined #openstack-meeting | 13:44 | |
| *** lbragstad has joined #openstack-meeting | 13:47 | |
| *** jamesmcarthur has joined #openstack-meeting | 13:48 | |
| *** lbragsta_ has joined #openstack-meeting | 13:52 | |
| *** maciejjozefczyk_ is now known as maciejjozefczyk | 13:52 | |
| *** lbragstad has quit IRC | 13:54 | |
| *** Liang__ is now known as LiangFang | 13:58 | |
| *** eharney has joined #openstack-meeting | 13:59 | |
| *** sfernand has joined #openstack-meeting | 14:00 | |
| *** andrebeltrami has joined #openstack-meeting | 14:00 | |
| liuyulong | #startmeeting neutron_l3 | 14:01 |
| openstack | Meeting started Wed Feb 19 14:01:10 2020 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:01 | |
| openstack | The meeting name has been set to 'neutron_l3' | 14:01 |
| liuyulong | hi there | 14:01 |
| liuyulong | #topic Announcements | 14:01 |
| *** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 14:01 | |
| liuyulong | #link http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-02-17-21.00.log.html | 14:01 |
| liuyulong | Since we have networking team meeting, I may have no announcement here. | 14:02 |
| ralonsoh | hi | 14:02 |
| liuyulong | Just some reminding: https://etherpad.openstack.org/p/neutron-victoria-ptg | 14:03 |
| liuyulong | ralonsoh, hi | 14:03 |
| liuyulong | OK, let's move to next topic. | 14:04 |
| liuyulong | #topic Bugs | 14:04 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:05 | |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2020-February/012610.html | 14:05 |
| liuyulong | Akihiro Motoki was our bug deputy last week. | 14:05 |
| liuyulong | First one: | 14:06 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1863110 | 14:06 |
| openstack | Launchpad bug 1863110 in neutron "2/3 snat namespace transitions to master" [Undecided,New] | 14:06 |
| liuyulong | slaweq and haleyb|away had replied on the bug, maybe a bug from low version keepalived. | 14:08 |
| slaweq | hi, sorry for being late | 14:08 |
| slaweq | I have another meeting in the same time, so I will be only lurking here today, sorry | 14:08 |
| liuyulong | slaweq, sure, no worries | 14:09 |
| liuyulong | And the Marek Grudzinski had left the version of the keepalived, it is 1.3.9. | 14:10 |
| liuyulong | The version is higher than my test ENV. | 14:11 |
| liuyulong | So I guess maybe the VRRP heartbeats were dropped between the hosts for their LVS clusters. | 14:12 |
| liuyulong | I will leave this comment to the bug. | 14:12 |
| liuyulong | More about that could be: 1. security group rules | 14:14 |
| liuyulong | 2. port security | 14:14 |
| liuyulong | 3. allowed address pair | 14:14 |
| *** jamesmcarthur has quit IRC | 14:14 | |
| liuyulong | OK, let's filter the next one... | 14:15 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1863213 | 14:17 |
| openstack | Launchpad bug 1863213 in neutron "Spawning of DHCP processes fail: invalid netcat options" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:17 |
| liuyulong | I met this issue also. | 14:17 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1863830 | 14:17 |
| openstack | Launchpad bug 1863213 in neutron "duplicate for #1863830 Spawning of DHCP processes fail: invalid netcat options" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 14:17 |
| *** links has quit IRC | 14:18 | |
| ralonsoh | I reverted the patch merged | 14:18 |
| liuyulong | So I will try that revert locally. | 14:18 |
| ralonsoh | And I've submitted a patch to mark those tests as unstable | 14:18 |
| liuyulong | ralonsoh, yes, I just marked it as duplicated. | 14:19 |
| ralonsoh | I still need to know why, sometimes, the netcat rootwrap filters don't work | 14:19 |
| ralonsoh | most of the time do | 14:19 |
| liuyulong | I run dsvm-functional case locally, it fails 100% times. | 14:20 |
| liuyulong | http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%20%5C%22Exit%20code:%202%3B%20Stdin:%20%3B%20Stdout:%20%3B%20Stderr:%20Ncat:%20Invalid%20-w%20timeout%20(must%20be%20greater%20than%200).%20QUITTING.%5C%22 | 14:20 |
| *** lbragsta_ has quit IRC | 14:20 | |
| liuyulong | We have lots of these logs. | 14:20 |
| ralonsoh | that was solved in https://review.opendev.org/#/c/707786/ | 14:21 |
| liuyulong | ralonsoh, yes, I know that revert patch. : ) | 14:22 |
| liuyulong | I'm going to try that locally | 14:22 |
| *** Lucas_Gray has quit IRC | 14:24 | |
| liuyulong | Next one: | 14:24 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1863091 | 14:24 |
| openstack | Launchpad bug 1863091 in neutron "IPVS setup fails with openvswitch firewall driver, works with iptables_hybrid" [Undecided,New] | 14:24 |
| liuyulong | Alright, it is not so related to L3... | 14:25 |
| liuyulong | But I have to say for the LVS(ipvs) loadbalancer, it the mode was DR (direct routing), the LVS server and real server may have some config in different. | 14:26 |
| *** slaweq has quit IRC | 14:27 | |
| liuyulong | The LVS server (frontend) should disable the security group and port_security. | 14:27 |
| liuyulong | The real server (backend) should add allowed address pair with VIP, and set this VIP to the lo device. | 14:28 |
| liuyulong | OK, I will leave this to the bug. | 14:28 |
| liuyulong | OK, next one: | 14:30 |
| liuyulong | #link https://launchpad.net/bugs/1859832 | 14:30 |
| openstack | Launchpad bug 1859832 in neutron "L3 HA connectivity to GW port can be broken after reboot of backup node" [Medium,In progress] - Assigned to LIU Yulong (dragon889) | 14:30 |
| *** slaweq has joined #openstack-meeting | 14:30 | |
| liuyulong | I just want to add the fix from me here: | 14:31 |
| liuyulong | #link https://review.opendev.org/#/c/707406/ | 14:31 |
| liuyulong | A totally L3 side change for this bug. | 14:31 |
| *** jamesmcarthur has joined #openstack-meeting | 14:32 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 14:33 | |
| liuyulong | Just update and rebase the code. | 14:33 |
| liuyulong | OK, no more bugs from me then. | 14:33 |
| liuyulong | Any updates? | 14:33 |
| ralonsoh | no | 14:33 |
| liuyulong | OK, let's move on. | 14:35 |
| liuyulong | #topic OVN_L3 | 14:35 |
| *** openstack changes topic to "OVN_L3 (Meeting topic: neutron_l3)" | 14:35 | |
| ralonsoh | maciejjozefczyk, lucasagomes ping | 14:36 |
| *** jamesmcarthur has quit IRC | 14:36 | |
| ralonsoh | any update this week in OVN L3? | 14:36 |
| lucasagomes | hi there, I don't think I have any updates | 14:37 |
| lucasagomes | same as last week, we still having some problems while merging the functional tests patch | 14:37 |
| ralonsoh | just one topic: we are reviewing the extensions (including L3 ones) just to know which are really supported | 14:37 |
| ralonsoh | that's all from me | 14:38 |
| lucasagomes | oh yeah, that as well | 14:38 |
| liuyulong | I have on question: the migrated networking-ovn code in neutron repo can run full L2/L3 functionalities? | 14:40 |
| liuyulong | s/on/one | 14:40 |
| ralonsoh | dhcp, FIP, DVR, qos (partially)... | 14:41 |
| liuyulong | All have been aligned to networking-ovn? | 14:44 |
| ralonsoh | that is the goal | 14:44 |
| liuyulong | I mean no gaps between neutron-ovn (a temporary name) and networking-ovn? | 14:44 |
| liuyulong | OK | 14:44 |
| liuyulong | Thank you for the information. : ) | 14:45 |
| ralonsoh | yw | 14:45 |
| liuyulong | So we have a name for the OVN extensions/drivers/mechanism/plugins in Neutron? I just gave us one: neutron-ovn. : ) | 14:46 |
| ralonsoh | in L3 ovn-router | 14:47 |
| *** yamamoto has quit IRC | 14:48 | |
| *** TrevorV has joined #openstack-meeting | 14:48 | |
| liuyulong | https://review.opendev.org/#/q/topic:bp/neutron-ovn-merge+(status:open+OR+status:merged) so I will put eyes on this bp. | 14:48 |
| liuyulong | #link https://blueprints.launchpad.net/neutron/+spec/neutron-ovn-merge | 14:48 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1855912 | 14:49 |
| openstack | Launchpad bug 1855912 in neutron "MariaDB 10.1 fails during alembic migration" [High,Confirmed] | 14:49 |
| liuyulong | I have a question on this. | 14:49 |
| liuyulong | This could cause an upgrading issue if user try to update the neutron DB schema with 10.1 mariadb. | 14:51 |
| ralonsoh | yes | 14:51 |
| ralonsoh | no, not an upgrade | 14:51 |
| ralonsoh | but neutron server will fail during runtime | 14:51 |
| ralonsoh | sorry sorry, yes, during upgrade | 14:52 |
| ralonsoh | alembic migration | 14:52 |
| liuyulong | For a cloud deployment, we should warn users that they should check their DB version before upgrading neutron. | 14:53 |
| ralonsoh | we could add a sanity check | 14:53 |
| liuyulong | ralonsoh, yes, this could cause the upgrading failure. | 14:53 |
| liuyulong | ralonsoh, that's a good approach. | 14:54 |
| liuyulong | But anyway, if user need to upgrade the basic components, all there neutron server and agent may have a potential long down time. | 14:55 |
| *** eharney has quit IRC | 14:56 | |
| liuyulong | So I have another idea, something like the "--subproject" for neutron-db-manage. | 14:56 |
| *** irclogbot_0 has quit IRC | 14:56 | |
| liuyulong | If users' deployment is not OVN and will not upgrade to use OVN, so these tables will not be used. | 14:57 |
| *** artom has joined #openstack-meeting | 14:57 | |
| liuyulong | Maybe we could add a independent upgrade branch for OVN DB schemas only. | 14:57 |
| ralonsoh | liuyulong, not, but there are plenty of other tables that, by default, are not used | 14:57 |
| ralonsoh | no, this is a risk | 14:58 |
| ralonsoh | having different DB upgrade paths could lead to errors in a future | 14:58 |
| ralonsoh | due to convergence problems | 14:58 |
| ralonsoh | this is backend problem, not Neutron | 14:58 |
| ralonsoh | same as other problems in OVS, dnsmasq, iproute2, etc | 14:59 |
| ralonsoh | (time goes by so slowly) | 15:01 |
| liuyulong | ralonsoh, it is just like the current networking-ovn, vpnaas, fwaas, and so on. | 15:01 |
| liuyulong | We have no Xaas, so we have no tables for that. | 15:02 |
| *** irclogbot_3 has joined #openstack-meeting | 15:02 | |
| liuyulong | alright, time is up. | 15:02 |
| liuyulong | Let end here. | 15:03 |
| liuyulong | #endmeeting | 15:03 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:03 | |
| openstack | Meeting ended Wed Feb 19 15:03:06 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:03 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-02-19-14.01.html | 15:03 |
| liuyulong | bye guys! | 15:03 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-02-19-14.01.txt | 15:03 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-02-19-14.01.log.html | 15:03 |
| liuyulong | Thank you. | 15:03 |
| ralonsoh | bye | 15:03 |
| *** psachin has quit IRC | 15:09 | |
| *** lpetrut has quit IRC | 15:11 | |
| *** ociuhandu has quit IRC | 15:11 | |
| *** Lucas_Gray has joined #openstack-meeting | 15:11 | |
| *** ociuhandu has joined #openstack-meeting | 15:17 | |
| *** johanssone has quit IRC | 15:24 | |
| *** johanssone has joined #openstack-meeting | 15:27 | |
| *** lucasagomes has quit IRC | 15:28 | |
| *** priteau has joined #openstack-meeting | 15:32 | |
| *** lucasagomes has joined #openstack-meeting | 15:39 | |
| *** Trevor_V has joined #openstack-meeting | 15:40 | |
| *** eharney has joined #openstack-meeting | 15:40 | |
| *** Trevor__V has joined #openstack-meeting | 15:41 | |
| *** TrevorV has quit IRC | 15:43 | |
| *** Trevor_V has quit IRC | 15:44 | |
| *** ociuhandu_ has joined #openstack-meeting | 15:51 | |
| *** ociuhandu has quit IRC | 15:54 | |
| *** ociuhandu_ has quit IRC | 15:55 | |
| *** artom has quit IRC | 16:13 | |
| *** artom has joined #openstack-meeting | 16:13 | |
| *** TrevorV has joined #openstack-meeting | 16:13 | |
| *** Trevor__V has quit IRC | 16:15 | |
| *** ysandeep|away is now known as ysandeep | 16:17 | |
| *** ysandeep is now known as ysandeep|gone | 16:24 | |
| *** liuyulong has quit IRC | 16:24 | |
| *** TrevorV has quit IRC | 16:27 | |
| *** TrevorV has joined #openstack-meeting | 16:33 | |
| *** gyee has joined #openstack-meeting | 16:36 | |
| *** Lucas_Gray has quit IRC | 16:38 | |
| *** epei has joined #openstack-meeting | 16:44 | |
| *** rpittau is now known as rpittau|afk | 16:48 | |
| *** ociuhandu has joined #openstack-meeting | 16:48 | |
| *** ociuhandu has quit IRC | 16:52 | |
| *** mattw4 has joined #openstack-meeting | 16:54 | |
| *** epei has quit IRC | 16:56 | |
| *** epei has joined #openstack-meeting | 16:57 | |
| *** igordc has joined #openstack-meeting | 16:59 | |
| *** sfernand has quit IRC | 17:00 | |
| *** lucasagomes has quit IRC | 17:03 | |
| *** andrebeltrami has quit IRC | 17:10 | |
| *** jmasud has quit IRC | 17:12 | |
| *** nicolasbock has joined #openstack-meeting | 17:24 | |
| *** nicolasbock has quit IRC | 17:31 | |
| *** TrevorV has quit IRC | 17:33 | |
| *** nicolasbock has joined #openstack-meeting | 17:46 | |
| *** igordc has quit IRC | 17:46 | |
| *** dougsz has quit IRC | 17:51 | |
| *** jmasud has joined #openstack-meeting | 17:52 | |
| *** ociuhandu has joined #openstack-meeting | 17:53 | |
| *** ociuhandu has quit IRC | 17:59 | |
| *** e0ne has quit IRC | 18:00 | |
| *** TrevorV has joined #openstack-meeting | 18:01 | |
| *** jmasud has quit IRC | 18:04 | |
| *** epei has quit IRC | 18:09 | |
| *** jmasud has joined #openstack-meeting | 18:14 | |
| *** epei has joined #openstack-meeting | 18:18 | |
| *** jmasud has quit IRC | 18:18 | |
| *** igordc has joined #openstack-meeting | 18:22 | |
| *** witek has quit IRC | 18:25 | |
| *** priteau has quit IRC | 18:27 | |
| *** priteau has joined #openstack-meeting | 18:29 | |
| *** priteau has quit IRC | 18:33 | |
| *** jmasud has joined #openstack-meeting | 18:35 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:39 | |
| *** jmasud has quit IRC | 18:40 | |
| *** jamesmcarthur_ has quit IRC | 18:41 | |
| *** lajoskatona has joined #openstack-meeting | 18:46 | |
| *** larainema has quit IRC | 18:47 | |
| *** ralonsoh has quit IRC | 18:52 | |
| *** lajoskatona has quit IRC | 18:58 | |
| *** maciejjozefczyk has quit IRC | 19:02 | |
| *** vishalmanchanda has quit IRC | 19:11 | |
| *** tesseract has quit IRC | 19:16 | |
| *** lajoskatona has joined #openstack-meeting | 19:33 | |
| *** lajoskatona has quit IRC | 19:40 | |
| *** eharney has quit IRC | 19:56 | |
| *** jamesmcarthur has quit IRC | 20:06 | |
| *** eharney has joined #openstack-meeting | 20:08 | |
| *** ociuhandu has joined #openstack-meeting | 20:12 | |
| *** ociuhandu has quit IRC | 20:16 | |
| *** ociuhandu has joined #openstack-meeting | 20:24 | |
| *** epei has quit IRC | 20:25 | |
| *** jmasud has joined #openstack-meeting | 20:27 | |
| *** ociuhandu has quit IRC | 20:31 | |
| *** ociuhandu has joined #openstack-meeting | 20:31 | |
| *** eharney has quit IRC | 20:53 | |
| timburke | #startmeeting swift | 21:00 |
| openstack | Meeting started Wed Feb 19 21:00:11 2020 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| rledisez | hi o/ | 21:00 |
| seongsoocho | o/ | 21:00 |
| kota_ | o/ | 21:00 |
| mattoliverau | o/ | 21:01 |
| *** zaitcev has joined #openstack-meeting | 21:01 | |
| timburke | as always, agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:02 |
| timburke | #topic vancouver | 21:02 |
| *** openstack changes topic to "vancouver (Meeting topic: swift)" | 21:02 | |
| timburke | so first off, a reminder that the PTG in vancouver is coming up | 21:02 |
| timburke | June 8-11 | 21:02 |
| timburke | #link https://www.openstack.org/events/opendev-ptg-2020/ | 21:02 |
| timburke | the foundation's looking for some attendance estimations, so if you know you're going to be going, that'd be nice for me to know! | 21:03 |
| zaitcev | Well, I plan to go. | 21:04 |
| zaitcev | FWIW | 21:04 |
| seongsoocho | I will go there. | 21:04 |
| zaitcev | Never a given at my age. | 21:04 |
| kota_ | planning (not yeg got approval) | 21:05 |
| timburke | it looks like i *won't* be able to go (my wife has her own conference that week, and i figure i owe her one) but i'm happy to make sure that there's space for swifters and help with any planning | 21:05 |
| rledisez | For me and alecuyer, no approval yet | 21:05 |
| clayg | 🎉??? | 21:06 |
| clayg | if seongsoocho is gunna go I wanna go | 21:06 |
| seongsoocho | wow.. 🙂 | 21:06 |
| *** jamesmcarthur has joined #openstack-meeting | 21:07 | |
| mattoliverau | There might be a meeting in NUE at the suse office around that time. If it doesn't clash, then I might see if I can apply for travel support :) | 21:07 |
| *** jamesmcarthur has quit IRC | 21:07 | |
| clayg | kota_: everyone in the swiftstack office is all about https://events.static.linuxfound.org/sites/events/files/slides/linuxcon15_bando.pdf | 21:07 |
| *** jamesmcarthur has joined #openstack-meeting | 21:07 | |
| timburke | should we plan on requesting an ops feedback session again? i feel like that was nice in shanghai | 21:07 |
| clayg | kota_: so if you could lookup Yuichi Bando in the company directory and send him a virtual high five that'd be awesome! | 21:07 |
| kota_ | OH | 21:08 |
| clayg | timburke: I feel like I remember prior-to-shanghai ops feedback sessions way better than shanghai | 21:08 |
| timburke | fair enough | 21:08 |
| clayg | ... we were all just in that one room? were their ops people that came by at some point? | 21:08 |
| kota_ | IIRC... he left... | 21:09 |
| clayg | kota_: well... his legacy lives on! | 21:09 |
| clayg | timburke: or no, there WAS an ops session in one of the speaking rooms - seperate from the PTG | 21:09 |
| kota_ | that sounds awesome. good to know | 21:09 |
| timburke | clayg, maybe it could just be done as some set-aside time in the working sessions, then | 21:09 |
| timburke | *shrug* | 21:09 |
| clayg | only it was mostly like just us | 21:09 |
| timburke | yeah, we wrote some stuff down at least: https://etherpad.openstack.org/p/PVG-swift-ops-feedback | 21:10 |
| clayg | no no, I do remember that now - there was a couple of people in there... | 21:10 |
| timburke | i think sorrison came by and wouldn't have necessarily done so for just the working sessions | 21:11 |
| timburke | anyway, something to think about: do you guys want one, and if so, who would like to lead it | 21:11 |
| clayg | timburke: yes I 100% agree, I just forgot - the ops sessions are great and we should definately have another one not just the working sessions | 21:12 |
| timburke | 👍 | 21:12 |
| clayg | seongsoocho: could be the MC like "I run swift, it's not my LEAST favorite piece of software - how about y'all?" | 21:12 |
| timburke | anyway, i think that's all i've got for vancouver -- thanks zaitcev, seongsoocho for the solid yes, and kota_, rledisez, alecuyer, clayg, mattoliverau for the tenative maybes ;-) | 21:14 |
| timburke | i figure by the time i need to actually get a response in, we'll all know a bit more about what's approved | 21:14 |
| timburke | #topic swiftclient release | 21:15 |
| *** openstack changes topic to "swiftclient release (Meeting topic: swift)" | 21:15 | |
| timburke | (sorry, a little out of order) | 21:15 |
| timburke | so, we had one! there's a 3.9.0 now | 21:15 |
| diablo_rojo | timburke, we will miss you | 21:15 |
| timburke | this was actually kinda unplanned; milestone 2 came up and i forgot that we need to get a client library out by then | 21:15 |
| timburke | but i *would* like to get another out in the not-too-distant future! | 21:16 |
| timburke | in particular to pick up versioning support | 21:16 |
| timburke | #link https://review.opendev.org/#/c/691877/ | 21:16 |
| timburke | and symlink support | 21:17 |
| timburke | #link https://review.opendev.org/#/c/694211/ | 21:17 |
| zaitcev | Well poke tdasilva with a physical stick | 21:17 |
| timburke | charz has apparently been rather busy :-) i'm also pretty excited about the ideas in https://review.opendev.org/#/c/707409/ | 21:18 |
| timburke | the filtering in https://review.opendev.org/#/c/708074/ is kind of interesting, too, and probably closer to mergable | 21:19 |
| clayg | zaitcev: can you make a summary of the debate about the interface for symlink support? | 21:19 |
| *** jamesmcarthur has quit IRC | 21:19 | |
| timburke | and i remember people specifically asking for keystone credential support in shanghai, so https://review.opendev.org/#/c/699457/ might be good | 21:20 |
| clayg | zaitcev: I remember thinking when I looked at it that the interface did not at a glance resemble the existing copy command (which I thought it reasonably MIGHT) | 21:20 |
| zaitcev | clayg: swift link [--cont2=c2] c a b versus swift link c1 a c2 b | 21:20 |
| clayg | so i'm not sure if things have moved to "no it's just like copy now" or "copy was wrong; and this is better" | 21:20 |
| clayg | ... or maybe even "why would creating a link be like copying?!" | 21:21 |
| zaitcev | A pinnacle of byteshedding. Although, I recall that Tim told me that we already have something like it, like "swift copy" so maybe we should just be consistent with that. | 21:21 |
| *** jamesmcarthur has joined #openstack-meeting | 21:21 | |
| kota_ | sounds reasonable | 21:23 |
| clayg | ok so maybe that one isn't done yet | 21:24 |
| clayg | the versioning one is GTG I think, and I'd love to have it | 21:24 |
| timburke | i'll find some time to review it this week | 21:25 |
| timburke | anything else to bring up with regard to swiftclient? | 21:25 |
| *** jamesmcarthur has quit IRC | 21:26 | |
| timburke | #topic EC gets and long tail latency | 21:27 |
| *** openstack changes topic to "EC gets and long tail latency (Meeting topic: swift)" | 21:27 | |
| timburke | so we here at swiftstack have a customer very interested in bringing down their 99.9%tile latencies | 21:27 |
| timburke | we realized that even though they had concurrent gets turned on, it wasn't actually helping, because all the data was EC'ed | 21:28 |
| *** raildo has quit IRC | 21:28 | |
| timburke | and the way that works is we spin up ndata connections, then wait up to node_timeout for them to indicate they're ready before ever spinning up any alternate connections | 21:29 |
| timburke | so we had this real interesting distribution of request timings where you'd see a big peak close to zero, then a pretty smooth drop-off until you got to node_timeout | 21:30 |
| clayg | and so if you have a "slow" frag it slows down the whole mess | 21:30 |
| clayg | timburke: were we able to isolate any of those specific requests up there around node_timeout and look at logs validate there was a XXXms fragment GET after a Xs node_timeout? | 21:31 |
| timburke | at which point you got another peak and drop-off until 2x node_timeout, at which point you've got one more little peak and only a smattering of longer requests | 21:31 |
| timburke | clayg, haven't yet; probably a good idea to validate assumptions | 21:32 |
| timburke | so i guess i've got two main questions for people | 21:32 |
| timburke | 1) has anyone else noticed this sort of behavior? got any users complaining about latencies? | 21:33 |
| timburke | and 2) how *should* it behave? spin up ndata+nparity connections immediately and wait for ndata? spin up ndata then have the concurrency_timeout behavior we currently have with replicated? should there be any special logic around handoff nodes? | 21:34 |
| rledisez | 1/ not really. yes we clearly see the ttfb is higher on EC than replica, but we didn't really investigate because by design our EC policy will be slower (and we didn't get complain from our users) | 21:35 |
| rledisez | 2/ i don't want that the proxy reach all nodes immediately because it will have an impact in terms of IO. it would be ok if the IO cost was nearly zero (aka storing meta on a faster device) | 21:35 |
| zaitcev | Fascinating. | 21:36 |
| rledisez | but as we are considering droping replica and move all EC, this is clearly a topic i'm interested in | 21:36 |
| mattoliverau | How long does it normall take for a node to become "ready" | 21:36 |
| mattoliverau | does it take node_timeout | 21:36 |
| mattoliverau | or can we use conn_timeout like in default concurrency | 21:36 |
| mattoliverau | *default concurrency timeout | 21:37 |
| mattoliverau | So their staggered, but not waiting too long. | 21:37 |
| clayg | mattoliverau: I think defaulting concurrent gets to conn_timeout has proven to be absolutely brilliant and has undoubtly smoothed out latency tails on replicated GETs | 21:37 |
| clayg | rledisez: I 100% agree that use-case expectation setting for "replicated is faster ttfb" proves out for the data - and I don't believe this deployment has dont A/B comparison to quantify that | 21:38 |
| clayg | rledisez: OTOH, if we can do a good job translating what mattoliverau taught us when implementing concurrent gets for replicated it's possible that difference could be diminished | 21:39 |
| timburke | fwiw, i've got a smallish log sample where 50% are <100ms, 90% are <600ms, and 99% are <2s | 21:40 |
| rledisez | i agree it looks like the right way to do it, especially since it's configurable, operators can choose to be aggressive or not on the timeout | 21:41 |
| timburke | (though i maybe need to clean that up, i don't think i filtered it to only look at object gets) | 21:41 |
| timburke | one thought that i'd had was to wait until we have max(0, ndata-nparity) connection in hand before switching to the concurrent-get behavior, but maybe that's just over-complicating things | 21:42 |
| mattoliverau | Sounds like conn_timeout a first thing to try and see how it goes. worst case is we get less of a tail and more connections.. which isn't great, but might be ok. Conn timeout defaults at 0.5 so might catch 90% of cases if were lucky. | 21:42 |
| timburke | and i *think* https://review.opendev.org/#/c/706361/ might help with the extra connections -- we were definitely seeing connections on the proxy that would hang around well past the client response on the same cluster... | 21:44 |
| timburke | anyway, just wanted to let people know about some of the stuff we've been poking at lately | 21:46 |
| timburke | #topic open discussion | 21:46 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:46 | |
| timburke | what else would people like to bring up? | 21:46 |
| clayg | 👍 we can trivially demonstrate in unittests and development that those greenthreads spawned and abandoned from the proxy after the client response goes through are still running and will finish | 21:46 |
| zaitcev | So, anyone wants to help out with that dark data thing? Romain, you had an opinion about the separation. | 21:47 |
| clayg | we leverage this behavior on purpose in the object-server with the container-update-timeout | 21:47 |
| zaitcev | Unfortunately, Sam left for Google, so I cannot debate him. He typically knew what he was doing about this, so I'm not very happy to conclude that he was wrong. https://review.opendev.org/706653 | 21:48 |
| clayg | mattoliverau: so for waterfall-ec your suggestion is spawn ec_ndata connections like we currently do, then use concurrent_gets to wait up to concurrency_timeout (defaults to connection timeout) before spawning more requests | 21:49 |
| rledisez | on the replace-md5-for-checksum side, I'm planning to put as a requirement, before the operator decide to use something else than md5 for checksum, that he must ensure that the whole cluster is upgraded to the right version. is that ok for everybody? i don't think it's possible to just let the proxy do its best to guess if it should use md5 or something else | 21:49 |
| rledisez | zaitcev: do you have a pointer on the dark-data thing? (bugreport, review, …) | 21:49 |
| clayg | mattoliverau: I assume like replicated concurrent gets we'd stop spawning once we get into handoffs until we get an non-success (maybe timeout) response from a primary | 21:50 |
| timburke | zaitcev, i think he had a goal of allowing marginally-trusted code to run; if we're content to say "you wan to run this? make sure it's stable!" i think i'd probably be ok with the simpler approach | 21:50 |
| mattoliverau | clayg: yeah, then we also dog food the same settings on EC and REPL. But of course, only brain storming atm | 21:51 |
| zaitcev | rledisez: I had a couple of cases where the loss of capacity was significant. It always was associated with some kind of catastrophic mismanagement by the operator: a bothched restore from a backup, or having half of the drives go down. | 21:51 |
| timburke | rledisez, https://review.opendev.org/#/c/706653/ i believe | 21:51 |
| clayg | so if we have a 4+2, we spawn 4, then 500ms later if we're still waiting on at least 2 of the 4 responses - we spawn 2 more | 21:52 |
| mattoliverau | yup | 21:52 |
| mattoliverau | then the ndata get a chance to give use the goods, and if not we can fall back to a rebuild. but not go searching handoffs.. though I guess we could | 21:52 |
| zaitcev | rledisez: I am comfortable to think that OVH or RAX aren't going to have any dark data even if clusters are heavily loaded. It's just that Red Hat sells this private cloud solution to people who don't care about running their clusters, and so this happens regularly. | 21:52 |
| mattoliverau | worst case, other then connections, we may get a frag back. | 21:53 |
| timburke | rledisez, on the hashing, yeah, that seems reasonable -- rather like what we documented for turning on encryption in an existing cluster | 21:53 |
| clayg | mattoliverau: I think the code is going to be fairly amicable to that change, thanks for thinking through it | 21:53 |
| rledisez | zaitcev: I'm pretty confident we have dark data hanging around :) but probably nothing massive. don't forget that container may not be up2date immediately, so you should allow a delay before checking the container server | 21:55 |
| *** jamesmcarthur has joined #openstack-meeting | 21:56 | |
| rledisez | I don't really like that because I can't imagine how long it would take, but I don't have any better option. if there is async_pendings somewhere, you might end up deleting valid object | 21:56 |
| clayg | zaitcev: same here, it's unfortunately all to human to have "some kind of catastrophic mismanagement by the operator" 😁 | 21:56 |
| zaitcev | Yeah... It can be stuck in an update somewhere | 21:57 |
| clayg | rledisez: on the md5 thing - i'm not sure I follow how you're suggesting we *enforce* "make sure your whole cluster is upgraded" | 21:57 |
| seongsoocho | rledisez: In my cluster, The swift proxy-server support multiple checksum. Some container use md5 for checksum and some container use SHA256 for checksum. The customer wants to choose the checksum.. | 21:57 |
| zaitcev | The main problem I'm having with this isolation thing is the throttling | 21:58 |
| *** jamesmcarthur has quit IRC | 21:58 | |
| rledisez | clayg: we can't enforce it, but we can write in the changelog/doc "if you don't do it, you'll be in trouble" | 21:58 |
| clayg | seongsoocho: !!! that's awesome! It's possible you avoided some of the hard problems rledisez is trying to solve - but I think generally that's the idea we'd like to support | 21:58 |
| zaitcev | My container servers are on rotating storage and they are slower than object auditors at times. | 21:58 |
| *** jamesmcarthur has joined #openstack-meeting | 21:58 | |
| timburke | seongsoocho, whoa, cool! is that stored in the container db, too, or just used for etags, or something else? i'm sad i won't be in vancouver to ask you more about it in person! | 21:58 |
| clayg | seongsoocho: i'm guessing there's at least proxy middleware to handle setting sysmeta? How much can you share? | 21:59 |
| zaitcev | So, very soon you start skipping on the checks. No big deal, just recheck on next pass, right | 21:59 |
| seongsoocho | timburke: It just used for etags . | 21:59 |
| seongsoocho | clayg: I try to write the details on etherpad as soon as possible. | 22:00 |
| zaitcev | Well, but now suppose it says that you have 0.03% capacity used up by dark data. Is that trustworthy? But one other thing is, with these separate processes everything is harder to analyze. | 22:00 |
| clayg | zaitcev: oh, ok, so but the "audit_dark_data" example watcher is new - sam's original design didn't include a concrete example? | 22:01 |
| timburke | all right, looks like we're about out of time -- but we can keep chatting in -swift for sure! | 22:01 |
| timburke | (sorry, not sure if there's anyone who'd be waiting on the room) | 22:01 |
| timburke | thank you all for coming, and thank you for working on swift! | 22:01 |
| timburke | #endmeeting | 22:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 22:02 | |
| openstack | Meeting ended Wed Feb 19 22:01:59 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 22:02 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-02-19-21.00.html | 22:02 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-02-19-21.00.txt | 22:02 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-02-19-21.00.log.html | 22:02 |
| zaitcev | And finally, the straw that overflowed that cup for me: I wrote a test and I needed to verify logging. It was a hell on a stick to extract from those isolation processes. I wrote some stupid thing that dumped into files. I completed it, it's in a separate review. So it can be done. But whyyyyyyy, Sam | 22:02 |
| zaitcev | ok | 22:02 |
| *** zaitcev has left #openstack-meeting | 22:03 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 22:09 | |
| *** jamesmcarthur has quit IRC | 22:13 | |
| *** ykatabam has joined #openstack-meeting | 22:14 | |
| *** TrevorV has quit IRC | 22:21 | |
| *** eharney has joined #openstack-meeting | 22:21 | |
| *** slaweq has quit IRC | 22:29 | |
| *** ociuhandu has quit IRC | 22:38 | |
| *** slaweq has joined #openstack-meeting | 22:40 | |
| *** slaweq has quit IRC | 22:45 | |
| *** enriquetaso has quit IRC | 22:53 | |
| *** rcernin has joined #openstack-meeting | 23:04 | |
| *** rh-jelabarre has quit IRC | 23:06 | |
| *** ysandeep|gone is now known as ysandeep | 23:27 | |
| *** jamesmcarthur_ has quit IRC | 23:32 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:33 | |
| *** jamesmcarthur has quit IRC | 23:39 | |
| *** ociuhandu has joined #openstack-meeting | 23:45 | |
| *** eharney has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!