Wednesday, 2020-06-24

*** diurnalist has quit IRC00:02
*** martial has quit IRC00:04
*** ttsiouts has quit IRC00:16
*** armax has joined #openstack-meeting00:29
*** jamesmcarthur has joined #openstack-meeting00:30
*** yasufum has joined #openstack-meeting00:30
*** yasufum has quit IRC00:35
*** yasufum has joined #openstack-meeting00:35
*** diurnalist has joined #openstack-meeting00:37
*** jamesmcarthur has quit IRC00:50
*** jamesmcarthur has joined #openstack-meeting00:51
*** jamesmcarthur has quit IRC00:58
*** diablo_rojo has quit IRC01:01
*** diurnalist has quit IRC01:05
*** rcernin has quit IRC01:12
*** jamesmcarthur has joined #openstack-meeting01:14
*** rcernin has joined #openstack-meeting01:18
*** Liang__ has joined #openstack-meeting01:18
*** ttsiouts has joined #openstack-meeting01:22
*** jamesmcarthur has quit IRC01:23
*** markvoelker has joined #openstack-meeting01:30
*** Liang__ has quit IRC01:32
*** Liang__ has joined #openstack-meeting01:33
*** markvoelker has quit IRC01:35
*** yasufum has quit IRC01:38
*** yamamoto has joined #openstack-meeting01:40
*** jamesmcarthur has joined #openstack-meeting01:42
*** hyunsikyang__ has joined #openstack-meeting01:44
*** hyunsikyang has quit IRC01:47
*** Liang__ has quit IRC01:47
*** jamesmcarthur has quit IRC01:50
*** tetsuro has joined #openstack-meeting01:52
*** yasufum has joined #openstack-meeting01:55
*** ttsiouts has quit IRC01:55
*** yamamoto has quit IRC02:04
*** jamesmcarthur has joined #openstack-meeting02:11
*** jamesmcarthur has quit IRC02:11
*** jamesmcarthur has joined #openstack-meeting02:11
*** rcernin has quit IRC02:34
*** rcernin has joined #openstack-meeting02:37
*** yamamoto has joined #openstack-meeting02:37
*** b1airo has quit IRC02:42
*** rbudden has quit IRC02:51
*** rbudden has joined #openstack-meeting02:51
*** rbudden has quit IRC02:52
*** rbudden has joined #openstack-meeting02:52
*** rbudden has quit IRC02:53
*** rbudden has joined #openstack-meeting02:53
*** rbudden has quit IRC02:53
*** rbudden has joined #openstack-meeting02:54
*** rbudden has quit IRC02:54
*** rbudden has joined #openstack-meeting02:55
*** rbudden has quit IRC02:55
*** rbudden has joined #openstack-meeting02:55
*** rbudden has quit IRC02:56
*** rbudden has joined #openstack-meeting02:56
*** rbudden has quit IRC02:56
*** jamesmcarthur has quit IRC02:57
*** rbudden has joined #openstack-meeting02:57
*** rbudden has quit IRC02:57
*** jamesmcarthur has joined #openstack-meeting03:02
*** ttsiouts has joined #openstack-meeting03:02
*** rfolco has quit IRC03:09
*** markvoelker has joined #openstack-meeting03:31
*** ttsiouts has quit IRC03:32
*** markvoelker has quit IRC03:36
*** psachin has joined #openstack-meeting03:42
*** rcernin has quit IRC03:46
*** rbudden has joined #openstack-meeting03:48
*** masahito has joined #openstack-meeting03:51
*** rcernin has joined #openstack-meeting03:55
*** ttsiouts has joined #openstack-meeting04:02
*** rcernin has quit IRC04:04
*** rcernin has joined #openstack-meeting04:05
*** ttsiouts has quit IRC04:07
*** masahito has quit IRC04:13
*** rbudden has quit IRC04:13
*** yasufum has quit IRC04:13
*** masahito has joined #openstack-meeting04:15
*** masahito has quit IRC04:20
*** jamesmcarthur has quit IRC04:31
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-meeting04:33
*** markvoelker has joined #openstack-meeting04:34
*** jamesmcarthur has joined #openstack-meeting04:37
*** Lucas_Gray has quit IRC04:38
*** markvoelker has quit IRC04:39
*** apetrich has quit IRC04:43
*** yasufum has joined #openstack-meeting04:44
*** ttsiouts has joined #openstack-meeting04:44
*** rh-jelabarre has quit IRC04:47
*** jamesmcarthur has quit IRC04:58
*** jamesmcarthur has joined #openstack-meeting04:58
*** dklyle has quit IRC04:58
*** yasufum has quit IRC05:00
*** yasufum has joined #openstack-meeting05:00
*** diurnalist has joined #openstack-meeting05:01
*** jamesmcarthur has quit IRC05:04
*** diurnalist has quit IRC05:06
*** ttsiouts has quit IRC05:17
*** links has joined #openstack-meeting05:19
*** jamesmcarthur has joined #openstack-meeting05:33
*** bbowen has quit IRC05:34
*** bbowen_ has joined #openstack-meeting05:34
*** jamesmcarthur has quit IRC05:42
*** jamesdenton has quit IRC05:52
*** jamesdenton has joined #openstack-meeting06:00
*** slaweq_ has joined #openstack-meeting06:12
*** jamesmcarthur has joined #openstack-meeting06:13
*** slaweq has quit IRC06:13
*** markvoelker has joined #openstack-meeting06:14
*** markvoelker has quit IRC06:20
*** jamesmcarthur has quit IRC06:22
*** ttsiouts has joined #openstack-meeting06:30
*** manuvakery has joined #openstack-meeting06:46
*** gyee has quit IRC06:51
*** ralonsoh has joined #openstack-meeting06:55
*** rpittau|afk is now known as rpittau06:57
*** ttsiouts has quit IRC07:05
*** ttsiouts has joined #openstack-meeting07:11
*** ykatabam has quit IRC07:28
*** maciejjozefczyk has joined #openstack-meeting07:29
*** ykatabam has joined #openstack-meeting07:30
*** ykatabam has quit IRC07:32
*** vishalmanchanda has joined #openstack-meeting07:33
*** rcernin has quit IRC07:39
*** namrata has joined #openstack-meeting07:40
*** dmellado has joined #openstack-meeting07:43
*** priteau has joined #openstack-meeting07:48
*** belmoreira has joined #openstack-meeting07:49
*** slaweq_ is now known as slaweq07:49
*** Lucas_Gray has joined #openstack-meeting07:52
*** belmoreira has quit IRC08:08
*** belmoreira has joined #openstack-meeting08:08
*** markvoelker has joined #openstack-meeting08:16
*** jamesmcarthur has joined #openstack-meeting08:18
*** markvoelker has quit IRC08:21
*** jamesmcarthur has quit IRC08:23
*** mdelavergne has joined #openstack-meeting08:32
*** apetrich has joined #openstack-meeting08:43
*** ttsiouts has quit IRC08:50
*** ttsiouts has joined #openstack-meeting08:50
*** ttsiouts has quit IRC08:55
*** manuvakery has quit IRC09:06
*** ttsiouts has joined #openstack-meeting09:09
*** namrata has quit IRC09:10
*** e0ne has joined #openstack-meeting09:23
*** moguimar has joined #openstack-meeting09:41
*** markvoelker has joined #openstack-meeting10:05
*** dmacpher_ has quit IRC10:08
*** markvoelker has quit IRC10:09
*** rcernin has joined #openstack-meeting10:10
*** yasufum has quit IRC10:11
*** rpittau is now known as rpittau|bbl10:11
*** dmacpher has joined #openstack-meeting10:13
*** ociuhandu has quit IRC10:14
*** rcernin has quit IRC10:15
*** jamesmcarthur has joined #openstack-meeting10:20
*** jamesmcarthur has quit IRC10:32
*** psachin has quit IRC10:57
*** ttsiouts has quit IRC11:16
*** ttsiouts has joined #openstack-meeting11:17
*** ttsiouts_ has joined #openstack-meeting11:18
*** raildo has joined #openstack-meeting11:21
*** ttsiouts has quit IRC11:22
*** rcernin has joined #openstack-meeting11:28
*** rcernin has quit IRC11:34
*** rcernin has joined #openstack-meeting11:40
*** rh-jelabarre has joined #openstack-meeting11:44
*** mdelavergne has quit IRC11:49
*** ociuhandu has joined #openstack-meeting11:52
*** markvoelker has joined #openstack-meeting11:55
*** markvoelker has quit IRC11:59
*** rcernin has quit IRC12:08
*** rfolco has joined #openstack-meeting12:11
*** rpittau|bbl is now known as rpittau12:13
*** yaawang has quit IRC12:20
*** jamesmcarthur has joined #openstack-meeting12:29
*** jamesmcarthur has quit IRC12:34
*** rcernin has joined #openstack-meeting12:36
*** rbudden has joined #openstack-meeting12:50
*** diurnalist has joined #openstack-meeting13:00
*** andrebeltrami has joined #openstack-meeting13:01
*** diurnalist has quit IRC13:04
*** jawad_axd has quit IRC13:18
*** jawad_axd has joined #openstack-meeting13:18
*** rcernin has quit IRC13:29
*** ociuhandu_ has joined #openstack-meeting13:31
*** ociuhandu has quit IRC13:35
*** dklyle has joined #openstack-meeting13:49
*** yaawang has joined #openstack-meeting13:51
*** TrevorV has joined #openstack-meeting13:54
*** Liang__ has joined #openstack-meeting13:56
*** Liang__ is now known as LiangFang13:57
*** liuyulong has joined #openstack-meeting14:06
liuyulong#startmeeting neutron_l314:06
openstackMeeting started Wed Jun 24 14:06:57 2020 UTC and is due to finish in 60 minutes.  The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot.14:06
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:06
*** openstack changes topic to " (Meeting topic: neutron_l3)"14:07
openstackThe meeting name has been set to 'neutron_l3'14:07
liuyulongsorry, a bit late14:07
liuyulong#chair haleyb14:07
openstackCurrent chairs: haleyb liuyulong14:07
liuyulong#chair slaweq14:08
openstackCurrent chairs: haleyb liuyulong slaweq14:08
slaweqhi14:08
haleybhi14:08
liuyulongJust in case...14:08
liuyulongHi14:08
liuyulong#link http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-06-22-21.00.log.html#l-1114:09
* haleyb is in a conflicting meeting so please use my nick if i don't respond14:09
liuyulongI have no announcement today. So the team Announcements can be found ^^.14:09
ralonsohhi14:10
liuyulongOK, let's directly goto next topic.14:10
liuyulong#topic Bugs14:10
*** openstack changes topic to "Bugs (Meeting topic: neutron_l3)"14:10
liuyulong#link http://lists.openstack.org/pipermail/openstack-discuss/2020-June/015562.html14:11
liuyulongBernard was our bug deputy last week.14:11
liuyulong#link https://bugs.launchpad.net/neutron/+bug/188427314:11
openstackLaunchpad bug 1884273 in neutron "tc_lib (QoS; tc qdisc tbf) uses wrong value for byte/s conversion" [Low,Fix released] - Assigned to Weronika Sikora (shushuda)14:11
liuyulongThis should be backported to stable branches?14:12
ralonsohyeah, good catch: we are using SI units, not IEC14:13
ralonsohI think so, we need that backported14:13
ralonsohI can take care of it14:13
liuyulongSure, another question is that this has influence on the l3_tc qdisc?14:14
liuyulongqdisc_type == 'tbf', tbf only?14:15
ralonsohyes, only tbf14:15
ralonsohfor add_tc_qdisc14:15
*** jamesmcarthur has joined #openstack-meeting14:15
liuyulongOK, I see that, L3 is in ['htb', 'ingress'].14:15
ralonsohso no, probably not14:15
liuyulongralonsoh, yes, L3 is fine. The bug is not for L3 tc stuffs. : )14:17
liuyulong#link https://bugs.launchpad.net/neutron/+bug/188400914:18
openstackLaunchpad bug 1884009 in neutron " fix a bug that when create a subnet the gateway of it out range of subnet" [Undecided,Invalid]14:18
ralonsohgood point c#214:18
liuyulongAlright, not the L3 gateway, but the gateway IP for the subnet and IPAM.14:20
liuyulongSo it is a feature.14:20
liuyulong#link https://bugs.launchpad.net/neutron/+bug/188308914:21
openstackLaunchpad bug 1883089 in neutron "[L3] floating IP failed to bind due to no agent gateway port(fip-ns)" [Medium,In progress] - Assigned to LIU Yulong (dragon889)14:21
*** sluna has quit IRC14:21
liuyulongThis is the last bug from the meeting last week.14:21
*** sluna has joined #openstack-meeting14:21
liuyulongThe bug is very easy to reproduce.14:22
liuyulongCreate a new external network-1, and create things under it.14:23
liuyulong1). create router, 2). set external gateway to network-1, 3) create network&subnet, 4). add router to the subnet14:23
liuyulong5). create instance14:24
liuyulongThen just delete everything.14:24
liuyulongexcept the external network-1.14:24
liuyulongIn the neutron DB, you will see DvrFipGatewayPortAgentBinding left.14:26
liuyulongBut there is no fip-gateway-port in the database.14:26
liuyulongSo we have 2 fixes now:14:26
liuyulong#link https://review.opendev.org/#/c/735432/14:26
liuyulong#link /14:27
liuyulong#undo14:27
openstackRemoving item from minutes: #link /14:27
liuyulong#link https://review.opendev.org/#/c/735762/14:27
liuyulong735432 is for the None port exception. 735762 is to remove the stale DvrFipGatewayPortAgentBinding entries in DB.14:28
*** sluna has quit IRC14:28
*** mlavalle has joined #openstack-meeting14:29
liuyulongralonsoh, slaweq, haleyb, please take a look of those fixes if you have enough time. It's pretty simple.14:29
*** sluna has joined #openstack-meeting14:29
ralonsohsure14:29
*** diurnalist has joined #openstack-meeting14:29
haleyback14:29
*** sluna has quit IRC14:30
liuyulongOK, thank you guys.14:30
*** sluna has joined #openstack-meeting14:30
liuyulongNo more bug from the deputy list.14:30
liuyulongLet's give a quick scan of the LP list.14:31
liuyulong#link https://bugs.launchpad.net/neutron/+bug/188490614:31
openstackLaunchpad bug 1884906 in neutron "L3 agent cannot be manually scheduled" [Undecided,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)14:31
ralonsohsimilar to https://bugs.launchpad.net/neutron/+bug/188351314:32
openstackLaunchpad bug 1883513 in neutron "Adding a third DHCP agent to the network fails due to binding index error" [High,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)14:32
ralonsohpatch in progress: https://review.opendev.org/#/c/737736/14:32
*** ociuhandu_ has quit IRC14:32
*** ociuhandu has joined #openstack-meeting14:33
liuyulongralonsoh, I guess, you may also fixed this:14:33
liuyulong#link https://bugs.launchpad.net/neutron/+bug/187921514:33
openstackLaunchpad bug 1879215 in neutron "[L3] Unexcepted HA router scheduled instance shows up after manully scheduling" [Medium,New]14:33
ralonsohI think si14:33
ralonsohso14:33
liuyulongYep, the bug 1879215 is also in get_vacant_binding_index.14:35
openstackbug 1879215 in neutron "[L3] Unexcepted HA router scheduled instance shows up after manully scheduling" [Medium,New] https://launchpad.net/bugs/187921514:35
ralonsohI'll add this info to the patch now14:36
ralonsoh(or we can mark one as duplicated)14:36
liuyulongralonsoh, no harry, please try to verify your fix to see if it also addresses that.14:37
*** links has quit IRC14:38
liuyulongNext14:38
*** sluna has quit IRC14:38
*** sluna has joined #openstack-meeting14:39
liuyulong#link https://bugs.launchpad.net/neutron/+bug/188452714:39
openstackLaunchpad bug 1884527 in neutron "Related dvr routers aren't created on compute nodes" [Medium,In progress] - Assigned to Slawek Kaplonski (slaweq)14:39
liuyulongslaweq is working on that already, adding me to the reviewers list...14:41
slaweqyes, I need to fix some failing tests now14:41
liuyulongIt's a long story. : )14:42
liuyulong#link https://bugs.launchpad.net/neutron/+bug/178627214:43
openstackLaunchpad bug 1786272 in neutron "Connection between two virtual routers does not work with DVR" [Medium,Fix released] - Assigned to Slawek Kaplonski (slaweq)14:43
liuyulongIt should be traced back to this bug.14:43
liuyulongJust in case if someone wants to catch the history.14:43
liuyulongOK, no more bugs now.14:44
liuyulongAnyone has any updates?14:44
liuyulongOK, let's move on.14:45
liuyulongI will start a new section in the meeting.14:45
liuyulongSince we have some L3 new features to implement.14:45
liuyulong#topic RFE14:45
*** openstack changes topic to "RFE (Meeting topic: neutron_l3)"14:45
liuyulong#link https://bugs.launchpad.net/neutron/+bug/187730114:46
openstackLaunchpad bug 1877301 in neutron "[RFE] L3 Router support ndp proxy" [Wishlist,Confirmed]14:46
liuyulongThis spec is here: https://review.opendev.org/#/c/728628/14:46
liuyulongFor now, we have done some reviews for the spec.14:47
liuyulongIMO, there are at least some things are not so much clear:14:49
liuyulong1. the port attribute of the ndp_proxy14:49
liuyulong2. the real reason of the "ip6tables DROP"14:50
liuyulong3. how the migration from DVR to DVR_NO_EXTERNAL node work14:51
liuyulong3. the "enable_ndp_proxy" attribute of the router14:51
liuyulongSo, this spec should still need more works. Let's continue the review on gerrit.14:52
liuyulong#link https://launchpad.net/bugs/188053214:53
openstackLaunchpad bug 1880532 in neutron "[RFE]L3 Router should support ECMP" [Wishlist,New] - Assigned to XiaoYu Zhu (honglan0914)14:53
liuyulongThis is not approved yet.14:53
*** jamesmcarthur has quit IRC14:54
*** jamesmcarthur has joined #openstack-meeting14:54
liuyulongFrom the topology of the spec, we could see the detail of the use case.14:55
liuyulongIt will be configurable. So I'm OK with the proposal, if you need it, just enable.14:59
liuyulongSo, maybe the drivers meeting could continue the discussion for more details.15:00
liuyulongOK, time is up.15:00
liuyulongLet's end here.15:00
ralonsohbye15:00
liuyulong#endmeeting15:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:00
liuyulongbye15:00
openstackMeeting ended Wed Jun 24 15:00:48 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-06-24-14.06.html15:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-06-24-14.06.txt15:00
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_l3/2020/neutron_l3.2020-06-24-14.06.log.html15:00
liuyulongThank you guys.15:00
*** lajoskatona has joined #openstack-meeting15:01
*** lajoskatona has left #openstack-meeting15:01
*** jamesmcarthur has quit IRC15:12
*** jamesmcarthur has joined #openstack-meeting15:13
*** jamesmcarthur has quit IRC15:23
*** priteau has quit IRC15:27
*** jiaopengju1 has quit IRC15:27
*** jiaopengju1 has joined #openstack-meeting15:28
*** yamamoto has quit IRC15:34
*** yasufum has joined #openstack-meeting15:34
*** LiangFang has quit IRC15:37
*** ttsiouts_ has quit IRC15:40
*** ttsiouts has joined #openstack-meeting15:41
*** ttsiouts has quit IRC15:45
*** ttsiouts has joined #openstack-meeting15:46
*** ricolin has joined #openstack-meeting15:55
*** liuyulong has quit IRC15:56
*** gyee has joined #openstack-meeting15:57
*** ociuhandu has quit IRC15:59
*** ttsiouts has quit IRC16:00
*** ttsiouts has joined #openstack-meeting16:01
*** yamamoto has joined #openstack-meeting16:04
*** moguimar has quit IRC16:05
*** ttsiouts has quit IRC16:06
*** yamamoto has quit IRC16:10
*** ociuhandu has joined #openstack-meeting16:13
*** diurnalist has quit IRC16:16
*** diurnalist has joined #openstack-meeting16:17
*** markvoelker has joined #openstack-meeting16:24
*** markvoelker has quit IRC16:28
*** rpittau is now known as rpittau|afk16:41
*** Lucas_Gray has quit IRC16:49
*** yasufum has quit IRC17:00
*** yasufum has joined #openstack-meeting17:07
*** markvoelker has joined #openstack-meeting17:09
*** markvoelker has quit IRC17:14
*** ricolin has quit IRC17:20
*** apetrich has quit IRC17:20
*** apetrich has joined #openstack-meeting17:24
*** e0ne has quit IRC17:42
*** priteau has joined #openstack-meeting17:49
*** apetrich has quit IRC18:15
*** apetrich has joined #openstack-meeting18:16
*** priteau has quit IRC18:16
*** vishalmanchanda has quit IRC18:17
*** diablo_rojo has joined #openstack-meeting18:23
*** yasufum has quit IRC18:24
*** belmoreira has quit IRC18:33
*** irclogbot_3 has quit IRC18:34
*** irclogbot_1 has joined #openstack-meeting18:38
*** yamamoto has joined #openstack-meeting18:53
*** yamamoto has quit IRC18:58
*** markvoelker has joined #openstack-meeting19:10
*** markvoelker has quit IRC19:15
*** ralonsoh has quit IRC19:26
*** mlavalle has quit IRC19:26
*** diurnalist has quit IRC19:27
*** diurnalist has joined #openstack-meeting19:30
*** mlavalle has joined #openstack-meeting19:31
*** markvoelker has joined #openstack-meeting19:33
*** markvoelker has quit IRC19:38
*** diurnalist has quit IRC19:45
*** markvoelker has joined #openstack-meeting19:59
*** markvoelker has quit IRC20:04
*** diurnalist has joined #openstack-meeting20:13
*** belmoreira has joined #openstack-meeting20:22
*** belmoreira has quit IRC20:26
*** priteau has joined #openstack-meeting20:28
*** priteau has quit IRC20:39
*** rfolco has quit IRC20:47
*** patchbot has joined #openstack-meeting20:54
*** alecuyer has joined #openstack-meeting20:58
*** zaitcev has joined #openstack-meeting20:59
timburke#startmeeting swift21:00
openstackMeeting started Wed Jun 24 21:00:02 2020 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
*** openstack changes topic to " (Meeting topic: swift)"21:00
openstackThe meeting name has been set to 'swift'21:00
timburkewho's here for the swift meeting?21:00
seongsoochoo/21:00
alecuyero/21:00
claygo/21:01
zaitcevo721:01
timburkeagenda's at https://wiki.openstack.org/wiki/Meetings/Swift -- i don't have much to bring up, so it may be a fairly short meeting ;-)21:02
timburkein fact, it's just updates21:02
timburke#topic replication network and background daemons21:02
*** openstack changes topic to "replication network and background daemons (Meeting topic: swift)"21:02
timburkeafter the feedback last week, i updated https://review.opendev.org/#/c/735751/ to touch more daemons21:03
patchbotpatch 735751 - swift - Allow direct and internal clients to use the repli... - 2 patch sets21:03
timburkethere were a couple (reconciler and expirer) where i still provided an option of using the client-data-path network21:04
claygis that a filter xprofile?  what is even going on with this change set?! 🤯21:04
*** rbudden has left #openstack-meeting21:04
claygoh, that's unrelated - use_legacy_network 👍21:04
claygtimburke: so is that one ready to go then!?  🤗21:05
timburkewait, what about xprofile?21:05
timburkeyeah, pretty sure it's good to go21:05
claygi just clicked on the file with the biggest diff21:05
timburkemy logic for whether to provide an option was basically: if it walks disks (which presumably would be exposed on the replication network), don't bother to provide an option. if it just gets work by querying swift, include it21:06
timburkeoh, yeah -- i was just moving the filter to what seemed like a more natural location. i could back that out; it's unrelated21:07
claygdude, this change looks good21:07
*** maciejjozefczyk has quit IRC21:08
claygi hate the option, i'm sure all of these places would have used the replication network from the get go if these interfaces already existed21:08
timburkedoes anybody know of deployments where a node that might be running reconciler or expirer *wouldn't* have access to the replication network? maybe i don't even need to include the option21:09
*** raildo has quit IRC21:09
claygbut the way you did it it's super clear; not a blocker for me21:09
alecuyerat least we don't have that21:09
alecuyer(i mean they do have access to the replication network)21:10
claygwell the reconciler is interesting because it uses internal client and direct client - it's not clear to me that the direct client requests honor the config option?21:10
claygi haven't looked at this since you pushed it up last thursday - i thought it was still wip 🤷‍♂️21:11
claygI'm sure i'll be great21:11
timburkeheh -- whoops. yeah, they don't atm -- feel free to leave a -121:11
timburkeanyway, i just wanted to raise attention on it21:11
clayg-1 let's just drop the option!?  😍21:11
claygor do you mean -1 if we have the option is has to work and best tested and 🤮21:12
timburkeeither one, up to you ;-)21:12
timburke#topic waterfall EC21:12
*** openstack changes topic to "waterfall EC (Meeting topic: swift)"21:12
claygi totally get the argument "if ONE deployment wants the option we'll wish we had that code ready to go" 🤷‍♂️21:13
mattoliverauSorry I'm late, slept in a bit o/21:13
timburkeclayg, i saw you get some more patchsets up; how's it going?21:13
claygi just don't know if such a deployment exists and tend to YAGNI21:13
claygtimburke: it's so great, i'm really happy21:13
timburkemattoliverau, no worries -- we'll probably let you get breakfast before long ;-)21:13
alecuyerthanks for the ping about the concurrent frag fetcher clay. Have started reading but I think I need to read more before I start asking questions :)21:14
claygok, great, np!21:14
timburkeyou also wrote up an etherpad about non-durables21:14
timburke#link https://etherpad.opendev.org/p/the-non-durable-problem21:14
alecuyerdidn't catch that , thanks21:15
claygthe implication was some sort of dump overly complicated looking code to define/override what's the "shortfall" for a non-durable bucket21:16
claygbut it makes a clean way to put non-durable responses into a gradient of "probably fine" until either we get a durable response or get down to ~parity outstanding requests21:17
timburkeare there any open questions you'd like us to discuss, clayg? or should we just get on with reading the patches?21:18
claygi could be debated/researched/proved where on the slider is "most correct" - but I think it's a good sliding scale, so the code is "correct" in some sense21:18
clayguh, I'd be happy to answer questions21:18
claygbut I would like some "early" feedback on gross over expressiveness of https://review.opendev.org/#/c/737096/21:18
patchbotpatch 737096 - swift - Make concurrency timeout per policy and replica - 3 patch sets21:18
clayghaving concurrent_gets/timeout be *per policy* is obviously a move a positive direction21:19
claygbut crazy implementation of alecuyer 's idea that waterfall-ec should be able to express start ndata+N concurrent requests before feeding in the remaining primaries21:19
clayg... could probably be expressed different ways than how I wrote it up21:20
claygthe underlying structure (the per primary count timeout) might be a good implementation; but a smart group of folks like we have here may have some better ways to configure it21:21
claygi.e. is there a "do_what_i_want = true" option that would be better21:21
clayg... than the `concurrency_timeout<N>` that I plumbed through21:21
*** ttsiouts has joined #openstack-meeting21:22
claygI mean it's great!  I'm happy with it - it's *completely* sufficient for anything I might want to test in a lab21:22
clayg... and I'm sure different cluster's would hvae good reasons to want to do different things; so it doesn't bother me to have it exposed21:22
kota_morning21:23
alecuyerWe'll have to test it - still swamped with romain about unrelated things but I hope we can test it soon21:23
claygoh wow, that'd be cool!21:23
timburkesounds like i need to find time to review p 711342 and p 737096 this week :-)21:23
patchbothttps://review.opendev.org/#/c/711342/ - swift - Add concurrent_gets to EC GET requests - 12 patch sets21:23
patchbothttps://review.opendev.org/#/c/737096/ - swift - Make concurrency timeout per policy and replica - 3 patch sets21:23
claygI'll probably be testing it in our lab like... in another week or two?21:23
alecuyerI think we want to use EC more and we have things like 12+3 so im quite sure it would help :)21:23
kota_alarm didn't ringr21:24
timburkealecuyer, oh for sure -- we're already grumpy with 8+4; needing to get another 4 live connections would surely make our problems worse ;-)21:25
*** rh-jelabarre has quit IRC21:25
timburkethat's it for the agenda21:25
*** rh-jelabarre has joined #openstack-meeting21:25
timburke#topic open discussion21:25
*** openstack changes topic to "open discussion (Meeting topic: swift)"21:25
timburkeanything else we should talk about this week?21:25
alecuyerI want to mention quickly an issue we found with romain during some tests,21:25
clayg😱21:26
alecuyerthe test setup had a ubuntu 20.04 proxy, and 18.04 object servers21:26
alecuyerwe used an EC policy, and were unable to reread data ,21:26
timburkepy2 still, or trying out py3?21:26
timburkeeep!21:26
alecuyerstill py2 sorry :/21:26
timburkecool, just making sure 👍21:27
alecuyerit _seems_ liberasure code has a problem in ubuntu between these two version21:27
alecuyers21:27
claygi blame 20.04 - that focal 😠21:27
timburkewhich versions of liberasurecode?21:27
alecuyerthe object server will do get_metadata (i think sorry i don't recall the function name)21:27
claygwasn't there a thing with CRC libs that was $%^&ing INSANE (cc zaitcev )21:27
timburkewere they coming from ubuntu's repos?21:27
alecuyer1.6.1 vs 1.5.0 i think21:28
alecuyeryes21:28
alecuyerrecompiling appeared to fix it,21:28
zaitcevtimburke fixed most of it, I only looked at that. I think you're thinking about zlib.21:28
alecuyerand it seems to be related to linker flags (??) if i used ubuntu flags it broke again21:28
timburkehttps://github.com/openstack/liberasurecode/commit/a9b20ae6a21:28
alecuyerbut well21:28
claygLINKER FLAGS21:28
alecuyerjust wanted to say we saw that, and maybe i can say more outside the meeting, or once i have tested this properly21:28
alecuyer(this was not the goal of the test erm..)21:28
*** jmasud has quit IRC21:28
*** yaawang_ has joined #openstack-meeting21:29
zaitcevYes. It was related to linking order. If system zlib got routines ahead of liberasurecode, then they're used instead of ours.21:29
claygto find bugs is always the goal testing - you are a winner21:29
alecuyerzaitcev: thanks, i didn't figure it out21:29
zaitcevalecuyer: so, does this mean that the fix we committed (linked above) was incorrect?21:30
claygso i guess probably someone would be glad if we could produce an actionable bug for ubuntu 20.04's liberasurecode package21:31
zaitcevI reviewed it and it seemed watertight to me, buuuuut21:31
alecuyerSorry to say im not sure, haven't had time to dig further, but I'll check it and post detailed version and a test script we have to check outside of swift21:31
clayg... but "always compile/distribute your own liberasurecode" also seems like reasonable advice 🤔21:31
timburkei think the issue must be new frags getting read by old libec :-(21:31
*** yaawang has quit IRC21:31
zaitcevah, okay21:31
claygtrolorlololo21:31
zaitcevNo, wait. What if you have a cluster that's halfway updated and rsync moves fragment archives from new to old21:32
timburkei think if it was the other way around, with old proxy talking to new object, it'd probably be fine? until the reconstructor actually had work to do :-(21:32
claygtimburke: but it's only: new ec compiled with "wrong" flags breaks21:32
timburkemaybe we could offer an env var or something to have the new lib write old crcs (that could then still be read by old code)?21:34
timburkeand once everything's upgraded, take out the env flag21:34
claygalecuyer: can you share the werx and borked flags?21:34
alecuyeryes I will send it on #openstack-swift and etherpad21:34
claygFABULOUS!!!21:34
claygalecuyer: well done21:34
timburkeso last night i ran down an s3api issue ormandj saw upgrading to py321:35
timburke#link https://bugs.launchpad.net/swift/+bug/188499121:35
openstackLaunchpad bug 1884991 in OpenStack Object Storage (swift) "s3api on py3 doesn't use the bytes-on-the-wire when calculating string to sign" [Undecided,In progress]21:35
*** ttsiouts has quit IRC21:35
timburkejust a heads-up -- the long tail of py3 bugs continues21:35
claygglad someone is testing py3 😬21:35
*** slaweq has quit IRC21:36
*** ttsiouts has joined #openstack-meeting21:36
zaitcevThey have no choice. We, for example, aren't shipping py26 anymore, at all.21:36
claygzaitcev: you're a hero!!! 🤗21:36
timburkehave a fix at https://review.opendev.org/#/c/737856/, but it needs tests21:36
patchbotpatch 737856 - swift - py3: Stop munging RAW_PATH_INFO - 1 patch set21:36
claygi'm very anti munging - +1 on principle alone21:37
timburke*especially* when it's for something with "raw" in the name :P21:38
claygtimburke: ❤️21:38
claygi'm not having a great time with s3 tests in https://review.opendev.org/#/c/735738/ right now21:39
patchbotpatch 735738 - swift - s3api: Don't do naive HEAD request for auth - 1 patch set21:39
zaitcevBTW, I have 2 same things on my plate: Dark Data with dsariel and account server crashing. Not much change on either... I know Tim looked at the account server thing, but I'm going to write a probe test that solidly reproduces it.21:39
claygseongsoocho: how are things going for you?21:40
*** yaawang has joined #openstack-meeting21:40
*** ttsiouts has quit IRC21:40
timburkezaitcev, oh, yeah yeah -- p 704435 -- i've got a head-start on a probe test for you at p 73711721:40
patchbothttps://review.opendev.org/#/c/704435/ - swift - Mark a container reported if account was reclaimed - 2 patch sets21:40
patchbothttps://review.opendev.org/#/c/737117/ - swift - probe: Explore reaping with async pendings - 1 patch set21:40
seongsoochoclayg:  just have a normal day. everythings are good21:41
timburkesomething i've learned hte last few months: every day your cluster isn't on fire is a good day :D21:42
alecuyerdefinitely :)21:42
zaitcevtimburke: thank yuo21:43
*** yaawang__ has joined #openstack-meeting21:43
*** yaawang_ has quit IRC21:44
timburkezaitcev, how is the watcher going? should i find time to look at it again soon, or wait a bit?21:44
zaitcevtimburke: wait a bit please. We're putting together a switch for selected action.21:44
*** yaawang has quit IRC21:44
timburke👍21:44
zaitcevbasically21:45
zaitcevSam's design didn't allow for configuration options specific for watchers.21:45
zaitcevSo, there's no way to express "The DD watcher should do X"21:45
zaitcevDavid wants something crammed into paste line21:46
*** slaweq has joined #openstack-meeting21:46
zaitcevso it can turn a little unweildy like  watchers=watcher_a,watcher_b#do_this=yes,watcher_c21:46
zaitcevI'll let you know.21:47
clayg🤯21:47
timburkemakes me think of the config changes sam was thinking about in p 504472 ...21:47
patchbothttps://review.opendev.org/#/c/504472/ - swift - Shorten typical proxy pipeline. - 4 patch sets21:47
timburkei feel like it should be fair for the DD watcher to claim the dark_data_* config namespace within the object-auditor21:48
zaitcevI'd prefer something lie  [object-auditor:watcher_b] \n do_this=yes21:48
zaitcevBut dunno21:48
zaitcevSeems like overkill.21:48
timburkeor that! also seems good :-)21:48
zaitcevok21:49
claygnoice21:50
timburkeall right, lets let kota_, mattoliverau, and seongsoocho get on with their day ;-)21:50
timburkethank you all for coming, and thank you for working on swift!21:50
timburke#endmeeting21:50
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"21:50
openstackMeeting ended Wed Jun 24 21:50:50 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:50
openstackMinutes:        http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-06-24-21.00.html21:50
kota_thanks timburke21:50
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-06-24-21.00.txt21:50
openstackLog:            http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-06-24-21.00.log.html21:50
*** patchbot has left #openstack-meeting21:51
*** slaweq has quit IRC21:52
*** yaawang has joined #openstack-meeting21:54
*** ttsiouts has joined #openstack-meeting21:55
*** yaawang__ has quit IRC21:56
*** markvoelker has joined #openstack-meeting22:00
*** rfolco has joined #openstack-meeting22:04
*** markvoelker has quit IRC22:05
*** ttsiouts has quit IRC22:05
*** ttsiouts has joined #openstack-meeting22:06
*** yaawang_ has joined #openstack-meeting22:09
*** yaawang has quit IRC22:10
*** ttsiouts has quit IRC22:10
*** rfolco has quit IRC22:27
*** mlavalle has quit IRC22:39
*** yaawang_ has quit IRC22:41
*** TrevorV has quit IRC22:41
*** rcernin has joined #openstack-meeting22:42
*** ykatabam has joined #openstack-meeting22:43
*** yaawang_ has joined #openstack-meeting22:46
*** markvoelker has joined #openstack-meeting22:49
*** markvoelker has quit IRC22:54
*** yaawang_ has quit IRC23:04
*** yaawang_ has joined #openstack-meeting23:15
*** rfolco has joined #openstack-meeting23:23
*** zaitcev has left #openstack-meeting23:27
*** yaawang_ has quit IRC23:29
*** yaawang_ has joined #openstack-meeting23:30
*** markvoelker has joined #openstack-meeting23:37
*** diurnalist has quit IRC23:41
*** yaawang_ has quit IRC23:42
*** markvoelker has quit IRC23:47

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!