| *** vishalmanchanda has quit IRC | 00:05 | |
| *** yasufum has joined #openstack-meeting | 00:15 | |
| *** jamesmcarthur has quit IRC | 00:21 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:22 | |
| *** jamesmcarthur has quit IRC | 00:30 | |
| *** jmasud has quit IRC | 00:32 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:35 | |
| *** jamesmcarthur has quit IRC | 00:35 | |
| *** tosky has quit IRC | 00:36 | |
| *** timburke__ has joined #openstack-meeting | 00:40 | |
| *** timburke_ has quit IRC | 00:42 | |
| *** timburke__ has quit IRC | 00:43 | |
| *** timburke__ has joined #openstack-meeting | 00:45 | |
| *** macz_ has joined #openstack-meeting | 01:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:08 | |
| *** macz_ has quit IRC | 01:09 | |
| *** jamesmcarthur has quit IRC | 01:17 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:19 | |
| *** jamesmcarthur has quit IRC | 01:23 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:23 | |
| *** jmasud has joined #openstack-meeting | 01:24 | |
| *** jamesmcarthur has quit IRC | 01:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:27 | |
| *** mlavalle has quit IRC | 01:27 | |
| *** jamesmcarthur has quit IRC | 01:32 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:33 | |
| *** ttx has quit IRC | 01:38 | |
| *** Adri2000 has quit IRC | 01:39 | |
| *** jamesmcarthur has quit IRC | 01:39 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:39 | |
| *** macz_ has joined #openstack-meeting | 01:40 | |
| *** macz_ has quit IRC | 01:45 | |
| *** jamesmcarthur has quit IRC | 01:47 | |
| *** ttx has joined #openstack-meeting | 01:47 | |
| *** macz_ has joined #openstack-meeting | 02:22 | |
| *** macz_ has quit IRC | 02:27 | |
| *** jmasud has quit IRC | 03:04 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:12 | |
| *** jamesmcarthur has quit IRC | 03:13 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:13 | |
| *** jamesmcarthur has quit IRC | 03:13 | |
| *** jmasud has joined #openstack-meeting | 03:26 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:27 | |
| *** udesale has joined #openstack-meeting | 03:29 | |
| *** jamesmcarthur has quit IRC | 03:33 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:34 | |
| *** jamesmcarthur has quit IRC | 03:38 | |
| *** jamesdenton has joined #openstack-meeting | 03:42 | |
| *** jamesdenton has quit IRC | 03:50 | |
| *** jamesdenton has joined #openstack-meeting | 03:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:52 | |
| *** jamesmcarthur has quit IRC | 03:57 | |
| *** jamesmcarthur has joined #openstack-meeting | 03:58 | |
| *** gyee has quit IRC | 03:58 | |
| *** jamesmcarthur has quit IRC | 04:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 04:07 | |
| *** macz_ has joined #openstack-meeting | 04:23 | |
| *** macz_ has quit IRC | 04:27 | |
| *** jamesmcarthur has quit IRC | 04:44 | |
| *** jmasud has quit IRC | 04:46 | |
| *** jmasud has joined #openstack-meeting | 04:57 | |
| *** vishalmanchanda has joined #openstack-meeting | 04:59 | |
| *** jamesmcarthur has joined #openstack-meeting | 05:27 | |
| *** jamesmcarthur has quit IRC | 05:31 | |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-meeting | 05:33 | |
| *** macz_ has joined #openstack-meeting | 05:50 | |
| *** macz_ has quit IRC | 05:55 | |
| *** jamesdenton has quit IRC | 05:57 | |
| *** jamesden_ has joined #openstack-meeting | 05:58 | |
| *** jmasud has quit IRC | 06:02 | |
| *** jmasud has joined #openstack-meeting | 06:06 | |
| *** e0ne has joined #openstack-meeting | 06:31 | |
| *** e0ne has quit IRC | 06:31 | |
| *** jamesmcarthur has joined #openstack-meeting | 06:49 | |
| *** jamesmcarthur has quit IRC | 06:50 | |
| *** jmasud has quit IRC | 07:02 | |
| *** jmasud has joined #openstack-meeting | 07:08 | |
| *** ralonsoh has joined #openstack-meeting | 07:21 | |
| *** e0ne has joined #openstack-meeting | 07:22 | |
| *** e0ne has quit IRC | 07:27 | |
| *** slaweq has quit IRC | 07:42 | |
| *** ociuhandu has joined #openstack-meeting | 07:45 | |
| *** slaweq has joined #openstack-meeting | 07:46 | |
| *** dklyle has quit IRC | 07:48 | |
| *** ociuhandu has quit IRC | 07:51 | |
| *** slaweq has quit IRC | 07:52 | |
| *** slaweq has joined #openstack-meeting | 07:54 | |
| *** ociuhandu has joined #openstack-meeting | 08:05 | |
| *** lpetrut has joined #openstack-meeting | 08:06 | |
| *** xinranwang has joined #openstack-meeting | 08:08 | |
| *** ociuhandu has quit IRC | 08:16 | |
| *** ociuhandu has joined #openstack-meeting | 08:17 | |
| *** ociuhandu has quit IRC | 08:17 | |
| *** ociuhandu has joined #openstack-meeting | 08:18 | |
| *** ociuhandu has quit IRC | 08:23 | |
| *** makoto-h has quit IRC | 08:26 | |
| *** rpittau|afk is now known as rpittau | 08:27 | |
| *** ociuhandu has joined #openstack-meeting | 08:28 | |
| *** jmasud has quit IRC | 08:30 | |
| *** jmasud has joined #openstack-meeting | 08:32 | |
| *** tosky has joined #openstack-meeting | 08:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 08:50 | |
| *** jamesmcarthur has quit IRC | 08:55 | |
| *** jmasud has quit IRC | 09:12 | |
| *** gaut_123 has joined #openstack-meeting | 09:34 | |
| *** gaut_123 has quit IRC | 09:41 | |
| *** rcernin has quit IRC | 09:54 | |
| *** yasufum has quit IRC | 10:09 | |
| *** ociuhandu has quit IRC | 10:23 | |
| *** yasufum has joined #openstack-meeting | 10:24 | |
| *** ociuhandu has joined #openstack-meeting | 10:24 | |
| *** ociuhandu has quit IRC | 10:31 | |
| *** ociuhandu has joined #openstack-meeting | 10:31 | |
| *** e0ne has joined #openstack-meeting | 10:35 | |
| *** oneswig has joined #openstack-meeting | 10:50 | |
| *** eliaswimmer has joined #openstack-meeting | 10:55 | |
| *** gaut_123 has joined #openstack-meeting | 10:59 | |
| oneswig | #startmeeting scientific-sig | 11:00 |
|---|---|---|
| openstack | Meeting started Wed Mar 10 11:00:19 2021 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 11:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 11:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 11:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 11:00 |
| oneswig | Hi all | 11:00 |
| oneswig | #link Agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_March_10th_2021 | 11:01 |
| oneswig | We have a discussion on Jupyter as today's main event | 11:02 |
| eliaswimmer | Hi | 11:02 |
| oneswig | Hi eliaswimmer, thanks for coming along | 11:03 |
| eliaswimmer | I have prepared a few slides about my lessons learned using jupyterhub for lectures | 11:03 |
| *** b1airo has joined #openstack-meeting | 11:03 | |
| eliaswimmer | https://docs.google.com/presentation/d/1Il7nCNTaKCla0AqbQJnrmPpp_TUhg_-E8IqgYA6q4gk/edit?usp=sharing | 11:03 |
| oneswig | I need to request access, can you make them world-readable? | 11:03 |
| b1airo | seconded | 11:03 |
| oneswig | Hi b1airo, evening | 11:04 |
| oneswig | #chair b1airo | 11:04 |
| openstack | Current chairs: b1airo oneswig | 11:04 |
| b1airo | howdy oneswig | 11:04 |
| * b1airo yawns | 11:04 | |
| eliaswimmer | oneswig: is it working now? | 11:05 |
| oneswig | Yes, thanks that works | 11:05 |
| oneswig | I am in | 11:06 |
| *** gaut_123 has quit IRC | 11:07 | |
| *** belmoreira has joined #openstack-meeting | 11:08 | |
| oneswig | eliaswimmer: how much additional work does Zero to JupyterHub require to make into a production service? | 11:09 |
| eliaswimmer | That really depends on your requirements | 11:10 |
| eliaswimmer | but it works really well out of the box | 11:10 |
| eliaswimmer | a lot of effort went into it | 11:11 |
| eliaswimmer | sometimes it is a bit hard to follow the fast release updates | 11:11 |
| eliaswimmer | I spent most time with creating images and getting user creation right | 11:12 |
| *** dh3 has joined #openstack-meeting | 11:12 | |
| oneswig | What were the complexities in docker container image creation? | 11:13 |
| eliaswimmer | and of course on the underlying kubernetes setup | 11:13 |
| verdurin | I'm not really here, but Magic Castle includes Jupyterhub. | 11:13 |
| b1airo | does Z2J already handle idle notebook cleanup? | 11:13 |
| verdurin | https://github.com/ComputeCanada/magic_castle | 11:14 |
| eliaswimmer | b1airo: yes, that works quite well | 11:14 |
| *** mpryor has joined #openstack-meeting | 11:14 | |
| eliaswimmer | oneswig: mainly the diverse needs of our users, that's the place where all the features are setup | 11:15 |
| dh3 | sorry for being late. we have a group which runs Jhub notebooks on k8s on Rancher on OpenStack (on turtles...) Their main difficulty was scheduling pods, not knowing if an arriving user was about to run something big or something small, and overcommitting resources. | 11:15 |
| *** mpryor has quit IRC | 11:16 | |
| b1airo | what does your front-end proxy setup look like, any load or scaling issues with so many clients? | 11:16 |
| dh3 | nothing special in our front end as far as I know, standard k8s ingresses | 11:18 |
| *** mpryor has joined #openstack-meeting | 11:18 | |
| oneswig | eliaswimmer: it sounds like your labs scale up and down a lot. What's the highest scale the deployment has reached in terms of users online? Is the Kubernetes auto-scaling working well? | 11:19 |
| *** macz_ has joined #openstack-meeting | 11:19 | |
| eliaswimmer | I have to admit, we just throw a lot of hardware onto it, so it was never 100% utilized | 11:19 |
| mpryor | I apologise for my lateness! Where I work we run Jupyter notebooks in two ways - we have JupyterHub running on Rancher Kubernetes which we manage for our users. We also run a system we have called "Cluster-as-a-Service" which can dynamically deploy Pangeo-based JupyterHub instances on our OpenStack cloud. | 11:19 |
| eliaswimmer | oneswig: autoscaling was never needed and tested so far | 11:20 |
| oneswig | ah ok | 11:20 |
| eliaswimmer | I set limits for each lecture separately, which is easier for lectures where you know your requirements | 11:21 |
| eliaswimmer | Does anyone use GPUs already in their setups? | 11:22 |
| oneswig | eliaswimmer: how is the storage interface working? | 11:22 |
| eliaswimmer | oneswig: right now I use CephFS via CSI driver directly for homes and shares | 11:23 |
| oneswig | We have used GPUs with K8S in a couple of deploys | 11:23 |
| *** macz_ has quit IRC | 11:24 | |
| eliaswimmer | How is it with utilization? I wonder how to do AI lectures with 150 students, I would need 150 GPUs for them! | 11:24 |
| *** udesale_ has joined #openstack-meeting | 11:24 | |
| eliaswimmer | That is why I am looking into an additional KubeFlow setup for a GPU cluster | 11:25 |
| mpryor | How many people that are running JupyterHub have Dask enabled? We have found that users like having that functionality. | 11:26 |
| b1airo | Could split them under k8s - MIG or vGPU | 11:26 |
| eliaswimmer | b1airo: therefore I would need tesla grade GPUs | 11:27 |
| b1airo | Yep, our HPC integrated JHub has Dask built-in | 11:27 |
| *** udesale has quit IRC | 11:28 | |
| eliaswimmer | Anyone using SLURM spawner? | 11:28 |
| verdurin | That's how the Magic Castle implementation works. | 11:28 |
| b1airo | true eliaswimmer , though is they are already in an OpenStack cluster I'm assuming they're in server machines, in a data centre somewhere, so... | 11:28 |
| b1airo | yes, we're using Slurmspawner | 11:29 |
| verdurin | https://github.com/cmd-ntrf/slurmformspawner | 11:30 |
| eliaswimmer | b1airo: Do you have extra partitions for JupyterHub with shared nodes? | 11:30 |
| dh3 | the system here has Dask (not sure how many people use it). not using SLURM (there is LSF elsewhere for those who want it) | 11:32 |
| *** mpryor has quit IRC | 11:32 | |
| b1airo | Actually our spawner is kind of a mashup, as the Hub machine is not allowed the Slurm keys directly, so once a user authenticates (2fa via a custom PAM authenticator) we create a Kerberos credential that allows them temporary ssh access to a login node, so our version of batchspawner does things via ssh | 11:34 |
| *** mpryor has joined #openstack-meeting | 11:36 | |
| oneswig | eliaswimmer: what do you do to provide user data into Jupyter environments? | 11:36 |
| b1airo | re partitions, we were just filling up space on gpu nodes to start with, but now have a dedicated interactive partition for jupyter and other modest jobs. partly because we had some requests for teaching postgrad labs on the environment | 11:37 |
| eliaswimmer | oneswig: that's a good question, upload and download capabilities are quite limited, so for lectures with huge data sets I provided the lecturers with an extra share server. | 11:38 |
| mpryor | eliaswimmer oneswig We have found that, especially when using Dask, it makes sense to have any large datasets in an object store. | 11:39 |
| eliaswimmer | b1airo: we do so the same as our clusters are getting smaller and smaller in terms of nodes | 11:39 |
| mpryor | For our managed notebook service, even though the notebook servers are running in Kubernetes we actually mount home directories and shared filesystems, so the environment they see is much like they see if they SSH to our traditional batch platform. | 11:41 |
| eliaswimmer | mpryor: Oh that sound interesting, are you using a plugin for Jupyter to provide a view on the object store? | 11:41 |
| mpryor | eliaswimmer The community that we operate in (Earth Sciences) has built tools around a technology called Zarr that makes using the object store more or less transparent. | 11:42 |
| eliaswimmer | mpryor: opencube? | 11:42 |
| mpryor | eliaswimmer I think we have some people using datacube-like technologies. However the most common software stack seems to be data on object store, accessed using Dask, XArray and Zarr. Data catalogs are provided by a tool called Intake. | 11:43 |
| mpryor | This is basically the Pangeo stack - https://pangeo.io/ | 11:43 |
| mpryor | The Pangeo community also maintain a data catalog for CMIP6 - https://pangeo.io/catalog.html | 11:45 |
| *** dh3 has quit IRC | 11:45 | |
| *** yasufum has quit IRC | 11:45 | |
| eliaswimmer | mpryor: thank you! Our geo scientist are very interested in our setups, so that is a good starting point for me | 11:46 |
| *** dh3 has joined #openstack-meeting | 11:46 | |
| mpryor | eliaswimmer Pangeo is our standard setup that we provide via our Cluster-as-a-Service system. | 11:47 |
| mpryor | Mostly it is oceanographers using it at the moment, but we have had interest from other groups included geo-type stuff. | 11:48 |
| eliaswimmer | does anyone use gpfs with manila and kubernetes? | 11:48 |
| oneswig | eliaswimmer: are you deploying all the k8s and jupyterhub environments for users or do they self-service somehow? | 11:48 |
| eliaswimmer | oneswig: right now I do everything my own, but the plan is to have a self service platform with a service catalog once | 11:49 |
| eliaswimmer | Anyone using JupyterHubs for teaching? | 11:52 |
| mpryor | eliaswimmer A few of our tenants have used the self-service hubs we offer via CaaS for workshops and teaching. | 11:52 |
| mpryor | They are able to onboard all their own users, so we often don't find out about it though. | 11:53 |
| eliaswimmer | We are planing to improve grading services (nbgrader and ngshare) a lot over summer, we will open source our code when ready | 11:53 |
| eliaswimmer | mpryor: how do the manage authentication? | 11:54 |
| verdurin | Magic Castle was originally created for teaching at ComputeCanada, so I'm pretty sure they use the Jupyter part for that. It sets up IPA for auth. | 11:56 |
| mpryor | eliaswimmer One of the other cluster types we offer as part of our Cluster-as-a-Service is a central identity manager, which all other clusters connect to. | 11:56 |
| verdurin | I meant to ask if they wanted to contribute to this meeting, but forgot, and it's a bit early for Canada. | 11:56 |
| oneswig | I think it's a significant enough use case that a follow-on is warranted | 11:57 |
| b1airo | Computational notebooks for teaching.. some interesting pedagogical arguments around that I've come across, feels like a lost battle though | 11:57 |
| mpryor | eliaswimmer verdurin Our identity manager is FreeIPA + Keycloak. Keycloak is only there in a readonly capacity to provide OpenID Connect. Our Pangeo (JupyterHub) instances authenticate using the LDAP that you get from FreeIPA. | 11:59 |
| oneswig | ah, we are out of time | 12:00 |
| mpryor | We could have also used OpenID Connect, but OIDC is not fully supported yet by the JupyterHub OAuthenticator. | 12:00 |
| oneswig | final comments please | 12:00 |
| b1airo | interesting discussion - thanks all | 12:00 |
| eliaswimmer | mpryor: keycloak is a great tool, I use it for our SLURM based setup, wrote a little extension for our 2fa auth | 12:00 |
| b1airo | seems everyone is doing Jupyter these days | 12:00 |
| *** macz_ has joined #openstack-meeting | 12:00 | |
| eliaswimmer | I think there is a lot to share, maybe we can setup some etherpad? | 12:01 |
| oneswig | Thanks eliaswimmer and all, useful discussion | 12:01 |
| b1airo | related, am keen to talk to anyone using OpenOnDemand | 12:01 |
| verdurin | Thanks. | 12:01 |
| *** mpryor has quit IRC | 12:01 | |
| oneswig | eliaswimmer: some follow-up is definitely needed. | 12:01 |
| oneswig | OK, have to close the session. Thanks all | 12:01 |
| oneswig | #endmeeting | 12:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 12:01 | |
| openstack | Meeting ended Wed Mar 10 12:01:52 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 12:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-10-11.00.html | 12:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-10-11.00.txt | 12:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2021/scientific_sig.2021-03-10-11.00.log.html | 12:01 |
| *** oneswig has quit IRC | 12:03 | |
| *** macz_ has quit IRC | 12:06 | |
| *** ociuhandu has quit IRC | 12:12 | |
| *** ociuhandu has joined #openstack-meeting | 12:12 | |
| *** ociuhandu has quit IRC | 12:12 | |
| *** ociuhandu has joined #openstack-meeting | 12:13 | |
| *** ociuhandu has quit IRC | 12:18 | |
| *** ociuhandu has joined #openstack-meeting | 12:44 | |
| *** ociuhandu has quit IRC | 12:48 | |
| *** ociuhandu has joined #openstack-meeting | 12:51 | |
| *** ociuhandu has quit IRC | 13:02 | |
| *** ociuhandu has joined #openstack-meeting | 13:05 | |
| *** ociuhandu has quit IRC | 13:19 | |
| *** ociuhandu has joined #openstack-meeting | 13:20 | |
| *** ociuhandu has quit IRC | 13:25 | |
| *** ociuhandu has joined #openstack-meeting | 13:27 | |
| *** ociuhandu has quit IRC | 13:33 | |
| *** ociuhandu has joined #openstack-meeting | 13:49 | |
| *** eliaswimmer has quit IRC | 13:57 | |
| *** liuyulong has joined #openstack-meeting | 13:59 | |
| liuyulong | test | 13:59 |
| liuyulong | #startmeeting neutron_l3 | 14:00 |
| openstack | Meeting started Wed Mar 10 14:00:11 2021 UTC and is due to finish in 60 minutes. The chair is liuyulong. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 14:00 | |
| openstack | The meeting name has been set to 'neutron_l3' | 14:00 |
| liuyulong | Hi there | 14:00 |
| *** ociuhandu has quit IRC | 14:01 | |
| *** ociuhandu has joined #openstack-meeting | 14:01 | |
| liuyulong | OK, looks like a one person meeting | 14:01 |
| liuyulong | Let's scan the bugs quickly. | 14:02 |
| liuyulong | #topic Bugs | 14:02 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 14:02 | |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020903.html | 14:02 |
| liuyulong | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020767.html | 14:02 |
| liuyulong | Two lists from our bug deputy. | 14:02 |
| liuyulong | First one is related to DVR | 14:03 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1916761 | 14:03 |
| openstack | Launchpad bug 1916761 in neutron "[dvr] bound port permanent arp entries never deleted" [High,In progress] - Assigned to LIU Yulong (dragon889) | 14:03 |
| liuyulong | We revert the code deletion of DVR arp control code. | 14:03 |
| liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/777903 | 14:04 |
| liuyulong | That DVR arp control code removal is for this change https://review.opendev.org/c/openstack/neutron/+/601336 | 14:04 |
| liuyulong | But as we discussed in the gerrit, another approach same to l2pop should be introduced to handle such "ARP responder for allowed_address_pair IP" | 14:05 |
| haleyb | hi, sorry i'm late, conflict | 14:05 |
| liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/651905 | 14:05 |
| liuyulong | And this one is also related to 601336. | 14:06 |
| liuyulong | If the 601336 is not going to accepted, maybe we should revert this as well. | 14:06 |
| liuyulong | I have created one: https://review.opendev.org/c/openstack/neutron/+/778820 | 14:06 |
| liuyulong | But there are many conflicts. | 14:06 |
| liuyulong | haleyb, hi | 14:07 |
| haleyb | yes, some of those dvr changes are not a simple revert unfortunately | 14:08 |
| *** jamesden_ is now known as jamesdenton | 14:09 | |
| liuyulong | Yes, I will read the git log again. My idea is to remove those changes. | 14:09 |
| liuyulong | Hope you guys can also take a look at these changes. : ) | 14:10 |
| liuyulong | Next one | 14:10 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1917393 | 14:10 |
| openstack | Launchpad bug 1917393 in neutron "[L3][Port forwarding] admin state DOWN/UP router will lose all pf-floating-ips and nat rules" [High,Fix released] - Assigned to LIU Yulong (dragon889) | 14:10 |
| liuyulong | A quick fix: https://review.opendev.org/c/openstack/neutron/+/778126 | 14:10 |
| liuyulong | This should be backport to stable branches. I will do that. | 14:11 |
| liuyulong | Next | 14:11 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1752903 | 14:11 |
| openstack | Launchpad bug 1752903 in neutron "Floating IPs should not allocate IPv6 addresses" [Medium,Won't fix] | 14:11 |
| liuyulong | I changed this to "wont fix" after my comments: https://bugs.launchpad.net/neutron/+bug/1752903/comments/5 | 14:11 |
| liuyulong | "Add service type to the subnets of public network" can fix the problem ! Mission complete! | 14:12 |
| *** b1airo has quit IRC | 14:12 | |
| *** jrollen is now known as jroll | 14:13 | |
| liuyulong | Last one: | 14:13 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1917409 | 14:13 |
| openstack | Launchpad bug 1917409 in neutron "neutron-l3-agents won't become active" [High,New] | 14:13 |
| liuyulong | There are gerrit changes uploaded. | 14:14 |
| liuyulong | #link https://review.opendev.org/q/topic:%22bug%252F1917409%22+(status:open%20OR%20status:merged) | 14:14 |
| haleyb | i finally figured out there were two related changes there, i was confused | 14:15 |
| liuyulong | The fix is simple, but we have no idea about why the port can be None from the call trace. | 14:16 |
| liuyulong | haleyb, yes, I have left some comments to that. | 14:16 |
| liuyulong | The author should merge these two changes to one. | 14:16 |
| haleyb | liuyulong: right, and i also don't like just catching the error there if it's really the caller at fault | 14:17 |
| haleyb | i'm guessing the port is '' or something | 14:17 |
| haleyb | i put a comment | 14:19 |
| liuyulong | OK, I see the bug... | 14:19 |
| liuyulong | after reading the report's l3 log, it is related to agent gateway port creation. | 14:20 |
| liuyulong | We fixed that here | 14:20 |
| liuyulong | #link https://review.opendev.org/c/openstack/neutron/+/735762 | 14:20 |
| liuyulong | #link https://bugs.launchpad.net/neutron/+bug/1883089 | 14:21 |
| openstack | Launchpad bug 1883089 in neutron "[L3] floating IP failed to bind due to no agent gateway port(fip-ns)" [Medium,Fix released] - Assigned to LIU Yulong (dragon889) | 14:21 |
| liuyulong | Same error as this bug. | 14:21 |
| liuyulong | OK, mission complete! | 14:21 |
| liuyulong | haha | 14:21 |
| *** lyarwood has joined #openstack-meeting | 14:22 | |
| liuyulong | Mark duplicate of bug #1883089. | 14:22 |
| openstack | bug 1883089 in neutron "[L3] floating IP failed to bind due to no agent gateway port(fip-ns)" [Medium,Fix released] https://launchpad.net/bugs/1883089 - Assigned to LIU Yulong (dragon889) | 14:22 |
| liuyulong | OK, no more bugs from me now. | 14:22 |
| *** lyarwood has left #openstack-meeting | 14:23 | |
| liuyulong | OK, let's move on. | 14:24 |
| liuyulong | #topic On demand agenda | 14:24 |
| *** openstack changes topic to "On demand agenda (Meeting topic: neutron_l3)" | 14:24 | |
| liuyulong | Again for bp/distributed-dhcp-for-ml2-ovs: https://review.opendev.org/q/topic:%22bp%252Fdistributed-dhcp-for-ml2-ovs%22+(status:open%20OR%20status:merged) | 14:25 |
| liuyulong | It's pretty close now, reviews are welcomed. | 14:26 |
| haleyb | yes, i have it on my list, just have a busy meeting morning | 14:26 |
| liuyulong | The fullstack test case works fine now: https://5fd5e74cdeb26ed32d55-9d697031d66865af8e6eba8e2a3ea98e.ssl.cf5.rackcdn.com/776568/11/check/neutron-fullstack-with-uwsgi/89bfdb7/testr_results.html | 14:27 |
| liuyulong | haleyb, thank you, your comments are all addressed. : ) | 14:28 |
| liuyulong | OK, let's end the meeting here. | 14:34 |
| liuyulong | #endmeeting | 14:34 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:34 | |
| openstack | Meeting ended Wed Mar 10 14:34:37 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:34 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2021/neutron_l3.2021-03-10-14.00.html | 14:34 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2021/neutron_l3.2021-03-10-14.00.txt | 14:34 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2021/neutron_l3.2021-03-10-14.00.log.html | 14:34 |
| liuyulong | Bye | 14:34 |
| *** liuyulong has quit IRC | 14:43 | |
| *** ociuhandu has quit IRC | 14:54 | |
| *** ociuhandu has joined #openstack-meeting | 14:54 | |
| *** jamesmcarthur has joined #openstack-meeting | 15:00 | |
| *** ociuhandu has quit IRC | 15:03 | |
| *** ociuhandu has joined #openstack-meeting | 15:03 | |
| *** Adri2000 has joined #openstack-meeting | 15:09 | |
| *** ociuhandu has quit IRC | 15:23 | |
| *** ociuhandu has joined #openstack-meeting | 15:24 | |
| *** ociuhandu has quit IRC | 15:26 | |
| *** ociuhandu has joined #openstack-meeting | 15:26 | |
| *** jamesdenton has quit IRC | 15:35 | |
| *** jamesdenton has joined #openstack-meeting | 15:36 | |
| *** dklyle has joined #openstack-meeting | 15:43 | |
| *** lpetrut has quit IRC | 15:44 | |
| *** ociuhandu has quit IRC | 15:46 | |
| *** ociuhandu has joined #openstack-meeting | 15:46 | |
| *** ociuhandu has quit IRC | 15:49 | |
| *** ociuhandu has joined #openstack-meeting | 15:49 | |
| *** macz_ has joined #openstack-meeting | 15:57 | |
| *** macz_ has quit IRC | 15:57 | |
| *** macz_ has joined #openstack-meeting | 15:58 | |
| *** ociuhandu has quit IRC | 16:15 | |
| *** udesale_ has quit IRC | 16:18 | |
| *** gyee has joined #openstack-meeting | 16:22 | |
| *** ociuhandu has joined #openstack-meeting | 16:24 | |
| *** ociuhandu has quit IRC | 16:24 | |
| *** ociuhandu has joined #openstack-meeting | 16:25 | |
| *** ociuhandu has quit IRC | 16:29 | |
| *** ociuhandu has joined #openstack-meeting | 16:35 | |
| *** ociuhandu has quit IRC | 16:37 | |
| *** ociuhandu has joined #openstack-meeting | 16:37 | |
| *** takamatsu has quit IRC | 16:37 | |
| *** ociuhandu has quit IRC | 16:51 | |
| *** ociuhandu has joined #openstack-meeting | 17:00 | |
| *** rpittau is now known as rpittau|afk | 17:05 | |
| *** mlavalle has joined #openstack-meeting | 17:06 | |
| *** jmasud has joined #openstack-meeting | 17:08 | |
| *** xinranwang has quit IRC | 17:18 | |
| *** jmasud has quit IRC | 17:20 | |
| *** jmasud has joined #openstack-meeting | 17:33 | |
| *** takamatsu has joined #openstack-meeting | 17:38 | |
| *** dh3 has quit IRC | 17:53 | |
| *** takamatsu has quit IRC | 18:10 | |
| *** tbarron has joined #openstack-meeting | 18:37 | |
| *** ralonsoh has quit IRC | 18:41 | |
| *** e0ne has quit IRC | 18:48 | |
| *** jamesmcarthur has quit IRC | 18:50 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:50 | |
| *** jamesmcarthur has quit IRC | 18:51 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:52 | |
| *** jamesmcarthur has quit IRC | 18:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:52 | |
| *** jamesmcarthur has quit IRC | 18:57 | |
| *** ociuhandu has quit IRC | 19:12 | |
| *** ociuhandu has joined #openstack-meeting | 19:12 | |
| *** jmasud has quit IRC | 19:18 | |
| *** ociuhandu has quit IRC | 19:19 | |
| *** ociuhandu has joined #openstack-meeting | 19:20 | |
| *** ociuhandu has quit IRC | 19:22 | |
| *** ociuhandu has joined #openstack-meeting | 19:23 | |
| *** redrobot2 has joined #openstack-meeting | 19:34 | |
| *** ociuhandu_ has joined #openstack-meeting | 19:34 | |
| *** jmasud has joined #openstack-meeting | 19:35 | |
| *** macz_ has quit IRC | 19:35 | |
| *** macz_ has joined #openstack-meeting | 19:36 | |
| *** mugsie__ has joined #openstack-meeting | 19:37 | |
| *** tosky_ has joined #openstack-meeting | 19:37 | |
| *** benj_- has joined #openstack-meeting | 19:37 | |
| *** dosaboy_ has joined #openstack-meeting | 19:38 | |
| *** ociuhandu has quit IRC | 19:42 | |
| *** tosky has quit IRC | 19:42 | |
| *** mjturek has quit IRC | 19:42 | |
| *** benj_ has quit IRC | 19:42 | |
| *** dosaboy has quit IRC | 19:42 | |
| *** mugsie has quit IRC | 19:42 | |
| *** redrobot has quit IRC | 19:42 | |
| *** redrobot2 is now known as redrobot | 19:43 | |
| *** irclogbot_3 has quit IRC | 19:44 | |
| *** jamesdenton has quit IRC | 19:45 | |
| *** mugsie__ is now known as mugsie | 19:47 | |
| *** jamesdenton has joined #openstack-meeting | 19:48 | |
| *** belmoreira has quit IRC | 19:52 | |
| *** belmoreira has joined #openstack-meeting | 19:59 | |
| *** tosky_ is now known as tosky | 20:16 | |
| *** jmasud has quit IRC | 20:23 | |
| *** takamatsu has joined #openstack-meeting | 20:25 | |
| *** jmasud has joined #openstack-meeting | 20:32 | |
| *** jmasud has quit IRC | 20:46 | |
| *** tosky has quit IRC | 20:49 | |
| *** tosky has joined #openstack-meeting | 20:49 | |
| *** jmasud has joined #openstack-meeting | 20:52 | |
| *** zaitcev has joined #openstack-meeting | 20:56 | |
| *** ociuhandu_ has quit IRC | 20:59 | |
| *** acoles has joined #openstack-meeting | 20:59 | |
| timburke__ | #startmeeting swift | 21:00 |
| openstack | Meeting started Wed Mar 10 21:00:50 2021 UTC and is due to finish in 60 minutes. The chair is timburke__. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:00 | |
| openstack | The meeting name has been set to 'swift' | 21:00 |
| timburke__ | who's here for the swift meeting? | 21:01 |
| mattoliverau | o/ | 21:01 |
| rledisez | hi o/ | 21:01 |
| seongsoocho | o/ | 21:01 |
| acoles | o/ | 21:02 |
| timburke__ | as usual, the agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:03 |
| timburke__ | first up | 21:03 |
| timburke__ | #topic next PTG | 21:03 |
| *** openstack changes topic to "next PTG (Meeting topic: swift)" | 21:03 | |
| timburke__ | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020778.html | 21:03 |
| timburke__ | i probably should have brought this up last week, but i've gotten behind on the ML | 21:03 |
| timburke__ | it's going to be another virtual PTG, April 19-23 | 21:04 |
| timburke__ | register (for free) at https://april2021-ptg.eventbrite.com/ | 21:04 |
| timburke__ | i'll get a doodle poll up for next week to pick meeting times | 21:05 |
| acoles | I already have my ticket :) | 21:05 |
| timburke__ | me too | 21:05 |
| timburke__ | we'll see if we can get notmyname to drop in again :-) | 21:05 |
| mattoliverau | Oh I should go get mine.. I assume my employer will let me go | 21:06 |
| timburke__ | heh "go" | 21:06 |
| timburke__ | but yeah, pretty sure your boss will be on board ;-) | 21:06 |
| timburke__ | next up | 21:07 |
| timburke__ | #topic elections | 21:07 |
| *** openstack changes topic to "elections (Meeting topic: swift)" | 21:07 | |
| timburke__ | (again, probably should have brought this up last week) | 21:07 |
| timburke__ | the nomination period is over! | 21:07 |
| timburke__ | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-March/020973.html | 21:07 |
| *** jmasud has quit IRC | 21:08 | |
| timburke__ | looks like there are currently 4 candidates for 5 slots on the TC, and no actual elections will need to be held :-/ | 21:08 |
| timburke__ | #link https://governance.openstack.org/election/ | 21:08 |
| timburke__ | i don't really have much else to say about it, but wanted to keep people informed | 21:10 |
| *** dklyle has quit IRC | 21:10 | |
| timburke__ | so on to Swift work! | 21:10 |
| timburke__ | #topic CORS and s3api | 21:10 |
| *** openstack changes topic to "CORS and s3api (Meeting topic: swift)" | 21:10 | |
| timburke__ | now that the CORS test suite landed, i'd like to keep pushing on the actual behavioral changes i'd like | 21:11 |
| mattoliverau | +1 | 21:11 |
| timburke__ | specifically, https://review.opendev.org/c/openstack/swift/+/710330/ (which has s3api translate more cors-related headers) | 21:11 |
| acoles | oh yes, I got distracted from that, I'll try to re-review | 21:12 |
| timburke__ | and https://review.opendev.org/c/openstack/swift/+/710355/ (which allows preflight OPTIONS requests) | 21:12 |
| *** ociuhandu has joined #openstack-meeting | 21:12 | |
| acoles | I've noticed a the zuul cors test has failed on a few patches :( | 21:12 |
| timburke__ | thanks! fwiw, it looks like there's at least a couple more changes i ought to make to the gate job given the failure on that last patch, but i'm fairly certain tests will pass with the recheck | 21:13 |
| timburke__ | acoles, did they seem to be timeouts during setup? that's what i saw on one, anyway... | 21:13 |
| acoles | TBH I didn't dig into the failure too much | 21:13 |
| timburke__ | (though it got a little buried by a post-failure when we tried to copy some non-existent outputs) | 21:14 |
| timburke__ | i'll be sure to dig in for next week | 21:14 |
| acoles | other than they weren't 'real' failures - the tests didn't seem to have run | 21:14 |
| acoles | ok, or maybe they ran but the output wasn't posted. IDK | 21:15 |
| timburke__ | as long as the tests actually run, i expect we won't see a post failure, fwiw | 21:15 |
| timburke__ | next up | 21:16 |
| timburke__ | #topic relinker | 21:16 |
| *** openstack changes topic to "relinker (Meeting topic: swift)" | 21:16 | |
| timburke__ | i know we've got a few different threads we're pulling at now | 21:16 |
| timburke__ | mattoliverau has a few patches for improved logging | 21:16 |
| timburke__ | acoles has been working on some refactoring that should make cleanup behave a lot more like relinking (and they both should get a lot more tolerant of things like reapable tombstones) | 21:17 |
| mattoliverau | but these will need to be rebased on top of acoles changes once they stablise. But mostly effect the post_partition hook for the moment, so mostly seperate. | 21:18 |
| timburke__ | do we have a preference for order of landing? | 21:18 |
| acoles | today I wrote --policy and --partition option patches | 21:18 |
| mattoliverau | oh cool, I'll check em out. | 21:19 |
| acoles | I'd really appreciate this one merging (subject to review of course) https://review.opendev.org/c/openstack/swift/+/778530 | 21:19 |
| timburke__ | nice, i should do some reviews :-) | 21:19 |
| acoles | p 778530 is blocking me doing some stuff on the refactor chain that I'd like | 21:20 |
| timburke__ | ...also, i should dust off the priority reviews wiki | 21:20 |
| *** belmoreira has quit IRC | 21:20 | |
| timburke__ | acoles, i'll try to make sure it's got a review by the time you wake up | 21:21 |
| acoles | thanks! | 21:21 |
| mattoliverau | which the amount of churn als code does on the main functions, it'll be easier to land that and then mine. Because mine will just need to be plugged into the partitals for the post_part hook. | 21:21 |
| timburke__ | sounds like a plan | 21:21 |
| seongsoocho | There are no timestamp in relink log in my env. How to add a timestamp in log? | 21:21 |
| acoles | mattoliverau: yours and mine may not conflict, but IIRC some tests were failing on your logging patch? | 21:22 |
| mattoliverau | yeah, I'll poke it, I reworked it a bit yesterday and pushed stuff up at the end of my day.. I shoud've run tests locally first. But will check it out today. | 21:23 |
| acoles | mattoliverau: sorry, it looks like it may have just been the cors test failing | 21:23 |
| mattoliverau | \o/ (well kinda yay) | 21:23 |
| timburke__ | seongsoocho, that sounds like a good logging enhancement to make. fwiw, it should "just" be a matter of updating format='%(message)s' in relinker.py | 21:24 |
| timburke__ | would you mind writing up a bug (or even a patch!) for it, so we won't forget about it? | 21:24 |
| seongsoocho | timburke__: Ok I will writing up a bug and also write a patch too! | 21:25 |
| timburke__ | thanks! | 21:25 |
| mattoliverau | nice! | 21:25 |
| acoles | mattoliverau: so don't wait on me, if https://review.opendev.org/c/openstack/swift/+/779439 is ready lets try to land it then I'll take care of any conflict (now I looked harder there will be some but nothing too tricky) | 21:26 |
| mattoliverau | nah it isn't. Like a said it should mostly be passing some extra params to the post_part hook partial call. Which you've just centralised, so actually makes it eaiser :) | 21:27 |
| acoles | and TBH I'd rather we merged smaller changes rather than rush through review of the bigger refactor | 21:28 |
| acoles | but yeah, the partial call does get easier :) | 21:28 |
| timburke__ | ok, one last topic | 21:29 |
| timburke__ | #topic releases | 21:29 |
| *** openstack changes topic to "releases (Meeting topic: swift)" | 21:29 | |
| mattoliverau | True. We'll put them in "order" on the priorities page then. Doesn't matter which order, but if you don't mind a conflict then happy to get mine in first, I just want to finish the 2nd recon one (needs some tests) | 21:29 |
| timburke__ | still need to get a swift release out -- anyone think they'll have a chance to proofread the changelog at https://review.opendev.org/c/openstack/swift/+/777708 ? make sure i'm not forgetting anything? | 21:30 |
| mattoliverau | I'll take a look today | 21:30 |
| timburke__ | and separately, is anyone aware of any reason we should hold off on getting a release out? any critical bugs? | 21:30 |
| acoles | I'll take a look tomorrow | 21:30 |
| mattoliverau | maybe relinker improvements? | 21:31 |
| mattoliverau | but so long as all the races are fixed and landed then that's good | 21:31 |
| mattoliverau | *enough | 21:31 |
| timburke__ | i guess my main thought on the relinker is whether we've got anything that's demonstrably worse than it was in 2.26.0 | 21:32 |
| acoles | timburke__: maybe this https://review.opendev.org/c/openstack/swift/+/779308 ? | 21:32 |
| mattoliverau | But who relinks very oftern, that could wait until next release :) | 21:32 |
| timburke__ | i'll take a look | 21:33 |
| timburke__ | that's all i've got | 21:33 |
| timburke__ | #topic open discussion | 21:33 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:33 | |
| timburke__ | anything else we ought to discuss this week? | 21:33 |
| acoles | just an FYI that mattoliverau and I have some patches to improve sharder & swift-manage-shard-range config handling, and we're proposing to change a couple of the defaults that relate to shrinking | 21:35 |
| acoles | https://review.opendev.org/c/openstack/swift/+/774584 | 21:35 |
| acoles | and https://review.opendev.org/c/openstack/swift/+/778989 | 21:36 |
| mattoliverau | oh yeah! good call to mention it :) | 21:36 |
| acoles | unless you use auto-sharding it should not have any impact | 21:36 |
| acoles | or 'swift-manage-shard-ranges compact' | 21:37 |
| timburke__ | all right | 21:41 |
| timburke__ | sounds like we've got a pretty good idea of what we want to look at next | 21:42 |
| *** dklyle has joined #openstack-meeting | 21:42 | |
| timburke__ | thank you all for coming, and thank you for working on swift! | 21:42 |
| timburke__ | #endmeeting | 21:42 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:42 | |
| openstack | Meeting ended Wed Mar 10 21:42:25 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:42 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-03-10-21.00.html | 21:42 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-03-10-21.00.txt | 21:42 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2021/swift.2021-03-10-21.00.log.html | 21:42 |
| *** ociuhandu has quit IRC | 21:42 | |
| *** acoles has left #openstack-meeting | 21:42 | |
| *** jamesmcarthur has joined #openstack-meeting | 21:44 | |
| *** johnsom has quit IRC | 21:46 | |
| *** johnsom has joined #openstack-meeting | 21:47 | |
| *** slaweq has quit IRC | 21:55 | |
| *** vishalmanchanda has quit IRC | 22:08 | |
| *** zaitcev has left #openstack-meeting | 22:08 | |
| *** ociuhandu has joined #openstack-meeting | 22:10 | |
| *** jmasud has joined #openstack-meeting | 22:13 | |
| *** ociuhandu has quit IRC | 22:18 | |
| *** jamespage has quit IRC | 22:20 | |
| *** jamespage has joined #openstack-meeting | 22:20 | |
| *** rcernin has joined #openstack-meeting | 22:27 | |
| *** timburke_ has joined #openstack-meeting | 22:28 | |
| *** timburke__ has quit IRC | 22:30 | |
| *** rpittau|afk has quit IRC | 23:37 | |
| *** rpittau|afk has joined #openstack-meeting | 23:38 | |
| *** jamesmcarthur has quit IRC | 23:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:43 | |
| *** jamesmcarthur has quit IRC | 23:47 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:47 | |
| *** jamesmcarthur has quit IRC | 23:52 | |
| *** jamesmcarthur has joined #openstack-meeting | 23:52 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!