13:00:01 <mnasiadka> #startmeeting kolla
13:00:01 <opendevmeet> Meeting started Wed Jul 26 13:00:01 2023 UTC and is due to finish in 60 minutes.  The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot.
13:00:01 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
13:00:01 <opendevmeet> The meeting name has been set to 'kolla'
13:00:02 <mnasiadka> #topic rollcall
13:00:04 <mnasiadka> o/
13:00:09 <kevko> \o/
13:00:25 <mmalchuk> \o
13:00:32 <mgoddard> \o
13:00:43 <bbezak> o/
13:00:46 <mhiner> o/
13:01:06 <ihalomi> \o
13:01:10 <mattcrees> o/
13:01:14 <frickler> \o/
13:02:51 <mnasiadka> #topic agenda
13:02:51 <mnasiadka> * Review action items from the last meeting
13:02:51 <mnasiadka> * CI status
13:02:51 <mnasiadka> * Release tasks
13:02:51 <mnasiadka> * Regular stable releases (first meeting in a month)
13:02:52 <mnasiadka> * Current cycle planning
13:02:52 <mnasiadka> * Additional agenda (from whiteboard)
13:02:54 <mnasiadka> * Open discussion
13:03:05 <mnasiadka> well, not action items from last meeting
13:03:08 <mnasiadka> #topic CI status
13:03:36 <mnasiadka> I've been off for the last three weeks - whiteboard says Kolla xena/wallaby is RED
13:04:08 <mnasiadka> wallaby is heading for EOL so probably not an issue
13:04:09 <bbezak> wallaby EOL
13:04:13 <bbezak> yeap
13:04:25 <mnasiadka> we also agreed for xena to be EOL, but maybe let's first wait for wallaby to be marked EOL
13:04:44 <mmalchuk> outdated info for xena? needs check
13:04:47 <mnasiadka> all the rest of the whiteboard says CI is green otherwise
13:04:59 <mnasiadka> would be nice if the person marking something as RED would write why ;-)
13:05:10 <mnasiadka> #topic Release tasks
13:05:32 <mnasiadka> it's R-10
13:06:21 <mnasiadka> nothing to do
13:06:27 <mnasiadka> #topic Current cycle planning
13:06:34 <mnasiadka> let's check status of some features
13:06:36 <mnasiadka> ihalomi: Podman?
13:06:54 <kevko> i've approved https://review.opendev.org/c/openstack/kolla/+/888335 without second +2 because of gate blocker ...
13:07:00 <kevko> so maybe xena red to xena green ?
13:07:25 <ihalomi> mnasiadka: working only one test failing for unknown reasons
13:07:40 <mnasiadka> I assume the rocky9 one
13:07:41 <kevko> ihalomi link ?
13:07:41 <mnasiadka> https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bfc/799229/77/check/kolla-ansible-rocky9-podman/bfc1625/primary/logs/ansible/deploy-prechecks
13:07:46 <ihalomi> i think the problem is in image since it was working and started failing without change
13:07:55 <ihalomi> https://zuul.opendev.org/t/openstack/build/bfc1625b4e0f4788be21f3bf5454ba4d
13:08:18 <mnasiadka> well, maybe it's some newer podman version
13:08:32 <mnasiadka> do we need to pin to older or something similar?
13:10:01 <ihalomi> idk i couldnt build that image on my own so i dont know the reason of failure but podman-py should be frozen not sure about podman
13:10:48 <mnasiadka> bbezak: probably we should spawn some test environment to help ihalomi
13:11:22 <mnasiadka> ok, I'll have a look into that next week
13:11:49 <bbezak> makes sense mnasiadka
13:13:30 <mnasiadka> ok then
13:13:39 <mnasiadka> kevko: you did have a look in Let's Encrypt patches, right?
13:14:40 <mnasiadka> mattcrees: how is the "changing default to RMQ HA mode" going?
13:15:08 <kevko> mnasiadka: yep, rewritten a lot ...but for now it is HA and working like a charm ...
13:15:26 <mnasiadka> kevko: nice, then now we need some reviewers
13:15:44 <kevko> i can review it :D
13:15:50 <mnasiadka> anyone signing up for reviewing Let's Encrypt patch?
13:15:51 <mattcrees> RMQ patch still needs more work to automate out the manual steps. I'm working on it, but slowly as other things have taken priority
13:16:14 <mnasiadka> kevko: if you rewrote a lot - then probably add yourself as a co-author :)
13:17:20 <opendevreview> Michal Nasiadka proposed openstack/kayobe master: Fix firewalld configuration for monitoring hosts  https://review.opendev.org/c/openstack/kayobe/+/883263
13:17:43 <mnasiadka> ok then, no reviewers, will try to chase some people :)
13:18:54 <mmalchuk> I'm back from vacation and ready to review)
13:19:09 <mnasiadka> ok, let's move on
13:19:11 <mnasiadka> #topic Additional agenda (from whiteboard)
13:19:29 <mnasiadka> failing podman test - this has been raised in previous topic
13:19:36 <mnasiadka> frickler - octavia jobboard
13:19:44 <mnasiadka> #link https://review.opendev.org/c/openstack/kolla/+/888587
13:19:51 <mnasiadka> #link https://review.opendev.org/c/openstack/kolla-ansible/+/888588
13:20:20 <mnasiadka> frickler: I asked a question in the first patch, although it's merged ;-)
13:20:28 <frickler> kevko already reviewed, need to update the second one
13:21:08 <frickler> mnasiadka: this is not a new feature, but not sure whether we'd want to backport, either
13:22:57 <mnasiadka> ok, so let's not backport for now, unless somebody really needs that
13:23:07 <mnasiadka> reviewed the k-a one
13:25:21 <mnasiadka> ok then
13:25:24 <frickler> thx, will check those things with christian
13:25:32 <mnasiadka> #topic Open discussion
13:25:42 <mnasiadka> Anybody?
13:25:48 <frickler> what I missed to add to the agenda is bookworm
13:27:03 <mnasiadka> I think hrw is not here, and probably he knows latest status
13:27:06 <frickler> #link https://review.opendev.org/c/openstack/kolla/+/886088
13:27:26 <opendevreview> Michal Nasiadka proposed openstack/kolla master: rabbitmq: bump version to 3.12  https://review.opendev.org/c/openstack/kolla/+/887225
13:27:30 <frickler> I added some fixes in k-a and now it seems to work in CI at least
13:27:45 <mnasiadka> nice
13:27:58 <mnasiadka> should we bump rmq now?
13:28:38 <frickler> what version of 3.12.x is this now?
13:29:18 <kevko> why in bookworm erlang is installed from debian and not from ppa ?
13:29:31 <kevko> doesn't exist for bookworm ?
13:29:49 <frickler> it didn't exist when the patch was created at least
13:29:58 <frickler> also the version in debian looked recent enough
13:29:59 <mnasiadka> frickler: 3.12.2
13:30:21 <frickler> 3.12.2 sounds ok-ish
13:32:26 <mnasiadka> there are still some months before the release
13:32:44 <mnasiadka> Upgrading to Erlang 26 and RabbitMQ 3.12 at the Same Time
13:32:44 <mnasiadka> When upgrading from 3.11.x on Erlang 25 to 3.12.x on Erlang 26,
13:32:44 <mnasiadka> the cluster must be on at least version 3.11.17 for a safe upgrade of quorum queues.
13:33:01 <mnasiadka> in theory we don't do quorum queues yet, but there might be users with such
13:33:08 <mnasiadka> should we put in a precheck?
13:33:28 <frickler> yes
13:33:35 <mattcrees> A precheck for tht sounds good, yes
13:34:27 <mnasiadka> Ok, I'll work on it (and updating the feature flags)
13:35:13 <mnasiadka> And need to have a look in Ansible bump (so we don't start running and screaming just before the release because something stops working)
13:35:56 <mnasiadka> Unless anyone has anything else - I'll end the meeting for today
13:36:41 <kevko> i would like to just again ask anyone to review letsencrypt as for now i have a time to rework
13:37:07 <mnasiadka> I'll try to find somebody from SHPC, we need that feature as well.
13:37:20 <kevko> thanks
13:37:25 <mmalchuk> kevko please repeat links
13:37:40 <kevko> and i  have one question regarding CADF
13:37:49 <mnasiadka> (and will have a look in the code, but we also need some testing on a real env)
13:38:22 <kevko> i have master deployed with lets encrypt if anyone wants to connect i can put ssh key there
13:38:46 <mnasiadka> I'll remember that ;-)
13:39:11 <mnasiadka> kevko: what about CADF? Keystone CADF?
13:39:32 <mmalchuk> kevko I can help next week if it is not too late
13:39:36 <kevko> we are using this in our downstream repositories
13:39:37 <kevko> https://docs.openstack.org/keystonemiddleware/pike/audit.html
13:40:10 <kevko> what is needed is  add https://github.com/sapcc/openstack-audit-middleware to openstack images
13:40:36 <kevko> and amend kolla-ansible to support custom api-paste files
13:41:47 <frickler> we use that middleware, too, so +1 to adding it
13:42:06 <mnasiadka> sure, makes sense to make lifes easier
13:42:23 <mnasiadka> (we don't use that, but who knows what future brings) ;)
13:42:30 <kevko> so i will prepare patches and i will ask you for review then ...
13:42:51 <kevko> well, we are not using it for all customers ...but for some yes ...
13:46:40 <mnasiadka> great, nice addition
13:46:55 <mnasiadka> ok, I guess it's enough for today
13:47:00 <mnasiadka> thanks for coming!
13:47:02 <mnasiadka> #endmeeting