15:00:19 <kopecmartin> #startmeeting qa
15:00:19 <opendevmeet> Meeting started Tue Aug 15 15:00:19 2023 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:19 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:00:19 <opendevmeet> The meeting name has been set to 'qa'
15:00:25 <kopecmartin> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours
15:00:28 <lpiwowar> o/
15:01:31 <kopecmartin> o/
15:03:05 <kopecmartin> let's get to it
15:03:06 <kopecmartin> #topic Announcement and Action Item (Optional)
15:03:24 <kopecmartin> tomorrow PTL and TC nominations start
15:03:27 <kopecmartin> #link https://governance.openstack.org/election/
15:04:06 <kopecmartin> let me know if anyone wanted to be PTL for QA
15:04:28 <kopecmartin> if there won't be any candidates, i'll probably continue
15:05:06 <kopecmartin> #topic Bobcat Priority Items progress
15:05:07 <kopecmartin> #link https://etherpad.opendev.org/p/qa-bobcat-priority
15:05:07 <lpiwowar> I would be definitely for keeping you as a PTL!:)
15:05:12 <kopecmartin> :)
15:05:15 * kopecmartin checking the doc
15:06:38 <kopecmartin> last week we merged the 'Add option to install everything in global venvs'
15:06:43 <kopecmartin> #link https://review.opendev.org/c/openstack/devstack/+/558930
15:07:09 <kopecmartin> that broke a few projects, e.g. freezer
15:07:10 <kopecmartin> #link https://zuul.opendev.org/t/openstack/build/8eb8ee33b26a42229a7c0f18118a8763
15:07:34 <kopecmartin> however, it seems freezer isn't active, there haven't been updates in the project for some time
15:08:17 <kopecmartin> thanks to the patch , which had impact on multiple projects, we'll see how many projects are still active and needed by users
15:08:21 <frickler> it also broke nova, neutron and glance
15:08:30 <frickler> but I fixed those already
15:08:58 <kopecmartin> right, thanks for that
15:09:13 <kopecmartin> if anyone hits a similar issue like the one above, please, let us know in this channel
15:09:14 <kopecmartin> e.g.
15:09:25 <kopecmartin> FileNotFoundError: [Errno 2] No such file or directory: 'freezer'
15:10:05 <frickler> or "command not found", although we have that way too often even in passing jobs, too
15:10:32 <kopecmartin> the patch which added debian-bookworm job to devstack was merged as well
15:10:34 <kopecmartin> #link https://review.opendev.org/c/openstack/devstack/+/887547/7
15:10:54 <kopecmartin> does it mean this priority item is finished? - 'Support for Debian 12 (bookworm) in devstack'
15:11:17 <frickler> and gmann proposed a PTI patch that will make it the default platform for 2024.1
15:11:49 <frickler> I think it is finished module the ongoing cleanup work, yes
15:12:00 <frickler> *modulo
15:12:26 <kopecmartin> nice
15:13:28 <kopecmartin> #topic Gate Status Checks
15:13:32 <kopecmartin> #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
15:13:35 <kopecmartin> no patches there
15:13:39 <kopecmartin> anything urgent to review?
15:14:32 <lpiwowar> This is not urgent => https://review.opendev.org/c/openstack/tempest/+/890798 ... But if someone has time to comment and do the review it would be great:)
15:15:06 <kopecmartin> sure
15:15:13 <lpiwowar> thanks!
15:17:19 <kopecmartin> #topic Bare rechecks
15:17:23 <kopecmartin> #link https://etherpad.opendev.org/p/recheck-weekly-summary
15:17:27 <kopecmartin> no updates since last week
15:17:59 <kopecmartin> #topic Periodic jobs Status Checks
15:18:00 <kopecmartin> periodic stable full
15:18:00 <kopecmartin> #link https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-zed&job_name=tempest-full-2023-1
15:18:01 <kopecmartin> periodic stable slow
15:18:03 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-slow-2023-1&job_name=tempest-slow-zed&job_name=tempest-slow-yoga&job_name=tempest-slow-xena
15:18:05 <kopecmartin> periodic extra tests
15:18:07 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-2023-1-extra-tests&job_name=tempest-full-zed-extra-tests&job_name=tempest-full-yoga-extra-tests&job_name=tempest-full-xena-extra-tests
15:18:09 <kopecmartin> periodic master
15:18:11 <kopecmartin> #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic
15:18:48 <kopecmartin> tempest-full-centos-9-stream is broken
15:18:49 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream
15:19:31 <kopecmartin> Could not find versioned identity endpoints when attempting to authenticate. Please check that your auth_url is correct. Internal Server Error (HTTP 500)
15:19:54 <kopecmartin> although i'm not sure if that's the original cause
15:20:20 <frickler> Aug 12 03:17:04.971803 np0034931512 devstack@keystone.service[44769]: failed to open python file /opt/stack/data/venv/bin/keystone-wsgi-public
15:21:24 <frickler> I think global_venv is still broken on c9s, so the flag needs to be set in tempest to disable it
15:22:19 <kopecmartin> thanks! i'll propose the patch
15:22:42 <frickler> not sure why tempest doesn't inherit this https://review.opendev.org/c/openstack/devstack/+/558930/38/.zuul.yaml#703
15:23:17 <kopecmartin> hmm, i'll check the inheritance path
15:24:00 <frickler> do we want a periodic job for bookworm, too? seems I didn't add one yet
15:25:24 <kopecmartin> hm, do we have other distros in periodic too?
15:25:39 <kopecmartin> that reminds me, i should add bookworm to the distros check in the agenda
15:26:17 <frickler> well we have this centos job
15:27:34 <kopecmartin> right, i guess it won't hurt
15:28:24 <kopecmartin> #topic Distros check
15:28:24 <kopecmartin> cs-9
15:28:24 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0
15:28:26 <kopecmartin> debian
15:28:28 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&skip=0
15:28:30 <kopecmartin> focal
15:28:32 <kopecmartin> #link https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-focal&skip=0
15:28:34 <kopecmartin> rocky
15:28:36 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx
15:28:38 <kopecmartin> openEuler
15:28:40 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&job_name=devstack-platform-openEuler-22.03-ovs&skip=0
15:30:12 <kopecmartin> all seems more or less good
15:30:31 <kopecmartin> #topic Sub Teams highlights
15:30:32 <kopecmartin> Changes with Review-Priority == +1
15:30:37 <kopecmartin> #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
15:30:47 <kopecmartin> no patches
15:30:52 <kopecmartin> #topic Open Discussion
15:30:56 <kopecmartin> anything for the open discussion?
15:31:03 <lpiwowar> I have one not that important question.
15:31:22 <lpiwowar> Would it be OK to extend account-generator to generate system scoped admin?
15:31:38 <lpiwowar> Currently, it does not generate it and it causes failure in the tempest-full-test-account-py3 job.
15:31:48 <lpiwowar> #link https://baadd3700d0f959a2148-132839ae31c66569d89d81463638a953.ssl.cf1.rackcdn.com/890798/7/check/tempest-full-test-account-py3/1e6521b/testr_results.html
15:32:13 <kopecmartin> hmm, system-scoped admin , isn't it deprecated?
15:32:23 <frickler> that url looks baadd ... *scnr*
15:32:47 <lpiwowar> So we should drop the system scouped admin in the test that is failing?
15:32:51 <kopecmartin> :D
15:33:04 <lpiwowar> :D
15:33:10 * kopecmartin trying to find the srbac doc, one sec
15:33:29 <frickler> maybe ask gmann as our srbac specialist
15:33:44 <lpiwowar> frickler: +1
15:35:03 <kopecmartin> try to check this, maybe there's something which would suggest what to do with that
15:35:05 <kopecmartin> #link https://governance.openstack.org/tc/goals/selected/consistent-and-secure-rbac.html
15:35:49 <lpiwowar> Yes, I know this doc. I will try to take a look at this again:).
15:37:39 <kopecmartin> phase1
15:37:42 <kopecmartin> ... "Keeping everything as project scoped will make sure to fail the operations performed with a system scoped token (which does not have project_id) early with 403 instead of failing it with 500 in the lower layer." ...
15:38:14 <kopecmartin> that refers to system-scoped token in general, does it include the admin one too? my assumption would be yes
15:38:18 <kopecmartin> but better to double check
15:38:36 <kopecmartin> oh, can't the test fail because of that ^^
15:38:37 <kopecmartin> ?
15:39:13 <lpiwowar> The test is failing because of missing system scoped admin creds in the accounts.yaml.
15:39:19 <lpiwowar> https://opendev.org/openstack/tempest/src/branch/master/tempest/scenario/test_unified_limits.py#L32
15:39:32 <lpiwowar> "Details: No credentials matching role: admin, scope: system specified in the accounts file"
15:40:06 <frickler> maybe the test should be skipped in that case, instead of failing?
15:40:15 <lpiwowar> Dynamic creds will create the system scoped admin on the go ...
15:40:47 <lpiwowar> frickler: skipped when pre-prov creds are used?
15:41:12 <frickler> skipped when "No credentials matching role: admin, scope: system specified in the accounts file"
15:41:54 <lpiwowar> frickler: ok, that sounds good to me:)
15:43:46 <frickler> that's it then?
15:44:05 <lpiwowar> frickler, kopecmartin: +1, thanks for the help!
15:44:40 <kopecmartin> lpiwowar:  you can try to propose a wip patch to see what happens if you add 'admin' to the test's credentials
15:45:06 <kopecmartin> and meanwhile figure out what's right, not just working, solution, i'd try follow up with gmann
15:45:22 <kopecmartin> let's move on
15:45:29 <kopecmartin> #topic Bug Triage
15:45:33 <kopecmartin> #link https://etherpad.openstack.org/p/qa-bug-triage-bobcat
15:45:53 <kopecmartin> i've recorded the numbers but haven't had time to go through the bugs :/
15:46:05 <kopecmartin> the numbers look stable though
15:46:13 <kopecmartin> anyway, that's all from my side
15:46:40 <lpiwowar> I just want to quickly mention this. Last week I talked with professor Corey we talked with at the PTG in Vancouver kopecmartin. It seems that we might have a group of students working on Tempest starting next year. I just wanted to inform everyone that we could potentially have some skilled students joining us to lend a hand :)
15:49:06 <kopecmartin> in theory sounds good, in reality it will require quite a lot of work on management as the students will require guidance, however, it will be awesome if they help us with something
15:49:16 <kopecmartin> we're always looking for new contributors
15:50:36 <lpiwowar> From what I heard from the professor Corey I think that the students might help us a lot:).
15:50:55 <kopecmartin> that'd be great, thanks for the initiative lpiwowar, i'm looking forward to some results  :)
15:51:19 <kopecmartin> let's wrap it up, i still need to propose one or 2 patches before my eod (9 minutes :D )
15:51:20 <lpiwowar> kopecmartin: I will keep you updated:)
15:51:30 <kopecmartin> thanks
15:51:33 <lpiwowar> kopecmartin: gl :D
15:51:37 <kopecmartin> thank you everyone, see you next week
15:51:38 <kopecmartin> #endmeeting