Tuesday, 2023-11-28

JayFtc-members: meeting in an hour16:57
dansmithJayF: just for your and others' information, today is my last day in the office for the year17:57
dansmithand thus my last meeting, obviously17:57
JayFack, lets get that in the meeting logs in open discussion if you don't mind17:57
dansmithyep, I will, just FYI in case it matters for earlier things on the agenda17:58
dansmithbefore I drop that bomb at the end when we're out of time17:58
* JayF jots a note to assign all action items to dansmith for things we want to table /s17:58
dansmithfine with me until jan :)17:59
JayF#startmeeting tc18:00
opendevmeetMeeting started Tue Nov 28 18:00:07 2023 UTC and is due to finish in 60 minutes.  The chair is JayF. Information about MeetBot at http://wiki.debian.org/MeetBot.18:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:00
opendevmeetThe meeting name has been set to 'tc'18:00
JayF#topic Roll Call18:00
JayFo/18:00
gmanno/18:00
frickler\o18:00
JayFWelcome to the weekly meeting of the OpenStack Technical Committee. A reminder that this meeting is held under the OpenInfra Code of Conduct available at https://openinfra.dev/legal/code-of-conduct.18:00
JayFToday's meeting agenda can be found at https://wiki.openstack.org/wiki/Meetings/TechnicalCommittee.18:00
JayFThere are no noted absenses in the agenda for today's meeting.18:00
slaweqo/18:00
jamespageo/18:00
rosmaitao/18:00
knikollao/18:00
JayFGoing to wait until :05 or until all TC members have checked in18:00
dansmitho/18:01
JayFAight, going to get started. We have 8 that is quorum.18:04
JayF#topic Follow up on tracked action items18:04
spotz[m]o/18:05
rosmaita9!18:05
JayFping?18:06
JayFokay, sorry, wifi network went down locally, but I appear to still have wired connectivity18:06
JayF#info Rosmaita to propose amendment to unmaintained branch resolution allowing a single review group18:07
JayF#info Rosmaita to email mailing list about progress implementing unmaintained branch resolution18:07
JayFrosmaita: I grouped these together since they are related; do you have an update?18:07
* rosmaita actually did all his action items for once18:07
rosmaita#link https://review.opendev.org/c/openstack/governance/+/90094018:07
rosmaita#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/ZYAZG43BLJJVXCYZVPYQX5733BYDVVNL/18:08
rosmaitaso, no response to the email, so i guess everyone is on board18:08
knikolla#success rosmaita did all his action items18:08
opendevstatusknikolla: Added success to Success page (https://wiki.openstack.org/wiki/Successes)18:08
rosmaita:)18:08
JayFThat governance change appears to have wide consensus; please make time to review it if you haven't and I will take a pass at landing eligible governance patches this afternoon.18:08
rosmaitathe resolution has achieved ripeness, and i think has enough votes to pass 18:08
gmannamendment to resolution looks good to me, thanks rosmaita for preparing that 18:09
dansmithjsut added one more18:09
rosmaita\o/18:09
JayFIs there anything further we should mention about unmaintained branches before moving on? I don't believe we have another agenda item for it.18:09
jamespageditto (and I managed to actually hit the right option this time)18:09
JayFWhat is our next step, assuming this governance change lands in the next hour or two18:09
rosmaitai think just to help the release team get this implemented18:10
JayFIs someone on TC doing or helping coordinate that work?18:10
rosmaitaand i guess we need opendev infra team to set up the meta-acl for gerrit18:10
fricklerthat should be a patch to project-config18:11
fungiyes, if you can get me details on what you need i can propose a patch18:11
rosmaitagreat18:11
JayFInstead of hashing those details out here, can someone take the action to work with fungi on this?18:11
fungiit'll just be an edit to the existing gerrit/acls/openstack/meta.config acl file18:11
JayFAnd we can move on?18:11
rosmaita#action rosmaita work with fungi on the gerrit meta-acls18:12
JayF#undo18:12
opendevmeetRemoving item from minutes: #action rosmaita work with fungi on the gerrit meta-acls18:12
JayF#redo18:12
JayF#action rosmaita work with fungi on the gerrit meta-acls18:12
JayFI didn't think anyone but the person who started the meeting could do that :)18:12
rosmaita:D18:12
JayFThanks for that18:12
JayF#topic Gate Health Check18:12
JayFHow is the gate?18:12
JayFThings have been mostly calm on the Ironic side. Some failures that we tracked down to real issues in one of our libraries, contained to Ironic-related projects.18:13
gmannone failure there in novaclient fucntional job with neutron new rbac enabled18:13
dansmithreally not great on the nova side18:14
gmannwe have enabled neutron rbac by default in devstack and that broke novaclient job, not sure why but it is disabled in that job and worked around 18:14
dansmithI'm at 14 rechecks for a patch that has been approved for weeks18:14
dansmithmany of the failures are related to volume tests, per usual, but some other instabilities have also crept up, but no giant smoking guns that I've seen18:15
JayFIs there anything at a TC level we can or should do? I would say can we raise awareness but if it's bad enough to need >a dozen rechecks; I imagine there's decent awareness.18:16
dansmithwell, tbh, I think most people are happy to recheck 20 times to get their patches in18:16
gmannI am sure those are not blind recheck18:16
dansmithso awareness is maybe not enough18:16
dansmithgmann: mine aren't for sure, except for yesterday when zuul wasn't loading log results, so it was hard to examine for root cause18:17
gmanni think we know what failing like volume tests and need someone to deep dive into those18:17
gmanndansmith: yeah18:17
dansmithagree.. before last week, the cinder grenade phase was failing for me a *lot*18:17
dansmithhaven't seen that yet this week, but the resize vol-backed test has bitten me a few times18:18
fricklerthere was an issue with cinder, grenade and tooz, I added that as dedicated agenda item18:18
rosmaitathe grenade seems to fail after it creates the third volume and then tries to ssh into the server18:18
rosmaitaat least that's what i've seen a few times18:19
rosmaitabut i don't know what's happening to the server18:19
dansmithrosmaita: okay I haven't seen that, it's usually waiting for the volume to become in-use, but that was 2+ weeks ago18:19
dansmithit'18:19
dansmithit's meaning "what I was seeing"18:19
dansmithanyway, agree with gmann that some deep dive is needed for sure18:20
rosmaitawell, there is something bad happening during that phase18:20
dansmithI'm pretty burned out on that stuff myself, as I spent months on it after I came back from holiday break this jan, when things were really bad18:20
JayFUnless folks in the TC want to dig this personally, I'd suggest putting some of these research results out onto the list and trying to recruit additional help.18:20
dansmithso I hope someone else can really jump in while I'm out18:20
JayFWe've gotta try to increase the number of people engaged with these kind of problems, and the only way I know to try and do that is to increase communication around them.18:21
dansmithI'm worried that the pain level has to be higher before people will really care, but .. yeah18:21
gmanntrue18:22
JayFI agree, based on the results of the similar approach I took with eventlet, but ensuring folks know where status is IMO is part of what we're supposed to do18:22
JayFwe can only do the work of 9 people, and there's a heck of a lot more to do to keep things going than that18:22
dansmiththat's not true18:22
dansmithI know for a fact that gmann can do the work of three people :P18:22
gmannyou should know that I am getting old :) 18:23
JayF:) moving on 18:23
JayF#topic Leaderless projects 18:23
JayFWell, one of those three gmann's gets to lead this topic :D 18:23
JayF#link https://etherpad.opendev.org/p/2024.1-leaderless18:23
gmannwe have two project PTL appointment proposed for ling time and we should take decision soon i will say in this meeting18:23
gmannsahara: #link https://review.opendev.org/c/openstack/governance/+/89978218:23
gmannsahara is marked as inactive but PTL appointment and give them a chance to make it active does not hurt18:24
gmann2nd is rally: #link https://review.opendev.org/c/openstack/governance/+/89822818:24
gmannit has voting in favor and not in favor too but we should decide18:24
gmannI think they are open in gerrit for enough time, I would like to request tc-members who have not voted to do that 18:25
JayFYes, please do, especially since one of those does have a negative vote18:25
JayFI'd really rather not land something with a plurality if it has a negative vote18:26
gmannother 3 project remaining for PTL appointment is no progress, I will send email today to their previous PTL or any active maintained i get to know18:26
gmannJayF: I will say let's get the remaining vote today and we should either merge them or abandon them this week max18:26
JayFYep, that's extremely reasonable, and abandoning isn't really a choice unless a project without a PTL is an OK state18:27
JayFI don't think "we take no action" is a good state here; we need to land these *or* take some other action to resolve the project's lack of leadership18:27
gmannbut better than not deciding about it and PTL volunteer just wait for us to say yes or not to appointment18:27
spotz[m]Having password issues but will vote if I haven’t18:28
gmannespecially there is no other candidate or even maitainers  18:28
JayFYeah, you're right, and I appreciate you pointing it out and will take that advice -- I'll land these if eligible to land by EOW, even if only a plurality vote to land if still eligible18:28
gmannthanks.18:28
JayFIs there anything else on leaderless projects before wee move on?18:28
gmannthat is all form my side on this.18:28
JayFNext topic was Implementation of Unmaintained branch statuses -- but I think we covered that during action items18:29
JayFso I'm going to skip it 18:29
JayF#topic 2024.1 TC Tracker18:29
JayF#link https://etherpad.opendev.org/p/tc-2024.1-tracker18:29
JayFIf there are any updated on TC Tracker items; please give them now. 18:29
JayFOK, moving on.18:30
JayF#topic Upgrade issue between tooz and cinder18:31
JayF#link https://review.opendev.org/c/openstack/requirements/+/90113118:31
JayF#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/L72QU3SR2VFVYOFXVYH74V7HGMQ3YJRU/18:31
JayFUnsure who added this to the agenda; but there's clearly an issue around Tooz upgrades that broke things, it got reverted but there are still issues here to resolve I believe18:31
JayFfrickler: ^ looks like this was your topic18:31
frickleryes, that was me, I wanted to check whether we need to discuss some general guidance regarding interactions between these projects18:32
clarkbnaively it seems like tooz could sort out what version of etcd it is talking to then use the appropriate api paths18:33
fungii.e. support multiple versions of etcd in tooz (noting that coinstalling services that needed those different versions would be challenging still)18:33
frickleryes, that's what https://review.opendev.org/q/topic:%22bug/2043810%22 does18:34
JayFI'm looking some stuff up, Ironic had similar failures and fixed it with devstack configuration18:35
JayFmainly because I want to ensure however it gets fixed that we all align in the same direction18:35
fricklerhaving grenade upgrade also etcd would be another option18:36
fricklerbut also I added the topic before those tooz patches were proposed, so maybe all is well for now. and the next topic is even more interesting ;)18:37
JayFHmm https://review.opendev.org/c/openstack/networking-generic-switch/+/895973 is the change Ironic landed18:37
JayFI think it's in the same realm but not the same mechanism18:38
JayFfrickler: it sounds like there's not much else to talk abuot here though, things got moving over the holiday?18:38
fricklerack18:38
JayF#topic Declare projects inactive for lack of ...?18:38
JayF#info (list from agenda) Working py311 unit tests, Support for sqla2, Broken CI since 2023.2 release, Do we want/need to look at specific deliverables or only whole projects?18:39
frickleralso added by me18:39
dansmithdefinitely not sqla2 yet, IMHO18:39
fricklermy main concern is what we can do to get sqla2 into u-c this cycle18:40
dansmiththe other two seem reasonable18:40
fricklerif we have projects that do not support sqla2, but depend on global upper-constraints, what other options do we have?18:41
gmanngate broken even due to py 3.11 or any other reason is reasonable way to mark them inactive18:41
dansmithfrickler: because it's a lot of work for some projects and 2024.1 won't even be supported on a distro that has 2.0 AFAIK18:41
gmannI think we need to go with community wide goal for sqla2 work and maybe multicycle effort. 18:42
dansmithit's fine to have it be a requirement or goal or whatever, but marking a project as inactive because it hasn't crossed that line yet is way too large of a hammer, IMHO18:42
dansmithyeah18:42
JayFWhile I mostly agree with frickler that we have to draw a line at some point, and it's getting to be that time, it seems late in the cycle to draw that line TBH.18:42
gmannagree, I think we discussed the same in gerrit in some change 18:42
JayFand I suspect if we apply the other criteria, we'll catch clearly inactive projects without catching any that might just be late with SQLA 2.0 migrations18:42
gmannmarking project inactive on this is little too strong and inconsistent in our process18:42
dansmithyeah18:42
JayFI'm thinking of this like a graduated filter; sqla2.0 is a more fine filter18:43
JayFlets use the larger, coarser filters first18:43
JayFwhich more clearly say "these should not be in 2024.1"18:43
JayFand perhaps decide (not today; but this cycle) that next cycle is where we draw the SQLA 2.0 line18:43
clarkb(it is R-18 according to the schedule)18:43
dansmithsqla2.0 is a point in time hurdle.. it's a filter right now, but won't be later, where CI brokenness and py$current unit tests are more of a reasonable timeless filter, IMHO18:43
fricklero.k., so I will propose some inactivity marks based on the latter18:44
* dansmith notes he's going to have to do his 15th recheck on that patch18:45
fricklerand then I'll add sqla2 planning as a new topic18:45
gmann++18:45
JayFfrickler++ Thank you for that, I put up (and abandoned) a governance change in that direction last cycle, it may be useful as a starting point or at least to review preexisting discussion18:45
frickler(I'm also not sure that it'll be sqla2.0 still ;)18:46
JayFAnything else on project inactivity before we move on?18:46
JayF#topic Open Discussion and Review18:47
JayF#link  https://review.opendev.org/q/status:open+repo:openstack/governance18:47
JayFas mentioned earlier; please prioritize governance reviews; I will be making a pass in a couple of hours to land things eligible to land18:47
JayFand it's nice if a majority of us have voted on those changes18:47
JayFdansmith: I think you had something for open discussion18:47
dansmithJust FYI to all, I'm out for the rest of the year starting tomorrow18:48
slaweqdansmith: have a great holiday time :)18:48
JayFEnjoy your holiday!18:49
JayFAre there any other items for open discussion?18:49
dansmithI shall endeavor to do so, thanks18:49
gmannEnjoy! and forget about gate :)18:49
spotz[m]Have a good break18:49
dansmithgmann: trust me, I shan't be thinking about the gate until Jan :)18:49
fungijust don't break the gate!18:49
gmanndansmith: ++18:49
JayFLast call for items for open discussion18:50
JayFThanks for coming to the TC meeting; see you all in 1 week for our monthly video meeting o/18:51
JayF#endmeeting18:51
opendevmeetMeeting ended Tue Nov 28 18:51:23 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:51
opendevmeetMinutes:        https://meetings.opendev.org/meetings/tc/2023/tc.2023-11-28-18.00.html18:51
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/tc/2023/tc.2023-11-28-18.00.txt18:51
opendevmeetLog:            https://meetings.opendev.org/meetings/tc/2023/tc.2023-11-28-18.00.log.html18:51
slaweqo/18:51
opendevreviewJay Faulkner proposed openstack/governance master: Update email for James Page  https://review.opendev.org/c/openstack/governance/+/90211120:09
JayFjamespage: ^ fyi; unsure if this is a recent change and gerrit 3.8 made it effectively broken; or if it was a new change and this spot was missed; but would like your +1 on this 20:09
JayFfor anyone who might need to check-review-status in my stead, you need 902111 for the script to run cleanly20:10
JayFhttps://review.opendev.org/c/openstack/governance/+/898228 tc-members: this change is still 4 votes for; 1 against; 4 abstaining. I'd prefer have a clear majority before landing this if someone can prioritize reviewing this change and making an explicit vote I'd appreciate it.20:29
JayFActually, miscounted; that one is 5 for, 1 against, 3 abstains. I'll land it after lunch if no further votes.20:33
opendevreviewMerged openstack/governance master: Resolution to create openstack-unmaintained core  https://review.opendev.org/c/openstack/governance/+/90094020:38
opendevreviewMerged openstack/governance master: Appoint Andriy Kurilin as Rally PTL  https://review.opendev.org/c/openstack/governance/+/89822821:42
tonybJayF: it's for sure the change gerrit made.  A script I used for that kind of query now returns 'secondary emails not permitted'21:48
opendevreviewMerged openstack/governance master: Appoint Jerry Zhou as Sahara PTL  https://review.opendev.org/c/openstack/governance/+/89978221:49
tonybJayF: This will at least require a docs update for the election as until now we'd accept a nomination from primary and secondary addresses, now it'll just need to be primary.21:50
fungithis could also indicate some surprises for election tooling, though we have for ages told candidates to use their preferred address21:50
fungimainly because a much earlier gerrit api behavior change stopped returning secondary addresses when we query, so they have to make sure their preferred address is included in their foundation profile21:51
tonybfungi: messages crossed in the ether ;P21:55
JayFhappy to be the accidental alpha tester22:09
JayFI think that's how it should work anyway :D 22:09
tonybhehe22:16
clarkbtonyb: fungi JayF fwiw I think ther is a way to give permissions to allow that. I thought it just had to be autenticated but maybe its an acl? at least the changelog implies that it is a permissions based rejection23:09
JayFFor my purposes, it's not that hard to just use the primary email for the 9 people on the tc :) 23:11
JayFthat is not great for electioning23:11
JayFand I'm the liason this time, so I guess I don't get a get-out-of-troubleshooting-free card ;) 23:11
tonybJayF: I agree, but I don't think we'd be happy granting https://gerrit-review.googlesource.com/Documentation/access-control.html#capability_modifyAccount to everyone.23:11
JayFtonyb: we went the other way for the TC fix: we updated reference/members.yaml to contain the primary email23:12
tonybI'm researching *if* there is a setting on a secondary email address to make it public23:12
tonybJayF: Yup I think that's the best idea23:12
JayFyeah, I think that's less likely to be a good answer for elections23:12
JayFgiven we know already that we have a ... almost too effective filter on the electorate already :| 23:12
tonybJayF: if there is a setting to do that then we give $potential_ptl the choice of a) using the primary address ; or b) setting permissions on any/all secondary addresses to be visible (again if that is a thing)23:13
JayFack; I'm not really super familiar with anything administrative on the gerrit side23:17
JayFI'm happy to help at some time when I'm not in flow for other tasks if you need it, but I suspect I'd just slow you down23:17
tonybJayF: Thanks.23:18
tonybI think I'm done for today.  I have an early meeting tomorrow.23:18
JayFsounds good, have a good one23:19

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!