Thursday, 2021-10-07

Clark[m]Maybe use irrelevant-files?00:00
fungimy rough draft on the penultimate patchset of the ptgbot handler addition broke out all the letsencrypt-* roles and all the files under letsencrypt-create-certs so as to exclude handlers/main.yaml00:02
* fungi finds00:02
ianwthat says though "all of the files changed match this list"; not sure it can exclude just one file00:03
fungiyeah, https://review.opendev.org/804791 patchset 1000:05
fungii think that's what you're talking about?00:06
ianwfungi: yep, that works too00:11
opendevreviewMerged opendev/system-config master: Build our gerrit images on Bullseye  https://review.opendev.org/c/opendev/system-config/+/80928600:12
opendevreviewIan Wienand proposed opendev/system-config master: letsencrypt: avoid running on handler changes  https://review.opendev.org/c/opendev/system-config/+/81276500:39
opendevreviewMerged opendev/system-config master: ptgbot: rename site to ptg.opendev.org  https://review.opendev.org/c/opendev/system-config/+/81275500:48
opendevreviewMerged opendev/system-config master: ptgbot: Add ServerAlias for ptg.openstack.org  https://review.opendev.org/c/opendev/system-config/+/81276300:48
ianwi haven't seen cla updates, but i might restart gerrit on the new images in a few hours anyway; that gives me a few hours to monitor it and a bit longer to shake out anything before we try a 3.3 image00:53
fungisounds good, i'm still somewhat around too00:55
Clark[m]Ya apparently there are some edits they have to sort out. I think it's fine if we end up needing to do a second restart later00:56
Clark[m]I'm sort of around but shifting to less and less around00:57
fungiand now i'm nodding off ;)01:36
ianwlooks like ptg.opendev.org and ptg.openstack.org are all responding, the bot is in the channel ... i think we can say it is done!02:09
ianwprobably close for to the golden hour for putting gerrit onto bullseye.  i'll pull the images and confirm everything03:08
ianw"opendevorg/gerrit@sha256:4b708dd0fea6854d0d83624cb01c09cf41fca3d289780496c3a2f98b79a3e529"03:50
ianwthat matches dockerhub03:50
ianw#status log restarted gerrit with sha256:4b708dd0... to pick up bullseye based images03:57
opendevstatusianw: finished logging03:57
*** ysandeep|out is now known as ysandeep06:39
*** jpena|off is now known as jpena06:47
opendevreviewShnaidman Sagi (Sergey) proposed openstack/diskimage-builder master: Correct path for CentOS 9 stream base image  https://review.opendev.org/c/openstack/diskimage-builder/+/80681908:30
*** ykarel is now known as ykarel|lunch08:34
*** jpena is now known as jpena|brb09:05
*** ykarel|lunch is now known as ykarel09:52
*** jpena|brb is now known as jpena10:00
opendevreviewAnanya proposed opendev/elastic-recheck rdo: Fix ER bot to report back to gerrit with bug/error report  https://review.opendev.org/c/opendev/elastic-recheck/+/80563810:16
opendevreviewShnaidman Sagi (Sergey) proposed zuul/zuul-jobs master: Include podman installation with molecule  https://review.opendev.org/c/zuul/zuul-jobs/+/80347110:19
*** jpena is now known as jpena|lunch11:23
*** jpena|lunch is now known as jpena12:23
*** raukadah is now known as chandankumar12:28
*** Gonri[m] is now known as Goneri12:29
GoneriHim I get an "Address unreachable" when I try to reach review.opendev.org with ipv6.12:31
mordredGonéri: I'm not really here - but I can connect to the server over ipv612:33
Gonerimordred:  Thanks for the feedback. I can ping ipv6.google.com just fine. So it may be a route problem somewhere else.12:34
fungi64 bytes from review02.opendev.org (2604:e100:1:0:f816:3eff:fe52:22de): icmp_seq=1 ttl=46 time=71.8 ms12:35
fungii'm hitting it just fine from my house over my isp's v6 routes (no tunneling)12:35
fricklerGoneri: can you do a traceroute and show it at paste.openstack.org?12:36
fungiand feel free to redact the first few hops if you're concerned about giving away your local routes12:36
fungithough also a traceroute from only one side can be misleading, since routing is often asymmetric, so the place you see responses stop may just be the point of route divergence12:37
fungibut it can't hurt12:37
GoneriI will contact my provider directly, it looks they've got the route wrong.12:38
fungioh neat12:38
fungigood luck!12:38
fungilet us know if we can help12:38
fungiworst case we can try to get vexxhost involved if it's anything to do with their bgp6 announcements or something12:38
*** mrkiko_ is now known as mrkiko13:37
*** ykarel_ is now known as ykarel|away13:52
fungipython 3.11.0a1 was tagged today, i've already discovered that pyyaml is broken on it14:13
mrkikofungi: corvus: thanks a lot again for the improvements!!14:15
corvusmrkiko: you're welcome!  and i haven't forgotten there's more to do...  :)14:23
fungicorvus: did you see the mention earlier this week that on switching to the change view the cursor seems to jump to the sync counter in the corner? i wonder if forcing the focus to the first selectable widget on view change would solve that14:24
corvusfungi: that sounds like a good solution14:25
fungithe way to do that is an event trigger? i'm still struggling to grasp the model for urwid14:26
corvusfungi: i think maybe at the bottom of the changescreen constructor14:26
fungiwould it be sufficient to explicitly set focus to the change-id link, or should some sort of recursion be used to find the first selectable?14:28
opendevreviewDong Zhang proposed zuul/zuul-jobs master: WIP: Implement role for limiting zuul log file size  https://review.opendev.org/c/zuul/zuul-jobs/+/81303414:32
opendevreviewJavier Peña proposed openstack/project-config master: Give RDO 3rd Party CI user permissions on Packstack  https://review.opendev.org/c/openstack/project-config/+/81303514:36
iceyhey, is tehre anything holding back these project-config and governance changes: https://review.opendev.org/c/openstack/project-config/+/809012 https://review.opendev.org/c/openstack/governance/+/809011 ?14:48
iceys/tehre/there14:49
opendevreviewDong Zhang proposed zuul/zuul-jobs master: WIP: Implement role for limiting zuul log file size  https://review.opendev.org/c/zuul/zuul-jobs/+/81303414:49
clarkbicey: I've approved the gerrit project addition but can't speak to the openstackgovernance stuff14:50
iceythanks clarkb!14:51
iceyis there a better place to ask?14:51
fungiicey: #openstack-tc for the governance changes14:52
clarkbicey: #openstack-infra tends to have a better cross section of opendev and openstack people. Though I think the idea was always that that channel's use would slowly drive to zero and you can ask #opendev for opendev things and various openstack channels for for their stuff. #openstack-tc for governance in this case14:52
opendevreviewDong Zhang proposed zuul/zuul-jobs master: WIP: Implement role for limiting zuul log file size  https://review.opendev.org/c/zuul/zuul-jobs/+/81303414:52
fungiyeah, the openstack tc are the folks with approval rights on the openstack/governance repo14:53
iceyawesome, thanks again!14:53
fungi#openstack-infra is still more or less the home of the tact sig14:53
opendevreviewMerged openstack/project-config master: Add the cinder-netapp charm to Openstack charms  https://review.opendev.org/c/openstack/project-config/+/80901215:00
opendevreviewTristan Cacqueray proposed opendev/system-config master: Update gerritbot-matrix version to include change number in notifications  https://review.opendev.org/c/opendev/system-config/+/81304015:02
mrkikocorvus: :) :)15:28
mrkikofungi: thanks for re-reporting;15:28
fungimrkiko: i'll look into creating a fix for that as soon as my current meetings are over15:29
mrkikofungi: ahaha, don't worry. thanks a lot instead.15:29
fungiit's my pleasure, i'm always happy to fix accessability bugs15:30
*** ysandeep is now known as ysandeep|dinner15:48
corvusfungi: yeah, i think just hard-code to that15:49
fungiwill give it a shot, thanks15:50
*** marios is now known as marios|out16:04
*** hjensas is now known as hjensas|afk16:12
clarkbfungi: ianw: I think we should write a change to do the gerrit swap to the 3.3 images and start a little document on the plan we intend to take sunday/monday. Rouhgly I think the process is either land change for 3.3, wait for it to apply, pull, down only the gerrit container, run init on 3.3 with mariadb up, start gerrit container. Or manually edit docker-compose.yaml. Down gerrit16:18
clarkbcontainer only, run init, start gerrit, land change to reflect the update.16:18
clarkbThen we can followup with job cleanups to stop building 3.2 images, start building 3.4 images, update upgrade job to test 3.3 to 3.4 upgrade etc16:18
clarkbIts nto a ton of work but would be good to think it through before sunday :)16:18
clarkbI can start work on that probably after lunch. I have a few things to get done before that16:19
clarkbcorvus: also is the plan still to do a zuul restart today? I wasn't suer what other changes have landed in addition to the bug fixes since the last restart16:19
fungiclarkb: planning today sounds good, as i will try to not be at the computer tomorrow16:26
clarkband ya you should enjoy a day off16:32
fungiit will be an exciting day of influenza vaccines and updated passport photos16:32
fungithe usual sorts of things one does to unwind16:33
clarkbdrive through flu shots for the whole family have revolutionized my vaccine getting. Seriously what was once 4 separate appoibtments is now half and hour on a saturday morning16:33
*** ralonsoh_ is now known as ralonsoh16:35
corvusclarkb: yeah, i think a zuul restart today would be good; might just look at doing that after lunch?16:37
fungii expect to be around then as well16:37
clarkbcorvus: sounds good16:37
opendevreviewMerged openstack/project-config master: Set launchpad bug Fix Released after adding comment  https://review.opendev.org/c/openstack/project-config/+/80137616:38
*** jpena is now known as jpena|off16:46
opendevreviewWes Wilson proposed opendev/system-config master: Update ICLA to reference OpenInfra  https://review.opendev.org/c/opendev/system-config/+/81305516:58
opendevreviewAnanya proposed opendev/elastic-recheck rdo: Fix ER bot to report back to gerrit with bug/error report  https://review.opendev.org/c/opendev/elastic-recheck/+/80563817:10
opendevreviewWes Wilson proposed opendev/system-config master: Consistent quotes  https://review.opendev.org/c/opendev/system-config/+/81305917:13
*** ysandeep|dinner is now known as ysandeep17:18
opendevreviewWes Wilson proposed opendev/system-config master: Consistent quotes  https://review.opendev.org/c/opendev/system-config/+/81305517:37
opendevreviewWes Wilson proposed opendev/system-config master: Consistent quotes  https://review.opendev.org/c/opendev/system-config/+/81306017:37
opendevreviewWes Wilson proposed opendev/system-config master: Consistent quotes  https://review.opendev.org/c/opendev/system-config/+/81305517:57
opendevreviewAnanya proposed opendev/elastic-recheck rdo: Fix ER bot to report back to gerrit with bug/error report  https://review.opendev.org/c/opendev/elastic-recheck/+/80563818:03
opendevreviewWes Wilson proposed opendev/system-config master: Update ICLA to reference OpenInfra  https://review.opendev.org/c/opendev/system-config/+/81305518:04
clarkbfungi: do you think we should get someone other than ourselves to review 813055 just to be sure we aren't getting foundation thing straight through? I don't expect anyone would have issue with that but maybe we should have ianw and/or corvus ack it anyway?18:05
fungican't hurt, it's a fairly sensitive document18:06
fungiand there's no rush on it18:06
clarkbLuca notes that a new gerrit 3.3.x release will be happening today or tomorrow18:09
clarkbwe should rebuild our images to pick that up once it happens18:09
fungigood call18:10
*** ysandeep is now known as ysandeep|out18:39
opendevreviewClark Boylan proposed opendev/system-config master: Fix gerrit image dep in zuul config  https://review.opendev.org/c/opendev/system-config/+/81306818:50
clarkbinfra-root ^ that should be an easy one. Probably good to land that before 81305518:51
opendevreviewJeremy Stanley proposed opendev/system-config master: Turn on mod_rewrite for PTG vhost  https://review.opendev.org/c/opendev/system-config/+/81306918:51
opendevreviewJeremy Stanley proposed opendev/system-config master: Add ptgbot serveralias for redirecting PTG site  https://review.opendev.org/c/opendev/system-config/+/81307018:51
opendevreviewJeremy Stanley proposed opendev/system-config master: Update management documentation for ptgbot service  https://review.opendev.org/c/opendev/system-config/+/81307118:51
fungidiablo_rojo_phone: ianw: clarkb: ^ those are also ptgbot fixes18:51
opendevreviewClark Boylan proposed opendev/system-config master: Start building gerrit 3.4  https://review.opendev.org/c/opendev/system-config/+/79204718:59
opendevreviewClark Boylan proposed opendev/system-config master: Upgrade Gerrit to 3.3  https://review.opendev.org/c/opendev/system-config/+/81307218:59
opendevreviewClark Boylan proposed opendev/system-config master: Test upgrade from Gerrit 3.3 to 3.4  https://review.opendev.org/c/opendev/system-config/+/81307318:59
opendevreviewClark Boylan proposed opendev/system-config master: Remove Gerrit 3.2 images  https://review.opendev.org/c/opendev/system-config/+/81307418:59
clarkbok found time just before lunch to write up that stack. I'm not sure any of those changes are complete, but I think that is roughyl the set of things we want to have for the gerrit upgrade and post upgrade cleanup18:59
fungion the topic of reducing our dependence on wiki.o.o, tristanC has a series of changes up to add etherpad support to statusbot, which i haven't had time to review yet but might be nice for us to have19:00
fungii can imagine configuring with an unguessable rw pad id and then publishing the link (perhaps via a redirect or proxy) to the read-only version of it, or even embedding that into some other page19:01
fungior even using the r-o api to grab the markup version of the pad contents and then rendering them however we want19:02
clarkbfungi: question on https://review.opendev.org/c/opendev/system-config/+/81307119:02
clarkbAnd now I should go make lunch19:03
fungianswered19:04
opendevreviewKendall Nelson proposed openstack/project-config master: Add diablo_rojo as OP to #openinfra-events  https://review.opendev.org/c/openstack/project-config/+/81307619:14
opendevreviewMerged opendev/system-config master: Fix gerrit image dep in zuul config  https://review.opendev.org/c/opendev/system-config/+/81306819:25
opendevreviewJeremy Stanley proposed opendev/system-config master: Turn on mod_rewrite for PTG vhost  https://review.opendev.org/c/opendev/system-config/+/81306919:34
opendevreviewJeremy Stanley proposed opendev/system-config master: Add ptgbot serveralias for redirecting PTG site  https://review.opendev.org/c/opendev/system-config/+/81307019:34
opendevreviewJeremy Stanley proposed opendev/system-config master: Update management documentation for ptgbot service  https://review.opendev.org/c/opendev/system-config/+/81307119:34
opendevreviewJeremy Stanley proposed opendev/system-config master: Update ptgbot jobs to use #opendev-sandbox channel  https://review.opendev.org/c/opendev/system-config/+/81307719:34
opendevreviewMerged openstack/project-config master: Add diablo_rojo as OP to #openinfra-events  https://review.opendev.org/c/openstack/project-config/+/81307619:40
opendevreviewAnanya proposed opendev/elastic-recheck rdo: Fix ER bot to report back to gerrit with bug/error report  https://review.opendev.org/c/opendev/elastic-recheck/+/80563819:53
clarkbfungi: forsome reason I thought they were hosting it under openinfra fro the same reasons we moved the irc channel19:56
fungithe repo wasn't moved out of the openstack namespace, it's currently tracked as belonging to openstack's tact sig19:57
clarkbfungi: re https://review.opendev.org/c/opendev/system-config/+/813077 I wouldn't expect we need to set the var in the group vars and the defaults. It should be enough to set the value in defaults, but it doesn't hurt to also set it in group vars19:57
fungiclarkb: i think the problem is the defaults is never hit because we set it in our global group vars19:57
clarkbah19:57
fungiit's set in inventory/service/group_vars/eavesdrop.yaml19:58
fungiso we need to override that with the test-specific group vars19:58
clarkbgot it, then ya we need to override in the zuul group vars file. We might consider dropping the default in that case but doesn't hurt to have it there iether19:58
clarkba more typical pattner would be to have the role express what we want out of production then only override in zuul vars19:59
fungii considered that, but then we have a required variable with no default provided in the role19:59
fungiand yeah, we could do it that way instead19:59
opendevreviewClark Boylan proposed openstack/project-config master: Update gerrit image dep for jeepyb triggered builds  https://review.opendev.org/c/openstack/project-config/+/81308020:06
opendevreviewClark Boylan proposed openstack/project-config master: Update jeepyb to trigger Gerrit 3.3 image builds  https://review.opendev.org/c/openstack/project-config/+/81308120:06
clarkbfungi: https://review.opendev.org/c/openstack/project-config/+/813080 is a similar fixup to https://review.opendev.org/c/opendev/system-config/+/81306820:07
opendevreviewClark Boylan proposed opendev/system-config master: Remove Gerrit 3.2 images  https://review.opendev.org/c/opendev/system-config/+/81307420:07
clarkbhttps://review.opendev.org/q/hashtag:gerrit-3.3+status:open I'm trying to accumulate these changes under that hashtag. Though i notice that only the change owner can set hashtag on those repos :/20:09
clarkbfungi: oh I hadn't realized that https://review.opendev.org/c/opendev/system-config/+/813055/ failed CI. Note that my earlier change wasn't related to that. Looking at the failures we seem to do enough validation of the cla content to ensure we are serving static content properly that we need to update the change for that too20:14
clarkbI'll ask wes if he wants to do that or I can update it20:14
fungioh, good point, i saw the failures and assumed they were related to the bullseye image change, i should have dug deeper there20:14
clarkbassert 'OpenStack Project Individual Contributor License Agreement' in cmd.stdout is what we check but the cla is being updated to say 'OpenInfra Foundation Individual Contributor License Agreement'20:15
fungiindeed, good test!20:16
opendevreviewClark Boylan proposed opendev/system-config master: Update ICLA to reference OpenInfra  https://review.opendev.org/c/opendev/system-config/+/81305520:17
clarkbfungi: ^ I think that will fix the testing20:17
clarkbhttps://review.opendev.org/c/opendev/system-config/+/813073/ getting a +1 from zuul the first time around scares me :)20:18
clarkb(that updates the upgrade testing we do for gerrit from 3.2 -> 3.3 to 3.3 -> 3.4)20:18
clarkbI forgot about that test but we added it when we got the paths for static file serving wrong20:18
clarkbIf we can land https://review.opendev.org/c/opendev/system-config/+/813055 today and restart on the updated image that would be a good point to stop for merging things pre upgrade then hashtag:gerrit-3.3 stuff should be ready to land Sunday as we work through the process20:22
clarkbLooks like we lost the matrix bridge almost an hour ago20:24
clarkbI'm chatting with corvus on matrix since he isn't here right now20:35
clarkbI think we'd like to go ahead and do that zuul restart nowish.20:35
clarkbI don't see any openstack release activity20:35
clarkbI'll let them know anyway20:35
fungiokay, i'm around for a few more minutes before i need to switch to dinner prep for a bit20:36
clarkbcorvus reports the restart is beginning20:37
clarkbwell the process to restart is beginning20:37
fungithanks!20:37
clarkbcorvus notes that we'll be relying on the periodic cleanup routine in zuul to clean up the leaked entries. So we should see that graph trend the other direction after about an hour when the routine starts20:40
clarkbbasically the restart itself isn't going to clean things up20:40
fungiahh, very cool20:40
fungiand a great test of the cleanup20:41
clarkbya20:41
fungihas reenqueuing started yet?20:51
clarkbyes20:52
clarkbas expected https://grafana.opendev.org/d/5Imot6EMk/zuul-status?viewPanel=37&orgId=1 doesn't show dramatic update to the znodes, but we should expect that cleanup in an hour or so20:52
clarkbit is up and reenqueuing has begun. When reeqeuing is done I'll #status log the info20:53
fungithanks!20:54
ianwclarkb: thanks for the gerrit work.  will look over in a little, and start a upgrade checklist etherpad20:57
clarkbianw: sounds good20:57
clarkbalso I think for the 3.3.7 release we'll want a change that bumps up the tag versions of plugins on the 3.3 build to do that. Assuming that doesn't arrive until tomorroe I can push that up and self approve it I guess20:58
ianwfungi: i thought i did test the ptg redirects, were they not working?20:58
clarkbianw: thsi is a new redirect because ptgbot.opendev.org was apparently communicated in non zero locations20:59
clarkboh you mean the mod rewrite thing?20:59
ianwhttps://review.opendev.org/c/opendev/system-config/+/813069/ where it enables mod_rewrite20:59
ianwthe ptgbot thing is fine, but i guess we need to add back dns and LE generation?21:00
*** dviroel is now known as dviroel|out21:02
clarkbya21:04
clarkbfungi: ^ were there LE changes?21:04
clarkb#status log restarted all of zuul on commit 96c61208a064a2c5cabe1446bafdd58d1d1387c421:04
opendevstatusclarkb: finished logging21:05
ianwi can add those bits in a bit too21:05
ianwjust have to eat some breakfast and reset a few things as we had a power outage overnight21:06
fungii'll have to catch up after dinner21:07
opendevreviewMerged openstack/project-config master: Update gerrit image dep for jeepyb triggered builds  https://review.opendev.org/c/openstack/project-config/+/81308021:09
fungiianw: the http to https redirect worked but https to https did not21:10
fungiadding the rewriteengine directive on the server temporarily solved it for me21:11
fungihttp to https was using a redirect directive which works fine on its own, but the rewrites on the https vhost were being ignored21:12
simondodsleywhatever the outage just was I now see patch 810331.11 running in both gate and check. Can someone kill the check job, but leave the gate running?21:13
clarkbas mentioned in #zuul before you moved over, I think I'm happy to let both buildsets run as I don't expect it will cause problems. Though I need to pop out now for a school run so can't dequeue anyway21:14
clarkbmaybe fungi or ianw can do that if we need to21:14
simondodsleyclarkb, thanks21:16
ianwfungi: ahh.  i don't try to hit the http sites but i guess firefox's default behaviour is to go there.  i did think they switched it to https first 21:22
fungiianw: it's configurable in ff's settings21:22
ianwwell it found one problem, but made me miss another ... i guess it's even :)21:23
fungiregardless, with the rewriteengine addition to the config it should be fine. part of the confusion there is mixing redirect and rewrite directives21:24
fungitook me a little while to figure out what wasn't working exactly21:24
fungiianw: since the fix hasn't deployed yet, if you browse to https://ptg.openstack.org/ptg.html you'll see it doesn't (yet) correct the domain in the url21:25
opendevreviewIan Wienand proposed opendev/zone-opendev.org master: Re-add ptgbot site  https://review.opendev.org/c/opendev/zone-opendev.org/+/81308821:26
fungithanks! i was just about to write that one after your prescient comment reminded me21:27
ianwclarkb: if you have a quick sec for https://review.opendev.org/c/opendev/system-config/+/812765 that will stop us running the LE job for changes like this21:28
fungiianw: minor issue noted inlinne on 81308821:30
opendevreviewIan Wienand proposed opendev/zone-opendev.org master: Re-add ptgbot site  https://review.opendev.org/c/opendev/zone-opendev.org/+/81308821:31
*** diablo_rojo_phone is now known as Guest213321:35
opendevreviewMerged opendev/system-config master: Update ptgbot jobs to use #opendev-sandbox channel  https://review.opendev.org/c/opendev/system-config/+/81307721:35
opendevreviewMerged opendev/system-config master: Turn on mod_rewrite for PTG vhost  https://review.opendev.org/c/opendev/system-config/+/81306921:35
fungic21:39
fungihah, you're not my mutt window21:39
opendevreviewMerged opendev/zone-opendev.org master: Re-add ptgbot site  https://review.opendev.org/c/opendev/zone-opendev.org/+/81308821:44
ianwclarkb: starting on https://etherpad.opendev.org/p/gerrit-upgrade-3.321:51
ianwclarkb: good point, i'll start mariadb separately because sometimes the pull refreshes that image too, so good to give it a restart22:05
clarkbwfm22:07
opendevreviewMerged opendev/system-config master: Add ptgbot serveralias for redirecting PTG site  https://review.opendev.org/c/opendev/system-config/+/81307022:21
opendevreviewMerged opendev/system-config master: Update management documentation for ptgbot service  https://review.opendev.org/c/opendev/system-config/+/81307122:21
ianwclarkb: does gerrit write out backup files, or should we do something like a hash comparision?22:38
clarkbianw: we would need to check ourselves. Maybe just backup those fiels so we can diff them and correct the ansible templates if necessary22:38
clarkbthough as noted there I seem to have checked this previously and at least for our test install of gerrit there was no change22:38
fungii suppose automating an exact comparison in an upgrade test wouldn't be hard. automating an inexact comparison tolerant of trivial changes however, far harder22:55
fungiclarkb: if you get time, https://review.opendev.org/812527 was the bridge upgrade check we mentioned, looks like it implies we could upgrade bridge.o.o to focal if we want22:57
funginot urgent, but system-config-run-base-ansible-devel does succeed on it as well22:58
fungiso that theory panned out at least22:58
clarkbcool and ya I just pushed a zuul bug fix, let me double check the upgrade etherpad again and then I can review it22:58
clarkbianw: left a comment on step 9 that I think is important if you can dobule check that23:01
clarkbfungi: do you have the etherpad url for the mega upgrade from 2.13 to 3.2 handy? that would give us more info on the init command to run23:02
clarkbthough I'm reasonably confident we should be using what we use in ansible for testing23:02
clarkbalso we halved our znodes in zk when zuul cleanup ran23:03
clarkbwe are about 9k above our previous steady state23:03
clarkbianw: would you be willing to review https://review.opendev.org/c/opendev/system-config/+/813055 as well?23:07
clarkbthat is the cla update we thoguht might be coming tomorrow. I don't want to approve it sicne the submitter and current reviewers are foundation staff, would be good to have another party just sanity check us23:08
ianwclarkb: sure, i don't know about the leagalese but it looks like it does what it says :)23:15
ianwwhat does d/b/a mean?23:16
ianw... https://en.wikipedia.org/wiki/Trade_name23:17
ianwTIL23:17
clarkbya its the lightweight way of renaming yourself aiui23:21
clarkbotherwise the process is far more invovled23:22
fungiclarkb: i can find it, just a sec23:28
fungiclarkb: https://etherpad.opendev.org/p/gerrit-upgrade-202123:30
ianwclarkb: i'll keep an eye on the gerrit twitter, but it does seem to run on a EU-ish TZ23:31
ianwfor a 3.3.7 release23:31
clarkbfungi: I think that is the server upgrade not service upgrade?23:31
clarkbianw: thanks23:31
fungiclarkb: ahh, yep, i'll dig back farther23:31
clarkbhttps://etherpad.opendev.org/p/gerrit-2.16-upgrade was in that etherpad I think that is what I was looking for23:32
clarkbianw: ya ^ shows us using the init commands like I put in the new etherpad from ansible, I think we should update to mimic on the 3.3 task list23:32
ianwyep, agree and updated that step23:32
fungiclarkb: https://etherpad.opendev.org/p/opendev-gerrit-3.2-upgrade-plan23:33
clarkbah that was the other one, cool we have lots of info :)23:33
fungimaybe?23:33
clarkbianw: re updating the plugins what I typically do is open the google source page for each plugin and check if there is a stable-3.3 branch for it. If not use the latest tag which should be 3.3.7 post release23:38
clarkbianw: then I think I remember that we also have to change the Dockerfile otherwise the jobs don't run the way we want23:38
clarkbthe change I made for updating mordreds 3.4 build change does that if you compare patchsets (but there was a rebase so that might be a little ugly)23:39
clarkbinteresting the matrix bridge to oftc sees our communication here but if I send a message from the matrix side it does not go through23:40
ianwyep, some like the its-base seem to have not make a 3.3 branch23:41
ianwi'm not sure that happens by default, or only at the point it needs a separate branch because master merged something incompat23:41
ianw(e.g. the zuul-summary-plugin current has no branch)23:41
clarkbI suspect that for many it is a compat thing23:42
clarkbbut the way they do branches has always confused me23:42
ianwyes they merge upwards instead of what i feel is more logical which is cherry-picking changes you need downwards23:43
clarkbfor a half second I was worried that it seemed we weren't allocating nodes maybe we quickly as I woudl expect, but it seems things are happy looking at grafana23:59
clarkbjust normal slowness (the cla update change in particular is waiting on a node, but I expect that is just normal wait though I hanve't look at logs for it)23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!