Tuesday, 2024-02-20

clarkbis the wiki not responding for anyone else? cc infra-root00:02
clarkband its back again. Looks like system load average was a bit high but I don't see anything amiss after ssh in and taking a quick look00:04
clarkband the agenda is sent. See yall then00:06
fungiclarkb: database backups maybe?00:10
Clark[m]Ooh ya could be backups00:15
opendevreviewTakashi Kajinami proposed opendev/yaml2ical master: Modernize python versions  https://review.opendev.org/c/opendev/yaml2ical/+/90948801:49
tkajinamI wonder where the job for that yaml2ical repository is configured ?02:56
fungitkajinam: which job? are you looking for opendev/irc-meetings maybe?03:22
tkajinamfungi, I was looking for what should be updated to get rid of tox-py35 job run there03:22
fungioh, checking03:23
tkajinamthe repository contains no .zuul.d or .zuul.yaml and seems jobs are configured differently in that repo, I guess03:23
fungitkajinam: https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L51503:25
tkajinamyeah seems that's the one03:26
fungiprobably we just never got around to moving its jobs in-repo after the zuul v3 transition years ago03:26
fungii can't think of any good reason not to, it simply doesn't seem to have happened03:27
tkajinamyeah03:27
opendevreviewTakashi Kajinami proposed openstack/project-config master: Drop py35 job template from yal2ical  https://review.opendev.org/c/openstack/project-config/+/90949403:27
opendevreviewTakashi Kajinami proposed opendev/yaml2ical master: Modernize python versions  https://review.opendev.org/c/opendev/yaml2ical/+/90948803:29
opendevreviewTakashi Kajinami proposed opendev/yaml2ical master: Modernize python versions  https://review.opendev.org/c/opendev/yaml2ical/+/90948803:29
tkajinamfungi, ok you now know where I got the base content for .zuul.yaml :-P03:32
tkajinamthat's should be fixed in the latest patch but I'll see which job may be triggered03:32
fungi~yep03:33
tkajinamah, wait03:33
tkajinamlet me drop pep8 as well. I'm adding it to the repository side03:33
fungik03:33
opendevreviewTakashi Kajinami proposed openstack/project-config master: Drop python jobs from yal2ical  https://review.opendev.org/c/openstack/project-config/+/90949403:35
tkajinamseems we have to merge the project-config update first to disable these jobs, but at least I saw pep8 job and py3(8|11) job were triggered so the update should work fine03:36
tkajinamwe may want to remove a few remaining jobs from the other repos but I'll look into these later when I get time.03:37
tkajinamfungi, thanks for your prompt help as always :-)03:37
fungiyes, project-config is a trusted config repo in that zuul tenant, so you can't get speculative execution of job changes in it for security reasons03:37
tkajinamah, I see03:37
fungibut once 909494 merges, rechecking 909488 should work as intended03:38
tkajinamyes. I'll post recheck once that one is merged03:38
opendevreviewMerged openstack/project-config master: Drop python jobs from yal2ical  https://review.opendev.org/c/openstack/project-config/+/90949403:49
opendevreviewTakashi Kajinami proposed opendev/yaml2ical master: Modernize python versions  https://review.opendev.org/c/opendev/yaml2ical/+/90948804:55
*** dmellado74522 is now known as dmellado745211:06
*** dmellado74522 is now known as dmellado745212:00
opendevreviewMerged opendev/yaml2ical master: Modernize python versions  https://review.opendev.org/c/opendev/yaml2ical/+/90948813:36
opendevreviewTakashi Kajinami proposed openstack/project-config master: Retire PowerVMStacker SIG: End Project Gating  https://review.opendev.org/c/openstack/project-config/+/90953513:46
opendevreviewTakashi Kajinami proposed openstack/project-config master: Retire PowerVMStacker SIG: Remove Project from Infrastructure Systems  https://review.opendev.org/c/openstack/project-config/+/90958414:06
*** dhill is now known as Guest33815:02
clarkbif anyone ever wonders what "speech-dispatcher-dummy" is in your pavucontrol playback list it is apparently a screen reader thing in gnome/xfce15:37
fungias i don't use fancy feature-rich desktop environments, i doubt i have that15:41
fungibut good to know!15:41
clarkbfungi: I'm already thinking of the possibilities. I could have my morning emails dictated to me while I drink tea!15:43
fungii'd spend too much time geeking out over which voicefont i wanted15:47
opendevreviewMerged openstack/project-config master: Retire PowerVMStacker SIG: End Project Gating  https://review.opendev.org/c/openstack/project-config/+/90953516:04
JayFI am working on moving from gnome->sway (i3 except wayland-flavored)16:21
JayFit's amazing how simplifying environments can help you more easily direct your focus where you want it16:21
fungistill using ratpoison, myself16:24
clarkbya I use xmonad with xfce. xfce is primarily there so I don't have to micro manage things like fonts and batteries16:24
JayFfungi: sounds to me like ratpoison and sway are cousins, at least :D 16:30
fungiseems similar, yep16:31
mnaserI don't assume there is a large particular interest in using OpenDev's Zuul for GitHub projects?18:20
mnaserI know it's been brought up but we've got a somewhat vocal community that wants to use the github workflow but use zuul for testing and what not18:21
clarkbmnaser: no, we did a small poc with kata and found that we end up in a culture clash where people don't want to debug anything and just want everythign to work for them but we aren't github experts and we end up at an impasse18:21
mnaserclarkb: but say if someone shows up and actually sorts out what's needed, or is it kindof a case closed and i should spin up my own instance18:22
clarkbI expect the current admins are unlikely to want to reopen that can of worms18:22
mnaserfair enough18:22
mnaserguess i'll have to stand up an instance :<18:23
clarkbgithub as a tool is difficult to integrate with in a reliable manner without significant investment18:23
mnaserright, i figured we were gonna do that investment anyways18:23
mnaserbetter than doing that AND operating zuul18:23
clarkbjust setting up appropriate acls is a major problem. Then you're dealing with rate limits and weird behaviors like doing PRs from the same repo to iself whcih lead to branch deletions whcih break things18:24
mnaseryeah i dont expect to be getting much support for it18:24
mnasermostly here's your project-config and glhf18:24
mnaserbut of course that's half the story if there are rate limits or whatever that will need admin assistance for logs18:25
clarkbunfortunately that isn't what we need because you can't debug the issues in that situation18:25
mnaseryeah fair nuff18:25
mnaserwelp, off to deploying a zuul instance i guess18:25
fungimnaser: put another way, we collectively decided that the opendev collaboratory includes an integrated code review+project gating solution, which includes a zuul deployment to provide that project gating, but the zuul exists as part of that combination and not in service of doing code review outside the collaboratory18:26
fungii.e. we're not offering zuul-as-a-service, it's zuul+gerrit-as-a-service18:26
mnaserthat's what i've been under the assumption of, but i thought it doesn't hurt to ask18:26
clarkbwhat we can do and have tried to make work is third party CI18:32
mnaserso no gating but just jobs?18:32
clarkbthe main gotcha for that right now is I think our current acl set on the zuul application in github assumed we might want to merge PRs so we need to prune that down to make people more comfortable18:32
clarkbmnaser: yes and specifically jobs that have an intersection between projects we host and projects on github18:33
mnaseryeah understandable18:33
clarkbmnaser: one example historically not sure if still in use is the openstack ansible modules doing testing and reporting to ansible PRs18:33
clarkbbut in theory we could do similar with eventlet and openstack or ansible and zuul though neither of those are a thing today18:33
fungialso jobs for projects hosted in opendev consuming source code from other hosting locations (including github)18:34
mnaseryeah in this case since its the reverse it doesnt really help18:34
fungithe other gotchas with either acting as a third-party ci to or consuming projects hosted elsewhere is that we can't safely consume zuul configuration in repositories that aren't gated by our zuul, so there inevitably ends up being a config project in gerrit where the job/project-pipeline stuff resides18:36
clarkbfungi: I think we were hoping to push that into the "hosting" project on the openstack side18:38
clarkbyou should be able to add the project to the tenant config then your hosting project can define the jobs that use it. However, if you want the github side to trigger then ya we need it in a config project18:38
fungiyeah, though in cases like pyca/cryptography's arm64 wheel builds, there was no clear place to stick it18:39
clarkbspeaking of I think we can turn that off now? I don't think it has been used in a bit18:40
clarkbanother example of how trying to work with github fails. They turn things off and say nothing ...18:40
JayFI can ask the cryptography folks if you want19:50
clarkbJayF: I don't think it hurts, but it has also been long enough that we can probably just clean stuff up on our side19:53
clarkband if they are able to get arm64 wheels built elsewhere then the utility we provide is limited19:53
fungithe impression i got was they dropped our zuul's access the moment github actions grew arm64 support19:54
clarkbah that could be19:55
clarkbwhich is also likely a simplification for them19:56
JayFconfirmed out of use20:11
tonybSorry I missed the team meeting earlier20:14
fungigotta sleep sometime20:16
fungiclarkb: so skimming our lodgeit source, it wants to use pillow to generate the captcha images. wasn't there a recent backward-incompatible major release of pillow and/or related libs?21:13
clarkbI'm not sure but it wouldn't surprise me. Server logs may have tracebacks that give us a clue21:13
fungiwe don't seem to cap it in requirements.txt21:13
clarkbfor context diablo_rojo discovered that the captcha is broken on paste so you can't post things that need a captcha to pass21:14
fungi`docker-compose logs lodgeit` is quite slow21:15
clarkbit will be logs from the beignning of the container starting21:15
clarkbthis is one of the advantages of the syslogging if we have it for that service21:15
clarkbI need ot eat lunch now though. And then do the service coordinator election thing21:16
fungitext_size = self.font.getsize(self.text)21:18
fungiAttributeError: 'FreeTypeFont' object has no attribute 'getsize'21:18
fungilooks familiar21:19
fungibeing raised a few layers deep from Captcha().get_response(set_cookie=True)21:20
fungilooks like we want pillow<10 or switch to calling getsize() on a font face instead21:23
fungior switch to the getbbox or getlength methods21:24
fungilooking around i see several of these approaches used... any preference?21:27
fungii don't think it's really passing untrusted user input to pillow, so my security concerns with pinning it are minimal21:28
Clark[m]Ya the input isn't from the user it's randomly generated words from the service aiui21:29
fungibut on the other hand it could be a fairly simple patch to fix the call for pillow v10, or it could just be the tip of a much larger iceberg21:29
Clark[m]I think it is figuring out sizes in order to make them fit in the final image?21:31
Clark[m]Not sure which alternative maps most closely to that 21:31
fungilike here's someone who did fix it quite trivially, so maybe if it's our only issue with new pillow? https://github.com/Belval/TextRecognitionDataGenerator/pull/328/files21:31
Clark[m]Could be. Can use a held node to test. Mine even maybe21:39
Clark[m]That shouldn't impact the db work21:39
fungiClark[m]: i hacked it onto the server since it was already broken, seems like switching to getbbox worked, test to see if it's good for you and i'll propose the change21:44
opendevreviewJames E. Blair proposed zuul/zuul-jobs master: prepare-workspace-git: Add ability to define synced pojects  https://review.opendev.org/c/zuul/zuul-jobs/+/88791721:46
clarkbfungi: ack testing now21:47
clarkbfungi: I get a captcha now but the text isn't very readable and it is shifted into the bottom right of the captcha21:48
clarkbok failed that captcha then it made a new one that I was able to pass21:48
clarkbi think this is an improvement and we should oprobably merge it and can always improve later21:49
opendevreviewJeremy Stanley proposed opendev/lodgeit master: Support Pillow v10  https://review.opendev.org/c/opendev/lodgeit/+/90961821:49
fungiyeah, i mean, those captchas are terrible, but they always were21:50
clarkbindeed. And it is definitely better than the error we had previously21:50
clarkbsnowman ☃ in my test paste server doesn't seem to work but it does in prod22:00
clarkbinteresting22:00
clarkbsqlalchemy.exc.DataError: (pymysql.err.DataError) (1366, "Incorrect string value: '\\xE2\\x98\\x83' for column `lodgeit`.`pastes`.`code` at row 1")22:02
clarkbI wonder if we manually changed the db datatypes in prod many moons ago and lodgeit doesn't properly set that up on a new instance22:04
clarkbya the test db is set to latin122:06
clarkbthe default is still latin1 in prod but the table seems to have set utf8 explicitly22:08
clarkbI'm going to ignore that for now22:09
clarkbI have two pastes of only latin1 content on the test server. One short trivial one and one a bit longer. I'm going to try the db upgrade process now22:11
clarkbhttps://paste.opendev.org/show/bWhZZH97IMLv44eeiWlB/ this is the result. I think it is happy from what I have seen so far22:18
clarkbIt does look like a temporary server is started that will complain about type deltas on system tables (this server is started to do the backup I think). Then that temp server is stopped and the upgrade process si performed22:19
clarkbso the errors are ok?22:19
clarkbthe upgrade process for those same tables reports OK later22:20
clarkbalso I added the env var flag to do the upgrade and bumped the image version at the asme time so we don't need to step those through and can use a single change for both updates22:20
clarkbI'll update the change to do that. I think we can even let automated deployments do the updates for us if we awnt or we can do it by hand then merge the change to reflect the new status. We can discuss thati n review22:24
opendevreviewClark Boylan proposed opendev/system-config master: Upgrade the lodgeit mariadb to 10.11  https://review.opendev.org/c/opendev/system-config/+/90947122:28
fungisounds great, thanks!22:30
clarkbI wonder if "user tables won't be touched" implies it can do something like an automatic conversion from latin1 to utf822:31
clarkbthat said I think leaving the actual db tables alone is what we want here22:32

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!