| opendevreview | Ian Wienand proposed opendev/system-config master: [wip] small overhaul of rpm builds https://review.opendev.org/c/opendev/system-config/+/906013 | 00:02 |
|---|---|---|
| opendevreview | Ian Wienand proposed opendev/system-config master: [wip] small overhaul of rpm builds https://review.opendev.org/c/opendev/system-config/+/906013 | 01:07 |
| ianw | ^ at least that tells us clearly why it was failing | 01:53 |
| ianw | *** Running kernel does not have headers | 01:53 |
| ianw | cur=4.18.0-532.el8.x86_64 | 01:53 |
| ianw | kernels | 01:53 |
| ianw | kernel-devel-uname-r = 4.18.0-535.el8.x86_64 | 01:53 |
| ianw | | centos-8-stream-d1380f065f264bc0af1193466458adcc | centos-8-stream | nb01.opendev.org | qcow2,raw,vhd | ready | 13:06:52:50 | | 01:57 |
| ianw | | centos-8-stream-447e693eca05446ea9e6c4f33accbaaf | centos-8-stream | nb02.opendev.org | qcow2,raw,vhd | ready | 06:04:04:59 | | 01:57 |
| Clark[m] | Oh I bet those images refresh weekly now | 02:00 |
| Clark[m] | That would explain at least some of the delay | 02:00 |
| ianw | -rw-r--r-- 1 nodepool nodepool 1.3M Dec 21 15:22 centos-8-stream-2a2b6da68bef4c4dad1eebea9c0de0b2.log | 02:05 |
| ianw | -rw-r--r-- 1 nodepool nodepool 1.3M Dec 28 17:13 centos-8-stream-7696746ed6004390b0dd7746188c73b1.log | 02:05 |
| ianw | -rw-r--r-- 1 nodepool nodepool 1.3M Jan 4 19:03 centos-8-stream-d1380f065f264bc0af1193466458adcc.log | 02:05 |
| ianw | that would explain the cadence ... | 02:05 |
| ianw | well i've kicked off two fresh builds of those | 02:10 |
| ianw | 906013 is likely to pass with new images | 02:11 |
| frickler | updating the mirror02.ord.rax.opendev.org cert seems to have worked tonight, yay | 08:18 |
| frickler | same for review.opendev.org | 08:19 |
| *** benj_4 is now known as benj_ | 08:24 | |
| ianw | https://zuul.opendev.org/t/openstack/buildset/5df314803b564a5998322825f7a9deb7 ... seems we're still behind on the centos-8-arm64 image, but when that appears i think we should be back to working openafs | 08:32 |
| opendevreview | Ian Wienand proposed opendev/system-config master: roles/openafs-client: small overhaul of rpm builds https://review.opendev.org/c/opendev/system-config/+/906013 | 08:40 |
| *** dmellado747 is now known as dmellado74 | 10:58 | |
| *** dmellado745 is now known as dmellado74 | 11:07 | |
| *** priteau_ is now known as priteau | 12:14 | |
| clarkb | OIL episode is done. I'm going to find braekfast then be back in an hour or so. I'm going to look at maybe approving those gitea changes today | 16:09 |
| fungi | yeah, heading out to lunch here, and then need to finish up some paperwork but i'll be around again after ~17:30 utc if i'm needed | 16:16 |
| *** tosky_ is now known as tosky | 16:41 | |
| clarkb | I'ev approved https://review.opendev.org/c/opendev/system-config/+/905020 which I wanted to go in before the robots.txt fix if possible | 17:21 |
| clarkb | fungi: maybe when you get back from lunch you want ot approve the robots.txt update? | 17:21 |
| fungi | sure, can do | 17:54 |
| jrosser | is there any possibility to have `job.collections` in a similar manner to `job.roles`? | 17:54 |
| clarkb | haproxy has made new releases I'm going to push up a change to test if they fix our issue. Not beacuse I think we should get off of the lts tag but because I want ot make sure that 2.9 eventually fixes things as I assume one day it will be an lts | 17:55 |
| clarkb | jrosser: that is currently unimplemented but something like that has been talked about in the past. There may even be a zuul spec for it | 17:55 |
| clarkb | may be worth discussing in the zuul matrix room if you are in that room. | 17:56 |
| jrosser | i am - i can do that | 17:57 |
| opendevreview | Clark Boylan proposed opendev/system-config master: DNM Use latest haproxy image to test newer versions https://review.opendev.org/c/opendev/system-config/+/906058 | 18:00 |
| TheJulia | hey folks, eventlet has unfortnately put one of ironic's repos in a not great state for the docs job. Is there any clean/happy/preferred way to make our docs job non-voting specifically when we're using a template from the system | 18:00 |
| clarkb | TheJulia: I'm not positive of this but I think you may be able to list the job in your jobs list and set it to non voting and have that override things | 18:01 |
| clarkb | if I'm wrong that should throw an error about duplicate jobs or something along those lines and return quickly I hope | 18:01 |
| TheJulia | clarkb: That is kind of what I was thinking as well | 18:01 |
| * TheJulia gives it a spin | 18:01 | |
| clarkb | and in that case you'd have to drop the template and list the jobs explicitly | 18:01 |
| fungi | TheJulia: another possibility is that something is not quite right with the tox config on that repo and is causing newer eventlet to be installed than what's in the requirements upper-constraints.txt | 18:05 |
| fungi | docs builds often have an extra bit of configuration which was problematic in tox v4, and may have gone unnoticed until now | 18:06 |
| TheJulia | it might be fine in u-c, the underlying issue regardless is a bug which is not common and we don't have a forward path on yet, either. | 18:06 |
| fungi | yeah, i mean you may have two bugs: constraints not being applied to your docs builds and also docs builds not working with latest eventlet (which will become relevant anyway once constraints updates for that) | 18:07 |
| JayF | I suspect we have more like 17 bugs and we're up to like, 3 of them identified ;) | 18:08 |
| TheJulia | heh | 18:08 |
| JayF | some combo of werkzeug + new eventlet + sphinx autodoc | 18:08 |
| TheJulia | We also don't care *as* much, since the specific repo is on the exit path in the grand scheme of things | 18:08 |
| fungi | well, yes, i didn't mean to imply that was the upper limit of your bug count, merely the lower limit of bugs affecting your docs builds ;) | 18:09 |
| JayF | fungi: I'm only talking about the docs build | 18:09 |
| fungi | hah, okay | 18:09 |
| JayF | I have stared into the sphinx, it gave me a riddle, I said "I'm only A MAN!" and it was like "correct" | 18:09 |
| JayF | and now I have all these bugs to fix | 18:10 |
| TheJulia | well, zuul didn't glare at me immediately | 18:10 |
| TheJulia | so there *is* hope | 18:10 |
| fungi | riddle me this | 18:11 |
| TheJulia | wait, who is batman in this context? | 18:11 |
| fungi | dunno, but i figure the sphinx and the riddler have something in common | 18:11 |
| JayF | batman is the one walking on zero legs and one grappling hook | 18:11 |
| * TheJulia wonders if JayF is describing an incorrectly assembled or "new age" office chair | 18:13 | |
| JayF | I'm trying to make a joke referencing the riddle of the Sphinx (What walks on four legs in the morning, two legs in the afternoon, and three legs at night?) | 18:14 |
| JayF | (the answer is "a man/human/person") | 18:14 |
| clarkb | looking at zuul status it appears my suggested method did work | 18:20 |
| * clarkb hopes to remember that for next time | 18:20 | |
| TheJulia | it.. also... passwed. | 18:31 |
| fungi | this too shall pass | 18:36 |
| TheJulia | Well, my mind is more in the mood for T'pol saying "facinating" or "intruiging" | 18:37 |
| fungi | or t'pau saying: "if both survive the lirpa, combat will continue with the ahn woon" | 18:39 |
| fungi | (most iconic tos episode evar) | 18:39 |
| TheJulia | I actually remarked about the main scene to someone this past weekend | 18:40 |
| fungi | i only recently got clearance from my better half that we could start watching strange new worlds together, and i was rather impressed with the relevance and accuracy of original series references | 18:41 |
| * fungi did not have high hopes going into it | 18:41 | |
| opendevreview | Merged opendev/system-config master: Disable gitea's update checker cron job https://review.opendev.org/c/opendev/system-config/+/905020 | 18:44 |
| clarkb | review.o.o did trip the certcheck alert. But looking at it in my browser the cert is updated. That one may need an apache restart if it doesn't clear out the older worker on its own | 18:46 |
| fungi | i thought the alert had merely raced fixing the base deploy job | 18:47 |
| fungi | wasn't going to pay it much heed unless it happened yet again | 18:47 |
| clarkb | ++ | 18:47 |
| clarkb | seems 905020 did not restart services (this was expected just confirming this) | 19:11 |
| clarkb | and new haproxy doesn't break afte 4k connections: https://zuul.opendev.org/t/openstack/build/4511def4d43b49c1a3c34624892ee74e/log/job-output.txt#30770 | 19:12 |
| opendevreview | Merged opendev/system-config master: Update our Gitea robots.txt from gitea.com's https://review.opendev.org/c/opendev/system-config/+/904868 | 19:27 |
| clarkb | thinking out loud for preptg planning. Maybe something like wednesday + thursday in a to be determined week. I would do Monday + Tuesday but Tuesdays tend to be filled with other meetings for me. Then the next questions are how to deal with timezones and which week do we ant to do. Also this is just brainstorming feel free to suggest alternatives | 19:30 |
| opendevreview | Merged openstack/project-config master: Retire heat-cfnclient: End Project Gating https://review.opendev.org/c/openstack/project-config/+/905818 | 19:31 |
| clarkb | if I stay up late we can get not compeltely terrible overlap with my timezone (and corvus') as well as tonyb and frickler. Something like 06:00-08:00 UTC. But that excludes fungi. If we do time around 14:00UTC-16:00UTC that excludes tonyb but should work for everyone else. And if we did say 21:00-23:00 UTC we'd exclude frickler but be somewhat reasonabel for everyone else | 19:34 |
| clarkb | talking out loud here maybe we pick two of those opptions each day for a total of 4 hours a day over two days? I'll keep trying to come up with something better | 19:34 |
| fungi | as long as i don't have anything else pressing immediately before/after, i can adjust my sleep schedule to accommodate either | 19:35 |
| clarkb | gitea09's gitea service restarted a few minutes ago | 19:37 |
| clarkb | so ya the robots.txt update appears to be doing what we want | 19:37 |
| clarkb | also I think there is a new gitea bugfix release | 19:38 |
| fungi | yep, https://opendev.org/robots.txt is showing up for me at this point, looks great | 19:54 |
| fungi | well, maybe not great, but looks like what we configured anyway | 19:54 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update gitea to 1.21.4 https://review.opendev.org/c/opendev/system-config/+/906062 | 20:03 |
| fungi | clarkb: was removal of the search templates intentional? it's neither mentioned in the commit message nor the changelog afaict | 20:18 |
| fungi | were our copies identical to upstream's or something? | 20:18 |
| Clark[m] | Oh sorry yes those were the files we patched to fix the code search 500 errors. I should've called that out | 20:43 |
| clarkb | fungi: should I update the commit message? | 20:53 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update gitea to 1.21.4 https://review.opendev.org/c/opendev/system-config/+/906062 | 21:00 |
| clarkb | I decided it was important enough for future us if digging through history to get that right and udpated the commit message | 21:00 |
| fungi | clarkb: yeah, clearly i had already forgotten why those were there in the previous upgrade. thanks! | 21:46 |
| ianw | ok https://review.opendev.org/c/opendev/system-config/+/906013 has succeeded ; which means all the centos nodes should be able to build openafs now. review of the changes proposed there to the checking/build/log collection welcome, but aren't required to build the modules now it's working (just to help us next time they're not) | 22:53 |
| JayF | I am having trouble exercising the "eventlet in required_projects" support that was mentioned in the last few days; both 'github.com/eventlet/eventlet' and 'eventlet/eventlet' both come up as unknown projects in zuul: https://review.opendev.org/c/openstack/ironic-inspector/+/906070 | 23:11 |
| JayF | I've checked out just about every repo that I can tell is involved in config, and a grep for 'eventlet' across them does not find anything interesting (including: openstack-zuul-jobs, project-config, system-config) ... so I'd not only like the correct answer, but I'd love to figure out how I coulda self-served this | 23:12 |
| tonyb | JayF: looking gimme a few | 23:21 |
| JayF | ack not urgent :) thank you | 23:21 |
| Clark[m] | It's possible we removed eventlet. Or maybe we aren't loading it into zuul properly | 23:21 |
| Clark[m] | https://opendev.org/openstack/project-config/src/branch/master/zuul/main.yaml is the file | 23:22 |
| JayF | Yeah; I think it may be worth the effort to plumb it back up if we can given current circumstances if it's not far out of reach. I certainly was going to add a unit test / docs / tempest job to Ironic's projects experimental queues | 23:22 |
| Clark[m] | I remember now we removed eventlet because it had a significant number of branches which incurred zuul startup penalties | 23:22 |
| Clark[m] | It appears to have 21 branches now which seems far less than it must've been before. We can probably add it back. Also zuul got improved since then for dealing with GitHub rate limits | 23:25 |
| tonyb | JayF: So adding it back would be a patch here: https://opendev.org/openstack/project-config/src/branch/master/zuul/main.yaml#L1526, then using it would be most like 906070,PS1 | 23:26 |
| opendevreview | Jay Faulkner proposed openstack/project-config master: Add eventlet to projects available from github https://review.opendev.org/c/openstack/project-config/+/906071 | 23:28 |
| tonyb | In terms self service, you can look at: https://zuul.opendev.org/t/openstack/projects to see which projects and drivers the openstack tenant has configured | 23:28 |
| JayF | Clark[m]: Yeah, it's all been ... what's the word ... maintained :D since them | 23:29 |
| JayF | tonyb: yeah, I mainly wanted to make sure there wasn't a bonus-config repo or something hiding somewhere ;) | 23:30 |
| tonyb | JayF: fair enough. That page will show you "all the things" finding where they're defined .... not so much | 23:30 |
| clarkb | JayF: ya I feel like the count was in the thousands range when we removed it | 23:30 |
| clarkb | which caused zuul to dig deep into github rate limits to process them all | 23:31 |
| JayF | I'd believe it, but have no direct knowledge :) | 23:31 |
| JayF | if that becomes true now, we have friends with brooms who can help clean up lol | 23:31 |
| clarkb | we probably should try and curate that list a bit though. Like is anyone doing dpdk stuff these days? | 23:32 |
| tonyb | JayF: There is a "zuul app" you can add to eventlet but I *think* that's only if you want zuul to do more than comment? | 23:32 |
| JayF | If there is value to you all to do that, we can pursue that with Herve and that crew. I'm happy to be ambassador for those discussions | 23:33 |
| clarkb | tonyb: I think the main issue with the app (and this is something we could investigate adjusting too) is that I think it may request push/merge perms since when it was set up we thought it might do things like that for some projects | 23:33 |
| clarkb | since we don't do gating and merging for anything we can remove that permission from the required list and then hopefully projects will be more inclined to add the app as it does make a huge difference for rate limits | 23:34 |
| tonyb | JayF: I don't have a strong opinion there. I feel like it's a time will tell situation | 23:34 |
| JayF | I'm just letting you know I'm happy to be the complaint box | 23:35 |
| JayF | *for this specific kind of complaint* | 23:35 |
| JayF | everything else OpenStack goes to the TC Chair ;) | 23:35 |
| tonyb | clarkb: Oh yeah that might help. I wonder if we could have 2 "apps". one for comments/tests and another for comments/tests/gating+merging | 23:35 |
| tonyb | JayF: LOL | 23:36 |
| clarkb | tonyb: I think we can probably minimize perms for the existing app now since we're just trying to do informative responses. But then ya if that changes a second app may make sense for doing more | 23:39 |
| clarkb | part of the problem there is I think the apps perms aren't always intuitive and there was a bit of trial and error we may have to go through again | 23:40 |
| clarkb | not that gerrit is better with some of its acls. Push tag is distinct from push signed tag and whether or not you can delete branches is affected by your push permissions. etc | 23:41 |
| tonyb | clarkb: Yeah, it's all a bit of a mess | 23:42 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!