| fungi | no, not yet | 00:00 |
|---|---|---|
| ianw | ok, i'll run a zuul_pull and start them in that screen then | 00:02 |
| fungi | thanks! | 00:03 |
| *** rlandy|bbl is now known as rlandy | 00:35 | |
| *** rlandy is now known as rlandy|out | 01:49 | |
| opendevreview | Jie Niu proposed opendev/system-config master: add computing force network mailling list for computing force network working group https://review.opendev.org/c/opendev/system-config/+/850268 | 03:31 |
| *** ysandeep|out is now known as ysandeep | 05:21 | |
| *** tkajinam is now known as Guest5435 | 07:14 | |
| *** Guest5435 is now known as tkajinam | 07:36 | |
| *** ysandeep is now known as ysandeep|lunch | 07:57 | |
| *** ysandeep|lunch is now known as ysandeep | 09:30 | |
| opendevreview | Merged opendev/system-config master: centos 7 mirror: switch upstream provider https://review.opendev.org/c/opendev/system-config/+/850260 | 09:55 |
| ianw | ^ i've manually run that, and the volume has released now | 10:22 |
| *** rlandy|out is now known as rlandy | 10:23 | |
| *** dviroel|out is now known as dviroel | 11:27 | |
| *** ysandeep is now known as ysandeep|break | 12:02 | |
| *** ysandeep|break is now known as ysandeep|mtg | 12:33 | |
| *** dhill is now known as Guest5458 | 12:49 | |
| *** ysandeep|mtg is now known as ysandeep | 12:58 | |
| *** dasm|off is now known as dasm|ruck | 13:31 | |
| *** ysandeep is now known as ysandeep|dinner | 14:28 | |
| opendevreview | Clark Boylan proposed opendev/system-config master: WIP Update to Gitea 1.17.0-rc1 https://review.opendev.org/c/opendev/system-config/+/847204 | 14:50 |
| opendevreview | Clark Boylan proposed opendev/system-config master: WIP Update to Gitea 1.17.0-rc2 https://review.opendev.org/c/opendev/system-config/+/847204 | 14:51 |
| *** ysandeep|dinner is now known as ysandeep | 15:02 | |
| *** marios is now known as marios|out | 15:58 | |
| clarkb | I'm not seeing any recent POST_FAILURES in our hourly deploy pipeline. Looking much better now that all the executors are updated | 16:08 |
| fungi | so we think the glibc update has taken care of it? did the ansible version override get rolled back yet? | 16:10 |
| *** ysandeep is now known as ysandeep|afk | 16:18 | |
| clarkb | fungi: yes the ansible version override was rolled back a day or two ago. I think this must fix it since we were able to find an example of the issue with only 50 % of the executors on old glibc yesterday | 16:21 |
| fungi | excellent | 16:26 |
| *** ysandeep|afk is now known as ysandeep|out | 16:38 | |
| corvus | Albin Vass: ^ 🍺 | 17:30 |
| AlbinVass[m] | Cool :) | 17:37 |
| *** rlandy is now known as rlandy|ruck | 17:40 | |
| clarkb | we'll definitely continue to check it just in case but ya good find | 17:44 |
| *** dasm|ruck is now known as dasm|off | 17:48 | |
| AlbinVass[m] | Btw since ansible closed the issue with "the way to fix this is to upgrade glibc" it seems likely to pop up in the future again as long as they use os.fork to spawn new processes. | 17:55 |
| clarkb | infra-root did anyone else want to weigh in on whether or not I should update https://review.opendev.org/c/opendev/system-config/+/850059 to be a role? | 17:55 |
| clarkb | AlbinVass[m]: ya I guess on older rhel they expect you to use ansible 2.9 so isn't a problem there | 17:56 |
| clarkb | I half expected them to want to figure out a way to fix it until I realized this | 17:56 |
| ianw | clarkb: https://review.opendev.org/c/openstack/project-config/+/850252/2/tools/check_valid_gerrit_projects.py -- i guess that's functionally the same as hitting an api end point like /repos/ or something? | 20:05 |
| clarkb | ianw: yup, except that the gitea api requires auth | 20:05 |
| clarkb | ianw: using the api was my first good idea until I realized that. I think checking the web ui for a 404 is simple and robust here | 20:06 |
| ianw | it does just check for a generic error | 20:06 |
| ianw | i guess if we broke things (so it was 500 instead of 404, say) , broken ssh would be about the same | 20:08 |
| clarkb | yup, but all that code does in that case is check the upstream remote can be cloned | 20:08 |
| clarkb | which means running in an unexpected failure case should be safe enough (we'll just do a potentially unnecessary git clone from the upstream remote) | 20:08 |
| ianw | clarkb/fungi: if you have time to go through the stack @ https://review.opendev.org/q/topic:selfsigned-shared-ca that would be good. the base change has had reviews, but just like some eyes on the bits on top | 20:09 |
| clarkb | ianw: I'll try to get to that today. SHould be able to | 20:10 |
| ianw | clarkb: if you could also double check https://review.opendev.org/c/opendev/system-config/+/845316 for the haproxy logs that you already looked at; i can deploy that and watch it closely | 20:10 |
| clarkb | ack | 20:13 |
| opendevreview | Merged openstack/project-config master: HTTP check existing repositories https://review.opendev.org/c/openstack/project-config/+/850252 | 20:21 |
| clarkb | ianw: https://review.opendev.org/c/opendev/system-config/+/845316 lgtm but didn't approve as unsure when you wanted to keep an eye on it. Feel free to +A | 20:23 |
| clarkb | Started there as I had previously reviewed it. Will look at the CA stuff shortly | 20:24 |
| ianw | thanks, yeah i'll do it a little later just to watch it closely | 20:24 |
| ianw | thanks; certainly no rush on that stuff | 20:25 |
| *** Guest5201 is now known as diablo_rojo_phone | 20:57 | |
| clarkb | ianw: question on https://review.opendev.org/c/opendev/system-config/+/848562 I'm sure I'm just not understanding some bash behavior there but figured I'd ask anyway | 21:39 |
| ianw | clarkb: yeah the args are really weird there; left a comment but basically each arg is a spaced-deliminated string | 21:44 |
| fungi | i too had to stare at that for a bit to realize that's how it was being parsed out | 21:47 |
| fungi | seems sort of like relying on an implementation detail, but it's not a terrible way to avoid double-accounting that list | 21:47 |
| clarkb | oh so when we've got multiple certs we'll get multiple compound arg lists | 21:47 |
| clarkb | is that worth a comment in the actual code (followup is fine) | 21:48 |
| ianw | i feel like there may be a comment to that effect, but maybe not at that point | 21:48 |
| ianw | on line 57, but yeah it is obscure | 21:49 |
| clarkb | ianw: ok I think I've reviewed the whole stack. A few nits here and there, but nothing crazy | 22:14 |
| ianw | thanks, will look soon. just writing up the changelog for another one for you to chew on wrt the zuul console logs :) | 22:15 |
| *** dviroel is now known as dviroel|dinner | 22:22 | |
| *** dviroel|dinner is now known as dviroel|out | 23:20 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!