| tkajinam | https://zuul.opendev.org/t/openstack/build/39b6cc18f6cb45439525e17f52758f25 | 08:58 |
|---|---|---|
| tkajinam | --2024-01-22 08:38:39-- (try:19) https://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64/os/EFI/BOOT/BOOTX64.EFI | 08:58 |
| tkajinam | Connecting to mirror.iad3.inmotion.opendev.org (mirror.iad3.inmotion.opendev.org)|173.231.253.126|:443... failed: Connection timed out. | 08:58 |
| tkajinam | Retrying. | 08:58 |
| tkajinam | seems this host is not reachable. | 08:58 |
| frickler | tkajinam: ack, it does not even respond to icmp, checking the provider now | 10:22 |
| tkajinam | frickler, thanks ! | 10:26 |
| frickler | infra-root: ^^ seems the last successful used node was on 2024-01-08 if I read https://grafana.opendev.org/d/53e8120f2a/nodepool3a-inmotion?orgId=1&from=now-30d&to=now correctly | 10:28 |
| frickler | I can't get the console log for the mirror server, trying to reboot it now. which also check nodepool logs for that cloud | 10:30 |
| frickler | nodepool ops on inmotion get server timeouts, same for my reboot request, but the instance still shows up as "rebooting". anyway that cloud seems to be rather borked and need further debugging | 10:43 |
| frickler | I was wondering how a job even managed to run on that cloud, but it looks like it ran on ovh-bhs1. tkajinam: is that mirror hardcoded into the job configuration somehow? that should not happen | 10:45 |
| tkajinam | frickler, hmm. let me look into it | 10:47 |
| frickler | IRONIC_GRUB2_FILE="https://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/BaseOS/x86_64/os/EFI/BOOT/grubx64.efi" | 10:48 |
| frickler | so yes | 10:48 |
| frickler | https://6411f27413aeaeed863a-624a66b127421bb56fbada761a704171.ssl.cf5.rackcdn.com/906216/2/check/sushy-tools-tempest-uefi-redfish-vmedia/39b6cc1/controller/logs/local_conf.txt | 10:48 |
| tkajinam | ahhh | 10:48 |
| tkajinam | yeees https://opendev.org/openstack/ironic/src/branch/master/zuul.d/ironic-jobs.yaml#L307 | 10:49 |
| * frickler kicks TheJulia a bit ;) but also nice that it worked for two years without issues. shows how stable our infra is :-) | 10:52 | |
| tkajinam | :-) | 10:57 |
| tkajinam | so https://review.opendev.org/c/openstack/ironic/+/906256 should unblock us. I'll dig into the way to replace the upstream mirror by an appropriate local CI mirror, though | 11:07 |
| * tkajinam is looking into shell hacks done in puppet | 11:07 | |
| tkajinam | ok so https://review.opendev.org/c/openstack/ironic/+/906256 should replace the "bad" hard-coded mirror host | 13:12 |
| priteau | Hello. Anyone know if I can end an IRC meeting if I am not the one who started it? | 14:45 |
| fungi | priteau: yes, you just have to wait at least 60 minutes from the #startmeeting | 14:46 |
| priteau | Easy, thanks fungi | 14:47 |
| fungi | yw | 14:47 |
| fungi | that's the main failsafe for cases where a meeting chair forgets to explicitly end a meeting or loses their internet mid-meeting | 14:48 |
| clarkb | I've noticed that in my note taking file and todo list I've been marking down the last week as december not january. Clearly an indication of how that week went | 16:17 |
| fungi | funny, i put it down as a week of mondays | 16:43 |
| clarkb | As probably my last followup on the haproxy thing 2.9 will not be an lts. 2.10 will be (even releases are LTS I guess). | 17:43 |
| clarkb | I guess that also explains why 2.9 got so many changes that seem to have disrupted things | 17:43 |
| clarkb | and reading more about their release strategy I think the LTS tag is correct for us | 17:44 |
| clarkb | that said they are only supposed to break users when they go to the 3.x series. 2.new should only add features | 17:44 |
| *** dhill is now known as Guest14944 | 17:46 | |
| clarkb | did anyone look to see what errors the inmotion servers are getting? Is it the no valid host found error? if so we may need to clean up the placement allocatiosn again | 18:02 |
| frickler | from what I saw in nodepool logs and also my trying to do openstack commands against the mirror host, these were really API timeouts, apache waiting too long for a response from nova | 18:07 |
| frickler | server list/show did work fine though, if I were to guess some issue with rabbitmq blocking RPC requests | 18:07 |
| clarkb | ack so probably something new to us | 18:09 |
| clarkb | poking at gitea12 with find I believe the repo archive cleanup ran properly over the weekend | 18:31 |
| clarkb | the only things in the repo-archive/ dir older than 3 days are directories (which don't get claered out by the clenaup only the endpoint files get removed) | 18:31 |
| clarkb | any thoughts on February 7+8 or February 14+15 or February 21+22 for pre ptg meetup? Then scheduling wise I think we can do 2 blocks each day something like 14:00-16:00 UTC and 22:00-00:00 UTC ? | 18:42 |
| clarkb | I think any of those days and times will work for me. I'm happy to defer to others if any are particularly good or bad | 18:44 |
| clarkb | then I plan to sign us up for the PTG proper on a more "as you're able" basis and maybe treat that as more user facing rather than admin dev time | 18:44 |
| fungi | all of that sounds fine to me. i don't have any significant conflicts with those dates/times | 18:51 |
| fungi | looks like openstack feature freeze is upon us: https://grafana.opendev.org/d/21a6e53ea4/zuul-status | 19:46 |
| frickler | rebase of a stack in nova with ... 46 patches? https://review.opendev.org/q/topic:%22bp/manila_shares_attachments%22 | 20:04 |
| clarkb | thats quite the stack | 22:13 |
| clarkb | I've taken a pass at updating the meeting agenda | 22:23 |
| clarkb | anything else to add? | 22:23 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Switch from legacy to new style keycloak container https://review.opendev.org/c/opendev/system-config/+/905469 | 22:59 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!