Sunday, 2022-01-16

fungi#status log Due to a hypervisor host problem in our donor provider, the afs01.dfw.openstack.org server was rebooted at 11:48 UTC13:42
opendevstatusfungi: finished logging13:42
fungias for the impending certificate expiration warnings we've been getting over the past couple of days, i determined that the periodic infra-prod-base job has been failing due to package database inconsistencies on several servers (codesearch, lists, nb03) which i've manually corrected with `sudo dpkg --configure -a` or in one case `sudo apt --fix-broken install` (they seemed to be related to13:45
fungiinterrupted package upgrades)13:45
fungiand per the thread on openstack-discuss, it appears rackspace's centos mirror began rejecting rsync connections on friday13:48
fungiso our centos stream 9 mirrors are now roughly two days stale13:48
fungirevisiting the afs01.dfw reboot, i don't see any obvious signs of problems like hung vos release transactions, so probably no cleanup work needed there but i'll try to make sure things still don't look stale in a few hours13:55
opendevreviewchandan kumar proposed opendev/system-config master: Use facebook mirror for centos stream 9 rsync  https://review.opendev.org/c/opendev/system-config/+/82482914:13
fungii'm going to disable deployments for the mirror-update server and manually test that ^14:15
fungilock is held and test is underway with that edit applied locally on the server14:22
fungiseems to have worked, approving14:40
chandankumarfungi: updating commit message14:46
chandankumarthanks for pointing out14:46
fungisure, i'll reapprove when you're done14:47
opendevreviewchandan kumar proposed opendev/system-config master: Use facebook mirror for centos stream 9 rsync  https://review.opendev.org/c/opendev/system-config/+/82482914:47
chandankumardone14:47
opendevreviewchandan kumar proposed opendev/system-config master: Use facebook mirror for centos stream 9 rsync  https://review.opendev.org/c/opendev/system-config/+/82482914:49
fungire-approved14:49
chandankumarthanks :-)14:50
chandankumar+++++++14:50
fungiyw14:50
opendevreviewMerged opendev/system-config master: Use facebook mirror for centos stream 9 rsync  https://review.opendev.org/c/opendev/system-config/+/82482915:55
fungii'll go ahead and reenable deployment for the mirror-update server now16:08
*** rlandy is now known as rlandy|out23:14

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!