| *** ysandeep|out is now known as ysandeep|rover | 05:08 | |
| *** ysandeep|rover is now known as ysandeep|rover|lunch | 08:02 | |
| opendevreview | A R proposed openstack/diskimage-builder master: Preserve local mirrors when using Ubuntu element https://review.opendev.org/c/openstack/diskimage-builder/+/841247 | 09:57 |
|---|---|---|
| *** ysandeep|rover|lunch is now known as ysandeep|rover | 10:01 | |
| *** rlandy|out is now known as rlandy | 10:15 | |
| *** dviroel|out is now known as dviroel | 11:21 | |
| *** pojadhav is now known as pojadhav|afk | 12:01 | |
| *** ysandeep|rover is now known as ysandeep|rover|afk | 12:45 | |
| *** pojadhav|afk is now known as pojadhav | 13:06 | |
| *** ysandeep|rover|afk is now known as ysandeep|rover | 13:11 | |
| *** ysandeep|rover is now known as ysandeep|out | 15:02 | |
| clarkb | my gcc package has updated again and I have a ton of rebuilt packages. I wonder what broke :) | 15:22 |
| *** dviroel is now known as dviroel|lunch | 15:25 | |
| fungi | i'm still hoping to find time to dig into https://bugs.debian.org/1010764 since i currently can't use openafs with linux 5.17 | 15:29 |
| clarkb | that reminds me I should go and update afs quotas today | 15:30 |
| clarkb | its the last piece of the cleanup of distro mirrors | 15:30 |
| *** marios is now known as marios|out | 15:37 | |
| clarkb | I'm going to help someone get set up to talk to gerrit and they are likely on OS X. Is the best way to get git and git-review via homebrew? | 16:12 |
| odyssey4me | clarkb I think git is included in dev tools, and git-review can just be installed into a venv via pip... so brew isn't required, but it does make it easier to maintain and get current versions. | 16:14 |
| odyssey4me | s/dev tools/xcode/ | 16:15 |
| opendevreview | Clark Boylan proposed zuul/zuul-jobs master: Make note of python_version being a string value https://review.opendev.org/c/zuul/zuul-jobs/+/840540 | 16:16 |
| clarkb | odyssey4me: good to know, thanks | 16:17 |
| *** dviroel|lunch is now known as dviroel | 16:24 | |
| clarkb | #status log Updated OpenAFS quotas for distro mirrors to better reflect current usage. | 16:36 |
| opendevstatus | clarkb: finished logging | 16:36 |
| clarkb | I aimed for round numbers that resulted in 70-80% utilization | 16:36 |
| opendevreview | Merged zuul/zuul-jobs master: Switch py3.10 testing to Ubuntu Jammy https://review.opendev.org/c/zuul/zuul-jobs/+/840539 | 16:58 |
| fungi | clarkb: how much potential quota did that free up? | 16:59 |
| fungi | or i guess it's not really clear, since you can oversubscribe quotas | 17:00 |
| clarkb | fungi: I'm not sure. Ya exactly | 17:00 |
| clarkb | we are currently at 72% ish utilization of 4TB? | 17:00 |
| fungi | it didn't free up space, but it does help us avoid some volume running away with a lot more utilization than we intend | 17:00 |
| opendevreview | Merged zuul/zuul-jobs master: Make note of python_version being a string value https://review.opendev.org/c/zuul/zuul-jobs/+/840540 | 17:27 |
| *** rlandy is now known as rlandy|mtg | 18:14 | |
| clarkb | fungi: exactly minimizes blast radius if anything goes crazy | 18:31 |
| clarkb | also success on setting up gerrit pushing on OSX. We ended up running `xcode-select --install` to install the git and python toolchains then with that made a venv to install git-review | 18:32 |
| clarkb | I've learned a lot | 18:32 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Upgrade gitea to v1.16.8 https://review.opendev.org/c/opendev/system-config/+/841988 | 18:37 |
| mnaser | I suspect this is something that might have been brought up, but what would be a good way for an opendev tenant to maintain a “downstream” of an openstack project? | 19:28 |
| mnaser | Example being: we have some patches that are taking longer than expected to land upstream in openstack, so we want to build our images with those patches on top | 19:28 |
| mnaser | I haven’t been able to come up with a clean way of maintaining this since we can’t really (easily) have say: an upstream branch and a downstream branch in gerrit | 19:29 |
| mnaser | Maintaining a bunch of patch files can also be a bit unclean as well since it might be hard to go about maintaining a bunch of files in system and “unwrapping” them | 19:30 |
| mnaser | Just wondering if anyone has any ideas | 19:30 |
| *** rlandy|mtg is now known as rlandy | 19:30 | |
| clarkb | mnaser: the deb package repos simply hard forked and kept a copy of all the repos which isn't ideal from a disk consumption standpoint but worked | 19:33 |
| clarkb | the biggest issue is likely goign to be CI config more than anything else. If you convince openstack to have extra branches that introduces CI weirdness. If you hard fork on a copy that also introduces CI weirdness | 19:34 |
| clarkb | If however you just want to apply some patches to docker containers you can do what OpenDev does and manage them liek distro pacakges do and use patch to apply them | 19:34 |
| clarkb | we've done this for gerrit and I think etherpad in the past | 19:35 |
| clarkb | as far as cleanliness goes I think that is largely solved by the distro packagers if you need more than a couple. They get numbered and tracked and applied in order | 19:35 |
| clarkb | infra-root https://review.opendev.org/c/opendev/system-config/+/841988 is a gitea upgrade to a new bugfix release. Mostly about keeping up more than fixing any particular issue if you get a chance | 19:36 |
| clarkb | I just trimmed the meeting agenda way down. Removed the PPA topic and the review cleanup topic. Now is the time to add anything new | 20:32 |
| fungi | cool | 20:40 |
| clarkb | ianw: when you start your day https://review.opendev.org/c/opendev/system-config/+/841988 is probably good to look at. If you think that is worthy of a +A soon I should be around to babysit | 20:51 |
| *** dviroel is now known as dviroel|out | 20:51 | |
| ianw | o/ looking | 21:54 |
| clarkb | looks like it got approved, thanks | 21:59 |
| ianw | yep i'm happy to keep an eye on deployment | 22:03 |
| ianw | clarkb: thanks for the upgrade comments. i'm going to validate the downgrade path and also have a look at keeping mariadb up-to-date as well | 22:05 |
| clarkb | ianw: ++ for downgrade path. Re mariadb I don't think that is urgent. The current version is supported for some time iirc. It was just something I have in the back of my mind and have thought about and noticed the env var flag you can set to have it check for updating from an old version | 22:06 |
| clarkb | but also the mariadb for review is pretty low impact if something goes wrong so oddly upgrading it first with review is maybe the easiest thing to do :) | 22:06 |
| ianw | yeah, that was my thinking; once we have a process for it, it's much simpler if we do need to move it for some more pressing reason | 22:07 |
| ianw | https://docs.fedoraproject.org/en-US/fedora/latest/release-notes/sysadmin/Networking/ ... glean still writes ifcfg-* files. although the plugin still exists i guess that still working is on borrowed time | 22:26 |
| clarkb | iirc the NM support in glean relies on those entirely | 22:27 |
| clarkb | it doesn't write native configs yet | 22:27 |
| clarkb | f36 almost dropped bios support too. Good thing they didn't :) | 22:27 |
| ianw | "The RPM database has been moved from its previous location in /var/lib/rpm to a new location in /usr/lib/sysimage/rpm" | 22:28 |
| ianw | i don't think that will matter ... but stranger things have happened | 22:28 |
| opendevreview | Merged opendev/system-config master: Upgrade gitea to v1.16.8 https://review.opendev.org/c/opendev/system-config/+/841988 | 22:56 |
| clarkb | gitea01 has updated and looks fine | 23:02 |
| fungi | i concur | 23:02 |
| *** rlandy is now known as rlandy|out | 23:05 | |
| ianw | am i crazy or are we missing periodic runs of https://zuul.opendev.org/t/openstack/builds?job_name=infra-prod-manage-projects ? | 23:13 |
| clarkb | looks like they stopped on the 12th | 23:15 |
| clarkb | https://review.opendev.org/c/opendev/system-config/+/838948 and https://review.opendev.org/c/opendev/system-config/+/837637 are the two system-cnofig changes that merge in roughly the time frame to cause that to happen but I don't see how either could cause that | 23:17 |
| clarkb | infra-prod-base has failed recently do we require infra-prod-base to succeed? | 23:18 |
| clarkb | ya infra-prod-base is a soft dependency so I think that is it | 23:19 |
| ianw | that must be it | 23:19 |
| ianw | gpg log download ftw :) | 23:20 |
| ianw | interrupted dpkg on kdc04 ... | 23:21 |
| clarkb | the gitea upgrades seem to be complete and I'm not seeing anything weird there | 23:21 |
| ianw | https://paste.opendev.org/show/brdhd2dNkkhMCNwAK7WF/ | 23:22 |
| ianw | i'm fixing the kernel install but i don't know how it got into this state | 23:23 |
| clarkb | is the fix to autoremove the older installs that are confusing it? | 23:24 |
| clarkb | as far as getting into that state maybe an unexpected reboot during updates? | 23:24 |
| ianw | 23:24:56 up 5 days | 23:25 |
| ianw | that seems recent, i don't think we did reboot in an expected fashion | 23:25 |
| ianw | there was some volume maintenance that fungi prepped for | 23:25 |
| clarkb | ya though that was for the afs servers not kdcs iirc | 23:25 |
| clarkb | and the prep work should've meant we bypassed it entirely by being on volumes that are unaffected | 23:26 |
| ianw | it's booted 5.4.0-109-generic but 110 is now installed | 23:26 |
| ianw | this is redundant so i might reboot it just to be sure it's happy | 23:26 |
| fungi | yes, i didn't reboot anything for the volume swaps | 23:26 |
| clarkb | ianw: maybe see what apt-get autoremoev has to say about cleanups? | 23:27 |
| clarkb | just to limit the number of moving parts fi we can trim further? | 23:27 |
| ianw | yep ran that :) -> https://paste.opendev.org/show/bWzTjjPwjjD7sP0LdoaZ/ | 23:28 |
| ianw | #status log manually fixed kernel install and rebooted kdc04.openstack.org | 23:31 |
| opendevstatus | ianw: finished logging | 23:31 |
| ianw | that should get the base job going again ... i'll look out for it now. i noticed because i expected the tiny (r) that un-centres the openstack logo on the gitea org page to have gone, but manage-projects hasn't run to update it | 23:32 |
| clarkb | ianw: earlier today I lowered distro mirror quotas so that most of them are using 70-80% of their quota while keeping round numbers. One thing I noticed is that all the wheel mirrors have very large quotas compared to consumption any concern with dropping those from 100 GB each to say 20GB? (some are almost 10GB due to time they've been around so double that seems reasonable) | 23:38 |
| ianw | clarkb: yeah, no problem with that. i half think i might have meant to make them 10gb and added a zero, and we've just set the rest the same | 23:39 |
| clarkb | heh ok. I'll do that tomorrow morning then. The older ones which accumulate more pacakges have grown to almost 10GB so they aren't tiny if given time to accumulate packages but they also are nowhere near 100GB | 23:40 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!