| opendevreview | Merged opendev/system-config master: Cleanup CentOS mirroring https://review.opendev.org/c/opendev/system-config/+/838759 | 00:05 |
|---|---|---|
| ianw | clarkb: ^ i'm happy to work through that stack; probably let things merge and apply then move on to the next one? | 00:07 |
| Clark[m] | ianw: works for me | 00:22 |
| opendevreview | Merged opendev/system-config master: Cleanup debian jessie and stretch keys https://review.opendev.org/c/opendev/system-config/+/838766 | 00:37 |
| opendevreview | Merged opendev/system-config master: Cleanup OpenSUSE mirroring https://review.opendev.org/c/opendev/system-config/+/838761 | 01:36 |
| opendevreview | Merged opendev/system-config master: Remove isos and other images from rpm mirroring https://review.opendev.org/c/opendev/system-config/+/838764 | 01:38 |
| *** ysandeep|out is now known as ysandeep | 03:09 | |
| *** ysandeep is now known as ysandeep|afk | 03:58 | |
| *** ysandeep|afk is now known as ysandeep | 04:38 | |
| *** pojadhav is now known as pojadhav|ruck | 04:55 | |
| *** luigi is now known as luigi-remote | 07:08 | |
| *** luigi-remote is now known as luigi | 07:09 | |
| *** jpena|off is now known as jpena | 07:11 | |
| *** ysandeep is now known as ysandeep|lunch | 07:52 | |
| *** pojadhav|ruck is now known as pojadhav|lunch | 08:07 | |
| *** ysandeep|lunch is now known as ysandeep | 08:36 | |
| *** pojadhav|lunch is now known as pojadhav|ruck | 09:21 | |
| *** ysandeep is now known as ysandeep|afk | 10:50 | |
| *** pojadhav|ruck is now known as pojadhav|brb | 11:22 | |
| *** rlandy is now known as rlandy|PTO | 11:51 | |
| *** pojadhav|brb is now known as pojadhav|ruck | 11:54 | |
| *** bhagyashris_ is now known as bhagyashris | 11:55 | |
| *** ysandeep|afk is now known as ysandeep | 12:22 | |
| *** ysandeep is now known as ysandeep|afk | 12:43 | |
| opendevreview | Maksim Malchuk proposed openstack/diskimage-builder master: Revert "Fallback to persistent netifs names with systemd" https://review.opendev.org/c/openstack/diskimage-builder/+/838863 | 12:53 |
| *** ysandeep|afk is now known as ysandeep | 13:24 | |
| *** ysandeep is now known as ysandeep|afk | 13:41 | |
| opendevreview | Merged openstack/diskimage-builder master: Update gentoo python version to 3.9 https://review.opendev.org/c/openstack/diskimage-builder/+/836237 | 13:56 |
| opendevreview | Dr. Jens Harbott proposed openstack/diskimage-builder master: Test building jammy https://review.opendev.org/c/openstack/diskimage-builder/+/836228 | 14:51 |
| *** ysandeep|afk is now known as ysandeep | 15:00 | |
| frickler | kevinz_: time to refresh us.linaro.cloud again if you get a chance | 15:05 |
| kevinz_ | frickler: Sure, thanks for the reminding, will do | 15:05 |
| clarkb | frickler: I think the changes to the mirror content have more than made enough room for jammy too | 15:13 |
| clarkb | Looks like there is one more update to the opensuse mirroring that we can alnd too | 15:13 |
| clarkb | fungi: if you have time for https://review.opendev.org/c/opendev/system-config/+/838765 just quickly doubling checking that would be great to further trim the mirror. Otherwise I'll probably single core approve it in a bit | 15:14 |
| fungi | sure, i'll take a peek | 15:14 |
| clarkb | and I guess I should plan to approve the gitea upgrade once I've settled in a bit | 15:15 |
| fungi | lgtm, thanks | 15:15 |
| fungi | and yeah, i just didn't want to approve gitea and go right to bed, or approve it when i was the oly one around | 15:15 |
| clarkb | ++ I'm happy too once the tc meeting is done | 15:16 |
| clarkb | as I don't have anywhere to be until school pickup | 15:16 |
| clarkb | lunch I guess. I should eat at some point :) | 15:16 |
| clarkb | the mirror cleanup already cleaned up about 350GB of data. | 15:19 |
| opendevreview | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Update promote-docker-image https://review.opendev.org/c/zuul/zuul-jobs/+/838919 | 15:44 |
| opendevreview | Merged opendev/system-config master: Remove unneeded arches from opensuse updates mirror https://review.opendev.org/c/opendev/system-config/+/838765 | 15:45 |
| frickler | clarkb: I was about to ask, as the 22.04 release seems to just have been made. so we simply bump the quota for the volume? I've already prepared a patch for the new mirroring | 15:49 |
| clarkb | frickler: yes I think the only remaining thing is to bump the quota. On average it seems we need about 230GB per release so add that to the quota? | 15:50 |
| opendevreview | Oleksandr Kozachenko proposed zuul/zuul-jobs master: Update promote-docker-image https://review.opendev.org/c/zuul/zuul-jobs/+/838919 | 15:52 |
| *** pojadhav|ruck is now known as pojadhav|out | 15:59 | |
| *** marios is now known as marios|out | 16:00 | |
| clarkb | infra-root we got agreement from the openstack TC to start shutting down the ELK services on our side. https://review.opendev.org/c/opendev/base-jobs/+/837619 should be ready to go if you have time to review. I think a second core reviewer would be good simply because it affects base jobs | 16:00 |
| *** ysandeep is now known as ysandeep|dinner | 16:07 | |
| frickler | clarkb: since the current quota is very tight, maybe start with +300 and then possibly reduce when we know how much it really is? | 16:08 |
| clarkb | frickler: works for me | 16:08 |
| opendevreview | David Wilde proposed opendev/git-review master: Bypass Java >= 17 strong encapsulation for tests https://review.opendev.org/c/opendev/git-review/+/838040 | 16:09 |
| opendevreview | Dr. Jens Harbott proposed opendev/system-config master: Start mirroring jammy https://review.opendev.org/c/opendev/system-config/+/838923 | 16:12 |
| clarkb | ok I'm going to find breakfast, then I can approve the base job gearman removal cleanup and check jobs are still happy. Then approve the gitea upgrade and monitor that | 16:15 |
| *** jpena is now known as jpena|off | 16:15 | |
| frickler | #status log bumped AFS quota for the ubuntu volume by 300G in preparation for mirroring 22.04 | 16:22 |
| opendevstatus | frickler: finished logging | 16:22 |
| frickler | actually went from 680E6 to 990E6 which is less than 300*2^20, but I didn't want to cross the 1T line ;) | 16:23 |
| fungi | probably wise | 16:25 |
| clarkb | ok I'm approving the gearman job submission removal change now | 16:34 |
| clarkb | ++ to being careful with the 1TB boundary. Though I think 2TB is the limit in afs so in theory that would be fine | 16:34 |
| frickler | "log" leaves a chunk of wood on twitter, nice idea, but not pretty obvious to parse ;) | 16:35 |
| opendevreview | Merged opendev/base-jobs master: Stop submitting logstash/subunit gearman jobs https://review.opendev.org/c/opendev/base-jobs/+/837619 | 16:40 |
| clarkb | I'm watching https://zuul.opendev.org/t/openstack/stream/9e143c9c254f4f43be62bc8514d06a90?logfile=console.log to check ^ is happy | 16:48 |
| clarkb | that jobs I was watching looks good. Any objection to approving the gitea upgrade now? | 16:58 |
| fungi | nah, everything's looking good to me, i say go for it | 16:59 |
| clarkb | done | 16:59 |
| clarkb | That last opensuse cleanup freed only about 7GB. Still in total I think that is about 350-360GB cleaned up. And I expect the new ubuntu release will be in the 230GB range so we're still ahead of where we were yesterday :) | 17:07 |
| opendevreview | David Wilde proposed opendev/git-review master: Bypass Java >= 17 strong encapsulation for tests https://review.opendev.org/c/opendev/git-review/+/838040 | 17:39 |
| opendevreview | David Wilde proposed opendev/git-review master: Bypass Java >= 17 strong encapsulation for tests https://review.opendev.org/c/opendev/git-review/+/838040 | 17:52 |
| opendevreview | Merged opendev/system-config master: Upgrade Gitea to 1.16.6 https://review.opendev.org/c/opendev/system-config/+/838799 | 18:14 |
| *** ysandeep|dinner is now known as ysandeep | 18:14 | |
| clarkb | the hourly jobs are running so rpobably another 20 minutes before ^ deploys | 18:15 |
| clarkb | I'm keeping an eye on it | 18:15 |
| *** ysandeep is now known as ysandeep|out | 18:20 | |
| clarkb | https://gitea01.opendev.org:3081/opendev/system-config that has updated to 1.16.6 and lgtm | 18:42 |
| clarkb | do we know how to trigger the error with partial clones using pip? Our test job tests with git directly and I wonder if we should quickly check with pip if we can | 18:43 |
| frickler | clarkb: iirc just pip install from a git url? | 18:43 |
| clarkb | oh that makes sense. Pip would use a shallow clone I guess. Let me try that | 18:44 |
| fungi | yeah, that's where we were seeing it | 18:44 |
| clarkb | I'm running a focal container and will install python3, python3-venv and git. Then make a venv and have pip install something like https://opendev.org/opendev/bindep | 18:46 |
| clarkb | oh I have to use https://gitea01.opendev.org:3081/opendev/bindep as not all backends are updated yet | 18:47 |
| clarkb | `venv/bin/pip install -vvv git+https://gitea01.opendev.org:3081/opendev/bindep` that worked in the focal container. Skimming logs now to see if I can see the partial clone | 18:48 |
| clarkb | Running command git clone --filter=blob:none --verbose --progress https://gitea01.opendev.org:3081/opendev/bindep /tmp/pip-req-build-3s01o5cc | 18:49 |
| clarkb | it ran that | 18:49 |
| clarkb | now let me try the partial cloen in the foreground and ensure we don't get the warning? | 18:49 |
| opendevreview | Dr. Jens Harbott proposed openstack/diskimage-builder master: Add a job to test building jammy https://review.opendev.org/c/openstack/diskimage-builder/+/836228 | 18:49 |
| frickler | clarkb: fungi: with ^^ and the dependency we should be ready to build jammy images | 18:50 |
| clarkb | ya no warning which I'm pretty sure we got before "it basically said warning ignoring the blob:none flag as server doesn't support it" | 18:50 |
| clarkb | and the config file is updated on gitea02 | 18:51 |
| clarkb | so ya I think this is happy | 18:51 |
| clarkb | 01-05 are upgraded at this point | 18:53 |
| clarkb | all 8 giteas are updated. I don't see any immediate problems. Assuming the job ends successfully I will eb going to lunch (properly outside today) | 18:59 |
| clarkb | when I get back I'll review 836228 | 19:01 |
| clarkb | yup job was a success. I'll check back in after lunch | 19:03 |
| corvus | i'd like to restart zuul... maybe a little faster than yesterday... | 19:31 |
| corvus | would a hard-restart of executors be okay? | 19:32 |
| corvus | (all jobs aborted+restarted) | 19:32 |
| fungi | looks like it's not terribly busy, so that seems fine to me | 19:38 |
| corvus | hard-restarting executors and mergers now | 19:44 |
| corvus | restarting zuul01 | 19:47 |
| corvus | restarting zuul02 | 19:55 |
| corvus | #status log restarted all of zuul on dd0135baa51cdf21a18831926c04227caa060878 | 19:56 |
| opendevstatus | corvus: finished logging | 19:56 |
| fungi | thanks! | 20:02 |
| clarkb | the jammy dib test change lgtm. I don't know if it will succeed but that seems like a good next step once we've managed to get dib building an image | 20:21 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Remove group vars for removed services https://review.opendev.org/c/opendev/system-config/+/838948 | 20:29 |
| clarkb | I noticed ^ when double checking the ELK removal. ianw I think we are ready to land the ELK removal change and I'll plan to turn off services tomorrow if you can review that change and its parent | 20:29 |
| clarkb | that chang ethat tests jammy builds (simply ones for glean etc compat) passed | 22:36 |
| clarkb | that is really good news. Likely means if we have trouble it will be after successfully booting (unbound, git repo caching, etc) | 22:37 |
| clarkb | fungi I'm trying to make heads and tails of whether or not git might get patched on bullseye to address that cve. Mostly because of the chance it will impact our image builds that run dib on bullseye more than a concern for security | 22:42 |
| clarkb | fungi: does <no-dsa> (minor issue) mean an update is unlikely? | 22:43 |
| fungi | clarkb: yeah, without a debian security advisory, a backport is not probable | 22:50 |
| clarkb | cool. Something to try and remember when we next update the base OS on our container images then | 22:51 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!