| opendevreview | Clark Boylan proposed opendev/bindep master: Handle no newline at the end of bindep.txt https://review.opendev.org/c/opendev/bindep/+/814839 | 00:30 |
|---|---|---|
| clarkb | fungi: ianw ^ fyi since that came up in a starlingx context earlier today. ireally did fiddle with the parsley setup and even very simple grammars exhibit problems with parsing when I try to match end (it seems to go into an infinite loop) | 00:31 |
| clarkb | Stepping through the parsley state machine with pdb was making me go a bit crazy and the fix is really actually very simple if I don't try to fix the grammar so I gave up | 00:32 |
| clarkb | probably a better use of my time :) | 00:32 |
| fungi | normalize your inputs, folks ;) | 00:39 |
| corvus | clarkb: what are the zuul keys that were an issue? | 00:59 |
| corvus | also hrm, i don't see that i logged the hash we restarted on :/ | 01:02 |
| corvus | i think it was on bfe5a4a93524e1b534851f3d04c4f1ad7d44eec7 | 01:04 |
| corvus | i would like to restart zuul now | 01:07 |
| fungi | sounds fine to me | 01:08 |
| fungi | also some of the affected keys were anything in the osf namespace, since we moved everything out of it | 01:08 |
| fungi | osf/openstackid for example | 01:08 |
| corvus | okay, restarting now | 01:09 |
| Clark[m] | corvus those listed as old at https://opendev.org/opendev/project-config/src/branch/master/renames/20211015.yaml | 01:11 |
| corvus | Clark: your change appears to work as expected. export shows errors for those projects. i delete one of them, then export no longer shows that error | 01:17 |
| corvus | #status log deleted empty zk key directories for all old projects listed at https://opendev.org/opendev/project-config/src/branch/master/renames/20211015.yaml | 01:20 |
| opendevstatus | corvus: finished logging | 01:20 |
| corvus | #status log restarted all of zuul on commit 1df09a82ef67e9536bce76b9ef071756f9164faa | 01:22 |
| opendevstatus | corvus: finished logging | 01:22 |
| corvus | re-enqueing | 01:22 |
| corvus | done | 01:30 |
| fungi | thanks! | 01:30 |
| corvus | it looks like the version change didn't land, so we'll need to restart one more time, but https://zuul.opendev.org/api/components is already looking pretty cool :) | 01:31 |
| fungi | ooh | 01:32 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: centos-minimal: boot test 9-stream https://review.opendev.org/c/openstack/diskimage-builder/+/814844 | 01:43 |
| Clark[m] | corvus cool thank you for checking the deletion thing | 01:44 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: Switch ARM64 testing to bullseye https://review.opendev.org/c/openstack/diskimage-builder/+/814846 | 01:53 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: Switch ARM64 testing to bullseye https://review.opendev.org/c/openstack/diskimage-builder/+/814846 | 02:02 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: centos-minimal: boot test 9-stream https://review.opendev.org/c/openstack/diskimage-builder/+/814844 | 02:19 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: centos-minimal: boot test 9-stream https://review.opendev.org/c/openstack/diskimage-builder/+/814844 | 03:17 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Refactor infra-prod jobs for parallel running https://review.opendev.org/c/opendev/system-config/+/807672 | 03:45 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Refactor infra-prod jobs for parallel running https://review.opendev.org/c/opendev/system-config/+/807672 | 03:46 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Refactor infra-prod jobs for parallel running https://review.opendev.org/c/opendev/system-config/+/807672 | 03:48 |
| ianw | clarkb: ^ gave the syntax checker a bit of a workout but i think that's right now | 03:59 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: Switch ARM64 testing to bullseye https://review.opendev.org/c/openstack/diskimage-builder/+/814846 | 04:07 |
| *** pojadhav is now known as pojadhav|ruck | 04:57 | |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: Switch ARM64 testing to bullseye https://review.opendev.org/c/openstack/diskimage-builder/+/814846 | 05:00 |
| *** ykarel|away is now known as ykarel | 05:15 | |
| *** ysandeep|away is now known as ysandeep | 05:34 | |
| *** jpena|off is now known as jpena | 06:53 | |
| *** ysandeep is now known as ysandeep|trng | 06:59 | |
| frickler | ianw: seems https://review.opendev.org/c/openstack/diskimage-builder/+/804000 broke gentoo builds. tmp/in_target.d/finalise.d/50-bootloader: line 75: GRUBENV: unbound variable | 07:07 |
| mrkiko | Hello all!! | 07:42 |
| mrkiko | I'm the gertty guy :) :) | 07:42 |
| *** bhagyashris_ is now known as bhagyashris | 07:46 | |
| ianw | prometheanfire: ^^ -- hopefully having the boot job in the gate tests will help avert things like this ... | 08:03 |
| frickler | not sure why there's neither /boot/grub nor /boot/grub2 though and what to use as fallback | 08:12 |
| frickler | https://opendev.org/openstack/diskimage-builder/src/branch/master/diskimage_builder/elements/bootloader/finalise.d/50-bootloader#L60-L66 | 08:14 |
| frickler | maybe just make the "elif" an "else" and see what happens. same as for the grub-mkconfig above | 08:14 |
| * frickler goes patching | 08:14 | |
| opendevreview | Dr. Jens Harbott proposed openstack/diskimage-builder master: Fix bootloader installation for gentoo https://review.opendev.org/c/openstack/diskimage-builder/+/814866 | 08:21 |
| *** ykarel is now known as ykarel|lunch | 08:53 | |
| *** ysandeep|trng is now known as ysandeep|lunch | 08:55 | |
| *** ysandeep|lunch is now known as ysandeep | 09:31 | |
| opendevreview | Aurelien Lourot proposed openstack/project-config master: Mirror newly added charms to GitHub https://review.opendev.org/c/openstack/project-config/+/814888 | 09:57 |
| opendevreview | Ettore Simone proposed openstack/project-config master: Add siss under x namespace https://review.opendev.org/c/openstack/project-config/+/814890 | 10:04 |
| opendevreview | Ettore Simone proposed openstack/project-config master: Add siss under x namespace https://review.opendev.org/c/openstack/project-config/+/814890 | 10:13 |
| opendevreview | Michal Nasiadka proposed openstack/diskimage-builder master: Add dnf versionlock support https://review.opendev.org/c/openstack/diskimage-builder/+/811945 | 10:13 |
| opendevreview | Aurelien Lourot proposed openstack/project-config master: Mirror newly added charms to GitHub https://review.opendev.org/c/openstack/project-config/+/814888 | 10:16 |
| *** ykarel|lunch is now known as ykarel | 10:20 | |
| *** dviroel|rover|out is now known as dviroel|rover | 10:51 | |
| ianw | infra-root: interesting one on the cpu type centos 9-stream is compiled for @ https://review.opendev.org/c/openstack/diskimage-builder/+/811392/17 | 10:55 |
| ianw | not 100% what the solution but might well be something that will affect production as we bring in new things as well, one to watch | 10:56 |
| mordred | ianw: wow | 11:11 |
| mordred | That seems like a thing that's going to confuse users | 11:11 |
| *** jpena is now known as jpena|lunch | 11:29 | |
| frickler | guess they'll have fun with that on a lot of clouds, not just ours | 11:30 |
| *** jpena|lunch is now known as jpena | 12:22 | |
| *** pojadhav is now known as pojadhav|ruck | 12:33 | |
| *** redrobot is now known as Guest3656 | 12:59 | |
| opendevreview | Dong Zhang proposed zuul/zuul-jobs master: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 13:16 |
| fungi | mrkiko: hey there, did you have another question or suggestion? | 13:42 |
| fungi | ianw: could that cpu type be related to our f34 boot issues? | 13:45 |
| Clark[m] | fungi: I was just wondering the same thing. Once tea is made I need to do a braindump on the comments of that change related to live migration testing and why custom CPU models didn't work in the past | 13:46 |
| opendevreview | Dong Zhang proposed zuul/zuul-jobs master: Implement role for limiting zuul log file size https://review.opendev.org/c/zuul/zuul-jobs/+/813034 | 13:47 |
| clarkb | I've left a comment on that change. With some of the background there and hopefully that helps us find a way forward. | 14:03 |
| prometheanfire | ianw: heh, thanks | 15:01 |
| *** ysandeep is now known as ysandeep|afk | 15:04 | |
| prometheanfire | ianw frickler, by default gentoo doesn't tell you which to install (for a bootloader), that's why neither exists, normally for gentoo it's /boot/grub (not grub2) | 15:05 |
| prometheanfire | https://wiki.gentoo.org/wiki/Handbook:AMD64/Installation/Bootloader | 15:05 |
| frickler | prometheanfire: well the issue happens after grub was emerged, see near the end of https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b53/814846/4/check/dib-nodepool-functional-openstack-gentoo-src/b5341df/nodepool/builds/test-image-0000000001.log | 15:17 |
| frickler | but it seems the easy fix of just assuming /boot/grub as default worked: https://review.opendev.org/c/openstack/diskimage-builder/+/814866 | 15:18 |
| clarkb | remote: https://review.opendev.org/c/openstack/devstack/+/815020 Use Nehalem CPU model by default <- that might fix our centos-9 issues. However, it is possible that we can't use the Nehalem CPU on some clouds beacuse the CPUs in our VMs aren't new enough | 15:20 |
| prometheanfire | frickler: ya, the package install and the creation of /boot/grub are two different things iirc | 15:22 |
| prometheanfire | nahalem, is that 12 years old now | 15:23 |
| *** ysandeep|afk is now known as ysandeep | 15:25 | |
| frickler | clarkb: would a dib job with depends-on devstack work? worth trying that, too, I'd think | 15:39 |
| clarkb | frickler: ++ | 15:39 |
| frickler | like on top of the c9 stack | 15:39 |
| clarkb | frickler: ya once the devstack job shows it doesn't just explode I can do that (I didn't check it locally before pushing) | 15:40 |
| frickler | also, if the f34 issues really are the same thing, doesn't that mean that this devstack change will fail there, too? | 15:40 |
| frickler | clarkb: I tested the libvirt settings locally, seem to be fine as far as that goes | 15:41 |
| clarkb | yes and kashyap confirmed in the nova channel that fedora-34 isn't using x86_64-v2 | 15:41 |
| clarkb | so fedora problems are different and wen eed to keep debugging that | 15:41 |
| frickler | ah, didn't see that yet. o.k., let's see if ianw can make progress, otherwise I can check with kashyap being in the same time zone it seems | 15:42 |
| clarkb | soudns great and I can followup tomorrow morning too | 15:43 |
| fungi | that's good i guess that maybe centos-9-stream won't have the same problems booting as fedora-34 does, but unfortunate that we're still short on theories as to the actual source of the fedora-34 boot problems | 15:44 |
| fungi | clarkb: the user with the login problem/duplicate account apparently never saw your reply and simply send the same message to openstack-discuss all over again | 15:47 |
| clarkb | fungi: I cc'd them too... Maybe someone else wants to try a response in case I'm getting bitbucketed? | 15:47 |
| clarkb | frickler: hrm depends-on won't work because the dib jobs use ensure-devstack which clones devstack out of band | 15:52 |
| *** jpena is now known as jpena|off | 15:52 | |
| clarkb | we could do a change to zuul-jobs that does a fetch of the change in ensure-devstack and depends-on that. I guess I'll give that a go | 15:52 |
| opendevreview | daniel.pawlik proposed openstack/project-config master: Add project openstack/ci-log-processing https://review.opendev.org/c/openstack/project-config/+/815024 | 15:56 |
| opendevreview | Clark Boylan proposed zuul/zuul-jobs master: DNM Manual depends on between dib and devstack https://review.opendev.org/c/zuul/zuul-jobs/+/815025 | 15:58 |
| *** ykarel is now known as ykarel|away | 15:58 | |
| opendevreview | Clark Boylan proposed openstack/diskimage-builder master: DNM testing against devstack Nehalem change https://review.opendev.org/c/openstack/diskimage-builder/+/815028 | 16:01 |
| clarkb | frickler: ^ lets see how that does | 16:01 |
| frickler | clarkb: doesn't seem to work. but also interesting set of unrelated failures | 16:15 |
| clarkb | frickler: which thing isn't working? I am not seeing failures yet | 16:16 |
| frickler | clarkb: on the zuul-jobs change | 16:16 |
| clarkb | oh the zuul jobs change. Ya I don't need it to merge, I just need it to exist for fetching the change in the dib jobs :) | 16:17 |
| frickler | also the "conflicts" shows ianw has tried this earlier already https://review.opendev.org/c/zuul/zuul-jobs/+/791116 | 16:17 |
| clarkb | ah cool worth following up on that more generic setup then I guess | 16:17 |
| frickler | that might even be mergeable, modulo those linter+py27 failures | 16:18 |
| *** marios is now known as marios|out | 16:22 | |
| frickler | clarkb: I think you need to use shell instead of command. the "&& ..." is placed into the first git command | 16:22 |
| Clark[m] | frickler: arg I had it as shell first too locally. I think you are right | 16:22 |
| frickler | https://zuul.opendev.org/t/zuul/build/72af9d14a1334eac8036b68e313fbfea | 16:22 |
| opendevreview | Clark Boylan proposed zuul/zuul-jobs master: DNM Manual depends on between dib and devstack https://review.opendev.org/c/zuul/zuul-jobs/+/815025 | 16:23 |
| *** ysandeep is now known as ysandeep|out | 16:23 | |
| clarkb | heh mixing up my clients. Sorry about that | 16:23 |
| *** bhagyashris_ is now known as bhagyashris | 16:27 | |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update zuul restart documentation https://review.opendev.org/c/opendev/system-config/+/814808 | 17:39 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Add zuul debugging documentation https://review.opendev.org/c/opendev/system-config/+/814812 | 17:39 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update zuul secrets decryption docs https://review.opendev.org/c/opendev/system-config/+/814817 | 17:39 |
| clarkb | fungi: frickler ^ fixed the review nits, but I Think we can probably land that today maybe? | 17:40 |
| clarkb | https://zuul.opendev.org/t/openstack/build/b5841d4d264c4c8f93d2368500d6221d nehalem worked | 17:41 |
| clarkb | now we just need to recheck the devsatck change enough to be confident all the clouds can support a nehalem qemu cpu | 17:41 |
| fungi | clarkb: i see you replied to the second e-mail, that was basically the same as what i was going to send anyway. i guess i can still do that if they don't seem to have received it either | 17:51 |
| clarkb | fungi: ya sorry I didn't want it to get forgotten so went ahead and responded. And ya if they continue to not respond I guess then we can assume I'm getting bitbucketed | 17:52 |
| fungi | corvus: i'm occasionally getting "AttributeError: 'Text' object has no attribute 'keypress'" raised at the beginning of gertty.view.change.ChangeView.keypress() where it tries to assign key = super(ChangeView, self).keypress(size, key) | 17:58 |
| fungi | seems to happen when i'm using pgdn to scroll through a diff view | 17:58 |
| fungi | but i'm not sure what the underlying cause might be, wondering if it's safe to just catch the AttributeError there are return None, or if it's a sign of some underlying bug which needs to be addressed | 17:59 |
| fungi | s/are/and/ | 17:59 |
| clarkb | fungi: I self approved https://review.opendev.org/c/opendev/bindep/+/814839 as I doubt anyone else will be reviewing that one | 18:03 |
| clarkb | that is the bindep newline change | 18:03 |
| fungi | wfm, thanks | 18:06 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Add comments to manage-projects about project-config syncing https://review.opendev.org/c/opendev/system-config/+/815049 | 18:45 |
| clarkb | fungi: ^ thats my last todo out of the renaming process | 18:45 |
| clarkb | Not a perfect solution but I think it calls out things in enough detail that we can improve the actual renaming process going forward. One thing that leads me to is we might consider squashing renaming changes into a single change in the future | 18:45 |
| *** sshnaidm is now known as sshnaidm|afk | 18:53 | |
| opendevreview | Merged opendev/bindep master: Handle no newline at the end of bindep.txt https://review.opendev.org/c/opendev/bindep/+/814839 | 19:15 |
| clarkb | I'm not sure that is worth a new release on its own but if we ever make another release that will be included :) | 19:16 |
| clarkb | corvus: did you want to review the stack at https://review.opendev.org/c/opendev/system-config/+/814808 ? all three changes are opendev zuul docs updates for various zuul acitvities in opendev (restarts, debugging, secret decryption) | 19:24 |
| corvus | clarkb: can do. | 20:17 |
| corvus | fungi: i have not seen that, and that does not make sense to me... | 20:18 |
| corvus | all approved, one +2 comment on the first | 20:21 |
| clarkb | corvus: fair enough I'll do a followup for that | 20:22 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Make logging zuul restarts less optional https://review.opendev.org/c/opendev/system-config/+/815065 | 20:25 |
| clarkb | corvus: ^ thats the followup | 20:25 |
| opendevreview | Merged opendev/system-config master: Update zuul restart documentation https://review.opendev.org/c/opendev/system-config/+/814808 | 20:27 |
| opendevreview | Merged opendev/system-config master: Add zuul debugging documentation https://review.opendev.org/c/opendev/system-config/+/814812 | 20:31 |
| opendevreview | Merged opendev/system-config master: Update zuul secrets decryption docs https://review.opendev.org/c/opendev/system-config/+/814817 | 20:31 |
| clarkb | spot checking the nehalem cpu change in devstack it seems like the various clouds (if not all regions) are supporting it. I need more data to say all regions are fine with it. Also the change as written may not work on arm64 | 20:36 |
| clarkb | there is a consistent failure in airship-kna1 but it is related to metadata service being slow not inability to boot VMs with thedifferent cpu type so I think we're ok there | 20:36 |
| clarkb | ah looks like devstack already handles the arm64 situation | 20:37 |
| corvus | imma just gonna +3 that | 20:40 |
| clarkb | thanks! | 20:40 |
| opendevreview | Merged opendev/system-config master: Make logging zuul restarts less optional https://review.opendev.org/c/opendev/system-config/+/815065 | 20:47 |
| ianw | clarkb: thanks for digging into the cpu thing, as soon as it was pointed out i figure this was something we needed to consider more globally | 20:58 |
| clarkb | ianw: ya kashyap really did the hard work | 20:58 |
| clarkb | ianw: the rechecks on the devsatck side seem ok so far (some failures but none related to cpu model as far as I can tell) | 20:59 |
| clarkb | I strongly suspect this will be the fix we end up with | 20:59 |
| ianw | my brother in law, who lives 9 hours drive from both sydney and melbourne, just got his starlink dish -> https://imgur.com/a/r0bbjxA | 21:03 |
| clarkb | not bad | 21:04 |
| ianw | the wheels released after we fixed the quota/bindep issues yesterday, yay! | 21:27 |
| opendevreview | James E. Blair proposed zuul/zuul-jobs master: Return dstat graph artifact https://review.opendev.org/c/zuul/zuul-jobs/+/815078 | 21:32 |
| *** dviroel|rover is now known as dviroel|rover|afk | 21:58 | |
| opendevreview | James E. Blair proposed zuul/zuul-jobs master: Use pcp instead of dstand and return dstat graph artifact https://review.opendev.org/c/zuul/zuul-jobs/+/815078 | 22:25 |
| clarkb | ianw: if you get a chance can you weigh in on https://review.opendev.org/c/opendev/system-config/+/814443 | 22:29 |
| ianw | oh yep, lgtm. always easy to go back | 22:32 |
| clarkb | tomorrow I'll probably land the gerrit group removal (in favor of the review group) | 22:38 |
| clarkb | as I expect I'll have time to keep a watchful eye on it. Also rereview the CD reorg in system-config | 22:39 |
| opendevreview | James E. Blair proposed zuul/zuul-jobs master: Use pcp instead of dstand and return dstat graph artifact https://review.opendev.org/c/zuul/zuul-jobs/+/815078 | 22:40 |
| opendevreview | Merged zuul/zuul-jobs master: Use pcp instead of dstand and return dstat graph artifact https://review.opendev.org/c/zuul/zuul-jobs/+/815078 | 23:17 |
| opendevreview | Merged opendev/system-config master: Always update gitea repo meta data https://review.opendev.org/c/opendev/system-config/+/814443 | 23:45 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!