Tuesday, 2023-10-24

mnasiadkafrickler: not really, everything was fine for me :)07:44
*** jroll05 is now known as jroll008:57
Clark[m]Johnson: fyi https://github.com/openstack/octavia/pull/812:40
Clark[m]Gah autocorrect is so annoying sometimes. johnsom ^12:40
gthiemongeClark[m]: interesting, this is an update of a patch that was already proposed on gerrit12:44
fungiClark[m]: sorry, still not really around until tomorrow afternoon, but is 358954 a typo? looks like an abandoned change from 7 years ago...12:51
fungioh! it's on gerrit's gerrit, not ours12:52
fungishould be fine, openstack election tooling uses anonymous queries, so had to switch to only relying on the gerrit "preferred" address years ago12:54
Clark[m]fungi: ya I'm slowly trying to work through the gerrit breaking change list and keeping track on that etherpad12:56
opendevreviewMerged openstack/project-config master: Add infrawatch/sg-core to available repos  https://review.opendev.org/c/openstack/project-config/+/89831413:09
clarkbI think ara has broken our system-config-run-* jobs14:42
clarkbnot sure yet if that was a one off failuer or something more persistent. I'm going to recheck (since that is easy) and then if it hapepns again look at debugging after PTG stuff14:43
fricklerclarkb: does it look like this? https://paste.openstack.org/show/b441YNDGVTDSizdpec90/ that's apparently due to a new ruamel version14:47
clarkbhrm no it failed on  sqlite3.OperationalError: no such table: playbooks but looking closer I think this was because ansible didn't run in the main job14:48
clarkbso the failure is actually elsewhere and ara fails beacuse we don't have any data generated for it to process into a report14:49
clarkbhttps://zuul.opendev.org/t/openstack/build/2f5672507d4c4aaaa7251430726873fe/logs is the build that failed14:50
frickler"Install root key" is what failed there, though no_log is set https://zuul.opendev.org/t/openstack/build/2f5672507d4c4aaaa7251430726873fe/console#2/0/46/bridge99.opendev.org14:51
fricklersame failure though in two jobs in the buildset, strange14:53
clarkbya it does look like that task records its log onto disk though so in theory I can hold the nodes and check for that log file to see why it broke14:54
clarkbthat will be the next step I think14:55
clarkbmy held nodes for gerrit yesterday hit this and didn't deploy gerrit things15:08
clarkbnot sure what is going on based on the logs yet though. Might need to -vvv the ansible run15:08
clarkbon a held server I reran the command that failed manually but switched -v to -vvv unfortunately it passed15:25
clarkbreturn code 015:25
clarkbI think a DNM change to remove the no log is in order as well as a bump to -vvv there?15:25
clarkboh maybe this command isn't what failed though and something else in the included role broke?15:26
opendevreviewClark Boylan proposed opendev/system-config master: DO NOT MERGE This is debugging only and if merged would be problematic for production  https://review.opendev.org/c/opendev/system-config/+/89918615:29
clarkblets see what that shows15:29
clarkboops forgot -vvv update. Maybe we'll see enough as is though15:33
clarkbheh of course that triggers a bunch of jobs15:37
clarkboh and I didn't set pipefail so maybe these will "succeed" on that task15:42
clarkbfrickler: yes now that we have logs it does appear to be that ruamel problem. Any idea what the fix is?15:47
clarkbfrickler: do we disable ara or maybe pin ruamel?15:47
opendevreviewClark Boylan proposed opendev/system-config master: DO NOT MERGE This is debugging only and if merged would be problematic for production  https://review.opendev.org/c/opendev/system-config/+/89918615:48
clarkb"If you only read this after your program has stopped working: I am sorry to hear that, but that also means you, or the person developing your program, has not tested with warnings on"15:50
opendevreviewClark Boylan proposed opendev/system-config master: Cap ruamel.yaml install for ARA  https://review.opendev.org/c/opendev/system-config/+/89919015:55
clarkb899190 will have to be rebased off of the DNM fix change if it fixes things15:55
clarkbit isn't clear to me hwy it didn't break when I ran things by hand on the held nodes15:55
clarkbmaybe ara is doing somethign stateful and skipping running on a second pass because the first ran failed so it disables itself?16:02
opendevreviewClark Boylan proposed opendev/system-config master: DO NOT MERGE This is debugging only and if merged would be problematic for production  https://review.opendev.org/c/opendev/system-config/+/89918616:22
opendevreviewClark Boylan proposed opendev/system-config master: Cap ruamel.yaml install for ARA  https://review.opendev.org/c/opendev/system-config/+/89919016:22
clarkbthis little corner of code is hitting all of the corner case gotchas. Yaml block string quoting fun, shell executable being sh not bash, pypi dependency problems16:22
opendevreviewClark Boylan proposed opendev/system-config master: Cap ruamel.yaml install for ARA  https://review.opendev.org/c/opendev/system-config/+/89919016:44
clarkbok based on test results from the previous stack I think ^ does fix things for us so I have rebased it off of the DNM change to make it mergable16:44
opendevreviewMerged opendev/system-config master: Cap ruamel.yaml install for ARA  https://review.opendev.org/c/opendev/system-config/+/89919017:35
clarkbI have abandoned https://review.opendev.org/c/opendev/system-config/+/899186 to make it much less likely it will ever merge17:44
opendevreviewMerged opendev/system-config master: Add zk test to check myid is set in service  https://review.opendev.org/c/opendev/system-config/+/89861418:38
*** diablo_rojo is now known as Guest449619:30
opendevreviewTristan Cacqueray proposed zuul/zuul-jobs master: Introduce logreduce roles  https://review.opendev.org/c/zuul/zuul-jobs/+/89921220:24
opendevreviewTristan Cacqueray proposed zuul/zuul-jobs master: Introduce logreduce roles  https://review.opendev.org/c/zuul/zuul-jobs/+/89921220:51
opendevreviewClark Boylan proposed opendev/system-config master: WIP Update gitea to 1.21  https://review.opendev.org/c/opendev/system-config/+/89767920:55
clarkbthere was a minor template difference between rc1 and rc2 but that was it20:56
clarkbhttps://149.202.181.121/c/x/test-project/+/3 shows comment links work for everything but the gitsha comment link. I'll have to dig into that more I guess21:01
clarkboh maybe this is simple. It appears to need to be surrounded by whitespace or <p> tags. My test case didn't do that.21:03
clarkbI think we can probably update the regex to make the test case work though and that might be worthwile but I've shown the commentlink works generally which means i think the commentlinks update change here: https://review.opendev.org/c/opendev/system-config/+/898989 is safe to merge whenever we want to restart gerrit to pick that up21:04
opendevreviewTristan Cacqueray proposed zuul/zuul-jobs master: Introduce logreduce roles  https://review.opendev.org/c/zuul/zuul-jobs/+/89921221:06
ianwobviously it got figured out, @ https://meetings.opendev.org/irclogs/%23opendev/%23opendev.2023-06-13.log.html#t2023-06-13T00:57:28 i did put the linaro steps into a file bridge:/root/tmp/linaro-renew-steps.txt (not that this was discoverable in any way)21:28
ianwi just ran out of time trying to split up the base install bits so we could have our users, deploy a script or similar on linaro but not do our full base playbook, which was wary would probably not be compatible with kolla21:29
Clark[m]The notes you left in the email were more than plenty to figure it out. Thank you for the writing those down. And ya avoiding conflicts between Kolla/openstack and our base playbooks seems like a good thing21:55
opendevreviewJames E. Blair proposed zuul/zuul-jobs master: Switch ensure-openshift to quay.io  https://review.opendev.org/c/zuul/zuul-jobs/+/89921722:33
opendevreviewTristan Cacqueray proposed zuul/zuul-jobs master: Introduce logreduce roles  https://review.opendev.org/c/zuul/zuul-jobs/+/89921222:37
opendevreviewTristan Cacqueray proposed zuul/zuul-jobs master: Introduce logreduce roles  https://review.opendev.org/c/zuul/zuul-jobs/+/89921223:02
opendevreviewJulia Kreger proposed opendev/glean master: Add support for tinycore linux  https://review.opendev.org/c/opendev/glean/+/89921923:13
opendevreviewTristan Cacqueray proposed zuul/zuul-jobs master: Introduce logreduce roles  https://review.opendev.org/c/zuul/zuul-jobs/+/89921223:25

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!