| opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/897273 | 02:14 |
|---|---|---|
| opendevreview | Merged openstack/project-config master: Revert "Temporarily remove release docs semaphores" https://review.opendev.org/c/openstack/project-config/+/896949 | 02:33 |
| frickler | not sure why the proposal bot sent a no-change update on this one, normally it should detect this and not send a new patchset? https://review.opendev.org/c/openstack/project-config/+/897273/1..2 | 02:35 |
| opendevreview | Merged openstack/project-config master: Add nested-virt-debian-bookworm https://review.opendev.org/c/openstack/project-config/+/897331 | 02:36 |
| frickler | does anyone understand when gerrit shows merge conflicts and when and why it does not? on https://review.opendev.org/c/openstack/project-config/+/896595 I was being shown five conflicts after submitting a +2, after a reload, they are no longer shown, same when I initially looked at it | 02:47 |
| frickler | infra-root: I'm hesitating to abandon https://review.opendev.org/c/openstack/project-config/+/722926 because it sounds like this might actually still be relevant? | 03:05 |
| *** diablo_rojo is now known as Guest2219 | 04:05 | |
| opendevreview | Merged openstack/project-config master: Clean up vestigial default-branch https://review.opendev.org/c/openstack/project-config/+/896595 | 07:50 |
| fungi | frickler: it has seemed to me like gerrit shows merge conflict on newly uploaded changes until it gets a chance to run its merge conflict check in the background. i'm not really sure though | 12:00 |
| fungi | on 897273, yes the "New patch set was added with same tree, parent tree, and commit message..." is strange, i'll hunt down the build log for that in zuul to see if it explains why it did that | 12:02 |
| fungi | frickler: so, it did think there was a difference... https://zuul.opendev.org/t/openstack/build/a12bfe3d1dea480f8d6f3e9c5f07e8e1/log/job-output.txt#844-846 | 12:08 |
| fungi | even though gerrit then warned at push "no changes between prior commit f3b7bf3 and new commit 54cd8a1" | 12:09 |
| fungi | seeing if i can recreate that locally | 12:11 |
| fungi | looking through the build log, i don't see any indication that it actually checked out the previous change. it queries it and lists details, but doesn't seem to actually retrieve it | 12:19 |
| fungi | yeah, it should probably be an extra step in https://opendev.org/openstack/project-config/src/branch/master/tools/propose_projects_yaml_update.sh | 12:22 |
| fungi | by comparison, https://opendev.org/openstack/project-config/src/branch/master/playbooks/proposal/propose_update.sh#L149-L162 does a `git review -d` of the existing change | 12:25 |
| tkajinam | I've not yet checked details but git repository in gerrit responds quite slowly for me, it seems | 13:13 |
| tkajinam | wondering if anyone else is seeing the same problem | 13:13 |
| fungi | tkajinam: slow webui? slow to push changes to it? slow in some other way? | 13:16 |
| fungi | browsing around different changes and queries, it's as snappy as usual for me | 13:16 |
| fungi | are you connecting to it over ipv4 or ipv6? | 13:17 |
| tkajinam | webui works quite smooth. the problem is seen only in CLI so far, when git cli tires to fetch contents from git in review.opendev.org | 13:18 |
| fungi | i just did a `git remote update` in a weeks-old openstack/nova checkout and it took roughly 3 seconds to complete (pulling in new tags for train-eol and the bobcat release) | 13:20 |
| fungi | i'm connecting over ipv4 though, because of a long-standing routing issue in vexxhost where it seems like their bgp tables are missing a route to my isp | 13:20 |
| fungi | missing the ipv6 route i mean | 13:21 |
| tkajinam | git pull gerrit master -4 completes in less than 1 second but -6 takes a few minutes. so the issue seems to be specific to ipv6 | 13:21 |
| tkajinam | I manipulated my local ssh config to use IPv4 to connect review.opendev.org, which seems to be a valid solution so far. this might be an issue with network connectivity (in my local env or probably in vexxhost which you mentioned ?), instead of one in infra servers | 13:26 |
| fungi | yes, or anywhere on the internet in between, are you seeing packet loss or high round-trip latency when you ping6 review.opendev.org? | 13:28 |
| fungi | (compared to ipv4 ping) | 13:28 |
| tkajinam | aha. 100% packet loss when I ping review.opendev.org by IPv6 :-D | 13:30 |
| fungi | mnaser: guilhermesp: on a related note, has anyone had a chance to check your bgp tables and see if you're missing as20115's announcement for 2600:6c60::/32 ? | 13:31 |
| tkajinam | ping -4 responds normally. I can ping other sites such as google by ping6 so I guess something with ipv6 route between me and review.opendev.org is messed up I guess | 13:32 |
| fungi | tkajinam: if you feel comfortable messaging me privately with your ipv6 address, i can test from the gerrit server end to see if it's acting like vexxhost is missing a return route to you | 13:32 |
| fungi | if so, you may have the same issue i've been seeing from home | 13:33 |
| fungi | i opened a support ticket with vexxhost a month or so ago about it, but if there are more networks affected than just my isp's, that may indicate a more serious problem | 13:34 |
| tkajinam | I've not seen this issue earlier this month in my env. I replaced my laptop last week but afair I didn't face this problem when I was setting up the new one initially. | 13:40 |
| fungi | mnaser: guilhermesp: i checked trying to reach tkajinam's ipv6 address from two of our servers in vexxhost ca-ymq-1 and it's behaving the same as trying to reach my home ipv6 address (routing loop at the next hop, back and forth between 2604:e100:1::1 and 2604:e100:1::2) | 13:43 |
| fungi | but from a server in vexxhost sjc1 it's fine, like for me | 13:44 |
| *** blarnath is now known as d34dh0r53 | 13:49 | |
| clarkb | toomer: its best to just ask here. Typically we try to have two core reviewers on system-config changes, but that has been more difficult these days. I will defer to fungi on whether or not he is comfortable landing that change with only my review | 14:40 |
| clarkb | fungi: question is when are we ready to merge https://review.opendev.org/c/opendev/system-config/+/897234 ? | 14:41 |
| fungi | clarkb: toomer: i went ahead and approved it | 14:47 |
| fungi | i just wanted to make sure i had some free time to keep an eye on the deploy job in case it doesn't go as expected | 14:47 |
| fungi | and yes, normally we want two sysadmins who aren't the author to review changes like that one, but we did announce it during the sysadmins meeting on tuesday and there's been time for folks to object | 14:49 |
| clarkb | Gerrit User Community Meeting was short. Not sure I'm a fan of discord for voice calls yet, but it did work. Sounds like they are happy to ahve anyone edit the agenda going forward though so we can add our stuff there and I can try to attend (it is monthly first Thursday of the month at 8am pacific time) | 15:18 |
| clarkb | Sounded like its a quiet time for the project as everyone recovers from post summit stuff. Hopefully we get more movement on docs updates and bugfixes in a week or two | 15:19 |
| opendevreview | Merged opendev/system-config master: Add mailing list for Nordix environment https://review.opendev.org/c/opendev/system-config/+/897234 | 15:22 |
| fungi | now to make sure that ^ doesn't encounter deployment issues | 15:22 |
| toomer | clarkb: Thanks for a help with pushing that trough. When the mailing list is up I will try to enrol on it. | 15:28 |
| fungi | toomer: once zuul reports on that change with success from the deploy pipeline, i'll give it a quick look-over and let you know | 15:30 |
| fungi | infra-prod-service-lists3 is running for it now | 15:40 |
| fungi | toomer: https://lists.openinfra.dev/mailman3/lists/nordix.lists.openinfra.dev/ exists and i was able to subscribe to it | 15:46 |
| fungi | if you create an account with the sign-in button in the top-right corner, then you should automatically end up with list owner status for it once you've confirmed your account | 15:46 |
| fungi | er, i guess the button says "sign up" | 15:47 |
| fungi | i should have brought https://review.opendev.org/896652 "Add Element X Ignition support for Matrix" in tuesday's meeting, i'll add it to next week's agenda so i don't forget | 16:01 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update gitea base OS during image builds https://review.opendev.org/c/opendev/system-config/+/897480 | 18:00 |
| clarkb | fungi: what is the tool you use for your mute button? its some X thing that listens for the button event then fires a script? | 18:24 |
| fungi | yep, xbindkeys | 18:25 |
| clarkb | thanks@ | 18:26 |
| fungi | in my ~/.xbindkeysrc i just list the script i want run followed by its language for specifying the keyboard scancode to listen for | 18:27 |
| fungi | also i run xbindkeys at login from my ~/.xinitrc but your window manager may have its own methods for doing that | 18:28 |
| fungi | or session manager more like | 18:28 |
| fungi | ly | 18:28 |
| toomer | fungi: Thank you! I crated an account and I'm both the owner and moderator for the Nordix list | 18:57 |
| toomer | Do we have an OpenInfra Europe website ? | 18:59 |
| Clark[m] | https://openinfraeurope.org/ I think. Note the OpenDev team doesn't run that | 19:04 |
| fungi | toomer: the foundation staff probably contract out management of that site, but i can ask around if you need to know how to make changes | 19:05 |
| opendevreview | Dr. Jens Harbott proposed openstack/project-config master: Retire opendev/puppet-openstack_health: remove project from infa https://review.opendev.org/c/openstack/project-config/+/836712 | 19:25 |
| clarkb | fungi: I went ahead and approved the gitea container image update. I think if you want to approve the element X change behind that that is fine then maybe aim for 1.20.5 tomorrow? (a day later than anticipated, but I'm realizing I have enough other things to do that two gitea updatse is plenty ) | 19:49 |
| fungi | done | 20:26 |
| opendevreview | Merged opendev/system-config master: Update gitea base OS during image builds https://review.opendev.org/c/opendev/system-config/+/897480 | 20:57 |
| opendevreview | Merged opendev/system-config master: Add Element X Ignition support for Matrix https://review.opendev.org/c/opendev/system-config/+/896652 | 21:44 |
| clarkb | fungi: the matrix client file being served now is updated | 22:09 |
| clarkb | fwiw that didn't actually go in the image so I was mistaken | 22:09 |
| clarkb | we're just serving that off of disk | 22:09 |
| fungi | oh, yeah there's an ansible task to install it to the servers | 22:10 |
| fungi | okay | 22:10 |
| fungi | anyway, i'll take it back off next week's agenda | 22:10 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update the apache us filter set https://review.opendev.org/c/opendev/system-config/+/897500 | 22:33 |
| fungi | spotted some new ones, eh? | 22:48 |
| clarkb | ya when verifying the updates we just did I went "why is gitea09 so slow" -> "wow why si system load ~100" -> "I know probably the same old thing" sure enough found evidence of new friends | 22:50 |
| clarkb | there were a bunch of git processes running to cat files and the like which maps pretty cleanly to commit specific requests that we get hit with | 22:51 |
| clarkb | note that change adds regexes and exact matches. Should probably be checked carefully to make sure I didnd't do anything stupid adding regexes | 22:51 |
| clarkb | in particular I'm not sure if I need to escape some things now that I think of it | 22:51 |
| fungi | i wonder if we could make a filter test with a file that's populated with all the bogus agent strings we see from our logs over time | 22:52 |
| clarkb | ya I suspect the (s and )s will need escaping? or are they matched literally and \( and \) are used for groups? | 22:52 |
| fungi | basically stuff requests through with each string and make sure we get a 403 back | 22:53 |
| clarkb | `RewriteCond "%{HTTP_USER_AGENT}" "(iPhone|Blackberry|Android)"` <- is the example from the mod rewrite docs. Based on that I bet I have to escape the (s and )s | 22:53 |
| fungi | likely | 22:54 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update the apache ua filter set https://review.opendev.org/c/opendev/system-config/+/897500 | 23:03 |
| clarkb | I read the docs more closely and I'm 99% sure that update is necessary | 23:03 |
| fungi | aha, you also fixed up the commit title, so i can delete my nit comment i hadn't saved yet | 23:03 |
| clarkb | ya that bothered me as soon as I pushed it :) | 23:04 |
| clarkb | I'm going to have to punt the caracal signing key checking until tomorrow | 23:06 |
| clarkb | but hoping to get to it then between the other stuff | 23:06 |
| fungi | no worries, the release team will also make a test release as soon as it merges anyway, so we can double-check things are still working and validate as expected | 23:07 |
| clarkb | fwiw I think the gitea updates we landed applied properly across all of the servers despite these annoyances | 23:08 |
| fungi | load average of 100 is no match for ansible | 23:09 |
| clarkb | I also think it was largely disk bound which kept cpus free to do useful work | 23:10 |
| clarkb | fungi: I was looking to see if I could switch to element x and it seems to be mobile os only for now | 23:10 |
| clarkb | there is no web app update yet. | 23:10 |
| clarkb | not sure yet if I want to install yet another app to test things | 23:11 |
| fungi | probably only apps for android and iphone too, nothing for mobian/phosh/etc | 23:12 |
| clarkb | ya ios and android only | 23:12 |
| clarkb | you might be able to emulate the android app on other platforms though | 23:13 |
| clarkb | wow when did apache docs get colorful diagrams | 23:15 |
| clarkb | https://httpd.apache.org/docs/2.4/rewrite/intro.html | 23:15 |
| fungi | that's pretty slick | 23:15 |
| fungi | i shouldn't have peeked behind the curtain | 23:20 |
| fungi | apache docs are assembled from xml sources with a mashup of perl and java | 23:20 |
| fungi | all in subversion, of course | 23:21 |
| fungi | i suddenly no longer care to find out what tool they generated those diagrams with (if they are indeed generated at all) | 23:23 |
| fungi | xmp:CreatorTool="Adobe Photoshop CS5.1 Windows" | 23:24 |
| *** cloudnull7 is now known as cloudnull | 23:45 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!