| clarkb | corvus: mordred: I'm noticing that I may have done a derp with timezones and the EMS discussion. I see now there may have been a desire to do 17:00 UK time instead of UTC. I'm able to do both (UK time would be 16:00 UTC). I'm usually awake well in advance of that and will try to clarify in the morning. Sorry about that | 00:27 |
|---|---|---|
| clarkb | also yay timezones | 00:27 |
| corvus | clarkb: i think that should be okay for me | 00:36 |
| *** ysandeep|away is now known as ysandeep | 01:09 | |
| mordred | clarkb: no worries - should be fine for me too | 01:18 |
| *** ykarel|away is now known as ykarel | 04:39 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: Add introduction to the container jobs documentation https://review.opendev.org/c/zuul/zuul-jobs/+/798969 | 04:53 |
| opendevreview | Ian Wienand proposed opendev/lodgeit master: Add mariadb requirements https://review.opendev.org/c/opendev/lodgeit/+/798411 | 05:05 |
| opendevreview | Merged opendev/base-jobs master: Add opendev-intermediate-registry-base https://review.opendev.org/c/opendev/base-jobs/+/798789 | 05:09 |
| *** bhagyashris is now known as bhagyashris|ruck | 05:22 | |
| *** chandankumar is now known as chkumar|rover | 05:31 | |
| *** gthiemon1e is now known as gthiemonge | 06:31 | |
| *** amoralej|off is now known as amoralej | 06:45 | |
| opendevreview | Ian Wienand proposed opendev/lodgeit master: Add mariadb connector to container https://review.opendev.org/c/opendev/lodgeit/+/798411 | 07:08 |
| opendevreview | Ian Wienand proposed opendev/lodgeit master: Drop Python 2.7 support https://review.opendev.org/c/opendev/lodgeit/+/798990 | 07:08 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Add paste service https://review.opendev.org/c/opendev/system-config/+/798400 | 07:15 |
| ianw | clarkb/fungi: ^ ready for review. i don't care about paste that much, what really interests me is getting a bit of experience with the mariadb container, which is the same as rolled out to review02 | 07:16 |
| *** gthiemon1e is now known as gthiemonge | 07:18 | |
| *** jpena|off is now known as jpena | 07:34 | |
| opendevreview | Ian Wienand proposed opendev/base-jobs master: Revert "Add opendev-intermediate-registry-base" https://review.opendev.org/c/opendev/base-jobs/+/798997 | 07:36 |
| *** ysandeep is now known as ysandeep|lunch | 07:48 | |
| opendevreview | Merged opendev/base-jobs master: Revert "Add opendev-intermediate-registry-base" https://review.opendev.org/c/opendev/base-jobs/+/798997 | 07:49 |
| opendevreview | Ian Wienand proposed opendev/lodgeit master: Add mariadb connector to container https://review.opendev.org/c/opendev/lodgeit/+/798411 | 08:02 |
| opendevreview | Ian Wienand proposed opendev/system-config master: Add paste service https://review.opendev.org/c/opendev/system-config/+/798400 | 08:06 |
| opendevreview | Ian Wienand proposed opendev/system-config master: lodgeit: use mariadb connector https://review.opendev.org/c/opendev/system-config/+/799004 | 08:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: Add introduction to the container jobs documentation https://review.opendev.org/c/zuul/zuul-jobs/+/798969 | 08:27 |
| *** slaweq_ is now known as slaweq | 08:29 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: Add introduction to the container jobs documentation https://review.opendev.org/c/zuul/zuul-jobs/+/798969 | 08:31 |
| *** ykarel is now known as ykarel|lunch | 08:44 | |
| *** ysandeep|lunch is now known as ysandeep | 08:45 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: Add introduction to the container jobs documentation https://review.opendev.org/c/zuul/zuul-jobs/+/798969 | 08:51 |
| *** sshnaidm is now known as sshnaidm|afk | 09:24 | |
| opendevreview | Merged opendev/system-config master: refstack: trigger image upload https://review.opendev.org/c/opendev/system-config/+/798931 | 09:37 |
| *** ykarel|lunch is now known as ykarel | 09:59 | |
| *** sshnaidm|afk is now known as sshnaidm | 10:47 | |
| *** dviroel|out is now known as dviroel | 11:32 | |
| *** jpena is now known as jpena|lunch | 11:47 | |
| fungi | noonedeadpunk: if you get time, can you take a look at ianw's two changes proposed changes for opendev/lodgeit? i know you've had some interest in it in the past | 12:26 |
| fungi | in particular, the first one is dropping python 2.7 support, and i don't know if that will impact your deployment | 12:26 |
| noonedeadpunk | yeah, that's fine as eventually it's dropping py27 only for CI I guess | 12:29 |
| noonedeadpunk | but I'm not sure under which python it works atm? As Iguess it's 2.7? | 12:29 |
| fungi | noonedeadpunk: these are preparing for 798400 which runs it from the containers we're building, so effectively switching to 3.x | 12:33 |
| fungi | though you're right, it does mean we risk merging a change which breaks 2.7 support while working on switching over our deployment | 12:34 |
| fungi | ianw: ^ we might want to call for a bit of a freeze on merging functional changes for lodgeit between when we merge 798990 and when we switch production over | 12:35 |
| fungi | not that it gets that many changes | 12:35 |
| noonedeadpunk | and iirc there's issue with py 3.8 due to old Werkzeug and I never had time to re-work using script | 12:42 |
| noonedeadpunk | and https://review.opendev.org/c/opendev/lodgeit/+/693378 was reasonably -CR | 12:42 |
| *** jpena|lunch is now known as jpena | 12:45 | |
| *** amoralej is now known as amoralej|lunch | 13:02 | |
| *** corvus is now known as Guest1170 | 13:12 | |
| fungi | noonedeadpunk: that's probably worth mentioning on 798990 in that case | 13:15 |
| *** marios is now known as marios|call | 13:26 | |
| *** amoralej|lunch is now known as amoralej | 13:54 | |
| clarkb | Guest1170: mordred looks like 16:00UTC is preferable | 14:21 |
| clarkb | also looks like the matrix oftc bridge had a hiccup? | 14:22 |
| *** ykarel is now known as ykarel|away | 14:25 | |
| Guest1170 | clarkb: ack; what'd the hiccup look like? | 14:52 |
| fungi | Guest1170: well, for starters you seem to be stuck with a guest nick | 14:53 |
| fungi | (or was that intentional?) | 14:53 |
| Guest1170 | neat, that is unapparent to me ;) | 14:53 |
| fungi | but there was a mass exit and rejoin which had a bunch of ...[m] nicks, looked like a netsplit | 14:54 |
| *** Guest1170 is now known as corvus | 14:54 | |
| fungi | reason was "Quit: Bridge terminating on SIGTERM) | 14:54 |
| *** corvus is now known as Guest1175 | 14:55 | |
| Guest1175 | ok, i had a chat with oftc-irc, and it said i was called Guest1170, but i told it i wanted to be corvus and it said ok. | 14:55 |
| fungi | it already switched you back to a guest nick again | 14:55 |
| Guest1175 | hrm | 14:55 |
| fungi | like your session isn't identified to the nickserv | 14:55 |
| fungi | (and with enforce set on your nick) | 14:55 |
| Guest1175 | usually oftc-irc handles that, but i guess whatever happened disrupted that process; i'll chat with nickserv | 14:56 |
| *** Guest1175 is now known as corvus | 14:57 | |
| *** corvus is now known as jeblair | 14:58 | |
| *** jeblair is now known as corvus | 14:58 | |
| corvus | how my doing now? | 14:58 |
| fungi | seems to be working now | 14:59 |
| fungi | it hasn't forced you back since 14:57 | 14:59 |
| fungi | whereas previously it was near-instant | 14:59 |
| corvus | seems like oftc-irc got out of sync with nickserv; so i had to manually identify to nickserv, then change my nick with oftc-irc twice (because it still thought i was corvus) | 15:00 |
| clarkb | I see a corvus now | 15:02 |
| fungi | same | 15:04 |
| fungi | that's fun | 15:04 |
| corvus | it's interesting how invisible that can be to folks on the matrix side | 15:05 |
| fungi | yeah, i guess because they're seeing just the matrix end so if it's out of sync, then that won't be visible | 15:06 |
| *** marios|call is now known as marios | 15:26 | |
| clarkb | https://matrix.org/blog/2021/06/30/security-update-synapse-1-37-1-released is interesting. Good to see them be so proactive about this though | 15:30 |
| *** sshnaidm is now known as sshnaidm|afk | 15:46 | |
| corvus | neat; i'll upgrade my synapse later today | 15:52 |
| corvus | mordred: can you tell what synapse you're running, and what the upgrade process is like? | 15:53 |
| corvus | (just wondering if that would give us clues to what life with ems hosting would be like -- do they just do that automatically in the background, etc...) | 15:53 |
| mordred | lemme see | 15:54 |
| mordred | so - it's not showing me a version that I see at the moment - it does say: "(last update: 10:58:58)" | 15:59 |
| mordred | oh - found it | 15:59 |
| * mordred uploaded an image: (173KiB) < https://matrix.org/_matrix/media/r0/download/inaugust.com/7be54b4c4e96bf116af188fd193b38846f21b6db/Screen%20Shot%202021-07-01%20at%2010.59.41.png > | 16:00 | |
| *** dviroel is now known as dviroel|lunch | 16:00 | |
| clarkb | mordred: corvus: its time now if you want to join | 16:01 |
| corvus | mordred: neat; so seems like they're keeping stuff up-to-date automatically without you noticing at all | 16:01 |
| *** ysandeep is now known as ysandeep|dinner | 16:01 | |
| fungi | mayhaps that was the reason for the bridge dropping and reconnecting earlier | 16:02 |
| *** amoralej is now known as amoralej|off | 16:07 | |
| *** marios is now known as marios|afk | 16:12 | |
| *** marios|afk is now known as marios|bosu | 16:22 | |
| *** marios|bosu is now known as marios|out | 16:23 | |
| *** dviroel|lunch is now known as dviroel | 16:28 | |
| clarkb | that went well. They don't seem opposed to our idea of how we host users separate from the homeserver. It sounds like the next steps will be for me to tell jbryce what I have learned since a credit card is necessary to take the next step (I'm meeting with him later today) then sign up at a trial level and start interacting with EMS directly | 16:30 |
| clarkb | mordred: corvus: (and the rest of infra-root) I'll keep you updated on that process but I can probably boostrap things to the point where other admins can start interacting with the small setup? | 16:30 |
| mordred | clarkb: yah. notable when you're setting up the homeserver, there is a field on the wizard called "custom DNS" - which you definitely want to expand/enable | 16:32 |
| clarkb | mordred: ok. I'm sure I'll ask lots of questions when I get to that points | 16:32 |
| mordred | that's what you need to do for us to be able to set the dns records and whatnot | 16:32 |
| mordred | it's mostly very straightforward | 16:32 |
| mordred | but I messed that up on my first stab at setting up the inaugust homeserver | 16:32 |
| clarkb | corvus: also I guess we should update the spec at this point since EMS didn't object immediately :) ? | 16:33 |
| mordred | clarkb: we'll also need to publish two well-known files on opendev.org | 16:33 |
| clarkb | ya that should be easy we just add it to the docker image (we already od that for the logo file iirc) | 16:34 |
| mordred | yah | 16:34 |
| mordred | https://opendev.org/inaugust/inaugust.com/src/branch/master/src/.well-known/matrix | 16:34 |
| mordred | those are mine, fwiw | 16:34 |
| fungi | popping out to the hardware store for a bit, but should return shortly | 16:35 |
| *** jpena is now known as jpena|off | 16:36 | |
| *** ysandeep|dinner is now known as ysandeep | 16:44 | |
| corvus | clarkb, mordred: yep, i'll update the spec to say "ems hosted" | 17:07 |
| *** ysandeep is now known as ysandeep|out | 17:24 | |
| fungi | okay, hardware has been obtained. also dirt. growing up in the mountains i would have never thought that buying dirt and rocks is a thing. now that i live on a sandbar where those resources are scarce, i understand it, but still feel inherently weird doing it | 17:51 |
| clarkb | fungi: you can also get giant dump trucks to dump it off in front of your drive way around here | 17:53 |
| clarkb | but then if I want to get rid of it again that is far more problematic as we have an invasive beetle around here and dirt is quarantined | 17:53 |
| fungi | yeah, here too, but they bring it from not this island, so it's not cheap | 17:53 |
| fungi | dump trucks of dirt being a thing here too i mean | 17:53 |
| fungi | here you usually just buy sand by the truckload if you need fill. or crushed shells | 17:54 |
| fungi | they're constantly dredging all that out of the inlets to keep them from shoaling over, so there's a surplus | 17:54 |
| fungi | here we put dirt in containers, it's way to precious to just dump on the ground ;) | 17:55 |
| fungi | otherwise it could just be carried away on the next tide | 17:56 |
| clarkb | diablo_rojo_phone: looks like the ptgbot container change is really close (it hit an issue in the gate after ianw approved it) there is a commetn on the change for how to fix the latest thing | 18:01 |
| diablo_rojo | clarkb, I will get the change updated today | 18:02 |
| corvus | We have clay on the ground so we have to buy dirt if we want things to grow, but we started making our own soil, so hopefully we won't need to buy any more. | 18:38 |
| clarkb | we got email from rackspace indicating afsdb03 had trouble. I see it has been up fro a couple of hours now and bos status against it seems fine | 18:44 |
| fungi | may be worth checking that vos release is still coming back clean for stuff in our logs, but sounds like it's okay | 18:50 |
| *** dviroel is now known as dviroel|sfk | 19:00 | |
| *** dviroel|sfk is now known as dviroel|afk | 19:01 | |
| *** gthiemon1e is now known as gthiemonge | 19:05 | |
| clarkb | infra-root I'm finally in a spot where I think I can keep an eye on https://review.opendev.org/c/opendev/system-config/+/794049 fallout so I'll approve that now | 20:18 |
| clarkb | please say something if you don't get puppet jobs running when you expect them to | 20:19 |
| clarkb | it only affects testing and is an easy revert if necessary | 20:19 |
| fungi | thanks for the heads up! | 20:21 |
| *** dviroel|afk is now known as dviroel | 20:21 | |
| opendevreview | Merged opendev/system-config master: Run the puppet apply job less often https://review.opendev.org/c/opendev/system-config/+/794049 | 20:29 |
| clarkb | fungi: our arm64 queue looks weird. We are still running jobs not not as many as I would expect based on the grafana graphs | 21:42 |
| clarkb | also linaro seems completely unused? | 21:42 |
| clarkb | our max servers value for linaro is 40 though | 21:42 |
| clarkb | [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired | 21:43 |
| clarkb | confirmed the cert expired on the 27th of june | 21:44 |
| clarkb | kevinz: ^ fyi the linaro cloud's ssl cert has expired and that is preventing us frmo scheduling workload to it | 21:44 |
| clarkb | I suspect the weirdness is that we need linaro to fail enough times that osuosl picks it up and osuosl has less overal headroom so it just takes longer? | 21:45 |
| clarkb | kevinz: if you use acme.sh for that LE provisioning they changed their default cert provider to zerossl. There are command line flags you can use to force letsencypt again (we ran into this somewhat recently) | 21:46 |
| *** dviroel is now known as dviroel|out | 21:52 | |
| fungi | clarkb: yeah, it seems like the cert for the api there is not auto-updating. we get into this same situation every few months and then he replaces the cert | 21:59 |
| clarkb | maybe we should add that host to certcheck? | 22:01 |
| fungi | not a terrible idea, at least then we could give kevinz a heads up one month in advance | 22:17 |
| fungi | do we need to keep running track-upstream for our gerrit? the replacement gerrit server e-mails us about a failure ~hourly from that cronjob, and i'm not certain we even still rely on it for anything of note | 22:22 |
| fungi | were we still relying on it in production until the very recent move to using upstream gerrit source for our images? | 22:23 |
| clarkb | fungi: we were relying on it on gerrit 213 | 22:26 |
| clarkb | *2.13 | 22:26 |
| clarkb | but when we upgraded to 3.2 we applied our patches using patch and diffs in the container dir. I think we can go that route for any potential future patching and just stop the upstream tracking | 22:27 |
| clarkb | (also we are unforked now and should keep it that way if at all possible) | 22:27 |
| ianw | clarkb / corvus: so after merging that intermediate registry pull yesterday i went to apply it an what started starting me in the face but ... https://opendev.org/opendev/system-config/src/branch/master/zuul.d/system-config-run.yaml#L34 | 22:34 |
| fungi | clarkb: okay, so we could probably retire our gerrit fork repo, and also disable/remove our track-upstream cronjob? | 22:34 |
| clarkb | fungi: pretty sure we can yes. gerrit.googlesource.com/gerrit is the git repo we check out in our jobs | 22:36 |
| clarkb | not our fork | 22:36 |
| clarkb | ianw: ah we have it in system-config not base-josb? | 22:37 |
| ianw | basically we already had it with "parent: opendev-buildset-registry-consumer" @ https://opendev.org/opendev/system-config/src/branch/master/zuul.d/system-config-run.yaml#L41 | 22:37 |
| ianw | i had totally missed it and didn't notice it. i think some of our jobs are incorrectly parented now, need to audit them | 22:38 |
| clarkb | ++ | 22:39 |
| ianw | kopecmartin: do you want me to pull the refstack container? i wasn't quite clear on the ordering required | 22:43 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Drop use of track-upstream https://review.opendev.org/c/openstack/project-config/+/799123 | 22:47 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Good riddance to track-upstream and its cronjob https://review.opendev.org/c/opendev/system-config/+/799124 | 22:48 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Drop use of track-upstream https://review.opendev.org/c/openstack/project-config/+/799123 | 23:14 |
| opendevreview | Ian Wienand proposed openstack/diskimage-builder master: [wip] test centos8-stream with hwrng map https://review.opendev.org/c/openstack/diskimage-builder/+/799126 | 23:28 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
