| opendevreview | Merged opendev/statusbot master: Add mastodon support https://review.opendev.org/c/opendev/statusbot/+/864586 | 00:00 |
|---|---|---|
| opendevreview | Merged opendev/lodgeit master: Modernize test suite https://review.opendev.org/c/opendev/lodgeit/+/864222 | 00:01 |
| opendevreview | Ian Wienand proposed opendev/system-config master: statusbot: add mastodon config options https://review.opendev.org/c/opendev/system-config/+/864599 | 00:03 |
| clarkb | ianw: if you have time for https://review.opendev.org/c/opendev/system-config/+/864217 that would be great too. I'm happy to do the restarts (probably tomorrow at this point) just want some eyeballs to make sure I haven't done anything silly in building gerrit | 00:04 |
| ianw | clarkb: oh yep, thanks -- i looked last week and that's when i noticed the screenshots weren't updating when we (I) switched to bridge99 | 00:06 |
| ianw | that's all back, they're showing 3.5.4, so all lgtm. i approved it, i can do a quick restart when it's quiet later | 00:07 |
| clarkb | sounds great, thanks! | 00:07 |
| opendevreview | Merged opendev/lodgeit master: Update uwsgi image to python 3.10 https://review.opendev.org/c/opendev/lodgeit/+/864220 | 00:10 |
| opendevreview | Merged opendev/lodgeit master: Drop python 3.6 testing https://review.opendev.org/c/opendev/lodgeit/+/864221 | 00:10 |
| opendevreview | Ian Wienand proposed opendev/system-config master: opendev.org: add status update links https://review.opendev.org/c/opendev/system-config/+/864600 | 00:42 |
| opendevreview | Merged opendev/system-config master: Update Gerrit images to 3.5.4 and 3.6.3 https://review.opendev.org/c/opendev/system-config/+/864217 | 01:29 |
| opendevreview | Merged opendev/system-config master: statusbot: add mastodon config options https://review.opendev.org/c/opendev/system-config/+/864599 | 01:29 |
| ianw | #status log test | 01:49 |
| ianw | hrm, that just recursively tooted, which was *not* the intent :/ | 01:57 |
| opendevreview | Ian Wienand proposed opendev/statusbot master: Don't recurse on log() message https://review.opendev.org/c/opendev/statusbot/+/864634 | 02:08 |
| opendevreview | Merged opendev/statusbot master: Don't recurse on log() message https://review.opendev.org/c/opendev/statusbot/+/864634 | 02:36 |
| fungi | hah, yes, that's a mess. i wonder if we can clean it up | 02:37 |
| fungi | it just keeps scrolling and scrolling and... | 02:39 |
| ianw | it's "only" 300 messages. i'm running a script to slowly purge them, but have to be careful of rate limit | 02:40 |
| ianw | i have pulled that new image so it can't happen again at least | 02:40 |
| ianw | i am kind of surprised it let me post so many in a row so quickly like that | 02:41 |
| fungi | yeah, i eventually found the bottom | 02:41 |
| ianw | i don't exactly know how the rate limit works, but we can't remove any more until the top of the hour (2pm here) | 02:42 |
| fungi | i guess the real test post can be a #status log entry about adding a fosstodon handle to the statusbot | 02:43 |
| ianw | https://docs.joinmastodon.org/api/rate-limits/ | 02:44 |
| ianw | 300 in 5 minutes, so that's where the 300 comes from i guess! | 02:45 |
| ianw | that still seems high, i wouldn't mind if it was 5% of that | 02:45 |
| ianw | but it looks like we can only delete 30/30 minutes | 02:47 |
| fungi | so 5 hours to clean up 5 minutes of entries | 02:48 |
| ianw | sigh, a terrible first impression, totally my fault :( | 02:49 |
| *** rlandy is now known as rlandy|out | 03:00 | |
| ianw | #status log test | 03:04 |
| opendevstatus | ianw: finished logging | 03:04 |
| ianw | https://fosstodon.org/@opendevinfra/109351264242468623 ... that's more like it. i'll clean this up and hopefully we can start fresh | 03:05 |
| ianw | at least i'm having a better day than the two people chosen to drive up to a fully fueled rocket and tighten some leaking nuts, i guess | 03:06 |
| *** dasm|off is now known as Guest1634 | 03:20 | |
| opendevreview | Ian Wienand proposed opendev/statusbot master: Update ancient hacking version https://review.opendev.org/c/opendev/statusbot/+/864588 | 03:36 |
| *** yadnesh|away is now known as yadnesh | 04:46 | |
| ianw | i'll do the gerrit restart | 05:31 |
| ianw | https://hub.docker.com/layers/opendevorg/gerrit/3.5/images/sha256-363467247a6f538d31a243b5f7539c8b244d980218fc5e07533158424018fb50?context=explore is the latest | 05:33 |
| ianw | which matches our container -- opendevorg/gerrit@sha256:363467247a6f538d31a243b5f7539c8b244d980218fc5e07533158424018fb50" | 05:34 |
| ianw | Powered by Gerrit Code Review (3.5.4-6-gc54f1da933-dirty) | 05:36 |
| ianw | #status log restarted gerrit to pick up 3.5.4 (https://review.opendev.org/c/opendev/system-config/+/864217) | 05:37 |
| opendevstatus | ianw: finished logging | 05:37 |
| *** ysandeep|out is now known as ysandeep | 05:41 | |
| frickler | Even though your account is not locked, the fosstodon.org staff thought you might want to review follow requests from these accounts manually. | 05:41 |
| frickler | is the bot autofollowing back everyone? do we want that? I'd say no | 05:42 |
| ianw | no i don't think so | 05:42 |
| frickler | got that follow request after I followed it | 05:43 |
| ianw | it may be because we are currently hidden; there's a few hours until the bad messages are cleared out. once that is done, i'll reach out to the admins to see if we can get unhidden | 05:43 |
| ianw | maybe don't advertise it or anything till we've got it sorted ... | 05:44 |
| ianw | i can delete 30 of the bad messages per 30 minutes, and there's 61 left | 05:45 |
| ianw | but the good news is the ^^ log went through fine | 05:46 |
| ianw | frickler: OOHHH I turned on "manually approve followers" until we sorted this out, i think that's what you saw | 05:50 |
| *** ysandeep is now known as ysandeep|brb | 06:16 | |
| *** soniya29|rover is now known as soniya29|rover|afk | 06:38 | |
| *** soniya29|rover|afk is now known as soniya29|rover | 06:57 | |
| *** ysandeep|brb is now known as ysandeep | 06:57 | |
| *** akahat|ruck is now known as akahat|rover|lunch | 07:35 | |
| *** soniya29|rover is now known as soniya29|rover|lunch | 07:43 | |
| *** yadnesh is now known as yadnesh|afk | 07:57 | |
| *** soniya29|rover|lunch is now known as soniya29|rover | 08:01 | |
| *** akahat|rover|lunch is now known as akahat|rover | 08:28 | |
| *** jpena|off is now known as jpena | 08:40 | |
| *** pojadhav is now known as pojadhav|afk | 08:47 | |
| *** ysandeep is now known as ysandeep|lunch | 08:52 | |
| *** yadnesh|afk is now known as yadnesh | 09:00 | |
| *** ysandeep|lunch is now known as ysandeep | 10:04 | |
| *** soniya29|rover is now known as soniya29|rover|afk | 10:16 | |
| *** pojadhav|afk is now known as pojadhav | 10:23 | |
| *** rlandy|out is now known as rlandy | 10:55 | |
| *** dviroel|afk is now known as dviroel | 11:20 | |
| *** yadnesh is now known as yadnesh|afk | 11:43 | |
| *** soniya29|rover|afk is now known as soniya29|rover | 11:49 | |
| *** ysandeep is now known as ysandeep|brb | 12:06 | |
| *** ysandeep|brb is now known as ysandeep | 12:17 | |
| *** yadnesh|afk is now known as yadnesh | 12:19 | |
| opendevreview | Merged opendev/statusbot master: Update ancient hacking version https://review.opendev.org/c/opendev/statusbot/+/864588 | 12:36 |
| *** ysandeep is now known as ysandeep|afk | 12:47 | |
| *** ysandeep|afk is now known as ysandeep | 13:26 | |
| *** Guest1634 is now known as dasm | 13:48 | |
| *** akahat|rover is now known as akahat|ruck|afk | 14:03 | |
| *** ysandeep is now known as ysandeep|retro | 14:58 | |
| *** akahat|ruck|afk is now known as akahat|ruck | 15:00 | |
| frickler | infra-root: some POST_FAILURE popping up with no logs available, maybe some issue with one of our backends, does one of you have time to check? eg. https://zuul.opendev.org/t/openstack/build/e94e6eaeaed24e06b6dfdcfc84456670 | 15:34 |
| clarkb | that job ran on ze12 if anyone wants to grep the log. It got a 503 from the ovh gra swift region | 15:46 |
| clarkb | https://public-cloud.status-ovhcloud.com/incidents/by8279p6sdjd I'll write a change | 15:48 |
| opendevreview | Clark Boylan proposed opendev/base-jobs master: Disable ovh swift endpoints due to errors https://review.opendev.org/c/opendev/base-jobs/+/864755 | 15:51 |
| *** ysandeep|retro is now known as ysandeep | 16:02 | |
| *** ysandeep is now known as ysandeep|out | 16:08 | |
| opendevreview | Merged opendev/base-jobs master: Disable ovh swift endpoints due to errors https://review.opendev.org/c/opendev/base-jobs/+/864755 | 16:09 |
| fungi | clarkb: frickler: ^ any builds starting now should be in the clear, at least, but already running builds have still possibly chosen a broken api endpoint | 16:10 |
| clarkb | note I don't think it is a 100% failure | 16:10 |
| clarkb | we don't have enough post failures to support that. But clearly happening often enough to still be a problem | 16:10 |
| *** yadnesh is now known as yadnesh|away | 16:27 | |
| *** dviroel is now known as dviroel|lunch | 16:32 | |
| clarkb | the ovh incident reports no more observed impact. We may be able to revert shortly | 16:47 |
| *** marios is now known as marios|out | 17:01 | |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Drop OpenStack governance repos from StoryBoard https://review.opendev.org/c/openstack/project-config/+/864771 | 17:13 |
| *** dviroel|lunch is now known as dviroel | 17:27 | |
| fungi | clarkb: not sure if you saw, but hashar was asking in the gerrit matrix/discord channel about solutions for dealing with duplicate email conflicts | 17:38 |
| fungi | didn't the guidance we followed originally come from wmf's gerrit admins? | 17:38 |
| clarkb | fungi: it was Andrew at the LF | 17:41 |
| *** jpena is now known as jpena|off | 18:01 | |
| opendevreview | Michael Kelly proposed zuul/zuul-jobs master: helm: Add job for linting helm charts https://review.opendev.org/c/zuul/zuul-jobs/+/861799 | 18:13 |
| clarkb | followup on the lodgeit updates. THe container was restarted automatically on what appears to be the updated image. I am able to make a test paste successfully | 18:22 |
| clarkb | we should expect a gitea 1.18.0-rc1 soon judging on their milestone tracker. Looks like they accidentally tagged 1.18.0-rc0 as latest on dockerhub and downgrading to 1.17.x doesn't work. Good thing we build our own images I guess | 18:25 |
| fungi | clarkb: i was going to point him at the scripts we have, but figured you might have more context | 19:09 |
| Clark[m] | Feel free to. I'm working on early lunch due to upcoming meetings | 19:21 |
| *** dviroel is now known as dviroel|afk | 19:34 | |
| opendevreview | Clark Boylan proposed opendev/base-jobs master: Revert "Disable ovh swift endpoints due to errors" https://review.opendev.org/c/opendev/base-jobs/+/864782 | 19:50 |
| clarkb | infra-root ^ the incident is marked resolved by ovh now. I'm going to dig up my old zuul-jobs base-test testing change to do a quick sanity check but I Think we can land that soon | 19:51 |
| fungi | thanks! | 19:51 |
| opendevreview | Merged openstack/project-config master: Drop OpenStack governance repos from StoryBoard https://review.opendev.org/c/openstack/project-config/+/864771 | 20:07 |
| clarkb | https://review.opendev.org/c/zuul/zuul-jobs/+/680178 is my test change and it got a +1. It should've only uploaded to ovh with the unittest jobs. I spot checked one of them and it uploaded to bhs | 20:08 |
| clarkb | all that to say I think 864782 is good to land if others agree that the testing doesn't expose any problems | 20:08 |
| jrosser | i have a question about WIP status, in the 'old days' we would put [WIP] in the first line of a commit message to indicate and anyone who pushed a new revision could change that, now we have the actual WIP status in gerrit but that only seems accessible to the owner of the change. | 21:28 |
| JayF | You can update the ACLs to enable others to do the WIP | 21:28 |
| JayF | e.g. https://review.opendev.org/c/openstack/project-config/+/863931 | 21:29 |
| JayF | I have to update that, apparently, thanks for the reminder :D | 21:29 |
| jrosser | ah that would be good - i have a case where the original author is no longer a contributor so the WIP feature is essentially unavailable on that change | 21:29 |
| opendevreview | Jay Faulkner proposed openstack/project-config master: Allow Ironic cores to toggle WIP state https://review.opendev.org/c/openstack/project-config/+/863931 | 21:34 |
| clarkb | note workflow -1 was the proper way to WIP things previously (since that actually prevented merging, and it still works today) | 21:34 |
| fungi | yeah, some time when i'm not so busy, i can attempt to recount our history of wip solutions in gerrit | 21:40 |
| fungi | shrews started an early implementation in 2012 | 21:40 |
| fungi | it still hangs over his head like a cloud | 21:41 |
| fungi | for the longest time it seemed like the gerrit maintainers just had no interest in a wip indicator, pointing at draft changes as their recommended approach | 21:42 |
| JayF | I honestly always liked Workflow-1 as a WIP indicator, I am not sure I ever understood why that's not good enough. | 21:43 |
| fungi | well, it was our (second? third?) workaround for there being no wip functionality in gerrit | 21:44 |
| fungi | the main problem with workflow -1 is that it's per reviewer, so multiple people can independently set wip on a change and nobody can undo anyone else's | 21:45 |
| fungi | with it being a change-specific value, we've now got the option for people to unset wip set by someone else given sufficient acls | 21:46 |
| *** darkowlzz7 is now known as darkowlzz | 21:58 | |
| opendevreview | James E. Blair proposed zuul/zuul-jobs master: Add no_log to all log upload tasks https://review.opendev.org/c/zuul/zuul-jobs/+/864795 | 22:17 |
| opendevreview | Merged zuul/zuul-jobs master: Add no_log to all log upload tasks https://review.opendev.org/c/zuul/zuul-jobs/+/864795 | 22:34 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Cleanup force merging docs https://review.opendev.org/c/opendev/system-config/+/864798 | 22:51 |
| clarkb | corvus: ^ fyi | 22:51 |
| corvus | clarkb: thanks, i think that would have addressed my cognitive dissonance when reading that :) | 22:52 |
| clarkb | I'm going to go ahead and land the ovh disable revert now https://review.opendev.org/c/opendev/base-jobs/+/864782 I have enough daylight left to be able to debug further if necessary and I'd prefer to not be down a provider overnight | 22:56 |
| JayF | fungi: that makes sense; ty | 22:59 |
| fungi | clarkb: yeah, those instructions started out in the ssh section, but i guess someone identified they were semi-redundant with instructions elsewhere and half moved them | 23:01 |
| opendevreview | Merged opendev/base-jobs master: Revert "Disable ovh swift endpoints due to errors" https://review.opendev.org/c/opendev/base-jobs/+/864782 | 23:03 |
| opendevreview | Michael Kelly proposed zuul/zuul-jobs master: helm: Add job for linting helm charts https://review.opendev.org/c/zuul/zuul-jobs/+/861799 | 23:09 |
| *** dasm is now known as dasm|off | 23:11 | |
| clarkb | some of the jobs for ^ uploaded to ovh and I don't see any post fialures yet. Initial indications are that this is working | 23:15 |
| *** rlandy is now known as rlandy|out | 23:25 | |
| clarkb | ianw: left some comments on the launch node venv. Some of that is my ocnfusion around newer tools and some of it is likely bits that we'll need to fix. Let me know if I wasn't clear cc fungi | 23:56 |
| fungi | what's the change id again? i've still been too overrun with other stuff to find time to review it | 23:57 |
| clarkb | fungi: https://review.opendev.org/c/opendev/system-config/+/861284 | 23:57 |
| fungi | thanks! | 23:58 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!