| *** kopecmartin|off is now known as kopecmartin | 07:04 | |
| opendevreview | Daniel Blixt proposed zuul/zuul-jobs master: Make prepare-workspace-git work with unique scheme https://review.opendev.org/c/zuul/zuul-jobs/+/896640 | 07:56 |
|---|---|---|
| opendevreview | Daniel Blixt proposed zuul/zuul-jobs master: Allow mirror push to delete current branch https://review.opendev.org/c/zuul/zuul-jobs/+/764152 | 07:57 |
| opendevreview | Merged openstack/project-config master: Add Designate Bind K8S charm https://review.opendev.org/c/openstack/project-config/+/896272 | 12:18 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Add mailing list for Nordix environment https://review.opendev.org/c/opendev/system-config/+/897234 | 14:44 |
| clarkb | arm image builds are all failing according to grafana | 15:03 |
| clarkb | also opensuse seems to be going away upstream of us? we can probably wind down that distro in nodepool now | 15:03 |
| clarkb | https://news.itsfoss.com/opensuse-leap-replacement/ | 15:04 |
| clarkb | there is a new gitea 1.20.5 release (we are on 1.20.4) https://github.com/go-gitea/gitea/blob/v1.20.5/CHANGELOG.md nothign in there looks urgent for us | 16:06 |
| clarkb | but we'll want to upgrade to that before the 1.21.x upgrade that eventually happens | 16:07 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Upgrade to gitea 1.20.5 https://review.opendev.org/c/opendev/system-config/+/897244 | 16:40 |
| clarkb | diablo_rojo: fungi frickler I think ptgbot has crashed again | 18:31 |
| fungi | clarkb: it's still working in irc | 18:37 |
| clarkb | fungi: ya the webserver and ircbot are different processes. The ircbot didn't crash previously jsut the wbeserver which i think has occured again | 18:37 |
| fungi | interesting | 18:38 |
| * tonyb is worried because his code merged and the bot crashed :( | 19:34 | |
| fungi | the bot also crashed before that merged | 19:34 |
| fungi | but yes, getting some actual logging from the web process so we can capture it's last-gasp traceback would go a long way toward identifying the culprit | 19:35 |
| fungi | without looking closely, i'm going to guess that the web service is a fork so its stdout/stderr are not being captured by the init parent | 19:36 |
| clarkb | it wouldn't surprise me if it is a port contention thing. We can try restarting it with no code changes and see if it crashes the same way | 19:38 |
| clarkb | just manually do tha down&& up -d or whatever ansible does for us | 19:38 |
| tonyb | I looked at etherpad, the front page worked but I'm getting js errors on any actual pad. I think that's due to the "bad" SSL cert | 19:45 |
| fungi | you need to set etherpad.opendev.org to that address in your local /etc/hosts | 19:45 |
| fungi | don't try connecting by ip address, definitely won't work due to the api callbacks | 19:46 |
| tonyb | I did that. | 19:47 |
| fungi | js errors may be the ones clarkb saw as well. clearing browser cache/storage/cookies might clear them up? | 19:47 |
| clarkb | tonyb: does that error go away if you use icognito mode? I think that was similar to what I got | 19:47 |
| tonyb | The error goes away with curl ;P | 19:48 |
| clarkb | infra-root I ran docker-compose down on nb04 and it is taking a very long time to remove the container... hopefully it isn't completely broken. I have also started clearing /opt/dib_tmp contents | 19:48 |
| tonyb | Shoot it went away with a reload :/ | 19:49 |
| clarkb | https://github.com/moby/moby/issues/22312 is the sort of thing I'm seeing on nb04 | 19:49 |
| clarkb | tonyb: ya I think it is related to caching/cookies/sometemporal state | 19:49 |
| clarkb | I restarted the docker daemon and the container transitioned to a dead state | 19:51 |
| clarkb | but trying to remove it is still looking like it will hit timeouts and fail | 19:51 |
| tonyb | Based on my testings I'd say it (etherpad update) is weird | 19:51 |
| clarkb | ya maybe we should avoid updating before the ptg as it is likely everyone will hit cache issues opening etherpad for the first time ina while if we do | 19:52 |
| clarkb | I was hoping I would be the only one but since you've reproduced it we may want to wait | 19:52 |
| tonyb | You're welcome ? | 19:54 |
| clarkb | well better to have the info than be surprised later | 19:55 |
| clarkb | ok the container eventually claened up | 19:56 |
| clarkb | once dib_tmp is cleared out I'll reboot the server and restart containers | 19:56 |
| JayF | Is there an expected delay before a newly-configured ssh key in gerrit becomes usable? | 20:36 |
| JayF | Trying to determine if we're fighting cache or local config. | 20:36 |
| JayF | trying to work in opendev/sandbox | 20:38 |
| * JayF suspects potential git-in-wsl-using-wrong-ssh-key | 20:40 | |
| JayF | we figured it out; I think there was one too few buttons hit in the gerrit web ui | 20:47 |
| diablo_rojo | frickler: I booked a slot for the ptgbot on thursday of PTG week. Does that time work for you? | 20:50 |
| clarkb | JayF: ya you have to hit the save button after adding the key | 20:52 |
| clarkb | and no there isn't a delay | 20:52 |
| JayF | yeah we figured that out I think | 20:52 |
| JayF | BTW; opendev/sandbox was very helpful for this exercise; thank you | 21:23 |
| fungi | glad it's useful for something ;) | 21:24 |
| opendevreview | Merged openstack/project-config master: Temporarily remove release docs semaphores https://review.opendev.org/c/openstack/project-config/+/896948 | 21:35 |
| clarkb | I went on a bike ride ande rm is still trying to clean up /opt on nb04 when I get back | 22:54 |
| clarkb | good thing I didn't wait for it. I might have to reboot tomorrow at this rate though | 22:55 |
| clarkb | fungi: what time did the release team decide to start festivities tomorrow? I'm unlikely to wake up super early just given how my schedule has been recently but can probably check in around 1400 UTC to see if there is anything that needs attention | 23:00 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Update our base container images https://review.opendev.org/c/opendev/system-config/+/897270 | 23:21 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!