| *** hamalq has quit IRC | 00:01 | |
| *** evrardjp has quit IRC | 01:05 | |
| *** evrardjp has joined #zuul | 01:06 | |
| *** evrardjp has quit IRC | 02:33 | |
| *** evrardjp has joined #zuul | 02:33 | |
| *** irclogbot_0 has quit IRC | 03:20 | |
| *** irclogbot_2 has joined #zuul | 03:25 | |
| *** icey has quit IRC | 05:17 | |
| *** icey has joined #zuul | 05:18 | |
| *** ricolin has joined #zuul | 07:05 | |
| *** ianychoi has joined #zuul | 07:40 | |
| *** tosky has joined #zuul | 09:44 | |
| *** ykarel has joined #zuul | 10:14 | |
| *** ykarel_ has joined #zuul | 10:31 | |
| *** ykarel has quit IRC | 10:34 | |
| *** ykarel_ has quit IRC | 12:24 | |
| *** phildawson has joined #zuul | 14:18 | |
| *** phildawson has quit IRC | 14:22 | |
| *** ykarel_ has joined #zuul | 15:20 | |
| *** tosky has quit IRC | 15:30 | |
| *** ykarel_ has quit IRC | 15:34 | |
| fungi | not debilitating, but i think we may be encountering a regression with our nodepool launchers for the past week | 16:39 |
|---|---|---|
| fungi | i keep finding items hung in pipelines with builds queued indefinitely, some launcher has picked up the node request and either failed or (more rarely) satisfied it but then never unlocked the request. restarting the launcher frees the lock and the request gets picked up by it or some other launcher immediately thereafter | 16:41 |
| fungi | it's happened with several different launchers and providers | 16:42 |
| fungi | there's no obvious error in the logs about it, the launcher just stops short of logging the "Fulfilled node request" line (at least in the cases where it does satisfy the request with a successfully booted node) | 16:45 |
| fungi | not really sure how to go about troubleshooting it, since i don't know what conditions are necessary to trigger the problem, though it does seem to come in bursts and happens much more often with boot failures than successes | 16:48 |
| fungi | even the ones which succeed but get stuck seem to have had at least one boot failure and then succeeded on a retry (but still never unlocked the request) | 16:48 |
| *** leoluk_ has quit IRC | 18:48 | |
| *** leoluk_ has joined #zuul | 18:50 | |
| *** tosky has joined #zuul | 20:20 | |
| *** evrardjp has quit IRC | 21:52 | |
| *** evrardjp has joined #zuul | 21:52 | |
| *** paladox has quit IRC | 22:04 | |
| *** paladox has joined #zuul | 22:25 | |
| *** tosky has quit IRC | 23:50 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!