Saturday, 2020-10-24

*** ysandeep|away is now known as ysandeep00:17
clarkbfungi: ok things are sad at least partially because etherpad filled its disk00:33
clarkbnot the db volume though so the service itself is probably fine?00:33
clarkbas you discovered it seems to be our backups. We are no longer double compressingthem which is good but we have too many overall Iguess00:36
clarkbI'm going to remove the oldest one for now00:36
clarkboh I see00:36
clarkbbecause the filename changed the logrotation isn't working properly anymore00:37
clarkbwe have a similar problem on the giteas but they are much smaller so it doesn't notice :) I'll clean things up a bit00:38
fungioops, thanks for catching that!01:07
clarkbthe giteas should be completely reset to the right filename now01:08
clarkbbut because etherpad ran out of disk its missed the last couple days of backups so I have only cleared out the 3 oldest there which should allow us to backup and rotate properly overnight01:09
clarkbI'm hoping that will then fix base ane LE jobs which will allow meetpad to run01:09
clarkbfungi: as a heads up I noticed we were leaking puppet else and base jobs too looking cloesr at those there appear to have been ~5 logstash workers that had all gone on lunchbreak01:18
clarkbI've rebooted them01:18
clarkbI've also cleaned up the leaked processes on bridge again, the next hourly pass will hopefully be much happier01:30
*** DSpider has quit IRC01:48
*** manpreet has quit IRC01:55
*** ysandeep is now known as ysandeep|away04:38
*** valleedelisle has quit IRC04:41
*** valleedelisle has joined #opendev04:41
*** mrunge has quit IRC07:32
*** mrunge has joined #opendev07:32
*** slaweq has joined #opendev07:53
*** DSpider has joined #opendev08:35
*** slaweq has quit IRC08:41
*** hillpd has quit IRC08:42
*** gmann has quit IRC08:42
*** hillpd has joined #opendev08:43
*** snbuback has quit IRC08:44
*** slaweq has joined #opendev08:44
*** snbuback has joined #opendev08:46
*** gmann has joined #opendev08:46
*** mattmceuen has quit IRC08:46
*** mattmceuen has joined #opendev08:46
*** slaweq has quit IRC09:10
*** roman_g has joined #opendev09:35
*** tosky has joined #opendev09:55
*** roman_g has quit IRC10:17
*** fressi has joined #opendev10:21
*** fressi has quit IRC10:27
*** Tengu has quit IRC12:45
*** paladox has quit IRC13:35
*** Tengu has joined #opendev13:37
*** paladox has joined #opendev13:41
*** slaweq has joined #opendev13:43
*** slaweq has quit IRC13:50
*** tosky has quit IRC15:48
*** kindwindfall has joined #opendev16:16
*** webmariner has joined #opendev18:26

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!