Increase of render times

Hi everyone, I'm using Adobe After Effects 2023 and have few hundred compositions in render queue. Average render time of composition is 8-10 minutes, (all comps do the same thing, the only difference are  source images).

Problem is that after few renders, render time increases to 15-16 minutes, then 30 minutes and after that every render is in average 1 hour 40 minutes and keeps increasing. The only way to combat this is to stop rendering, close AE, open it again and then it's back to 8-10 minutes per render. Sometimes even that doesn't help, I need to restart windows. I have intel i7 processor, 32gb ram, gtx 1080ti, m2 ssd + cache ssd.

Any idea why this happens?