AE/PS Crashes when using certain tools

Hello,
Every time I use rotobrush in AE or remove tool in PS it crashes and restarts my pc. It only happens when I apply remove to a large area or when I add more than, say, 60 frames in the timeline using the rotobrush tool. I upgraded my cpu and went from 16GB to 32GB ram and it keeps happening.