Why is AE "Remove Grain" so slow to render???

I really like the results with the "Remove Grain" filter in AE, but I regret I was unable to use it due to the render times. Without the effect applied my 30 minute 1080p project took about 6 minutes to render on an AMD 3900X with 32GB of memory. With the Remove Grain filter applied it was guessing at 30 hours...

Maybe it is just me but that seems like an excessively huge jump in time.

Doing the math, at a frame rate of 29.97fps my 30 minute video has 53,946 frames. A render time of 30 hours equates to 2.002 seconds to render each frame. With a 1080p frame size that seems excessively long or am I crazy? Shouldn't it take a couple of milliseconds to render some grain removal?

Makes me thankful I sprung for the EOS R5, it has no grain even shooting indoors in a poorly lit school auditorium. Unfortunately my B cam does have grain so I wanted the footage to match a little better between that camera and the ultra clean output of the R5. Maybe recording at 4k and downsizing the video will give better results in a reasonable amount of time?

Other possibilities are that I need a new video card. Currently I just have a 980TI. I know it is a bit old but are the new cards really all that much faster? I was never impressed with Nvidia/AMD and their video card "improvements" over the past few generations. The supposed performance bumps tend to go missing in lots of applications. And if I'm being honest, I haven't seen visuals in a game that were really all that better than the best of the 980TI days. Still waiting for real time radiosity, maybe it is not doable in this universe. No idea. I had a thought recently that if reality was a video game it would have to be a very powerful computer to calculate everything. But then I realized if it was a trained machine learning AI it wouldn't need to calculate anything, it could just invent scenes on the fly and make them look real just like an artist would. An odd thought. 

Anyway, thanks for any help you can provide.