Lumetri Color Enhancements Makes Video Choppy

I have a video clip that is very smooth but when I add it to my project and make any color enhancements it becomes very choppy and laggy.  To the point where it is almost unusable.  If I remove the lumetri effect from the clip it is smooth again.  This is on both the previews and the final rendered product.  I have noticed this on several projects I have worked on recently but this particular project is strange.  I used this clip twice in the project and the second use of the clip (even with the color enhancements) was smooth as butter.  It is the exact same clip with the exact same lumetri effect (I copied/pasted it).  The only difference is that I am including a long bit of the clip on the second use of it.  Has anyone else experienced this behavior or have any suggestions on how to remedy it?  I have tried using the Warp Stabilizer to smooth the clip some and it helps but it doesn't entirely fix the issue.

I am using a Windows 10 machine and the latest version of Premiere Pro CC.  The color enhancements that I am making are very simple adjustments to brightness levels and saturation.   Nothing past the "Basic Correction" section.