Audio degredation when left running

I use a simple live noise reduction in adobe audition for use with programs such as Skype, and OBS. I take in audio from my Blue Yeti Mic (Stereo) and output it into a Virtual Audio Cable Line 1 (Stereo.)

Recently, when I've left this setup going, after about 10-15 minutes of use, the quality of my voice has begun to degrade. It will begin to sound slightly distorted and the pitch lowers slightly. (This happens regardless of whether or not the Noise Removal effect is enabled.)

The kicker is, if I switch my output off of Line 1 to anything else, and then back to Line 1, the problem fixes itself for a little bit again.