Editing faster w/ Time Stretch, reverting to normal speed issues

I've been trying to speed up my workflow by listening to Multitrack audio (a single track) at higher speeds, using Time Stretch.

I've been scrubbing through a single track in Multitrack viewer, crossfading silence and chopping unwanted bits of the audio out. I've been doing this while listening at about 1.5x speed through Audition's time stretch feature.

When I revert back to a Stretch of 100% (Normal) in Properties, all of my edits seem to not scale with the audio's changes. There's a lot of audio overlap, as if the edits have stayed in place from where I did them at 1.5x speed. Is there any fix for this anyone knows of?