Time Remapping totally changes clip

Hi,

I feel like I do not understand something fundamental here. When I use time remapping on a clip, slow it down or speed it up, the whole clip changes to a footage further along in the sequence. This is also probably a poor explanation. I hope someone is familiar with this issue, or can let me know where I am going wrong.