Issue with master controller and time remapping

Hi there, 

My setup. I have two pieces of footage playing side-by-side in my MAIN COMP. They're each in Precomps: COMP A and COMP B. I have time remap keyframes on each of these Precomps within the MAIN COMP so that they align properly with each other. 

Here's my problem. I'm trying to scale and change the position of the footage within each of them. To do so, I have a controller within the MAIN COMP that the scale and position of each of these raw footage files is linked to (within COMP A and COMP B). My problem is that the keyframes don't seem to be affecting the footage when I change their scale and position values with the controller.

Happy to provide more info. Thanks!