Replace a moving ball in a clip with an image of an apple.

In V2 I have a moving ball in a clip with some camera movement. I can track that ball easily with an object mask.
In V1 I have a .png of an apple.
I could use Opacity or an Ultra Key with that mask to make the ball transparent and position and scale the V1 apple to fit the V2 “hole”. That’s an OK method for one frame but what I want to do is to automatically let the apple position and scale in V1 follow the mask I have in V2.

Is this not possible in Premiere? No keyframes worth trying to copy are in the mask. Mask properties are all in Tracker and I cannot copy those keyframes to the V1 Motion or a Transform effect.

As of now Im manually keyframing position and scale of the apple to follow the ball and its too much work and not looking good.

/G