I often go back and forth between comps to see if they match each other. Suggestion: Shift+click on a comp (at the timeline panel) and it would match the zoom/pan position from the comp I am leaving. I almost never use "zoom fit" which is the only option to match viewers position precisely - but most of the time I need to match some details (e.g. zoomed in on the corners).