Is there a faster way?

You can do this probably a lot more efficiently in After Effects and then add it as a dynamically linked composition in Premiere Pro.

Please watch this tutorial: https://www.youtube.com/watch?v=8TjgyH02UO8

Hope this helps.

I would use the crop effect as it's much easier to work with it in the program view, and you can use keyframes of type "Hold" to minimize the number of keyframes in the effect controls panel.