how to add a frame/border to magnify zoomed part in premiere pro?

Not sure what you want. Do you want to put a border around a section of the image?

If so, use the Essential Graphics workspace. Make a new rectangle, size it to the image. Then give it a stroke width of whatever border thickness you want, and no fill.

Neil