Fit to Frame size not working

I have a 4K timeline in which I also have imported some 1080p clips. I have set my pref. to "fit to frame."  It isn't working. I've reimported these clips several times and still cannot get it to work. I've had to manually change every one. Very tedious and time consuming.  Please help. What am I doing wrong?