In the book file window, highlight the target chapters that have the empty variable. Do File > Import > Import Formats, pick the correct source file, and activate Variables. (You may need to import both Page Layouts and Variables, if you've set up the headers already.)
Art