This is something which cannot be achieved with Muse natively and has to be done at server side.
I found this article - https://techwelkin.com/add-expires-header-to-images which describes how we can add expire tags on Apache and IIS server specifically.
Hope this helps.
Thanks so much Ankush. Appreciate your help.
Have a lovely day!