When Removing filler words have transcription NOT replace filler with a comma

This may only be an issue for me but I'll put it out there.

I edit an hour long podcast weekly. I spend a great deal of time removing the comma which is added by the transcription when removing filler words, ums and uhs. I would like to see the option to remove filler only, not remove and replace (with comma).