Anyone know how to only normalize audio clips that contain talking

When ever I edit videos I like to normalize the vocal audio clips to -3db, the way I do it is by just selecting all the audio clips (including ones where theres no talking and just background noise) since I have quite a lot of them , then normalizing, the problem with this is that it also raises the gain on those audio clips with no talking and only background noise, wondering if theres a way to automatically only normalize audio over a certain db threshold or a way to delete audio clips under a certain threshold?  Thanks!!