Color Range confusion

Hello everyone

I'm trying to deepen my understanding of the Color Range selection tool using the hue/sat adjustment layer for precise and targeted adjustments

.  
I want to use it to target the color of the gloves which Alfredo is wearing. But using it, despite lowering the fuzziness, selects other areas. Since hue/sat uses a mask, I can mask out the other areas (And I believe that is a workaround too). But is there a direct way to limit it precisely to the spots?
As I did it for the flowers behind, the selection was simple for the color range tool, and the result was achieved easily, with little masking out other areas. 
I want to know if that is how it is done by masking out colors from unwanted areas>