White color brush to remove the color from image doesn't work

I desaturated an image and want to bring back the color on a specific part of the image. The black color on the brush tool to bring back the color on the image is working just fine, but when i use the white brush to remove color it doesn't work... please help 😞