Hi!
What version of Photoshop are you using? Did you do anything to Photoshoop before this started happening--upgrade anything?
Have you tried resetting the tool? With the Remove tool selected, choose the Tool in the Options and click on the dropdown menu icon. On the right side, select the gear icon and choose Reset tool.
Let us know if that works?
Michelle