select and mask not working

using photoshop CC, trying to smooth the edges on this image. I used select and mask, but when i move the feather and some other sliders, nothing happens. the opacity sliders works though. no boxes are checked. please help! Thanks.