Paint Brush Stop Working

While I am manipulating a curves adjustment layer mask with the paint brush; anytime I stop using the brush within the photo field, then make any selection in the Layers channel. Once I try to continue and use the paint brush, it no longer effects the photo.