Does Mask and Select work?

Result is influenced by the tool and settings in the right-side panel. Please capture the entire Photoshop window so that someone can provide better guidance.

Which tool are you currently using in Select and Mask? Is that Quick Select? Refine Edge? Something else? My guess is you are simply using the wrong tool for what you are trying to accomplish.

Did you start with the Object Selection Tool? 

That you posted a recording is commendable, but you seem to have left out all the UI elements. 

Could you post the part in question of the image at full res? 

When the new features don’t work out well, I would recommend going »old-school« and correcting the Layer Mask and decontaminating the edges manually.