Add texture effect to shirt without bevel and emboss

Hi there, I would like to add a texture effect to a tshirt, so it gets a heather look.

I know how to do it, but I can't seem to get texture working without bevel and emboss also being enabled.

This adds a black line across the outline of the shirt which I have to remove later which is really annoying.

Is there anyway to apply a texture without this outer black line effect?

Thank you!