VrayMtl metallic looks weird

Hey guys, I am trying to use the substance painter vray shader for the first time, but when switching to vraymtl metallic shader the material (which is not even a material yet, just a standard fill layer) looks very reflective. When I take the roughness all the way up (as in no reflection at all) I am getting this weird cartoony look. Why is that? am I doing something wrong?
BTW if I am using the VrayMtl specular it looks fine