exporting as mp4 leaves extra files ending on .mp4_00_

I am starting to always get extra files when I export a sequence from premiere.  If I export a sequence as movie.mp4, there will also be a file next to it named movie.mp4_00_

Furthermore I am getting losts of corrupt renders, here's an example frame from a corrupt render, if I rerender it is usually fine but super annoying, not sure if related to the _00_ files