Publishing f4v files consistently

The majority of the f4v files I'm publishing work perfectly, but there are a few that decide that they only want to play half the video but all of the audio. The video hangs at a particular point, but it varies on each file. What's causing this? I'm publishing in the same manner on every file.