Drop in frame rate/latency issue

Hi all! I've been having a latency issue with Adobe, and I am wondering if it is at all possible to fix...here's some background:

I film with two cameras, and I tend to saturate and make the colors brighter. The issue is not during the editing, but rather after exporting. It seems that my second camera, and only some clips, have a drop in frames and the picture has latency, although the sound is fine. I don't think it's the camera (if it was, you would think it would be happening with every clip), but I am open to some suggestions. To show you what I mean, I have included a video link to watch so you can get an idea...https://www.youtube.com/watch?v=DGQ51xizW9c 

Go to 5:43 and 8:32 to get an idea (both shots are with the same camera). Any help is appreciated. Thank you!