Mp4 audio skipping AF/Premiere

Ok, so I ran into a bug with my audio in my project.

I have 60 mp4 clips that have no audio issues when played on a video player, but when imported to AF or Premiere, random clips will go mad with the audio sync  skipping parts. Premiere does this with some audios that are just fine in After Effects and this goes around.

As I say the videos are mp4 ext, filmed with go pros.

Is there any solution for this? other than convert the mp4 to mp3 or wav and then importing to sync with the video?