Playback sometimes lags cursor

When I press the space bar to initiate playback in waveform mode, about half the time it works fine. The other half the time, the playback cursor will start moving right away, as normal, but the audio playback won't start for about half a second, so the cursor and the audio aren't lined up.

Is this a known issue? Setting? I searched but couldn't find anything.