Question slide navigation question

I am trying to figure out the best way to solve an issue we are having with some courses we've created.

So many of our courses are in this style, watch a video, answer some questions, watch a video, answer some question, etc.

The problem we are running into is being able to navigate away from question slides in order, to say, re-watch the video.

So we enable backwards movement on the quiz. This works fine except when you've already answered a question. If you end up back on a question screen already answered you can't progress forward from it. We can enable TOC to do this but that makes it even more confusing because if you end up on a question screen and DO NOT answer the question, the TOC marks it with a checkbox which to people taking the course, looks like you did it already when you didn't.

We tried putting the play bar on question slides but that is a bigger disaster because you can navigate forward without actually answering the question.

So people end up all over the place and or stuck.

I suspect this is our fault and are missing some setting somewhere.