Skip to main content
Participant
June 14, 2014
Answered

Why does the LMS report a Success criteria of "Unknown" for a quiz that I fail?

  • June 14, 2014
  • 2 replies
  • 2862 views

Hi,

I'm using Captivate 6 to create a course in which there are three components, a demo, a try it, and a test. I have only configured the test click boxes to "Include in Quiz". Also, I set my quiz preferences as shown below.

So basically our client wants an Incomplete ---> Pass/Fail reporting with the pass fail set at 80% (which I've done in the 'Pass or Fail' section of the Quiz preferences)

I'm testing my results in SCORM cloud and they are as follows:

When I click through my test passing it, SCORM Cloud reports

Completions Status: "Complete"

Success: "Passed"

Score: "97.8%"

However when I take the test and intentionally try to fail it, I get:

Completions Status: "Incomplete"

Success: "Unknown"

Score: "44.28%"

What I can't figure out is why 'Unknown'? Shouldn't this have been "Failed"? So I created a small dummy one-slide project with six boxes. Set all of them to be included in the quiz (so each box contributes 16.67%) when clicked and set a passing grade to 80%. I tested this on SCORM Cloud and failed it intentionally, and got what I expected.

Completions Status: "Incomplete"

Success: "Failed"

Score: "44.28%"

So why didn't this work in my main course? What could be causing the LMS to not know that I failed the Quiz and recording the success field as "Unknown"? Been trying this for a while now and can't figure this out. Appreciate any sort of help I can get here.

Thanks,

Sean

This topic has been closed for replies.
Correct answer TLCMediaDesign

There is not a "success status" in SCORM 1.2.

There really is no way of knowing what your LMS is using to determine/display a "success" of failed.

Captivate sets objectives to failed in this line, with the "failed" held in the strSCORMStatus variable.

SCORM_CallLMSSetValue("cmi.objectives." + intObjectiveIndex + ".status", strSCORMStatus) && blnResult;

This sets the objective status based on the lesson_status and shuod set the objective status to "incomplete" if the lesson_status is "incomplete".

I think that technically if the Completion status is "incomplete", there is no way to know what the success would be because the LMS thinks that all scored interactions have not been complete yet.

2 replies

Erik Lord
Inspiring
June 16, 2014

TLC's correct overall.

The easiest solution is to use SCORM 2004, if you're LMS supports it. Then it can report the 'completion status' and the 'success status' both.

Otherwise, SCORM 1.2 just supports 'lesson status' which can be passed, failed, completed, incomplete.

By your CP settings, it would seem CP should be sending 'passed/failed'...so I would have expected your LMS results to be:

--

Completions Status: "Passed"

Success: "Unknown"

Score: "97.8%"

-

Completions Status: "Failed" (or "Incomplete")

Success: "Unknown"

Score: "44.28%"

--

BUT it is technically up to your LMS to determine how to report those results.

If it works as you'd expect on the SCORM Cloud, that's not too surprising as Rustici developed both the SCORM cloud and the SCORM engine that CP7+ use.

If it doesn't work as you expect on your LMS, that's likely because your vendor interpreted the spec differently (which is a common issue). You should ask them what values they expect to get the results you need, if you're stuck with SCORM 1.2...or just tell the boss that's the way the LMS works.

Good luck

Participant
June 17, 2014

Thanks Erik.

TLCMediaDesign
TLCMediaDesignCorrect answer
Inspiring
June 16, 2014

There is not a "success status" in SCORM 1.2.

There really is no way of knowing what your LMS is using to determine/display a "success" of failed.

Captivate sets objectives to failed in this line, with the "failed" held in the strSCORMStatus variable.

SCORM_CallLMSSetValue("cmi.objectives." + intObjectiveIndex + ".status", strSCORMStatus) && blnResult;

This sets the objective status based on the lesson_status and shuod set the objective status to "incomplete" if the lesson_status is "incomplete".

I think that technically if the Completion status is "incomplete", there is no way to know what the success would be because the LMS thinks that all scored interactions have not been complete yet.

Participant
June 17, 2014

Thanks TLC!