Highlighted

Why does the LMS report a Success criteria of "Unknown" for a quiz that I fail?

Community Beginner ,
Jun 14, 2014

Copy link to clipboard

Copied

Hi,

I'm using Captivate 6 to create a course in which there are three components, a demo, a try it, and a test. I have only configured the test click boxes to "Include in Quiz". Also, I set my quiz preferences as shown below.

So basically our client wants an Incomplete ---> Pass/Fail reporting with the pass fail set at 80% (which I've done in the 'Pass or Fail' section of the Quiz preferences)

QuizSettings.jpg

I'm testing my results in SCORM cloud and they are as follows:

When I click through my test passing it, SCORM Cloud reports

Completions Status: "Complete"

Success: "Passed"

Score: "97.8%"

However when I take the test and intentionally try to fail it, I get:

Completions Status: "Incomplete"

Success: "Unknown"

Score: "44.28%"

What I can't figure out is why 'Unknown'? Shouldn't this have been "Failed"? So I created a small dummy one-slide project with six boxes. Set all of them to be included in the quiz (so each box contributes 16.67%) when clicked and set a passing grade to 80%. I tested this on SCORM Cloud and failed it intentionally, and got what I expected.

DummyScoreTest.jpg

Completions Status: "Incomplete"

Success: "Failed"

Score: "44.28%"

So why didn't this work in my main course? What could be causing the LMS to not know that I failed the Quiz and recording the success field as "Unknown"? Been trying this for a while now and can't figure this out. Appreciate any sort of help I can get here.

Thanks,

Sean

Adobe Community Professional
Correct answer by TLCMediaDesign | Adobe Community Professional

There is not a "success status" in SCORM 1.2.

There really is no way of knowing what your LMS is using to determine/display a "success" of failed.

Captivate sets objectives to failed in this line, with the "failed" held in the strSCORMStatus variable.

SCORM_CallLMSSetValue("cmi.objectives." + intObjectiveIndex + ".status", strSCORMStatus) && blnResult;

This sets the objective status based on the lesson_status and shuod set the objective status to "incomplete" if the lesson_status is "incomplete".

I think that technically if the Completion status is "incomplete", there is no way to know what the success would be because the LMS thinks that all scored interactions have not been complete yet.

Views

1.0K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more

Why does the LMS report a Success criteria of "Unknown" for a quiz that I fail?

Community Beginner ,
Jun 14, 2014

Copy link to clipboard

Copied

Hi,

I'm using Captivate 6 to create a course in which there are three components, a demo, a try it, and a test. I have only configured the test click boxes to "Include in Quiz". Also, I set my quiz preferences as shown below.

So basically our client wants an Incomplete ---> Pass/Fail reporting with the pass fail set at 80% (which I've done in the 'Pass or Fail' section of the Quiz preferences)

QuizSettings.jpg

I'm testing my results in SCORM cloud and they are as follows:

When I click through my test passing it, SCORM Cloud reports

Completions Status: "Complete"

Success: "Passed"

Score: "97.8%"

However when I take the test and intentionally try to fail it, I get:

Completions Status: "Incomplete"

Success: "Unknown"

Score: "44.28%"

What I can't figure out is why 'Unknown'? Shouldn't this have been "Failed"? So I created a small dummy one-slide project with six boxes. Set all of them to be included in the quiz (so each box contributes 16.67%) when clicked and set a passing grade to 80%. I tested this on SCORM Cloud and failed it intentionally, and got what I expected.

DummyScoreTest.jpg

Completions Status: "Incomplete"

Success: "Failed"

Score: "44.28%"

So why didn't this work in my main course? What could be causing the LMS to not know that I failed the Quiz and recording the success field as "Unknown"? Been trying this for a while now and can't figure this out. Appreciate any sort of help I can get here.

Thanks,

Sean

Adobe Community Professional
Correct answer by TLCMediaDesign | Adobe Community Professional

There is not a "success status" in SCORM 1.2.

There really is no way of knowing what your LMS is using to determine/display a "success" of failed.

Captivate sets objectives to failed in this line, with the "failed" held in the strSCORMStatus variable.

SCORM_CallLMSSetValue("cmi.objectives." + intObjectiveIndex + ".status", strSCORMStatus) && blnResult;

This sets the objective status based on the lesson_status and shuod set the objective status to "incomplete" if the lesson_status is "incomplete".

I think that technically if the Completion status is "incomplete", there is no way to know what the success would be because the LMS thinks that all scored interactions have not been complete yet.

Views

1.0K

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Jun 14, 2014 0
Adobe Community Professional ,
Jun 16, 2014

Copy link to clipboard

Copied

There is not a "success status" in SCORM 1.2.

There really is no way of knowing what your LMS is using to determine/display a "success" of failed.

Captivate sets objectives to failed in this line, with the "failed" held in the strSCORMStatus variable.

SCORM_CallLMSSetValue("cmi.objectives." + intObjectiveIndex + ".status", strSCORMStatus) && blnResult;

This sets the objective status based on the lesson_status and shuod set the objective status to "incomplete" if the lesson_status is "incomplete".

I think that technically if the Completion status is "incomplete", there is no way to know what the success would be because the LMS thinks that all scored interactions have not been complete yet.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 16, 2014 1
Community Beginner ,
Jun 16, 2014

Copy link to clipboard

Copied

Thanks TLC!

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 16, 2014 0
New Here ,
Jun 19, 2018

Copy link to clipboard

Copied

Hello - sorry to drag up an old thread, but I am having a similar problem to the original poster, albeit using SCORM 2004 when I publish.
When a learner fails my quiz, I am getting "unknown" returned as the success status instead of "Failed" in SCORM Cloud.

I have a simple 6 multiple choice question quiz that a learner must answer 100% to pass.

When the learner gets 100%; when tested, SCORM Cloud reports the following:

Completion: Complete
Success: Passed

Score: 100%

Time: whatever it took

When the learner fails the quiz and scores less than 100% (for example 33.33%) and exits the course; when tested, SCORM Cloud reports the following:

Completion: Incomplete
Success: Unknown

Score: 33.33%

Time: whatever it took

The completion status of "Incomplete" seems to make sense, since I've set the Completion Criteria (as shown below) to be determined by whether the quiz is passed. So I assume until that quiz is passed, the completion status is correct by returning "Incomplete"?!

But for the success parameter, since I failed the quiz, how can I replace the "Unknown" status with "failed" instead?

I would've assumed by default that the "Failed" status would show automatically if a learner actually fails?!

My client's LMS is Workday and they require SCORM 2004 instead of 1.2, and at the moment the unknown status is causing problems with their reporting data.

Of note, my Captivate Quiz Results slide appears to be working correctly and returns the correct details when a Learner passes or fails etc. It's just not setting the Success parameter to "failed" when a Learner actually fails the quiz.

results_slide.jpg

Perhaps I'm setting something up incorrectly?

I've read numerous threads on similar topics, but all delve too deep into Javascript or a parameter called cmi.success_status that I don't really understand, but perhaps someone can help me troubleshoot. I'm willing to give anything a try.

Here is a screenshot of my Captivate 9 settings:

Perpetual_SCORM_Insider_Trading_4.jpg

.... and my pass/fail option is set to 100% or more of total points to pass.

Here is the link to my SCORM Cloud log if its of any use.

SCORM Cloud

In my report above I notice the following lines towards the bottom:

[04:19:00.645] Completion Threshold is not specified, using the completion status recorded by the SCO-incomplete

[04:19:00.645] Scaled Passing Score is not specified, using the success status recorded by the SCO-unknown

I suspect these might be a clue, but I'm not sure what to do next.

Any help appreciated.
Cheers.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 19, 2018 0
Explorer ,
Sep 18, 2020

Copy link to clipboard

Copied

Is the quiz you are testing against set to "unlimited tries" in the Failure branch?

That wsa my issue.

If I only allow 1 try at the quiz and the user fails it then SCORM Cloud reports a "failed" status.

If I set it to "unlimited tries" the  status will ONLY change when the user passes teh quiz. Until then it is always set to "unknown".

This ISNT the case when publishing for SCORM 1.2 though. I can fail a quiz even if I have infinite tries.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Sep 18, 2020 0
Guide ,
Jun 16, 2014

Copy link to clipboard

Copied

TLC's correct overall.

The easiest solution is to use SCORM 2004, if you're LMS supports it. Then it can report the 'completion status' and the 'success status' both.

Otherwise, SCORM 1.2 just supports 'lesson status' which can be passed, failed, completed, incomplete.

By your CP settings, it would seem CP should be sending 'passed/failed'...so I would have expected your LMS results to be:

--

Completions Status: "Passed"

Success: "Unknown"

Score: "97.8%"

-

Completions Status: "Failed" (or "Incomplete")

Success: "Unknown"

Score: "44.28%"

--

BUT it is technically up to your LMS to determine how to report those results.

If it works as you'd expect on the SCORM Cloud, that's not too surprising as Rustici developed both the SCORM cloud and the SCORM engine that CP7+ use.

If it doesn't work as you expect on your LMS, that's likely because your vendor interpreted the spec differently (which is a common issue). You should ask them what values they expect to get the results you need, if you're stuck with SCORM 1.2...or just tell the boss that's the way the LMS works.

Good luck

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 16, 2014 1
Community Beginner ,
Jun 16, 2014

Copy link to clipboard

Copied

Thanks Erik.

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
Reply
Loading...
Jun 16, 2014 0