Interactive Video Multiple Choice Question Grading

Submitted by taraMatuszek on Tue, 11/03/2020 - 02:06
Forums: 
Bugs in content types

We are using Moodle Moodle 3.9.1+ (Build: 20200807) and have not gotten the most recent Interactive Video update (still on Default: H5P framework v1.24 (h5plib_v124)) because I was leary of updating after some students had completed them.

Some of the multiple choice queestions are being marked as the correct answer but the student still gets a 0 for the grade and I can't tell why.

This is happening with only some students and I can't figure out what's causing it (I thought maybe some type of retake penalty if they had multiple tried but could not find anything about that).  Here is an example of the issue (attached).

Any help / advice is appreciated!

Thanks,

Tara

Attachments: 
Image icon h5pIssue.png
BV52's picture

BV52

Tue, 11/03/2020 - 18:21

Hi Tara,

I am unable to reproduce the issue that you mentioned. Would you mind providing some additional information:

  1. Does this happen to all Interactive Videos with Multiple Choice?
  2. Screenshot of the settings in Moodle (Grades, Activity completion etc.)
  3. Sample content that is having the issue.

-BV

taraMatuszek

Tue, 11/03/2020 - 19:29

Sorry, I tried exporting the activity but it didn't let me attach that.  How can I include the content here?
It seems to happen sporadically -- not with all videos or with all students in a particular video but it is happening in a variety of videos to various students. 

I've finally been able to replicate it myself!  It happened to me when I had answeredteh question correctly but had not clicked continue or submit.  Then, I went to the main course page and came back to the video -- the correct answer was still selected and when I submitted it, it showed up as correct but gave me a score of 0/1 for that question on the submit page (though the question itself says 1).  I'm attaching screenshots of that display, as well as the settings for the assignment.

I've tried to include several screenshots of settings, but let me knowif something else will be more helpful. 

Thank you for your prompt reply!

-Tara

Attachments: 
Image icon questionScreen.png
Image icon submitScreen.png
Image icon activitySettings.png
Image icon questionBehaviouralSettings.png
BV52's picture

BV52

Wed, 11/04/2020 - 18:00

Hi Tara,

Thank you for the additional information. These are actually sufficient and no need to upload a sample content. Also I'd like to apologize I forgot that I filed a report with this issue about a year ago. This is the ticket for you reference.

-BV

taraMatuszek

Thu, 11/05/2020 - 18:26

Hello,

I'm glad that was enough for you to figure it out.  I did go look at that ticket but seems like there isn't really a timeline on a fix / maybe not even something they're working on?  I was also wondering if anyone has tested whether the issue still persists if the randomize answers option is turned off?  (Wondering if it's caching the right answer somewhere and then it's changing the options around?)  What about not allowing multiple attempts?  HAve you heard of any work arounds for now?


Thanks again,

Tara

Mrs. D

Fri, 11/06/2020 - 00:31

I built a fun interactive video assignment with questions too.  Can't get grades to work.  So I had to give it a grade of 0 and excuse it in my grade book.  Very annoying.  What is the point then?  A ticket from a year ago with no work on it. Why do you have a forum for help if we can't get help or things fixed. Better off just to not use H5P.  I was so excited about it.  

BV52's picture

BV52

Fri, 11/06/2020 - 00:45

Hi Everyone,

In behalf of the H5P core team I apologize for the delay of resolution for this issue. However the core team is very small and there is only so much coding that they can do. Projects with funding would have to take precedence as well as bugs that renders content types unsable. H5P is also open sourced which means anyone can create the fix or hire someone to help fix the issue. I will follow up with the core team regarding this specific the issue.

-BV

taraMatuszek

Fri, 11/06/2020 - 15:52

Hello,

So there aren't currently any workarounds?  I wasn't able to find a way to override scores like the option for quizzes -- am I missing that or does it not exist for interactive videos?

I do understand having a small team and I have actually worked as web developer in the past but for me it takes a very significant amount of time to familiarize myself with a project and setup a suitable test environment to tryout changes -- it seems like it would be extremely expensive to pay someone to come in and fix just this.  What are the options for funding bug fixes with the Moodle team?

Thanks,

Tara

BV52's picture

BV52

Fri, 11/06/2020 - 18:03

Hi Tara,

I don't think it can be called a workaround but to make sure that this does not happen:

  1. Click submit the first time a student interacts with the content.
  2. If the student decides to rewatch the video and review the answers do not click submit again.
  3. If in case a student refreshes the screen or for some reason leaves the page before submitting the answer he/she needs to untick the answers and tick it again before clicking submitting the scores.

There is no separate team in H5P that handles Moodle issues since all content types are the same for all platforms. As for the H5P core team they have a full schedule until 1st quarter of next year. However after the next major release, scheduled next week or the week after that the plan is to tackle "smaller" projects such as fixing bugs, reviewing PRs and minor updates. I will request that they include this specific issue and hopefully (fingers crossed) it gets included in the list.

-BV