Interactive Video: Intermittent problem reporting grades

crossbow42's picture

 

  1. Detailed steps to reproduce the bug (exactly how and when did it happen)
    Sadly, since this is so intermittent, my attempts to reproduce it have failed.  It has happened on Macs and PC’s.  We tell our students to use Chrome, and all the students I have contacted have been using Chrome.

  2. Platform and version number. E.g. Drupal, Wordpress, Moodle.
    Moodle 3.7.6

  3. Mobile or Desktop
    Web interface

  4. Browser: Chrome, Firefox, Safari etc
    Chrome

  5. H5P plugin version
    1.20.2 (2020020500)

  6. H5P content type and version (if a content type was used), and a sample URL or attached H5P.
    Interactive Video day10-video2-646.h5p

  7. Any browser console errors
    Unable to observe.

  8. Any PHP errors
    Unable to observe

  9. Screenshots if it's a visual problem
    N/A

  10. Any recent changes to the environment (new plugins/modules, updates, configuration changes etc.)
    Moodle upgraded July 2020.

  11. Any recent changes to the browser you're using (new extensions, updates etc.)
    No

 

Several instructors have reported intermittent grading problems.  The students are told to click the submit button, and report that they have, but the grade doesn’t appear in the gradebook.  This seems to happen to about 10% of the students.  The students are told to use Google Chrome, and report that’s what they used.  Some students are on Win10 PC’s, and some are on MacBooks or MacBook Pro’s.  One student reported that the video continued playing past the questions, so I checked that Poster and Pause video were both checked.  They were.

We do not use a Summary Task, but there is always a Submit screen.

 

There are three things I’ve looked at to try to find a pattern: 

  • The Moodle log files

  • The gradebook

  • The “Results” page you get if you click the activity name from the gradebook setup or the gradebook grader report (the “spreadsheet view”) (/mod/hvp/grade.php?id=xx&itemnumber=yy).

 

The log files always show that the student viewed the video; there is always a “course module viewed,” and often more than one.  Sometimes there is a “mod_hvp: attempt submitted” log entry.  One thing that appears consistent, is that if the log file doesn’t show a submit record, then there is nothing in the gradebook or the Results page.  Are there any known ways a student can click the Submit button, but still nothing posted to the Results or gradebook?  Also, if a student does an interactive video again, and again clicks Submit, will the existing results be overwritten, or will the Results page report two Attempts?

 

Occasionally, even with a submit record in the log, and report on the Results page (showing correct and incorrect answers), there will still not be a grade recorded in the gradebook.  Are there any known circumstances where this might happen?  Is it possible this has something to do with Surface Mode?

 

Cheers?

 

P. S., the H5P file I have for this is 45 MB, and therefore too large for this forum. Is there another way I could get it to you?



Content types: 
BV52's picture

Hi crossbow42,

You mentioned at the end that regarding the "Surface Mode", if the Interactive Video is within a Course Presentation and Surface Mode is active scores will not be sent to the Gradebook. For complex content type all "triggers" needs to be met for the scores to be generated. In the case of Interactive Video within Course Presentation both the submit button needs to be clicked as well as the student needs to reach the summary slide.

-BV 

crossbow42's picture

The IV's are not within Course Presentations (I didn't know you could do that!).  They're just regular Moodle Activities.  How can I tell if Surface Mode is active? BTW, what is surface mode? What are all the triggers that need to be met for an IV to send scores?  Maybe if I knew that list I could figure it out... Cheers!

BV52's picture

Hi crossbow42,

Sorry I got confused you mentioned in your last paragraph "Is it possible this has something to do with Surface Mode?" that's why I assumed that the IV is inside CP. Anyway there is only one known cause of IV not sending scores and this is not clicking on the submit button. To answer the other question if a student clicks on submit the second time it will overwrite the previous recorded score.

For your reference below is are the triggers:

Branching Scenario - Make sure that scoring is configured please check the built in walkthrough for details

Column - Triggers are met for all activities that are included

Course Presentation - A graded activity is included and the student needs to reach the summary slide for scores to be recorded

Dictation - Check button is clicked

Drag and Drop - Check button is clicked

Drag the Words - Check button is clicked

Essay - Check button is clicked

Fill in the Blanks - Check button is clicked

Flashcards - Check button is clicked

Image Sequencing - Check button is clicked

Interactive Book - Submit button in the “Submit & Summary” screen is clicked

Interactive Video - A graded activity is included and the student needs click submit in the submit screen

Mark the Words - Check button is clicked

Multiple Choice - Check button is clicked

Quiz (Question Set) - Check button is clicked for all questions and reaching the summary screen

Single Choice Set - Check button is clicked

Summary - All statements are answered correctly

 

Please note that this is may not be a complete list since the last time I updated it was about 2 months ago.

 

-BV

crossbow42's picture

Hm.... OK, is there any known issue where the reverse happens, where the score is recorded in the Results page, but not the gradebook?  Again, this only happened to one student out of 30, but it was weird.....  Cheers!

BV52's picture

Hi crossbow42,

I haven't come accross a similar issue here in the forums also I do not create/manage content for students. The only reason I can think of is that the submit button was not clicked but it could be something else. If someone else in the community has experienced something similar feel free to post your comments.

-BV

crossbow42's picture

Here's an interesting new wrinkle. The report says the student got 0 points for that question, even though he got the answer right.  See attached screenshot. Is here an obvious way this can happen? E.g., the student gets it wrong on the first attempt, then right on the second? Or, the student gets the first question wrong, but then logs out (or gets timed out). He comes back the next day, and this time gets all questions right, clicks Submit, but the system rembers the first time he got the first question wrong? Or, what other use case can cause this apparent disconnect between getting the right answer and getting a 0 for the activity?

BV52's picture

Hi crossbow42,

I'm positive that this is related to this bug report.

-BV

crossbow42's picture

In order to fix this,I take it I could contribute code on GitHub? Cheers!

BV52's picture

Hi crossbow42,

Yes of course feel free to file PR for it ;-)

-BV

we are with 3.9.

In several instances we have observed that the IV plays past the inserted MCQs when the question is inserted anywhere but the end, in the video timeline, so the user is unable to score the question. However if the Qn is created at the end, the video pauses as setup and scoring can be done.. 
If we advance the start time of a previously-created Qn from the end to the middle of the video, the same proble occurs.

So, it appears that somehow IV fails to recognise the Pause setting when the Qn is anywhere but the end. This is a big problem for the way our learnng structure is conceptualised. Any help will be much appreciated.

 

BV52's picture

Hi Puneet,

It would be helpful if you can upload your content here or provide a link to the content with the download button enabled so that we can check it.

-BV

This 113-1 interactive video has 4 questions. in our implementation the player does not pause when encontering any of these questions. 

The 132-2 IV also has 4 questions but the player pauses on the question timeline.
I hope this is sufficient to evaluate. Look forward.. 

BV52's picture

Hi Puneet,

I uploaded your content here and the video pauses whenever the questions pops up. Can you please check if you will see the same issue. 

If you encounter the same issue I suggest that you try using a different browser. You can also try disabling some plugins in your browser. On the other hand if the video pauses whenever the question pops-up you could try disbling plugins in the platform that you are using to host H5P contents.

-BV

Wil check back and revert.

I had resonded yesterday but somehow I do not see it here, so I am sending again. 
Two files. For comparson from our system Each have 4 MCQs.
file 132-2 pauses on all questions, while 113-1 does not any any

H5P file: 

Hello The situation we have is that some hvp modules in the same setup, plugins, filters etc work fine and some do not. The settings are same, created by the same person, same number of questions etc, but in some the video pauses and in some it does not.
I tried Edge (instead of Chrome) but the same result. We also see the same outcome in Android Mobile app.
The other confounding issue is that if these questions pause fine at the end of the video, but not when anywhere in the middle???  

BV52's picture

Hi Puneet,

Still the same result the videos are pausing when they are supposed to pause. This means that there could be something in the setup of your site that is causing this. Would it be possible to provide a URL where a content is having this issue?

-BV

BV52's picture

Hi Puneet,

I am still investigating this. I will be editing your reply to delete the username/pwords.

-BV

BV52's picture

Hi Puneet,

I just tested the content and I can confirm the issue that you described. To isolate the problem I downloaded the content and uploaded in my H5P.com account. In that environment the video pauses on all the questions. This supports my earlier theory that there is something in Moodle a theme or plugin perhaps that may be causing this however I am unable to determine which is it. You can try the following:

  1. Disable other plugins
  2. Change the theme
  3. Post a similar question in the Moodle forum for H5P. Community members may have experienced a similar issue and have other suggestions.

-BV