H5P Interactive video summary questions not passing values to Moodle gradebook

  1. Detailed steps to reproduce the bug (exactly how and when did it happen). Answer: Step 1) Begin playing the H5P interactive video with two summary questions. 2) Watch entire video until Summary section. 3) click Summary, answer questions - see screenshot. 4) Go to Gradebook, no values appear. 5) Check Results report for the activity, "Gradebook score: 100 out of 100" but nothing is displayed under "Your Answer" section. See screenshot.
  2. Platform and version number. E.g. Drupal, Wordpress, Moodle. Answer: Moodle
  3. Mobile or Desktop. Answer: Desktop
  4. Browser: Chrome, Firefox, Safari etc. Answer: Chrome
  5. H5P plugin version. Not sure, how can I check? 
  6. H5P content type and version (if a content type was used), and a sample URL or attached H5P. Interactive video, not sure how to check for the version.
  7. Any browser console errors. Not sure how to check for this.
  8. Any PHP errorsNot sure how to check for this.
  9. Screenshots if it's a visual problem. Answer: not a visual problem but screenshots provided to show the answering of the questions in the summary and the result screen which does not show answers were recorded.
Content types: 
BV52's picture

Hi Bsimanti,

I'm a bit confused, the screenshot you provided "no_your_answer_shown_" shows the scores and answers provided by the user.

-BV52

Sorry for confusion and thanks for your help.

Attached is screenshot from a student in which their grade was passed to the gradebook (see You_Answer_populated.png)

It appears for the students that do not get their grades passed to the gradebook, the "Your Answer" is blank (as shown in the no_your_answer_shown.png).

Does that help?

Sorry for confusion and thanks for your help.

Attached is screenshot from a student in which their grade was passed to the gradebook (see You_Answer_populated.png)

It appears for the students that do not get their grades passed to the gradebook, the "Your Answer" is blank (as shown in the no_your_answer_shown.png).

Does that help?

 

BV52's picture

Hi Bsimanti,

Thank you for the clarification. I've taken a second look at the screenshot and it's all clear now ;-)

The only reason why other students don't get their answers and scores recorded is that they did not finish the video. IV sends the scores to the Gradebook once a "finish" event is created, this happens once the video reaches the end.

-BV52

Hi BV52.

I sent an earlier comment today about an issue that popped up after we updated to the Interactive Video library from 1.17.2 to 1.19.4. (H5P version 1.10). After I updated the library yesterday, no Interactive Video grades would post in the Moodle gradebook. We have several hundred Interactive Videos this is affecting.

It was found that the Interactive Video will add the grade into the Moodle gradebook if we manually go in and add the Submit Screen to each of the Interactive Videos (we have 393) by clicking on the star and adding this Submit Screen at the end of the videos.

Is there a way so we do not have to go in and manually add this Submit Screen to each video in order for students' grades to automatically post in the Moodle gradebook as they did before this update?

We use Chromebooks.

Moodle version: 3.5.1

H5P:  1.10

Interactive Video version: 1.19.4

 

Thank you for your help with this!

Thanks for your quick reply! Unfortunately, we ran a test and waited until the end of the video but no value was passed. Additionally, our student support ran through two videos answering the questions correctly with the student and watching until the end of the video but no luck. We originally thought it was isolated to one student (perhaps a client-side issue with javascript/plugins) but then it happened with another student as well. However, every other student (about 10) didn't experience the issue at all so we're a bit baffled on why it's not working for just a few students. We were wondering if there is a way to "clear an attempt" for a specific student? Perhaps their initial attempt is somehow "locked in" to Moodle and whenever they retry (even from a different browser), it's not allowing any change to their initial attempt that got stuck? I look forward to your thoughts and ideas. Thanks again for your help!

thomasmars's picture

Hi,
You did not specify the H5P and Moodle version, you can check the H5P version at:
Site Administration -> plugins -> plugins overview, and look for H5P.

I tested this with the example content at H5P.org and was not able to reproduce the bug that you described.
Do you have a copy of the Interactive Video content that you can share with us so we can try to reproduce it there ?

Make sure that the users that you want to save score for has the 'mod/hvp:saveresults' capability in Moodle permissions. 

If you're able to reproduce this consistently, please check for any errors in your browser's console and PHP error log when this happens.

Also be aware that the score will only be updated the first time you reach the end of the video, so if they went to the end, then filled in all the answers, then went back to the end of the video the new answers will not be registered, unfortunately.
We're soon releasing a new version of Interactive Video that will give control of when the answers are submitted to the users, if your issue is caused by scores not being properly sent in to the gradebook, the changes we introduce in this new and improved version will solve your problem.

Best regards, Thomas

Thanks for your reply Thomas! We're still working on any additional info/interactive we may be able to send. For now, here's the H5P version info: H5P plugin version 1.5.  Dated 2017083100

We have a test video that replicates the issue but would prefer to share it via email. Do you have an email address we can share it directly to?

otacke's picture

Hi Bsimanti!

Have you been following the advice of Thomas in the meantime? Your plugIn version is really outdated. We're currently at version 1.9 with many improvements, and the latest version of Interactive Video contains the submit feature that Thomas mentioned.

Best,
Oliver

crossbow42's picture

We are on Moodle 3.2, with Interactive Video library versions 1.15 and 1.17 installed.  This was reported by students to their professor, who reported it to me, the Moodle admin guy.

 

The students noted an odd anomaly in the way grades show in the grade book.  Sometimes, for the same interactive video, it will say there are 2 points possible, other times it will say 3 points possible.

For example, in interactive video “1.4 lecture,” there are two fill-in-the-blanks questions and a summary task.  The total points possible is 10. One student got 10 points, another got 6.77 points. In the gradebook, we click the little magnifying glass to show the “Results for” page, the first student shows she got 2 of 2 correct, the other shows she got 2 of 3 correct.  So, one student gets graded on 2 questions, the other on 3 questions. Shouldn’t both be graded on 3 questions, the fill-in-the-blanks questions and the summary task?

We are hypothesizing that one student did the summary task (and got it wrong), and the other skipped the summary task, and it didn’t count at all.  Is that possible?

(Note: A possible complicating factor is: This interactive video was apparently created with library version 1.15.0, and the issue discovered on that version.  Since then (like, 20 minutes ago), I used the tools to upgrade the activity up to 1.17.4. While this had no effect on the grading or student display, I thought I’d mention it in case it was important.)

Any other idea what might be going on here?

thomasmars's picture

Hi,

You are correct, only questions that has been loaded and attempted are taken into account for the final score. So if you completely skip a question that will not count towards the final score.
The reason behind this logic is like this is among other things that there are ways to branch Interactive Video into different paths, in these scenarios you would not want questions that the student is not lead to take to be taken into account for the final score, we also do not load activities before they are encountered. We're aware there's room for improvement for the scoring of Interactive Video, and we're continually taking measures towards it, recently by introducing the score screen for version 1.17. 

Hope that helps dispel some of the mystery around the scoring in this case, and thanks for the feedback.

crossbow42's picture

OK, thanks for the clarification and rationaile. Does 1.19 work the same way, i.e., doesn't count the question if they skip it?  (I may be able to upgrade to 1.19 mid-semester if it will help....)  If so, have you got any clever ideas to solve this issue?  There are approximately 60 interactive videos in the course, it would be a bummer if she had to change them all.....  Cheers!

thomasmars's picture

Hi, 1.19 works the same way, yes.
There is a "prevent skipping" behavioural option in Interactive Video, you could enable that and set a score screen at the end of the video, this may be a possible workaround, but there will be no robust solution until it is solved properly I'm afraid.

The score screen is the screen you get when clicking the "star" icon on the timeline of the Interactive Video, you can see it in our example content at: https://h5p.org/interactive-video.

Best regards, Thomas

I allow myself to chime in ;)

The behaviour is also very confusing for our staff and students. It's not how you expect it to work. If you conduct an exam and you skip questions you lose the points for those questions. 

I'd really love to see an option here to make skipped questions count to the total result.  

BV52's picture

Hi philpav,

I apologize for the inconvenience and thank you for your input.

-BV52

crossbow42's picture

By score screen, do you mean the "Results for" page I mentioned earlier, where it shows "2 of 2" or "2 of 3"?  Cheers!

BV52's picture

Hi Crossbow42,

What Thomas meant was the submit/scrore screen that can be triggered by click on the star icon in the slide bar of the Interactive Video.

Please note that I filed a bug report and you can follow it here.

-BV52

Hi BV52.

A day or so ago, I asked you about the problem we were having where our YouTube videos continuously looped even though this feature was not checked.

Even though we updated H5P to the version 1.10 the beginning of September, new libraries appeared a day ago which I updated. I updated the Interactive Video library (from 1.17.2 to 1.19.4)  and the YouTube videos stopped continuously looping.

Now students' grades are not saving in the gradebook for any Interactive Videos. I (and others) have made sure several different videos ran to the end - we know videos must run to the end for scores to post. The student system role setting "mod/hvp:saveresults" is set to "allow" as it should.

We use Chromebooks.

Moodle version: 3.5.1

H5P:  1.10

 

Interactive Video version: 1.19.4

Sorry for the recent influx of issues, but we love the Interactive Video (currently have 393 instances), so this is impacting hundreds of students. Any ideas as to what I can try to fix this?

I have attached an H5P, but again, this seemed to have happened after I updated the Interactive Video to 1.19.4 yesterday and affects all videos.

falcon's picture

Hi jbaumgartner,

To improve upon some of the issues mentioned in this thread the new submit screen features was added allowing authors to add a submit screen that sumarizes the users activity and let the user actively choose to submit her answers.

The idea was that if you had the submit screen any other submitting of grades and answers would be disabled and if you did not have the submit screen (typically for existing content) the old behavior should remain. Unfortunately this was lost in translation somewhere and a "bug-fix" completely disabled the old behavior so if you don't have the submit screen there is no way to submit your answers.

What would be your advice in terms of the severity here. Should we put effort into fixing this for old content or encourage users to add submit screens to their old content using the star button instead? The submit at the end of the video never worked very well, so I'm not sure how many relies on it. Are you telling your students to make sure that they watch until they reach the very end?

crossbow42's picture

Hi, thanks for asking for input on this topic.

My vote would be to fix this for old content, rather than focussing on the submit screens.  To be more precise, fix for old content first, then do the submit screen.  I do like the submit screen as a solution -- I think that once its in place it would be best practice to always use this because it makes clear to stsudents what grade they'll get (unless, by closing the browser window they get an opportunity to retry....).  But, like others, we have so much content already that fixing the system is better than fixing the content in the short term.

Sorry to want the quick fix to have priority over the long-term solution, but I'm trying to prioritze the needs of current faculty.

Thanks again for asking the question!  Cheers!

falcon's picture

Hi @crossbow42

Your vote is noted. We're delayed with the "September release" and have a lot of other deadlines ahead of us from organizations sponsoring new features. We advice that you add submit screens. Adding submit screens to 60 H5Ps will be many, many times faster than for us to create, test and release a fix.

(If any H5P.com customers read this and are in the same situation just reach out to H5P.com support and our support team will add the submit screens for you)

Hi Falcon.

I appreciate your quick response and the information.

We are going ahead and manually adding the submit screens using the star button to all of our Interactive Videos. We are an online high school so students are actively working and can't be held up by these Interactive Video grades not populating the gradebooks. (We use restrictions to allow students to only move forward after they have sequentially completed work.)

Also, I am sure the students did go all the way to the end of the videos. I also replicated the issue and made sure the video(s) completely ended as it needs to do.

Again, we are adding the submit screen ourselves so no further action is required on our part, but I appreciate your offer of trying to fix it.

falcon's picture

Hi jbaumgartner,

Thank you for the reply. I'm sorry you have to add all these submit-screens in a hurry now because of the mistake that was made with Interactive Video. The job will at least not be wasted - the submitscreen should make the content better. We've had a lot of reports from teachers telling us that their students closes the browser when the video has clearly ended (it is showing subtitles for instance), but before the very last second of it. I was curious as to how you make your students wait until they reach the very end. When reaching the end unlocks the next content they probably quickly learned how it worked.

Hi Falcon.

In addition to adding restrictions to coursework "making" students work sequentially (meaning students can't move forward in a course until the previous "assignment" is submitted and/or graded), we also add a "warning" such as this in the Description text for every Interactive Video:

Warning: The computer will not recognize your responses or award credit unless you play the video from the start to the very end.

Many of our students take courses both on and off campus. On-campus students go to a computer lab daily where a tech monitors and helps students follow instructions completely for items such as this. Also, I always log in “as the student” to verify any issues reported.

Bottom line is that students learned quickly the videos needed to be watched until the very end before they could move on in a course.

 

I do agree that the new Submit Screen was needed as it provides a concrete way for students to submit Interactive Video responses, so appreciate the work you have put into this. Thank you!

falcon's picture

Hi @jbaumgartner,

Thank you for your feedback. It is good to know!

Hi,

So I'm beginning with H5P. I'm trying to use h5p branching scenarios for a course.

I have used interactive videos with questions (true/false) and single answer questions. Also some course presentations with also questions (agains single answer and true/false).

But at the end,I can't see the scores in gradebook.

Is this normal? Or where I'm making a mistake? 

Thanks for your help,

I added a screenshot in attachment.

meltem

Attachments: 
BV52's picture

Hi meltem,

Your screenshot shows that the results/answers are logged but you mentioned that the scores are not sent to the Gradebook. Would you mind provided a sample content as well as a screenshot of the grade settings and activity completion settings in Moodle.

-BV52

Hi BV52 thank you for your answer.

I have to make some error somewhere.

I try to use h5p other activities (without branching scenarios), the results are seen in gradebook.

Here is h5p file. 

The gradebook settings for the course and activity achievment is in attachement.

Do you mention these two or other settings? 

Thank you again for the help,

 

meltem

 

H5P file: 
BV52's picture

Hi meltem,

Thank you for the file and screenshots. 

I checked the settings of your content and with a minor change you will see the scores in the Gradebook. Edit the content with an scored activity in yoru case the Interactive Videos and Course Presentation, go to "branching options" then feedback place a score in the "score for this scenario". This needs to be done for every content that has an activity with a score.

-BV52

Dear BV52,

Thank you so much !!! I've just tried and it works ! 

Thank you a lot for your help again ! 

Meltem 

BV52's picture

Hi Meltem,

I'm glad it works if you have any other questions feel free to post in the forums.

-BV52

nadavkav's picture

We experiance the same challanges. and my question is:

Is there a way so we do not have to go in and manually add this Submit Screen to each video in order for students' grades to automatically post in the Moodle gradebook as they did before this update?

otacke's picture

Hi Nadav!

There should be a submit screen at the end of a video by default when you create one. There's no option to change the behavior, so the interactive video content type would have to be changed, or you could probably listen for xAPI statements yourself and write the results to the gradebook.

Cheers,
Oliver

nadavkav's picture

Thank you Oliver for your reply and information.

I am familiar with the submit screen, but it seems the students do not care for it and just ignore it, as they seem to expect that each interaction they answer should be saved in the grade book and calculated as part of the final grade. especially, becasue we embed the H5P interactive video inside a Moodle quiz question. so it seems as part of a larger quiz.

Anyways...

I will take your advise and listen to the xAPI events and make the grade calculations myself.

Thank you very much.

Nadav

otacke's picture

Hey Nadav!

I agree that an alternate mode would be nice, but I don't have influence on IV :-)

Best,
Oliver

nadavkav's picture

Taking Oliver's good advise (as always!) I have added a patch to v 1.19.1 that saves each user's interaction in Interactive video component and automatically calculate the final grade and save it into Moodle's gradebook for that specific student. so the student does not need to click the "star" icon to view and submit the answers intentionally at the end of the Interactive video activity. (this feature is an admin setting)

To put it in context... we emebed H5P Interactive video activity inside a Moodle quiz question, so the student has no idea he/she need to submit the interaction answers at the end of the interactive video, as it is just a question inside a Quiz. which get submitted at the end of the quiz.

Also he/she has already submitted each interaction, so it does not make sense to submit them again at the end of the video.

I think H5P team needs to re think this behaviour.

We are using it for a few weeks now, and the teachers and students are very happy, so...

Here is the patch: https://github.com/iucc/h5p-moodle-plugin/commit/dcfe15ce5bf95ab64d4beadb27375631b99b0799

Enjoy :-)