AR Scavenger issue with recognizing picture

Submitted by youriberg on Fri, 01/26/2024 - 21:32
Forums: 
Bugs in content types

Hey!

Thanks for this amazing H5P. I would like also to thank the community behind it who support the development of libraries.

First, I'm using the H5P plugin's last version (1.15.7) in Wordpress which is working wonderfully so far.

But I have a problem with AR Scavenger (both on desktop and mobile) using any browser (I tried Edge, Firefox and Chrome), it seems that some pictures are recognized and some others are not recognized (it doesn't actually matter how complicated they are, simple ones can be unrecognized and very complex very easily recognized), then when I make a new AR content and put these pictures which were not recognized, this time they are recognized, but pictures which were, are not recognized anymore. I can't seem to make all the markers work (I have few, only 4) in the same time! 

It doesn't seem to be related with the pictures themselves as they are quite different, I've tried with the Beta version on the official library directory (AR Scavenger (beta) (1.2.9)) as well as the github "stable" version (ARScavenger (1.0.1)), neither work. I really can't explain what's going on!

Another problem is that I can't use "interactive video" as interaction, it's just not appearing in the list even if I used it separately (so the library is downloaded).

H5P file: 
Binary Data test-ar-scavenger-test-17.h5p
otacke's picture

otacke

Sat, 01/27/2024 - 00:17

Have you been following the hints for choosing marker images that are listed in the editor? Unfortunately, the 3rd party library for detecting markers that is used in AR Scavenger cannot reliably handle high resolution images, photos in particular (that you used).

The latest version of AR Scavenger requires version 1.26 of Interactive Video. Is that version installed? 

youriberg

Sat, 01/27/2024 - 07:19

As i said in the first message, i have tried with 50*50 pixels pictures and they were not working and i tried with high resolution pictures which were working. I have tried high contrast pictures which were not working and low contrast which were working. Using same image in one h5p in another one and then they are not working. The picture definition, quality or contrast doesn't seem to affect the recognition, it's more like if it's randomly detected or not from one h5p to another! I will try on another WordPress website and let you know if it works better.

I will try another interactive video library version as you suggested and let you know.

otacke's picture

otacke

Sat, 01/27/2024 - 19:27

And as the hints say, images internally are handled with a resolution of 16x16 pixels (with one 8bit color channel if I recall correctly), so images are scaled down and color information will be lost. The detection of markers also is influenced by the light conditions. If the markers are not lit uniformly, detection gets worse. Has nothing to do with the platform that you use H5P on.

Not happy with the limitations, but that's what the 3rd party library that is used has to offer.

youriberg

Sat, 01/27/2024 - 19:33

I've tried with low resolution black and white pictures, it's not working, actually, I've tried replacing a marker's picture that was not working with one that was working before and it's still not working. Even when my camera is super blurry, it still recognizes the pictures that are working. Sorry but I still can't explain how it's related with the picture. I'll make more research on the issue as I'd love to make it work properly.

youriberg

Sat, 01/27/2024 - 20:00

I've tried using a simple qr code as marker and you can see that it's just not working even with this simple picture : https://streamable.com/d43w44

Also i still can't make video interaction appear in the list of interactions despite having installed the libraries...

otacke's picture

otacke

Sun, 01/28/2024 - 10:06

A QR code is not the same as a marker and given that it will be scaled down to 16x16 and given its typical pattern, it's very likely that there's not much to distinguish it from noise.

As I mentioned already, I am not happy about the limitations, but that's all the 3rd party library has to offer for markers.

If Interactive Video does not show up, then something is wrong below the layer of the content type. It can only request the library from H5P's core which in turn will try to get it via the H5P integration (aka plugin). If that request fails (for whatever reason), then there is nothing that the content type can do. You can cross check this on other platform such as H5P.com or moodle (e. g. in the sandbox https://moodle.org/demo).

youriberg

Sat, 01/27/2024 - 19:16

I've tried to use H5P AR scavenger on another website and i have the same issue and a new one with text of a marker appearing on another marker, even though the pictures are very different! I'm also using the correct version of interactive video with the AR Scavenger but it's not showing in the available H5P interaction. 

Attachments: 
Image icon IMG_20240127_191329.jpg
otacke's picture

otacke

Sun, 01/28/2024 - 10:07

I could only repeat myself.