Interactive Video VR Support

Submitted by Swerv3 on Thu, 11/24/2016 - 07:28
Forums: 
Feature requests

Hi Guys, 

Just wondering if it would be possible to enable the VR support (Google Cardboard) from YouTube in the H5P interactive video when it's played. I saw that 360° videos work but can't enable the VR function from Youtube. 

We maybe be able to fund the work.

Can you tell me if it is possible to do and please give me an estimate on cost / time to complete? 

Regards,

Steve. 

Summary: 
Virtual Reality for Interactive Video
Content types: 
Interactive Video
Issue Status: 
Open
1
0
Supporter votes Members of the Supporter Network can vote for feature requests. When the supporter network has generated sufficient funding for the top voted feature request it will normally be implemented and released. More about the H5P Supporter Network
tomaj's picture

tomaj

Fri, 11/25/2016 - 08:17

Hi,

I've been thinking a bit about how VR would work with Interactive Video, and I think it would be really cool, but it's not something that can quickly be thrown together.

Here are some things that need to be resolved.

  • Double rendering of interactive content (one for each eye).
  • How does the user interact with the content in Google Cardboard? (the device is strapped to their face)
  • Should the interactive content be placed in space, or glued to the viewport?

I think VR probably needs it's own Content Type, and if you would like to fund the work for a prototype, let me know. :)

If not, it is anyway something that I'll experiment with when I get the time (but I have no idea when that will be).

- Tom

otacke's picture

otacke

Mon, 11/28/2016 - 11:19

I like that topic and I'd like to help out if I can!

I think that H5P should not stick to Google Cardboard, but also anticipate the successor Google Daydream which offers a controller. Also, thinking of more "higher tech" solutions such as the Oculus Rift, I wonder if there already is some kind of best practice for interaction in virtual environments. It's a field that's still evolving, I guess.

Regarding the placing of content, there will probably scenarios for both options. Some content might not need being placed in space, e.g. general information for some kind of a "common" head up display. On the other hand, there might be interactions that should be directly linked to visible content and should not be glued to the viewport. I'd love to have something like this: https://www.youtube.com/watch?v=7Nz4c0DqW7k ;-)

Swerv3

Mon, 11/28/2016 - 23:13

Is a cool concept to aim for but not sure of the technical requirements. Just talking about here in our office we are trying to nut out how it would be best to have the editor display the content. Should it be a compressed video displaying the the whole video or should it be a psudo 3d environment where the user can rotate the screen as the learner would. On screen graphics/questions would have an option to attach an object to the viewport or in the space at a predefined distance from the viewport. We are thinking the second option.

I also agree with the idea of future proofing but we only need "simple" browser support before worrying about the Oculus type devices.  However that does bring up a point of requiring user input, some of the devices that use Cardboard don't have buttons, could a timer be used in conjuction with the onClick? If the learner looks are an object for long enough (2-3 seconds) it is the same as a click? 

@otacke are you able to develop something like this? Are experienced in developing content types for H5P? 

otacke's picture

otacke

Tue, 11/29/2016 - 00:15

Well, I have already created a brand new library for H5P from scratch, but I lack quite some knowledge about the APIs that Google is currently offering for VR next to the YouTube app (if any), and about JavaScript libraries such as three.js for building your own VR solution. Given your apparently tight schedule, I fear that I can't do it all on my own. Sorry.

Swerv3

Mon, 11/28/2016 - 02:16

Thanks for the reply Tom, 

Are you able to contact me over email directly.  

We are interested but are under a fair bit of time pressure. Can you please give me an idea of cost and timeframe required to do this? 

- Steve. 

tim's picture

tim

Mon, 11/28/2016 - 09:48

Hi Steve, VR is not on the short term roadmap for the Core Team but you can contact us at [email protected] to get a discussion going.

- Tim 

tomaj's picture

tomaj

Tue, 12/13/2016 - 09:47

I have some thoughts on VR. :)

  • Primarily to be used with VR Videos on YouTube (where you can look around 360°)
  • Need to render a Content type two times (one for each eye), but disable any direct input (to keep them in sync).
  • Need the VR-Video component to "drive" the sub Content types
  • Keyboard/gampad input in all Content types
  • Connect a PC to the VR-device using Web Sockets, to allow for keyboard/gamepad navigation

- Tom

Robert_UUlm

Fri, 06/19/2020 - 11:37

Hello everyone

Is there any news on VR support for 360°-videos? I`d love to upload own videos, add interactive features and view them on tethered devices such as HTC Vive. Is that currently possible and if not, will it be developed any time soon?

Best regards
Robert

Robert_UUlm

Fri, 06/19/2020 - 11:39

Hello everyone

Is there any news about VR support for 360° videos? I`d love to upload own videos, add interactions and view them over tethered devices such as the HTC Vive. Is this currently possible and if not, will it be developed?

Best regards
Robert

BV52's picture

BV52

Fri, 06/19/2020 - 19:35

Hi Robert,

Currently there are no ongoing projects from the core and as far as I know no plans in the near future. The good thing about H5P is that it is open source so anyone can create this feature.

-BV

Faultline

Fri, 07/21/2023 - 04:00

Sorry to ressurect such an old thread but it'd be incredible to see VR180 support for Interactive Video, it already does everything so well. I'm currently seeking a VR180 solution that can also do branching interactivity but there's very few solutions out there, and none that are as feature rich as H5P IV.   Near-life and InstaVR are about as close as i can find, neither seem to do timecode jumps like H5P IV.   

A number of manufacturers are releasing modern 5-8K consumer and pro cameras - the timing is ripe!