Week 10: 20 - 27 April [Google Cardboard]

-

Using Cardboard

I began by incorporating google cardboard into the existing build.

Google cardboard is an inexpensive way to provide more immersive mixed reality to event visitors. Limited by the mobile devices placed within it, the extent of a Cardboard VR experience will be greatly reduced in comparison to an Oculus rift; a small number of headsets could be used by many people over the course of the exhibition.

Using the current GVR (google virtual reality) SDK, provides an emulator prefab within Unity so that the application does not have to be built to the device for testing purposes. This reduced development time hugely.

My main focus for inclusion of the Cardboard headset is user experience. With this is mind, when purchasing the headset, I also selected some inexpensive additional items which will assist with the overall experience.

  • Cushioned pads – to aid with extended sessions, as the Cardboard corners can irritate the nose.

Face pads.

  • Head strap – so users have both hands available to navigate the scene.

Head strap

  • NFC tag – provides functionality for launching a user defined application when phone comes within range of tag, starting the experience seamlessly.

NFC tag



In addition to this, Cardboard also includes some basic default functionality. The most relevant of which, is the premade raycast out from the viewers position, which allows a physical magnet toggle on the headset to be moved to interact with object in app. From reading, this interaction with the magnet has a significant effect on the phones compass, which when in Cardboard mode is registered in the same way as a screen tap.





Camera  raycast and headview.



Early tests using this feature indicate it would be a good addition to the controller already incorporated – should users find tracking of the controller too unreliable, given that the magnet toggle will never go undetected.  

Still keen to focus the remaining development time on user experience, I began researching the potential pitfalls of using the Carboard and more general VR.
The most common result was disorientation, which research shows is most prevalent in ‘non-gamers’. As the attendees of the exhibition are likely to be made up of a wide range of people, who will be wearing the headset while stationary, as their perspective moves within the app, this is a significantly probable problem.
The current most effective method of negating the effects of disorientation work “by providing a clear visual reference that moves with the point of view of the observer in the scene, gives a better impression of your motion in the virtual world.” (Wired.com 2015). I included a nose focal point at the low middle camera positions to achieve this.


Vuforia and Cardboard Compatibility Issues

Cardboard, loading with immediate crash
While the device performed as expected in the emulator within Unity, I found this was not the case when built to an android device.

Numerous attempts saw the application load only a black screen, or crash immediately on loading the split, VR scene.

The Vuforia documentation for integration with Google Cardboard is outdated as of 2016, though does provide a detailed walkthrough for their mutual set-up using 2016’s current versions. Following the deprecated setup advice does not allow for the technologies to be incorporated as many of the attributes for each element have been overhauled entirely.

Current forum posts and responses from Vuforia’s own development team, highlight the current incompatibility of the two technologies.

To achieve a functioning build, I began rolling both the GVR SDK and Vuforia back through previous releases, with the hope of finding a compatible combination.

I followed the advice described in the documentation for both Vuforia and Google Cardboard, learning that the minimum API level needed to continue function is 19, with android 4.4 (KitKat) or newer installed.

Each time, the build was completely functional in the emulator, but failed on the device. All versions of Vuforia were trialled, back to June 2016. All versions of GVR were trailed, back to 1.100.0. All versions of Unity trialled, back to 5.5.6.

I created my own post on the Vuforia developer forums to request an answer. A Vuforia developer responded, advising that Vuforia have no goal of currently developing towards compatability with Cardboard, and are instead looking to implement their own functionality which will use the mobile device itself to replicate the function of a headset. With this, I abandoned the inclusion of Google Cardboard.



References
  •         GitHub. (2018). googlevr/gvr-unity-sdk. [online] Available at: https://github.com/googlevr/gvr-unity-sdk/releases [Accessed 27 Apr. 2018].
  •          Google Developers. (2018). Google VR SDK for Unity  |  Google VR  |  Google Developers. [online] Available at: https://developers.google.com/vr/reference/unity/ [Accessed 27 Apr. 2018].
  •          Google Developers. (2018). Quickstart for Google VR SDK for Unity with Android  |  Google VR  |  Google Developers. [online] Available at: https://developers.google.com/vr/develop/unity/get-started-android [Accessed 27 Apr. 2018].
  • ·         Stinson, E., Stinson, E., Stinson, E., Calore, M., Pardes, A., Stinson, E., Pierce, D. and Stinson, E. (2018). How to Reduce VR Sickness? Just Add a Virtual Nose. [online] WIRED. Available at: https://www.wired.com/2015/04/reduce-vr-sickness-just-add-virtual-nose/ [Accessed 27 Apr. 2018].








Comments

Post a Comment

Popular posts from this blog

Week 3: 2 - 9 March [Continued AR prototype]

-
Image
I have spoken with the university’s 3D technologist, who is happy to assist with printing the airship model, but does not have the capacity to do so for several weeks. Until I can print a model I will continue to develop the prototype started last week. Instantiating model versus instantiating model with shadow shader. To add an element of realism to the instantiated airship, I added a plane below the model so the light source within the scene would be blocked by the model, casting a shadow onto the plane. The shadow had very poor definition, not appearing to look even vaguely similar the model, and often went unnoticed against grey/white backgrounds. To improve this, I added a shader to the airship model, which casts a much more well-defined shadow. I also updated the components of the plane within Unity, setting its alpha value to 0, making it transparent. This still casts a shadow onto the planes surface, while making it appear to the user that the shadow is cast direc...
Read more

Week 7, Part 2: 30 March - 6 April [Leap Motion, Prototype]

-
Image
Thinking of possible uses of the Leap Motion in the application, I ruled out a pop-up menu as this could only be used to trigger scene changes – not the level of engagement the project requires. Despite this, I was still able to draw inspiration from the ‘Hover-UI-Kit’ menu I experimented with in the previous blog entry, in Unity. Using a gesture to activate a ‘mode’ then more intuitive movements within the mode for further functionality. Using the hand to select parts of the airship to then display related information was the idea I decided to develop. This could be done with relative ease through raycasting out from the hand prefab to detect colliders on a ship model. I used the last bone in the index finger for the origin of the ray, casting the ray forward in the direction of the bones Z-axis. Once this functionality was implemented it needed to be made toggleable, triggered by a user gesture. Leap Motion provides an example script to detect predefined hand positions. Th...
Read more

Week 1: 16 - 23 Feb. [Meeting with Museum Director]

-
Image
While I was intrigued by both the energy efficient car and the museums interactive experience, the prospect of working with new technology directly related to the content of the degree, where people outside of the university would be the end users made the museum’s project far more appealing. Diss museum had reached out to the university for assistance with their upcoming exhibition, to commemorate the successful double Atlantic crossing of the R34 airship. No brief or requirements were specified in the museum’s request, so after learning of the project I contacted the museum manager, Basil Abbott, to arrange a meeting to further clarify what they hoped to include in their exhibition and available resources. From initial email exchanges it was clear that the intention was to involve the community with a hands-on experience(s) rather than a static exhibition, the implementation of which the museum has left to our discretion. To prepare for the meeting it was necess...
Read more