Virtual reality isn’t just for rich nerds any more. Here’s the future of VR on a budget

Virtual reality headsets on the market today are mainly about what you can see and hear. Basically, the user gets his or her own IMAX theatre. But the technology is advancing fast and dropping in price, and in the not-too-distant future, a fully immersive experience that uses all five human senses could be achieved.

A recent research project at the Singapore lab of Metalworks, the creative tech division of global media agency Maxus, aims to show how companies can take advantage of the rising medium to transform their storytelling. They posted a video on Youtube about the assets and limitations of today’s VR offerings. Tech in Asia got in touch with Metalworks’ director of technology Tom Kelshaw to ask about the project.

"We’re trying to solve for scale, which demands accessible solutions. We can’t fill a stadium, or an emerging market campaign, with Oculus headsets and $1,200 computers. We can with VR One or Cardboard mobile headsets. So adding reassuring, grounding experiences such as hand interaction make the experience more natural to a wider audience than just the tech pioneers,” Kelshaw said.

Gesture control


"Most VR experiences don’t allow you to see your hands in the virtual world. This almost makes you feel like a body-less head floating in space," says Sarah Tan, a creative technologist at Metalworks, in the video. To overcome this disembodied sensation, many VR headsets are developing ways to incorporate gesture control.

Metalworks, like many others, achieves this using Leap Motion. The Leap Motion controller uses an infrared camera to detect human hands and let them interact with the virtual world.

Here’s a video of another project called Hovercast, a customizable menu interface for virtual reality applications:


The demo in Metalworks’ video is still fairly primitive. Yes, hands do show up in real time, but they can’t yet interact with anything. Kelshaw points out that the gap between getting hands to show up on screen and actually interacting with the virtual environment isn’t a big one, though. "Once you can put virtual hands in a virtual environment, interacting with the environment is easy. You’re essentially a video game character," he says.

The hands also don’t have fingers. Instead, they look sort of like mittens, or the hands of a Mii avatar on a Nintendo console. Tan says the performance of Leap Motion on mobile is fine, and detection of individual fingers isn’t the problem. But because realistic hands don’t look quite realistic enough, some users are creeped out. This is called the "uncanny valley" hypothesis. "Our brain knows there is something wrong, but can’t figure out just what it is," Tan explains.

@Oculus + @leapmotion Tripping

A video posted by Daylon Soh (@daylonsoh) on Jan 13, 2015 at 12:47am PST​

The HTC Vive, an upcoming headset powered by Valve’s Steam VR software, is primarily designed for gaming. Like Oculus Rift, it doesn’t use a smartphone and has elected to forgo hand-tracking gesture control in favor of handheld controllers. It’s not as cool as just using your hands, but it will cut down on latency and probably be far more accurate – essentials for video games.

Smartphone limitations


Led by Google Cardboard, smartphones are quickly becoming the medium of choice for most VR headsets. Just slot them in and split the display, and you’re on your way. It’s far cheaper than dedicated VR headsets like Oculus Rift, but phones do have their limitations and tend not to be as well-equipped for gaming.

Display-wise, mobile phones are superior in resolution and refresh rate, according to Metalworks. But compared to the larger gaming rigs required by Oculus, processing power is restricted on mobile VR. However, most smartphones today are fully capable of processing virtual environments, 360 degree spherical environments, and HD videos. "The flexibility and accessibility benefits of mobile VR headset far outweighs the technical limitations," Kelshaw says.

To use the app that Metalworks created, which uses the Unity mobile game engine and places the user in a 360-degree video scene, the phone must perform a number of intensive tasks. "Each 360-degree video frame is a few times bigger than a normal video, and we have to dynamically load and unload video frames so that only a few seconds worth of it is stored in memory at any one time," Tan says. Furthermore, the device has to check and display the user’s hands, check the movement of the user’s head, and change to different parts of the scene accordingly. All this has to be performed 30 times per second.

Head and position tracking is another challenge that many VR headset makers are on the verge of overcoming, but haven’t quite nailed down yet. Through some combination of lasers, accelerometers, and gyrometers, a headset will be able to determine where the user is in a room and which direction her head is pointed. It’s yet to be perfected on a consumer model, but progress is being made quickly.

Smellovision


And let’s not forget about smells. "For full immersion experience, you need to involve all senses, including scents and being able to interact with objects," Tan says.

Metalworks says it has implemented a pilot project with an Indian company and is in discussion with several other brands to launch scent controls as part of its VR interactive advertising campaigns.

It’s not as crazy as it sounds. Another startup from Japan is developing its own tech to integrate smells with TV broadcasts. As for taste? We’ll let you figure that one out.

This post Virtual reality isn’t just for rich nerds any more. Here’s the future of VR on a budget appeared first on Tech in Asia.