Thoughts on VR-gaming in 2016

By  Michael Voigt

A List recently had a good article about Nvidia and Virtual Reality. [ link ] 

It was quite interesting and feels like 2016 is going to be a critical year for gaming-VR. A lot of releases are scheduled for just Q1.

Content might be the big winner. Let me elaborate : 

Stereoscopy has been around for quite awhile.

We are going to have plenty of flavors of VR-devices doing essentially the same thing - displaying 3D-images 2 inches in front of our eyes. Quite similar to stereoscopy devices that have been around for quite awhile. These devices will use different hardware-schemes to render the 3D images for content. 

- Some will use high-end PCs that have minimum-specs to be compatible. The VR goggles will be connected to the PC video card. Cables will be required between the HD video stream and the googles. 

- Some will use goggles that are just shells that surround smart phones. These will be more ubiquitous, but will have a lower-fidelity experience. However, modern smart phones have the necessary equipment to provide a compelling VR experience.

- Some will embed hardware within the goggles, but will have higher-priced entry points for the devices. These self contained units will provide a specialized experience and won't need cables or other equipment.

Most will converge around a common controller scheme. The input method will resemble the interface between a console and a controller. Basically consisting of trigger buttons and movement controls.

They will also converge around common game development tools like Unreal and Unity. Existing studios are already geared-up to make VR games, look for a lot of familiar studios making VR content.

The VR hardware battle is brewing to be a tight race, much like BlueRay versus HD-DVD. The big players are going to spend quite a bit of money attempting to become the standard for VR gaming. 

I predict Oculus is going to take the early lead. Taking the win with the premium experience. Adopters will be those willing to spend over $1000 for a PC capable of driving the Oculus, or ones that already have a gaming-PC. A small amount of people that have the high-end Samsung phones will also adopt. I'm not sure if this lead will be a win for Oculus? They are going to spend an enormous amount of Facebook money for this early lead.

Microsoft, Carl Zeiss, Google Cardboard, Nvidia, Sony and others will need to focus on bringing a premium experience to rest of the market. Consisting of the 472 million iPhones that have been sold and the world of computers that don't meet Oculus specs or Macs. However, these guys are behind the battle on how you control the game, they are also still struggling with just the visual experience. 

Samsung sells more phones globally than Apple, but how many of those international customers are going to rush out and buy a $200+ accessory to play VR games developed for a Western audience? I predict lower sales for Samsung VR units than the market might expect. 

A break-out hardware leader might bring a premium VR experience to existing consoles. ( Xbox and PS4 ) 

Sony is laying down that gauntlet with their PS4 'Morpheus' project. After watching the promo video, it just reenforced that these VR devices are just  : (  a phone screen - two plastic lenses -  and a gyro ).

Sony Morpheus VR is just 1080p resolution and only a 100 degree viewing area. Smartphones push that many pixels and a larger viewing area...

With a name like Morpheus, I expected quite a bit more. Also, just imagine the umbilical cord from your console to your couch? Unless someone has a wireless method to bring 120-FPS 4k video between those, the experience is broken for the mass-market. 

While the hardware battle ensues, studios with great game ideas and experiences for VR have an amazing opportunity to capitalize upon. 

I feel the content providers have a great chance to win in the VR game. 

Studios that develop engaging games that work across this hardware have a great chance of solid revenue and a market foothold. Whichever flavor of VR you have adopted, they will have quality games to play and share with your friends. 

The content race won't be about exclusive titles. These will be funded by the big VR players, but are really just designed to sell hardware.

Successful content also won't be about pushing the most polygons and pixels to your VR device. Content should bring unique experiences that unleash the immersive power of VR. I'm much more excited to see games like Monument Valley in VR, versus Grand Theft Auto in VR. Think more like Myst, and less like Call-Of-Duty ... VR edition. 

I want the market to bring break-out games to VR, I'm excited to see game-changers. They will be the big winners, while the VR-hardware battles tight margins and lower than expected adoption.

Most importantly, bring content across all the flavors of VR hardware.

What about the other side to VR? Watching movies through your 3D device? Netflix for VR? I'm not convinced the mass market wants to watch movies that way. Do parents really want their children to jack-in and sit mindlessly on the couch? Is human-interaction while watching a movie that important?

Is your significant-other going to be supportive of your nightly 2+ hours of jacking-in time? 

Do you want to bring your VR device into the bedroom? Jacked-in while your partner sleeps?

If watching movies with VR becomes a popular pass-time, I'll vote for the device to come with 'popcorn-mode' so I can see my snacks. 

Human-Robot interaction : Tesla making a right turn

Sooner than we might expect, autonomous cars will be navigating our cities, and drivers will transition to passengers, paying minimal attention to traffic. I even envision a future without driver seats, with occupants of autonomous cars gathered around a table, engaged in social interaction.

However, what about the dynamics between drivers, pedestrians, and cyclists? This interaction demands mutual awareness; a lack of it could lead to hazardous outcomes.

I'm particularly vigilant about establishing eye contact with drivers, essentially using it as my 'interface' when crossing a street, especially during a right turn on red. Trusting that a driver will glance in my direction before accelerating through the turn is something I can't risk.

Ensuring safety dictates the importance of establishing eye contact with a driver before stepping in front of a vehicle. But how does one accomplish this with an autonomous car?

While current autonomous vehicles are equipped with sensors to prevent accidents, if one were to walk in front of them at just the right moment, it could trigger a sudden reaction from the car. After accelerating for a turn, the vehicle might abruptly stop, alarming pedestrians and passengers alike. Such an experience would be better avoided.

Consider also the scenario where someone stands behind a street pole, out of view of the autonomous car's sensors. Upon stepping out to cross the street, assuming the car detects them, the vehicle won't hit them, but the sudden reaction could still be startling.

The ability to make right turns at a red light is essential for traffic flow but demands careful safety checks by human drivers. I have a simple idea that could enhance safety and streamline this process for autonomous cars.

How about a simple light that tells the pedestrian what the car is sensing?

Red light = I'm an autonomous car, but I don't see you. So, I think it's okay to make a turn!

Wouldn't it be more effective to incorporate a bright light on autonomous cars to indicate their intent? Pedestrians could then focus on this light, akin to making eye contact with a human driver. Positioning this light near where eye contact would have been.

A green light would signal to pedestrians that they're seen by the car and can proceed. If the light turns bright red, it alerts pedestrians to use caution, indicating that the car doesn't detect them. This approach eliminates guesswork and transparently communicates the AI's decision-making process.

However, what about blind individuals? 

They wouldn't see this light. Perhaps a safety sensor could be implemented to detect a high-pitched sound, informing the blind whether it's safe to proceed or not. The autonomous car emits a sound as an indication of its current intent.

App UI : iPad Pro and Anki OverDrive

For this posting, I would like to talk about my thoughts on designing for 'edge-cases'. I'm suggesting a fix that might be considered an edge-case. This is a product for younger children, in particular young boys. 

How many children are going to have an expensive iPad pro, iPad Air 2, samsung Galaxy View or another larger device?

For edge-cases like this, I still like to produce design solutions that solve for all. 

However these suggestions would need to consider against larger issues that might offer more value to be addressed. For example, the battery life of the cars might be a much larger issue? During games, your car battery will die during a battle, which is quite disruptive.

UX suggestions for larger screens ( iPad Pro - Samsung - etc )

A lot games are going to have to consider making alternative UI schemes for the new larger devices. Games and RC control UI generally utilize the entire screen. Including products like parrot drone, sphero, bb-8 and even a company I used to work for Anki. I’m going to suggest solutions that would improve the experience for my former company and products - Anki OverDrive and Drive.

OverDrive is amazing fun, I highly recommend giving it a try :) 

The iPad Pro weighs over 1 pound and has a large screen. Users will rest the weight of the device on their thighs, and they will sit down more. This is much different than playing with a lightweight phone. 

In Anki OverDrive Lane-switching is done by rotating the device, using the gyros. This will be fatiguing and should be re-thought, or at least be an option you can disable/enable.

You also tap the buttons hundreds of times per game and the distance between them will fatigue your hands.

Wouldn’t it be cooler to let the player tap their controls where they want them? With less distance for thumb travel needed? 

Where they tap is where the UI mounts, the UI could be moved by tapping in a new location, it is dynamic and you control the placement.

I see much less hand fatigue and a much better gameplay experience. Could you imagine the thumb fatigue with the old UI? 

These devices are so large, younger folks might want to hold them in portrait mode. This provides a more controlled grip on the larger and heavier devices.

This orientation also allows for less accidental ‘home’ button presses. Accidentally pressing the ‘home’ button closes the app!

It also doesn’t cover the 4 speakers for better sound presence. When your hands cover the speakers it mutes the sound, a big part of this game is the sound feedback.

30% of the world’s population is Left-Handed. Wouldn’t it also be cool to have a UI setting for Left-Handed mode? Allow the player to pick sides for the controls?

Better Facebook posting and acknowledgements

( 9/20/2015 ) 

I wanted to do a blog entry in-which I document the thinking behind the suggestion. Elaborate more on my initial approach of what is the user, environment, emotions, goals and the interaction. Document what runs through my head when I approach a problem. 

I do my blog mostly for fun because I like to improve existing world experiences I find ... For this one : Better Facebook posting and acknowledgements.

Facebook built their empire on the simplicity of the 'Like' my post, Google is attempt to relegate them with the '+1' that. The battle continues...

Recently I have found life events being announced on FaceBook, including death announcements of people that I knew. I also have been finding announcements of local weather events or people on the loose that might be dangerous. In-fact, I was just informed that two people from a former team passed-away today!

'Facebook has informed me that someone passed away, do I like that post???'

These leave me confused on whether to 'Like' the posting or not? It seems inappropriate and I decline to respond to these posting. Obviously, the poster's stimulus to keep posting is knowing people saw and thought about your post. I'm not supporting that loop, I'm breaking it.

'Like' doesn't work for all posting. Wouldn't it be cooler if the poster was able to tailor the acknowledgement they want to receive? For the viewer, wouldn't it also be cooler to appropriately respond?

To improve this experience, first I identify the users. This one is very broad, it includes nearly everyone. The experience needs to stay neutral to gender, age, sophistication and culture. If this were gamers, I would consider that they are probably very tech-savvy and need less hand-holding and instruction.

Next, let's look at the environment, again this is just about anywhere and across many different devices. Most common the toilet, more extreme would be driving a car. The experience needs to stay as easy and ubiquitous as the one I'm changing.

Emotionally the user viewing the post is generally calm and inquisitive. Facebook browsing is a somewhat habitual task that can be done infrequently or multiple times per day. While they peruse the postings their emotions are obviously affected by the postings.

The experience is pretty passive with scrolling and occasionally liking a post. When deciding whether to like a post or comment, the user considers what this action will say about about them. They have different classes of people contained in their network, they will almost automatically like the upper caste and rarely do more than glance at the low-end of the spectrum. Emotionally, this is all pretty much common sense and Facebook is a popularity contest ... But your parents always got your back ;)

The interaction has two sides. The poster posting posts and the viewer viewing posts and reacting. The reaction is glancing, liking or commenting. ( and some other stuff like sharing and flagging )

Let's look at some mock-ups : 

Posting that doesn't feel like a 'like' is the right response.

My suggested solution is to give the poster another option that offers suggested actions the viewer can select. I'm thinking of two new ones : 'My Regards' & 'Heard' The poster selects that from the additional UI pictured above.

For the viewer when they see a posting, they still just have one quick action. The displayed action is the one the poster selected. Simple, right?

Thanks for taking a look at a simple experience improvement coupled with my thoughts behind the idea!

I also like to throw in one more idea at the end, from time-to-time. Facebook, can you please add the number of times one of your posting was viewed? If you look at your own posting, you see the number of views. ( Above : 245 Views )

Apple Watch : How the battery makes it a Gadget

I have been using my Apple Watch for over one month. Overall, I'm happy with the software and the experience. However, the short battery makes this product less of a tool and more of a gadget. 

The design of this watch always being there for you, a constant companion on your wrist. Much like what people think of their smartphone, but how long can you go without your smartphone? I don't know about you, but I still use my iPhone when it is plugged in and charging. The Apple Watch is unusable while charging, it isn't on your wrist. I don't find it a constant companion, when the battery is charging ... in-fact, mine is charging right now and off my wrist, and will be for another 1 hour. I default back to my iPhone as my constant companion, I can just reach for it and us it as I usually do.

It is a small device with a small battery, you can't change that. It has a beautiful display and a fast processor, these make the battery life much less than other smart watches on the market. 

Maybe future technology will allow for a similar design with a much longer battery life. But for now this is what we have, an expensive watch with one solid day of battery life. 

[ Doesn't stay on the charger ]

Currently, I find myself charging it on the go. The Apple idea of charging while you sleep and putting it on the charger every night before bed doesn't work with my lifestyle. Maybe I'm not the norm and people find this routine easy. 

When I do charge it, the inductive charging is kind of cool. But frequently the watch falls off the charger and isn't charging. I would just prefer a cord to plug-in and make a solid connection. I feel the inductive charging is more of a sales gimmick. Also, when charging Apple should always show the battery percentage on the screen and the time.

Wouldn't it be cooler if you didn't have to be without a watch while it is charging? Take a look at my idea for that : 

[ Click for Larger View ]

Apple Release : Ideas and predictions

Apple is going to release the iPhone 6s and maybe a larger iPad tomorrow. Here are some thoughts that I put down Saturday about what I would like to see.

Usually, I hope for a lot from Apple's releases. I'm always left wanting Steve to come on stage and say 'and ... one more thing'.

What I really hope to not see :

- Just another phone update that makes them thinner and feeling even more delicate and bendable.'
- A full sapphire screen - boring ... right?
- Integration of Beats into the phone, Beats branded internal speakers or some nonsense like that.
- Software updates without any cool hardware updates.

What I really hope to see :

- A new phone design that breaks the Apple shape language that hasn't changed much since 2001 with the release of the iPod.

* - Take a chance and try a new shape, I like a wedge. Gives me a grip, less slippery and sits nicely on a table.

- Battery, Battery .. Battery -- I want a larger battery on my phone more than most other features. My sketches have ideas for a new shape that allow more room for a larger battery.

* - My phone is skinny enough and light enough, I wouldn't mind more mass and size for 150% more battery.

- A more natural camera placement that allows for a better grip for taking photos.

I usually have more time to annotate and details my ideas, I apologize for just attaching pencil sketches .. but I wanted to post before the event tomorrow ;/

Apple iWatch UI : The passcode

Highway UI : HOV Lane

My suggested improvements for a common highway sign.

Product UI : Thermostat and Google Nest

A less-than ideal and frequent interaction with my thermostat control spawned an idea. This idea lead into a Google Nest redesign, which resulted in a Google interview.