NVIDIA Partners with SMI for Eye-Tracking VR Rendering Tech

Subject: General Tech | July 21, 2016 - 12:31 PM |
Tagged:

NVIDIA is announcing a "new technique" for VR using eye-tracking technology from SMI, and with this NVIDIA's researchers are working to "match the physiology of the human eye to heighten visual fidelity in VR".

View Full Size

Image credit: NVIDIA

NVIDIA provides this description and video demo of the new tech:

"The demo - which we’re bringing to the annual SIGGRAPH computer graphics conference in Anaheim, Calif., July 24-28 - is simple. Strap on a head-mounted display with integrated eye tracking. Look around the virtual scene of a school classroom with blackboard and chairs. Looks good, right?

Now gaze at the teacher’s chair, turn off the eye tracking and look around again. Only the area around the chair is rendered in detail. In your periphery the demo was rendering a less detailed version of the image — and you couldn’t tell."

NVIDIA further explains the technology:

"Human vision can be thought of as having two components: foveal and peripheral vision. The small region of your retina called the fovea is densely packed with cones — a type of photoreceptor cell — providing sharp and detailed vision. Peripheral vision covers a much wider field of view but lacks acuity.

This acuity difference has inspired foveated rendering systems, which track the user’s gaze and seek to increase graphics performance by rendering with lower image quality in the periphery. However, foveated rendering taken too far will lead to visible artifacts, such as flicker, blur or a sense of “tunnel vision.”

Our researchers used SMI’s prototype eye-tracking HMD to perform a careful perceptual study of what people actually see in their peripheral vision in VR. Our researchers then used those insights to design a new rendering algorithm that enables much greater foveation, or reduction in rendering effort, without any discernible drop in visual quality."

There's a lot more information about this new VR technology in NVIDIA's blog post (source), and the company also has a project page up for this "Perceptually-Based Foveated Virtual Reality" technique.

Source: NVIDIA

July 21, 2016 | 03:26 PM - Posted by mLocke

The always-forgotten StarVR announced eye tracking last year. Nice to see others adopting this, in my opinion, must-have feature.

starbreezeDOTcom/2015/09/starbreeze-in-collaboration-with-tobii-to-integrate-its-world-leading-eye-tracking-technology-into-the-unique-210-degree-5k-resolution-starvr-hmd/

July 22, 2016 | 04:19 AM - Posted by vrtime (not verified)

You need hand-tracked controllers for this bad boy.
www.virtualrealitytimes.com/category/hardware/

July 22, 2016 | 04:21 AM - Posted by vrtime (not verified)

I really need to feel even worse about all the life decisions I've made which will prevent me from ever experiencing VR. www.virtualrealitytimes.com/category/hardware/

July 22, 2016 | 10:04 PM - Posted by arc (not verified)

Makes my eyes hurt.

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Lines and paragraphs break automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <blockquote><p><br>
  • Web page addresses and e-mail addresses turn into links automatically.

More information about formatting options

CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.