NVIDIA introduced deepfake technology that makes the user look directly at the camera

[Viper Carder]

The NVIDIA eye contact effect directs the user's eyes to the camera during video conferencing.

NVIDIA introduced the new effect of NVIDIA Maxine Eye Contact, which during video conferencing directs the user's eyes to the camera, even if he looks the other way.

According to the company, continuous eye contact is not possible in the scenarios of video conferencing. It can be difficult if the speaker reads the script or looks at the data on the computer screen. In addition, according to NVIDIA, maintaining direct eye contact can also be difficult for some people for psychological reasons.

The effect of eye contact is based on an artificial intelligence algorithm that evaluates the user's view in real time and redirects it to the camera using the filter to the webcam. At the same time, the eyes retain their natural color and blink.

Workout effect

This function detects human hands or other objects that overlap the eyes and adjusts accordingly. If the user is too far from the camera, the function is disabled, making a smooth transition between simulated and real eyes

The effect takes into account environmental factors – lighting, shadows, blurry, white and hue balance, as well as the position of the object’s head, skin color, glasses, look, shape of the face and eyes.

The new technology is in beta and will improve based on feedback from users. NVIDIA said it created technology based on a set of data from 4 million images, with about 25% of them created artificially, « to add diversity in eye color and shape ».

This effect is part of the Nvidia Broadcast package update for live broadcasts and video conferencing, which is available free of charge to NVIDIA and GeForce RTX GPU owners.