New patent filings indicate that Meta company is developing its version of the EyeSight feature found on the Apple Vision Pro, likely for the upcoming Quest Pro 2 headset.
EyeSight on Vision Pro displays a virtual image of the user’s eyes on an external screen, reducing social isolation typically associated with VR headsets. Meta's patent, titled “Embedded Sensors in Immersive Reality Headset to Enable Social Presence,” shares the same goal of reducing social isolation through similar technology.
While the goal is the same, Meta is taking a different approach by updating a user's avatar in real-time using facial expressions detected by sensors embedded in the headset. These sensors capture signals indicative of facial muscle movements, which are then interpreted using a machine learning algorithm to determine the user's facial expression.
The sensors in the headset include ECG (electrocardiogram), EEG (electroencephalogram), and PPG (photoplethysmogram). These sensors not only reduce social isolation by tracking facial movements but also add health-related functionalities by monitoring the user's cardiovascular health.
When Vision Pro was released, many pointed out the significant gap between Apple's promotional images and the reality of EyeSight. The Verge described it as a “low-res, ghostly image of them (eyes) that feels like CGI.” Although the concept was promising, the poor execution led to disappointing results.
Perhaps Meta’s implementation of the EyeSight feature will be better than the original. Perhaps Meta Quest Pro 2 will crush Apple Vision Pro with a superior execution of the EyeSight technology. However, the Quest Pro 2 release date is not until 2027, so we will have to wait to see how Meta’s version compares.
Currently, Meta is focusing on the Meta Quest 3S, aka Quest 3 Lite, which is set to be unveiled at Meta Connect 2024. Meanwhile, Apple is working on a cheaper version of the Vision Pro, which will omit the EyeSight feature along with some other functionalities to lower the price and attract a broader user base.