Apple's mixed reality headset will feature hand and eye tracking

When Apple’s highly anticipated mixed reality headset hits the market, it will feature unique design elements and capabilities that will set it apart from competing offerings, according to information reported by Bloomberg.

Unlike other headsets which feature hand-held controllers, the device – which is expected to be called Apple Reality Pro – is expected to allow users to manipulate their augmented reality (AR) and virtual reality (VR) environments using only their hands. and their eyes. The new headset’s external cameras will track the user’s hands, while the device’s sensors will track their eyes. The user will be able to control the device with his gaze or by pinching his thumb and index finger together.

“The gaze and hand tracking capabilities will be a major selling point for the device,” unnamed sources told Bloomberg.

Avatars for FaceTime calls

In the meantime, the device will “attempt to create a 3D version of the iPhone operating system,” the Bloomberg article says, bringing a familiar interface to Apple customers. That means you might see a headset that features a VR version of apps like the Safari web browser, Apple App Store, and Apple TV+, all displayed in a grid of icons.

In a move that requires significant processing power, Apple reportedly plans to offer users realistic VR avatars during FaceTime calls. On the other hand, Meta, the current leader in the VR headset market, offers more cartoonish avatars during virtual meetings. According to Bloomberg, FaceTime avatars will show the user’s face and full body.

However, the headset will only be able to support realistic avatars for two users at a time, each with an Apple headset – any other users joining a call will need to use icons or Memojis.

Given the processing power required for the new device, Apple would have chosen to drain the battery of the headset itself. According to Bloomberg, it will be in an external box that will slip into the user’s pocket and connect by cable.

Source: ZDNet.com

Disclaimer: If you need to update/edit/remove this news or article then please contact our support team Learn more

Tarun Kumar

Tarun Kumar has worked in the News sector for 05 years and is currently the Owner and Editor of Then24. He reside in Delhi, India with his Family.

Leave a Reply