Quest Developers Will Finally Get Access to Cameras, Promising New Wave of “cutting-edge” Mixed Reality

Developers have long been frustrated by the lack of access to the cameras on the Quest headset when creating mixed reality content. However, Meta has announced a new camera Passthrough API that will change this.

During Connect this week, Meta VP of VR/AR Mark Rabkin revealed that the Passthrough API will be available early next year. This release is anticipated to open up possibilities for various cutting-edge MR experiences, including tracked objects, AI applications, overlays, scene understanding, and more.

Testing for the Passthrough API is set to begin very soon, with select developers potentially being able to use a beta version in their games.

Currently, developers have had to rely on alternative methods like geometric representations and tracking data due to the lack of camera access. With greater access to cameras, developers can create more personalized experiences for users.

Meta will also need to address privacy concerns regarding camera access. While specific limitations for the Passthrough API have not been disclosed yet, it will be interesting to see how Meta ensures user anonymity when accessing additional camera data.

In addition to the Passthrough API announcement, Meta revealed updates to Horizon OS alongside the launch of Quest 3S on October 15th. These updates include simpler and more transparent Privacy Settings, a sensor lock feature, and privacy indicators for microphone and location usage.