Apple 8K 3D Camera Unveiled with “Submerged” Short Film for Vision Pro

Camera News

by Nino LeitnerToday

Apple just released “Submerged”, the first scripted short film shot entirely to be viewed with the Vision Pro. With the film, they released behind-the-scenes footage about the process that reveals the long-rumoured Apple 8K 3D camera which was used to shoot the production. Read on to learn more!

For a long time, I have speculated that Apple would make big efforts in creating immersive video content for its Vision Pro headset in order to boost its adoption, and we’re seeing their first efforts in that regard become reality.

Submerged – first scripted film shot in “Apple Immersive Video”

Submerged is the name of a newly released 16-minute short film that is exclusively produced for the Apple Vision Pro. Apple calls the technology “Apple Immersive Video” and they used a camera which surfaced in a patent application uncovered by Y.M.Cinema (Yossy behind that site is a former CineD / cinema5D writer). Submerged was directed by Edward Berger (Oscar winner for All Quiet on the Western Front as Best International Film), and shot by his long-time collaborator James Friend ASC BSC, who also won the Best Cinematography Oscar for that same movie.

While the short film can only be viewed using a Vision Pro for obvious reasons, they released an insightful behind-the-scenes video which uncovers much of the practical process behind shooting a film in that format.

Apple 8K 3D camera – what we know and what we don’t know

While they have not released any technical details on their Apple 8K 3D camera, we know a few things for a fact: the camera has two fixed focal length lenses built into the camera, and they deliver 8K resolution each in order to satisfy the high resolution OLED screens inside every Vision Pro. The field-of-view of the lenses is close to 180 degrees to mimic human vision including peripheral vision, allowing people to turn their head somewhat.

The complications of shooting 180 degree 3D video for VR headsets

While I haven’t had a chance to actually watch Submerged on a Vision Pro headset yet, I wonder what really happens if you turn your head as the cameras only recorded 180 degrees to the sides, not 360 degrees, which of course would be an impracticality considering camera tracks, wiring and mounting and potentially crew would become visible. It must have been shot in a way that still the center of the action in front of you at all times, with some minimal, less important stuff going on left and right, so you can turn your head towards that somewhat when you hear audio from the side, but not too far – I am guessing they’re blurring anything beyond those 180 degrees so it doesn’t just cut out to black.

Not your average cinema camera

What’s clear for anyone who’s shot for VR headsets before is that the Apple 8K 3D camera can’t be your average cinema camera. Properties considered “cinematic” like shallow depth-of-field are a no-go for such cameras as they’re trying to mimic human vision – and basically anything you look at must be in (deep) focus.

While we don’t know the sensor size of the cameras used, it’s speculated that the sensor size is Super 35 or Micro Four Thirds in order to allow for a decent amount of light sensitivity with a lower noise floor than smaller sensors.

Shooting for Vision Pro: a challenge for lighting, art departments, and even extras scripting

Deep focus and a high-resolution headset like the Vision Pro means a meticulous attention to detail by the art department is needed, so all the sets were built from actual metal to a higher level of realism than usual sets are built – which of course will have affected the total production cost greatly.

Additionally, lights cannot be hidden, so every light source needs to be disguised as a practical light, creating additional challenges.

Lastly, even extras and supporting actors who would only be visible for a brief moment in a traditional film production need to be scripted in much more detail, because a viewer could decide to look more closely at them even though they are not the main characters.

Apple 8K 3D camera likely never for sale, Blackmagic URSA Cine Immersive as alternative

It seems unlikely that Apple will release its 8K 3D camera for sale in its current state, given the fact that it’s not a mass consumer product as most of their other products. It’ll likely only be available for Apple-commissioned productions for now, although it would be in their best interest to make the technology available to many more film producers in order to get more content made for the Vision Pro in order to motivate more people to buy the $3,600+ headset.

Given the fact that they promoted it during the WWDC 2024 keynote, it seems like Apple instead wants to push indie producers to the upcoming Blackmagic URSA Cine Immersive camera, a dual fixed-lens version of their Blackmagic URSA Cine 17K camera – our original report can be found here. No pricing or availability of that product has been announced either.

Budget alternative Apple Immersive production: PDMOVIE 3D Air Smart Mini

Now, we are really in no way experts for 3D productions here (but I am immensely interested in learning more and shoot for the Vision Pro myself), but we’ve come across a remarkable low-budget alternative for 3D production at IBC: the PDMOVIE 3D Air Smart Mini. Check out our interview about the product in case you missed it. We’ve even decided to give them one of our coveted CineD Best-of-Show Awards for IBC 2024 for the remarkable innovation in this product.

What’s your opinion on Apple’s 8D 3D camera and their latest short film production, “Submerged”? Let us know in the comments below.