Apple iPhone 16 Pro Shoots 4K120 fps in Dolby Vision & Adds Impressive Audio Mix Capabilities

Smartphone Filmmaking

by Nino LeitnerSeptember 10^th, 2024

Apple’s latest iPhone 16 Pro and iPhone 16 Pro Max introduce several new features that may interest filmmakers looking to expand their mobile video toolkit – most notably, much improved slow-motion capabilities with 4K at 120fps in Dolby Vision, and an innovative new feature called “Audio Mix”. While smartphones are certainly not typically the primary choice for professional productions, Apple made a point of it by using it again to shoot the entire Apple event, as well a new music video for The Weeknd on iPhone 16 Pro. Read on to learn more.

At yesterday’s “It’s Glowtime” event, as expected, Apple announced a range of product upgrades, and most notably a new generation of iPhones. The iPhone 16 Pro and iPhone 16 Pro Max enhance their video capabilities further – as a reminder, last year’s iPhone 15 Pro and iPhone 15 Pro Max were the first iPhones to shoot Apple Log, and record even ProRes 422 HQ externally via USB-C. This year’s release builds on that and enhances what the phones can do in terms of video recording.

In case you missed it, check out our extensive Lab Test article and video on the dynamic range, exposure latitude and rolling shutter of iPhone 15 Pro and Pro Max. We plan to repeat this test with the new generation of iPhone 16 Pro and Pro Max as soon as we get access to them.

Rewatch the Apple event “It’s Glowtime”

Sensor specs and high frame rates

The core of the iPhone 16 Pro’s camera system is a new 48MP Fusion camera with a quad-pixel sensor. This hardware, coupled with the A18 Pro chip, enables 4K video recording at 120 fps in Dolby Vision. This frame rate and resolution combination is unprecedented in the smartphone market and could potentially serve slow-motion and high-frame-rate projects.

The quad-pixel sensor in both the main and ultra-wide cameras is designed to read data twice as fast as previous models. Apple claims this eliminates shutter lag for 48MP ProRAW or HEIF photos, which could translate to improved video performance as well.

Both iPhone 16 Pro and Pro Max now feature same 13mm, 24mm and 120mm equivalent cameras – for better or worse

A notable addition for cinematographers is the 5x telephoto camera, now available on both Pro models. (the iPhone 15 Pro has a 3x telephoto camera, only the iPhone 15 Pro Max had the 5x telephoto camera). This extended reach could prove useful for capturing distant subjects without digital zoom artefacts, however I am personally never sure whether I’d prefer a 3x magnification over the 5x magnification in my iPhone 15 Pro Max, because very often, I am really missing that “middle focal length”. After all, the focal lengths of the new iPhones translate to 13mm, 24mm, and 120mm – you see there is a HUGE gap in the middle which makes it difficult in practical shooting. Essentially, you have a choice between an ultrawide, a wide and a long telephoto lens, and what’s considered a “standard focal length” – 35mm or 50mm – is truly missing in the middle. My hope is that Apple will address this with a fourth focal length in the future, which will make video shooting with the iPhone much easier.

4K120 fps in ProRes and Apple Log recordable externally

The iPhone 16 Pro now supports 4K120 fps recording in both Slo-mo and Video modes. Post-capture, users can adjust playback speeds in the Photos app, with options including quarter-speed, half-speed, and a new fifth-speed option corresponding to 24 fps.

For professional workflows, the device can capture 4K120 fps ProRes and Log directly to external storage devices. This feature could potentially integrate smartphone footage more seamlessly into existing post-production pipelines.

Significant audio enhancements with “Audio Mix” feature

Audio capabilities have been expanded with four new microphones that Apple describes as “studio-quality.” The device can now capture video with Spatial Audio, designed for immersive playback on compatible systems like Apple Vision Pro.

A new Audio Mix feature allows for post-capture sound adjustments and sounds really exciting, building on machine learning. Users can choose to focus on on-camera voices, apply a studio acoustic simulation, or position vocal tracks in a surround sound field. The practical applications and quality of these features remain to be tested in real-world scenarios, but essentially iPhone 16 Pro should be capable of isolating voices and muting background noise, or distributing it onto separate channels, all from the built-in four microphones. I can’t wait to test out this feature in practice as it sounds quite promising.

Additional Features – Photographic Styles

The iPhone 16 Pro introduces next-generation Photographic Styles, allowing for localized adjustments to color, highlights, and shadows in real-time. While primarily a still photography feature, this could potentially be applied to video frames as well in the future.

Apple is also going to be implementing new AI-driven features, including the ability to use Siri for in-app photo and video editing tasks. The practical utility of these features in a professional workflow is yet to be determined. Unfortunately, Apple Intelligence features will not make it to the EU soon it seems, so many users will have to wait for them quite a while longer.

New “Camera Control” button

Apple’s latest iPhone 16 lineup introduces a game-changing feature for mobile photographers and videographers: the Camera Control button. Positioned strategically on the device’s right side, just below the power button, this new addition promises to enhance how users interact with their iPhone’s camera.

The Camera Control button is a versatile tool designed to enhance the shooting experience in both portrait and landscape orientations. Its sophisticated design incorporates both force and touch sensors, enabling a wide range of gestures and functions.

With a single click, users can launch the Camera app or a third-party alternative. Once the camera is active, the captures a photo, while a click-and-hold gesture initiates video recording. A light press opens up essential controls like zoom, with the added benefit of locking focus and exposure—a feature set to debut this fall.

The button’s capabilities extend further, allowing users to access a camera preview menu, swap between adjustment options, and fine-tune parameters such as zoom, exposure, and depth of field. This deep software integration means photographers can seamlessly switch between various control functions without navigating through the Camera app’s interface.

Third-party developers haven’t been left out of the equation, they can access the functionality of the Camera Control button too.

Looking ahead, Apple plans to integrate the Camera Control button with an advanced visual intelligence feature. This will transform the iPhone into a powerful tool for real-world information gathering, from identifying plants to adding event dates to your calendar with a simple gesture.

The hardware itself is a testament to Apple’s attention to detail. Featuring a sapphire crystal cover with a smooth texture and stainless steel trim, the button is slightly recessed into the iPhone’s frame. Its force sensor provides haptic feedback, mimicking the satisfying click of a DSLR camera shutter.

For those concerned about accidental presses or seeking a personalized experience, Apple has included options to adjust the button’s double-press speed and sensitivity.

Real-World Application – The Weeknd’s “Dancing in the Flames” music video shot on iPhone 16 Pro

To showcase these capabilities, Apple commissioned a music video for The Weeknd’s “Dancing in the Flames,” shot entirely on the iPhone 16 Pro. Directed by Anton Tammi with cinematography by Erik Henrikkson, this project could provide insights into the device’s performance in a controlled production environment.

I was very impressed with how iPhone 16 was able to pick up the strong highlights, the deep blacks, because we were shooting with very bright HDMI backlights hitting the rain and that was something I was worried about. ‘How will the iPhone pick these lights up, how will the contrast be managed, how will this look on the Weeknd’s face?’ And when I saw the results, I was blown away to be honest.

Director of Photography, Eric Hendrikkson

Conclusion

While the iPhone 16 Pro’s video capabilities are extensive for a smartphone, their practical application in professional filmmaking contexts remains to be seen. Our hands-on testing as soon as we get access to iPhone 16 Pro will be crucial in determining the device’s place in the broader landscape of filmmaking equipment. We plan on testing the 4K120 feature as well as the Audio Mix capabilities of the new devices.

What do you think about the video and photo capabilities of Apple’s new iPhones? Will you be upgrading? Let us know in the comments below.