Halide shows the iPhone SE uses machine learning to shoot portrait photos

Apple takes a huge step in machine learning with the iPhone SE camera.

What you need to know

• Halide has gone in-depth on the new iPhone SE camera.
• The company details how Portrait Mode is possible with machine learning.
• It also compares photos between the iPhone SE and iPhone 11 Pro.

Halide, the company behind the popular camera app for iPhone, has gone in-depth in its tests with the new iPhone SE and how its camera stacks up against the iPhone 11 and iPhone 11 Pro.

In a blog post posted to Medium, the company has gone deep into how the new iPhone SE accomplishes its Portrait Mode photographs with software.

"This iPhone goes where no iPhone has gone before with "Single Image Monocular Depth Estimation." In English, this is the first iPhone that can generate a portrait effect using nothing but a single, 2D image."

While some may point out that the iPhone XR can also shoot in Portrait Mode with a single camera, Halide notes that the XR's sensor had focus pixels that enabled this feature through hardware. The iPhone SE, in comparison, is generating a portrait photo entirely through machine learning.

"While the iPhone XR has a single camera, it still obtained depth information through hardware. It tapped into the sensor's focus pixels, which you can think of as tiny pairs of 'eyes' designed to help with focus. The XR uses the very slight differences seen out of each eye to generate a very rough depth map ... The new iPhone SE can't use focus pixels, because its older sensor doesn't have enough coverage. Instead, it generates depth entirely through machine learning."

Currently, Apple is saying that its Portrait Mode on the iPhone SE only works with people. Halide chalks this up to Apple's strategy to "under-promise and over-deliver."

"As long as the subject in the foreground in sharp and in focus, most people will never know you're playing fast and loose with the background blur. So back to the question, "Why does Apple limit this to people?" Apple tends to under-promise and over-deliver. There's nothing stopping them from letting you take depth photos of everything, but they'd rather set the expectation, "Portrait Mode is only for people," than disappoint users with a depth effect that stumbles from time to time."

The exciting thing about this is that, as Apple's machine learning improves, Portrait Mode could become available for more and more subjects for a single camera. If you want to see all of the comparisons between Portrait Mode on the iPhone SE and the iPhone 11 Pro, check out Halide's blog post.

from iMore - The #1 iPhone, iPad, and iPod touch blog https://ift.tt/3aLITu6
via IFTTT