Exploring the Astonishing AI-Powered Features of Google’s Pixel 8 and Pixel 8 Pro

Exploring the Astonishing AI-Powered Features of Google’s Pixel 8 and Pixel 8 Pro

In all my years of reviewing personal technology gadgets, I can count the number of times my jaw has dropped when learning about a new product. It’s good to be a skeptical journalist! But I failed to maintain that detachment when Google demoed a few imaging tricks on its new Pixel 8 and Pixel 8 Pro smartphones.

Taken in a vacuum, these features are things anyone with knowledge of Photoshop or video editing software can execute. But the new Pixel phones make them accessible to everyone, which is exciting, and frankly a little scary. Let’s go through ’em.

Magic Editor: Transforming Your Photos with Ease

Google teased this feature during its developer conference in May. It’s the natural evolution of Magic Eraser, which Google debuted a few years ago. The latter lets you erase unwanted objects in your photo, like a fire hydrant or a person in the background. Magic Editor can warp the whole photo to a new level.

In a demo, Google showed a picture of a girl running on a beach. With Magic Editor in the Google Photos app, a spokesperson pressed on the subject and the software accurately made a cutout. They were then able to move the subject anywhere in the scene, and the software filled in the space left behind with what it thought should be there. These were photos picked by Google, of course, but Magic Editor filled them in with great accuracy.

Magic Editor also enabled the option to change the scene’s lighting. If you take a photo at noon with harsh lighting, you can easily change it to golden hour to get those wonderfully warm evening tones—and maybe even throw in a sunset!

In another photo, a kid about to shoot a basketball from the ground. The spokesperson grabbed the subject in the photo, dragged him up into the air to make it look like he was about to dunk, and then casually said, “You can move their shadow too!”

Last year, I spoke with Ramesh Raskar, an associate professor at MIT Media Lab, about computational photography and digital photo alteration. His words now sound prescient. Companies are making an assumption that “most consumers would like to just take a photo, click a button, and get something they really would like to see, whether it matches the reality or not,” Raskar said. Say you reach Paris, and the Eiffel Tower is in a haze. “What you would like is to take a photo with your family with the Eiffel Tower in the back as if it’s a bright sunny day, right? If somebody can paste a bright, sunny photo of the Eiffel Tower behind your family, you’ll be pretty happy about it.”

This is now easier than ever with Magic Editor. There’s also a chance you’ll come across more nefarious, distorted images that might subtly massage the truth of a scene, not unlike the AI-generated viral images of Donald Trump that circulated over the summer. There’s some hope for truth seekers, as Google says the metadata will note whether Magic Editor was employed. It’s easy to strip metadata from images though, so it’s unclear how effective this will be.

We’ve all taken group photos where someone is looking away or has their eyes closed. Best Take is going to let parents of active kids breathe a sigh of relief (while perhaps also inducing mild panic).

When you capture a photo on most smartphones, they’re actually snapping multiple images at different exposures, which is how you can get well-exposed photos in various kinds of lighting. Google’s solution to fix someone’s closed eyes is to snag another frame from what it has captured and replace the person’s face with one where their eyes are open.

This is not unlike a feature Google introduced years ago called Top Shot, which suggests a potentially better frame from the series of photos captured when you tap the shutter button. However, Best Take can pull a frame from a series of up to six photos taken within seconds of each other—handy if whoever took the photo snapped multiple images in a row.

I watched as the spokesperson selected a person’s face and cycled through other versions of the face from recent images and other frames. Just choose the face you want (a weird sentence to write) to complete your perfect group photo. Google assured me it is not generating any facial expressions but is instead using an on-device face recognition algorithm (Google Photos can already detect familiar faces) to match images up.

Audio Magic Eraser: Silencing Unwanted Sounds

Magic Eraser removes stuff you don’t want to see in your photos. Now, with the Pixel 8 series, it can also eliminate sounds you don’t want to hear.

In one of my demos, I saw a video of someone playing a cello at a park. In the background? A siren going off in the distance (classic New York City). With Audio Magic Eraser, you can edit the clip and split the sounds up to completely remove the frequencies of the siren. The result is a video with just the sounds of a cello. It was pretty remarkable. This also means you can cut the sound of the cello and just play the siren, so you do you.

Google says the system uses machine learning to identify up to five types of common sounds, like “sirens,” “animals,” and “crowds.” It’s not going to work perfectly every time—I watched a demo of a man humming while at the beach, and when we tried to cancel the sounds of the ocean, I could still hear them cropping up here and there.

Video Boost: Elevating Your Low-Light Videos

This feature is a little less creepy, and more just plain impressive. Video Boost is exclusive to the Pixel 8 Pro, and you can toggle it on when you’re shooting video clips in low light or if there’s going to be a lot of action.

A copy of your video, which can be up to 4K at 30 frames per second, is then sent over to Google’s Cloud for processing. This processing can dramatically improve stabilization, upgrade clarity, and reduce noise, and the improved clip is then sent back to your device. Depending on the video length, this could take minutes or you might have to wait overnight. Still, the results were startling when I was shown a comparison clip alongside an iPhone 14 Pro. The Pixel 8 Pro’s video in similar low light was dramatically clearer, brighter, more colorful, and better stabilized. It’ll be exciting to see how this works, but it won’t be available at launch.

Again, none of the aforementioned features are things that you can’t currently do with other tools, but the ability to democratize them and make them accessible for the cost of a smartphone—without requiring any technical know-how—made me stare.

Google launched the Pixel 8 series on October 4. The company relied on showing Google’s AI prowess as a core selling point. Google’s launch comes weeks after Apple launched its new iPhone 15 series of devices. That’s why we wanted to compare the specifications of these new devices from Apple and Google.

Pixel 8 vs. iPhone 15

Display:
Pixel 8: 6.2-inch OLED display; 1080 × 2400 pixels resolution; 428 pixels per inch
iPhone 15: 6.1-inch OLED display; 1179 × 2556 pixels resolution; 460 pixels per inch

Processor:
Pixel 8: Google Tensor G3
iPhone 15: A16 bionic

RAM:
Pixel 8: 8GB
iPhone 15: 6GB

Battery:
Pixel 8: 4,575mAh
iPhone 15: 3,349mAh

Rear Camera:
Pixel 8: 50-megapixel main camera with ƒ/1.7 aperture; 12-megapixel ultrawide camera with ƒ/2.2 aperture (126° field of view)
iPhone 15: 48-megapixel main camera with ƒ/1.6 aperture; 12-megapixel ultrawide camera with ƒ/2.4 aperture (120° field of view)

Front Camera:
Pixel 8: 10.5-megapixel main camera with ƒ/2.2 aperture
iPhone 15: 12-megapixel main camera with ƒ/1.9 aperture

Main Port:
Pixel 8: USB-C connector with USB 3.2
iPhone 15: USB-C connector with USB 2.0

Pixel 8 Pro vs. iPhone 15 Pro Max

Display:
Pixel 8 Pro: 6.7-inch OLED display; 1344 × 2992 pixels resolution; 489 pixels per inch
iPhone 15 Pro Max: 6.7-inch OLED display; 1290 × 2796 pixels resolution; 460 pixels per inch

Processor:
Pixel 8 Pro: Google Tensor G3
iPhone 15 Pro Max: A17 Pro

RAM:
Pixel 8 Pro: 12GB
iPhone 15 Pro Max: 8GB

Battery:
Pixel 8 Pro: 5,050mAh
iPhone 15 Pro Max: 4,441mAh

Storage:
Pixel 8 Pro: 128GB, 256GB, 512GB, and 1TB UFS 3.1 storage
iPhone 15 Pro Max: 256GB, 512GB, and 1TB NVMe storage

Rear Camera:
Pixel 8 Pro: 50-megapixel main camera with ƒ/1.7 aperture; 12-megapixel ultrawide camera with ƒ/2.2 aperture (126° field of view); 48-megapixel telephoto camera with ƒ/2.8 aperture and 5× optical zoom
iPhone 15 Pro Max: a 48-megapixel main camera with ƒ/1.6 aperture; 12-megapixel ultrawide camera with ƒ/2.4 aperture (120° field of view); 12-megapixel periscope telephoto camera with ƒ/2.8 aperture and 5× optical zoom

Front Camera:
Pixel 8 Pro: 10.5-megapixel main camera with ƒ/2.2 aperture
iPhone 15 Pro Max: a 12-megapixel main camera with ƒ/1.9 aperture

Main Port:
Pixel 8 Pro: USB-C connector with USB 3.2
iPhone 15 Pro Max: USB-C connector with USB 3.1

While specifications are an important part of the picture, it still depends on users’ preference of Android versus iOS. Google committed to seven years of software updates for Pixel 8 series phones in order to compete with Apple’s updates. Google is also relying heavily on computational photography and AI trickery for photos as compared to Apple.