
The Google Pixel 7 and Google Pixel 7 Pro were released earlier this month, amid a wave of fanfare. Amongst a host of new software features, the duo featured the first public appearance of the Tensor G2 chip, Google's latest in-house design.
Before the phones were released, the Tensor G2 got a lot of heat from commentators online. Why? Benchmark tests, which seemed to leak a rather weedy performance upgrade had leaked online.
Weeks before any members of the general public would have a chance to get their hands on these devices, many had written them off altogether based on the score it achieved in an online test. It's fair to say it felt a little premature.
Now, Google's Senior Director of Product Management, Monika Gupta, has said that Google is "perfectly comfortable" not winning benchmark tests. On a podcast with 9to5Google, she said, "I think classical benchmarks served a purpose at some moment in time, but I think the industry has evolved since then. They may tell some story, but we don’t feel like they tell the complete story."
It's a statement that makes sense. Google's launch of the Pixel 7 range saw a host of AI-powered functionality. This kind of software isn't tested by a benchmark, but can improve the quality of the overall experience for users.
So, do we as consumers need to pay less attention to benchmarks? I think so, and here's why.
A good benchmark doesn't make a good phone
Benchmark testing is very specific. In essence, the software will give your device a handful of tasks and time how quickly it completes them. This gives it a score, for both multi-core and single-core performance. But it's hardly perfect.
Sign up to the T3 newsletter for smarter living straight to your inbox
Get all the latest news, reviews, deals and buying guides on gorgeous tech, home and active products from the T3 experts
Benchmarks are designed to test what the CPU can do, but it does so by testing the extreme limit for a short period of time. Real-world usage requires sustained performance at varying levels of power. No consumer is going to run their device at the absolute peak of it's processing capability for a few seconds at a time, so testing a device like that isn't very useful. It's like testing how good a marathon runner is by making them run a 100m sprint.
Because Gupta is right: the industry has evolved and raw CPU power is no longer the defining characteristic of the best phones. AI and Machine Learning mean that devices can be more efficient and adapt to make better use of the processing power they have.
Plus, most phone users are unlikely to be pushing modern CPU's to their breaking point. Perhaps if you're an avid mobile gamer, though one of the best gaming phones may be better if that's the case.
It's not entirely useless though. Benchmark testing is a great way of comparing raw CPU performance. That can be useful, particularly as more and more people buy tech products online without using them first.
But we need to reshape the narrative around what a benchmark means. Rather than treating it like the gold standard of whether or not a phone is worth your time, we need to treat it as one method of testing one aspect of a device.
Sam is an award-winning journalist with over six years of experience across print and digital media. As T3’s Senior Staff Writer, Sam covers everything from new phones and EVs to luxury watches and fragrances. Working across a range of different social media platforms alongside his written work, Sam is a familiar face for fans of T3. When he’s not reviewing snazzy products or hunting for stellar deals, Sam enjoys football, analog photography and writing music.
-
Struggling to nail push-ups? A fitness expert says this simple hack will make them stronger
A simple tweak to your arm position can make all the difference
By Bryony Firth-Bernard Published
-
Android Auto 14 beta arrives and it sets the groundwork for major changes
More details link Android Auto to significant car control changes
By Chris Hall Published
-
You can now try Android 16 for yourself, here's how
The latest beta from Android is now available on Pixel devices
By Chris Hall Published
-
Google Pixel 9a could come with a free perk worth a fifth of the phone itself
You just have to live in the right region
By Britta O'Boyle Published
-
Chromecast with Google TV just got the massive free update that's been promised for months
It may be discontinued, but there's still life in the streamer yet
By Rik Henderson Published
-
Your older Chromecast might be borked, but Google promises a fix
There's a problem with some Chromecasts, including Chromecast Audio – they can't currently Cast
By Carrie Marshall Published
-
Google Pixel 10 renders show the candy bar camera seems set to stay
It looks like there's not much change from the Pixel 9
By Britta O'Boyle Published
-
Google Pixel 9a hands-on video leaks – what it reveals about the forthcoming phone
If you’re going to leak a phone, this is the way to do it
By Chris Hall Published
-
Google could make smart glasses again to take on Apple Vision Pro
Google's going shopping for low-power eye-tracking technology
By Carrie Marshall Published
-
Your Chromebook will soon gain a neat trick borrowed from Pixel phones
The update will help preserve the health of a Chromebook
By Chris Hall Published