In another example of how the user experience should be on the forefront of importance in terms of buying a phone and that specs are a thing of the past; it has come to light that Samsung is not the only one to pad their britches in terms of Benchmark scores. For those that don’t know, Samsung was again, caught boosting benchmarks of their latest flagship device the Galaxy Note 3, much like that of the Galaxy S 4. There’s been back and forth to the relevance of such scores as all companies on one level or another do this. For those that want to put their money where their mouths are in such an argument can now do so with evidence to back it up. The folks at AnandTech put together a report showcasing all the OEMs that do and don’t do this.
According to the report, the only devices to not partake in such shenanigans included the Nexus 4, Nexus 7, NVIDIA Shield, and the current generation of Motorola devices including the Moto X. Apples devices didn’t participate as well. For the Nexus devices, They don’t include that optimization in the software. However, even as such the Google Play Edition devices sported the optimization.
We’ve come to a point where these benchmarks are silly (were they ever anything but) and real world usage will vary. The important thing to take away from all of this is that while benchmarks can show just how well a device can perform under optimal conditions, they should be taken with a large grain of salt. You can hit the source link below to read the full report but if I can leave you with one snippet that you should take away, it’s this:
The hilarious part of all of this is we’re still talking about small gains in performance. The impact on our CPU tests is 0 – 5%, and somewhere south of 10% on our GPU benchmarks as far as we can tell. I can’t stress enough that it would be far less painful for the OEMs to just stop this nonsense and instead demand better performance/power efficiency from their silicon vendors.
source: AnandTech
Come comment on this article: Other Companies Guilty of Boosting Benchmark Scores, Adds to How Seriously Benchmarks Shouldn’t be Taken Seriously
Powered by WPeMatico
