The Great Equalizer Part 2: Surface Pro vs. Android Devices in 3DMarkby Anand Lal Shimpi on April 2, 2013 2:26 PM EST
While we're still waiting for Windows RT and iOS versions of the latest 3DMark, there is one cross-platform comparison we can make: Ivy Bridge/Clover Trail to the Android devices we just tested in 3DMark.
The same caveats exist under 3DMark that we mentioned in our GL/DXBenchmark coverage: not only is this a cross-OS comparison, but we're also looking across APIs as well (OpenGL ES 2.0 for Android vs. Direct3D FL 9_1 for Windows). There will be differences in driver maturity not to mention just how well optimized each OS is for the hardware its running on. There are literally decades of experience in optimizing x86 hardware for Windows, compared to the past few years of evolution on the Android side of the fence.
Absent from these charts is anything running on iOS. We're still waiting for a version of 3DMark for iOS unfortunately. If our previous results are any indication however, Qualcomm's Adreno 320 seems to be hot on the heels of the GPU performance of the 4th generation iPad:
In our GL/DXBenchmark comparison we noted Microsoft's Surface Pro (Intel HD 4000 graphics) managed to deliver 3x the performance of the 4th generation iPad. Will 3DMark agree?
All of these tests are run at the default 720p settings. The key comparisons to focus on are Surface Pro (Intel HD 4000), VivoTab Smart (Intel Clover Trail/SGX 545) and the HTC One (Snapdragon 600/Adreno 330). I've borrowed the test descriptions from this morning's article.
Graphics Test 1
Ice Storm Graphics test 1 stresses the hardware’s ability to process lots of vertices while keeping the pixel load relatively light. Hardware on this level may have dedicated capacity for separate vertex and pixel processing. Stressing both capacities individually reveals the hardware’s limitations in both aspects.
In an average frame, 530,000 vertices are processed leading to 180,000 triangles rasterized either to the shadow map or to the screen. At the same time, 4.7 million pixels are processed per frame.
Pixel load is kept low by excluding expensive post processing steps, and by not rendering particle effects.
In this mostly geometry bound test, Surface Pro does extremely well. As we saw in our GL/DXBenchmark comparison however, the ARM based Android platforms don't seem to deliver the most competitive triangle throughput.
Graphics Test 2
Graphics test 2 stresses the hardware’s ability to process lots of pixels. It tests the ability to read textures, do per pixel computations and write to render targets.
On average, 12.6 million pixels are processed per frame. The additional pixel processing compared to Graphics test 1 comes from including particles and post processing effects such as bloom, streaks and motion blur.
In each frame, an average 75,000 vertices are processed. This number is considerably lower than in Graphics test 1 because shadows are not drawn and the processed geometry has a lower number of polygons.
The more pixel shader bound test seems to agree with what we've seen already: Intel's HD 4000 appears to deliver around 3x the performance of the fastest ultra mobile GPUs, obviously at higher power consumption. In the PC space a 3x gap would seem huge, but taking power consumption into account it doesn't seem all that big of a gap here.
The purpose of the Physics test is to benchmark the hardware’s ability to do gameplay physics simulations on CPU. The GPU load is kept as low as possible to ensure that only the CPU’s capabilities are stressed.
The test has four simulated worlds. Each world has two soft bodies and two rigid bodies colliding with each other. One thread per available logical CPU core is used to run simulations. All physics are computed on the CPU with soft body vertex data updated to the GPU each frame. The background is drawn as a static image for the least possible GPU load.
The Physics test uses the Bullet Open Source Physics Library.
Surprisingly enough, the CPU bound physics test has Surface Pro delivering 2.3x the performance of the Snapdragon 600 based HTC One. Quad-core Cortex A15 based SoCs will likely eat into this gap considerably. What will be most interesting is to see how the ARM and x86 platforms converge when they are faced with similar power/thermal constraints.
What was particularly surprising to me is just how poorly Intel's Atom Z2560 (Clover Trail) does in this test. Granted the physics benchmark is very thread heavy, but the fact that four Cortex A9s can handily outperform two 32nm Atom cores is pretty impressive. Intel hopes to fix this with its first out-of-order Atom later this year, but that chip will also have to contend with Cortex A15 based competitors.
Ice Storm - Overall Score
The overall score seems to agree with what we learned from the GL/DXBenchmark comparison. Intel's HD 4000 delivers around 3x the graphics performance of the leading ultra mobile GPUs, while consuming far more power. Haswell will drive platform power down, but active power should still be appreciably higher than the ARM based competition. I've heard rumblings of sub-10W TDP (not SDP) Haswell parts, so we may see Intel move down the power curve a bit more aggressively than I've been expecting publicly. The move to 14nm, and particularly the shift to Skylake in 2015 will bring about true convergence between the Ultrabook and 10-inch tablet markets. Long term I wonder if the 10-inch tablet market won't go away completely, morphing into a hybird market (think Surface Pro-style devices) with 7 - 8 inch tablets taking over.
It's almost not worth it to talk about Clover Trail here. The platform is just bad when it comes to graphics performance. You'll notice I used ASUS' VivoTab Smart here and in the GL/DXBenchmark comparison instead of Acer's W510. That's not just because of preference. I couldn't get the W510 to reliably complete GL/DXBenchmark without its graphics driver crashing. It's very obvious to me that Intel didn't spend a lot of time focusing on 3D performance or driver stability with Clover Trail. It's disappointing that even in 2012/2013 there are parts of Intel that still don't take GPU performance seriously.
The next-generation 22nm Intel Atom SoC will integrate Intel's gen graphics core (same architecture as HD 4000, but with fewer EUs). The move to Intel's own graphics core should significantly modernize Atom performance. The real question is how power efficient it will be compared to the best from Imagination Tech and Qualcomm.
Post Your CommentPlease log in or sign up to comment.
View All Comments
WagonWheelsRX8 - Wednesday, April 3, 2013 - linkI second that! My phone has a Tegra 2 in it and I guesstimated it was about the equivalent of a GeForce FX 5200 (if that)...but I don't have a PC with a configuration that old to test it. Of course Tegra 2 is long in the tooth now but I think it'd be really awesome to be able to relate a current SoC with an equivalent oldschool PC, just as a frame of reference.
Chubbbs - Tuesday, April 2, 2013 - linkOut-of-order execution is not likely to help Atom with physics and other floating-point code. These workloads are all about memory bandwidth and the ability to simultaneously issue FP load/store and FP compute instructions.
Remember that Intel spent most of the 1990s trailing the floating-point performance of the PowerPC 604/G3/G4, even though these microarchitectures had much smaller reorder buffers than the P6-based Pentiums.
If Atom is to improve its floating-point, vector, and graphics performance, it needs a major overhaul of its load/store units, cache hierarchy, and memory controllers. There's just not a huge demand for better integer performance on mobile devices.
Phelerox - Tuesday, April 2, 2013 - linkThe Snapdragon 600 has an Adreno 320 GPU, right? So this is a typo: "HTC One (Snapdragon 600/Adreno 330)"
Great article, as always.
lmcd - Tuesday, April 2, 2013 - linkFor some more context:
"All of these tests are run at the default 720p settings. The key comparisons to focus on are Surface Pro (Intel HD 4000), VivoTab Smart (Intel Clover Trail/SGX 545) and the HTC One (Snapdragon 600/Adreno 330). I've borrowed the test descriptions from this morning's article."
Kidster3001 - Tuesday, April 2, 2013 - linkYou have the Atom part wrong for the VivoTab Smart. Z2760 is what's in it.
Z2760 is Clovertrail (no +) with SGX545.
Z2560 is Clovertrial+ with SGX544MP2
watersb - Tuesday, April 2, 2013 - linkThanks as always for a great article.
Suggestion for Anand: Please remind us in the first few paragraphs that the VivoTab is the one with Clover Trail -- my very small brain hasn't memorized all the product specs yet. :-)
WagonWheelsRX8 - Wednesday, April 3, 2013 - linkConcur...great article. Also haven't memorized which SoC is in which device, would be nice for the charts to note those next to the device name.
TiGr1982 - Tuesday, April 2, 2013 - linkAnand,
Your MSM8960 (Galaxy S3 AT&T) posted really weak scores in 3dmark. Mine (Motorola RAZR HD XT925, Canadian Rogers/Fido, stock Motorola Android 4.1.2, stock SoC frequency, unrooted and untouched) even with 1 GB RAM (in contrast to 2 GB in Galaxy S3) posted the following Ice Storm scores, which are way bigger:
Regular Ice Storm:
- Ice Storm score: 6293
- Graphics score: 6688
- Physics score: 5215
- Graphics test 1: 30.7 FPS
- Graphics test 2: 27.6 FPS
- Physics test: 16.6 FPS
Ice Storm Extreme:
- Ice Storm score: 3536
- Graphics score: 3220
- Physics score: 5386
- Graphics test 1: 18.1 FPS (18.1 FPS)
- Graphics test 2: 11.4 FPS (11.2 FPS)
- Physics test: 17.1 FPS (16.4 FPS)
Sony Xperia SX and Motorola Droid RAZR M, based on the same SoC with 1 GB of RAM (unlike North American Galaxy S3 with 2 GB RAM) score mostly like my XT925.
So, Galaxy S3 is severely underperforming for its SoC. Hence, it's better to look at other MSM8960-based devices (see above).
P.S. The "Post Your Comment" window in the new website design has ridiculously small vertical size. This window should be increased 4X vertically.
ChronoReverse - Tuesday, April 2, 2013 - linkIt looks like his GS3 is only activating one core when running the physics test which destroyed the overall score. The graphics score doesn't look too off.
yannigr - Wednesday, April 3, 2013 - linkHD4000 looks like a Titan here. Funny.