Comparing Performance of Multiple Apple Devices Before and After Spectre Security Update

Some guy said a dumb thing...
January 10, 2018

I spent some time this evening putting together some fun tables and graphs after seeing a post by Melvin Mughal on his blog that the iOS 11.2.2 update slows down devices by something like 40%. I didn’t believe it, so I fired up all the iDevices I own and benchmarked them before and after the Spectre-fixing update.

January 11 Update: I’ve added links to the Geekbench results at the end of the post for those needing verification of these numbers.

TL;DR: For my three devices, there was no difference in synthetic performance. This isn’t to say that real-world won’t be affected, but since those on the Internet were using synthetic benchmarks to prove their point, I opted to do the same to disprove.

Statistical Note: These measurements were taken using the latest-at-the-time for when the measurements were taken. The measurement of the iPhone X on iOS version 11.1 was taken on November 3, 2017 using Geekbench version 4.2.0. For all other measurements of all other pre-11.2.2 versions, they were taken with Geekbench version 4.2.1.

Summary

Based on the data I was able to collect, I was not able to reproduce the dramatic drop in performance that some are reporting. A couple reasons for this could be that Melvin’s test was performed using an iPhone 6 which may be subject to an elder battery and thus throttling brought about in iOS 11.2. This throttling is in place to prevent the hardware from pulling a higher voltage than the battery can offer. This is a natural cycle of evolution of batteries of this type.

Another possibility is simply that I did not have an iPhone 6 to test. it is possible that a well-performing iPhone 6 is subject to greater performance woes than my newer iPhone X and iPad Pro 10.5”, though that doesn’t explain the inconsequential difference in performance from my iPad Mini 2, a device that uses a much older chipset than an iPhone 6.

Single Core

DeviceDifference % After Updating from X to 11.2.2
iPhone X (11.1)0.21%
iPad Pro 10.5” (11.2.1)3.56%
iPad Mini 2 (11.1.2)1.20%

Multi Core

DeviceDifference % After Updating from X to 11.2.2
iPhone X (11.1)-0.27%
iPad Pro 10.5” (11.2.1)-0.39%
iPad Mini 2 (11.1.2)-0.64%

Compute

DeviceDifference % After Updating from X to 11.2.2
iPhone X (11.1)-2.88%
iPad Pro 10.5” (11.2.1)1.94%
iPad Mini 2 (11.1.2)-0.51%

Data Dump

iPhone X

Single Core

Benchmark11.111.2.2Difference %
Score422442330.21%
Crypto30793075-0.13%
Integer464246650.50%
Floating Point39573940-0.43%
Memory397239910.48%
AES30793075-0.13%
LZMA342634831.66%
JPEG41494144-0.12%
Canny432643600.79%
Lua47174702-0.32%
Dijkstra458847663.88%
SQLite426342690.14%
HTML5 Parse436943780.21%
HTML5 DOM50024996-0.12%
Histogram Equalization405640580.05%
PDF Rendering43494341-0.18%
LLVM90109000-0.11%
Camera508950990.20%
SGEMM256625720.23%
SFFT332933300.03%
N-Body Physics35053434-2.03%
Ray Tracing431243490.86%
Rigid Body Physics41694126-1.03%
HDR50475043-0.08%
Gaussian Blur466446700.13%
Speech Recognition404940931.09%
Face Detection46374499-2.98%
Memory Copy498550100.50%
Memory Latency389939090.26%
Memory Bandwidth322532480.71%

Multi Core

Benchmark11.111.2.2Difference %
Score1024210270-0.27%
Crypto77087650-0.75%
Integer13223133671.09%
Floating Point1032210193-1.25%
Memory405040700.49%
AES77087650-0.75%
LZMA1134010957-3.38%
JPEG13128134782.67%
Canny118991352313.65%
Lua12792132013.20%
Dijkstra1346112878-4.33%
SQLite1151411128-3.35%
HTML5 Parse1311012705-3.09%
HTML5 DOM12256123921.11%
Histogram Equalization11595117531.36%
PDF Rendering1161311582-0.27%
LLVM225462580714.46%
Camera14724154444.89%
SGEMM58765663-3.62%
SFFT933895031.77%
N-Body Physics97709560-2.15%
Ray Tracing1072510370-3.31%
Rigid Body Physics11873129318.91%
HDR1549714517-6.32%
Gaussian Blur10896110181.12%
Speech Recognition943394520.20%
Face Detection1223811397-6.87%
Memory Copy579858150.29%
Memory Latency35633560-0.08%
Memory Bandwidth321732591.31%

Compute

Benchmark11.111.2.2% Difference
Score1530614865-2.88%
Histogram Equalization1207511719-2.95%
SFFT275527590.15%
Gaussian Blur2548622871-10.26%
Face Detection103719841-5.11%
Sobel118619726-18.00%
RAW509425895515.73%
Depth of Field26303266541.33%
Particle Physics2156621437-0.60%

iPad Pro 10.5”

Single Core

Benchmark11.2.111.2.2Difference %
Score382439603.56%
Crypto240224984.00%
Integer403941743.34%
Floating Point342135503.77%
Memory429944613.77%
AES240224984.00%
LZMA3231362912.32%
JPEG356036743.20%
Canny369337130.54%
Lua415443053.64%
Dijkstra456547934.99%
SQLite367637512.04%
HTML5 Parse385839071.27%
HTML5 DOM452046583.05%
Histogram Equalization338934040.44%
PDF Rendering344135192.27%
LLVM762278943.57%
Camera411642473.18%
SGEMM232423983.18%
SFFT281628922.70%
N-Body Physics321133233.49%
Ray Tracing344736425.66%
Rigid Body Physics365438114.30%
HDR408841902.50%
Gaussian Blur378038983.12%
Speech Recognition3940435910.63%
Face Detection39873933-1.35%
Memory Copy536954792.05%
Memory Latency365936930.93%
Memory Bandwidth404743898.45%

Multi Core

Benchmark11.2.111.2.2Difference %
Score940894450.39%
Crypto718871900.03%
Integer11469114820.11%
Floating Point965896580.00%
Memory495151093.19%
AES718871900.03%
LZMA95219514-0.07%
JPEG10576105770.01%
Canny1052210519-0.03%
Lua12011120650.45%
Dijkstra1146111349-0.98%
SQLite9728100753.57%
HTML5 Parse11203112640.54%
HTML5 DOM1281012467-2.68%
Histogram Equalization979097980.08%
PDF Rendering96269619-0.07%
LLVM21986221880.92%
Camera1228112245-0.29%
SGEMM66676654-0.19%
SFFT836083720.14%
N-Body Physics954495500.06%
Ray Tracing9956100310.75%
Rigid Body Physics10993109970.04%
HDR1205511810-2.03%
Gaussian Blur1113011064-0.59%
Speech Recognition857285950.27%
Face Detection10925111031.63%
Memory Copy716974253.57%
Memory Latency369437441.35%
Memory Bandwidth458547984.65%

Compute

Benchmark11.2.111.2.2% Difference
Score3083230233-1.94%
Histogram Equalization2109320851-1.15%
SFFT484848850.76%
Gaussian Blur54249588098.41%
Face Detection1227211940-2.71%
Sobel3312629732-10.25%
RAW1672271701891.77%
Depth of Field7122868612-3.67%
Particle Physics3404128111-17.42%

iPad Mini 2

Single Core

Benchmark11.1.211.2.2Difference %
Score125512701.20%
Crypto66875312.72%
Integer130213060.31%
Floating Point117212012.47%
Memory141814230.35%
AES66875312.72%
LZMA1035128223.86%
JPEG149315040.74%
Canny131914167.35%
Lua12281222-0.49%
Dijkstra129513675.56%
SQLite10751051-2.23%
HTML5 Parse123512430.65%
HTML5 DOM1124900-19.93%
Histogram Equalization13261323-0.23%
PDF Rendering11401124-1.40%
LLVM20661947-5.76%
Camera158415860.13%
SGEMM7677670.00%
SFFT125012550.40%
N-Body Physics8898930.45%
Ray Tracing109111656.78%
Rigid Body Physics138813910.22%
HDR16851675-0.59%
Gaussian Blur131613190.23%
Speech Recognition118512071.86%
Face Detection1234140213.61%
Memory Copy137913830.29%
Memory Latency221522180.14%
Memory Bandwidth9359400.53%

Multi Core

Benchmark11.1.211.2.2Difference %
Score21842170-0.64%
Crypto14721471-0.07%
Integer24302374-2.30%
Floating Point226823081.76%
Memory16811679-0.12%
AES14721471-0.07%
LZMA233723510.60%
JPEG293529550.68%
Canny27322715-0.62%
Lua24562314-5.78%
Dijkstra253425340.00%
SQLite20841959-6.00%
HTML5 Parse24402400-1.64%
HTML5 DOM11211110-0.98%
Histogram Equalization25322454-3.08%
PDF Rendering21142043-3.36%
LLVM38553591-6.85%
Camera30993098-0.03%
SGEMM14751471-0.27%
SFFT246024690.37%
N-Body Physics17601754-0.34%
Ray Tracing222322852.79%
Rigid Body Physics275127620.40%
HDR325832650.21%
Gaussian Blur255325550.08%
Speech Recognition201320290.79%
Face Detection2436273212.15%
Memory Copy188418900.32%
Memory Latency22442242-0.09%
Memory Bandwidth11241119-0.44%

Compute

Benchmark11.1.211.2.2% Difference
Score587584-0.51%
Histogram Equalization325318-2.15%
SFFT35350.00%
Gaussian Blur3653660.27%
Face Detection647645-0.31%
Sobel414408-1.45%
RAW17091704-0.29%
Depth of Field21712170-0.05%
Particle Physics342134230.06%

Sources


filed under: Technology
more about: benchmarks / geekbench / iOS / spectre