8 Comments

Summary:

I’ve seen the videos online of iOS 4.2 running smoothly on an iPhone 3G, but we did not get iOS 4.2 yesterday, we got iOS 4.2.1. I ran the update through its paces on my 3G to see if performance did indeed improve.

ios-benchamrks-42

I’ve seen the videos online of iOS 4.2 running smoothly on an iPhone 3G. Most of these reviews have proclaimed that iOS 4.2 is faster than iOS 4.1.  The following benchmarking results challenge this perception. I ran the update through its paces on my 3G, and this is what I found.

iOS 4.2.1 Update Tested

To test how iOS 4.2 affected performance, I took an iPhone 3G and ran it through the same series of performance tests I did when iOS 4.1 was released. Just like last time, I used GeekBench 2 ($1.99), Gauge Mathematical Tool ($1.99), BenchTest (99 cents), SunSpider (free) and V8 (free) to test the performance of each OS version on the 3G.

Also like last time, the 3G I was testing was still running with a lot of features disabled, and was being used more as an iPod touch than as an iPhone. I am reusing the same data collected last time for comparison. The following results are only a subset of the data collected, and focus on the data points that changed the most from version to version:

Results for iPhone 3G: The 4.2.1 Update

While some things seem to have improved slightly, like JavaScript and drawing new content when you switch views in an app, other tests have dropped off considerably. Memory performance as measured by GeekBench, as well as the executions of Gague’s Prime Number test are especially bad. These would affect apps that are doing much more than just displaying or editing a simple screen, like an RSS reader, for instance.  It would have a greater impact on apps performing more advanced computational functions, such as Documents to Go.

Just informally trying out several core apps like Apple’s Notes, Safari, Calendar and Contacts revealed more than the benchmarking tests indicate, however. Scrolling speed and data entry appear to be much improved. It seemed as though my performance tests were contradicting my real world experience.

One More iPhone 4 Test: The 4.2.1 Update

Testing on the iPhone 4 was the best way to find out if the performance degradation I was seeing on the iPhone 3G in the tests was really something to worry about. I reused the same benchmarking data collected in earlier tests for comparison. I was looking for the same degradation in performance in the same areas.


Since both the GeekBench Stdlib Allocate test as well as the Gague Prime Number test degrade on the iPhone 4 as they did on the iPhone 3G, I had to conclude that it was an issue with how the test was seeing changes made to the iOS firmware in version 4.2.1, and not necessarily a reflection of actual device performance.

Conclusions

While data entry, scrolling, pinching and zooming have improved slightly, the 3G is still not up to par with its newer siblings. Where we see the most gains on both the iPhone 3G and the iPhone 4 is in the JavaScript results.  Whatever the Webkit/Safari team is doing, it is having a positive effect with each release.

Bottom line: If you’re still using iOS 3.1.3 and use sophisticated apps that are heavily computational, then it’s probably best to avoid 4.2 (that’s easier if the apps you’re using don’t require 4.0 or higher). If you’re content with the apps Apple provides and mobile Safari, you should be fine. If you need the more demanding apps, and those apps need iOS 4.0 or higher, it might be time to consider that hardware upgrade.

Online Benchmark Results

Related content from GigaOM Pro (sub req’d):

  1. Fragmentation!

    Share
  2. I needed this type of article to let me know if I should jump from 3.1 to 4.2. My conclusion….I’m still scared to make that jump with my 3G!!! I also hate the fact I can’t restore my phone without downloading and installing the latest software. It should let me restore using the iOS version I currently have. They can prompt me if I want to upgrade but that should be all. Keeping iOS 3.1 alive!!!

    Share
    1. you can restore to any ios just download whichever you want then when you click restore hold down shift and select the ios you just downloaded and it will start the restore but you will need “tinyumberella” to kick the device out of recovery because at the last minute itunes will say it cant be done but it has already been done. if in doubt just google it and youll find a more indepth explanation

      Share
  3. You should upgrade in any case. Else you would live with lots and lots of security vulnerabilites on you phone. Upgrade now!

    Share
  4. Thanks for this excellent article. It’s this kind of precise analysis that I’ve been looking for.

    Share
  5. I have kept my iPhone 3G on 3.1.3 all along, and have been reasonably happy with it. However, I have been running into issues with apps requiring 4.0 so, with this new release, I made the jump to 4.2.1. So far the 3G has worked great. I too noticed the improved scrolling and display rendering, but everything else seems about the same. Nothing seems to have slowed or degraded. So, yes, I would recommend going to 4.2.1 now. The iPhone 3G is never going to be up to par with newer phones…it would be impossible no matter how good the IOS is. But 4.2.1 works very good on the older phones.

    Share
  6. conclusion….I’m still scared to make that jump with my 3G!!! I also hate the fact I can’t restore my phone without downloading and installing the latest software. It should let me restore using the iOS version I currently have. They can prompt me if I want to upgrade but that should be all. Keeping iOS 3.1 alive!!!

    Share
  7. DON’T DO IT! I risked upgrading to 4 for the second time after reading articles like this. I am back to frozen maps, quitting or sluggish apps and overall uselessness. I am running a 3G on 4.2.1 and it has ruined my phone, again.

    Share

Comments have been disabled for this post