FORUMS
Remove All Ads from XDA

G2x Benchmark Comparison

190 posts
Thanks Meter: 43
 
By brentil, Senior Member on 5th May 2011, 09:33 PM
Post Reply Email Thread
This thread is meant to be a comparison of changes over time for the G2x and not really a 'me too' benchmarks thread. The idea is to see unequivocally how various changes or versions impact our hardware over time. Benchmarking is something I enjoy and take very seriously. At this time I do not plan to run any custom ROMs and I will be holding off on OC/UV kernels until they have matured.

Feel free to suggest additional tests but please be realistic in what you're asking for.

Completed Tests
  • G2x 2.2 Stock
  • G2x 2.2 Rooted + Frozen Apps
  • G2x 2.3 Stock + Frozen Apps
  • G2x 2.3 Rooted
  • G2x 2.3 Stock + faux123 SV Kernel
  • G2x 2.3 Stock + faux123 OC Kernel @ 1.1
  • G2x 2.3 Stock + faux123 OC Kernel @ 1.4
  • G2x 2.3 Stock + faux123 OC Kernel @ 0.5
  • G2x ROM Benchmarks
  • G2x CM 7.1 RC vs Nightly 124 (2.3.5) vs Nightly 154 (2.3.7) Benchmarks

Planned Tests
  • ???

Testing Methedology
  • All tests are run on freshly booted phones
  • Airplane mode is enabled for tests not involving the internet
  • First runs are ignored for caching purposes
  • Each test is run 10 times and averaged
  • Erroneous data points are ignored (values that +/- the norm of other tests excessively)

Revisions
  • 2011.05.05 - Initial Release: G2x Stock vs G2x Rooted + Frozen Apps
  • 2011.07.26 - Second Release: G2x 2.2 Stock vs G2x 2.2 Rooted vs G2x 2.3 Stock
  • 2011.08.30 - G2x 2.3 Rooted vs Faux123 Kernels
  • 2011.08.30 - G2x 2.3 Faux123 Kernels @ 500 MHz vs G1 @ 614 MHz
  • 2011.09.07 - G2x ROM benchmarks
Attached Thumbnails
Click image for larger version

Name:	G2x_20110505.jpg
Views:	916
Size:	24.6 KB
ID:	587720   Click image for larger version

Name:	G2x_20110726.jpg
Views:	409
Size:	26.5 KB
ID:	666542   Click image for larger version

Name:	G2x_20110829.jpg
Views:	405
Size:	38.3 KB
ID:	705015   Click image for larger version

Name:	G2x_vs_G1_20110830.jpg
Views:	286
Size:	18.3 KB
ID:	705039   Click image for larger version

Name:	G2x_ROMs_20110907.jpg
Views:	245
Size:	29.6 KB
ID:	712946   Click image for larger version

Name:	G2x_CM_20110930.jpg
Views:	229
Size:	23.1 KB
ID:	736299  
The Following 2 Users Say Thank You to brentil For This Useful Post: [ View ] Gift brentil Ad-Free
 
 
5th May 2011, 09:33 PM |#2  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
2011.05.05 - G2x Stock vs G2x Rooted + Frozen Apps

Higher Resolution Images

This test demonstrates the rooting and then using an application to freeze apps that are running. I did not freeze MyAccount or Tegra Zone since I use them.
  • AppPack
  • logmein.rescue
  • logmein.rescuesecurity
  • EA Games
  • NFS Shift
  • Nova
  • Polaris Office
  • SmartShare
  • T-Mobile TV
  • TeleNav
  • Video Chat (qik)
  • Wi-Fi Calling
  • Zinio Reader

As can been seen from the attached graph the there was a noticeable bump in performance in all tests performed on the phone. SmartBench 2011 showed a larger gap than Quadrant because a couple of its tests are SMP aware and probably benefited more from the extra overhead on the two cores. The gain of ~250 in Quadrant for comparison is the value a stock G1/MT3G gets by itself in Quadrant. SunSpider performs extensive small javascript tests that I did not expect to see much gain from since it is more implementation bound than CPU bound where SmartBench however performs much more CPU intensive visual browser tests.


2011.07.26 - G2x 2.2 Stock vs G2x 2.2 Rooted vs G2x 2.3 Stock

Higher Resolution Images

I've updated my G2x via the LG update software to the GB 2.3 that was released for it. I did not unroot/unfreeze prior so I lost root but my frozen apps stayed frozen post update. As can be seen from the graph the Gingerbread tests show it performing within 2% of the results of the previous FroYo 2.2 rooted phone. I will not be able to perform a true stock test until I re-root the phone and unfreeze applications. The SunSpider test shows a decent 5% gain in speed which is not unexpected since browser performance was a touted feature of 2.3 on phones.

The lack of overall performance gain though was expected for this update before I ran the tests.
  • FroYo was the performance release version of the 2.x series of versions where 2.3 was a feature release. The addition of new features will typically garner a drop in overall performance unless additional time is spent focusing solely on performance increases. Google has already stated that the next phone oriented performance release will be Ice Cream Sandwich (4.0?) which will merge in the multi-core enhancements of the Honeycomb 3.x series.
  • This release of 2.3 is still running the 2.6.32.9 kernel version # as the previous 2.2 version was. This DOES NOT mean it is the same kernel, but it does indicate a lack of major changes, just primarily bug fixes and tweaks were done. The kernel controls task switching and various other base level processes, without a significant change at this level there will not be significant changes at the upper levels.



2011.08.30 - G2x 2.3 Rooted vs Faux123 Kernels

Higher Resolution Image

After running my updated 2.2 Rooted + Frozen to 2.3 Unrooted + Frozen I felt there was something wrong with it as some things felt slightly off. My belief is the freezing process removes the permissions from an application required to read/write/execute it which in turn may have prevented specific items from being updated during the LG Updater process. I decided to do the GB root process and flashed the stock rooted GB file onto my phone which being a ROM flash and not an updater over wrote the frozen applications. Afterwards with everything running the phone just behaved more as I expected than the previously frozen version. Benchmarks attached show this as everything increased (except for SunSpider).

A note on SunSpider I was reporting results wrong previously as I forgot lower scores in SunSpider mean better results. Which in terms of the 5% variance is still not much of a change.

Now being rooted again I decided to start working with kernels to see how they changed things.
  • Faux123 SV (Stock Voltage & Frequencies) - This kernel showed higher values in some tests but lower in others. The main disadvantage is the memory compression in my opinion as it actually sacrifices bandwidth for capacity. The thing is though even with our ~380mb of RAM it's still more than enough for daily use. If you use the System Stats Live Wallpaper with memory listed you'll see that even with the most taxing applications this phone never reaches capacity. The decrease in bandwidth is noticeable with larger applications like games as they take longer to load and to switch between large maps and other data sets.
  • Faux123 OC/UV @ 1.1 - The slight bump in frquency provides the extra benefit to push the memory bandwidth past the hurdle created by compcache. This kernel provides an all around (except in 3D applications) performance increase making it very worth while even at this slight MHz bump.
  • Faux123 OC/UV @ 1.4 - Everything else before this was in single digit % of increase. The bump to 1.4 GHz on both cores provides significant increases as the graph shows. If your phone can run stable at these speeds then I say go for it. For me 1.4 GHz was as high as I could go and stay stable, 1.55 GHz would crash my phone on boot.



2011.08.30 - G2x 2.3 Faux123 Kernels @ 500 MHz vs G1 @ 614 MHz

Having been an Android user from the start with a T-Mobile G1 & MT3G I still actively use that phone for testing and playing around with. When I actively used it we were always trying to find various tricks just to get smidgens more performance from it. So I decided to underclock the G2x down to 500 MHz and overclocked the G1 to 614 MHz running CS-DOS (GB 2.3.4) with everything tweaked for the fun of it.

This comparison shows the difference in terms of an ARMv6 versus an ARMv7 Cortex9 architecture and is just a fun informative bit. While being 100 MHz slower the G2x still was able to outperform the tweaked G1 by the following.
  • Quadrant - 72% faster
  • SmartBench - 79% faster
  • BrowserMark - 27% faster
  • SunSpider - 61% faster



2011.09.07 - G2x ROM benchmarks

High Res Image

I've completed my various ROM comparison testing and below are my numerical findings. I averaged the overall results and as listed in the order below are the highest to lowest scoring ROMs in terms of performance. In terms of numerical, graphical, & I/O performance they're all very close to each other. However it becomes very clear that either the stock ROM's web browser has been modified or the Android 2.3.4/2.3.5 web browser has had some significant performance optimization done to it as BrowserMark & SunSpider both return values nearly twice as fast as the 2.3.3 based versions. I believe that CompCache settings on the Faux123 kernel used in the Faux123 ROM result in its lower CF-Bench scores as it impacts memory bandwidth. With Miui it has a different/modified web browser in place and it shows as it has the worst of the browser benchmark scores.
  1. CM7.1-RC1
  2. CM7 Nightly 124 (2011.08.31)
  3. Eagles Blood 1.08
  4. Faux123 1.3.1
  5. G2x 2.3 Root
  6. Stock Tweaked 1.2.2
  7. Miui 1.8.26
  8. Weapon G2x 2.4 (0823)


2011.09.30 - G2x CM benchmarks

With the release of G2x Nightly 154 the codebase is now Gingerbread 2.3.7 so I decided to do a CM benchmark comparison to see how it handled compared to the others. Of not since the 14x series of nightlies EXT4 was also enabled by default.

As 2.3.6/2.3.7 were mainly Sprint Nexus S updates along with Google Wallet feature additions I am not surprised from the results to see the numbers are fairly close to each other. The 2.3.7 eeked out slightly ahead in CF-Bench but lagged behind in SunSpider by about 500 milliseconds making it's score larger (ie slower) than 2.3.5 however those values are still much better than 2.3.3 based browsers.
25th July 2011, 03:55 PM |#3  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
Performing benchmarks with the newly installed GB version on my G2x now, results to follow. I was rather surprised to see that all of the apps I had frozen while rooted are still frozen now post installation even though my phone is no longer rooted.
25th July 2011, 07:12 PM |#4  
Member
Thanks Meter: 14
 
More
my quadrant score
my quadrant score on a g2x .. :P
Attached Thumbnails
Click image for larger version

Name:	267594_10150323660336354_502451353_9487966_732850_n.jpg
Views:	627
Size:	46.2 KB
ID:	665472  
25th July 2011, 08:48 PM |#5  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
This isn't meant to be a showoff type thread but a scientific analysis. If you want to contribute I suggest following the guidelines I set out in the OP along with providing detailed information about your setup and settings.
The Following 2 Users Say Thank You to brentil For This Useful Post: [ View ] Gift brentil Ad-Free
26th July 2011, 04:07 PM |#6  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
I've updated the first 2 posts with the same information.

2011.07.26 - G2x 2.2 Stock vs G2x 2.2 Rooted vs G2x 2.3 Stock

Higher Resolution Images

I've updated my G2x via the LG update software to the GB 2.3 that was released for it. I did not unroot/unfreeze prior so I lost root but my frozen apps stayed frozen post update. As can be seen from the graph the Gingerbread tests show it performing within 2% of the results of the previous FroYo 2.2 rooted phone. I will not be able to perform a true stock test until I re-root the phone and unfreeze applications. The SunSpider test shows a decent 5% gain in speed which is not unexpected since browser performance was a touted feature of 2.3 on phones.

The lack of overall performance gain though was expected for this update before I ran the tests.
  • FroYo was the performance release version of the 2.x series of versions where 2.3 was a feature release. The addition of new features will typically garner a drop in overall performance unless additional time is spent focusing solely on performance increases. Google has already stated that the next phone oriented performance release will be Ice Cream Sandwich (4.0?) which will merge in the multi-core enhancements of the Honeycomb 3.x series.
  • This release of 2.3 is still running the 2.6.32.9 kernel version # as the previous 2.2 version was. This DOES NOT mean it is the same kernel, but it does indicate a lack of major changes, just primarily bug fixes and tweaks were done. The kernel controls task switching and various other base level processes, without a significant change at this level there will not be significant changes at the upper levels.
Attached Thumbnails
Click image for larger version

Name:	G2x_20110726.jpg
Views:	228
Size:	26.5 KB
ID:	666540  
The Following 2 Users Say Thank You to brentil For This Useful Post: [ View ] Gift brentil Ad-Free
30th August 2011, 06:36 PM |#7  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
I've updated the first 2 posts with the same information.

2011.08.30 - G2x 2.3 Rooted vs Faux123 Kernels

Higher Resolution Image

After running my updated 2.2 Rooted + Frozen to 2.3 Unrooted + Frozen I felt there was something wrong with it as some things felt slightly off. My belief is the freezing process removes the permissions from an application required to read/write/execute it which in turn may have prevented specific items from being updated during the LG Updater process. I decided to do the GB root process and flashed the stock rooted GB file onto my phone which being a ROM flash and not an updater over wrote the frozen applications. Afterwards with everything running the phone just behaved more as I expected than the previously frozen version. Benchmarks attached show this as everything increased (except for SunSpider).

A note on SunSpider I was reporting results wrong previously as I forgot lower scores in SunSpider mean better results. Which in terms of the 5% variance is still not much of a change.

Now being rooted again I decided to start working with kernels to see how they changed things.
  • Faux123 SV (Stock Voltage & Frequencies) - This kernel showed higher values in some tests but lower in others. The main disadvantage is the memory compression in my opinion as it actually sacrifices bandwidth for capacity. The thing is though even with our ~380mb of RAM it's still more than enough for daily use. If you use the System Stats Live Wallpaper with memory listed you'll see that even with the most taxing applications this phone never reaches capacity. The decrease in bandwidth is noticeable with larger applications like games as they take longer to load and to switch between large maps and other data sets.
  • Faux123 OC/UV @ 1.1 - The slight bump in frquency provides the extra benefit to push the memory bandwidth past the hurdle created by compcache. This kernel provides an all around (except in 3D applications) performance increase making it very worth while even at this slight MHz bump.
  • Faux123 OC/UV @ 1.4 - Everything else before this was in single digit % of increase. The bump to 1.4 GHz on both cores provides significant increases as the graph shows. If your phone can run stable at these speeds then I say go for it. For me 1.4 GHz was as high as I could go and stay stable, 1.55 GHz would crash my phone on boot.
Attached Thumbnails
Click image for larger version

Name:	G2x_20110829.jpg
Views:	194
Size:	38.3 KB
ID:	705020  
30th August 2011, 07:01 PM |#8  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
2011.08.30 - G2x 2.3 Faux123 Kernels @ 500 MHz vs G1 @ 614 MHz

High Res Image

Having been an Android user from the start with a T-Mobile G1 & MT3G I still actively use that phone for testing and playing around with. When I actively used it we were always trying to find various tricks just to get smidgens more performance from it. So I decided to underclock the G2x down to 500 MHz and overclocked the G1 to 614 MHz running CS-DOS (GB 2.3.4) with everything tweaked for the fun of it.

This comparison shows the difference in terms of an ARMv6 versus an ARMv7 Cortex9 architecture and is just a fun informative bit. While being 100 MHz slower the G2x still was able to outperform the tweaked G1 by the following.
  • Quadrant - 72% faster
  • SmartBench - 79% faster
  • BrowserMark - 27% faster
  • SunSpider - 61% faster
Attached Thumbnails
Click image for larger version

Name:	G2x_vs_G1_20110830.jpg
Views:	182
Size:	18.3 KB
ID:	705043  
30th August 2011, 10:07 PM |#9  
moshe22's Avatar
Senior Member
Thanks Meter: 198
 
More
I find this thread very interesting and informative. Thanks for this

Sent From My G2x EB 1.07
1st September 2011, 07:08 PM |#10  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
Thanks!

I've started performing ROM benchmarks now. This is my intended set of ROMs to evaluate using the same testing patterns. I chose ROMs that are actively being worked on and used.

  • CM7.1-RC1
  • CM7 Nightly 124 (2011.08.31)
  • Eagles Blood 1.08
  • Faux123 1.3.1
  • Miui 1.8.26
  • Stock Tweaked 1.2.2
  • Weapon G2x 2.4 (0823)
The Following User Says Thank You to brentil For This Useful Post: [ View ] Gift brentil Ad-Free
7th September 2011, 07:52 PM |#11  
brentil's Avatar
OP Senior Member
Thanks Meter: 43
 
More
2011.09.07 - G2x ROM benchmarks

High Res Image

I've completed my various ROM comparison testing and below are my numerical findings. I averaged the overall results and as listed in the order below are the highest to lowest scoring ROMs in terms of performance. In terms of numerical, graphical, & I/O performance they're all very close to each other. However it becomes very clear that either the stock ROM's web browser has been modified or the Android 2.3.4/2.3.5 web browser has had some significant performance optimization done to it as BrowserMark & SunSpider both return values nearly twice as fast as the 2.3.3 based versions. I believe that CompCache settings on the Faux123 kernel used in the Faux123 ROM result in its lower CF-Bench scores as it impacts memory bandwidth. With Miui it has a different/modified web browser in place and it shows as it has the worst of the browser benchmark scores.
  1. CM7.1-RC1
  2. CM7 Nightly 124 (2011.08.31)
  3. Eagles Blood 1.08
  4. Faux123 1.3.1
  5. G2x 2.3 Root
  6. Stock Tweaked 1.2.2
  7. Miui 1.8.26
  8. Weapon G2x 2.4 (0823)
Attached Thumbnails
Click image for larger version

Name:	G2x_ROMs_20110907.jpg
Views:	303
Size:	29.6 KB
ID:	712941  
The Following 2 Users Say Thank You to brentil For This Useful Post: [ View ] Gift brentil Ad-Free
Post Reply Subscribe to Thread

Tags
benchmarking, g2x

Guest Quick Reply (no urls or BBcode)
Message:
Previous Thread Next Thread
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes