FORUMS

XDA Picks: Best Apps of the Week (June 27 – July 4)

Apps are at the front and center of any smartphone experience, and with over a … more

HTC One M9 Developer Edition Android 5.1 OTA

The Developer Edition of the HTC One M9 is receiving an over-the-air update to Android 5.1. … more

Index Project For XDA Device Subforums

Another ambitious project from the collaborative efforts of Recognized Contributors and Forum … more

The Atlas of XDA

A few weeks ago, we asked you “How Does Your Location Affect Your Life As A Power User?”. In the days that … more

Niefs Rom Comparison

183 posts
Thanks Meter: 0
 
By nief1313, Senior Member on 6th August 2010, 03:40 AM
Post Reply Subscribe to Thread Email Thread
additional details on test:
The first part of the table is to test the rom with the stock kernel.
The second part is to see how well it performs oc/uc.
This is supposed to show how well a ROM performs by itself and how well it works while oc/uced since a lot of us do use custom kernels.

On all of the tests, there should be no widgets or apps installed that didn't come preset with rom(excluding setCPU, fps2d,quadrant, and linpack). This should help eliminate variability of what apps different users have.

On all the test (performance or battery) if the rom has preset profiles they can use them as long as it doesn't require a reboot or any 3rd party apps. all these profile should be mentioned though in additional notes.

I said no profiles on the battery test, meaning no setCPU profile due to variability of profiles.

All ROMs will be using sense except CM6


Update 8/6: Updated the spread sheet and put it up and google docs Niefs Rom Comparison
There are now explanations of the tests and I am going to start testing today. Also, looking for testers.
I have posted my scores for part of Fresh.

update: 8/12
Most ROMs are completely filled out under features
Most performance test have been ran
Few battery tests

http://i996.photobucket.com/albums/a...f1313/test.jpg
Last edited by nief1313; 12th August 2010 at 06:02 PM.
 
 
6th August 2010, 03:53 AM |#2  
Member
Thanks Meter: 0
 
More
I think it will be a great idea... google docs might be a good way to let people collaborate, otherwise some kind of wiki.

Might be easier to organize by features such as "stripped of sprint apps" or "added X app" vs things like battery and performance which can sometimes be highly variable by device. Also, if you run performance I would maybe do a baseline of 998mhz (since we all know we can hit this clock) and then another showing oc'd (since some people can barely OC one tick).

I think there are enough people across all the roms that if the spreadsheet were public you'd gather a lot of data. I also have NAND backups of a few of the froyo roms so it wouldn't be hard to boot into recover, reflash a nand, run the benches, then reflash back to whatever i was on.

The battery ones will be a little tough #1 cuz i'm not sure how many people wanna completely lock up their phone for several hours waiting to see how long it lasts. #2, depending on how some people's batteries are calibrated and what they're running in the background, MMV.

Great idea tho!!! I think the ultimate key is thinking of a good way for everyone to easily submit their data. Anyone have suggestions?
6th August 2010, 03:55 AM |#3  
toastcfh's Avatar
Retired Forum Mod / Retired Senior Recognized Developer
Flag Lakeland, FL
Thanks Meter: 1,895
 
Donate to Me
More
Wink
u could add it to our wiki and update it like monthly. idk just an idea
6th August 2010, 04:01 AM |#4  
AlkamistStar's Avatar
Member
Flag Fort Lauderdale, FL
Thanks Meter: 0
 
More
Looking forward to it
This is a great idea, and i look forward to seeing this list grow. This could really help someone new to Android like me.
6th August 2010, 04:12 AM |#5  
OP Senior Member
Thanks Meter: 0
 
More
Quote:
Originally Posted by toastcfh

u could add it to our wiki and update it like monthly. idk just an idea

I think adding it to the wiki would be really nice. I will try to come up with a spread sheet that only a few can edit(I don't want one person to delete or mess up all the data). I rather have were people pm there scores and other data so i can add it in.

I will finish tweaking on how to tests and how the spreadsheet will look tomorrow.
6th August 2010, 02:00 PM |#6  
Member
Thanks Meter: 7
 
More
You should add 2 additional categories:

Does WiFi Tethering work with 3G speeds Y/N
if yes, which version of Wifi Tethering

Does WiFi Tethering work with 4G speeds Y/N
if yes, which version of Wifi Tethering
6th August 2010, 02:30 PM |#7  
OP Senior Member
Thanks Meter: 0
 
More
Quote:
Originally Posted by rek410

You should add 2 additional categories:

Does WiFi Tethering work with 3G speeds Y/N
if yes, which version of Wifi Tethering

Does WiFi Tethering work with 4G speeds Y/N
if yes, which version of Wifi Tethering

I have just added that to the spreadsheet, the versions will be written down in the additional notes. Also, i just posted the link to the spreadsheet in the OP. I will be looking for testers if anyone is interested to help.
6th August 2010, 03:46 PM |#8  
Senior Member
New York City
Thanks Meter: 3
 
More
nief, im running EViO 2 V1.0.2

ill post results for you later.
6th August 2010, 04:10 PM |#9  
OP Senior Member
Thanks Meter: 0
 
More
Quote:
Originally Posted by nenn

nief, im running EViO 2 V1.0.2

ill post results for you later.


Sweet thanks for the help.
6th August 2010, 04:16 PM |#10  
OgremustCrush's Avatar
Senior Member
Thanks Meter: 55
 
More
Which version of CM6 were you going to test? RC1 is getting pretty old, a lot of us are using nightlys. RC2 should be out soon though.
Post Reply Subscribe to Thread
Previous Thread Next Thread
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes