[REF][15-05-2009: NEW ROMs]Some benchmarking...

[mondilv]

could you benchmark "NATALY". V.2.0.RC1 UC Ready please? ;)


Op op op...!
Don't hurry, please, it's not the FINAL release, just the test.:D
Even in RC2 will be many & big changes.
But it'll interesting for me too: mainboard of my device had changed.
The NAND looks bit slower, then previous. So I can't to compare the new rom correctly.
Need something, like coefficient.

[pietrucci]

Op op op...!
Don't hurry, please, it's not the FINAL release, just the test.:D
Even in RC2 will be many & big changes.
But it'll interesting for me too: mainboard of my device had changed.
The NAND looks bit slower, then previous. So I can't to compare the new rom correctly.
Need something, like coefficient.I don't know exactly what you're saying: should I test RC1 or not?
Well I'll do a test, just to compare 2.03 with your previous one.

I predict that this one wil be a bit slower than 1.1.1!!!

[pietrucci]

VERY strange: this is the first ROM which doesn't pass the VS Benchmark test!!! In test 3, the JPG test, it just terminates the test...
This means I can't compare with the others.
I will do the SPB Benchmark anyway.

Report back...

[mondilv]

I don't know exactly what you're saying: should I test RC1 or not?
Only for own pleasure.:D
And for me too - I can't to compare it to previous.
Not for public, I think - many changes ahead.
I predict that this one wil be a bit slower than 1.1.1!!!
Yes, it's possible.
But hope for interface responsibility.

[mondilv]

In test 3, the JPG test, it just terminates the test...
This means I can't compare with the others.

Hm. Strange.
Try without install Opera browser.
I did the jpeg test now - passed (on rc2)

[Sergy330]

Op op op...!
Don't hurry, please, it's not the FINAL release, just the test.:D
Even in RC2 will be many & big changes.
But it'll interesting for me too: mainboard of my device had changed.
The NAND looks bit slower, then previous. So I can't to compare the new rom correctly.
Need something, like coefficient.


Ops! sorry about that, I thought that RC1 was a final release :)

[pietrucci]

Another big problem: SPB removed their site to analyze the testresults.
On their site http://www.spbsoftwarehouse.com/products/benchmark/handleresult.php?en I always get the SPB indices, but now they replaces this with another site.

So now I can do my tests anymore. I just finished mondilv's 2.0 RC1 test, but can''t complete it.
Hope their site get's back soon!

[djcedric]

can you do a test with the newest rom of skippycentraal please because i want see the scores of is new rom to compare with the others?
is this possible?
thx in advance

[danny_and_2]

can you do a test with the newest rom of skippycentraal please because i want see the scores of is new rom to compare with the others?
is this possible?
thx in advance

If I remember rightm pietrucci don't test roms that not are WWE Lang. So if you want to do it, you have to do it by yourself. ;).

[djcedric]

If I remember rightm pietrucci don't test roms that not are WWE Lang. So if you want to do it, you have to do it by yourself. ;).

on first post :
tested roms so far SC 3.1 NLDTT7 Extreme (20753) :)

[danny_and_2]

on first post :
tested roms so far SC 3.1 NLDTT7 Extreme (20753) :)

Oh my bad then. ;)

[luk-a-sz]

Hi,


Could You test:
"NATALY". V.2.0.FINAL

http://forum.xda-developers.com/showthread.php?t=459854

[pietrucci]

Hi,


Could You test:
"NATALY". V.2.0.FINAL

http://forum.xda-developers.com/showthread.php?t=459854
No I can't anymore. As I already stated a few posts before SPB removde the analyze page to get the SPB indices. Don't know why they removed it, but now I can't get the calculated indices...

So no more testing for now...

[charly_mx]

please continue with your work pietrucci :D

[pietrucci]

please continue with your work pietrucci :DSorry I can't anymore!
I can do my tests, but after these test I always go to the analyze page from SPB where the SPB indices are calculated.
But SBP has removed this page since a few days (I really son't know why, now their benchmark tool is useless), so my totalindices can't be calculated anymore...

[band27]

Is there no other App that can be used to do the same ? I guess not, as you would have by now, moved to that App. Does anyone else know of any App to be used for this purpose?

[pietrucci]

Is there no other App that can be used to do the same ? I guess not, as you would have by now, moved to that App. Does anyone else know of any App to be used for this purpose?And if there was such an application, then all previous results can't be used anymore to compare with.

[mondilv]

I tried to compare previous (1.1.1) "Nataly' ROM & 2.0. By SPB bench. With absolutely the same packages/OS/Build.
Performance looks very close.
But, by my opinion, 2.03 is bit more responsible.

[band27]

And if there was such an application, then all previous results can't be used anymore to comparise with.

True, hmmm..... I guess the forum is in a bit of a bind..... as I too found your statistical data very informative. Especially when you are surrounded by subjective comments when discussing these ROMs.

Your services will be missed...:(

[losdrivare]

Perhaps it's possible to run only VS benchmark? Then at least those can be compared.

I would truly miss your work, Pietrucci.

[pietrucci]

As some people ask for it: I could calculate the SPB indices myself, based on the info SPB give on their description page: http://www.spbsoftwarehouse.com/products/benchmark/indices_descriptions.html. (http://www.spbsoftwarehouse.com/products/benchmark/indices_descriptions.html)

Takes a few hours to bring in and test the calculations in Excel. Maybe tomorrow I'll give it a try.
I'll report back..

[Dr.Tenma]

Hey, good work,
could you post also results for this rom http://forum.xda-developers.com/showthread.php?t=459854 ? Because in the excel file, there is only the v1.1 light.
Thank's man !

[EazyVG]

How about testing Nataly 2.0 FINAL ... tnx.

[pietrucci]

Hi, I'm back!

Finally I managed to translate index calculations from SPB to my Excel spreadsheet. I have a small difference in calculations but that's within a range of < 1%.

I tested Nataly's v2.0 RC1 and final, see post #1.
Now I'm going tio test my first 6.5, Cloudyfa_6.5.01.

[mondilv]

Could you try "Nataly" on the old 1.00.25.05 radio?
It'll be more correct:)

[mondilv]

And, at all, I glad to see your work is continue.
Very useful for developers too.
Thanks!

[mondilv]

Interesting, what do you install to "Nataly" except Opera (default UC)?
In default variant - 136.7M is free.

[pietrucci]

Interesting, what do you install to "Nataly" except Opera (default UC)?
In default variant - 136.7M is free.When testing I install SPB Benchmark and VS Benchmark and Mortscript. All of them are about 10-12 Mb.

[mondilv]

When testing I install SPB Benchmark and VS Benchmark and Mortscript. All of them are about 10-12 Mb.

Clear.
P.S. Mortscript present allready inside.:)

[losdrivare]

Glad to see you back! :)

[pietrucci]

Interesting, what do you install to "Nataly" except Opera (default UC)?
In default variant - 136.7M is free.

When testing I install SPB Benchmark and VS Benchmark and Mortscript. All of them are about 10-12 Mb.

I just checked it: SPB consumes about 3 Mb, VS consumes about 12,5 Mb! This means all Storage memory reports in my benchmarks are about 15,5 Mb to low. I will correct this right now (hope people don't get confused...).

[pietrucci]

I just checked it: SPB consumes about 3 Mb, VS consumes about 12,5 Mb! This means all Storage memory reports in my benchmarks are about 15,5 Mb to low. I will correct this right now (hope people don't get confused...).
I corrected the Storage memory figures (+15,5 Mb), new report in post 1

[pietrucci]

hi,

Tested two more new roms:
Cloudyfa_6.5.01 Full WWE (21159)
Nataly v2.0 Final Full WWE (20769), radio 1.00.25.05

Cloudyfa ROM is the first 6.5 ROM I tested. Results not so good (it also doesn't feel that fast). VS Benchmark gives extreme result on test3, like some ROMs from alphazero's and swtos.

Nataly v2.0 Final Full WWE (20769) with radio 1.00.25.05 has about the same figures as the same ROM with radio 1.08.25.20.
Just a fraction slower, like I expected.

[mondilv]

Cloudyfa ROM is the first 6.5 ROM I tested. Results not so good (it also doesn't feel that fast). VS Benchmark gives extreme result on test3, like some ROMs from alphazero's and swtos.

Bad news. Hope, because it's not the final & official WM release.


Nataly v2.0 Final Full WWE (20769) with radio 1.00.25.05 has about the same figures as the same ROM with radio 1.08.25.20.
Just a fraction slower, like i suspected.


Looks bit strange. 1.00.25.05 always faster about 10% at file operations at least. Even on my new (and slow) flash.

[pietrucci]

Looks bit strange. 1.00.25.05 always faster about 10% at file operations at least. Even on my new (and slow) flash.Yes, maybe it IS strange (but maybe it is NOT). And therefore I re-tested twice extra (I always do each SPB test 5 times, in this case 10!): always worse results for the 25.05 radio. Finally I even did a complete new flash+hardrest last night, just to be 100% sure. Still the same results: 25.20 slightly faster.

On the other hand: I'm using radio 25.20 for a while now, it feels very good and solid, no huge battery consumption. Yes, radio 25.08 was slower then 25.05, but this 25.20 one... I don't know, I like it.

At the moment I'm using radio 1.09.25.23, see what that does....

[nicholas99]

Hey Man, Thanks for the results but the attach file u post on to download is for January not February. Hope u can change it. Cheers.

[mondilv]

Want to explain my opinion about 1.00.25.05/others radio:
(note: results for "slow" flash, on Pietrucci's device should be faster at write/copy operations). Not the test. Comparison only!

SPB bench 1.00.25.05
"Write 1 MB file" - 524 ms
"Read 1 MB file" - 31 ms
"Copy 1M file" - 628 ms

SPB bench 1.08.25.20
"Write 1 MB file" - 603 ms
"Read 1 MB file" - 32 ms
"Copy 1M file" - 746 ms

I haven't enough experience (and patience:D) for make FULL test. Possible, the ALL tests make summary 1.08.25.20 radio faster.
But "short" results make me puzzled.:)

[pietrucci]

Hey Man, Thanks for the results but the attach file u post on to download is for January not February. Hope u can change it. Cheers.Sorry, indeed the wrong file! Corrected it, see post #1,

[pietrucci]

Want to explain my opinion about 1.00.25.05/others radio:
(note: results for "slow" flash, on Pietrucci's device should be faster at write/copy operations). Not the test. Comparison only!

SPB bench 1.00.25.05
"Write 1 MB file" - 524 ms
"Read 1 MB file" - 31 ms
"Copy 1M file" - 628 ms

SPB bench 1.08.25.20
"Write 1 MB file" - 603 ms
"Read 1 MB file" - 32 ms
"Copy 1M file" - 746 ms

I haven't enough experience (and patience:D) for make FULL test. Possible, the ALL tests make summary 1.08.25.20 radio faster.
But "short" results make me puzzled.:)hi mondilv,
I don't doubt the results on your device, this is very possible.
My experience is that if you run SPB Benchmark 5 times, you get 5 different results! Sometimes slightly different, sometimes huge difference... That's why I always test 5 times nowadays and take the best values from it.
Did you test only once?

[mondilv]

Did you test only once?
Not, of course.
But always 1.00.25.05 was the fastest by spbbench. And the "trend" was very evident. At every rom in any time.
Even by subjective look to your's last table. I didn't summ index - just compare by strings.
Other (jounger) radios are very similar each to over in this test. Tried original Diamond & "alien" radios.
Possible index calculating have any summary coefficients?

P.S. I didn't compare battery consumption .05 to others.
Situation can be not so good as at later radios. By straight logic.:)

[pietrucci]

Not, of course.
But always 1.00.25.05 was the fastest by spbbench. And the "trend" was very evident. At every rom in any time.
Even by subjective look to your's last table. I didn't summ index - just compare by strings.
Other (jounger) radios are very similar each to over in this test. Tried original Diamond & "alien" radios.
Possible index calculating have any summary coefficients?

P.S. I didn't compare battery consumption .05 to others.
Situation can be not so good as at later radios. By straight logic.:)mondilv and other interested,

I think I know where the "pain" lies...
It's the fact that the indices are calculated with a weight factor. This means that all individual testresults have their own weight.
As you can see on the technical page from SPB, http://www.spbsoftwarehouse.com/products/benchmark/indices_descriptions.html , the formula for calculating the indices is:

http://www.spbsoftwarehouse.com/uploads/images/benchmark/site/indexformula_.gif

where C1, ...,Cn are the weight factors.
When you look closely at this formula you'll see a obvious contradiction: the HIGHER the weight of a test, the LOWER the influence of that test on the index! So a testresult with a weight factor of 5 has more influence than a testresult with a weight factor of 20!

Now, look at the File System results of both of the radio's .05 and .20 in your Nataly ROM. You'll see that almost all results from radio .05 are BETTER than .20. BUT... the results from test "Directory list from 2000 files" from radio .20 is faster than .05 (1185 vs. 1211). And this individual test has a weight factor of 5, while the rest have a factor 20, 15 or 10!
Conclusion: because of this individual test with a weight of 5, radio .20 in the File System index get's faster than .05!!!

I do think it's a bit strange that a high factor has the least influence, but that's the way SPB calculates it's results. I guess they have a meaning doing this because of the sysntax of the formula... (they give the most important tests the lowest factor).

I hope you get my point.

[alphazero]

welcome back pietrucci! i didnt know your a math genius. :D
thanks for the formula explanation.

[mondilv]

Thanks, clear now.
Did think so.
Now I'm relax.:D

[mondilv]

May be is a reason to test radios too?
:D
Take one rom & check performance at diff radios.
What do you think, Pietrucci?

[pietrucci]

May be is a reason to test radios too?
:D
Take one rom & check performance at diff radios.
What do you think, Pietrucci?Maybe I could do that.
But first of all it's a lot of work...
As you know I do all my tests 5 times. And I experienced that some hardresets give a slow result (don't know how that's possible, but it is!), so I have to hardreset and test again...
So it takes very very much time.

Secondly I think it's very strange that different radio's gives different testresults. My simcard is removed, my radio is off, so what's the influence of the radio??? (none I would say.). But radio DOES matter, I already did a simple test comparing radio's .05 and .23. You can see that in my Excel sheet on the tab Radio. Radio 0.5 is faster...

[nicholas99]

Anyone can help or tell me am i done something wrong with my diamond phone coz i have try few of the ROMs that the program memory should be around 60mb to 70mb like nataly v2.0 final rom and CTs v6.4 Org TF3D rom, But after try flash few time and the rest of the ROMs got big size for the program memory still i got only 50mb. Why was that....

[mondilv]

Anyone can help or tell me am i done something wrong with my diamond phone coz i have try few of the ROMs that the program memory should be around 60mb to 70mb like nataly v2.0 final rom and CTs v6.4 Org TF3D rom, But after try flash few time and the rest of the ROMs got big size for the program memory still i got only 50mb. Why was that....

Look at the first post: Manila & PhoneCanvas are disabled before tests.

[nicholas99]

lol i got it now....sorry didnt look on it.....cheers.

[Dr.Tenma]

Hello, i got question, in first post, you give link to your opinion, i read it. But noticed that this opinion is old(2.03 is out now), is your opinion updated though ? I mean is still cooked rom's based on 1.93 still better ?

[losdrivare]

I miss your benchmarks, Pietrucci.

There are new and interesting ROMs out there, like Nataly 2.1, udK Syrius Topaz R1 and PDAcornerIllusion V3, just to mention a few. But how do they compare in the challanging Pietrucci benchmarks? :D

[pietrucci]

I miss your benchmarks, Pietrucci.

There are new and interesting ROMs out there, like Nataly 2.1, udK Syrius Topaz R1 and PDAcornerIllusion V3, just to mention a few. But how do they compare in the challanging Pietrucci benchmarks? :DOk, because you miss me that much, losdrivare, here some new benchmarks:

swtos V2.6 Light (20764)
udK Syrius Topaz R2 (21032)
Nataly V2.1 Final (20771)
Cloudy WM 6.1 V1.0 (21018)
PDACornerIllusion V3 (21039)

With it's first Diamond WM6.1 ROM, Cloudifa's goes straight to the top: fastest ROM I benchmarked (except for the exotic one's)!

See post #1

[mondilv]

Thanks for test!
Just a little comment: in Nataly V2.1 Final Opera is present.

[pietrucci]

Thanks for test!
Just a little comment: in Nataly V2.1 Final Opera is present.Ok, I didn't notice, I thought it was in sdconfig like previous versions. I'll correct my comment for the next version of my spreadsheet.

[dysje]

You may want to update the your advice post you made, it tells me to go for a 1.93 rom but it seems old since the 2.03 finals are out for a while now?

[cloudedhopes]

welcome back pietrucci :) was missing ur benchmarks :) btw, you forgot to update the date in the title :D

[losdrivare]

Ok, because you miss me that much, losdrivare, here some new benchmarks:


Awesome, thanks! You're the man! =)

It's tight on top these days, a lot of ROM's are getting top scores +/- a few points.

[pietrucci]

Ok guys, thanx for your reactions.
I changed the date in post 1 and my advise in post 199.

EDIT 16-03: Corrected some small errors in Excel en recent ROM file. No errors in figures, just in texts.

[gregmits]

According to the new file, Cloudy is not the fastest. Is that right?

[pietrucci]

According to the new file, Cloudy is not the fastest. Is that right?No that is NOT right! Cloudy IS the fastest!

Sorry guys I really ****ed up this time, I think I'm getting a bit rusty...
All measurements are correct, only the calculated corrected index was wrong, because I forgot to exclude a ROM with "strange" results.
Now everything corrected.

Sorry again...

[losdrivare]

Sorry guys I really ****ed up this time, I think I'm getting a bit rusty...
All measurements are correct, only the calculated corrected index was wrong, because I forgot to exclude a ROM with "strange" results.
Now everything corrected.

Sorry again...

Never you mind. No one could do what you do better! :D

[drgupta1981]

EDIT 14-03: I changed my advise for 1.93 to 2.03
------------------------------------------------

So you Want my opinion which ROM to choose???

Well here it is: just pick one!

Although benchmarks give (some) differences between ROMS, in normal daily use really you won't notice any difference.
People often shout "very fast ROM, speedy ROM" (including me), but I think that are mostly feelings than facts (by the way: there's nothing wrong with these feeling, just fine!).
- Take any 2.03 based cooked ROM: they all are fastest and stabile at the moment; the cooked versions are just better with less bloat and more memory.
- Maybe take a look in my table which has the largest memory left.
- Take one with the programs you like cooked in. Or just a ROM that looks nice.
- Or take a naked/lite version and add the programs you like.
Advantage of a naked ROM is that new program versions will be overwritten, so no extra ROM memory in use.
Also you can just install the programs you need, no extra's.
And they seem to be as fast as ROMs with cooked in programs!
Disadvantage of naked ROM: you have to install everything afterwards (althoug you can automate this process; I postinstall about 20 programs in about 10-15 minutes, fully automated).

That's my opinion....

until there comes a the one...!



Pietrucci


hi there,

you mentioned that you do automated installs for programs after downloading naked versions of ROMs.

Can you please tell me the detailed procedure how to do that??

Regards.

[pietrucci]

hi there,

you mentioned that you do automated installs for programs after downloading naked versions of ROMs.

Can you please tell me the detailed procedure how to do that??

Regards.I already PM'd you...

[DefJamz]

hi.. is possible to have these 2 roms benchmarked?

aFast v2.03 (b35) (http://forum.xda-developers.com/showthread.php?t=479049)
vs
A.Z.T.O.R. X2 Ultimate ("http://forum.xda-developers.com/showthread.php?t=422417)?

i need to know the faster of the 2 that's as close as possible to the stock 2.03 ROM.

Thanks in advance.

[laser21]

Thanks for your time pietrucci! I think a lot of us would be lost in the sea of new roms floating around without your xls sheet :-)

[pietrucci]

2 more new ROMs:
udK Syrius Topaz R4 (21040, 2.04)
Cloudy WM 6.1 V1.1 (21040, 2.04)

Both ROMs are 21040, 2.04 version.
And both give very bad SPB-results especially in CPU and File system!
Don't know why, I hardresttet many times, just to make sure I didn't test wrong. But always these bad figures...

There are two possible reasons for this: 1) SPB cant handle this 2.04 ROMs or 2) there ROM version stink on our Diamonds...

See post #1.

[cloudedhopes]

its good to see you are active once again! :)

just wondering - any chances of benchmarking the aztor's X2?

[mondilv]

There are two possible reasons for this: 1) SPB cant handle this 2.04 ROMs or 2) there ROM version stink on our Diamonds...

...or didn't change pagepul from 8PP. As I see, udK use 2.04 drivers. If payload from "Orange" rom, PP is 8M as default.

[Dr.Tenma]

Yes please the Aztor's x2, the aFast and Nataly v2.1.1 if possible...Thank's !
Also, i saw in your excess file, that the wildberry has best sound score, does it mean, sound is more powerful or quality is better ?

[aussie1234]

Hi Pietrucci

Thanks for your ROM Statistics.

I have found them very useful in choosing my ROMS.

And I do agree that the new 2.04 ROMS are noticeably slower than previous ROMS. I have seen this in UDK's R4 and Cloudy's 1.1 ROM.

Keep up the good work.

Aussie :)

[wencyv]

May I know which ROM has at least all the new setup for HTC Diamond2? I would really love to install one.

please advise.
thanks

[cloudedhopes]

since XDA got restored - it lost the last update

attached is his last benchmarking done on 29th March 2009

until pietrucci gets chance to update his posts :)

EDIT: pietrucci already updated

[pietrucci]

Tested new ROM: swtos V2.71 Full (21042)

[shaks1979]

Tested new ROM: swtos V2.71 Full (21042)

Hi

Any chance of testing my latest: Shaks.P v4.00 (21042/2.03MRII) 12Mb PP?

Thanks for taking the time to do all these benchmarks. Much appreciated.

Regards

[pietrucci]

Hi

Any chance of testing my latest: Shaks.P v4.00 (21042/2.03MRII) 12Mb PP?

Thanks for taking the time to do all these benchmarks. Much appreciated.

RegardsTested it, see post #1.

Hate to be a pain in the ass, but at the moment I'm disappointed about the speed of the 21040 and 21042 builds. They just don't seem to fit that well on our Diamonds. Not only benchmarks but also in normal use I just dont' feel them so snappy.

[cloudedhopes]

Tested it, see post #1.

Hate to be a pain in the ass, but at the moment I'm disappointed about the speed of the 21040 and 21042 builds. They just don't seem to fit that well on our Diamonds. Not only benchmarks but also in normal use I just dont' feel them so snappy.

pietrucci - i've noticed you're now testing the ROMs with radio 1.09, could that be?

[pietrucci]

pietrucci - i've noticed you're now testing the ROMs with radio 1.09, could that be?Yes, you are right that radio can make a difference. But I compared radio 1.00.25.05 and 1.09.25.23 with two recent ROMs (Nataly 2.2 Test and udk R4): results were about the same!

Just to do another test: right now I'm using Cloudy 1.0 with radio 1.09.25.23, I will test this one again and compare it with the results of radio 1.00.25.05 (already in my benchmark).

[losdrivare]

Hate to be a pain in the ass, but at the moment I'm disappointed about the speed of the 21040 and 21042 builds. They just don't seem to fit that well on our Diamonds. Not only benchmarks but also in normal use I just dont' feel them so snappy.

Judging from your scores 21040 really seems slow, both udK and Couldyfa usually makes really fast ROMs. But 21042 seems as fast as the fastest builds to me, at least Mondilv got a great score with it. If you compare the 21042 ROMs, the only significant difference is that Nataly has a higher File System score.

[mispook01]

Which of these ROMs can be flashed to the Sprint Diamond.

Thanks

[shaks1979]

Tested it, see post #1.

Hate to be a pain in the ass, but at the moment I'm disappointed about the speed of the 21040 and 21042 builds. They just don't seem to fit that well on our Diamonds. Not only benchmarks but also in normal use I just dont' feel them so snappy.

Thanks for testing. It's slower than my last roms according to the benches however feels very quick here. Feedback I'm getting is it feels very quick and I don't get slowdowns which I did on the previous builds.
P.S was this run with opera still installed? I don't think it would make much difference however I remember you uninstalled opera on my 3.10 build. It's not important anyway.

Regards & thanks for your hard work & testing.

[band27]

Interesting results consider the snappy overall feel of Shaks latest installment. Quite surprised!

[mgs333]

Which of these ROMs can be flashed to the Sprint Diamond.

Thanks

none (10 chars)

[cloudedhopes]

Yes, you are right that radio can make a difference. But I compared radio 1.00.25.05 and 1.09.25.23 with two recent ROMs (Nataly 2.2 Test and udk R4): results were about the same!

Just to do another test: right now I'm using Cloudy 1.0 with radio 1.09.25.23, I will test this one again and compare it with the results of radio 1.00.25.05 (already in my benchmark).

did u get a chance? any interesting findings?

[pietrucci]

did u get a chance? any interesting findings?Well yes. I did several tests with radio's 1.00.25.05 and 1/09.25.23.
I took de average differences in radio results and recalculated the benchmark results from the recent .23 ROMs I tested, back to radio .05.
The total results in short (will publish my sheet with detailled results soon):

.....................................Benchmarked.. .....Recalculated
Radio...............................1.09.25.23.... .......1.00.25.05

udk Syrius Topaz R4..................906......................915

Cloudy WM6.1 V1.1...................909......................91 9

swtos v2.71 Full.......................938.................... ..948

Shaks.P v4.00..........................926................ ......936


If you would take a look in my benchmark spreadsheet, you'd see these results wouldn't change the overall ranking, the best ROMs stay the best.

[cloudedhopes]

wow - thats very interesting, however i still can't understand why the change when the radio is turned off... but anyway

thanks for the info! :)

[pietrucci]

wow - thats very interesting, however i still can't understand why the change when the radio is turned off... but anyway thanks for the info! :)Do not try to understand this, radio off and still of influence in the tests. It just is that way. Has been discussed many times before, I didn't believe it either at first.
But already tested this about a year ago, it really is true.

[laser21]

Is Nataly 2.2 coming up? Thanks

[boscaiolo]

why you dont bech rom with wm6.5 without manila?

[boscaiolo]

last manila rom's VS wm 6.5?

[megahenebi]

Macadam 1.2 rom please

[devilsneck]

hmmm...ive tried macadam and its full of bugs....wont use until thers is a more stable version

[pietrucci]

Tested 2 more ROMs:

AZTOR X2 WWE (20764)
Nataly 2.5 beta test1 (21043) (private)

Got myself the new Diamond 2, so I won't be around so much anymore at the Diamond part.
Thnx for your positive responses, hope to see you soon at the TD2's!

[ssj5trunks]

It's normal that when i soft reset my Diamond with last Official HTC Rom the speed of programs is more quickly?
But after 3/4 restart of programs it half the speed!!!!

Why????

[losdrivare]

Tested 2 more ROMs:

AZTOR X2 WWE (20764)
Nataly 2.5 beta test1 (21043) (private)

Got myself the new Diamond 2, so I won't be around so much anymore at the Diamond part.
Thnx for your positive responses, hope to see you soon at the TD2's!


Thanks for those last 2 benchmarks, it seems Mondilv keeps pushing the speed forward. :)

Congrats on your new purchase, hope you'll be happy with your new device! I'm a little torn between the HD and TD2 myself, if I'm going for a bigger device than my Diamond, then the HD is not much bigger than TD2 but with considerably more screen estate + 3,5 mm jack. Decisions, decisions... :D

Anyway, your benchmarks will be missed here in the Diamond section. Thanks for an awesome achievement on testing all these ROMs.

[pietrucci]

Check this out: first benchmark of the new Diamond 2 (Topaz). See first post.

It's faster and it has much more memory!
(by the way: and it's more beautiful...)


Had to test VS Benchmark in VGA mode, VS Benchmark doesn't support WVGA.

[cyron_at]

Check this out: first benchmark of the new Diamond 2 (Topaz). See first post.

It's faster and it has much more memory!
(by the way: and it's more beautiful...)


Had to test VS Benchmark in VGA mode, VS Benchmark doesn't support WVGA.
...great but we don't have a diamond 2 :-(

[mondilv]

Check this out: first benchmark of the new Diamond 2 (Topaz). See first post.

Great!
Just one thing - hardspl.... and test results will be much better.:)

[pietrucci]

Great!
Just one thing - hardspl.... and test results will be much better.:)Yes, anxiously waiting...

[pietrucci]

Pubished in the Diamond 2 section a sheet with benchmark results of several HTC devices from Hermes to Kaiser to Diamond to Diamond 2.
You can see the evolution of speed...

See http://forum.xda-developers.com/showthread.php?t=510385

[pietrucci]

hi,

mondilv asked me to benchmark his latest Nathaly. Well, it fast, in fact the fastest Diamond ROM I ever benchmarked!
See first post.

[losdrivare]

hi,

mondilv asked me t obenchmark his latest Nathaly. Well, it fast, in fsact the fastest Diamond ROM I ever benchmarked!
See first post.

Thanks for the test, it confirmed my suspicions about Nataly 2.5! =)

If I may make one last fan request, before you are forever lost to the Diamond 2 section, it would be to benchmark udK Topaz R7 (preferably with 12mb PP). I'm really curious to get an indication on how much LZX compression affects performance. 5 mb more RAM is worth alot... :)

Only if you have the time and willingness. Thanks again for all your work, it's invaluable.

[3dward87]

Update this very good topic !

[norgan]

sorry if this is a repeat but the 50+ threads are hard to look through. have you tested the energyrom? i really liek this rom and am interested to see if it's worth trying others as far as speed.

i think i am in love with this rom, using the 6.5.3 build 28xxx build. stable very minor bugs and very pleasing to use visually.