[20-Aug-2018][mido] Battery Life / Performance Benchmarks - ROMs & Kernels

Search This thread

svbarbosa

Senior Member
Dec 18, 2010
1,486
2,655
Rio de Janeiro
[20-Aug-2018] NEW: For the ranking table with normalized scores of Oreo Treble Kernels head directly to post #421.

Let me first say that is not a "best rom" thread. There is no absolute best rom. What is best for one user may not be best for another. To give a simple example, battery is very important for some users while performance is priority for others.

Benchmark results are usually misleading, but PC Mark battery life benchmark shines by using day to day tasks to measure phone performance and battery drain. It repeats a series of tasks including web browsing, photo and video editing, text editing and data manipulation.

For each rom I made a clean install and a simple setup with basic settings and a few apps necessary to monitor/admin the runs.

The tests are run with the screen brightness calibrated at 200 lumens as required by PC Mark and all sound levels set to zero, so results are better suited for comparison.

Each benchmark run takes over 8 hours. So this test is also a stability test. Some rom/kernel combinations simply fail to complete the test.

Here is the index of all my mido benchmarks compilations:

  • Treble Oreo Roms ranking table - post #390.
  • Latest preview of Treble Kernels - post #413.
  • Latest preview of Treble Roms - post #343.
  • Previous preview of kernels benchmarks - post #256.
  • Previous Kernel normalized scores and ranking tables - post #273.
  • Non-Treble Oreo & Nougat Roms - post #4.
  • Previous Compilations - Roms & Kernel - post #5.

04-May-2018 - Kernel Poll Results:

I had 75 votes in my kernel poll. Thanks to you all. Here are the poll results:

# Votes / Kernel
34 FrancoKernel
12 ElectraBlue
09 KudKernel
06 Xenial
04 Velvet
03 Revolt
03 Stormguard
02 None of the above
02 ZPX Inferno
00 Chewy-Weeb
75 Total Votes!

.
 
Last edited:

svbarbosa

Senior Member
Dec 18, 2010
1,486
2,655
Rio de Janeiro
The following is the series of Nougat and non-treble Oreo Roms prepared between February and April 2018.


Let me first say that is not a "best rom" thread. There is no absolute best rom. What is best for one user may not be best for another. To give a simple example, battery is very important for some users while performance is priority for others.

Benchmark results are usually misleading, but PC Mark battery life benchmark shines by using day to day tasks to measure phone performance and battery drain. It repeats a series of tasks including web browsing, photo and video editing, text editing and data manipulation.

For each rom I made a clean install and a simple setup with basic settings and a few apps necessary to monitor/admin the runs.

The tests are run with the screen brightness calibrated at 200 lumens as required by PC Mark and all sound levels set to zero, so results are better suited for comparison.

Each benchmark run takes over 8 hours. So this test is also a stability test. Some rom/kernel combinations simply fail to complete the test.

It took almost three weeks to run these tests with two midos dedicated for it 24/7!

If you want to learn more about PC Mark take a look at the site: PC Mark for Android.

For this compilation I picked the following roms:

Of course I could not use all the latest builds, remember it takes weeks to run all benchmarks.

Enough talk. Now Let's see the results:


PC%20Mark%20Battery%20Tests%20mido%20-%202018-0414%20RR.png



PC%20Mark%20Battery%20Tests%20mido%20-%202018-0403%20Etc.png



Score is a performance index - the higher the better.

SOT (Screen On Time) is an estimate of the number of hours the device may be used until battery drops dead (from 100% to 0%). It's a very good estimate because the test starts with the battery at 86% and ends when the battery drops to 20%.

There is no clear advantage comparing Oreo roms. They all offer similar performance and battery drain.

Nougat RR is still better in both performance and battery drain, again with no expressive advantage over Oreo.

So any of there roms will serve you well and you should pick one based mainly on the features you want.

25-Feb-2018 Update:

Added RR-O Official. Its performance score is similar to other Oreo roms, but SOT is a little behind - 10:37 hours - one hour less than average. Not a big problem because any number over 10 hours is probably good enough for most people.

07-Mar-2018 Update:

Added RR-O Alexey's build. Its performance score and SOT are below other Oreo roms averages. When compared to official RRO SOT is a little better - 11:06 x 10:37 hours and performance score is worse - 4235 x 4763. My benchmark was done with 2018-0303 build and Alexey has a new build almost everyday. I plan to benchmark it again sometime in the future.

24-Mar-2018 Update:

Added @EndLess's RRO and @Adesh15's AOSiP.

This time I broke the results spreadsheet into two, one for Resurrection Remix builds and one for all other Oreo builds.

Adding two more roms once again proves that there is no major difference between Oreo roms. Any one of these roms offers similar performance and battery SOT.

The new RRO build by @EndLess offers the best combination of performance ans battery for Oreo RR. Still Nougat roms have better figures and there is the RRO LuisBUILD by @8224Freak still to be tested.

For the other Oreo roms, the newcomer AOSiP has a slight disadvantage compared to the others. But again this should not influence your choice. Features should be the deciding factor.

03-Apr-2018 Update:

Added @khan_frd2002's Omni and @Alexey71's LineageOS Extended.

Again no surprises. Omni is very fluid, but has slightly less than average SOT. LA Extended has less than average performance and a good SOT.

All tested roms so far are more than capable to serve you well.

14-Apr-2018 Update:

Added RRO by @EndLess 2018-0407 and RRO by @8224Freak LuisBUILD 2018-0405.

RR Oreo roms are evolving, but still RR Nougat roms have better battery/performance.

@EndLess's RRO reached 12 hours SOT, with below average performance - score was 3878.

@8224Freak's has a better compromise of battery/performance, with 11:29 SOT and 4645 performance score.

Thanks @y2ksnoop for the following extra information, based on his usage experience:

The Endless rom has downclocked the CPU to 1.6GHz for better battery life. Though the bench scores are low, there isn't any hiccups in day to usage. The rom is really smooth and games do run fine without heating for a extended time. The thermal management is excellent and the throttling doesn't kick in early. It's the best RR stable build for day to day usage. The next best would be Luis RR Oreo rom which has SE Linux mode enforced by default.
.
 
Last edited:

svbarbosa

Senior Member
Dec 18, 2010
1,486
2,655
Rio de Janeiro
This post includes some of my previous compilations. You may find them interesting, but rom and kernel builds are old for obvious reasons.


The following was posted on 14-01-2018, see original post here.


I have just finished testing @Alexey711's Velvet 6.5 kernel that came with RR-N-v5.8.5-20180109-mido-Final new led driver.

Here are the results:

PC%20Mark%20Battery%20Tests%20mido%20-%202018-0114.png


Comparing to Velvet 5.5 battery drain has improved a little and performance is the same.

I did not experience any problems copying files with this build. I use Root Explorer.

Please note that this is not the latest build. Running these benchmarks take a long time and it is difficult to keep up with Alexey711.



The following was posted on 06-01-2018, see original post here.


Here is my latest compilation of PC Mark Battery Life Benchmarks to compare currently available kernels for the Redmi Note 4

If you haven´t read my previous posts and need more info on PC Mark read the explanation at the end of this post.

This time let´s start with the results:

PC%20Mark%20Battery%20Tests%20mido%20-%202018-0106.png


All test were done with @Alexey71's RR-N-v5.8.5-20171219-mido-Final new led driver, using stock kernel and the available custom kernels at this moment.

There is one kernel missing: Stormguard. Unfortunately if failed to complete the benchmarks too many times.

Again there is no clear winner.

if your main goal is battery life and you don't worry about sacrificing some performance your kernel of choice should be Velvet, with an average SOT of 13:28 hours and average performance score of 4092. Good alternatives are Revolt kernel, with 12:52 SOT and 4239 performance, and Xenial kernel, with 12:40 and 4272. Both had more consistent results then Velvet.

If you are looking for the best performance then ZPX Inferno should be your kernel, with an average performance score of 4822 and an average SOT of 12:07 hours. ZPX had almost no variation in SOT between runs, with a mere 0,1% variation.

For a balance between battery and performance the best choices are ElectraBlue, with 4677 and 11:59 and RR Stock kernel, with 4623 and 12:14.

It took almost two weeks to run these tests with two midos dedicated for it 24/7!

This time I calibrated the brightness output of each kernel to 200 lux, as required by PC Mark, so results are better suited for comparison.

Now some words on benchmarks and PC Mark:

Benchmark results are usually misleading, but PC Mark battery life benchmark shines by using day to day tasks to measure phone performance and battery drain. It repeats a series of tasks including web browsing, photo and video editing, text editing and data manipulation.

For these runs I started the benchmarks with battery precisely at 85% and the test automatically stops when battery reaches 20%, so the test consumes 65% of the battery charge. Of course the screen is always on during the whole test.

If you want to learn more about PC Mark take a look at the site: PC Mark for Android.

Where to get the kernels:
.
 
Last edited:

svbarbosa

Senior Member
Dec 18, 2010
1,486
2,655
Rio de Janeiro

sajty

Senior Member
Oct 6, 2012
2,427
992
Praha
Great work man. Just one note - try to compare the same governors and i/o schedulers. Now, you are comparing a little bit incomparable, cfq vs maple...

Keep it up.
 

drakylucas

New member
Feb 19, 2018
1
0
Can you do the same test using the official global rom and the official beta rom? Thanks.. Very nice topic!
 

svbarbosa

Senior Member
Dec 18, 2010
1,486
2,655
Rio de Janeiro
Unfortunately no, I liked PE :(

Well, if you change your mind please keep RR-O in the top of your list of "next to build" roms. :eek:

Great work man. Just one note - try to compare the same governors and i/o schedulers. Now, you are comparing a little bit incomparable, cfq vs maple...

I know. Depending on tweaks the benchmark results may vary a lot. @Zile995 also pointed out that tweaks could have a great impact on results.

But it takes so long to run the benchmarks that I would never finish them if I had to start trying different options for each rom/kernel.

So I have decided to always test the roms and kernels "as they come". No modifications at all. I just leave it up to the devs to decide what is best for their builds.


Can you add dirty unicorns nougat 11.7.2 version for comparison ?

What about stock miui 9.Try to add it next time. any way you did a great job

Can you do the same test using the official global rom and the official beta rom? Thanks.. Very nice topic!

I will try my best to accommodate requests, but no promises.

Too many roms and kernels and too little time. :p
 

Top Liked Posts

  • There are no posts matching your filters.
  • 138
    [20-Aug-2018] NEW: For the ranking table with normalized scores of Oreo Treble Kernels head directly to post #421.

    Let me first say that is not a "best rom" thread. There is no absolute best rom. What is best for one user may not be best for another. To give a simple example, battery is very important for some users while performance is priority for others.

    Benchmark results are usually misleading, but PC Mark battery life benchmark shines by using day to day tasks to measure phone performance and battery drain. It repeats a series of tasks including web browsing, photo and video editing, text editing and data manipulation.

    For each rom I made a clean install and a simple setup with basic settings and a few apps necessary to monitor/admin the runs.

    The tests are run with the screen brightness calibrated at 200 lumens as required by PC Mark and all sound levels set to zero, so results are better suited for comparison.

    Each benchmark run takes over 8 hours. So this test is also a stability test. Some rom/kernel combinations simply fail to complete the test.

    Here is the index of all my mido benchmarks compilations:

    • Treble Oreo Roms ranking table - post #390.
    • Latest preview of Treble Kernels - post #413.
    • Latest preview of Treble Roms - post #343.
    • Previous preview of kernels benchmarks - post #256.
    • Previous Kernel normalized scores and ranking tables - post #273.
    • Non-Treble Oreo & Nougat Roms - post #4.
    • Previous Compilations - Roms & Kernel - post #5.

    04-May-2018 - Kernel Poll Results:

    I had 75 votes in my kernel poll. Thanks to you all. Here are the poll results:

    # Votes / Kernel
    34 FrancoKernel
    12 ElectraBlue
    09 KudKernel
    06 Xenial
    04 Velvet
    03 Revolt
    03 Stormguard
    02 None of the above
    02 ZPX Inferno
    00 Chewy-Weeb
    75 Total Votes!

    .
    25
    The following is the series of Nougat and non-treble Oreo Roms prepared between February and April 2018.


    Let me first say that is not a "best rom" thread. There is no absolute best rom. What is best for one user may not be best for another. To give a simple example, battery is very important for some users while performance is priority for others.

    Benchmark results are usually misleading, but PC Mark battery life benchmark shines by using day to day tasks to measure phone performance and battery drain. It repeats a series of tasks including web browsing, photo and video editing, text editing and data manipulation.

    For each rom I made a clean install and a simple setup with basic settings and a few apps necessary to monitor/admin the runs.

    The tests are run with the screen brightness calibrated at 200 lumens as required by PC Mark and all sound levels set to zero, so results are better suited for comparison.

    Each benchmark run takes over 8 hours. So this test is also a stability test. Some rom/kernel combinations simply fail to complete the test.

    It took almost three weeks to run these tests with two midos dedicated for it 24/7!

    If you want to learn more about PC Mark take a look at the site: PC Mark for Android.

    For this compilation I picked the following roms:

    Of course I could not use all the latest builds, remember it takes weeks to run all benchmarks.

    Enough talk. Now Let's see the results:


    PC%20Mark%20Battery%20Tests%20mido%20-%202018-0414%20RR.png



    PC%20Mark%20Battery%20Tests%20mido%20-%202018-0403%20Etc.png



    Score is a performance index - the higher the better.

    SOT (Screen On Time) is an estimate of the number of hours the device may be used until battery drops dead (from 100% to 0%). It's a very good estimate because the test starts with the battery at 86% and ends when the battery drops to 20%.

    There is no clear advantage comparing Oreo roms. They all offer similar performance and battery drain.

    Nougat RR is still better in both performance and battery drain, again with no expressive advantage over Oreo.

    So any of there roms will serve you well and you should pick one based mainly on the features you want.

    25-Feb-2018 Update:

    Added RR-O Official. Its performance score is similar to other Oreo roms, but SOT is a little behind - 10:37 hours - one hour less than average. Not a big problem because any number over 10 hours is probably good enough for most people.

    07-Mar-2018 Update:

    Added RR-O Alexey's build. Its performance score and SOT are below other Oreo roms averages. When compared to official RRO SOT is a little better - 11:06 x 10:37 hours and performance score is worse - 4235 x 4763. My benchmark was done with 2018-0303 build and Alexey has a new build almost everyday. I plan to benchmark it again sometime in the future.

    24-Mar-2018 Update:

    Added @EndLess's RRO and @Adesh15's AOSiP.

    This time I broke the results spreadsheet into two, one for Resurrection Remix builds and one for all other Oreo builds.

    Adding two more roms once again proves that there is no major difference between Oreo roms. Any one of these roms offers similar performance and battery SOT.

    The new RRO build by @EndLess offers the best combination of performance ans battery for Oreo RR. Still Nougat roms have better figures and there is the RRO LuisBUILD by @8224Freak still to be tested.

    For the other Oreo roms, the newcomer AOSiP has a slight disadvantage compared to the others. But again this should not influence your choice. Features should be the deciding factor.

    03-Apr-2018 Update:

    Added @khan_frd2002's Omni and @Alexey71's LineageOS Extended.

    Again no surprises. Omni is very fluid, but has slightly less than average SOT. LA Extended has less than average performance and a good SOT.

    All tested roms so far are more than capable to serve you well.

    14-Apr-2018 Update:

    Added RRO by @EndLess 2018-0407 and RRO by @8224Freak LuisBUILD 2018-0405.

    RR Oreo roms are evolving, but still RR Nougat roms have better battery/performance.

    @EndLess's RRO reached 12 hours SOT, with below average performance - score was 3878.

    @8224Freak's has a better compromise of battery/performance, with 11:29 SOT and 4645 performance score.

    Thanks @y2ksnoop for the following extra information, based on his usage experience:

    The Endless rom has downclocked the CPU to 1.6GHz for better battery life. Though the bench scores are low, there isn't any hiccups in day to usage. The rom is really smooth and games do run fine without heating for a extended time. The thermal management is excellent and the throttling doesn't kick in early. It's the best RR stable build for day to day usage. The next best would be Luis RR Oreo rom which has SE Linux mode enforced by default.
    .
    20
    Hi Folks!

    I was travelling overseas with little time for XDA.

    Just got back and will soon restart the benchmarks.

    I guess now it is time for Pie.
    20
    Finally this kernel series is done!! :D

    I will have to rework the OP. :p

    In the meantime here are the final results:

    PC%20Mark%20Battery%20Tests%20mido%20-%202018-0503%20Kernels.png


    PC%20Mark%20Battery%20Tests%20mido%20-%202018-0513%20Kernels.png


    Newly added kernels are FrancoKernel r6 and KudKernel r17.

    Two kernels failed the benchmark: Weeb and Velvet t6.8 (test build - so it is no surprise it fails).

    Next benchmark series will be treble roms. I am already benchmarking EndLess's RRO treble build.