[KERNEL][E6653/E6633/E6683] Zach's Kernel Playground for Z5, WIP (work in progress)

[zacharias.maladroit]

2021 September update:

Since I've been getting requests lately due to Google's updated Google Drive policy - here's the updated share link for the Z5 kernels

Z5-Kernels - Google Drive

drive.google.com

Final notice: Since my Z5 died (it's broken into pieces, glass shattered) - development is effectively halted - NO more updates - sorry

This is a Stock (Sony) ROM Kernel and WILL NOT work on AOSP, CM, etc.

aka SunKernel for Z5 + Z5 Dual - Stock ROM (for now only stock)

Alright guys,

this is my intermediate result on working on the Kernel for the Z5 (e6653, sumire), which I'm currently using

There's now also a Kernel for the dsds (Dual Slot/Sim) Version (E6633/E6683), but I can't test if it works due to lack of that very device - Enjoy !


Keep in mind that building for the Z5 "Stock" ROMs and "Stock" Kernels, you're constantly facing the following tradeoff:

• compatibility with pre-built "core" kernel modules (e.g. texfat [proprietary exfat microSD fs driver])
• compatibility with pre-built "goodies" kernel modules (e.g. video and other acceleration, hwcodecs, ...)
• losing features that can NOT be replaced by similar ones (e.g. ecryptfs, wlan, exfat, etc.)
• when going too far the device doesn't boot or simply hangs on bootanimation

this resulted in a couple branches (at least several dozen) that are partially or totally broken :silly:

[snip]
...
[snip]





More info on the Latest Kernel can be usually found at:

AT the end of the thread

( I KNOW - I should have reserved a few posts for better overview )

---------------------------------------------------------------------------------

[Download] How to get the current ("corona", 5.11) Kernel(s) - Step by Step:

1)
Choose your device from one of the 4 folders

Z5 + Z5 Dual:

• Stock Kernels: https://drive.google.com/open?id=0BykGGWB96CBQQy05VURLbzJTZlU
• Resurrection Remix: https://drive.google.com/open?id=0BykGGWB96CBQTnYzcGFURmhZbUk
• Carbon Rom 5.1:https://drive.google.com/open?id=0BykGGWB96CBQakJDRG03NTV0ZFU
• crDroid (3.7_HZ_4):https://drive.google.com/open?id=0BykGGWB96CBQdDVGNWxSR2ljdEk

Z5 Compact: https://drive.google.com/open?id=0BykGGWB96CBQVE0tb2dieTZMXzg
Z5 Prem + Z5 Prem Dual: https://drive.google.com/open?id=0BykGGWB96CBQaVZTdnF5QnVTMU0
Z4/Z3+ + Z4/Z3+ Dual: https://drive.google.com/open?id=0BykGGWB96CBQa2xBdHR5TzlrNUE

2)
At the upper right, click on "List View"

3)
At the top of the table, there are 3 labels (name, owner, [last] modified, File size)

click on "Last modified", the newest Kernels should be shown either at the top, or at the bottom

4)
Download the latest Kernel

5)
???

6)
Profit !

All other features, things should work - no guarantees


Before starting to test/use keep in mind that this is WIP (work in progress),

that means - NO guarantees,

backups before flashing are a MUST (especially your microSD card content !)

stability, speed, improved battery and satisfaction are a great side-effect to have.

You have been WARNED !


Enjoy !


Obligatory Source:
(according to the rules in single commits no giant blobs, authorship kept)

https://github.com/zachariasmaladroit/android_kernel_sony_msm8994_kitakami_r2/branches


Mentions/Kudos:

@AndroPlus thanks for your great kernel base and support for all of the Sony Xperia devices - you definitely are a Sensei in that area !
@Tommy-Geenexus another Sensei on the Xperia devices
@auras76 Thanks for your great ROM + Kernel !
@Adi Shakthi You are da man ! God's Kernel - there's truly no kernel like it ! @faux123 thanks for intelli_plug and Dynamic Fsync and all the other goodies - they are awesome ! :victory: @neobuddy89 Your kernels really inspire that there is more to be achieved @Cl3Kener @flar2 @DespairFactor @Imoseyon @showp1984 @myfluxi @savoca @franciscofranco @dorimanx @arter97 @ak @eng.stk You (and all other devs I might have forgotten) truly push progress forward !
Linus Torvalds - you started it all !
Richard Stallman - thanks for your "viral" license and GNU
Linux Kernel Devs , Linux Foundation
Google , Android @jerpelea @kholk The masters of the Sony Sauce @Grarak for Kernel Adiutor - for such a fine Kernel Command Center
@caspase for AppOpsXposed
@rovo89 for XPosed
@oasisfeng for Greenify

 

[albertobom]

Testing right now.
Thanks my friend. ?

Enviado desde mi E6653 mediante Tapatalk

---------- Post added at 03:01 AM ---------- Previous post was at 02:56 AM ----------

Just reporting...
Lost access to my 64 Gb micro sdcard

Enviado desde mi E6653 mediante Tapatalk

 

[_LLJY]

Is there undervolting in this?

 

[Tommy-Geenexus]

upcoming:

• Faux Sound Control for TomTom codec on WCD9330 ( someone can take a look whether the settings are correct for our device ? )

https://github.com/Tommy-Geenexus/android_kernel_sony_msm8994_suzuran_5.x/commit/be36a1e704207a10865d179c5425222bb526c2c1

This driver works on all Z4/Z5 variants. It is less bloated and safer than "Faux-Sound".

That said, i see no real for Sound Control to exist. There seem to be some issues with registers not properly resetting.
My only motivation of writing this was a partially broken headset.

 

[zacharias.maladroit]

Testing right now.
Thanks my friend.

Enviado desde mi E6653 mediante Tapatalk

---------- Post added at 03:01 AM ---------- Previous post was at 02:56 AM ----------

Just reporting...
Lost access to my 64 Gb micro sdcard

Enviado desde mi E6653 mediante Tapatalk

Thanks for your feedback,

that was to be expected though,

you get me an idea how to get about with the next iteration - hopefully then it should work.

How did you format your microSD card ?

Through the phone ? So the format must have been extfat ( then the missing textfat driver explain why it stopped to work, although the vfat or at least exfat driver should work, too )

Did you get a "SDcard corrupted" error ? I got it in the past but that was probably related to excessive flashing

Thanks !

Is there undervolting in this?

Of course, its base is AndroPlus Kernel,

this is more like of a playground to test out what works or doesn't with "Stock" Kernel Base - most of this (or ALL) works on the AOSP Kernel

https://github.com/Tommy-Geenexus/android_kernel_sony_msm8994_suzuran_5.x/commit/be36a1e704207a10865d179c5425222bb526c2c1

This driver works on all Z4/Z5 variants. It is less bloated and safer than "Faux-Sound".

That said, i see no real for Sound Control to exist. There seem to be some issues with registers not properly resetting.
My only motivation of writing this was a partially broken headset.

Thanks @Tommy-Geenexus no offense or hard feelings against your Sound Control driver,

I love its clean and slim approach !

the issue in the past when I tried it was that there was no GUI capable to drive it - when there's sound control I need a "live" - on-the-fly adaptation capability when doing changes to see how it affects output

(well, with mic, not so much)

Do you know of an app that supports that interface ? I'd be forever grateful

Thanks !

 

[Tommy-Geenexus]

Do you know of an app that supports that interface ? I'd be forever grateful

Thanks !

You could do a pull-request for kernel adiutor. I'm not sure if hex input is supported, but you can turn all hex vals into decimals. Then it would be fairly easy.

 

[albertobom]

I format my sdcard via phone.
Yes I get sdcard corrupted.
Also my sdcard is brand new. ?

Enviado desde mi E6653 mediante Tapatalk

 

[zacharias.maladroit]

You could do a pull-request for kernel adiutor. I'm not sure if hex input is supported, but you can turn all hex vals into decimals. Then it would be fairly easy.

I'll take a look - thanks

I format my sdcard via phone.
Yes I get sdcard corrupted.
Also my sdcard is brand new.

Enviado desde mi E6653 mediante Tapatalk

ugh - my bad,

that's some stupid error-handling - when the driver is gone or replaced with vfat, there must be no corruption

Hope the data is nevertheless intact (backups !),

I flashed A LOT of times during migration to AOSP and building it & testing kernels - so I had thought that the driver issues caused that corruption

Thanks

 

[zacharias.maladroit]

Okay,

here is one additional Kernel (v20_9-X_preview):

one-additional feature per branch (for the first 3 three below)

Z5_Sunkernel_Permissive_v20_9-VI_pluggin-only_ALL-OK.zip (Hotplug framework)

Z5_Sunkernel_Permissive_v20_9-IV_zram+lz4_ALL_OK.zip (zram + lz4)

Z5_Sunkernel_Permissive_v20_9-III_frandom+ext4_ALL_OK.zip (frandom + no entropy depletion with ext4)


Z5_Sunkernel_Permissive_v20_9-X_preview_ALL-OK.zip (camera fixes, DSP fixes, frandom, zram+lz4, hotplug, clearpad fix)


The Kernel features the following:

• Dynamic Fsync ( @faux123 )
• qdspv6v2 general improvements
• Sound: 320K AAC encoding support (from 192 kbit, thanks to @auras76 )
• wcd9330 (sound) fixed 24bit support (haven't tested due to lack of audios in that format)
• improved and fixed lpm (low power mode)
• frandom ( @Imoseyon and others ) + ext4 fixes to prevent entropy depletion
• general fixes and improvements to the memory subsystem and others
• optimized KSM (kernel samepage merging)
• Camera fixes & improvements (might make it more reliable and faster to react)
• scheduler improvements (picked by @auras76 )
• hotplug framework
• intelli_plug 4.0 by @faux123
• "Bricked Hotplug" by showp1984
• MSM Hotplug @neobuddy89
• cpu-boost improvements ( @neobuddy89 )
• MSM Limiter ( @neobuddy89 )
• reduced wakelocks for the Modem
• cpu-boost in charge of cpu scaling ( no mpdecision, thanks @neobuddy89 )
• some general scheduling improvements
• ext4 and writeback speed tweaks and stability improvements
• kthread fixes - improved reliability in case of OOM (related to LMK)
• clearpad (touchpad) potential FIX - answering phonecalls when dt2w (double-tap-to-wake) is enabled, but suspended and the driver confused, works again

Use-cases:

• 20_9-VI_pluggin: Hotplug, you know you want it
• 20_9-IV: zram+lz4 - for those who have countless apps running and e.g. use the Shallow Hibernation feature from Greenify), set swappiness to 90 and see what happens
• 20_9-III: could be an improvement for those with system encryption or use-cases that need more entropy fast
• 20_9-X_preview: ALL of the Above combined

texfat and ecryptfs drivers work - no modules report

"disagrees about symbol",

except core_ctl , which is intentional (MPDecision replaced by CPU-Boost handling)


Feedback:

- stability (crash ?)
- smoothness (some hotplug mechanisms are less smooth - I know, but battery should be better)
- increased, improved usability (e.g. with zram) with much more apps running flawless
- 20_9-X_preview: how do all the features interact, is it stable ? smooth (depending on settings) ? multi-tasking ?

...

Enjoy !



ninja edit:

removed all the kernel builds, re-compiling with (re-added) upstream fixes from AndroPlus

will only upload 20_9-X_preview

ninja edit.


Kernel Sauce:

Sun-Kernel_32.1.A.0.xxx_AP-mod-v20_9-X



Once I get enough features working flawless in combination - the next step is to combine all into one terrific kernel - like, e.g. God's Kernel

 

[albertobom]

Okay,

here is one additional Kernel (v20_9-X_preview):

one-additional feature per branch (for the first 3 three below)

Z5_Sunkernel_Permissive_v20_9-VI_pluggin-only_ALL-OK.zip (Hotplug framework)

Z5_Sunkernel_Permissive_v20_9-IV_zram+lz4_ALL_OK.zip (zram + lz4)

Z5_Sunkernel_Permissive_v20_9-III_frandom+ext4_ALL_OK.zip (frandom + no entropy depletion with ext4)


Z5_Sunkernel_Permissive_v20_9-X_preview_ALL-OK.zip (camera fixes, DSP fixes, frandom, zram+lz4, hotplug, clearpad fix)


The Kernel features the following:

• Dynamic Fsync ( @faux123 )
• qdspv6v2 general improvements
• Sound: 320K AAC encoding support (from 192 kbit, thanks to @auras76 )
• wcd9330 (sound) fixed 24bit support (haven't tested due to lack of audios in that format)
• improved and fixed lpm (low power mode)
• frandom ( @Imoseyon and others ) + ext4 fixes to prevent entropy depletion
• general fixes and improvements to the memory subsystem and others
• optimized KSM (kernel samepage merging)
• Camera fixes & improvements (might make it more reliable and faster to react)
• scheduler improvements (picked by @auras76 )
• hotplug framework
• intelli_plug 4.0 by @faux123
• "Bricked Hotplug" by showp1984
• MSM Hotplug @neobuddy89
• cpu-boost improvements ( @neobuddy89 )
• MSM Limiter ( @neobuddy89 )
• reduced wakelocks for the Modem
• cpu-boost in charge of cpu scaling ( no mpdecision, thanks @neobuddy89 )
• some general scheduling improvements
• ext4 and writeback speed tweaks and stability improvements
• kthread fixes - improved reliability in case of OOM (related to LMK)
• clearpad (touchpad) potential FIX - answering phonecalls when dt2w (double-tap-to-wake) is enabled, but suspended and the driver confused, works again

Use-cases:

• 20_9-VI_pluggin: Hotplug, you know you want it
• 20_9-IV: zram+lz4 - for those who have countless apps running and e.g. use the Shallow Hibernation feature from Greenify), set swappiness to 90 and see what happens
• 20_9-III: could be an improvement for those with system encryption or use-cases that need more entropy fast
• 20_9-X_preview: ALL of the Above combined

texfat and ecryptfs drivers work - no modules report

"disagrees about symbol",

except core_ctl , which is intentional (MPDecision replaced by CPU-Boost handling)


Feedback:

- stability (crash ?)
- smoothness (some hotplug mechanisms are less smooth - I know, but battery should be better)
- increased, improved usability (e.g. with zram) with much more apps running flawless
- 20_9-X_preview: how do all the features interact, is it stable ? smooth (depending on settings) ? multi-tasking ?

...

Enjoy !



ninja edit:

removed all the kernel builds, re-compiling with (re-added) upstream fixes from AndroPlus

will only upload 20_9-X_preview

ninja edit.


Kernel Sauce:

Sun-Kernel_32.1.A.0.xxx_AP-mod-v20_9-X



Once I get enough features working flawless in combination - the next step is to combine all into one terrific kernel - like, e.g. God's Kernel

Dear zacharias.maladroit is possible to make a thread how to tuning a kernel properly?

Enviado desde mi E6653 mediante Tapatalk

---------- Post added at 10:22 PM ---------- Previous post was at 09:59 PM ----------

Apparently xreality stop working. ?

Enviado desde mi E6653 mediante Tapatalk

 

[zacharias.maladroit]

Dear zacharias.maladroit is possible to make a thread how to tuning a kernel properly?

Enviado desde mi E6653 mediante Tapatalk

---------- Post added at 10:22 PM ---------- Previous post was at 09:59 PM ----------

Apparently xreality stop working.

Enviado desde mi E6653 mediante Tapatalk

First part:

I've still too little experience and information on this kernel to really efficiently tweak it,

but will soon post a few preliminary settings to either get a good balance of a battery vs. performance

and runtime & running cool



Hm, thanks for the report,

the preview under settings doesn't show a change anymore once it's switched on or off ?

I still can see a difference,

only with the Video Player I also noticed some kind of change,

perhaps I'm used to 4K videos too much - so I'm over-reacting a bit to HD or lower res videos


This works with AndroPlus v20 and v21, right ?

 

[korom42]

Keep up the great work .. I am following the , I may test this later

 

[goRt]

Dear zacharias.maladroit is possible to make a thread how to tuning a kernel properly?

Enviado desde mi E6653 mediante Tapatalk

---------- Post added at 10:22 PM ---------- Previous post was at 09:59 PM ----------

Apparently xreality stop working. ?

Enviado desde mi E6653 mediante Tapatalk

There's no reason to keep copying the whole post when it doesn't relate to your question.
Some of us try to read this on our phone!

Sent from my E6653 using Tapatalk

 

[albertobom]

Sorry about that guys.
Apparently the xreality problem is due to rom booster app. Nothing to due with your kernel at all. Everything is fine. ?

Enviado desde mi E6653 mediante Tapatalk

 

[_LLJY]

This kernel is stable, has eh ish battery life(could do better), has excellent thermals(when undervolted to -355mv) but overall I would say great job but how do I use the sound control I'm the kernel?

 

[zacharias.maladroit]

This kernel is stable, has eh ish battery life(could do better), has excellent thermals(when undervolted to -355mv) but overall I would say great job but how do I use the sound control I'm the kernel?

Thanks for the feedback !

So, hm - is that battery life worse than with AndroPlus v21 ?

I assumed something like that but wasn't sure - perhaps the hotplugging is draining battery,

the best option would be to use CPUQUIET Hotplug Framework with runnable governor - which I also successfully ported, but something wasn't working fine with the "Stock" (Sony's) ROM

What are your settings for Hotplugging ? What is your governor ?

Sound Control isn't implemented yet (not in kernel right now), I'll use Tommy-Geenexus 's TomTom Sound Control in the future, so you'll have to set the values via terminal or script until support for it is included in Kernel Adiutor ("helper") or other tools

 

[zacharias.maladroit]

Updated first post with new kernel that the folks over at Z5 Premium also got

new goodies !

Enjoy !

 

[_LLJY]

Thanks for the feedback !

So, hm - is that battery life worse than with AndroPlus v21 ?

I assumed something like that but wasn't sure - perhaps the hotplugging is draining battery,

the best option would be to use CPUQUIET Hotplug Framework with runnable governor - which I also successfully ported, but something wasn't working fine with the "Stock" (Sony's) ROM

What are your settings for Hotplugging ? What is your governor ?

Sound Control isn't implemented yet (not in kernel right now), I'll use Tommy-Geenexus 's TomTom Sound Control in the future, so you'll have to set the values via terminal or script until support for it is included in Kernel Adiutor ("helper") or other tools

Yes the battery life is worse than AndroPlus kernel (I only enabled intelliplug)

[

/QUOTE]

 

[zacharias.maladroit]

Yes the battery life is worse than AndroPlus kernel (I only enabled intelliplug)

On hindsight I believe it really comes down to configuration and usage of wakelock blockers and aggressive Doze,

agreed that it might consume more battery during operation (and offer more performance) - but there are also improvements for LPM (low power mode) that should really cut down

the battery consumption when the device is really able to sleep.

It's much harder to cut down the garbage on Sony's ROM compared to AOSP as a base where almost no additional cruft is running,

but it might (possibly) be achievable,

I've it currently down to 2% in 4 hours idle in Airplane - 0.5% per hour.

Main tools used are:

- Greenify ("boosted" with XPosed) and "Aggressive Doze"
- Amplify with pretty default settings
- AppOpsXposed with Wakelock ( "keep awake" disabled for most apps (section device) that are at the top (recently requested) - such as Camera, Google Play*, and a bunch more)
- Titanium Backup (freezing com.sonymobile.anonydata and devicemonitor, Service Menu and some more - since those also consume some battery)

AndroidSystem is at the top of consumers keeping the phone awake/using battery under GSam Battery,

but I'm a little hesitant right now to disable the "Keep awake" functionality if the phone stops to work properly


edit:

Go away forum quotation function ! You're drunk !

 

[zacharias.maladroit]

Any Sony Xperia Z5 Dual (e6683) users here ?

You need a dedicated build, too ?