[REFERENCE] How to compile an Android kernel

Search This thread

zainifame

Senior Member
Aug 26, 2015
509
129
Lampung
Lenovo K900
Samsung Galaxy Fame
Sorry, does anyone know how to extract kernel tarball contain linux permission and symlink file or folder on internal/local android storage? I've extracted kernel from lenovo oss but I've problem with loosing actual permission and symlink from compressed kernel oem provide, thanks

Sent from my Redmi 3S using XDA Labs
 

Ani96

Senior Member
Mar 21, 2017
238
93
KOLKATA
How can I under-volt my kernel . ? Where I can find that script in kernel source? Thanks. .in adv
 

Uzephi

Inactive Recognized Contributor
Apr 20, 2012
3,439
1,892
Phoenix
Google Pixel 3a
How can I under-volt my kernel . ? Where I can find that script in kernel source? Thanks. .in adv

That really depends. Also if you have to ask, you probably shouldn't attempt it.

E.G. my device's dtsi for voltages and clocks are at " arch/arm/boot/dts/qcom/msm8998-v2.dtsi" If you don't have a pixel 2, 2 XL, OP5 or Z2 force, do not edit that file, it'd be useless. Each chipset uses a different dtsi file.
 
Last edited:
  • Like
Reactions: Ani96

hightech316

Senior Member
Jan 27, 2011
1,281
220
github.com
OnePlus 8T
Great write up!

I've followed the steps and attempted to compile for galaxy j7 exynos 7580 kernel.

Ran into some errors, ended up getting past them to only another! Now I understand why you must have patience!

The latest error is,

error loading plugin: /dev-a7000/j7dev/techOS/Kernel/uberTC64/bin/../libexec/gcc/aarch64-linux-android/4.9.4/liblto_plugin.so: file too short
collect2: error: ld returned 1 exit status
/dev-a7000/j7dev/techOS/Kernel/arch/arm64/kernel/vdso/Makefile:27: recipe for target 'arch/arm64/kernel/vdso/vdso.so.dbg' failed
make[2]: *** [arch/arm64/kernel/vdso/vdso.so.dbg] Error 1
scripts/Makefile.build:455: recipe for target 'arch/arm64/kernel/vdso' failed
make[1]: *** [arch/arm64/kernel/vdso] Error 2
Makefile:841: recipe for target 'arch/arm64/kernel' failed
make: *** [arch/arm64/kernel] Error 2
make: *** Waiting for unfinished jobs....

Which seems like an issues with my toolchain?

Error 1
scripts/Makefile.build:455: recipe for target 'arch/arm64/kernel/vdso' failed

I'm sure Ill get past by going through defconfig and checking vdso?

Thanks for this reference, it was very helpful .
 
Last edited:

logan71f100

Member
Apr 9, 2014
38
1
HERSHEY, PA
need a little help
trying to compile nexus 6 for android 8.0 using https://github.com/AICP/kernel_moto_shamu/tree/o8.0

i used the google toolchain as stated because up streaming needs patchs, and id like to upstream but im not that good. i get this after i run make:
/home/logan/android_kernel_moto_shamu/scripts/gcc-version.sh: line 25: /home/logan/arm-eabi-4.8gcc: No such file or directory
/home/logan/android_kernel_moto_shamu/scripts/gcc-version.sh: line 26: /home/logan/arm-eabi-4.8gcc: No such file or directory

i did exactly like ZawZaw did
--------------------------------------------------------------------------------------
export CROSS_COMPILE=${HOME}/arm-eabi-4.8

export ARCH=arm && export SUBARCH=arm

make clean && make mrproper
---------------------------------------------------------------------------------------

everything seems to be in the right location and named the correct stuff
https://ibb.co/nvLKsR


my goal is to enable over clocking by modifying the frequency configs, if this cannot be done please let me know.... i haven't found any 8.0 kernels for shamu yet.... please enlighten me
 
Last edited:

nathanchance

Senior Recognized Developer / Contributor
Jul 22, 2015
13,760
50,106
29
Mesa, AZ
nathanchance.dev
need a little help
trying to compile nexus 6 for android 8.0 using https://github.com/AICP/kernel_moto_shamu/tree/o8.0

i used the google toolchain as stated because up streaming needs patchs, and id like to upstream but im not that good. i get this after i run make:
/home/logan/android_kernel_moto_shamu/scripts/gcc-version.sh: line 25: /home/logan/arm-eabi-4.8gcc: No such file or directory
/home/logan/android_kernel_moto_shamu/scripts/gcc-version.sh: line 26: /home/logan/arm-eabi-4.8gcc: No such file or directory

i did exactly like ZawZaw did
--------------------------------------------------------------------------------------
export CROSS_COMPILE=${HOME}/arm-eabi-4.8/bin/arm-eabi-

export ARCH=arm && export SUBARCH=arm

make clean && make mrproper
---------------------------------------------------------------------------------------

everything seems to be in the right location and named the correct stuff
https://ibb.co/nvLKsR


my goal is to enable over clocking by modifying the frequency configs, if this cannot be done please let me know.... i haven't found any 8.0 kernels for shamu yet.... please enlighten me

I've highlighted the error in red
 

nathanchance

Senior Recognized Developer / Contributor
Jul 22, 2015
13,760
50,106
29
Mesa, AZ
nathanchance.dev

logan71f100

Member
Apr 9, 2014
38
1
HERSHEY, PA

i was looking at this https://www.youtube.com/watch?v=lBYRLc5GKAI

but what you sent is way better, do you think i would be able to pull that whole file out of a kernel like elementalx? i used that kernel for some time and voltages where perfect.

https://github.com/flar2/shamu/blob/ElementalX-5.00/arch/arm/boot/dts/qcom/apq8084.dtsi
comparing this one to the one from your link i know elementalx allows for a 3.0 ghz overclock but it may be applying it in ramdisk.... do you think if i add a frequency in the current and frequency list for each cpu that it would use it?
 
Last edited:

nathanchance

Senior Recognized Developer / Contributor
Jul 22, 2015
13,760
50,106
29
Mesa, AZ
nathanchance.dev
i was looking at this https://www.youtube.com/watch?v=lBYRLc5GKAI

but what you sent is way better, do you think i would be able to pull that whole file out of a kernel like elementalx? i used that kernel for some time and voltages where perfect.

https://github.com/flar2/shamu/blob/ElementalX-5.00/arch/arm/boot/dts/qcom/apq8084.dtsi
comparing this one to the one from your link i know elementalx allows for a 3.0 ghz overclock but it may be applying it in ramdisk.... do you think if i add a frequency in the current and frequency list for each cpu that it would use it?

Code:
git fetch https://github.com/flar2/shamu ElementalX-5.00
git cherry-pick eb8d56044571a4e597e7665aef1edcc4e2c1bd95

That's the proper way to add the change from one kernel to another.

Code:
git fetch <repo_url> <branch_name>
git cherry-pick <commit_hash>
 
  • Like
Reactions: DsturbD

Qiangong2

Senior Member
Oct 31, 2014
1,452
381
Samsung Galaxy S20
I have been trying to build a kernel for my mediatek device for a while now. I was given an incomplete kernel source and now it does not build when I use "make zImage".

It always gets stuck at xt_TCPMSS.c with this error:

Code:
net/netfilter/xt_TCPMSS.c: In function 'tcpmss_mt':
net/netfilter/xt_TCPMSS.c:64:26: error: dereferencing pointer to incomplete type
    return (mssval >= info->mss_min &&
                          ^
net/netfilter/xt_TCPMSS.c:65:19: error: dereferencing pointer to incomplete type
     mssval <= info->mss_max) ^ info->invert;
                   ^
net/netfilter/xt_TCPMSS.c:65:36: error: dereferencing pointer to incomplete type
     mssval <= info->mss_max) ^ info->invert;
                                    ^
net/netfilter/xt_TCPMSS.c:73:13: error: dereferencing pointer to incomplete type
  return info->invert;
             ^
net/netfilter/xt_TCPMSS.c: At top level:
net/netfilter/xt_TCPMSS.c:85:23: error: invalid application of 'sizeof' to incomplete type 'struct xt_tcpmss_match_info'
   .matchsize = sizeof(struct xt_tcpmss_match_info),
                       ^
net/netfilter/xt_TCPMSS.c:93:23: error: invalid application of 'sizeof' to incomplete type 'struct xt_tcpmss_match_info'
   .matchsize = sizeof(struct xt_tcpmss_match_info),
                       ^
scripts/Makefile.build:257: recipe for target 'net/netfilter/xt_TCPMSS.o' failed

There are no other errors.
Here is my kernel source (due to issues with travis-ci, the true stock branch is stock2 and dev is "stock"): https://github.com/Qiangong2/android_kernel_blu_d790q

I'm worried that just copying the xt_TCPMSS.c file from another MT6580 device may brick my device. That is why I have not tried that yet.
 

Top Liked Posts

  • There are no posts matching your filters.
  • 1
    How can I compile a 5.x kernel using the 3.18 source? My device doesn’t have newer source.
    sorry I haven't tried, I'm also newbie. I will try first and may tell you if success
  • 240
    Introduction

    Hello everyone, I will be going over how to compile a kernel from beginning to end!

    Prerequisites:
    • A Linux environment (preferably 64-bit)
    • Knowledge of how to navigate the command line
    • Common sense
    • A learning spirit, there will be no spoonfeeding here

    What this guide will cover:
    1. Downloading the source
    2. Downloading a cross compiler
    3. Building the kernel
    4. Flashing the kernel

    What this guide will NOT cover:
    • Setting up a build environment (plenty of existing Linux installation guides)
    • Adding features to the kernel (plenty of git cherry-picking guides)

    I know this has been done before but on a cursory search, I have not seen a guide that was recently updated at all.


    1. Downloading the source


    If you have a custom kernel you want to build, move along after cloning the kernel using the git clone command below.

    If you are compiling your stock kernel, it is ultimately up to you to know where to get your kernel source from but here are some common places:

    Google: https://android.googlesource.com/kernel/msm/ (pick your architecture and look at the branches)
    LG: http://opensource.lge.com/index
    Samsung: http://opensource.samsung.com/reception.do
    HTC: https://www.htcdev.com/devcenter/downloads
    OnePlus: https://github.com/OnePlusOSS
    Motorola: https://github.com/MotorolaMobilityLLC
    Sony: https://github.com/sonyxperiadev/kernel

    To download the kernel, you can either use git clone or download the tarball and extract it:
    Code:
    git clone -b <branch_to_checkout> <url> <desired_folder_name>
    
    OR
    
    tar -xvf <filename>

    For example, if I wanted to grab the latest Nexus 6P from Google above:
    Code:
    git clone -b android-msm-angler-3.10-nougat-mr2 https://android.googlesource.com/kernel/msm/ angler
    This will clone the kernel/msm repo into an angler folder and checkout the android-msm-angler-3.10-nougat-mr2 automatically.

    I can try and help you locate your source if necessary.



    2. Downloading a cross compiler


    Since most Android devices are ARM based, we need a compiler that is targeting ARM devices. A host (or native) compiler will not work unless you are compiling on another ARM device.

    You can either compile one yourself if you know how (crosstool-NG is a great tool for this) or download a prebuilt one. Luckily Google provides a high quality toolchain for this, in both an arm (32-bit) and arm64 (64-bit). It's up to you to know the architecture of your device. Typically speaking, most devices in the past two-three years are 64-bit.

    Another popular toolchain is UberTC, which can be found here: https://bitbucket.org/matthewdalex/. Most kernels will need patches for anything higher than 4.9 and while I don't mind assisting with finding them, you should compile with Google's toolchain first.

    Once you have decided, clone the toolchain:
    Code:
    git clone <url>


    3. Compile the kernel


    1. Point the Makefile to your compiler (run this from within the toolchain folder!!)
    Code:
    export CROSS_COMPILE=$(pwd)/bin/<toolchain_prefix>-
    Example:
    Code:
    export CROSS_COMPILE=$(pwd)/bin/aarch64-linux-android-

    NOTE #1: For kernels that can be compiled with Clang (like the Pixel 2), see this guide. I will support it here if there are any questions.

    NOTE #2: Pixel and Pixel 2 users, you will need to follow these steps as well if compiling for Android Pie.

    2. Tell the Makefile the architecture of the device
    Code:
    export ARCH=<arch> && export SUBARCH=<arch>
    Example:
    Code:
    export ARCH=arm64 && export SUBARCH=arm64

    3. Locate your proper defconfig
    Navigate to the arch/<arch>/configs folder within the kernel source (e.g. arch/arm64/configs) and locate your device's or custom kernel developer's proper config file. For example, it will often be in the form of <codename>_defconfig or <kernel_name>_defconfig. Generic Qualcomm configs may be used as well (msm-perf_defconfig, msmcortex-perf_defconfig). When in doubt, ask here if you are confused. A defconfig tells the compiler what options to add to the kernel.

    4. Build the kernel

    Code:
    make clean
    make mrproper
    make <defconfig_name>
    make -j$(nproc --all)

    If those commands succeed, you will have an Image, Image-dtb, Image.gz, or Image.gz-dtb file at the end.

    If it failed, as was pointed out to me by @flar2 while making a complete idiot of myself, you may need to specify an output directory while making new CAF based kernels, like so:
    Code:
    mkdir -p out
    make O=out clean
    make O=out mrproper
    make O=out <defconfig_name>
    make O=out -j$(nproc --all)

    If after that something is still broken, you may need to fix some headers or other issues. If it is a custom kernel, bring it up with your developer.
    If it's an OEM, it's up to you to try and fix it, which we can assist with.



    4. Flash the kernel


    Assuming you were able to compile the kernel successfully, you now need to flash it! I will be covering two different ways to flash a compiled kernel: unpacking and repacking the boot image by hand using Android Image Kitchen or AnyKernel2, both by the brilliant @osm0sis. If there are any per-device nuances, please let me know and I'll add them here! Additionally, this section can vary drastically by device, you may need to consult developers of your device for assistance if necessary.

    Android Image Kitchen

    1. Pull your device's boot image from the latest image available for your device (whether it be a ROM or stock)
    2. Download the latest Android Image Kitchen from this thread.
    3. Run the following with the boot image:
      Code:
      unpackimg.sh <image_name>.img
    4. Locate the zImage file and replace it with your kernel image (rename it to what came out of the boot image)
    5. Run the following to repack:
      Code:
      repackimg.sh
    6. Flash the new boot image with fastboot or TWRP!

    AnyKernel2

    1. Download the latest AnyKernel2 zip: https://github.com/osm0sis/AnyKernel2/archive/master.zip
    2. Apply this patch to clean out all of the demo files:
      Code:
      wget https://github.com/nathanchance/AnyKernel2/commit/addb6ea860aab14f0ef684f6956d17418f95f29a.diff
      patch -p1 < addb6ea860aab14f0ef684f6956d17418f95f29a.diff
      rm addb6ea860aab14f0ef684f6956d17418f95f29a.diff
    3. Place your kernel image in the root of the file.
    4. Open the anykernel.sh file and modify the following values:
      • kernel.string: your kernel name
      • device.name#: List all of your device's codenames (from the /system/build.prop: ro.product.device, ro.build.product)
      • block: Your boot image's path in your fstab. The fstab can be opened from the root of your device and it will look something like this:
        https://android.googlesource.com/device/huawei/angler/+/master/fstab.angler
        The first column is the value you want to set block to.
    5. After that, zip up the kernel and flash it!
      Code:
      zip -r9 kernel.zip * -x README.md kernel.zip


    Tips and tricks


    1. Remove GCC wrapper

    A lot of kernels from CAF include a Python script that will essentially turn on -Werror, causing your build to error at the most benign stuff. This is necessary with higher GCC versions as there are a lot more warnings.

    Here is the diff of what you need to change in the Makefile:
    Code:
    diff --git a/Makefile b/Makefile
    index 1aaa760f255f..bfccd5594630 100644
    --- a/Makefile
    +++ b/Makefile
    @@ -326,7 +326,7 @@ include $(srctree)/scripts/Kbuild.include
    
     AS		= $(CROSS_COMPILE)as
     LD		= $(CROSS_COMPILE)ld
    -REAL_CC		= $(CROSS_COMPILE)gcc
    +CC		= $(CROSS_COMPILE)gcc
     CPP		= $(CC) -E
     AR		= $(CROSS_COMPILE)ar
     NM		= $(CROSS_COMPILE)nm
    @@ -340,10 +340,6 @@ DEPMOD		= /sbin/depmod
     PERL		= perl
     CHECK		= sparse
    
    -# Use the wrapper for the compiler.  This wrapper scans for new
    -# warnings and causes the build to stop upon encountering them.
    -CC		= $(srctree)/scripts/gcc-wrapper.py $(REAL_CC)
    -
     CHECKFLAGS     := -D__linux__ -Dlinux -D__STDC__ -Dunix -D__unix__ \
     		  -Wbitwise -Wno-return-void $(CF)
     CFLAGS_MODULE   =

    2. Using a higher level GCC toolchain

    Using a higher GCC toolchain (5.x, 6.x, 7.x or even 8.x) will require you to nuke the GCC wrapper script as above and use a unified GCC header file (pick the following if you have an include/linux/compiler-gcc#.h file):

    3.4/3.10: https://git.kernel.org/pub/scm/linu...h?id=a4a4f1cd733fe5b345db4e8cc19bb8868d562a8a
    3.18: https://git.kernel.org/pub/scm/linu...h?id=677fa15cd6d5b0843e7b9c58409f67d656b1ec2f

    You may get a lot of warnings but they are not entirely necessary to fix.


    3. Adding upstream Linux to kernel source

    Once you have gotten familiar with git and the compilation process, you should consider upstreaming your kernel. This will allow you to stay on top of CVE and bug fixes by staying up to date with the latest work of the Linux kernel developers.



    Receiving help

    I am happy to answer anything that I touched on in this guide. I may point you to another thread if it's better suited but I don't mind off topic (within reason) within the thread. I also want this to be a collaborative effort; other developers, if you have something to add, correct, or improve upon, please let me know!

    I am particular in how people ask for help. I do NOT respond to posts asking for a hand out ("How do I fix this?", "Please fix this!", etc.). I only respond to posts with clear logs and steps that you have tried. Basically, show me that you have read this guide and have a specific issue. I am not here to hold your hand through this, this is a developers' forum.
    20
    Compile Android Pie kernels for the Pixel (XL) and Pixel 2 (XL)

    Google added a new compat vDSO on Android Pie for 32-bit userspace, which requires a 32-bit toolchain (commit). As a result, if CROSS_COMPILE_ARM32 is not set, your build will error.

    After setting your main CROSS_COMPILE in step 1, clone this toolchain (or another compatible arm toolchain) next to the aarch64 one (if in the toolchain folder after running 'export CROSS_COMPILE', type 'cd ..'). Move into the 32-bit toolchain folder using cd then run
    Code:
    export CROSS_COMPILE_ARM32=$(pwd)/bin/<toolchain_prefix>
    Example:
    Code:
    export CROSS_COMPILE_ARM32=$(pwd)/bin/arm-linux-androideabi-

    Then continue on with the rest of the steps.
    9
    Introduction

    I am happy to answer anything that I touched on in this guide. I may point you to another thread if it's better suited but I don't mind off topic (within reason) within the thread. I also want this to be a collaborative effort; other developers, if you have something to add, correct, or improve upon, please let me know!

    I am particular in how people ask for help. I do NOT respond to posts asking for a hand out ("How do I fix this?", "Please fix this!", etc.). I only respond to posts with clear logs and steps that you have tried. Basically, show me that you have read this guide and have a specific issue. I am not here to hold your hand through this, this is a developers' forum.

    On a scale of 1-10 how much Off-Topic is allowed ? :highfive::laugh::silly::eek:





    Nice guide :good: :highfive: ..



    8
    @nathanchance thx for great work
    But how to build kernel with gcc 9.2.0
    could you please add manual for that

    Unfortunately, my time nowadays is limited between my job, school, and more important open source projects.

    However, compiling with GCC 9.2.0 is the same as compiling with GCC 4.9.4, you point the CROSS_COMPILE variable at the GCC 9.2.0 toolchain (or use PATH and update the CROSS_COMPILE prefix to match) and go from there. There are probably going to be new warnings that you will need to solve and there are potentially some other commits that you will need to pick to get a boot off.

    If anyone else wants to pitch in and write something up, I'd be happy to add it to the OP.
    7
    You're on fire with this kernel stuff:D

    Sent from my LEX727 using XDA Labs