[SOURCES] [DevXchange] Android Sources Highly Compressed & Developer Exchange

Status
Not open for further replies.
Search This thread
S

ShadowLeaf

Guest
@MSF Jarvis Can you please update cm11 sources because security patches and other things have been updated in the sources

Sent From My GT-S7582 using Tapatalk
 

MSF Jarvis

XDA Feed Mod/Inactive RC
Mar 31, 2015
3,820
7,476
msfjarvis.dev
@MSF Jarvis Can you please update cm11 sources because security patches and other things have been updated in the sources

Sent From My GT-S7582 using Tapatalk
My main build server is currently down, my friend and mentor who hosted it for me is shifting office at the moment. I'll see if I can use any of my backup nodes but it may take some time. You want repo or non-repo? BTW, repo folder makes no sense because you'll run repo sync and it will automatically update to the latest, no matter when it was compressed.

Sent from my Pixel V1 using XDA Labs
 
S

ShadowLeaf

Guest
My main build server is currently down, my friend and mentor who hosted it for me is shifting office at the moment. I'll see if I can use any of my backup nodes but it may take some time. You want repo or non-repo? BTW, repo folder makes no sense because you'll run repo sync and it will automatically update to the latest, no matter when it was compressed.

Sent from my Pixel V1 using XDA Labs
I don't want repo. If my net would have been fast then I would have already downloaded repo and repo synced the sources. But my net is slow so I want non-repo sources

Sent From My GT-S7582 using Tapatalk
 

MSF Jarvis

XDA Feed Mod/Inactive RC
Mar 31, 2015
3,820
7,476
msfjarvis.dev
Wow, you are so fast :D Thanks :D

Sent From My GT-S7582 using Tapatalk
Blame scaleway.com for it ;) Must have finished compressing, I'm working on my school's app so forgot it. Lemme see if I can upload it to AFH real quick :)

Edit : Nope, hasn't finished compressing yet, currently on the toolchains. I'll upload it as soon as it's finished

Sent from my Pixel V1 using XDA Labs
 
S

ShadowLeaf

Guest
Blame scaleway.com for it ;) Must have finished compressing, I'm working on my school's app so forgot it. Lemme see if I can upload it to AFH real quick :)

Sent from my Pixel V1 using XDA Labs
I just wanted to say thanks bro :D

Sent From My GT-S7582 using Tapatalk

---------- Post added at 03:30 PM ---------- Previous post was at 03:23 PM ----------

Blame scaleway.com for it ;) Must have finished compressing, I'm working on my school's app so forgot it. Lemme see if I can upload it to AFH real quick :)

Edit : Nope, hasn't finished compressing yet, currently on the toolchains. I'll upload it as soon as it's finished

Sent from my Pixel V1 using XDA Labs
Just I wanted to say thanks to you. I have only 50kbps download speed so you can imagine how difficult it is for me.

Sent From My GT-S7582 using Tapatalk
 
S

ShadowLeaf

Guest
Still compressing, the toolchains are the biggest in size, and they're compiled code, so don't compress much too. I'll let you all know when it's done and uploaded.

Sent from my Pixel V1 using XDA Labs
Thanks :) :D By the which server plan you are using. Scaleway has good pricing. We can buy and upgrade the size of SSD, that's cool :D

Sent From My GT-S7582 using Tapatalk
 

MSF Jarvis

XDA Feed Mod/Inactive RC
Mar 31, 2015
3,820
7,476
msfjarvis.dev
Thanks :) :D By the which server plan you are using. Scaleway has good pricing. We can buy and upgrade the size of SSD, that's cool :D

Sent From My GT-S7582 using Tapatalk
I've got a developer account that costs €5.99 per month and then additional servers costs vary, depending upon configuration. Mine is a VCS1 instance with the fully specced-out hardware. Don't remember how much it costs

Sent from my Pixel V1 using XDA Labs
 
S

ShadowLeaf

Guest
I've got a developer account that costs €5.99 per month and then additional servers costs vary, depending upon configuration. Mine is a VCS1 instance with the fully specced-out hardware. Don't remember how much it costs

Sent from my Pixel V1 using XDA Labs
Good :D Can I ask for more sources ?

Sent From My GT-S7582 using Tapatalk
 

htb2050

Senior Member
Apr 8, 2009
1,304
602
I've got a developer account that costs €5.99 per month and then additional servers costs vary, depending upon configuration. Mine is a VCS1 instance with the fully specced-out hardware. Don't remember how much it costs

Sent from my Pixel V1 using XDA Labs
Quick Question, do they accept payments directly from credit cards or do they use some middle man like paypal or 2checkout? Also is 50GB enough space for making a build only for a single device? I should get myself one of these. They also allow making a seedbox so my uses are infinite.
 
Status
Not open for further replies.

Top Liked Posts

  • There are no posts matching your filters.
  • 125
    qr98avA.png

    Ss8GksS.png

    Project abandoned, please do not submit pull requests.

    Disclaimer: The wordings in the thread are meant to be noob-friendly and for newer developers that have just dipped their feet into Android platform development. Hence, they won't be accurate in many places for the 'geek'. Also, we had started distributing shallow cloned sources with a depth of '1' instead of non-repo sources (as they are more or less of the same size). So this should not be a problem for the ROM developers in our opinion as they can be fetched by syncing.

    Hello!
    We, Android Developers, have many problems. One such of them is "SLOW INTERNET" or even "LOW BANDWIDTH".
    Due to these problems, we are unable to sync the BIG chunk of Android source codes from the respective repositories.
    Hence, most of the new and learning developers just fail at the first step: Downloading The Source Code!
    So, here I present you with a thread, which contains links to download "HIGHLY COMPRESSED", untouched (unmodified) and full Android source codes of many different ROMs!
    The links to the highly compressed source codes you will find here are not uploaded by me alone. There are many other people that have contributed.
    Some of them are: @DigiGoon @MSF Jarvis and @regalstreak (me)

    jPIwEta.png

    So, Let's begin!
    First things first.
    You should know what a repo is.
    I quote XDA:

    What is Repo?
    Repo is a repository management tool built on top of Git.

    It’s first purpose is to downloads files from multiple git repositories into your local working directory (aka the source tree). That means that you won’t have to manually download or fetch the latest changes from about 300+ projects (depending on if you are downloading AOSP, CM or AOKP for example), repo will do it for you.

    The second purpose of repo is to made it easy to submit your code contributions for review to a Gerrit server.
    When you download a source code with repo, you get a folder named .repo in your working directory. It contains all the compressed .git format files that need to be in the source code.
    After the source has been downloaded, the repo tool decompresses the files from the ".repo" folder and you get the source code in the working directory itself!
    This project will give you a highly compressed shallow cloned and full tarball of the sources (for those who can't download it via repo or have limited speeds on github/aosp servers). More information is given in the FAQ section. It is must-read. Without it, you won't understand how to use these.

    Note: You cannot go from CM12 source to CM12.1 or going CM12 to CM13 as these are different branches on the CyanogenMod repo. No way doing that. You will have to manually download the new source.

    t86aGPB.png

    So, We are done with the information!
    Now, The interesting part. The sources!

    Note: All links on this thread are tap friendly! They open in new tabs :)

    I have divided this into several sections for ease of reading and getting the sources. They are:

    65
    As you know that we have been using the Skadoosh script recently, which is made by me (@regalstreak), @MSF Jarvis and @DigiGoon, all our sources are being uploaded to one common folder on AndroidFileHost.
    This is an automated process in which you submit a Pull Request on the Skadoosh's git and the required source will be available to you soon after it.
    More information regarding the process is on Post 3 by @MSF Jarvis
    The link to the folder where all the sources are uploaded is Here.
    The old upload afh folder can be found Here
    If you have any other issues regarding the sources, please mention us here. We will be happy to help you. Please read the FAQ before doing stuff.
    59
    FAQ

    Q1> How should I extract the source?
    Ans:

    First you will have to join the archive parts into one big archive. Download all the parts. Then put all parts in one folder. Verify md5sum by
    Code:
    md5sum -c *.md5sum
    Then do
    Code:
    cat *.tar.* > yourbigarchivename.tar.xz
    Just quote me if you don't understand this. I'll help you out.

    If your archive is in .tar.xz format, do this:
    • Open Terminal
    • Now cd to the drive where you have downloaded the sources
    • Extract it
      Code:
      tar -xvJf (file name here).tar.xz

    If your archive is in .tar.gz format, so do this:
    • Open Terminal
    • Now cd to the drive where you have downloaded the sources
    • Extract it
      Code:
      tar -xvzf (file name here).tar.gz

    Now you have extracted the source.

    Q2> I am not able to extract the source. What should I do?
    Ans: You cannot extract source with GUI on the Archive Extractor. So, try the method I mentioned.

    Q3> Is the size of all files 2GB? I saw the size 2GB on AndroidFileHost!
    Ans: The mentioned size on AFH is incorrect. AndroidFileHost has some problems while showing file sizes for files above 2GB. You need to click on Download once to view the correct size!

    Q4> How do you compress them? I mean, I need the command so that I can help you out!
    Ans: Our script is open source. You can view it here: https://github.com/regalstreak/skadoosh

    Q5> What are shallow and full sources?
    Ans: Shallow sources are the ones that just have the latest or the HEAD commits in each subproject. You can read more about it from here. Full are the ones that have all the bits from the starting of the subprojects and hence the archives have a large file size.

    Q6> How do I use these sources?
    Ans: First, you will have to extract them as mentioned above. You should get a .repo folder. In the same folder itself (not inside .repo but the folder that contains .repo), you will have to update the local work tree. You can update it by using
    Code:
    repo sync -c -f --force-sync --no-clone-bundle --no-tags -j8
    This command will help you to use minimum data/internet as it does not download extra tags or clone bundles.
    If you do not want to use data at all, you can use this:
    Code:
    repo sync -c -f --force-sync --no-clone-bundle --no-tags -j8 --local-only
    This will not fetch anything from the internet. Happy compiling!

    Please press the "Thanks Button" if we helped you and quote us if you have a problem!
    52
    Reserved

    Reserved for stuff.
    36
    Originally, we have had a "Ask on the thread, we'll try" approach to how things work. This is changing now.
    While this worked good enough for those asking for the sources, the people who did the actual work were overburdened. Frankly, the process was pretty sketchy. I personally faced the burden part when there were about 6 or 7 ROMs to do! I actually forgot about one guy who made the request earliest, which kinda sucked.
    Going forward, this won't happen now. We have a script up on @regalstreak's Github. Updates to it are synced to my server and executed.

    url]

    The process for requesting sources is now something like this :
    • Go to the Github repo and edit the compress.bash script
    • Start a Pull Request
    • Wait for it to be merged
    • Wait for even more time to let it upload and one of us to send the confirmation here.
    • Do whatever the heck you want with those sources!

    url]

    NOTE: The compress.bash looks like this in a classic example of how to do it WRONG.
    Code:
    name=AOSP
    manifest=[url]https://android.googlesource.com/platform/manifest[/url] -b android-4.0.1_r1
    branch=android-6.0.1_r55
    
    ./skadoo.sh $name $manifest $branch

    This was after This PR was merged and is being shown as the perfect way to mess it up. You are ALREADY passing the branch parameter separately, so adding '-b android-4.0.1_r1' looks like a shining example of blind copy paste. Don't do that. Change the name, manifest and branch with some general application of the faculty of common sense.

    Interested users are also suggested to read this strongly worded post.