On Thursday, 2 June 2022 at 08:22:01 UTC+12 Christian Gagneraud wrote:

> Hi all,
>
> We're looking into reducing our build time.
> The first benchmark we did was to measure build time of aosp_arm64 versus 
> number of parallel jobs.
> We have a machine with 28 cores (56 threads), so i ran a script to build 
> aosp from 4 jobs up to 56 jobs with an increment of 4.
>
> The results surprised me, in a nutshell, with ccache enabled and 100% hit 
> rate
> 4 cores: 1h
> 8 cores: 42m
> 12 cores: 35m
> 16+ cores: 32m
>

Here are my results with ccache disabled. These benchmarks were done on 
android 11 branch.

4 cores: 4h15m
8 cores: 2h20m
12 cores: 1h40m
16 cores: 1h25m
20+ cores: 1h15m down to 55 minutes

Again, the curve flatten with increasing cores.

I am now exploring RBE (Remote build execution), i found some information 
on the web (joined the magic group to access the docs), i have enabled the 
API on gcloud.
I haven't try a build yet, because i'm having a hard time to understand how 
to setup all of these.
Ultimately, we're interesting in reducing our build time in our CI.
Our builds are done in AWS, but we'll consider moving to gcloud if it's 
worth it.

In another thread, i found this table:
[image: Screenshot_20220605_104826.png]
Timing of local builds don't really match my benchmarking, odd.

Does anyone knows more about what should be a typical CI setup?
eg. How many cores is needed for the machine that run ninja, and how to 
size the worker pool? eg. number of workers and worker machine spec.

Looking at logs from ci.android.com, i can see NINJA_REMOTE_NUM_JOBS="500".
I wonder if the worker pool can be auto-scaled or not.

Thanks,
Chris


-- 
-- 
You received this message because you are subscribed to the "Android Building" 
mailing list.
To post to this group, send email to android-building@googlegroups.com
To unsubscribe from this group, send email to
android-building+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/android-building?hl=en

--- 
You received this message because you are subscribed to the Google Groups 
"Android Building" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to android-building+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/android-building/0443622c-1ba6-4466-a8e4-51bd9261cbecn%40googlegroups.com.

Reply via email to