On Thursday, 2 June 2022 at 08:22:01 UTC+12 Christian Gagneraud wrote: > Hi all, > > We're looking into reducing our build time. > The first benchmark we did was to measure build time of aosp_arm64 versus > number of parallel jobs. > We have a machine with 28 cores (56 threads), so i ran a script to build > aosp from 4 jobs up to 56 jobs with an increment of 4. > > The results surprised me, in a nutshell, with ccache enabled and 100% hit > rate > 4 cores: 1h > 8 cores: 42m > 12 cores: 35m > 16+ cores: 32m >
Here are my results with ccache disabled. These benchmarks were done on android 11 branch. 4 cores: 4h15m 8 cores: 2h20m 12 cores: 1h40m 16 cores: 1h25m 20+ cores: 1h15m down to 55 minutes Again, the curve flatten with increasing cores. I am now exploring RBE (Remote build execution), i found some information on the web (joined the magic group to access the docs), i have enabled the API on gcloud. I haven't try a build yet, because i'm having a hard time to understand how to setup all of these. Ultimately, we're interesting in reducing our build time in our CI. Our builds are done in AWS, but we'll consider moving to gcloud if it's worth it. In another thread, i found this table: [image: Screenshot_20220605_104826.png] Timing of local builds don't really match my benchmarking, odd. Does anyone knows more about what should be a typical CI setup? eg. How many cores is needed for the machine that run ninja, and how to size the worker pool? eg. number of workers and worker machine spec. Looking at logs from ci.android.com, i can see NINJA_REMOTE_NUM_JOBS="500". I wonder if the worker pool can be auto-scaled or not. Thanks, Chris -- -- You received this message because you are subscribed to the "Android Building" mailing list. To post to this group, send email to android-building@googlegroups.com To unsubscribe from this group, send email to android-building+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/android-building?hl=en --- You received this message because you are subscribed to the Google Groups "Android Building" group. To unsubscribe from this group and stop receiving emails from it, send an email to android-building+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/android-building/0443622c-1ba6-4466-a8e4-51bd9261cbecn%40googlegroups.com.