Hi Ruben!
Enabling RBE once you have a remote execution cluster running requires
approximately these steps:
source build/make/rbesetup.sh
ulimit -n 20000
export RBE_service=<hostname>:<port, typically 443>
export RBE_tls_ca_cert=certificate.crt <-- depends on what TLS cert is
in use on the service
export RBE_use_rpc_credentials=false <-- depends on how you do client
authentication
export RBE_JAVA_POOL=default
export RBE_METALAVA_POOL=default
export RBE_ABI_DUMPER=1
export RBE_ABI_LINKER=1
export RBE_CLANG_TIDY=1
export RBE_CXX_LINKS=1
export RBE_D8=1
export RBE_JAVAC=1
export RBE_METALAVA=1
export RBE_R8=1
export RBE_SIGNAPK=1
export RBE_TURBINE=1
export RBE_ZIP=1
export RBE_ABI_DUMPER_EXEC_STRATEGY=remote_local_fallback
export RBE_ABI_LINKER_EXEC_STRATEGY=remote_local_fallback
export RBE_CXX_EXEC_STRATEGY=remote_local_fallback
export RBE_CXX_LINKS_EXEC_STRATEGY=remote_local_fallback
export RBE_CLANG_TIDY_EXEC_STRATEGY=remote_local_fallback
export RBE_D8_EXEC_STRATEGY=remote
export RBE_JAR_EXEC_STRATEGY=remote_local_fallback
export RBE_JAVAC_EXEC_STRATEGY=remote
export RBE_SIGNAPK_EXEC_STRATEGY=remote_local_fallback
export RBE_TURBINE_EXEC_STRATEGY=remote_local_fallback
export RBE_R8_EXEC_STRATEGY=remote
export RBE_ZIP_EXEC_STRATEGY=remote_local_fallback
export RBE_METALAVA_EXEC_STRATEGY=remote_local_fallback
You can also adjust the number of remote actions like so:
export NINJA_REMOTE_NUM_JOBS=8
You may need to run a Docker registry, or you can pull images from GCR.
And then you can use the `m` tool as usual
mmma external/sqlite/
m
Hope that helps,
-- Ulf
*EngFlow GmbH*
Fischerweg 51, 82194 Gröbenzell, Germany
Amtsgericht München, HRB 255664
Geschäftsführer (Managing Director): Ulf Adams
https://www.engflow.com
On Tue, 18 May 2021 at 22:48, Ruben Wu <ruben...@gmail.com> wrote:
> Thanks for the info, Dan! Is there a place I can reference on how to turn
> on RBE on Android 11/12? I understand a remote build execution
> engine/service is needed, but how do I configure Android 11 to send jobs to
> that service?
>
> Thanks,
> Ruben
>
> On Friday, May 14, 2021 at 5:40:44 PM UTC-5 Dan Willemsen wrote:
>
>> While I understand goma support is being deprecated/removed on AOSP
>>> master, is there a way to still be able to use Goma on Android 12 since I
>>> already have a goma client and server setup to work with Android 10.
>>>
>>
>> No, it was removed before Android 12 was branched, so it's not in Android
>> 12 either. You could always attempt to revert those removals in your own
>> tree, but I don't know how complex that could be. RBE works with
>> significantly more of the build actions than GOMA ever did.
>>
>> - Dan
>>
>> On Fri, May 14, 2021 at 3:37 PM Ruben Wu <rube...@gmail.com> wrote:
>>
>>> Hi Dan,
>>> While I understand goma support is being deprecated/removed on AOSP
>>> master, is there a way to still be able to use Goma on Android 12 since I
>>> already have a goma client and server setup to work with Android 10.
>>>
>>> Best,
>>> Ruben
>>>
>>> On Tuesday, February 16, 2021 at 4:14:19 PM UTC-6 Dan Willemsen wrote:
>>>
>>>> GOMA support has been removed on the AOSP master branch, and has been
>>>> replaced with RBE.
>>>>
>>>> - Dan
>>>>
>>>> On Wed, Feb 3, 2021 at 9:30 AM 唐木村 <tmc...@gmail.com> wrote:
>>>>
>>>>> @Dan Willemsen
>>>>>
>>>>> >>> The build team does not recommend using Goma -- it does not work
>>>>> particularly well with the Android build, and we expect to be removing
>>>>> support for it in master in the coming months (support will most likely
>>>>> still be in this years release, but not next years).
>>>>>
>>>>> whether goma not work well for android build ??? and now 2021 year
>>>>> support better ???
>>>>> https://chromium.googlesource.com/infra/goma/client/
>>>>> https://chromium.googlesource.com/infra/goma/server/
>>>>>
>>>>> 在2020年3月4日星期三 UTC+8 上午5:57:32<Dan Willemsen> 写道：
>>>>>
>>>>>> The build team does not recommend using Goma -- it does not work
>>>>>> particularly well with the Android build, and we expect to be removing
>>>>>> support for it in master in the coming months (support will most likely
>>>>>> still be in this years release, but not next years).
>>>>>>
>>>>>> RBE is the replacement, but it's still evolving at the moment. Many
>>>>>> of our CI builds have switched to it (they never used Goma), but only a
>>>>>> handful of developers have used it so far. If you're interested in this,
>>>>>> I'd highly recommend asking your TAM about it (or if you don't have one,
>>>>>> contact me and I can try to route your request to the right team).
>>>>>>
>>>>>> For what we're doing (other than Goma/RBE), the majority of our CI
>>>>>> builds are done on n1-standard-64
>>>>>> <https://cloud.google.com/compute/docs/machine-types#n1_machine_type>
>>>>>> machines with SSD persistent disks. Depending on your
>>>>>> limitations/requirements, the newer C2/N2 machine families may be more
>>>>>> efficient. For local developers, we're generally buying fast desktops --
>>>>>> 2x
>>>>>> Intel Xeon GOLD 6154 processor (18-core Skylake, up to 3.70 GHz) with 192
>>>>>> GB RAM and a few TB of SSDs.
>>>>>>
>>>>>> - Dan
>>>>>>
>>>>>> On Sun, Mar 1, 2020 at 11:52 PM 'Orion Hodson' via Android Building <
>>>>>> android-...@googlegroups.com> wrote:
>>>>>>
>>>>>>> Hi Alexander
>>>>>>>
>>>>>>> Internally Android developers use goma. The thread below has
>>>>>>> pointers to the client and server. It is built on GCP.
>>>>>>>
>>>>>>>
>>>>>>> https://groups.google.com/a/chromium.org/forum/#!topic/chromium-dev/eOtBzosZtd8
>>>>>>>
>>>>>>> Kind regards
>>>>>>> Orion
>>>>>>>
>>>>>>> On Sun, 1 Mar 2020 at 22:39, alexander zhu <mooo...@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I faced one problem, i have tried to solve it many days.
>>>>>>>>
>>>>>>>>
>>>>>>>> AOSP compile on one powerful physical server(36U128G) is fast .
>>>>>>>> Because my company has so many people need to compile AOSP on the
>>>>>>>> server,so
>>>>>>>> it is busy all the time , and I do not have money to buy more.But the
>>>>>>>> VM I
>>>>>>>> can request more.So I want to use VM on the cloud to compile AOSP.
>>>>>>>>
>>>>>>>> I have some distribute compile experiences in other c/c++ projects.
>>>>>>>> So I'm thinking is there any way to compile AOSP in distribute
>>>>>>>> way?exp: use
>>>>>>>> many VMs for one AOSP build.
>>>>>>>>
>>>>>>>> I noticed there had topic long time ago :
>>>>>>>> https://groups.google.com/forum/#!searchin/android-building/distcc%7Csort:date/android-building/_YJNwvq6FtY/EENyTx4Elk4J
>>>>>>>>
>>>>>>>> I tried distcc , but failed . AOSP switching to clang, but distcc
>>>>>>>> support clang not ok.
>>>>>>>> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=926884
>>>>>>>>
>>>>>>>>
>>>>>>>> So, I want to know ,AOSP in google , how to solve the long build
>>>>>>>> time ?use more powerful physical server? or you have your own
>>>>>>>> distribute compile solution?
>>>>>>>>
>>>>>>>> --
>>>>>>>> --
>>>>>>>> You received this message because you are subscribed to the
>>>>>>>> "Android Building" mailing list.
>>>>>>>> To post to this group, send email to android-...@googlegroups.com
>>>>>>>> To unsubscribe from this group, send email to
>>>>>>>> android-buildi...@googlegroups.com
>>>>>>>> For more options, visit this group at
>>>>>>>> http://groups.google.com/group/android-building?hl=en
>>>>>>>>
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>> Groups "Android Building" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to android-buildi...@googlegroups.com.
>>>>>>>> To view this discussion on the web visit
>>>>>>>> https://groups.google.com/d/msgid/android-building/e3dd71e8-e452-48e2-8686-c51e359cbf5c%40googlegroups.com
>>>>>>>> <https://groups.google.com/d/msgid/android-building/e3dd71e8-e452-48e2-8686-c51e359cbf5c%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>>>>> .
>>>>>>>>
>>>>>>> --
>>>>>>> --
>>>>>>> You received this message because you are subscribed to the "Android
>>>>>>> Building" mailing list.
>>>>>>> To post to this group, send email to android-...@googlegroups.com
>>>>>>> To unsubscribe from this group, send email to
>>>>>>> android-buildi...@googlegroups.com
>>>>>>> For more options, visit this group at
>>>>>>> http://groups.google.com/group/android-building?hl=en
>>>>>>>
>>>>>>> ---
>>>>>>> You received this message because you are subscribed to the Google
>>>>>>> Groups "Android Building" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>> send an email to android-buildi...@googlegroups.com.
>>>>>>>
>>>>>> To view this discussion on the web visit
>>>>>>> https://groups.google.com/d/msgid/android-building/CAAttue0u%2BuqgwNO4ggmnWsYS%2B8FmL8xURN-Xqt9sw9d1aLENQQ%40mail.gmail.com
>>>>>>> <https://groups.google.com/d/msgid/android-building/CAAttue0u%2BuqgwNO4ggmnWsYS%2B8FmL8xURN-Xqt9sw9d1aLENQQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>>> .
>>>>>>>
>>>>>> --
>>>>> --
>>>>> You received this message because you are subscribed to the "Android
>>>>> Building" mailing list.
>>>>> To post to this group, send email to android-...@googlegroups.com
>>>>> To unsubscribe from this group, send email to
>>>>> android-buildi...@googlegroups.com
>>>>> For more options, visit this group at
>>>>> http://groups.google.com/group/android-building?hl=en
>>>>>
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Android Building" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to android-buildi...@googlegroups.com.
>>>>>
>>>> To view this discussion on the web visit
>>>>> https://groups.google.com/d/msgid/android-building/6062ea95-ea49-483d-8e32-675bbf2a954en%40googlegroups.com
>>>>> <https://groups.google.com/d/msgid/android-building/6062ea95-ea49-483d-8e32-675bbf2a954en%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>> .
>>>>>
>>>> --
>>> --
>>> You received this message because you are subscribed to the "Android
>>> Building" mailing list.
>>> To post to this group, send email to android-...@googlegroups.com
>>> To unsubscribe from this group, send email to
>>> android-buildi...@googlegroups.com
>>> For more options, visit this group at
>>> http://groups.google.com/group/android-building?hl=en
>>>
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Android Building" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to android-buildi...@googlegroups.com.
>>>
>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/android-building/84771f90-a135-4025-85d3-4d5fe5e3b662n%40googlegroups.com
>>> <https://groups.google.com/d/msgid/android-building/84771f90-a135-4025-85d3-4d5fe5e3b662n%40googlegroups.com?utm_medium=email&utm_source=footer>
>>> .
>>>
>> --
> --
> You received this message because you are subscribed to the "Android
> Building" mailing list.
> To post to this group, send email to android-building@googlegroups.com
> To unsubscribe from this group, send email to
> android-building+unsubscr...@googlegroups.com
> For more options, visit this group at
> http://groups.google.com/group/android-building?hl=en
>
> ---
> You received this message because you are subscribed to the Google Groups
> "Android Building" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to android-building+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/android-building/ae2ba21a-319f-4960-9041-8b349dd1fd9fn%40googlegroups.com
> <https://groups.google.com/d/msgid/android-building/ae2ba21a-319f-4960-9041-8b349dd1fd9fn%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
--
--
You received this message because you are subscribed to the "Android Building"
mailing list.
To post to this group, send email to android-building@googlegroups.com
To unsubscribe from this group, send email to
android-building+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/android-building?hl=en
---
You received this message because you are subscribed to the Google Groups
"Android Building" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to android-building+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/android-building/CAHUnK-1%3D2z-U%2B-gmmTzzfdkxUuei6qcFmP_qz%3Dvgp16i4t2P2w%40mail.gmail.com.
