Oh, thank you, 力召.
last time I didn't wait for long enouth when the log blocks. also there are
some issues with the serivce end, which made me misunderstand.
Now there could be failure logs like below:
reclient[1a42b3d9-0a8c-4c83-860f-7fa398daf641]:
RemoteErrorResultStatus: failed to upload
/home/faqiang/android13/prebuilts/clang/host/linux-x86/clang-r450784d/bin/ld64.lld:
retry budget exhausted (6 attempts): context deadline exceeded
I can see that the cas storage size keeps rising when dependencies are bing
transfrred from client end to server end, and then preceding logs occur.
what does this mean usually? Does it mean the dependencies fail to be sent
to the server end in time (i.e. network speed issue)? can I change the 6
attempts to a higher number to relieve this and how can I do that?
Best Regards,
Zhu Faqiang.
在2023年4月4日星期二 UTC+8 22:23:27<李力召> 写道：
> Sorry for a late reply.
>
> * The client distribute actions to the service, the service schedules
> the actions to the workers, the workers does the actions.*
> * In android build system, there is a limitation of using the host
> installed tools, many tools under "prebuilts/" directory like clang++ is
> used, how can a worker get the environment as the local build?*
>
> No, the reproxy in the aosp will send all the depends to the CAS as
> normal input. So the worker can be very light weight.
>
> * I set "RBE_CXX_EXEC_STRATEGY" to be "remote" then try to build a test
> module with RBE, the log shows that it blocks on "clang++
> test_source_file.cpp", while on the service end, it can be known that there
> is input requests, but the worker seems does nothing.*
> * I guesss it's related to the clang++ tool, although I installed
> clang++ on the worker machine. but android should use its own.*
>
> Maybe the worker is not completely implement the remote api
> <https://github.com/bazelbuild/remote-apis> .
>
> On Saturday, March 4, 2023 at 3:08:04 AM UTC+8 Faqiang Zhu wrote:
>
>> Hi 力召,
>>
>> Thank you, now the reproxy can be started.
>>
>> then I have another issue:
>> The client distribute actions to the service, the service schedules
>> the actions to the workers, the workers does the actions.
>> In android build system, there is a limitation of using the host
>> installed tools, many tools under "prebuilts/" directory like clang++ is
>> used, how can a worker get the environment as the local build?
>>
>> I set "RBE_CXX_EXEC_STRATEGY" to be "remote" then try to build a
>> test module with RBE, the log shows that it blocks on "clang++
>> test_source_file.cpp", while on the service end, it can be known that there
>> is input requests, but the worker seems does nothing.
>> I guesss it's related to the clang++ tool, although I installed
>> clang++ on the worker machine. but android should use its own.
>>
>> Best Regards,
>> Zhu Faqiang.
>> 在2023年2月23日星期四 UTC+8 02:28:59<李力召> 写道：
>>
>>> hi Faqiang
>>>
>>> Reproxy is call the rbe service by https with credential . You can
>>> disable it by enviroment "export RBE_service_no_security=true"
>>>
>>> On Wednesday, February 22, 2023 at 12:45:06 PM UTC+8 Faqiang Zhu wrote:
>>>
>>>> I'm trying to build android13 with RBE.
>>>>
>>>> As suggested in this post: Build AOSP 11 with Google RBE service
>>>> <https://groups.google.com/g/android-building/c/jOd1Z7C6xxk/m/v1os5xbKFgAJ>,
>>>>
>>>> I am trying an alternative option of BuildGrid listed here -
>>>> https://bazel.build/community/remote-execution-services.
>>>>
>>>> I setup the BuildGrid server based on the document, with bazel as the
>>>> client to build C++ tutorial examples, the build action can be distributed
>>>> from a machine to the GuildGrid Server, then I tried build android 13 with
>>>> RBE and this BuildGrid server with below steps:
>>>>
>>>> - modify the file "build/soong/docs/rbe.json" as below:
>>>>
>>>> diff --git a/docs/rbe.json b/docs/rbe.json
>>>> index f6ff10772..3f4c4ccf3 100644
>>>> --- a/docs/rbe.json
>>>> +++ b/docs/rbe.json
>>>> @@ -10,8 +10,8 @@
>>>> "RBE_R8": "1",
>>>> "RBE_D8": "1",
>>>>
>>>> - "RBE_instance": "[replace with your RBE instance]",
>>>> - "RBE_service": "[replace with your RBE service endpoint]",
>>>> + "RBE_instance": "main",
>>>> + "RBE_service": "grpc://10.193.102.33:50051",
>>>>
>>>> "RBE_DIR": "prebuilts/remoteexecution-client/live",
>>>>
>>>>
>>>> - create a credential file of
>>>> "$HOME/.config/gcloud/application_default_credentials.json" with below
>>>> command:
>>>>
>>>> gcloud auth application-default login --no-launch-browser
>>>> --disable-quota-project
>>>>
>>>>
>>>> - try to start the build with below commands:
>>>>
>>>> ANDROID_BUILD_ENVIRONMENT_CONFIG=rbe
>>>> ANDROID_BUILD_ENVIRONMENT_CONFIG_DIR=build/soong/docs make
>>>>
>>>>
>>>> but I got below failure and seems no related source code can be found:
>>>>
>>>> 18:58:52 Unable to start RBE reproxy
>>>> FAILED: RBE bootstrap failed with: exit status 10
>>>> E0221 18:58:52.597734 1344945 bootstrap.go:96] Unable to start
>>>> reproxy: "E0221 18:58:50.166111 1344959 main.go:205] Failed to initialize
>>>> remote-execution client: rpc error: code = Unavailable desc = rpc error:
>>>> code = Unavailable desc = retry budget exhausted (6 attempts): all
>>>> SubConns
>>>> are in TransientFailure, authentication type (identity) used=\"application
>>>> default credentials\"\n"
>>>>
>>>> Try restarting the build after running the following command:
>>>> gcloud auth application-default login --no-launch-browser
>>>> --disable-quota-project
>>>>
>>>>
>>>> Dose anyone tried the alternative RE service options listed in
>>>> https://bazel.build/community/remote-execution-services?
>>>> what RE service is choosed?
>>>> Is there similar or the same issue encountered as me?
>>>> Are there any fixes for the issue I encountered?
>>>>
>>>> Best Regards,
>>>> Zhu Faqiang.
>>>>
>>>
--
--
You received this message because you are subscribed to the "Android Building"
mailing list.
To post to this group, send email to android-building@googlegroups.com
To unsubscribe from this group, send email to
android-building+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/android-building?hl=en
---
You received this message because you are subscribed to the Google Groups
"Android Building" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to android-building+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/android-building/c389cc93-8b40-499b-9d43-24d4e395fc42n%40googlegroups.com.
