guyuqi commented on PR #916: URL: https://github.com/apache/bigtop/pull/916#issuecomment-1161682112
Thanks for working on this. LGTM. Build Arm64 debian-10 docker images (protocbuf-3.7.1) based on PR: https://github.com/apache/bigtop/pull/915. Verified Hadoop-3.3.3 build within built docker image above. Also run the smoke tests. ``` index ad77d34a..d7bcdf8e 100644 --- a/provisioner/docker/config_debian-10.yaml +++ b/provisioner/docker/config_debian-10.yaml @@ -20,5 +20,5 @@ docker: repo: "http://repos.bigtop.apache.org/releases/3.0.0/debian/10/$(ARCH)" distro: debian components: [hdfs, yarn, mapreduce] -enable_local_repo: false +enable_local_repo: true smoke_test_components: [hdfs, yarn, mapreduce] ``` Smoke tests: ``` ./docker-hadoop.sh -C config_debian-10.yaml -c 3 -s -d Environment check... Check docker: Docker version 20.10.15, build fd82621 Check docker-compose: Docker Compose version v2.6.0 Check ruby: ruby 2.7.0p0 (2019-12-25 revision 647ee6f091) [aarch64-linux-gnu] No cluster exists! [+] Running 4/4 ⠿ Network 20220621_163341_r8800_default Created 0.1s ⠿ Container 20220621_163341_r8800-bigtop-3 Started 2.2s ⠿ Container 20220621_163341_r8800-bigtop-1 Started 2.2s ⠿ Container 20220621_163341_r8800-bigtop-2 Started 2.2s ...... ... . Successfully started process 'Gradle Test Executor 4' org.apache.bigtop.itest.hadoop.mapreduce.TestHadoopExamples STANDARD_ERROR 22/06/21 08:50:01 INFO lang.Object: Failed to unpack jar resources. Attemting to use bigtop sources 22/06/21 08:50:01 INFO lang.Object: MAKING DIRECTORIES ..................... examples examples-output Gradle Test Executor 4 finished executing tests. > Task :bigtop-tests:smoke-tests:mapreduce:test Finished generating test XML results (0.002 secs) into: /bigtop-home/bigtop-tests/smoke-tests/mapreduce/build/test-results/test Generating HTML test report... Finished generating test html results (0.017 secs) into: /bigtop-home/bigtop-tests/smoke-tests/mapreduce/build/reports/tests/test Now testing... :bigtop-tests:smoke-tests:mapreduce:test (Thread[Execution worker for ':' Thread 58,5,main]) completed. Took 6 mins 2.258 secs. BUILD SUCCESSFUL in 19m 29s 41 actionable tasks: 14 executed, 27 up-to-date Stopped 1 worker daemon(s). + rm -rf buildSrc/build/test-results/binary + rm -rf /bigtop-home/.gradle ``` Let me take the tests on Fedora-35/Rockylinux-8 before merging this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
