See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/2744/display/redirect?page=changes>
Changes: [xqhu] Ignore flags for beam_sql magic [xqhu] Raise the error when some functions are misused [xqhu] change how to import [noreply] Validate that GBK coders are always set correctly. (#25394) [noreply] Fix tox error running hdfsIntegrationTest (#25446) [noreply] Adding support for DLQ for ZetaSQL (#25426) ------------------------------------------ [...truncated 119.09 KB...] > Task :sdks:java:io:debezium:createCheckerFrameworkManifest > Task :sdks:java:testing:kafka-service:compileTestJava FROM-CACHE > Task :sdks:java:testing:kafka-service:processTestResources > Task :sdks:java:testing:kafka-service:testClasses > Task :sdks:java:io:debezium:compileJava FROM-CACHE > Task :sdks:java:io:debezium:processResources NO-SOURCE > Task :sdks:java:io:debezium:classes UP-TO-DATE > Task :sdks:java:io:debezium:jar > Task :sdks:java:io:debezium:expansion-service:createCheckerFrameworkManifest > Task :sdks:java:io:debezium:expansion-service:compileJava NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:processResources NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:classes UP-TO-DATE > Task :sdks:java:io:debezium:expansion-service:jar > Task :sdks:java:io:debezium:expansion-service:startScripts > Task :sdks:java:io:debezium:expansion-service:distTar > Task :sdks:java:testing:kafka-service:buildTestKafkaServiceJar FROM-CACHE > Task > :sdks:java:io:google-cloud-platform:expansion-service:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:expansion-service:compileJava > NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:processResources > NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:expansion-service:jar > Task :sdks:java:io:debezium:expansion-service:distZip > Task :sdks:java:io:debezium:expansion-service:compileTestJava NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:processTestResources NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:testClasses UP-TO-DATE > Task :sdks:java:io:debezium:expansion-service:packageTests > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py37:copyGolangLicenses > Task :sdks:python:container:py37:dockerPrepare > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:io:expansion-service:shadowJar > Task :sdks:java:io:google-cloud-platform:expansion-service:startScripts > Task :sdks:java:io:google-cloud-platform:expansion-service:distTar > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:java:io:expansion-service:startShadowScripts > Task :sdks:java:io:expansion-service:shadowDistTar > Task :sdks:java:io:expansion-service:shadowDistZip > Task :sdks:java:io:expansion-service:assemble > Task :sdks:java:io:expansion-service:analyzeClassesDependencies > Task :sdks:java:io:expansion-service:analyzeTestClassesDependencies SKIPPED > Task :sdks:java:io:expansion-service:analyzeDependencies > Task :sdks:java:io:expansion-service:checkstyleMain NO-SOURCE > Task :sdks:java:io:expansion-service:checkstyleTest NO-SOURCE > Task :sdks:java:io:expansion-service:javadoc NO-SOURCE > Task :sdks:java:io:expansion-service:spotbugsMain NO-SOURCE > Task :sdks:java:io:expansion-service:spotbugsTest SKIPPED > Task :sdks:java:io:expansion-service:spotlessJava FROM-CACHE > Task :sdks:java:io:expansion-service:spotlessJavaCheck UP-TO-DATE > Task :sdks:java:io:expansion-service:spotlessCheck UP-TO-DATE > Task :sdks:java:io:expansion-service:test NO-SOURCE > Task :sdks:java:io:expansion-service:check > Task :sdks:java:io:expansion-service:build > Task :sdks:go:container:docker Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB] Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [226 kB] Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [14.6 kB] Fetched 8632 kB in 2s (3599 kB/s) Reading package lists... Reading package lists... > Task :sdks:java:io:google-cloud-platform:expansion-service:distZip > Task :sdks:java:io:google-cloud-platform:expansion-service:compileTestJava > NO-SOURCE > Task > :sdks:java:io:google-cloud-platform:expansion-service:processTestResources > NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:testClasses > UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:expansion-service:packageTests > Task :sdks:python:container:py37:docker Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8183 kB] Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [226 kB] Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [14.6 kB] Fetched 8632 kB in 3s (3376 kB/s) Reading package lists...(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 23423 files and directories currently installed.) Preparing to unpack .../ccache_4.2-1_amd64.deb ... Unpacking ccache (4.2-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.8-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.8-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.8-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.8-1) ... Setting up ccache (4.2-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.8-1) ... Setting up libsnappy-dev:amd64 (1.1.8-1) ... Processing triggers for libc-bin (2.31-13+deb11u5) ... > Task :sdks:java:io:debezium:expansion-service:shadowJar > Task :sdks:go:container:docker (Reading database ... 95%(Reading database ... 100%(Reading database ... 6661 files and directories currently installed.) Preparing to unpack .../openssl_1.1.1n-0+deb11u4_amd64.deb ... Unpacking openssl (1.1.1n-0+deb11u4) ... Selecting previously unselected package ca-certificates. Preparing to unpack .../ca-certificates_20210119_all.deb ... Unpacking ca-certificates (20210119) ... Setting up openssl (1.1.1n-0+deb11u4) ... Setting up ca-certificates (20210119) ... Updating certificates in /etc/ssl/certs... 129 added, 0 removed; done. Processing triggers for ca-certificates (20210119) ... Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. > Task :sdks:java:io:debezium:expansion-service:startShadowScripts > Task :sdks:java:io:debezium:expansion-service:shadowDistTar > Task :sdks:go:container:docker Removing intermediate container 58f586c3b5d1 ---> 79aa6550af24 Step 5/11 : ADD target/linux_amd64/boot /opt/apache/beam/ > Task :sdks:java:io:debezium:expansion-service:shadowDistZip > Task :sdks:java:io:debezium:expansion-service:assemble > Task :sdks:java:io:debezium:expansion-service:analyzeClassesDependencies > Task :sdks:java:io:debezium:expansion-service:analyzeTestClassesDependencies > SKIPPED > Task :sdks:java:io:debezium:expansion-service:analyzeDependencies > Task :sdks:java:io:debezium:expansion-service:checkstyleMain NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:checkstyleTest NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:javadoc NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:spotbugsMain NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:spotbugsTest SKIPPED > Task :sdks:java:io:debezium:expansion-service:spotlessJava FROM-CACHE > Task :sdks:java:io:debezium:expansion-service:spotlessJavaCheck UP-TO-DATE > Task :sdks:java:io:debezium:expansion-service:spotlessCheck UP-TO-DATE > Task :sdks:java:io:debezium:expansion-service:test NO-SOURCE > Task :sdks:java:io:debezium:expansion-service:check > Task :sdks:java:io:debezium:expansion-service:build > Task :sdks:python:container:py37:docker Removing intermediate container 32346241dec4 ---> 544b5230c418 Step 5/32 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> 618c372f9fb0 Step 6/32 : RUN pip install --no-deps -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in dd3563dff6e4 > Task :sdks:go:container:docker ---> 792c4f22bf4a Step 6/11 : COPY target/LICENSE /opt/apache/beam/ ---> 19a5bb9cae63 Step 7/11 : COPY target/NOTICE /opt/apache/beam/ ---> 536306b4526b Step 8/11 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 3048d9bbf432 Step 9/11 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 8a3cfb7da9b8 Removing intermediate container 8a3cfb7da9b8 ---> 0d1be4dd2770 Step 10/11 : RUN if [ "$pull_licenses" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in fdd8a8b8200e Removing intermediate container fdd8a8b8200e ---> 1f7ec7261b7f Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 77eb436dd2fa Removing intermediate container 77eb436dd2fa ---> d56b6858883f Successfully built d56b6858883f Successfully tagged apache/beam_go_sdk:latest > Task :runners:spark:3:job-server:sparkJobServerCleanup Stopping job server pid: 809072. > Task :sdks:python:container:py37:docker Collecting absl-py==1.4.0 Downloading absl_py-1.4.0-py3-none-any.whl (126 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 126.5/126.5 KB 4.6 MB/s eta 0:00:00 Collecting astunparse==1.6.3 Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB) Collecting attrs==22.2.0 Downloading attrs-22.2.0-py3-none-any.whl (60 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.0/60.0 KB 10.3 MB/s eta 0:00:00 Collecting beautifulsoup4==4.11.1 Downloading beautifulsoup4-4.11.1-py3-none-any.whl (128 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 128.2/128.2 KB 17.6 MB/s eta 0:00:00 Collecting bs4==0.0.1 Downloading bs4-0.0.1.tar.gz (1.1 kB) Preparing metadata (setup.py): started > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowJar > Task :sdks:java:io:google-cloud-platform:expansion-service:startShadowScripts > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistTar > Task :sdks:java:io:google-cloud-platform:expansion-service:shadowDistZip > Task :sdks:java:io:google-cloud-platform:expansion-service:assemble > Task > :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies > Task > :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies > SKIPPED > Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies > Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain > NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest > NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain > NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest > SKIPPED > Task :sdks:java:io:google-cloud-platform:expansion-service:spotlessJava > FROM-CACHE > Task :sdks:java:io:google-cloud-platform:expansion-service:spotlessJavaCheck > UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:expansion-service:spotlessCheck > UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE > Task :sdks:java:io:google-cloud-platform:expansion-service:check > Task :sdks:java:io:google-cloud-platform:expansion-service:build > Task :sdks:python:container:py37:docker FAILED COPY failed: stat /var/lib/docker/tmp/docker-builder707309128/target/launcher/linux_amd64/boot: no such file or directory FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:container:pullLicenses'. > Process 'command './license_scripts/license_script.sh'' finished with > non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py37:docker'. > Process 'command 'docker'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 12m 51s 254 actionable tasks: 180 executed, 62 from cache, 12 up-to-date Publishing build scan... https://gradle.com/s/5652cbspvaw4i Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
