See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/2944/display/redirect>
Changes: ------------------------------------------ [...truncated 76.49 KB...] > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:python:container:py36:copyLauncherDependencies > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE > Task :sdks:java:container:buildLinuxAmd64 > Task :sdks:java:io:expansion-service:distZip > Task :sdks:java:io:expansion-service:compileTestJava NO-SOURCE > Task :sdks:java:io:expansion-service:testClasses UP-TO-DATE > Task :sdks:java:io:expansion-service:packageTests > Task :sdks:java:io:expansion-service:assemble > Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE > Task :runners:spark:2:job-server:shadowJar FROM-CACHE > Task :runners:spark:2:job-server:sparkJobServerSetup Launching job server @ 42743 ... > Task :sdks:java:io:expansion-service:analyzeClassesDependencies > Task :sdks:java:io:expansion-service:analyzeTestClassesDependencies SKIPPED > Task :sdks:java:io:expansion-service:analyzeDependencies > Task :sdks:java:io:expansion-service:checkstyleMain NO-SOURCE > Task :sdks:java:io:expansion-service:checkstyleTest NO-SOURCE > Task :sdks:java:io:expansion-service:javadoc NO-SOURCE > Task :sdks:java:io:expansion-service:spotbugsMain NO-SOURCE > Task :sdks:java:io:expansion-service:spotbugsTest SKIPPED > Task :sdks:java:io:expansion-service:test NO-SOURCE > Task :sdks:java:io:expansion-service:check > Task :sdks:python:setupVirtualenv Successfully installed backports.entry-points-selectable-1.1.0 distlib-0.3.1 filelock-3.3.2 future-0.18.2 grpcio-1.41.1 grpcio-tools-1.37.0 importlib-metadata-2.1.1 importlib-resources-5.3.0 mypy-protobuf-1.18 packaging-21.2 platformdirs-2.4.0 pluggy-1.0.0 protobuf-3.19.1 py-1.10.0 pyparsing-2.4.7 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.9.0 zipp-3.6.0 > Task :sdks:java:container:goBuild > Task :sdks:python:sdist <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/setuptools/dist.py>:487: UserWarning: Normalizing '2.35.0.dev' to '2.35.0.dev0' warnings.warn(tmpl.format(**locals())) INFO:gen_protos:Regenerating Python proto definitions (no output files). INFO:gen_protos:Found protoc_gen_mypy at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy> beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. > Task :sdks:java:container:java8:copySdkHarnessLauncher > Task :sdks:java:io:expansion-service:shadowJar FROM-CACHE > Task :sdks:java:io:expansion-service:build > Task :release:go-licenses:go:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/go/container > Task :sdks:python:sdist Writing mypy to external_transforms_pb2.pyi Writing mypy to beam_runner_api_pb2.pyi Writing mypy to standard_window_fns_pb2.pyi Writing mypy to metrics_pb2.pyi Writing mypy to endpoints_pb2.pyi Writing mypy to schema_pb2.pyi Writing mypy to beam_artifact_api_pb2.pyi Writing mypy to beam_expansion_api_pb2.pyi Writing mypy to beam_job_api_pb2.pyi Writing mypy to beam_provision_api_pb2.pyi Writing mypy to beam_fn_api_pb2.pyi Writing mypy to beam_interactive_api_pb2.pyi RefactoringTool: Skipping optional fixer: idioms RefactoringTool: Skipping optional fixer: ws_comma RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> RefactoringTool: Files that were modified: RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/java/container > Task :sdks:python:container:py36:copyDockerfileDependencies > Task :release:go-licenses:py:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/python/container > Task :sdks:java:container:pullLicenses DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 3.944992 seconds with 16 threads. > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:python:installGcpTest > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses > Task :release:go-licenses:go:dockerRun + go-licenses save github.com/apache/beam/sdks/go/container --save_path=/output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/java/container + chmod -R a+w /output/licenses > Task :release:go-licenses:go:dockerRun + go-licenses csv github.com/apache/beam/sdks/go/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :release:go-licenses:py:dockerRun + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/python/container + chmod -R a+w /output/licenses > Task :sdks:go:container:dockerPrepare > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :sdks:python:container:py36:dockerPrepare > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:go:container:docker > Task :sdks:python:container:py36:docker > Task :sdks:java:container:java8:docker Removing intermediate container 7595e6f58b77 ---> 9b96fb867a60 Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 532f68c5c6e2 Removing intermediate container 532f68c5c6e2 ---> ab03efab65db Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> 8119da04ed3b Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in a5b05e4d6bcf Removing intermediate container a5b05e4d6bcf ---> 1dcd135eefc5 Successfully built 1dcd135eefc5 Successfully tagged apache/beam_java8_sdk:2.35.0.dev > Task :sdks:python:container:py36:docker Collecting grpcio==1.40.0 Downloading grpcio-1.40.0-cp36-cp36m-manylinux2014_x86_64.whl (4.3 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.19.1 Downloading httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Collecting protobuf==3.17.3 Downloading protobuf-3.17.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting pyarrow==3.0.0 Downloading pyarrow-3.0.0-cp36-cp36m-manylinux2014_x86_64.whl (20.7 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pymongo==3.10.1 Downloading pymongo-3.10.1-cp36-cp36m-manylinux2014_x86_64.whl (460 kB) > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerSetup > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava Oct 30, 2021 12:13:41 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] ./run_validatesrunner_tests.sh: line 399: go: command not found > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task > :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup > Task :runners:spark:2:job-server:sparkJobServerCleanup FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 212 * What went wrong: Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 31m 4s 216 actionable tasks: 155 executed, 54 from cache, 7 up-to-date Publishing build scan... https://gradle.com/s/cbt7vitzr2zgo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
