See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/869/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using [Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0 [Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build [noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657) ------------------------------------------ [...truncated 94.05 KB...] + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :release:go-licenses:go:dockerRun + tee /output/licenses/list.csv + go-licenses csv github.com/apache/beam/sdks/go/container + chmod -R a+w /output/licenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv + chmod -R a+w /output/licenses > Task :sdks:go:container:dockerPrepare > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :sdks:python:container:py36:dockerPrepare > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :runners:spark:3:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:3:classes > Task :runners:spark:3:jar > Task :runners:spark:3:job-server:compileJava NO-SOURCE > Task :runners:spark:3:job-server:classes UP-TO-DATE > Task :runners:spark:3:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:3:testClasses > Task :runners:spark:3:testJar > Task :sdks:go:container:docker > Task :sdks:python:container:py36:docker > Task :sdks:java:container:java8:docker > Task :sdks:python:container:py36:docker Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (3031 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24613 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container dbd4a0197fc9 ---> 96a899bbf47e Step 6/27 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> c203d039bb8a Step 7/27 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in e8957d5c5200 Ignoring pandas: markers 'python_version >= "3.7"' don't match your environment Collecting avro-python3==1.8.2 Downloading avro-python3-1.8.2.tar.gz (36 kB) Collecting fastavro==1.0.0.post1 Downloading fastavro-1.0.0.post1-cp36-cp36m-manylinux2014_x86_64.whl (1.4 MB) Collecting crcmod==1.7 Downloading crcmod-1.7.tar.gz (89 kB) Collecting dill==0.3.1.1 Downloading dill-0.3.1.1.tar.gz (151 kB) Collecting future==0.18.2 Downloading future-0.18.2.tar.gz (829 kB) > Task :runners:spark:3:job-server:shadowJar > Task :sdks:python:container:py36:docker Collecting grpcio==1.40.0 Downloading grpcio-1.40.0-cp36-cp36m-manylinux2014_x86_64.whl (4.3 MB) Collecting hdfs==2.5.8 Downloading hdfs-2.5.8.tar.gz (41 kB) Collecting httplib2==0.19.1 Downloading httplib2-0.19.1-py3-none-any.whl (95 kB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Collecting protobuf==3.17.3 Downloading protobuf-3.17.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting pyarrow==3.0.0 Downloading pyarrow-3.0.0-cp36-cp36m-manylinux2014_x86_64.whl (20.7 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pymongo==3.10.1 Downloading pymongo-3.10.1-cp36-cp36m-manylinux2014_x86_64.whl (460 kB) Collecting pytz==2020.1 Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB) Collecting pyyaml==5.4 Downloading PyYAML-5.4-cp36-cp36m-manylinux1_x86_64.whl (640 kB) Collecting typing-extensions==3.7.4.3 Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB) Collecting google-auth==1.31.0 Downloading google_auth-1.31.0-py2.py3-none-any.whl (147 kB) Collecting google-api-core==1.22.2 Downloading google_api_core-1.22.2-py2.py3-none-any.whl (91 kB) Collecting google-apitools==0.5.31 Downloading google-apitools-0.5.31.tar.gz (173 kB) Collecting google-cloud-pubsub==1.0.2 Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB) Collecting google-cloud-bigquery==1.26.1 Downloading google_cloud_bigquery-1.26.1-py2.py3-none-any.whl (170 kB) Collecting google-cloud-bigtable==1.0.0 Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB) Collecting google-cloud-core==1.4.1 Downloading google_cloud_core-1.4.1-py2.py3-none-any.whl (26 kB) Collecting google-cloud-datastore==1.15.3 Downloading google_cloud_datastore-1.15.3-py2.py3-none-any.whl (134 kB) Collecting google-cloud-dlp==0.13.0 Downloading google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB) Collecting google-cloud-language==1.3.0 Downloading google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB) Collecting google-cloud-profiler==3.0.4 Downloading google-cloud-profiler-3.0.4.tar.gz (32 kB) Collecting google-cloud-recommendations-ai==0.2.0 Downloading google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB) Collecting google-cloud-spanner==1.13.0 Downloading google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB) Collecting google-cloud-videointelligence==1.13.0 Downloading google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177 kB) Collecting google-cloud-vision==0.42.0 Downloading google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB) Collecting google-python-cloud-debugger==2.15 Downloading google_python_cloud_debugger-2.15-cp36-cp36m-manylinux1_x86_64.whl (767 kB) Collecting grpcio-gcp==0.2.2 Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB) Collecting beautifulsoup4==4.9.1 Downloading beautifulsoup4-4.9.1-py3-none-any.whl (115 kB) Collecting bs4==0.0.1 Downloading bs4-0.0.1.tar.gz (1.1 kB) Collecting cython==0.29.21 Downloading Cython-0.29.21-cp36-cp36m-manylinux1_x86_64.whl (2.0 MB) Collecting cachetools==3.1.1 Downloading cachetools-3.1.1-py2.py3-none-any.whl (11 kB) Collecting dataclasses==0.8 Downloading dataclasses-0.8-py3-none-any.whl (19 kB) Collecting guppy3==3.0.10 Downloading guppy3-3.0.10-cp36-cp36m-manylinux2010_x86_64.whl (597 kB) Collecting mmh3==2.5.1 Downloading mmh3-2.5.1.tar.gz (9.8 kB) Collecting orjson==3.6.1 Downloading orjson-3.6.1-cp36-cp36m-manylinux_2_24_x86_64.whl (233 kB) Collecting python-dateutil==2.8.1 Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) Collecting requests==2.24.0 Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB) Collecting freezegun==0.3.15 Downloading freezegun-0.3.15-py2.py3-none-any.whl (14 kB) Collecting pillow==7.2.0 Downloading Pillow-7.2.0-cp36-cp36m-manylinux1_x86_64.whl (2.2 MB) Collecting python-snappy==0.5.4 Downloading python-snappy-0.5.4.tar.gz (21 kB) Collecting numpy==1.19.5 Downloading numpy-1.19.5-cp36-cp36m-manylinux2010_x86_64.whl (14.8 MB) Collecting scipy==1.4.1 Downloading scipy-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (26.1 MB) Collecting scikit-learn==0.24.1 Downloading scikit_learn-0.24.1-cp36-cp36m-manylinux2010_x86_64.whl (22.2 MB) Collecting pandas==1.1.5 Downloading pandas-1.1.5-cp36-cp36m-manylinux1_x86_64.whl (9.5 MB) Collecting protorpc==0.12.0 Downloading protorpc-0.12.0.tar.gz (117 kB) Collecting python-gflags==3.1.2 Downloading python-gflags-3.1.2.tar.gz (52 kB) Collecting tensorflow==2.6.0 Downloading tensorflow-2.6.0-cp36-cp36m-manylinux2010_x86_64.whl (458.3 MB) > Task :runners:spark:3:job-server:sparkJobServerSetup > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava Oct 30, 2021 12:37:52 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] ./run_validatesrunner_tests.sh: line 399: go: command not found > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task > :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup > Task :runners:spark:3:job-server:sparkJobServerCleanup FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212 * What went wrong: Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 36m 32s 216 actionable tasks: 166 executed, 44 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/4ea2rkagttzlg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
