See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1876/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using [Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0 [Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build [noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657) ------------------------------------------ [...truncated 109.95 KB...] + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :sdks:python:installGcpTest Collecting execnet>=1.1 Downloading execnet-1.9.0-py2.py3-none-any.whl (39 kB) Collecting charset-normalizer~=2.0.0 Downloading charset_normalizer-2.0.7-py3-none-any.whl (38 kB) Collecting idna<4,>=2.5 Downloading idna-3.3-py3-none-any.whl (61 kB) Collecting urllib3<1.27,>=1.21.1 Downloading urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Collecting certifi>=2017.4.17 Downloading certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting greenlet!=0.4.17 Downloading greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB) Collecting docker Downloading docker-5.0.3-py2.py3-none-any.whl (146 kB) Collecting wrapt Downloading wrapt-1.13.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (78 kB) Collecting deprecation Downloading deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting cffi>=1.12 Downloading cffi-1.15.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (405 kB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Downloading googleapis_common_protos-1.53.0-py2.py3-none-any.whl (198 kB) Collecting protobuf<4,>=3.12.2 Downloading protobuf-3.17.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting google-crc32c<2.0dev,>=1.0 Downloading google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB) Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.35.0.dev0) (3.6.0) Collecting typing-inspect>=0.4.0 Downloading typing_inspect-0.7.1-py3-none-any.whl (8.4 kB) Collecting isodate>=0.6.0 Downloading isodate-0.6.0-py2.py3-none-any.whl (45 kB) Collecting requests-oauthlib>=0.5.0 Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB) Collecting proto-plus>=1.10.0 Downloading proto_plus-1.19.6-py3-none-any.whl (45 kB) Collecting websocket-client>=0.32.0 Downloading websocket_client-1.2.1-py2.py3-none-any.whl (52 kB) Collecting pycparser Downloading pycparser-2.20-py2.py3-none-any.whl (112 kB) Collecting oauthlib>=3.0.0 Downloading oauthlib-3.1.1-py2.py3-none-any.whl (146 kB) Collecting mypy-extensions>=0.3.0 Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB) Building wheels for collected packages: avro-python3, crcmod, dill, google-apitools, apache-beam, grpc-google-iam-v1, docopt Building wheel for avro-python3 (setup.py): started Building wheel for avro-python3 (setup.py): finished with status 'done' Created wheel for avro-python3: filename=avro_python3-1.9.2.1-py3-none-any.whl size=43512 sha256=46882ef993c98cd32245e9a0858fcc96d4bb11680c8c35bb0ff54374d8f5116c Stored in directory: /home/jenkins/.cache/pip/wheels/4e/08/0c/727bff8f20fedbdeb8a2c5214e460b214d41c10dc879cf6dac Building wheel for crcmod (setup.py): started Building wheel for crcmod (setup.py): finished with status 'done' Created wheel for crcmod: filename=crcmod-1.7-cp36-cp36m-linux_x86_64.whl size=30569 sha256=928c3c068add7a7b88d70c6f117814ea9adec7fd85c2b852931bdcb6e12bae33 Stored in directory: /home/jenkins/.cache/pip/wheels/ac/bb/07/adfb4ffd0aaace2022ea25c082a7cdc688b10d30e86d6d2fde Building wheel for dill (setup.py): started > Task :sdks:python:container:py36:dockerPrepare > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:python:container:py36:docker > Task :sdks:go:container:docker > Task :sdks:java:container:java8:docker > Task :sdks:python:container:py36:docker Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7906 kB] Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [15.2 kB] > Task :sdks:go:container:docker Removing intermediate container d903d64e4e05 ---> 6cc477c2a96a Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in 5d51fb7c335a Removing intermediate container 5d51fb7c335a ---> 1f0fca9170f9 Successfully built 1f0fca9170f9 Successfully tagged apache/beam_go_sdk:latest > Task :sdks:python:container:py36:docker Fetched 8469 kB in 3s (2590 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... libyaml-dev is already the newest version (0.2.1-1). Suggested packages: distcc | icecc The following NEW packages will be installed: ccache libsnappy-dev libsnappy1v5 0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded. Need to get 203 kB of archives. After this operation, 514 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB] Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB] Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 203 kB in 0s (2861 kB/s) Selecting previously unselected package ccache. (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70% (Reading database ... 75%(Reading database ... 80% (Reading database ... 85%(Reading database ... 90% (Reading database ... 95% (Reading database ... 100%(Reading database ... 24613 files and directories currently installed.) Preparing to unpack .../ccache_3.6-1_amd64.deb ... Unpacking ccache (3.6-1) ... Selecting previously unselected package libsnappy1v5:amd64. Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ... Unpacking libsnappy1v5:amd64 (1.1.7-1) ... Selecting previously unselected package libsnappy-dev:amd64. Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ... Unpacking libsnappy-dev:amd64 (1.1.7-1) ... Setting up ccache (3.6-1) ... Updating symlinks in /usr/lib/ccache ... Setting up libsnappy1v5:amd64 (1.1.7-1) ... Setting up libsnappy-dev:amd64 (1.1.7-1) ... Processing triggers for libc-bin (2.28-10) ... Removing intermediate container 04a0b5eced96 ---> fa190a8256f1 Step 6/27 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt ---> 2da1b06ddd86 Step 7/27 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "import nltk; nltk.download('stopwords')" && rm /root/nltk_data/corpora/stopwords.zip && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt ---> Running in 98ebcab343a8 > Task :sdks:java:extensions:sql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup Waiting for server to start up... Server started at port 40665 > Task :sdks:java:extensions:sql:classes > Task :sdks:java:extensions:sql:jar > Task :sdks:java:extensions:sql:zetasql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:extensions:sql:zetasql:classes > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/ExternalSqlTransformRegistrar.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :sdks:java:extensions:sql:expansion-service:classes > Task :sdks:java:extensions:sql:expansion-service:shadowJar > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava Oct 30, 2021 12:36:19 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] ./run_validatesrunner_tests.sh: line 399: go: command not found > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingJava > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql Exception in thread wait_until_finish_read: Traceback (most recent call last): File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner self.run() File "/usr/lib/python3.6/threading.py", line 864, in run self._target(*self._args, **self._kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,> line 565, in read_messages for message in self._message_stream: File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,> line 426, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py";,> line 826, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.DEADLINE_EXCEEDED details = "Deadline Exceeded" debug_error_string = "{"created":"@1635554910.307911206","description":"Error received from peer ipv4:127.0.0.1:40665","file":"src/core/lib/surface/call.cc","file_line":1069,"grpc_message":"Deadline Exceeded","grpc_status":4}" > > Task > :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql > FAILED > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup > Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 212 * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 52m 50s 199 actionable tasks: 164 executed, 29 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/pdn34mhmssjz4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
