See <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/938/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using [Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0 [Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build [noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657) ------------------------------------------ [...truncated 194.29 KB...] copying apache_beam/portability/api/metrics_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_provision_api_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_provision_api_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_job_api_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_interactive_api_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_runner_api_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/endpoints_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/external_transforms_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_artifact_api_pb2_urns.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/standard_window_fns_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/__init__.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_fn_api_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/standard_window_fns_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_job_api_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/external_transforms_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_artifact_api_pb2_grpc.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/portability/api/beam_runner_api_pb2.py -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> copying apache_beam/coders/stream.pyx -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/coders> copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/transforms> copying apache_beam/runners/worker/statesampler_fast.pyx -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners/worker> copying apache_beam/coders/coder_impl.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/coders> copying apache_beam/coders/stream.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/coders> copying apache_beam/utils/counters.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/utils> copying apache_beam/utils/windowed_value.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/utils> copying apache_beam/transforms/cy_combiners.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/transforms> copying apache_beam/transforms/stats.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/transforms> copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/transforms> copying apache_beam/runners/common.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners> copying apache_beam/metrics/execution.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/metrics> copying apache_beam/metrics/cells.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/metrics> copying apache_beam/runners/worker/opcounters.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners/worker> copying apache_beam/runners/worker/statesampler_fast.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners/worker> copying apache_beam/runners/worker/operations.pxd -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners/worker> copying apache_beam/runners/worker/crossplatform_time.h -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners/worker> copying apache_beam/runners/worker/crossplatform_unistd.h -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/runners/worker> creating <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/testing/data> copying apache_beam/testing/data/trigger_transcripts.yaml -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/testing/data> copying apache_beam/portability/api/standard_coders.yaml -> <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build/lib/apache_beam/portability/api> > Task :sdks:go:test:setupVirtualenv Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/bin/python3.8> Also creating executable in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/bin/python> Installing setuptools, pip, wheel... done. Running virtualenv with interpreter /usr/bin/python3.8 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting future==0.18.2 Using cached future-0.18.2-py3-none-any.whl Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting py>=1.4.17 Using cached py-1.10.0-py2.py3-none-any.whl (97 kB) Collecting six>=1.14.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting filelock>=3.0.0 Using cached filelock-3.3.2-py3-none-any.whl (9.7 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.9.0-py2.py3-none-any.whl (5.6 MB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting packaging>=14 Using cached packaging-21.2-py3-none-any.whl (40 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.41.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/build/gradleenv/-273006051/lib/python3.8/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/python/build-requirements.txt> (line 17)) (58.3.0) Collecting pyparsing<3,>=2.0.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.4.0-py3-none-any.whl (14 kB) Collecting backports.entry-points-selectable>=1.0.4 Using cached backports.entry_points_selectable-1.1.0-py2.py3-none-any.whl (6.2 kB) Installing collected packages: six, pyparsing, platformdirs, filelock, distlib, backports.entry-points-selectable, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future Successfully installed backports.entry-points-selectable-1.1.0 distlib-0.3.1 filelock-3.3.2 future-0.18.2 grpcio-1.41.1 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.2 platformdirs-2.4.0 pluggy-1.0.0 protobuf-3.19.1 py-1.10.0 pyparsing-2.4.7 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.9.0 > Task :release:go-licenses:go:dockerRun + go-licenses save github.com/apache/beam/sdks/go/container --save_path=/output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:go:dockerRun + go-licenses csv github.com/apache/beam/sdks/go/container + tee /output/licenses/list.csv golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java11:copyGolangLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:pullLicenses DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. INFO:root:Pulling license for 208 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 4.679074 seconds with 16 threads. > Task :sdks:java:container:java11:copyJavaThirdPartyLicenses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:go:container:docker > Task :sdks:java:core:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE > Task :sdks:java:io:hadoop-common:classes UP-TO-DATE > Task :sdks:java:io:hadoop-common:jar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:parquet:compileJava FROM-CACHE > Task :sdks:java:io:parquet:classes UP-TO-DATE > Task :sdks:java:io:parquet:jar > Task :sdks:java:fn-execution:jar > Task :runners:core-construction-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:core-construction-java:classes > Task :runners:core-construction-java:jar > Task :runners:core-java:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:core-java:classes > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:harness:classes > Task :sdks:java:harness:jar > Task :sdks:java:harness:shadowJar > Task :runners:java-fn-execution:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:java-fn-execution:classes > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:testing:expansion-service:compileTestJava Note: <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/src/test/java/org/apache/beam/sdk/testing/expansion/TestExpansionService.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: <https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/java/testing/expansion-service/src/test/java/org/apache/beam/sdk/testing/expansion/TestExpansionService.java> uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:testing:expansion-service:testClasses > Task :sdks:java:io:kafka:compileJava > Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar > Task :sdks:java:io:kafka:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:kafka:classes > Task :sdks:java:io:kafka:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:java:container:java11:copyDockerfileDependencies > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java11:dockerPrepare > Task :sdks:java:container:java11:docker > Task :sdks:java:container:java8:docker > Task :sdks:go:test:ulrValidatesRunner Oct 30, 2021 12:40:27 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transforms:xlang:test:cgbk, beam:transforms:xlang:test:flatten, beam:transforms:xlang:test:prefix, beam:transforms:xlang:test:multi, beam:transforms:xlang:test:gbk, beam:transforms:xlang:test:comgl, beam:transforms:xlang:test:compk, beam:transforms:xlang:count, beam:transforms:xlang:filter_less_than_eq, beam:transforms:xlang:test:partition, beam:transforms:xlang:test:parquet_write, beam:transforms:xlang:parquet_read, beam:transforms:xlang:textio_read, beam:external:java:generate_sequence:v1] INFO:apache_beam.runners.portability.local_job_service:Grpc server started at localhost on port 47871 INFO:__main__:Listening for beam jobs on port 47871. INFO:__main__:Listening for beam jobs on port 47871. ./run_validatesrunner_tests.sh: line 399: go: command not found > Task :sdks:go:test:ulrValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PreCommit_GoPortable_Cron/ws/src/sdks/go/test/build.gradle'> line: 185 * What went wrong: Execution failed for task ':sdks:go:test:ulrValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 13m 17s 109 actionable tasks: 88 executed, 16 from cache, 5 up-to-date Publishing build scan... https://gradle.com/s/muwrcldtfk5yu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
