See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/1489/display/redirect?page=changes>
Changes: [Robert Bradshaw] Restore "Default to Runner v2 for Python Streaming jobs. (#15140)" [Robert Bradshaw] Avoid incompatible setting. [noreply] [BEAM-12909][BEAM-12849] Add support for running spark3 nexmark queries ------------------------------------------ [...truncated 61.22 KB...] > Task :sdks:python:test-suites:portable:py36:setupVirtualenv Collecting grpcio>=1.37.0 Using cached grpcio-1.41.0-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.9 MB) > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:container:java8:copyDockerfileDependencies > Task :sdks:python:test-suites:portable:py36:setupVirtualenv Collecting zipp>=0.5 Using cached zipp-3.6.0-py3-none-any.whl (5.3 kB) Collecting pyparsing>=2.0.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting importlib-resources>=1.0 Using cached importlib_resources-5.2.2-py3-none-any.whl (27 kB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.4.0-py3-none-any.whl (14 kB) Collecting backports.entry-points-selectable>=1.0.4 Using cached backports.entry_points_selectable-1.1.0-py2.py3-none-any.whl (6.2 kB) Installing collected packages: zipp, importlib-metadata, six, pyparsing, platformdirs, importlib-resources, filelock, distlib, backports.entry-points-selectable, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future > Task :runners:direct-java:shadowJar > Task :sdks:python:setupVirtualenv Successfully installed backports.entry-points-selectable-1.1.0 distlib-0.3.1 filelock-3.3.0 future-0.18.2 grpcio-1.41.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-21.0 platformdirs-2.4.0 pluggy-1.0.0 protobuf-3.18.1 py-1.10.0 pyparsing-2.4.7 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.8.1 > Task :sdks:java:container:pullLicenses Already using interpreter /usr/bin/python3 Using base prefix '/usr' New python executable in <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python3> Also creating executable in <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python> Installing setuptools, pip, wheel... > Task :sdks:java:extensions:sql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:classes > Task :sdks:java:extensions:sql:jar > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE > Task :sdks:java:extensions:sql:expansion-service:jar > Task :sdks:python:test-suites:portable:py36:setupVirtualenv Successfully installed backports.entry-points-selectable-1.1.0 distlib-0.3.1 filelock-3.3.0 future-0.18.2 grpcio-1.41.0 grpcio-tools-1.37.0 importlib-metadata-2.1.1 importlib-resources-5.2.2 mypy-protobuf-1.18 packaging-21.0 platformdirs-2.4.0 pluggy-1.0.0 protobuf-3.18.1 py-1.10.0 pyparsing-2.4.7 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.8.1 zipp-3.6.0 > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:python:sdist <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:487: UserWarning: Normalizing '2.34.0.dev' to '2.34.0.dev0' warnings.warn(tmpl.format(**locals())) INFO:gen_protos:Regenerating Python proto definitions (no output files). INFO:gen_protos:Found protoc_gen_mypy at <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy> beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to external_transforms_pb2.pyi Writing mypy to beam_runner_api_pb2.pyi Writing mypy to standard_window_fns_pb2.pyi Writing mypy to metrics_pb2.pyi Writing mypy to endpoints_pb2.pyi Writing mypy to schema_pb2.pyi Writing mypy to beam_artifact_api_pb2.pyi Writing mypy to beam_expansion_api_pb2.pyi Writing mypy to beam_job_api_pb2.pyi Writing mypy to beam_provision_api_pb2.pyi Writing mypy to beam_fn_api_pb2.pyi Writing mypy to beam_interactive_api_pb2.pyi RefactoringTool: Skipping optional fixer: idioms RefactoringTool: Skipping optional fixer: ws_comma RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> > Task :sdks:java:container:pullLicenses done. > Task :sdks:java:extensions:sql:expansion-service:shadowJar > Task :sdks:python:sdist RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> > Task :sdks:java:container:pullLicenses DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality. Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB) Collecting future<1.0.0,>=0.16.0 Using cached future-0.18.2-py3-none-any.whl Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.1-py3-none-any.whl (32 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4 Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5 Executing <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> INFO:root:Pulling license for 209 dependencies using 16 threads. INFO:root:pull_licenses_java.py succeed. It took 2.58599 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:python:sdist RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> RefactoringTool: Files that were modified: RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:python:sdist INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker Sending build context to Docker daemon 166.9MB Step 1/18 : ARG java_version Step 2/18 : FROM openjdk:${java_version} ---> c6a23ae24020 Step 3/18 : MAINTAINER "Apache Beam <[email protected]>" ---> Running in 8f2349f6b874 Removing intermediate container 8f2349f6b874 ---> 1639ca927091 Step 4/18 : ARG pull_licenses ---> Running in 7cc8e42f409f Removing intermediate container 7cc8e42f409f ---> 17e5a9cfdad7 Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/ ---> b60c48a6b5f6 Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/ ---> a156d91c040a Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/ ---> 0417c8919597 Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/ ---> b6e00c6d49a5 Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/ ---> f40c49f047b0 Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/ ---> 9591a0179d1a Step 11/18 : COPY target/LICENSE /opt/apache/beam/ ---> 5c379bf910a3 Step 12/18 : COPY target/NOTICE /opt/apache/beam/ ---> fc4f4285cf7c Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ ---> 220985d89026 Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 73e2ea1ab726 Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 426d34548cc9 Removing intermediate container 426d34548cc9 ---> 4b215d8e0cec Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in 39618b8bcc6c Removing intermediate container 39618b8bcc6c ---> 94d0fbb94165 Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/ ---> df9a408fe34d Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in c5827c5fc4b0 Removing intermediate container c5827c5fc4b0 ---> e7b409def63c Successfully built e7b409def63c Successfully tagged apache/beam_java8_sdk:2.34.0.dev > Task :runners:flink:1.13:job-server:shadowJar > Task :runners:flink:1.13:job-server:shadowJar FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:flink:1.13:job-server:shadowJar'. > Failed to load cache entry for task ':runners:flink:1.13:job-server:shadowJar' * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 11m 58s 138 actionable tasks: 98 executed, 38 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/w7ckiwe343iao Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
