See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/4550/display/redirect?page=changes>
Changes: [Ismaël Mejía] [BEAM-9283] Disable caching ValidatesRunner tests tasks [Kenneth Knowles] Enable dual job submission for Dataflow [zyichi] [BEAM-12045] Install google cloud profiler agent in java sdk container [edre] Fix worker_pool plumbing to use a mutable List. [noreply] [BEAM-12237] Fix logging in Samza Runner (#14657) [Valentyn Tymofieiev] [BEAM-2085] Add resource hints support in Java SDK. [Valentyn Tymofieiev] Translate Resource Hints into v1beta3 API in DF Runner and add test [Valentyn Tymofieiev] Support passing resource hints through pipeline options. [Valentyn Tymofieiev] Add resource hints supported by Dataflow. ------------------------------------------ [...truncated 24.77 KB...] Using cached grpcio-1.37.0-cp37-cp37m-manylinux2014_x86_64.whl (4.2 MB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build-requirements.txt> (line 17)) (56.0.0) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.15.8-cp37-cp37m-manylinux1_x86_64.whl (1.0 MB) Collecting zipp>=0.5 Using cached zipp-3.4.1-py3-none-any.whl (5.2 kB) Collecting pyparsing>=2.0.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting appdirs<2,>=1.4.3 Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Installing collected packages: zipp, six, pyparsing, importlib-metadata, filelock, distlib, appdirs, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future Successfully installed appdirs-1.4.4 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.37.0 grpcio-tools-1.37.0 importlib-metadata-2.1.1 mypy-protobuf-1.18 packaging-20.9 pluggy-0.13.1 protobuf-3.15.8 py-1.10.0 pyparsing-2.4.7 six-1.15.0 toml-0.10.2 tox-3.20.1 virtualenv-20.4.4 zipp-3.4.1 > Task :sdks:python:test-suites:portable:py36:setupVirtualenv done. Running virtualenv with interpreter /usr/bin/python3.6 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp36-cp36m-manylinux2014_x86_64.whl (2.5 MB) Collecting future==0.18.2 Using cached future-0.18.2-py3-none-any.whl Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting importlib-metadata<3,>=0.12 Using cached importlib_metadata-2.1.1-py2.py3-none-any.whl (10 kB) Collecting filelock>=3.0.0 Using cached filelock-3.0.12-py3-none-any.whl (7.6 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.4.4-py2.py3-none-any.whl (7.2 MB) Collecting pluggy>=0.12.0 Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting py>=1.4.17 Using cached py-1.10.0-py2.py3-none-any.whl (97 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting six>=1.14.0 Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Collecting packaging>=14 Using cached packaging-20.9-py2.py3-none-any.whl (40 kB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.15.8-cp36-cp36m-manylinux1_x86_64.whl (1.0 MB) Collecting grpcio>=1.37.0 Using cached grpcio-1.37.0-cp36-cp36m-manylinux2014_x86_64.whl (4.2 MB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build-requirements.txt> (line 17)) (56.0.0) Collecting zipp>=0.5 Using cached zipp-3.4.1-py3-none-any.whl (5.2 kB) Collecting pyparsing>=2.0.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting appdirs<2,>=1.4.3 Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Collecting importlib-resources>=1.0 Using cached importlib_resources-5.1.2-py3-none-any.whl (25 kB) Installing collected packages: zipp, six, pyparsing, importlib-resources, importlib-metadata, filelock, distlib, appdirs, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future Successfully installed appdirs-1.4.4 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.37.0 grpcio-tools-1.37.0 importlib-metadata-2.1.1 importlib-resources-5.1.2 mypy-protobuf-1.18 packaging-20.9 pluggy-0.13.1 protobuf-3.15.8 py-1.10.0 pyparsing-2.4.7 six-1.15.0 toml-0.10.2 tox-3.20.1 virtualenv-20.4.4 zipp-3.4.1 > Task :sdks:python:test-suites:portable:py38:setupVirtualenv done. Running virtualenv with interpreter /usr/bin/python3.8 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting future==0.18.2 Using cached future-0.18.2-py3-none-any.whl Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting py>=1.4.17 Using cached py-1.10.0-py2.py3-none-any.whl (97 kB) Collecting pluggy>=0.12.0 Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting filelock>=3.0.0 Using cached filelock-3.0.12-py3-none-any.whl (7.6 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.4.4-py2.py3-none-any.whl (7.2 MB) Collecting six>=1.14.0 Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Collecting packaging>=14 Using cached packaging-20.9-py2.py3-none-any.whl (40 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (4.2 MB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build-requirements.txt> (line 17)) (56.0.0) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.15.8-cp38-cp38-manylinux1_x86_64.whl (1.0 MB) Collecting pyparsing>=2.0.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting appdirs<2,>=1.4.3 Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Installing collected packages: six, pyparsing, filelock, distlib, appdirs, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future Successfully installed appdirs-1.4.4 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.37.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-20.9 pluggy-0.13.1 protobuf-3.15.8 py-1.10.0 pyparsing-2.4.7 six-1.15.0 toml-0.10.2 tox-3.20.1 virtualenv-20.4.4 > Task :sdks:python:setupVirtualenv done. Running virtualenv with interpreter /usr/bin/python3.8 Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting future==0.18.2 Using cached future-0.18.2-py3-none-any.whl Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.4.4-py2.py3-none-any.whl (7.2 MB) Collecting six>=1.14.0 Using cached six-1.15.0-py2.py3-none-any.whl (10 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting packaging>=14 Using cached packaging-20.9-py2.py3-none-any.whl (40 kB) Collecting filelock>=3.0.0 Using cached filelock-3.0.12-py3-none-any.whl (7.6 kB) Collecting py>=1.4.17 Using cached py-1.10.0-py2.py3-none-any.whl (97 kB) Collecting pluggy>=0.12.0 Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.15.8-cp38-cp38-manylinux1_x86_64.whl (1.0 MB) Collecting grpcio>=1.37.0 Using cached grpcio-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (4.2 MB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from grpcio-tools==1.37.0->-r <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/build-requirements.txt> (line 17)) (56.0.0) Collecting pyparsing>=2.0.2 Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Collecting appdirs<2,>=1.4.3 Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB) Installing collected packages: six, pyparsing, filelock, distlib, appdirs, virtualenv, toml, py, protobuf, pluggy, packaging, grpcio, tox, mypy-protobuf, grpcio-tools, future Successfully installed appdirs-1.4.4 distlib-0.3.1 filelock-3.0.12 future-0.18.2 grpcio-1.37.0 grpcio-tools-1.37.0 mypy-protobuf-1.18 packaging-20.9 pluggy-0.13.1 protobuf-3.15.8 py-1.10.0 pyparsing-2.4.7 six-1.15.0 toml-0.10.2 tox-3.20.1 virtualenv-20.4.4 > Task :sdks:java:core:compileJava > Task :sdks:python:sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:463: UserWarning: Normalizing '2.30.0.dev' to '2.30.0.dev0' warnings.warn(tmpl.format(**locals())) INFO:gen_protos:Regenerating Python proto definitions (no output files). INFO:gen_protos:Found protoc_gen_mypy at <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/build/gradleenv/1922375555/bin/protoc-gen-mypy> beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to external_transforms_pb2.pyi Writing mypy to beam_runner_api_pb2.pyi Writing mypy to standard_window_fns_pb2.pyi Writing mypy to metrics_pb2.pyi Writing mypy to endpoints_pb2.pyi Writing mypy to schema_pb2.pyi Writing mypy to beam_artifact_api_pb2.pyi Writing mypy to beam_expansion_api_pb2.pyi Writing mypy to beam_job_api_pb2.pyi Writing mypy to beam_provision_api_pb2.pyi Writing mypy to beam_fn_api_pb2.pyi Writing mypy to beam_interactive_api_pb2.pyi RefactoringTool: Skipping optional fixer: idioms RefactoringTool: Skipping optional fixer: ws_comma RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: No changes to <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: Refactored <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> RefactoringTool: Files that were modified: RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_expansion_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_fn_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_interactive_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_job_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_provision_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_grpc.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/endpoints_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/external_transforms_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/schema_pb2.py> RefactoringTool: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/metrics_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_artifact_api_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/standard_window_fns_pb2_urns.py> INFO:gen_protos:Writing urn stubs: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/python/apache_beam/portability/api/beam_runner_api_pb2_urns.py> warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:java:core:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:fn-execution:compileJava warning: Memory constraints are impeding performance; please increase max heap size. error: warnings found and -Werror specified Note: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Spark/ws/src/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataSizeBasedBufferingOutboundObserver.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 error 1 warning > Task :sdks:java:fn-execution:compileJava FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:fn-execution:compileJava'. > Compilation failed; see the compiler error output for details. * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 22s 46 actionable tasks: 35 executed, 11 from cache Publishing build scan... https://gradle.com/s/dhtd2qyx6ogz6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
