See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2629/display/redirect?page=changes>
Changes: [noreply] Bump terser from 5.9.0 to 5.14.2 in [noreply] Fixes #22156: Fix Spark3 runner to compile against Spark 3.2/3.3 and add ------------------------------------------ [...truncated 82.02 KB...] go: added google.golang.org/protobuf v1.28.0 + go-licenses save github.com/apache/beam/sdks/v2/java/container --save_path=/output/licenses W0722 10:26:20.277538 28 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + go-licenses csv github.com/apache/beam/sdks/v2/java/container + tee /output/licenses/list.csv W0722 10:26:24.167787 164 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.40.0/sdks/go/README.md,Apache-2.0 github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.40.0/sdks/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause golang.org/x/net,https://cs.opensource.google/go/x/net/+/c690dde0:LICENSE,BSD-3-Clause golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/bc2c85ad:LICENSE,BSD-3-Clause golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/e326c6e8e9c8/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.47.0/LICENSE,Apache-2.0 google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.1,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.3,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,importlib-metadata==4.12.0,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.21.6,orjson==3.7.8,packaging==21.3,pandas==1.3.5,parameterized==0.8.1,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.1,requests-mock==1.9.3,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,SQLAlchemy==1.4.39,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,typing_extensions==4.3.0,urllib3==1.26.10,wcwidth==0.2.5,websocket-client==1.3.3,wrapt==1.14.1,zipp==3.8.1> [0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='3560592388' [0m[1mflink-runner-test run-test-pre: commands[0] | python --version [0mPython 3.7.12 [1mflink-runner-test run-test-pre: commands[1] | pip --version [0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/pip> (python 3.7) [1mflink-runner-test run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK' [0m============================= test session starts ============================== platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =================================== FAILURES =================================== __________________ FlinkRunnerTestOptimized.test_assert_that ___________________ RuntimeError: Pipeline timed out waiting for job service subprocess. During handling of the above exception, another exception occurred: self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that> def test_assert_that(self): # TODO: figure out a way for fn_api_runner to parse and raise the # underlying exception. with self.assertRaisesRegex(Exception, 'Failed assert'): with self.create_pipeline() as p: > assert_that(p | beam.Create(['a', 'b']), equal_to(['a'])) E AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess." apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError ----------------------------- Captured stderr call ----------------------------- Jul 22, 2022 10:32:27 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems WARNING: Unable to retrieve the requested metadata. Jul 22, 2022 10:32:27 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService INFO: ArtifactStagingService started on localhost:41637 Jul 22, 2022 10:32:27 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService INFO: Java ExpansionService started on localhost:39567 Jul 22, 2022 10:32:27 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer INFO: JobService started on localhost:54259 Jul 22, 2022 10:32:27 AM org.apache.beam.runners.jobsubmission.JobServerDriver run INFO: Job server now running, terminate with Ctrl+C =============================== warnings summary =============================== apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_element_to_batch_pardo <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/worker/operations.py>:358: InefficientExecutionWarning: Input to operation <DoOperation ParDo(ArrayMultiplyDoFn) output_tags=['None'], receivers=[GeneralPurposeConsumerSet[ParDo(ArrayMultiplyDoFn).out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]> must be rebatched from type NumpyArray[dtype('int64')] to NumpyArray[dtype('O')]. This is very inefficient, consider re-structuring your pipeline or adding a DoFn to directly convert between these types. InefficientExecutionWarning) apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_element_to_batch_pardo <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/common.py>:1704: FutureWarning: arrays to stack must be passed as a "sequence" type such as list or tuple. Support for non-sequence iterables such as generators is deprecated as of NumPy 1.16 and will raise an error in the future. self.main_receivers.receive_batch(windowed_batch) -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> - ======== 1 failed, 163 passed, 46 skipped, 6 warnings in 918.42 seconds ======== [31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1) [0m[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [31mERROR: flink-runner-test: commands failed [0m > Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK > FAILED > Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.1,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.3,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,orjson==3.7.8,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.1,requests-mock==1.9.3,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.39,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,typing_extensions==4.3.0,urllib3==1.26.10,wcwidth==0.2.5,websocket-client==1.3.3,wrapt==1.14.1> [0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='2452000786' [0m[1mflink-runner-test run-test-pre: commands[0] | python --version [0mPython 3.8.10 [1mflink-runner-test run-test-pre: commands[1] | pip --version [0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8) [1mflink-runner-test run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK' [0m============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =============================== warnings summary =============================== target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_element_to_batch_pardo <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/operations.py>:352: InefficientExecutionWarning: Input to operation <DoOperation ParDo(ArrayMultiplyDoFn) output_tags=['None'], receivers=[GeneralPurposeConsumerSet[ParDo(ArrayMultiplyDoFn).out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]> must be rebatched from type NumpyArray[dtype('int64')] to NumpyArray[dtype('O')]. This is very inefficient, consider re-structuring your pipeline or adding a DoFn to directly convert between these types. warnings.warn( apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_element_to_batch_pardo <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/common.py>:1704: FutureWarning: arrays to stack must be passed as a "sequence" type such as list or tuple. Support for non-sequence iterables such as generators is deprecated as of NumPy 1.16 and will raise an error in the future. self.main_receivers.receive_batch(windowed_batch) -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> - ============= 164 passed, 46 skipped, 7 warnings in 719.20 seconds ============= [1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [32m flink-runner-test: commands succeeded [0m[32m congratulations :) [0m > Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.1,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.3,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,orjson==3.7.8,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.1,requests-mock==1.9.3,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.39,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,typing_extensions==4.3.0,urllib3==1.26.10,wcwidth==0.2.5,websocket-client==1.3.3,wrapt==1.14.1> [0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='3782887992' [0m[1mflink-runner-test run-test-pre: commands[0] | python --version [0mPython 3.9.10 [1mflink-runner-test run-test-pre: commands[1] | pip --version [0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9) [1mflink-runner-test run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK' [0m============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =============================== warnings summary =============================== target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_element_to_batch_pardo <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/operations.py>:352: InefficientExecutionWarning: Input to operation <DoOperation ParDo(ArrayMultiplyDoFn) output_tags=['None'], receivers=[GeneralPurposeConsumerSet[ParDo(ArrayMultiplyDoFn).out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]> must be rebatched from type NumpyArray[dtype('int64')] to NumpyArray[dtype('O')]. This is very inefficient, consider re-structuring your pipeline or adding a DoFn to directly convert between these types. warnings.warn( apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_element_to_batch_pardo apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_element_to_batch_pardo <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/common.py>:1704: FutureWarning: arrays to stack must be passed as a "sequence" type such as list or tuple. Support for non-sequence iterables such as generators is deprecated as of NumPy 1.16 and will raise an error in the future. self.main_receivers.receive_batch(windowed_batch) -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> - ============= 164 passed, 46 skipped, 7 warnings in 728.93 seconds ============= [1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [32m flink-runner-test: commands succeeded [0m[32m congratulations :) [0m > Task :sdks:python:test-suites:portable:py39:flinkValidatesRunner FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 43m 5s 151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/cvadjnwk5afoc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
