See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/4171/display/redirect>
Changes: ------------------------------------------ [...truncated 71.12 KB...] #20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/ #20 DONE 0.1s #21 exporting to image #21 exporting layers #21 exporting layers 0.3s done #21 writing image sha256:be5276527efc4d1bdd5c256e022b0fd812930cd4426feacaa7dc5b08a8cc2acc done #21 naming to docker.io/apache/beam_java8_sdk:2.51.0.dev done #21 DONE 0.3s > Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK .pkg_external: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external> .pkg_external_sdist_meta: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external_sdist_meta> flink-runner-test: install_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre -r build-requirements.txt .pkg_external: freeze> python -m pip freeze --all .pkg_external: pip==23.2.1,setuptools==68.0.0,wheel==0.41.1 .pkg_external_sdist_meta: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel .pkg_external_sdist_meta: _optional_hooks <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: install_requires_for_build_wheel> python -I -m pip install wheel .pkg_external_sdist_meta: freeze> python -m pip freeze --all .pkg_external_sdist_meta: pip==23.2.1,setuptools==68.0.0,wheel==0.41.1 .pkg_external_sdist_meta: prepare_metadata_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: install_package_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' flink-runner-test: install_package> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre --force-reinstall --no-deps <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz> flink-runner-test: freeze> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> freeze flink-runner-test: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz>#sha256=13ec13bfa6606e9aa4e6a1eb498814746364369a8f19bd29c15cd7ca479f4188,attrs==23.1.0,certifi==2023.7.22,cffi==1.15.1,charset-normalizer==3.2.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==41.0.3,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.7,dnspython==2.4.2,docker==6.1.3,docopt==0.6.2,execnet==2.0.2,fastavro==1.8.2,fasteners==0.18,freezegun==1.2.2,greenlet==3.0.0a1,grpcio==1.57.0,grpcio-tools==1.53.0,hdfs==2.7.2,httplib2==0.22.0,hypothesis==6.82.3,idna==3.4,iniconfig==2.0.0,joblib==1.3.2,mock==5.1.0,mypy-protobuf==3.5.0,numpy==1.24.4,objsize==0.6.1,orjson==3.9.4,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.2.0,proto-plus==1.22.3,protobuf==4.23.4,psycopg2-binary==2.9.7,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.1,PyMySQL==1.1.0,pyparsing==3.1.1,pytest==7.4.0,pytest-timeout==2.1.0,pytest-xdist==3.3.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0.1,regex==2023.8.8,requests==2.31.0,requests-mock==1.11.0,scikit-learn==1.3.0,scipy==1.11.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.49,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.2.0,types-protobuf==4.24.0.0,typing_extensions==4.7.1,urllib3==2.0.4,websocket-client==1.6.1,wrapt==1.15.0,zstandard==0.21.0 flink-runner-test: commands_pre[0]> python --version Python 3.11.2 flink-runner-test: commands_pre[1]> pip --version pip 23.2.1 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pip> (python 3.11) flink-runner-test: commands_pre[2]> pip check No broken requirements found. flink-runner-test: commands_pre[3]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> flink-runner-test: commands[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar> --environment_type=LOOPBACK' ============================= test session starts ============================== platform linux -- Python 3.11.2, pytest-7.4.0, pluggy-1.2.0 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python> configfile: pytest.ini plugins: xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0, hypothesis-6.82.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =================================== FAILURES =================================== __________________ FlinkRunnerTestOptimized.test_assert_that ___________________ RuntimeError: Subprocess terminated unexpectedly with exit code 0. During handling of the above exception, another exception occurred: self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that> def test_assert_that(self): # TODO: figure out a way for fn_api_runner to parse and raise the # underlying exception. > with self.assertRaisesRegex(Exception, 'Failed assert'): E AssertionError: "Failed assert" does not match "Subprocess terminated unexpectedly with exit code 0." apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:112: AssertionError ----------------------------- Captured stderr call ----------------------------- Aug 11, 2023 10:35:03 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems WARNING: Unable to retrieve the requested metadata. Aug 11, 2023 10:35:03 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService INFO: ArtifactStagingService started on localhost:38647 Aug 11, 2023 10:35:04 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService INFO: Java ExpansionService started on localhost:58191 Aug 11, 2023 10:35:04 PM org.apache.beam.runners.jobsubmission.JobServerDriver run WARNING: Exception during job server creation java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:32807 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.netty.NettyServer.start(NettyServer.java:328) at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:184) at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:93) at org.apache.beam.sdk.fn.server.ServerFactory$InetSocketAddressServerFactory.createServer(ServerFactory.java:162) at org.apache.beam.sdk.fn.server.ServerFactory$InetSocketAddressServerFactory.create(ServerFactory.java:145) at org.apache.beam.sdk.fn.server.GrpcFnServer.create(GrpcFnServer.java:110) at org.apache.beam.runners.jobsubmission.JobServerDriver.createJobServer(JobServerDriver.java:238) at org.apache.beam.runners.jobsubmission.JobServerDriver.run(JobServerDriver.java:176) at org.apache.beam.runners.flink.FlinkJobServerDriver.main(FlinkJobServerDriver.java:77) Caused by: org.apache.beam.vendor.grpc.v1p54p0.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use Aug 11, 2023 10:35:04 PM org.apache.beam.runners.jobsubmission.JobServerDriver stop INFO: ArtifactStagingServer stopped on localhost:38647 Aug 11, 2023 10:35:04 PM org.apache.beam.runners.jobsubmission.JobServerDriver stop INFO: Expansion stopped on localhost:58191 =============================== warnings summary =============================== apache_beam/runners/portability/stager.py:63 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/stager.py>:63: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/hdfs/config.py:28 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses from imp import load_source apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self._expansion_service, pipeline.options) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/pytest_flink-runner-test.xml> - =========================== short test summary info ============================ FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that ===== 1 failed, 163 passed, 46 skipped, 10 warnings in 1028.27s (0:17:08) ====== flink-runner-test: exit 1 (1030.59 seconds) <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python>> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar> --environment_type=LOOPBACK' pid=1660404 flink-runner-test: commands_post[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: FAIL code 1 (1088.46=setup[56.25]+cmd[0.00,0.43,1.13,0.02,1030.59,0.03] seconds) evaluation failed :( (1088.60 seconds) > Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK > FAILED > Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK .pkg_external: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external> .pkg_external_sdist_meta: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external_sdist_meta> flink-runner-test: install_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre -r build-requirements.txt .pkg_external: freeze> python -m pip freeze --all .pkg_external: pip==23.2.1,setuptools==68.0.0,wheel==0.41.1 .pkg_external_sdist_meta: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel .pkg_external_sdist_meta: _optional_hooks <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: install_requires_for_build_wheel> python -I -m pip install wheel .pkg_external_sdist_meta: freeze> python -m pip freeze --all .pkg_external_sdist_meta: pip==23.2.1,setuptools==68.0.0,wheel==0.41.1 .pkg_external_sdist_meta: prepare_metadata_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: install_package_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' flink-runner-test: install_package> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre --force-reinstall --no-deps <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz> flink-runner-test: freeze> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> freeze flink-runner-test: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz>#sha256=13ec13bfa6606e9aa4e6a1eb498814746364369a8f19bd29c15cd7ca479f4188,attrs==23.1.0,certifi==2023.7.22,cffi==1.15.1,charset-normalizer==3.2.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==41.0.3,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.7,dnspython==2.4.2,docker==6.1.3,docopt==0.6.2,exceptiongroup==1.1.2,execnet==2.0.2,fastavro==1.8.2,fasteners==0.18,freezegun==1.2.2,greenlet==3.0.0a1,grpcio==1.57.0,grpcio-tools==1.53.0,hdfs==2.7.2,httplib2==0.22.0,hypothesis==6.82.3,idna==3.4,iniconfig==2.0.0,joblib==1.3.2,mock==5.1.0,mypy-protobuf==3.5.0,numpy==1.24.4,objsize==0.6.1,orjson==3.9.4,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.2.0,proto-plus==1.22.3,protobuf==4.23.4,psycopg2-binary==2.9.7,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.1,PyMySQL==1.1.0,pyparsing==3.1.1,pytest==7.4.0,pytest-timeout==2.1.0,pytest-xdist==3.3.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0.1,regex==2023.8.8,requests==2.31.0,requests-mock==1.11.0,scikit-learn==1.3.0,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.49,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.2.0,tomli==2.0.1,types-protobuf==4.24.0.0,typing_extensions==4.7.1,urllib3==2.0.4,websocket-client==1.6.1,wrapt==1.15.0,zstandard==0.21.0 flink-runner-test: commands_pre[0]> python --version Python 3.8.10 flink-runner-test: commands_pre[1]> pip --version pip 23.2.1 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8) flink-runner-test: commands_pre[2]> pip check No broken requirements found. flink-runner-test: commands_pre[3]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> flink-runner-test: commands[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.51.0-SNAPSHOT.jar> --environment_type=LOOPBACK' ============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-7.4.0, pluggy-1.2.0 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python> configfile: pytest.ini plugins: xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0, hypothesis-6.82.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =============================== warnings summary =============================== apache_beam/runners/portability/stager.py:63 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/stager.py>:63: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py:28 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self._expansion_service, pipeline.options) apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_pardo_side_input_dependencies <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_state Traceback (most recent call last): File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner self.run() File "/usr/lib/python3.8/threading.py", line 870, in run self._target(*self._args, **self._kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 1035, in pull_responses for response in responses: File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py";,> line 541, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py";,> line 967, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.CANCELLED details = "Received RST_STREAM with error code 8" debug_error_string = "UNKNOWN:Error received from peer {grpc_message:"Received RST_STREAM with error code 8", grpc_status:1, created_time:"2023-08-11T22:53:53.252227644+00:00"}" > warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg)) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> - =========== 164 passed, 46 skipped, 11 warnings in 848.34s (0:14:08) =========== flink-runner-test: commands_post[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.51.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: OK (902.03=setup[49.99]+cmd[0.01,0.40,1.03,0.03,850.54,0.03] seconds) congratulations :) (902.21 seconds) > Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 34m 29s 153 actionable tasks: 103 executed, 46 from cache, 4 up-to-date Publishing build scan... https://ge.apache.org/s/3pzcoq23i4xwo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
