See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/4108/display/redirect>
Changes: ------------------------------------------ [...truncated 99.37 KB...] #11 DONE 0.1s #12 [ 8/16] COPY target/jamm.jar target/open-module-agent*.jar /opt/apache/beam/jars/ #12 DONE 0.1s #13 [ 9/16] COPY target/linux_amd64/boot /opt/apache/beam/ #13 DONE 0.2s #14 [10/16] COPY target/LICENSE /opt/apache/beam/ #14 DONE 0.0s #15 [11/16] COPY target/NOTICE /opt/apache/beam/ #15 DONE 0.1s #16 [12/16] ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/ #16 DONE 0.2s #17 [13/16] COPY target/LICENSE target/options/* /opt/apache/beam/options/ #17 DONE 0.1s #18 [14/16] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ #18 DONE 0.1s #19 [15/16] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi #19 DONE 0.3s #20 [16/16] COPY target/profiler/* /opt/google_cloud_profiler/ #20 DONE 0.1s #21 exporting to image #21 exporting layers #21 exporting layers 0.2s done #21 writing image sha256:ad17baf370677fb2ad10db2ad5e25bf00fde93a8f0aa05d3e96eedd01559c452 done #21 naming to docker.io/apache/beam_java8_sdk:2.50.0.dev done #21 DONE 0.2s > Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK .pkg_external: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external> .pkg_external_sdist_meta: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external_sdist_meta> flink-runner-test: install_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre -r build-requirements.txt .pkg_external: freeze> python -m pip freeze --all .pkg_external: pip==23.1.2,setuptools==68.0.0,wheel==0.40.0 .pkg_external_sdist_meta: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel .pkg_external_sdist_meta: _optional_hooks <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: install_requires_for_build_wheel> python -I -m pip install wheel .pkg_external_sdist_meta: freeze> python -m pip freeze --all .pkg_external_sdist_meta: pip==23.1.2,setuptools==68.0.0,wheel==0.40.0 .pkg_external_sdist_meta: prepare_metadata_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: install_package_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' flink-runner-test: install_package> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre --force-reinstall --no-deps <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz> flink-runner-test: freeze> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> freeze flink-runner-test: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz>#sha256=09cad0dbeabe3e41b1769c8b48fa8cd9e7abc7325225f2140e5b6b76dd051f2b,attrs==23.1.0,certifi==2023.7.22,cffi==1.15.1,charset-normalizer==3.2.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==41.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.7,dnspython==2.4.1,docker==6.1.3,docopt==0.6.2,execnet==2.0.2,fastavro==1.8.2,fasteners==0.18,freezegun==1.2.2,greenlet==3.0.0a1,grpcio==1.57.0rc1,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.22.0,hypothesis==6.82.0,idna==3.4,iniconfig==2.0.0,joblib==1.3.1,mock==5.1.0,mypy-protobuf==3.4.0,numpy==1.24.4,objsize==0.6.1,orjson==3.9.2,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.2.0,proto-plus==1.22.3,protobuf==4.23.4,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.1,PyMySQL==1.1.0,pyparsing==3.1.0,pytest==7.4.0,pytest-timeout==2.1.0,pytest-xdist==3.3.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0.1,regex==2023.6.3,requests==2.31.0,requests-mock==1.11.0,scikit-learn==1.3.0,scipy==1.11.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.49,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.2.0,types-protobuf==4.23.0.2,typing_extensions==4.7.1,urllib3==2.0.4,websocket-client==1.6.1,wrapt==1.15.0,zstandard==0.21.0 flink-runner-test: commands_pre[0]> python --version Python 3.11.2 flink-runner-test: commands_pre[1]> pip --version pip 23.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/pip> (python 3.11) flink-runner-test: commands_pre[2]> pip check No broken requirements found. flink-runner-test: commands_pre[3]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> flink-runner-test: commands[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.50.0-SNAPSHOT.jar> --environment_type=LOOPBACK' ============================= test session starts ============================== platform linux -- Python 3.11.2, pytest-7.4.0, pluggy-1.2.0 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python> configfile: pytest.ini plugins: hypothesis-6.82.0, xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py F.....s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =================================== FAILURES =================================== _______________________ FlinkRunnerTest.test_assert_that _______________________ RuntimeError: Subprocess terminated unexpectedly with exit code 0. During handling of the above exception, another exception occurred: self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTest testMethod=test_assert_that> def test_assert_that(self): # TODO: figure out a way for fn_api_runner to parse and raise the # underlying exception. > with self.assertRaisesRegex(Exception, 'Failed assert'): E AssertionError: "Failed assert" does not match "Subprocess terminated unexpectedly with exit code 0." apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:112: AssertionError ----------------------------- Captured stderr call ----------------------------- Jul 27, 2023 4:27:30 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems WARNING: Unable to retrieve the requested metadata. Jul 27, 2023 4:27:30 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService INFO: ArtifactStagingService started on localhost:38411 Jul 27, 2023 4:27:30 AM org.apache.beam.runners.jobsubmission.JobServerDriver run WARNING: Exception during job server creation java.io.IOException: Failed to bind to address localhost/127.0.0.1:38411 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.netty.NettyServer.start(NettyServer.java:328) at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:184) at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ServerImpl.start(ServerImpl.java:93) at org.apache.beam.sdk.expansion.service.ExpansionServer.<init>(ExpansionServer.java:54) at org.apache.beam.sdk.expansion.service.ExpansionServer.create(ExpansionServer.java:38) at org.apache.beam.runners.jobsubmission.JobServerDriver.createExpansionService(JobServerDriver.java:271) at org.apache.beam.runners.jobsubmission.JobServerDriver.createJobService(JobServerDriver.java:59) at org.apache.beam.runners.jobsubmission.JobServerDriver.createJobServer(JobServerDriver.java:229) at org.apache.beam.runners.jobsubmission.JobServerDriver.run(JobServerDriver.java:176) at org.apache.beam.runners.flink.FlinkJobServerDriver.main(FlinkJobServerDriver.java:77) Caused by: org.apache.beam.vendor.grpc.v1p54p0.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use Jul 27, 2023 4:27:30 AM org.apache.beam.runners.jobsubmission.JobServerDriver stop INFO: ArtifactStagingServer stopped on localhost:38411 =============================== warnings summary =============================== target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.11/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses from imp import load_source apache_beam/runners/portability/stager.py:63 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/stager.py>:63: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self._expansion_service, pipeline.options) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/pytest_flink-runner-test.xml> - =========================== short test summary info ============================ FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_assert_that ====== 1 failed, 163 passed, 46 skipped, 10 warnings in 809.61s (0:13:29) ====== flink-runner-test: exit 1 (811.78 seconds) <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python>> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.50.0-SNAPSHOT.jar> --environment_type=LOOPBACK' pid=446826 flink-runner-test: commands_post[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py311/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/-1720702906/lib/python3.11/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: FAIL code 1 (864.05=setup[50.84]+cmd[0.00,0.36,1.00,0.02,811.78,0.03] seconds) evaluation failed :( (864.18 seconds) > Task :sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK > FAILED > Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK .pkg_external: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external> .pkg_external_sdist_meta: remove tox env folder <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external_sdist_meta> flink-runner-test: install_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre -r build-requirements.txt .pkg_external: freeze> python -m pip freeze --all .pkg_external: pip==23.2.1,setuptools==68.0.0,wheel==0.41.0 .pkg_external_sdist_meta: install_requires> python -I -m pip install 'setuptools>=40.8.0' wheel .pkg_external_sdist_meta: _optional_hooks <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_sdist <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: get_requires_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ .pkg_external_sdist_meta: install_requires_for_build_wheel> python -I -m pip install wheel .pkg_external_sdist_meta: freeze> python -m pip freeze --all .pkg_external_sdist_meta: pip==23.2.1,setuptools==68.0.0,wheel==0.41.0 .pkg_external_sdist_meta: prepare_metadata_for_build_wheel <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: install_package_deps> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre 'cloudpickle~=2.2.1' 'crcmod<2.0,>=1.7' 'cryptography>=41.0.2' 'dill<0.3.2,>=0.3.1.1' 'fastavro<2,>=0.23.6' 'fasteners<1.0,>=0.3' 'freezegun>=0.3.12' 'grpcio!=1.48.0,<2,>=1.33.1' 'hdfs<3.0.0,>=2.1.0' 'httplib2<0.23.0,>=0.8' 'hypothesis<=7.0.0,>5.0.0' 'joblib>=1.0.1' 'mock<6.0.0,>=1.0.1' 'numpy<1.25.0,>=1.14.3' 'objsize<0.7.0,>=0.6.1' 'orjson<4.0' 'pandas<2.0.0' 'parameterized<0.10.0,>=0.7.1' 'proto-plus<2,>=1.7.1' 'protobuf<4.24.0,>=3.20.3' 'psycopg2-binary<3.0.0,>=2.8.5' 'pyarrow<12.0.0,>=3.0.0' 'pydot<2,>=1.2.0' 'pyhamcrest!=1.10.0,<3.0.0,>=1.9' 'pymongo<5.0.0,>=3.8.0' 'pytest-timeout<3,>=2.1.0' 'pytest-xdist<4,>=2.5.0' 'pytest<8.0,>=7.1.2' 'python-dateutil<3,>=2.8.0' 'pytz>=2018.3' 'pyyaml<7.0.0,>=3.12' 'regex>=2020.6.8' 'requests-mock<2.0,>=1.7' 'requests<3.0.0,>=2.24.0' 'scikit-learn>=0.20.0' 'sqlalchemy<2.0,>=1.3' 'tenacity<9,>=8.0.0' 'testcontainers[mysql]<4.0.0,>=3.0.3' 'typing-extensions>=3.7.0' 'zstandard<1,>=0.18.0' flink-runner-test: install_package> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> install --retries 10 --pre --force-reinstall --no-deps <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz> flink-runner-test: freeze> target/.tox-flink-runner-test/flink-runner-test/bin/python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/pip> freeze flink-runner-test: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build/apache-beam.tar.gz>#sha256=09cad0dbeabe3e41b1769c8b48fa8cd9e7abc7325225f2140e5b6b76dd051f2b,attrs==23.1.0,certifi==2023.7.22,cffi==1.15.1,charset-normalizer==3.2.0,cloudpickle==2.2.1,crcmod==1.7,cryptography==41.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.7,dnspython==2.4.1,docker==6.1.3,docopt==0.6.2,exceptiongroup==1.1.2,execnet==2.0.2,fastavro==1.8.2,fasteners==0.18,freezegun==1.2.2,greenlet==3.0.0a1,grpcio==1.57.0rc1,grpcio-tools==1.53.0,hdfs==2.7.0,httplib2==0.22.0,hypothesis==6.82.0,idna==3.4,iniconfig==2.0.0,joblib==1.3.1,mock==5.1.0,mypy-protobuf==3.4.0,numpy==1.24.4,objsize==0.6.1,orjson==3.9.2,packaging==23.1,pandas==1.5.3,parameterized==0.9.0,pluggy==1.2.0,proto-plus==1.22.3,protobuf==4.23.4,psycopg2-binary==2.9.6,pyarrow==11.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==2.0.4,pymongo==4.4.1,PyMySQL==1.1.0,pyparsing==3.1.0,pytest==7.4.0,pytest-timeout==2.1.0,pytest-xdist==3.3.1,python-dateutil==2.8.2,pytz==2023.3,PyYAML==6.0.1,regex==2023.6.3,requests==2.31.0,requests-mock==1.11.0,scikit-learn==1.3.0,scipy==1.10.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.49,tenacity==8.2.2,testcontainers==3.7.1,threadpoolctl==3.2.0,tomli==2.0.1,types-protobuf==4.23.0.2,typing_extensions==4.7.1,urllib3==2.0.4,websocket-client==1.6.1,wrapt==1.15.0,zstandard==0.21.0 flink-runner-test: commands_pre[0]> python --version Python 3.8.10 flink-runner-test: commands_pre[1]> pip --version pip 23.2.1 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8) flink-runner-test: commands_pre[2]> pip check No broken requirements found. flink-runner-test: commands_pre[3]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> flink-runner-test: commands[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.50.0-SNAPSHOT.jar> --environment_type=LOOPBACK' ============================= test session starts ============================== platform linux -- Python 3.8.10, pytest-7.4.0, pluggy-1.2.0 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python> configfile: pytest.ini plugins: hypothesis-6.82.0, xdist-3.3.1, requests-mock-1.11.0, timeout-2.1.0 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =============================== warnings summary =============================== target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source apache_beam/runners/portability/stager.py:63 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/stager.py>:63: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html import pkg_resources apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sql apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_read apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_expand_kafka_write apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_external_transform apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestStreaming::test_sql <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/transforms/external.py>:676: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self._expansion_service, pipeline.options) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> - =========== 164 passed, 46 skipped, 10 warnings in 783.94s (0:13:03) =========== flink-runner-test: commands_post[0]> bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> .pkg_external_sdist_meta: _exit <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.pkg_external/tmp/sdist-extract/apache-beam-2.50.0.dev0>> python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/pyproject_api/_backend.py> True setuptools.build_meta __legacy__ flink-runner-test: OK (845.26=setup[57.10]+cmd[0.01,0.42,1.51,0.04,786.16,0.03] seconds) congratulations :) (845.44 seconds) > Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py311:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 29m 49s 153 actionable tasks: 103 executed, 46 from cache, 4 up-to-date Publishing build scan... https://ge.apache.org/s/wmg2z5r5jvzrq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
