See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/2879/display/redirect>
Changes: ------------------------------------------ [...truncated 61.41 KB...] Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages> (from -r <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build-requirements.txt> (line 20)) (58.1.0) Collecting setuptools Using cached setuptools-65.4.1-py3-none-any.whl (1.2 MB) Collecting wheel>=0.36.0 Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp39-cp39-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting numpy<1.23.0,>=1.14.3 Using cached numpy-1.22.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB) Collecting packaging>=14 Using cached packaging-21.3-py3-none-any.whl (40 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB) Collecting six>=1.14.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting filelock>=3.0.0 Using cached filelock-3.8.0-py3-none-any.whl (10 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting grpcio>=1.37.0 Using cached grpcio-1.49.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting pyparsing!=3.0.5,>=2.0.2 Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB) Collecting platformdirs<3,>=2.4 Using cached platformdirs-2.5.2-py3-none-any.whl (14 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB) Installing collected packages: distlib, wheel, toml, six, setuptools, pyparsing, py, protobuf, pluggy, platformdirs, numpy, filelock, virtualenv, packaging, mypy-protobuf, grpcio, tox, grpcio-tools Attempting uninstall: setuptools Found existing installation: setuptools 58.1.0 Uninstalling setuptools-58.1.0: Successfully uninstalled setuptools-58.1.0 Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.49.1 grpcio-tools-1.37.0 mypy-protobuf-1.18 numpy-1.22.4 packaging-21.3 platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.3 py-1.11.0 pyparsing-3.0.9 setuptools-65.4.1 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.37.1 > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/v2/java/container + tee /output/licenses/list.csv W1008 22:02:55.921058 206 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s > Task :sdks:python:sdist org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:530: UserWarning: Normalizing '2.43.0.dev' to '2.43.0.dev0' warnings.warn(tmpl.format(**locals())) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:java:container:pullLicenses Collecting pip Using cached pip-22.2.2-py3-none-any.whl (2.0 MB) Collecting setuptools Using cached setuptools-65.4.1-py3-none-any.whl (1.2 MB) Collecting wheel Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB) Installing collected packages: pip, setuptools, wheel Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed pip-22.2.2 setuptools-65.4.1 wheel-0.37.1 Collecting beautifulsoup4<5.0,>=4.9.0 Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB) Collecting pyyaml<6.0.0,>=3.12 Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB) Collecting tenacity<6.0,>=5.0.2 Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB) Collecting soupsieve>1.2 Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4 Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5 Executing python <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses> INFO:root:Pulling license for 256 dependencies using 16 threads. INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5 INFO:root:pull_licenses_java.py succeed. It took 13.029949 seconds with 16 threads. Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.> Finished license_scripts.sh > Task :sdks:java:container:goPrepare UP-TO-DATE > Task :release:go-licenses:java:dockerRun github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0 github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0 google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause + chmod -R a+w /output/licenses > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:container:goBuild /home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go > Task :sdks:java:container:java8:copySdkHarnessLauncher Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons: - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem. - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem. > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :runners:flink:1.15:job-server:shadowJar > Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE > Task :sdks:java:container:java8:docker > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.24,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.49.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.4,iniconfig==1.1.1,joblib==1.2.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.5.0,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.3,psycopg2-binary==2.9.4,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.4,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.7.0,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0> [0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='1731055162' [0m[1mflink-runner-test run-test-pre: commands[0] | python --version [0mPython 3.9.10 [1mflink-runner-test run-test-pre: commands[1] | pip --version [0mpip 22.2.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9) [1mflink-runner-test run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK' [0m============================= test session starts ============================== platform linux -- Python 3.9.10, pytest-7.1.3, pluggy-1.0.0 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> configfile: pytest.ini plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0 timeout: 600.0s timeout method: signal timeout func_only: False collected 207 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] .........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...sss [ 43%] ......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%] ...s....s...s..s............s..ss.....ss.s.. [100%] =================================== FAILURES =================================== __________________ FlinkRunnerTestOptimized.test_assert_that ___________________ RuntimeError: Pipeline timed out waiting for job service subprocess. During handling of the above exception, another exception occurred: self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that> def test_assert_that(self): # TODO: figure out a way for fn_api_runner to parse and raise the # underlying exception. with self.assertRaisesRegex(Exception, 'Failed assert'): with self.create_pipeline() as p: > assert_that(p | beam.Create(['a', 'b']), equal_to(['a'])) E AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess." apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError ----------------------------- Captured stderr call ----------------------------- Oct 08, 2022 10:09:21 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems WARNING: Unable to retrieve the requested metadata. Oct 08, 2022 10:09:22 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService INFO: ArtifactStagingService started on localhost:44707 Oct 08, 2022 10:09:22 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService INFO: Java ExpansionService started on localhost:43309 Oct 08, 2022 10:09:22 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer INFO: JobService started on localhost:34345 Oct 08, 2022 10:09:22 PM org.apache.beam.runners.jobsubmission.JobServerDriver run INFO: Job server now running, terminate with Ctrl+C =============================== warnings summary =============================== target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> - =========================== short test summary info ============================ FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that ====== 1 failed, 160 passed, 46 skipped, 2 warnings in 843.22s (0:14:03) ======= [31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1) [0m[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [31mERROR: flink-runner-test: commands failed [0m > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK > FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 15m 48s 147 actionable tasks: 98 executed, 45 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/oai5kihrityiq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
