See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2722/display/redirect>
Changes: ------------------------------------------ [...truncated 70.18 KB...] Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB) Collecting six>=1.9.0 Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4 Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5 > Task :sdks:python:test-suites:portable:py37:setupVirtualenv > Task :sdks:python:sdist org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:530: UserWarning: Normalizing '2.42.0.dev' to '2.42.0.dev0' warnings.warn(tmpl.format(**locals())) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :release:go-licenses:java:dockerRun W0814 16:26:01.544013 185 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies: /go/pkg/mod/golang.org/x/[email protected]/unix/asm_linux_amd64.s + chmod -R a+w /output/licenses > Task :sdks:java:container:pullLicenses Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses> INFO:root:Pulling license for 241 dependencies using 16 threads. INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5 INFO:root:pull_licenses_java.py succeed. It took 8.516201 seconds with 16 threads. > Task :sdks:java:container:goPrepare UP-TO-DATE > Task :sdks:java:container:java8:copyJavaThirdPartyLicenses > Task :sdks:java:container:goBuild /home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go > Task :sdks:java:container:java8:copySdkHarnessLauncher Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons: - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem. - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem. > Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:java:container:java8:docker > Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.4,freezegun==1.2.2,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,importlib-metadata==4.12.0,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.21.6,orjson==3.7.11,packaging==21.3,pandas==1.3.5,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.0,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.2,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.7.25,requests==2.28.1,requests-mock==1.9.3,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,SQLAlchemy==1.4.40,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.11,websocket-client==1.3.3,wrapt==1.14.1,zipp==3.8.1,zstandard==0.18.0> [0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='30468198' [0m[1mflink-runner-test run-test-pre: commands[0] | python --version [0mPython 3.7.12 [1mflink-runner-test run-test-pre: commands[1] | pip --version [0mpip 22.2.1 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/pip> (python 3.7) [1mflink-runner-test run-test-pre: commands[2] | pip check [0mNo broken requirements found. [1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.42.0-SNAPSHOT.jar> --environment_type=LOOPBACK' [0m============================= test session starts ============================== platform linux -- Python 3.7.12, pytest-7.1.2, pluggy-1.0.0 cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> configfile: pytest.ini plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 210 items apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [ 9%] ..........s....s...s..s............s..ss.....ss.s........s...s...ss...ss [ 43%] s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%] ......s....s...s..s............s..ss.....ss.s.. [100%] =============================== warnings summary =============================== target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> - ============ 164 passed, 46 skipped, 1 warning in 737.90s (0:12:17) ============ [1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh> [0m___________________________________ summary ____________________________________ [32m flink-runner-test: commands succeeded [0m[32m congratulations :) [0m > Task :sdks:python:test-suites:portable:py37:flinkValidatesRunner > Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[31mERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log> [0m================================== log start =================================== Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting crcmod<2.0,>=1.7 Using cached crcmod-1.7-cp38-cp38-linux_x86_64.whl Collecting orjson<4.0 Downloading orjson-3.7.12.tar.gz (946 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 946.7/946.7 kB 16.9 MB/s eta 0:00:00 Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'error' error: subprocess-exited-with-error × Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [6 lines of output] Cargo, the Rust package manager, is not installed or is not on PATH. This package requires Rust and Cargo to compile extensions. Install it through the system's package manager or via https://rustup.rs/ Checking for Rust toolchain.... [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. [notice] A new release of pip available: 22.2.1 -> 22.2.2 [notice] To update, run: pip install --upgrade pip =================================== log end ==================================== ___________________________________ summary ____________________________________ [31mERROR: flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1) [0m > Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK > FAILED > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK [1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test> [0m[1mflink-runner-test installdeps: -rbuild-requirements.txt [0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz> [0m[31mERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log> [0m================================== log start =================================== Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting crcmod<2.0,>=1.7 Using cached crcmod-1.7-cp39-cp39-linux_x86_64.whl Collecting orjson<4.0 Using cached orjson-3.7.12.tar.gz (946 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'error' error: subprocess-exited-with-error × Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [6 lines of output] Cargo, the Rust package manager, is not installed or is not on PATH. This package requires Rust and Cargo to compile extensions. Install it through the system's package manager or via https://rustup.rs/ Checking for Rust toolchain.... [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. [notice] A new release of pip available: 22.2.1 -> 22.2.2 [notice] To update, run: pip install --upgrade pip =================================== log end ==================================== ___________________________________ summary ____________________________________ [31mERROR: flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1) [0m > Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK > FAILED FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 14m 25s 151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/sktioi5lsq3rc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
