See <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/121/display/redirect?page=changes>
Changes: [noreply] Set DELETE_BEFORE_DAY in accordance with release period (#24867) [noreply] adding parameters flag to support schema based transforms (#24864) [noreply] Fix SQLIO Performance Test (#24824) [noreply] Reduce redundant Get API call when creating bq temp dataset (#24831) [noreply] Disable sonarqube cron job (#24769) ------------------------------------------ [...truncated 1.21 KB...] Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --force --progress -- https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision c46c6d373d7af23e90630f0d201da1389d106d91 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f c46c6d373d7af23e90630f0d201da1389d106d91 # timeout=10 Commit message: "Disable sonarqube cron job (#24769)" > git rev-list --no-walk 6d058d9ee4774204d90b11f6b9a5e612f1eb5ca2 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SETUPTOOLS_USE_DISTUTILS=stdlib SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_Inference_Python_Benchmarks_Dataflow] $ /bin/bash -xe /tmp/jenkins1314469969358502493.sh + echo '*** Pytorch Vision Classification with Resnet 101 ***' *** Pytorch Vision Classification with Resnet 101 *** [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.benchmarks.inference.pytorch_image_classification_benchmarks -Prunner=DataflowRunner "-PloadTest.args=--job_name=benchmark-tests-pytorch-imagenet-python0104151927 --project=apache-beam-testing --region=us-central1 --machine_type=n1-standard-2 --num_****s=75 --disk_size_gb=50 --autoscaling_algorithm=NONE --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --requirements_file=apache_beam/ml/inference/torch_tests_requirements.txt --publish_to_big_query=true --metrics_dataset=beam_run_inference --metrics_table=torch_inference_imagenet_results_resnet101 --input_options={} --influx_measurement=torch_inference_imagenet_resnet101 --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --pretrained_model_name=resnet101 --device=CPU --input_file=gs://apache-beam-ml/testing/inputs/openimage_50k_benchmark.txt --model_state_dict_path=gs://apache-beam-ml/models/torchvision.models.resnet101.pth --output=gs://temp-storage-for-end-to-end-tests/torch/result_1010104151927.txt --runner=DataflowRunner" -PloadTest.requirementsTxtFile=apache_beam/ml/inference/torch_tests_requirements.txt -PpythonVersion=3.8 --continue --max-****s=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:python:apache_beam:testing:load_tests:run To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.5.1/userguide/gradle_daemon.html#sec:disabling_the_daemon. Daemon will be stopped at the end of the build Configuration on demand is an incubating feature. > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build > Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv Collecting pip Using cached pip-22.3.1-py3-none-any.whl (2.1 MB) Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Successfully installed pip-22.3.1 Ignoring grpcio: markers 'sys_platform == "darwin"' don't match your environment Ignoring protobuf: markers 'python_version == "3.10" and sys_platform == "darwin"' don't match your environment Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages> (from -r <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/sdks/python/build-requirements.txt> (line 20)) (44.0.0) Collecting setuptools Using cached setuptools-65.6.3-py3-none-any.whl (1.2 MB) Collecting six Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting wheel>=0.36.0 Using cached wheel-0.38.4-py3-none-any.whl (36 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting numpy<1.23.0,>=1.14.3 Using cached numpy-1.22.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.9 MB) Collecting packaging>=14 Using cached packaging-22.0-py3-none-any.whl (42 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.17.1-py3-none-any.whl (8.8 MB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting filelock>=3.0.0 Using cached filelock-3.9.0-py3-none-any.whl (9.7 kB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting grpcio>=1.37.0 Using cached grpcio-1.51.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB) Collecting platformdirs<3,>=2.4 Using cached platformdirs-2.6.2-py3-none-any.whl (14 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.17.0-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.7-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.6-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB) Installing collected packages: distlib, wheel, toml, six, setuptools, py, protobuf, pluggy, platformdirs, packaging, numpy, grpcio, filelock, virtualenv, mypy-protobuf, grpcio-tools, tox Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed distlib-0.3.1 filelock-3.9.0 grpcio-1.51.1 grpcio-tools-1.37.0 mypy-protobuf-1.18 numpy-1.22.4 packaging-22.0 platformdirs-2.6.2 pluggy-1.0.0 protobuf-3.20.3 py-1.11.0 setuptools-65.6.3 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.38.4 > Task :sdks:python:setupVirtualenv Collecting pip Using cached pip-22.3.1-py3-none-any.whl (2.1 MB) Installing collected packages: pip Attempting uninstall: pip Found existing installation: pip 20.0.2 Uninstalling pip-20.0.2: Successfully uninstalled pip-20.0.2 Successfully installed pip-22.3.1 Ignoring grpcio: markers 'sys_platform == "darwin"' don't match your environment Ignoring protobuf: markers 'python_version == "3.10" and sys_platform == "darwin"' don't match your environment Collecting tox==3.20.1 Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB) Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages> (from -r <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/sdks/python/build-requirements.txt> (line 20)) (44.0.0) Collecting setuptools Using cached setuptools-65.6.3-py3-none-any.whl (1.2 MB) Collecting six Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Collecting wheel>=0.36.0 Using cached wheel-0.38.4-py3-none-any.whl (36 kB) Collecting grpcio-tools==1.37.0 Using cached grpcio_tools-1.37.0-cp38-cp38-manylinux2014_x86_64.whl (2.5 MB) Collecting mypy-protobuf==1.18 Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB) Collecting distlib==0.3.1 Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB) Collecting numpy<1.23.0,>=1.14.3 Using cached numpy-1.22.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.9 MB) Collecting toml>=0.9.4 Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.17.1-py3-none-any.whl (8.8 MB) Collecting filelock>=3.0.0 Using cached filelock-3.9.0-py3-none-any.whl (9.7 kB) Collecting py>=1.4.17 Using cached py-1.11.0-py2.py3-none-any.whl (98 kB) Collecting packaging>=14 Using cached packaging-22.0-py3-none-any.whl (42 kB) Collecting pluggy>=0.12.0 Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB) Collecting protobuf<4.0dev,>=3.5.0.post1 Using cached protobuf-3.20.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting grpcio>=1.37.0 Using cached grpcio-1.51.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB) Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 Using cached virtualenv-20.17.0-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.7-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.6-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB) Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB) Collecting platformdirs<3,>=2 Using cached platformdirs-2.6.2-py3-none-any.whl (14 kB) Installing collected packages: distlib, wheel, toml, six, setuptools, py, protobuf, pluggy, platformdirs, packaging, numpy, grpcio, filelock, virtualenv, mypy-protobuf, grpcio-tools, tox Attempting uninstall: setuptools Found existing installation: setuptools 44.0.0 Uninstalling setuptools-44.0.0: Successfully uninstalled setuptools-44.0.0 Successfully installed distlib-0.3.1 filelock-3.9.0 grpcio-1.51.1 grpcio-tools-1.37.0 mypy-protobuf-1.18 numpy-1.22.4 packaging-22.0 platformdirs-2.6.2 pluggy-1.0.0 protobuf-3.20.3 py-1.11.0 setuptools-65.6.3 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.38.4 > Task :sdks:python:sdist org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused. Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:529: UserWarning: Normalizing '2.45.0.dev' to '2.45.0.dev0' warnings.warn(tmpl.format(**locals())) warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' warning: no files found matching 'LICENSE.python' warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md > Task :sdks:python:apache_beam:testing:load_tests:installGcpTest Processing <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz> Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Requirement already satisfied: protobuf<4,>3.12.2 in <https://ci-beam.apache.org/job/beam_Inference_Python_Benchmarks_Dataflow/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages> (from apache-beam==2.45.0.dev0) (3.20.3) Collecting crcmod<2.0,>=1.7 Using cached crcmod-1.7-cp38-cp38-linux_x86_64.whl Collecting orjson<4.0 Using cached orjson-3.8.4.tar.gz (651 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'error' error: subprocess-exited-with-error × Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [6 lines of output] Cargo, the Rust package manager, is not installed or is not on PATH. This package requires Rust and Cargo to compile extensions. Install it through the system's package manager or via https://rustup.rs/ Checking for Rust toolchain.... [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. > Task :sdks:python:apache_beam:testing:load_tests:installGcpTest FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:apache_beam:testing:load_tests:installGcpTest'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org BUILD FAILED in 38s 14 actionable tasks: 8 executed, 4 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/fb6q6tlumpv4e Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
