See <https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/1158/display/redirect>
Changes: ------------------------------------------ [...truncated 167.48 KB...] Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0) Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB) Collecting tzlocal>=1.2 (from js2py<1,>=0.74) Using cached tzlocal-5.2-py3-none-any.whl.metadata (7.8 kB) Collecting pyjsparser>=2.5.1 (from js2py<1,>=0.74) Using cached pyjsparser-2.7.1-py3-none-any.whl Collecting importlib-resources>=1.4.0 (from jsonschema<5.0.0,>=4.0.0) Using cached importlib_resources-6.1.0-py3-none-any.whl.metadata (4.1 kB) Collecting jsonschema-specifications>=2023.03.6 (from jsonschema<5.0.0,>=4.0.0) Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl.metadata (2.8 kB) Collecting pkgutil-resolve-name>=1.3.10 (from jsonschema<5.0.0,>=4.0.0) Using cached pkgutil_resolve_name-1.3.10-py3-none-any.whl (4.7 kB) Collecting referencing>=0.28.4 (from jsonschema<5.0.0,>=4.0.0) Using cached referencing-0.30.2-py3-none-any.whl.metadata (2.6 kB) Collecting rpds-py>=0.7.1 (from jsonschema<5.0.0,>=4.0.0) Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.7 kB) Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0) Using cached dnspython-2.4.2-py3-none-any.whl.metadata (4.9 kB) Collecting iniconfig (from pytest<8.0,>=7.1.2) Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB) Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2) (1.3.0) Requirement already satisfied: tomli>=1.0.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2) (2.0.1) Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0) Using cached execnet-2.0.2-py3-none-any.whl.metadata (2.9 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0) Using cached charset_normalizer-3.3.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (33 kB) Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0) Using cached idna-3.4-py3-none-any.whl (61 kB) Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0) Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB) Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0) Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB) Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0) Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB) Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0) Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB) Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3) Downloading greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.7 kB) Collecting docker>=4.0.0 (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test") Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB) Collecting wrapt (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test") Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB) Collecting deprecation (from testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test") Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test") Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB) Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0) Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2) Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test") Using cached websocket_client-1.6.4-py3-none-any.whl.metadata (7.7 kB) Collecting google-crc32c<2.0dev,>=1.0 (from google-cloud-storage<3.0.0dev,>=1.32.0->google-cloud-aiplatform<2.0,>=1.26.0) Using cached google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB) Collecting zipp>=3.1.0 (from importlib-resources>=1.4.0->jsonschema<5.0.0,>=4.0.0) Using cached zipp-3.17.0-py3-none-any.whl.metadata (3.7 kB) Collecting PyJWT<3,>=1.0.0 (from PyJWT[crypto]<3,>=1.0.0->msal<2.0.0,>=1.24.0->azure-identity<2,>=1.12.0) Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB) Collecting portalocker<3,>=1.0 (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0) Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB) Collecting pyasn1>=0.1.7 (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31) Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB) Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74) Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB) Using cached azure_core-1.29.5-py3-none-any.whl (192 kB) Using cached azure_identity-1.15.0b2-py3-none-any.whl (162 kB) Using cached azure_storage_blob-12.19.0b1-py3-none-any.whl (394 kB) Using cached boto3-1.28.70-py3-none-any.whl (135 kB) Using cached cryptography-41.0.5-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB) Using cached fastavro-1.8.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB) Using cached fasteners-0.19-py3-none-any.whl (18 kB) Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB) Using cached google_auth-2.23.3-py2.py3-none-any.whl (182 kB) Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB) Using cached google_cloud_aiplatform-1.35.0-py2.py3-none-any.whl (3.1 MB) Using cached google_cloud_bigquery-3.12.0-py2.py3-none-any.whl (220 kB) Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB) Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB) Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB) Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB) Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB) Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB) Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB) Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB) Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 kB) Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB) Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB) Using cached google_cloud_vision-3.4.5-py2.py3-none-any.whl (444 kB) Using cached grpcio-1.59.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB) Using cached hypothesis-6.88.1-py3-none-any.whl (421 kB) Using cached joblib-1.3.2-py3-none-any.whl (302 kB) Using cached jsonschema-4.19.1-py3-none-any.whl (83 kB) Using cached mock-5.1.0-py3-none-any.whl (30 kB) Using cached numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB) Using cached orjson-3.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) Using cached proto_plus-1.23.0rc1-py3-none-any.whl (48 kB) Using cached protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl (311 kB) Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB) Using cached pyhamcrest-2.1.0-py3-none-any.whl (54 kB) Using cached pymongo-4.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (687 kB) Using cached pytest-7.4.3-py3-none-any.whl (325 kB) Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB) Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB) Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB) Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB) Using cached regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 kB) Using cached requests-2.31.0-py3-none-any.whl (62 kB) Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB) Using cached scikit_learn-1.3.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB) Using cached SQLAlchemy-1.4.49-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB) Using cached tenacity-8.2.3-py3-none-any.whl (24 kB) Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB) Using cached botocore-1.31.70-py3-none-any.whl (11.3 MB) Using cached certifi-2023.7.22-py3-none-any.whl (158 kB) Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB) Using cached charset_normalizer-3.3.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) Using cached dnspython-2.4.2-py3-none-any.whl (300 kB) Using cached docker-6.1.3-py3-none-any.whl (148 kB) Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB) Using cached execnet-2.0.2-py3-none-any.whl (37 kB) Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB) Using cached google_cloud_storage-2.12.0-py2.py3-none-any.whl (120 kB) Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB) Using cached googleapis_common_protos-1.61.0-py2.py3-none-any.whl (230 kB) Downloading greenlet-3.0.1-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (618 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 618.6/618.6 kB 10.8 MB/s eta 0:00:00 Using cached grpcio_status-1.59.0-py3-none-any.whl (14 kB) Using cached importlib_resources-6.1.0-py3-none-any.whl (33 kB) Using cached jsonschema_specifications-2023.7.1-py3-none-any.whl (17 kB) Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB) Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB) Using cached referencing-0.30.2-py3-none-any.whl (25 kB) Using cached rpds_py-0.10.6-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB) Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB) Using cached shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB) Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB) Using cached tzlocal-5.2-py3-none-any.whl (17 kB) Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB) Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (82 kB) Using cached portalocker-2.8.2-py3-none-any.whl (17 kB) Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB) Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB) Using cached zipp-3.17.0-py3-none-any.whl (7.4 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (pyproject.toml): started Building wheel for apache-beam (pyproject.toml): still running... Building wheel for apache-beam (pyproject.toml): still running... Building wheel for apache-beam (pyproject.toml): still running... Building wheel for apache-beam (pyproject.toml): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl size=16207130 sha256=fa50bcfbc43eb9cd8eabd0286e8c20a92178392fc2e61aec2e98ef45a9311d71 Stored in directory: /home/jenkins/.cache/pip/wheels/67/34/b8/5adce605a0a3f10491be234729fa4854c6a127bc01194f13fc Successfully built apache-beam Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, crcmod, zstandard, zipp, wrapt, websocket-client, urllib3, typing-extensions, threadpoolctl, tenacity, sqlparse, six, rpds-py, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, psycopg2-binary, protobuf, portalocker, pkgutil-resolve-name, parameterized, overrides, orjson, objsize, numpy, mock, joblib, jmespath, iniconfig, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, backports.zoneinfo, attrs, tzlocal, sqlalchemy, shapely, scipy, rsa, requests, referencing, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, proto-plus, isodate, importlib-resources, hypothesis, httplib2, googleapis-common-protos, google-resumable-media, cffi, scikit-learn, requests-mock, pytest-xdist, pytest-timeout, pandas, oauth2client, jsonschema-specifications, js2py, hdfs, grpcio-status, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, jsonschema, grpc-google-iam-v1, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, msal, google-cloud-core, boto3, apache-beam, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0 azure-core-1.29.5 azure-identity-1.15.0b2 azure-storage-blob-12.19.0b1 backports.zoneinfo-0.2.1 boto3-1.28.70 botocore-1.31.70 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.1 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.5 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.8.4 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.3 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.35.0 google-cloud-bigquery-3.12.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.12.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.5 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.61.0 greenlet-3.0.1 grpc-google-iam-v1-0.12.6 grpcio-1.59.0 grpcio-status-1.59.0 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.88.1 idna-3.4 importlib-resources-6.1.0 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 jsonschema-4.19.1 jsonschema-specifications-2023.7.1 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.9 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 pkgutil-resolve-name-1.3.10 portalocker-2.8.2 proto-plus-1.23.0rc1 protobuf-4.24.4 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.1.0 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.3 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 referencing-0.30.2 regex-2023.10.3 requests-2.31.0 requests-mock-1.11.0 rpds-py-0.10.6 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.2 scipy-1.10.1 shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.2 urllib3-1.26.18 websocket-client-1.6.4 wrapt-1.16.0rc1 zipp-3.17.0 zstandard-0.21.0 > Task :sdks:python:apache_beam:testing:load_tests:run INFO:apache_beam.runners.portability.stager:Copying Beam SDK "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. INFO:apache_beam.runners.dataflow.dataflow_runner:Pipeline has additional dependencies to be installed in SDK **** container, consider using the SDK container image pre-building workflow to avoid repetitive installations. Learn more on https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild INFO:root:Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/beam_python3.8_sdk:beam-master-20231023 INFO:root:Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/beam_python3.8_sdk:beam-master-20231023" for Docker environment INFO:apache_beam.internal.gcp.auth:Setting socket default timeout to 60 seconds. INFO:apache_beam.internal.gcp.auth:socket default timeout is 60.0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1025125312.1698246730.629521/dataflow_python_sdk.tar... INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1025125312.1698246730.629521/dataflow_python_sdk.tar in 0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1025125312.1698246730.629521/pipeline.pb... INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1025125312.1698246730.629521/pipeline.pb in 0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job clientRequestId: '20231025151210630628-7982' createTime: '2023-10-25T15:12:11.565661Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2023-10-25_08_12_11-15862768479812034062' location: 'us-central1' name: 'load-tests-python-dataflow-streaming-combine-1-1025125312' projectId: 'apache-beam-testing' stageStates: [] startTime: '2023-10-25T15:12:11.565661Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)> INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2023-10-25_08_12_11-15862768479812034062] INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2023-10-25_08_12_11-15862768479812034062 INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-10-25_08_12_11-15862768479812034062?project=apache-beam-testing INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2023-10-25_08_12_11-15862768479812034062 is in state JOB_STATE_PENDING INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T15:12:17.457Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b. INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T15:12:20.308Z: JOB_MESSAGE_BASIC: Running job using Streaming Engine INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T15:12:20.626Z: JOB_MESSAGE_BASIC: Starting 5 ****s in us-central1-b... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2023-10-25_08_12_11-15862768479812034062 is in state JOB_STATE_RUNNING INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T15:12:42.979Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T15:13:47.827Z: JOB_MESSAGE_BASIC: All ****s have finished the startup processes and began to receive work requests. WARNING:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T16:27:01.808Z: JOB_MESSAGE_WARNING: Autoscaling: Unable to reach resize target in zone us-central1-b. QUOTA_EXCEEDED: Instance 'load-tests-python-dataflo-10250812-hu8f-harness-pc9x' creation failed: Quota 'DISKS_TOTAL_GB' exceeded. Limit: 500000.0 in region us-central1. INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T16:44:28.814Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b. INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T16:44:30.656Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete ERROR:apache_beam.runners.dataflow.dataflow_runner:2023-10-25T18:22:59.598Z: JOB_MESSAGE_ERROR: generic::aborted: SDK harness sdk-0-0_sibling_1 disconnected. This usually means that the process running the pipeline code has crashed. Inspect the Worker Logs and the Diagnostics tab to determine the cause of the crash. with MessageCode: (6b2512f8b45b221e): SDK disconnect. passed through: ==> dist_proc/dax/workflow/****/fnapi_control_service.cc:215 generic::aborted: SDK harness sdk-0-0 disconnected. This usually means that the process running the pipeline code has crashed. Inspect the Worker Logs and the Diagnostics tab to determine the cause of the crash. with MessageCode: (e114374760053658): SDK disconnect. passed through: ==> dist_proc/dax/workflow/****/fnapi_control_service.cc:215 INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2023-10-25_08_12_11-15862768479812034062 is in state JOB_STATE_CANCELLING Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/combine_test.py";,> line 129, in <module> CombineTest().run() File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test.py";,> line 152, in run state = self.result.wait_until_finish(duration=self.timeout_ms) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 763, in wait_until_finish assert duration or terminated, ( AssertionError: Job did not reach to a terminal state after waiting indefinitely. Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-10-25_08_12_11-15862768479812034062?project=<ProjectId> > Task :sdks:python:apache_beam:testing:load_tests:run FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 63 * What went wrong: Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'. > error occurred * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 4h 54m 22s 9 actionable tasks: 8 executed, 1 from cache Publishing build scan... https://ge.apache.org/s/ixux5c3dfwjwo Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
