See 
<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/1152/display/redirect>

Changes:


------------------------------------------
[...truncated 166.78 KB...]
Collecting sqlparse>=0.4.4 (from google-cloud-spanner<4,>=3.0.0)
  Using cached sqlparse-0.4.4-py3-none-any.whl (41 kB)
Collecting docopt (from hdfs<3.0.0,>=2.1.0)
  Using cached docopt-0.6.2-py2.py3-none-any.whl
Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 (from 
httplib2<0.23.0,>=0.8)
  Using cached pyparsing-3.1.1-py3-none-any.whl.metadata (5.1 kB)
Collecting attrs>=19.2.0 (from hypothesis<=7.0.0,>5.0.0)
  Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis<=7.0.0,>5.0.0)
  Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0)
  Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB)
Collecting tzlocal>=1.2 (from js2py<1,>=0.74)
  Using cached tzlocal-5.1-py3-none-any.whl.metadata (16 kB)
Collecting pyjsparser>=2.5.1 (from js2py<1,>=0.74)
  Using cached pyjsparser-2.7.1-py3-none-any.whl
Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0)
  Using cached dnspython-2.4.2-py3-none-any.whl.metadata (4.9 kB)
Collecting iniconfig (from pytest<8.0,>=7.1.2)
  Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Requirement already satisfied: pluggy<2.0,>=0.12 in 
<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages>
 (from pytest<8.0,>=7.1.2) (1.3.0)
Requirement already satisfied: tomli>=1.0.0 in 
<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages>
 (from pytest<8.0,>=7.1.2) (2.0.1)
Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0)
  Using cached execnet-2.0.2-py3-none-any.whl.metadata (2.9 kB)
Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0)
  Using cached 
charset_normalizer-3.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
 (32 kB)
Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0)
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0)
  Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB)
Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0)
  Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0)
  Using cached 
scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0)
  Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3)
  Using cached 
greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata
 (3.8 kB)
Collecting docker>=4.0.0 (from 
testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == 
"test")
  Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB)
Collecting wrapt (from 
testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == 
"test")
  Using cached 
wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
 (6.6 kB)
Collecting deprecation (from 
testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3; extra == 
"test")
  Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3; extra == "test")
  Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0)
  Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2)
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0 (from 
docker>=4.0.0->testcontainers<4.0.0,>=3.0.3->testcontainers[mysql]<4.0.0,>=3.0.3;
 extra == "test")
  Using cached websocket_client-1.6.4-py3-none-any.whl.metadata (7.7 kB)
Collecting google-crc32c<2.0dev,>=1.0 (from 
google-cloud-storage<3.0.0dev,>=1.32.0->google-cloud-aiplatform<2.0,>=1.26.0)
  Using cached 
google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 
(32 kB)
Collecting PyJWT<3,>=1.0.0 (from 
PyJWT[crypto]<3,>=1.0.0->msal<2.0.0,>=1.24.0->azure-identity<2,>=1.12.0)
  Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting portalocker<3,>=1.0 (from 
msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0)
  Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Collecting pyasn1>=0.1.7 (from 
oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31)
  Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74)
  Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB)
Using cached azure_core-1.29.4-py3-none-any.whl (192 kB)
Using cached azure_identity-1.15.0b2-py3-none-any.whl (162 kB)
Using cached azure_storage_blob-12.19.0b1-py3-none-any.whl (394 kB)
Using cached boto3-1.28.66-py3-none-any.whl (135 kB)
Using cached cryptography-41.0.4-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB)
Using cached 
fastavro-1.8.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fasteners-0.19-py3-none-any.whl (18 kB)
Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB)
Using cached google_auth-2.23.3-py2.py3-none-any.whl (182 kB)
Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Using cached google_cloud_aiplatform-1.35.0-py2.py3-none-any.whl (3.1 MB)
Using cached google_cloud_bigquery-3.12.0-py2.py3-none-any.whl (220 kB)
Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB)
Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB)
Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB)
Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB)
Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB)
Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB)
Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB)
Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB)
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 
kB)
Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB)
Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB)
Using cached google_cloud_vision-3.4.4-py2.py3-none-any.whl (444 kB)
Using cached 
grpcio-1.59.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.3 MB)
Using cached hypothesis-6.88.1-py3-none-any.whl (421 kB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached mock-5.1.0-py3-none-any.whl (30 kB)
Using cached 
numpy-1.24.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
Using cached 
orjson-3.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Using cached proto_plus-1.22.3-py3-none-any.whl (48 kB)
Using cached protobuf-4.24.4-cp37-abi3-manylinux2014_x86_64.whl (311 kB)
Using cached 
psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 
(3.0 MB)
Using cached 
pymongo-4.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (687 kB)
Using cached pytest-7.4.2-py3-none-any.whl (324 kB)
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB)
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached 
PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached 
regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 
kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB)
Using cached 
scikit_learn-1.3.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 
(11.1 MB)
Using cached 
SQLAlchemy-1.4.49-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 (1.6 MB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached botocore-1.31.66-py3-none-any.whl (11.3 MB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached 
cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Using cached 
charset_normalizer-3.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 (137 kB)
Using cached dnspython-2.4.2-py3-none-any.whl (300 kB)
Using cached docker-6.1.3-py3-none-any.whl (148 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached execnet-2.0.2-py3-none-any.whl (37 kB)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB)
Using cached google_cloud_storage-2.12.0-py2.py3-none-any.whl (120 kB)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB)
Using cached googleapis_common_protos-1.61.0-py2.py3-none-any.whl (230 kB)
Using cached 
greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (617 
kB)
Using cached grpcio_status-1.59.0-py3-none-any.whl (14 kB)
Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB)
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB)
Using cached 
shapely-2.0.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.5 MB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tzlocal-5.1-py3-none-any.whl (21 kB)
Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB)
Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB)
Using cached 
wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 (82 kB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB)
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam (pyproject.toml): started
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): still running...
  Building wheel for apache-beam (pyproject.toml): finished with status 'done'
  Created wheel for apache-beam: 
filename=apache_beam-2.52.0.dev0-cp38-cp38-linux_x86_64.whl size=16206918 
sha256=37ca366a10087a778fe28652eb3e916978ec57a17443432dbc262cc3fd0b6570
  Stored in directory: 
/home/jenkins/.cache/pip/wheels/67/34/b8/5adce605a0a3f10491be234729fa4854c6a127bc01194f13fc
Successfully built apache-beam
Installing collected packages: sortedcontainers, pytz, pyjsparser, docopt, 
crcmod, zstandard, wrapt, websocket-client, urllib3, typing-extensions, 
threadpoolctl, tenacity, sqlparse, six, regex, pyyaml, pyparsing, pymysql, 
PyJWT, pyhamcrest, pycparser, pyasn1, psycopg2-binary, protobuf, portalocker, 
parameterized, overrides, orjson, objsize, numpy, mock, joblib, jmespath, 
iniconfig, idna, grpcio, greenlet, google-crc32c, fasteners, fastavro, execnet, 
exceptiongroup, dnspython, dill, deprecation, cloudpickle, charset-normalizer, 
certifi, backports.zoneinfo, attrs, tzlocal, sqlalchemy, shapely, scipy, rsa, 
requests, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, pyarrow, 
proto-plus, isodate, hypothesis, httplib2, googleapis-common-protos, 
google-resumable-media, cffi, scikit-learn, requests-mock, pytest-xdist, 
pytest-timeout, pandas, oauth2client, js2py, hdfs, grpcio-status, google-auth, 
freezegun, docker, cryptography, botocore, azure-core, testcontainers, 
s3transfer, grpc-google-iam-v1, google-auth-httplib2, google-apitools, 
google-api-core, azure-storage-blob, apache-beam, msal, google-cloud-core, 
boto3, msal-extensions, google-cloud-vision, google-cloud-videointelligence, 
google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, 
google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, 
google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, 
google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, 
google-cloud-aiplatform, azure-identity
Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0 
azure-core-1.29.4 azure-identity-1.15.0b2 azure-storage-blob-12.19.0b1 
backports.zoneinfo-0.2.1 boto3-1.28.66 botocore-1.31.66 certifi-2023.7.22 
cffi-1.16.0 charset-normalizer-3.3.0 cloudpickle-2.2.1 crcmod-1.7 
cryptography-41.0.4 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 
docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.8.4 fasteners-0.19 
freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 
google-auth-2.23.3 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.35.0 
google-cloud-bigquery-3.12.0 google-cloud-bigquery-storage-2.22.0 
google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 
google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 
google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 
google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 
google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 
google-cloud-storage-2.12.0 google-cloud-videointelligence-2.11.4 
google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.6.0 
googleapis-common-protos-1.61.0 greenlet-3.0.0 grpc-google-iam-v1-0.12.6 
grpcio-1.59.0 grpcio-status-1.59.0 hdfs-2.7.3 httplib2-0.22.0 hypothesis-6.88.1 
idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 
mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 numpy-1.24.4 oauth2client-4.1.3 
objsize-0.6.1 orjson-3.9.9 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 
portalocker-2.8.2 proto-plus-1.22.3 protobuf-4.24.4 psycopg2-binary-2.9.9 
pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 
pyhamcrest-2.0.4 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 
pytest-7.4.2 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 
pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.10.3 requests-2.31.0 
requests-mock-1.11.0 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.1 scipy-1.10.1 
shapely-2.0.2 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 
sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 
typing-extensions-4.8.0 tzlocal-5.1 urllib3-1.26.18 websocket-client-1.6.4 
wrapt-1.16.0rc1 zstandard-0.21.0
WARNING: There was an error checking the latest version of pip.

> Task :sdks:python:apache_beam:testing:load_tests:run
INFO:apache_beam.runners.portability.stager:Copying Beam SDK 
"<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/build/apache-beam.tar.gz";>
 to staging location.
INFO:apache_beam.runners.dataflow.dataflow_runner:Pipeline has additional 
dependencies to be installed in SDK **** container, consider using the SDK 
container image pre-building workflow to avoid repetitive installations. Learn 
more on 
https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild
INFO:root:Using provided Python SDK container image: 
gcr.io/cloud-dataflow/v1beta3/beam_python3.8_sdk:beam-master-20231009
INFO:root:Python SDK container image set to 
"gcr.io/cloud-dataflow/v1beta3/beam_python3.8_sdk:beam-master-20231009" for 
Docker environment
INFO:apache_beam.internal.gcp.auth:Setting socket default timeout to 60 seconds.
INFO:apache_beam.internal.gcp.auth:socket default timeout is 60.0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to 
gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1019125341.1697728352.508053/dataflow_python_sdk.tar...
INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to 
gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1019125341.1697728352.508053/dataflow_python_sdk.tar
 in 0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to 
gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1019125341.1697728352.508053/pipeline.pb...
INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to 
gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-1019125341.1697728352.508053/pipeline.pb
 in 0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
 clientRequestId: '20231019151232509038-3620'
 createTime: '2023-10-19T15:12:33.618624Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2023-10-19_08_12_32-14734917503801090023'
 location: 'us-central1'
 name: 'load-tests-python-dataflow-streaming-combine-1-1019125341'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2023-10-19T15:12:33.618624Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: 
[2023-10-19_08_12_32-14734917503801090023]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 
2023-10-19_08_12_32-14734917503801090023
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow 
monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-10-19_08_12_32-14734917503801090023?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 
2023-10-19_08_12_32-14734917503801090023 is in state JOB_STATE_PENDING
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T15:12:40.478Z: 
JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T15:12:43.276Z: 
JOB_MESSAGE_BASIC: Running job using Streaming Engine
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T15:12:43.591Z: 
JOB_MESSAGE_BASIC: Starting 5 ****s in us-central1-b...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 
2023-10-19_08_12_32-14734917503801090023 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T15:13:14.610Z: 
JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric 
descriptors, so new user metrics of the form custom.googleapis.com/* will not 
be created. However, all user metrics are also available in the metric 
dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, 
you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T15:14:13.801Z: 
JOB_MESSAGE_BASIC: All ****s have finished the startup processes and began to 
receive work requests.
ERROR:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T15:37:22.855Z: 
JOB_MESSAGE_ERROR: generic::aborted: SDK harness sdk-0-0_sibling_1 
disconnected. This usually means that the process running the pipeline code has 
crashed. Inspect the Worker Logs and the Diagnostics tab to determine the cause 
of the crash.
with MessageCode:
(2863c131b6695964): SDK disconnect.
passed through:
==>
    dist_proc/dax/workflow/****/fnapi_control_service.cc:215
generic::aborted: SDK harness sdk-0-0 disconnected. This usually means that the 
process running the pipeline code has crashed. Inspect the Worker Logs and the 
Diagnostics tab to determine the cause of the crash.
with MessageCode:
(d18888c2a6af4924): SDK disconnect.
passed through:
==>
    dist_proc/dax/workflow/****/fnapi_control_service.cc:215
ERROR:apache_beam.runners.dataflow.dataflow_runner:2023-10-19T17:20:36.063Z: 
JOB_MESSAGE_ERROR: generic::aborted: SDK harness sdk-0-0_sibling_1 
disconnected. This usually means that the process running the pipeline code has 
crashed. Inspect the Worker Logs and the Diagnostics tab to determine the cause 
of the crash.
with MessageCode:
(eb1bdeff32a44f9d): SDK disconnect.
passed through:
==>
    dist_proc/dax/workflow/****/fnapi_control_service.cc:215
generic::aborted: SDK harness sdk-0-0 disconnected. This usually means that the 
process running the pipeline code has crashed. Inspect the Worker Logs and the 
Diagnostics tab to determine the cause of the crash.
with MessageCode:
(d295b3a44139cfca): SDK disconnect.
passed through:
==>
    dist_proc/dax/workflow/****/fnapi_control_service.cc:215
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 
2023-10-19_08_12_32-14734917503801090023 is in state JOB_STATE_CANCELLING
Traceback (most recent call last):
  File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File 
"<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/combine_test.py";,>
 line 129, in <module>
    CombineTest().run()
  File 
"<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test.py";,>
 line 152, in run
    state = self.result.wait_until_finish(duration=self.timeout_ms)
  File 
"<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
 line 763, in wait_until_finish
    assert duration or terminated, (
AssertionError: Job did not reach to a terminal state after waiting 
indefinitely. Console URL: 
https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-10-19_08_12_32-14734917503801090023?project=<ProjectId>

> Task :sdks:python:apache_beam:testing:load_tests:run FAILED

FAILURE: Build failed with an exception.

* Where:
Build file 
'<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'>
 line: 63

* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

For more on this, please refer to 
https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings
 in the Gradle documentation.

BUILD FAILED in 4h 54m 26s
9 actionable tasks: 8 executed, 1 from cache

Publishing build scan...
https://ge.apache.org/s/6xu5wth7wxmpw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to