See <https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/1116/display/redirect>
Changes: ------------------------------------------ [...truncated 53.12 KB...] Collecting google-cloud-storage<3.0.0dev,>=1.32.0 (from google-cloud-aiplatform<2.0,>=1.26.0->apache-beam==2.51.0.dev0) Obtaining dependency information for google-cloud-storage<3.0.0dev,>=1.32.0 from https://files.pythonhosted.org/packages/88/14/c9d4faae7ea4bff4405152cbc762b61100aa6949273b4eb3203d23308670/google_cloud_storage-2.10.0-py2.py3-none-any.whl.metadata Using cached google_cloud_storage-2.10.0-py2.py3-none-any.whl.metadata (6.0 kB) Collecting google-cloud-resource-manager<3.0.0dev,>=1.3.3 (from google-cloud-aiplatform<2.0,>=1.26.0->apache-beam==2.51.0.dev0) Obtaining dependency information for google-cloud-resource-manager<3.0.0dev,>=1.3.3 from https://files.pythonhosted.org/packages/d2/f3/e7d1848edf2f4714d8925e6c749464c190e696b3c85264441c2b3787ae72/google_cloud_resource_manager-1.10.3-py2.py3-none-any.whl.metadata Using cached google_cloud_resource_manager-1.10.3-py2.py3-none-any.whl.metadata (5.2 kB) Collecting shapely<2.0.0 (from google-cloud-aiplatform<2.0,>=1.26.0->apache-beam==2.51.0.dev0) Using cached Shapely-1.8.5.post1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.1 MB) Collecting google-resumable-media<3.0dev,>=0.6.0 (from google-cloud-bigquery<4,>=2.0.0->apache-beam==2.51.0.dev0) Obtaining dependency information for google-resumable-media<3.0dev,>=0.6.0 from https://files.pythonhosted.org/packages/c7/4f/b8e5e22406e5aeafa46df8799939d5eeee52f18eeed339675167fac6603a/google_resumable_media-2.6.0-py2.py3-none-any.whl.metadata Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl.metadata (2.1 kB) Collecting grpc-google-iam-v1<1.0.0dev,>=0.12.4 (from google-cloud-bigtable<3,>=2.19.0->apache-beam==2.51.0.dev0) Using cached grpc_google_iam_v1-0.12.6-py2.py3-none-any.whl (26 kB) Collecting grpcio-status>=1.33.2 (from google-cloud-pubsub<3,>=2.1.0->apache-beam==2.51.0.dev0) Obtaining dependency information for grpcio-status>=1.33.2 from https://files.pythonhosted.org/packages/f6/48/2bcf11bc2df159564eac099ea38d80663d291a56fa2f2f561d08bf083dfa/grpcio_status-1.58.0-py3-none-any.whl.metadata Using cached grpcio_status-1.58.0-py3-none-any.whl.metadata (1.3 kB) Collecting overrides<7.0.0,>=6.0.1 (from google-cloud-pubsublite<2,>=1.2.0->apache-beam==2.51.0.dev0) Using cached overrides-6.5.0-py3-none-any.whl (17 kB) Collecting sqlparse>=0.4.4 (from google-cloud-spanner<4,>=3.0.0->apache-beam==2.51.0.dev0) Using cached sqlparse-0.4.4-py3-none-any.whl (41 kB) Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.51.0.dev0) Using cached docopt-0.6.2-py2.py3-none-any.whl Collecting pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 (from httplib2<0.23.0,>=0.8->apache-beam==2.51.0.dev0) Obtaining dependency information for pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 from https://files.pythonhosted.org/packages/39/92/8486ede85fcc088f1b3dba4ce92dd29d126fd96b0008ea213167940a2475/pyparsing-3.1.1-py3-none-any.whl.metadata Using cached pyparsing-3.1.1-py3-none-any.whl.metadata (5.1 kB) Collecting attrs>=19.2.0 (from hypothesis<=7.0.0,>5.0.0->apache-beam==2.51.0.dev0) Using cached attrs-23.1.0-py3-none-any.whl (61 kB) Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis<=7.0.0,>5.0.0->apache-beam==2.51.0.dev0) Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Collecting exceptiongroup>=1.0.0 (from hypothesis<=7.0.0,>5.0.0->apache-beam==2.51.0.dev0) Obtaining dependency information for exceptiongroup>=1.0.0 from https://files.pythonhosted.org/packages/ad/83/b71e58666f156a39fb29417e4c8ca4bc7400c0dd4ed9e8842ab54dc8c344/exceptiongroup-1.1.3-py3-none-any.whl.metadata Using cached exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB) Collecting dnspython<3.0.0,>=1.16.0 (from pymongo<5.0.0,>=3.8.0->apache-beam==2.51.0.dev0) Obtaining dependency information for dnspython<3.0.0,>=1.16.0 from https://files.pythonhosted.org/packages/f6/b4/0a9bee52c50f226a3cbfb54263d02bb421c7f2adc136520729c2c689c1e5/dnspython-2.4.2-py3-none-any.whl.metadata Using cached dnspython-2.4.2-py3-none-any.whl.metadata (4.9 kB) Collecting iniconfig (from pytest<8.0,>=7.1.2->apache-beam==2.51.0.dev0) Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB) Requirement already satisfied: pluggy<2.0,>=0.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.51.0.dev0) (1.3.0) Requirement already satisfied: tomli>=1.0.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.8/site-packages> (from pytest<8.0,>=7.1.2->apache-beam==2.51.0.dev0) (2.0.1) Collecting execnet>=1.1 (from pytest-xdist<4,>=2.5.0->apache-beam==2.51.0.dev0) Obtaining dependency information for execnet>=1.1 from https://files.pythonhosted.org/packages/e8/9c/a079946da30fac4924d92dbc617e5367d454954494cf1e71567bcc4e00ee/execnet-2.0.2-py3-none-any.whl.metadata Using cached execnet-2.0.2-py3-none-any.whl.metadata (2.9 kB) Collecting charset-normalizer<4,>=2 (from requests<3.0.0,>=2.24.0->apache-beam==2.51.0.dev0) Obtaining dependency information for charset-normalizer<4,>=2 from https://files.pythonhosted.org/packages/cb/e7/5e43745003bf1f90668c7be23fc5952b3a2b9c2558f16749411c18039b36/charset_normalizer-3.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata Using cached charset_normalizer-3.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (31 kB) Collecting idna<4,>=2.5 (from requests<3.0.0,>=2.24.0->apache-beam==2.51.0.dev0) Using cached idna-3.4-py3-none-any.whl (61 kB) Collecting certifi>=2017.4.17 (from requests<3.0.0,>=2.24.0->apache-beam==2.51.0.dev0) Obtaining dependency information for certifi>=2017.4.17 from https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl.metadata Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB) Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0->apache-beam==2.51.0.dev0) Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB) Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0->apache-beam==2.51.0.dev0) Obtaining dependency information for threadpoolctl>=2.0.0 from https://files.pythonhosted.org/packages/81/12/fd4dea011af9d69e1cad05c75f3f7202cdcbeac9b712eea58ca779a72865/threadpoolctl-3.2.0-py3-none-any.whl.metadata Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB) Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3->apache-beam==2.51.0.dev0) Obtaining dependency information for greenlet!=0.4.17 from https://files.pythonhosted.org/packages/64/b9/416bd3547aab7c2a2f557d281aab30e3f9bf5a695318f6961b9e8eeb0bc3/greenlet-3.0.0rc3-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata Using cached greenlet-3.0.0rc3-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.8 kB) Collecting docker>=4.0.0 (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.51.0.dev0) Obtaining dependency information for docker>=4.0.0 from https://files.pythonhosted.org/packages/db/be/3032490fa33b36ddc8c4b1da3252c6f974e7133f1a50de00c6b85cca203a/docker-6.1.3-py3-none-any.whl.metadata Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB) Collecting wrapt (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.51.0.dev0) Using cached wrapt-1.15.0-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (81 kB) Collecting deprecation (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.51.0.dev0) Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.51.0.dev0) Obtaining dependency information for pymysql from https://files.pythonhosted.org/packages/e5/30/20467e39523d0cfc2b6227902d3687a16364307260c75e6a1cb4422b0c62/PyMySQL-1.1.0-py3-none-any.whl.metadata Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB) Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2->apache-beam==2.51.0.dev0) Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.51.0.dev0) Obtaining dependency information for websocket-client>=0.32.0 from https://files.pythonhosted.org/packages/0b/50/49e0d7342e5d441d43b525d6c84656ea40aea3e58d530004d07b22bc9b04/websocket_client-1.6.3-py3-none-any.whl.metadata Using cached websocket_client-1.6.3-py3-none-any.whl.metadata (7.7 kB) Collecting google-crc32c<2.0dev,>=1.0 (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=2.0.0->apache-beam==2.51.0.dev0) Using cached google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB) Collecting PyJWT[crypto]<3,>=1.0.0 (from msal<2.0.0,>=1.20.0->azure-identity<2,>=1.12.0->apache-beam==2.51.0.dev0) Obtaining dependency information for PyJWT[crypto]<3,>=1.0.0 from https://files.pythonhosted.org/packages/2b/4f/e04a8067c7c96c364cef7ef73906504e2f40d690811c021e1a1901473a19/PyJWT-2.8.0-py3-none-any.whl.metadata Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB) Collecting portalocker<3,>=1.0 (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0->apache-beam==2.51.0.dev0) Using cached portalocker-2.7.0-py2.py3-none-any.whl (15 kB) Collecting pyasn1>=0.1.7 (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam==2.51.0.dev0) Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB) Using cached azure_core-1.29.4-py3-none-any.whl (192 kB) Using cached azure_identity-1.15.0b1-py3-none-any.whl (162 kB) Using cached azure_storage_blob-12.18.0-py3-none-any.whl (392 kB) Using cached boto3-1.28.46-py3-none-any.whl (135 kB) Using cached cryptography-41.0.3-cp37-abi3-manylinux_2_28_x86_64.whl (4.3 MB) Using cached fastavro-1.8.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.8 MB) Using cached google_api_core-2.12.0rc1-py3-none-any.whl (121 kB) Using cached google_auth-2.23.0-py2.py3-none-any.whl (181 kB) Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB) Using cached google_cloud_aiplatform-1.32.0-py2.py3-none-any.whl (2.9 MB) Using cached google_cloud_bigquery-3.11.4-py2.py3-none-any.whl (219 kB) Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB) Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB) Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB) Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB) Using cached google_cloud_dlp-3.12.2-py2.py3-none-any.whl (143 kB) Using cached google_cloud_language-2.11.0-py2.py3-none-any.whl (138 kB) Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB) Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB) Using cached google_cloud_recommendations_ai-0.10.4-py2.py3-none-any.whl (173 kB) Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB) Using cached google_cloud_videointelligence-2.11.3-py2.py3-none-any.whl (229 kB) Using cached google_cloud_vision-3.4.4-py2.py3-none-any.whl (444 kB) Using cached hypothesis-6.84.3-py3-none-any.whl (419 kB) Using cached joblib-1.3.2-py3-none-any.whl (302 kB) Using cached mock-5.1.0-py3-none-any.whl (30 kB) Using cached orjson-3.9.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB) Using cached proto_plus-1.22.3-py3-none-any.whl (48 kB) Using cached psycopg2_binary-2.9.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB) Using cached pymongo-4.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (687 kB) Using cached pytest-7.4.2-py3-none-any.whl (324 kB) Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB) Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB) Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB) Using cached regex-2023.8.8-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (774 kB) Using cached requests-2.31.0-py3-none-any.whl (62 kB) Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB) Using cached scikit_learn-1.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB) Using cached SQLAlchemy-1.4.49-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB) Using cached tenacity-8.2.3-py3-none-any.whl (24 kB) Using cached botocore-1.31.46-py3-none-any.whl (11.2 MB) Using cached certifi-2023.7.22-py3-none-any.whl (158 kB) Using cached charset_normalizer-3.2.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (199 kB) Using cached dnspython-2.4.2-py3-none-any.whl (300 kB) Using cached docker-6.1.3-py3-none-any.whl (148 kB) Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB) Using cached execnet-2.0.2-py3-none-any.whl (37 kB) Using cached google_cloud_resource_manager-1.10.3-py2.py3-none-any.whl (320 kB) Using cached google_cloud_storage-2.10.0-py2.py3-none-any.whl (114 kB) Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB) Using cached googleapis_common_protos-1.60.0-py2.py3-none-any.whl (227 kB) Using cached greenlet-3.0.0rc3-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (617 kB) Using cached grpcio_status-1.58.0-py3-none-any.whl (14 kB) Using cached msal-1.24.0-py2.py3-none-any.whl (91 kB) Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB) Using cached s3transfer-0.6.2-py3-none-any.whl (79 kB) Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB) Using cached urllib3-1.26.16-py2.py3-none-any.whl (143 kB) Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB) Using cached websocket_client-1.6.3-py3-none-any.whl (57 kB) Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.51.0.dev0-py3-none-any.whl size=3312222 sha256=ccac010c1a5a12cd32b3ac2b0f9ea4996077362256e9b2466f1ce4986bcbc266 Stored in directory: /home/jenkins/.cache/pip/wheels/67/34/b8/5adce605a0a3f10491be234729fa4854c6a127bc01194f13fc Successfully built apache-beam Installing collected packages: sortedcontainers, pytz, docopt, crcmod, zstandard, wrapt, websocket-client, urllib3, threadpoolctl, tenacity, sqlparse, six, shapely, scipy, regex, pyyaml, pyparsing, pymysql, PyJWT, pyhamcrest, pycparser, pyasn1, pyarrow, psycopg2-binary, proto-plus, portalocker, parameterized, overrides, orjson, objsize, mock, joblib, jmespath, iniconfig, idna, greenlet, googleapis-common-protos, google-crc32c, fasteners, fastavro, execnet, exceptiongroup, dnspython, dill, deprecation, cloudpickle, charset-normalizer, certifi, attrs, sqlalchemy, scikit-learn, rsa, requests, python-dateutil, pytest, pymongo, pydot, pyasn1-modules, isodate, hypothesis, httplib2, grpcio-status, google-resumable-media, cffi, requests_mock, pytest-xdist, pytest-timeout, pandas, oauth2client, hdfs, grpc-google-iam-v1, google-auth, freezegun, docker, cryptography, botocore, azure-core, testcontainers, s3transfer, google-auth-httplib2, google-apitools, google-api-core, azure-storage-blob, apache-beam, msal, google-cloud-core, boto3, msal-extensions, google-cloud-vision, google-cloud-videointelligence, google-cloud-storage, google-cloud-spanner, google-cloud-resource-manager, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-cloud-pubsublite, google-cloud-aiplatform, azure-identity Successfully installed PyJWT-2.8.0 apache-beam-2.51.0.dev0 attrs-23.1.0 azure-core-1.29.4 azure-identity-1.15.0b1 azure-storage-blob-12.18.0 boto3-1.28.46 botocore-1.31.46 certifi-2023.7.22 cffi-1.15.1 charset-normalizer-3.2.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.3 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.8.3 fasteners-0.18 freezegun-1.2.2 google-api-core-2.12.0rc1 google-apitools-0.5.31 google-auth-2.23.0 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.32.0 google-cloud-bigquery-3.11.4 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.2 google-cloud-language-2.11.0 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.4 google-cloud-resource-manager-1.10.3 google-cloud-spanner-3.40.1 google-cloud-storage-2.10.0 google-cloud-videointelligence-2.11.3 google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.60.0 greenlet-3.0.0rc3 grpc-google-iam-v1-0.12.6 grpcio-status-1.58.0 hdfs-2.7.2 httplib2-0.22.0 hypothesis-6.84.3 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 mock-5.1.0 msal-1.24.0 msal-extensions-1.0.0 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.7 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 portalocker-2.7.0 proto-plus-1.22.3 psycopg2-binary-2.9.7 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.2 pytest-timeout-2.1.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.8.8 requests-2.31.0 requests_mock-1.11.0 rsa-4.9 s3transfer-0.6.2 scikit-learn-1.3.0 scipy-1.10.1 shapely-1.8.5.post1 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 urllib3-1.26.16 websocket-client-1.6.3 wrapt-1.15.0 zstandard-0.21.0 > Task :sdks:python:apache_beam:testing:load_tests:run INFO:apache_beam.runners.portability.stager:Copying Beam SDK "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/build/apache-beam.tar.gz";> to staging location. INFO:apache_beam.runners.dataflow.dataflow_runner:Pipeline has additional dependencies to be installed in SDK **** container, consider using the SDK container image pre-building workflow to avoid repetitive installations. Learn more on https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild INFO:root:Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/beam_python3.8_sdk:beam-master-20230912 INFO:root:Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/beam_python3.8_sdk:beam-master-20230912" for Docker environment INFO:apache_beam.internal.gcp.auth:Setting socket default timeout to 60 seconds. INFO:apache_beam.internal.gcp.auth:socket default timeout is 60.0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-0913125355.1694617681.608152/dataflow_python_sdk.tar... INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-0913125355.1694617681.608152/dataflow_python_sdk.tar in 0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-0913125355.1694617681.608152/pipeline.pb... INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to gs://temp-storage-for-perf-tests/smoketests/load-tests-python-dataflow-streaming-combine-1-0913125355.1694617681.608152/pipeline.pb in 0 seconds. INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job clientRequestId: '20230913150801609165-4723' createTime: '2023-09-13T15:08:02.602428Z' currentStateTime: '1970-01-01T00:00:00Z' id: '2023-09-13_08_08_02-6299722890580030042' location: 'us-central1' name: 'load-tests-python-dataflow-streaming-combine-1-0913125355' projectId: 'apache-beam-testing' stageStates: [] startTime: '2023-09-13T15:08:02.602428Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)> INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2023-09-13_08_08_02-6299722890580030042] INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2023-09-13_08_08_02-6299722890580030042 INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-09-13_08_08_02-6299722890580030042?project=apache-beam-testing INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2023-09-13_08_08_02-6299722890580030042 is in state JOB_STATE_PENDING INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T15:08:08.083Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-b. INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T15:08:15.136Z: JOB_MESSAGE_BASIC: Running job using Streaming Engine INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T15:08:15.476Z: JOB_MESSAGE_BASIC: Starting 5 ****s in us-central1-b... INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2023-09-13_08_08_02-6299722890580030042 is in state JOB_STATE_RUNNING INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T15:08:36.770Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T20:00:37.587Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2023-09-13_08_08_02-6299722890580030042. INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2023-09-13_08_08_02-6299722890580030042 is in state JOB_STATE_CANCELLING INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T20:00:37.692Z: JOB_MESSAGE_BASIC: Stopping **** pool... INFO:apache_beam.runners.dataflow.dataflow_runner:2023-09-13T20:00:37.742Z: JOB_MESSAGE_BASIC: Stopping **** pool... Traceback (most recent call last): File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.8/runpy.py", line 87, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/combine_test.py";,> line 129, in <module> CombineTest().run() File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test.py";,> line 152, in run state = self.result.wait_until_finish(duration=self.timeout_ms) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 757, in wait_until_finish assert duration or terminated, ( AssertionError: Job did not reach to a terminal state after waiting indefinitely. Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-09-13_08_08_02-6299722890580030042?project=<ProjectId> > Task :sdks:python:apache_beam:testing:load_tests:run FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 63 * What went wrong: Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'. > error occurred * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 4h 55m 8s 15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date Publishing build scan... Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)... Publishing failed. The response from https://ge.apache.org/scans/publish/gradle/3.13.2/token was not from Gradle Enterprise. The specified server address may be incorrect, or your network environment may be interfering. Please report this problem to your Gradle Enterprise administrator via https://ge.apache.org/help and include the following via copy/paste: ---------- Gradle version: 7.6.2 Plugin version: 3.13.2 Request URL: https://ge.apache.org/scans/publish/gradle/3.13.2/token Request ID: ca5454d3-6c70-4f1b-9c88-e2b51b2bd7f4 Response status code: 502 Response content type: text/html ---------- Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
