See <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/305/display/redirect?page=changes>
Changes: [kmjung] Add a deadline of 30s to SplitReadStream [sychen] Remove experiement --enable_streaming_auto_sharding [Boyuan Zhang] Add topic and subscription overridden field into pubsub proto. [heejong] [BEAM-11924] Add Java TextIO.read() to TestExpansionService [noreply] Merge pull request #14136: [BEAM-11648] Add conversion utilities for [noreply] [BEAM-11748] Fix PViewToIdMapper in Samza runner to not include hashcode [noreply] Bump pandas version to 1.2.3 in python container (#14157) [noreply] Increase the timeout for ValidatesContainer suite (#14151) [heejong] [BEAM-11591] Create pypi dependencies registry and populate environment ------------------------------------------ [...truncated 65.86 KB...] Requirement already satisfied: httplib2<0.18.0,>=0.8 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (0.17.4) Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (2.0.0) Requirement already satisfied: numpy<1.21.0,>=1.14.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.20.1) Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (3.11.3) Requirement already satisfied: oauth2client<5,>=2.0.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (4.1.3) Requirement already satisfied: protobuf<4,>=3.12.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (3.15.5) Requirement already satisfied: pyarrow<4.0.0,>=0.15.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (3.0.0) Requirement already satisfied: pydot<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.4.2) Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (2.8.1) Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (2021.1) Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (2.25.1) Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (3.7.4.3) Requirement already satisfied: freezegun>=0.3.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.1.0) Requirement already satisfied: nose>=1.3.7 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.3.7) Requirement already satisfied: nose_xunitmp>=0.4.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (0.4.1) Requirement already satisfied: pandas<1.3.0,>=1.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.2.3) Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (0.7.5) Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.10.1) Requirement already satisfied: pyyaml<6.0.0,>=3.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (5.4.1) Requirement already satisfied: requests_mock<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.8.0) Requirement already satisfied: tenacity<6.0,>=5.0.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (5.1.5) Requirement already satisfied: pytest<5.0,>=4.4.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (4.6.11) Requirement already satisfied: pytest-xdist<2,>=1.29.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.34.0) Requirement already satisfied: pytest-timeout<2,>=1.3.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.4.2) Requirement already satisfied: sqlalchemy<2.0,>=1.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.3.23) Requirement already satisfied: psycopg2-binary<3.0.0,>=2.8.5 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (2.8.6) Requirement already satisfied: testcontainers<4.0.0,>=3.0.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (3.2.0) Requirement already satisfied: boto3>=1.9 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.17.22) Requirement already satisfied: azure-storage-blob>=12.3.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (12.8.0) Requirement already satisfied: azure-core>=1.7.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.11.0) Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (4.2.1) Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (0.5.31) Requirement already satisfied: google-auth<2,>=1.18.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.27.1) Requirement already satisfied: google-cloud-datastore<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.15.3) Requirement already satisfied: google-cloud-pubsub<2,>=0.39.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.7.0) Requirement already satisfied: google-cloud-bigquery<2,>=1.6.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.28.0) Requirement already satisfied: google-cloud-core<2,>=0.28.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.6.0) Requirement already satisfied: google-cloud-bigtable<2,>=0.31.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.7.0) Requirement already satisfied: google-cloud-spanner<2,>=1.13.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.19.1) Requirement already satisfied: grpcio-gcp<1,>=0.2.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (0.2.2) Requirement already satisfied: google-cloud-dlp<2,>=0.12.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.0.0) Requirement already satisfied: google-cloud-language<2,>=1.3.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.3.0) Requirement already satisfied: google-cloud-videointelligence<2,>=1.8.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.16.1) Requirement already satisfied: google-cloud-vision<2,>=0.38.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.29.0.dev0) (1.0.0) Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from azure-core>=1.7.0->apache-beam==2.29.0.dev0) (1.15.0) Requirement already satisfied: msrest>=0.6.18 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (0.6.21) Requirement already satisfied: cryptography>=2.1.4 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (3.4.6) Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from boto3>=1.9->apache-beam==2.29.0.dev0) (0.10.0) Requirement already satisfied: botocore<1.21.0,>=1.20.22 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from boto3>=1.9->apache-beam==2.29.0.dev0) (1.20.22) Requirement already satisfied: s3transfer<0.4.0,>=0.3.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from boto3>=1.9->apache-beam==2.29.0.dev0) (0.3.4) Requirement already satisfied: urllib3<1.27,>=1.25.4 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from botocore<1.21.0,>=1.20.22->boto3>=1.9->apache-beam==2.29.0.dev0) (1.26.3) Requirement already satisfied: cffi>=1.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from cryptography>=2.1.4->azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (1.14.5) Requirement already satisfied: pycparser in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from cffi>=1.12->cryptography>=2.1.4->azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (2.20) Requirement already satisfied: fasteners>=0.14 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam==2.29.0.dev0) (0.16) Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-auth<2,>=1.18.0->apache-beam==2.29.0.dev0) (4.7.2) Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-auth<2,>=1.18.0->apache-beam==2.29.0.dev0) (54.1.0) Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-auth<2,>=1.18.0->apache-beam==2.29.0.dev0) (0.2.8) Requirement already satisfied: google-resumable-media<2.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-cloud-bigquery<2,>=1.6.0->apache-beam==2.29.0.dev0) (1.2.0) Requirement already satisfied: google-api-core<2.0dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-cloud-bigquery<2,>=1.6.0->apache-beam==2.29.0.dev0) (1.26.1) Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery<2,>=1.6.0->apache-beam==2.29.0.dev0) (1.53.0) Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery<2,>=1.6.0->apache-beam==2.29.0.dev0) (20.9) Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam==2.29.0.dev0) (0.12.3) Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from google-resumable-media<2.0dev,>=0.6.0->google-cloud-bigquery<2,>=1.6.0->apache-beam==2.29.0.dev0) (1.1.2) Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.29.0.dev0) (0.6.2) Requirement already satisfied: pbr>=0.11 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.29.0.dev0) (5.5.1) Requirement already satisfied: isodate>=0.6.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (0.6.0) Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (2020.12.5) Requirement already satisfied: requests-oauthlib>=0.5.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (1.3.0) Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from oauth2client<5,>=2.0.1->apache-beam==2.29.0.dev0) (0.4.8) Requirement already satisfied: pyparsing>=2.0.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from packaging>=14.3->google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery<2,>=1.6.0->apache-beam==2.29.0.dev0) (2.4.7) Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (1.10.0) Requirement already satisfied: more-itertools>=4.0.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (8.7.0) Requirement already satisfied: pluggy<1.0,>=0.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (0.13.1) Requirement already satisfied: attrs>=17.4.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (20.3.0) Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (2.1.1) Requirement already satisfied: wcwidth in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (0.2.5) Requirement already satisfied: atomicwrites>=1.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (1.4.0) Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.29.0.dev0) (3.4.1) Requirement already satisfied: execnet>=1.1 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.29.0.dev0) (1.8.0) Requirement already satisfied: pytest-forked in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.29.0.dev0) (1.3.0) Requirement already satisfied: apipkg>=1.4 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.29.0.dev0) (1.5) Requirement already satisfied: chardet<5,>=3.0.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam==2.29.0.dev0) (4.0.0) Requirement already satisfied: idna<3,>=2.5 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam==2.29.0.dev0) (2.10) Requirement already satisfied: oauthlib>=3.0.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from requests-oauthlib>=0.5.0->msrest>=0.6.18->azure-storage-blob>=12.3.2->apache-beam==2.29.0.dev0) (3.1.0) Requirement already satisfied: deprecation in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from testcontainers<4.0.0,>=3.0.3->apache-beam==2.29.0.dev0) (2.1.0) Requirement already satisfied: docker in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from testcontainers<4.0.0,>=3.0.3->apache-beam==2.29.0.dev0) (4.4.4) Requirement already satisfied: wrapt in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from testcontainers<4.0.0,>=3.0.3->apache-beam==2.29.0.dev0) (1.12.1) Requirement already satisfied: websocket-client>=0.32.0 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from docker->testcontainers<4.0.0,>=3.0.3->apache-beam==2.29.0.dev0) (0.58.0) DEPRECATION: Source distribution is being reinstalled despite an installed package having the same name and version as the installed package. pip 21.1 will remove support for this functionality. A possible replacement is use --force-reinstall. You can find discussion regarding this at https://github.com/pypa/pip/issues/8711. Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.29.0.dev0-py3-none-any.whl size=2428488 sha256=e0790acb802d754803b7396e7253943bd143153c9ea097eb962b0199de411bb8 Stored in directory: /home/jenkins/.cache/pip/wheels/bc/10/43/2e6f08d57c0f9fc9e1f1ee753673c40f9e03ed660bcae39b4a Successfully built apache-beam Installing collected packages: apache-beam Attempting uninstall: apache-beam Found existing installation: apache-beam 2.29.0.dev0 Uninstalling apache-beam-2.29.0.dev0: Successfully uninstalled apache-beam-2.29.0.dev0 Unknown event 0x800 for <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/apache_beam-2.29.0.dev0.dist-info> Unknown event 0x800 for <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/apache_beam> Dropped VFS state due to lost state > Task :sdks:python:apache_beam:testing:load_tests:installGcpTest Successfully installed apache-beam-2.29.0.dev0 > Task :sdks:python:apache_beam:testing:load_tests:run WARNING:root:Make sure that locally built Python SDK docker image has Python 3.7 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.7_sdk:2.29.0.dev INFO:root:Using provided Python SDK container image: gcr.io/apache-beam-testing/beam_portability/beam_python3.7_sdk:latest INFO:root:Python SDK container image set to "gcr.io/apache-beam-testing/beam_portability/beam_python3.7_sdk:latest" for Docker environment WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=200', '--number_of_counter_operations=0', '--number_of_counters=0', '--use_stateful_load_generator'] INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results for test: cb3392ef86cd457393660a6b718e1db7 and timestamp: 1615036183.2117388: INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_2_runtime Value: 3156 INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_2_ref_appliedptransform_measure_latency_208_count_latency Value: 20000000 INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_2_ref_appliedptransform_measure_latency_208_max_latency Value: 69 INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_2_ref_appliedptransform_measure_latency_208_min_latency Value: 0 INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_2_ref_appliedptransform_measure_latency_208_sum_latency Value: 10383824 Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 706, in urlopen chunked=chunked, File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 445, in _make_request six.raise_from(e, None) File "<string>", line 3, in raise_from File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 440, in _make_request httplib_response = conn.getresponse() File "/usr/lib/python3.7/http/client.py", line 1321, in getresponse response.begin() File "/usr/lib/python3.7/http/client.py", line 296, in begin version, status, reason = self._read_status() File "/usr/lib/python3.7/http/client.py", line 257, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.7/socket.py", line 589, in readinto return self._sock.recv_into(b) File "/usr/lib/python3.7/ssl.py", line 1052, in recv_into return self.read(nbytes, buffer) File "/usr/lib/python3.7/ssl.py", line 911, in read return self._sslobj.read(len, buffer) ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/requests/adapters.py";,> line 449, in send timeout=timeout File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 756, in urlopen method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2] File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/util/retry.py";,> line 531, in increment raise six.reraise(type(error), error, _stacktrace) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/packages/six.py";,> line 734, in reraise raise value.with_traceback(tb) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 706, in urlopen chunked=chunked, File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 445, in _make_request six.raise_from(e, None) File "<string>", line 3, in raise_from File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/urllib3/connectionpool.py";,> line 440, in _make_request httplib_response = conn.getresponse() File "/usr/lib/python3.7/http/client.py", line 1321, in getresponse response.begin() File "/usr/lib/python3.7/http/client.py", line 296, in begin version, status, reason = self._read_status() File "/usr/lib/python3.7/http/client.py", line 257, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.7/socket.py", line 589, in readinto return self._sock.recv_into(b) File "/usr/lib/python3.7/ssl.py", line 1052, in recv_into return self.read(nbytes, buffer) File "/usr/lib/python3.7/ssl.py", line 911, in read return self._sslobj.read(len, buffer) urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "/usr/lib/python3.7/runpy.py", line 85, in _run_code exec(code, run_globals) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/pardo_test.py";,> line 169, in <module> ParDoTest().run() File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test.py";,> line 154, in run self._metrics_monitor.publish_metrics(self.result, self.extra_metrics) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test_metrics_utils.py";,> line 235, in publish_metrics publisher.publish(insert_dicts) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test_metrics_utils.py";,> line 407, in publish outputs = self.bq.save(results) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test_metrics_utils.py";,> line 456, in save return self._client.insert_rows(self._bq_table, results) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/cloud/bigquery/client.py";,> line 2840, in insert_rows return self.insert_rows_json(table, json_rows, **kwargs) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/cloud/bigquery/client.py";,> line 2987, in insert_rows_json timeout=timeout, File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/cloud/bigquery/client.py";,> line 641, in _call_api return call() File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/api_core/retry.py";,> line 286, in retry_wrapped_func on_error=on_error, File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/api_core/retry.py";,> line 184, in retry_target return target() File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/cloud/_http.py";,> line 479, in api_request timeout=timeout, File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/cloud/_http.py";,> line 337, in _make_request method, url, headers, data, target_object, timeout=timeout File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/cloud/_http.py";,> line 375, in _do_request url=url, method=method, headers=headers, data=data, timeout=timeout File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/google/auth/transport/requests.py";,> line 488, in request **kwargs File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/requests/sessions.py";,> line 542, in request resp = self.send(prep, **send_kwargs) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/requests/sessions.py";,> line 655, in send r = adapter.send(request, **kwargs) File "<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/requests/adapters.py";,> line 498, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) > Task :sdks:python:apache_beam:testing:load_tests:run FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 58 * What went wrong: Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'. > error occurred * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 53m 22s 5 actionable tasks: 3 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/xuxg6n42re7a6 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
