See
<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/1080/display/redirect>
Changes:
------------------------------------------
[...truncated 67.03 KB...]
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-26T23:59:43.369Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:00:13.689Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:00:43.792Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:01:15.612Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:01:45.953Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:02:16.094Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:02:46.351Z:
JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 295, in _execute
response = task()
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 370, in <lambda>
lambda: self.create_****().do_instruction(request), request)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 630, in do_instruction
getattr(request, request_type), request.instruction_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 661, in process_bundle
instruction_id, request.process_bundle_descriptor_id)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/sdk_****.py",
line 496, in get
self.data_sampler)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 877, in __init__
_verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
File
"/usr/local/lib/python3.7/site-packages/apache_beam/runners/****/bundle_processor.py",
line 841, in _verify_descriptor_created_in_a_compatible_env
"Pipeline construction environment and pipeline runtime "
RuntimeError: Pipeline construction environment and pipeline runtime
environment are not compatible. If you use a custom container image, check that
the Python interpreter minor version and the Apache Beam version in your image
match the versions used at pipeline construction time. Submission environment:
beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev. Runtime
environment: beam:version:sdk_base:apache/beam_python3.7_sdk:2.48.0.dev.
WARNING:apache_beam.runners.dataflow.dataflow_runner:Timing out on waiting for
job 2023-05-26_16_50_55-15575526398489765243 after 723 seconds
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results
for test: a423d0d247e94c73939038266d31059d and timestamp: 1685145978.2912583:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric:
pubsub_io_perf_write_runtime Value: 98
INFO:apache_beam.runners.portability.stager:Copying Beam SDK
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/build/apache-beam.tar.gz";>
to staging location.
INFO:apache_beam.runners.dataflow.dataflow_runner:Pipeline has additional
dependencies to be installed in SDK **** container, consider using the SDK
container image pre-building workflow to avoid repetitive installations. Learn
more on
https://cloud.google.com/dataflow/docs/guides/using-custom-containers#prebuild
INFO:root:Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.49.0.dev
INFO:root:Using provided Python SDK container image:
gcr.io/cloud-dataflow/v1beta3/beam_python3.7_sdk:beam-master-20230422
INFO:root:Python SDK container image set to
"gcr.io/cloud-dataflow/v1beta3/beam_python3.7_sdk:beam-master-20230422" for
Docker environment
INFO:apache_beam.runners.dataflow.internal.apiclient:Defaulting to the
temp_location as staging_location: gs://temp-storage-for-perf-tests/loadtests
INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to
gs://temp-storage-for-perf-tests/loadtests/performance-tests-psio-python-2gb0526215449.1685145984.148257/dataflow_python_sdk.tar...
INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to
gs://temp-storage-for-perf-tests/loadtests/performance-tests-psio-python-2gb0526215449.1685145984.148257/dataflow_python_sdk.tar
in 0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Starting GCS upload to
gs://temp-storage-for-perf-tests/loadtests/performance-tests-psio-python-2gb0526215449.1685145984.148257/pipeline.pb...
INFO:apache_beam.runners.dataflow.internal.apiclient:Completed GCS upload to
gs://temp-storage-for-perf-tests/loadtests/performance-tests-psio-python-2gb0526215449.1685145984.148257/pipeline.pb
in 0 seconds.
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
clientRequestId: '20230527000624149157-6806'
createTime: '2023-05-27T00:06:25.187409Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2023-05-26_17_06_24-2737973249188852113'
location: 'us-central1'
name: 'performance-tests-psio-python-2gb0526215449'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2023-05-27T00:06:25.187409Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id:
[2023-05-26_17_06_24-2737973249188852113]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job:
2023-05-26_17_06_24-2737973249188852113
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow
monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-26_17_06_24-2737973249188852113?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.test_dataflow_runner:Console log:
INFO:apache_beam.runners.dataflow.test_dataflow_runner:https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-26_17_06_24-2737973249188852113?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job
2023-05-26_17_06_24-2737973249188852113 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:28.836Z:
JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-f.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.314Z:
JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable
parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.333Z:
JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into
optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.414Z:
JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.489Z:
JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into
optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.522Z:
JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write
steps
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.582Z:
JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.633Z:
JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.683Z:
JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.718Z:
JOB_MESSAGE_DETAILED: Fusing consumer Read from pubsub/Map(_from_proto_str)
into Read from pubsub/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.754Z:
JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at
pubsub_io_perf_test.py:168>) into Read from pubsub/Map(_from_proto_str)
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.787Z:
JOB_MESSAGE_DETAILED: Fusing consumer Measure time into Map(<lambda at
pubsub_io_perf_test.py:168>)
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.811Z:
JOB_MESSAGE_DETAILED: Fusing consumer Window into Measure time
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.833Z:
JOB_MESSAGE_DETAILED: Fusing consumer Count messages/KeyWithVoid into Window
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.866Z:
JOB_MESSAGE_DETAILED: Fusing consumer Count
messages/CombinePerKey/Combine/ConvertToAccumulators into Count
messages/KeyWithVoid
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.899Z:
JOB_MESSAGE_DETAILED: Fusing consumer Count
messages/CombinePerKey/GroupByKey/WriteStream into Count
messages/CombinePerKey/Combine/ConvertToAccumulators
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.930Z:
JOB_MESSAGE_DETAILED: Fusing consumer Count messages/CombinePerKey/Combine into
Count messages/CombinePerKey/GroupByKey/ReadStream
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.954Z:
JOB_MESSAGE_DETAILED: Fusing consumer Count
messages/CombinePerKey/Combine/Extract into Count messages/CombinePerKey/Combine
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:31.987Z:
JOB_MESSAGE_DETAILED: Fusing consumer Count messages/UnKey into Count
messages/CombinePerKey/Combine/Extract
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.020Z:
JOB_MESSAGE_DETAILED: Fusing consumer Convert to bytes into Count messages/UnKey
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.053Z:
JOB_MESSAGE_DETAILED: Fusing consumer Write to Pubsub/ToProtobuf into Convert
to bytes
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.088Z:
JOB_MESSAGE_DETAILED: Fusing consumer Write to Pubsub/Write into Write to
Pubsub/ToProtobuf
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.120Z:
JOB_MESSAGE_BASIC: Running job using Streaming Engine
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.156Z:
JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.175Z:
JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.197Z:
JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.220Z:
JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.424Z:
JOB_MESSAGE_DEBUG: Starting **** pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.454Z:
JOB_MESSAGE_BASIC: Starting 5 ****s in us-central1-f...
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:06:32.510Z:
JOB_MESSAGE_DEBUG: Starting **** pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:07:01.688Z:
JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric
descriptors, so new user metrics of the form custom.googleapis.com/* will not
be created. However, all user metrics are also available in the metric
dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics,
you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:07:33.734Z:
JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of ****s to 2 so that the
pipeline can catch up with its backlog and keep up with its input rate.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:07:33.758Z:
JOB_MESSAGE_DETAILED: Autoscaling: Resized **** pool to 2, though goal was 5.
This could be a quota issue.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:07:43.457Z:
JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of ****s to 5 so that the
pipeline can catch up with its backlog and keep up with its input rate.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:08:10.642Z:
JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2023-05-27T00:08:22.531Z:
JOB_MESSAGE_DETAILED: All ****s have finished the startup processes and began
to receive work requests.
WARNING:apache_beam.runners.dataflow.dataflow_runner:Timing out on waiting for
job 2023-05-26_17_06_24-2737973249188852113 after 721 seconds
ERROR:apache_beam.io.gcp.tests.pubsub_matcher:Timeout after 900 sec. Received 0
messages from
projects/apache-beam-testing/subscriptions/pubsub_io_performance_e10adee8-1bf3-4329-bc6d-a71df2529962_read_matcher.
Traceback (most recent call last):
Worker logs:
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-26_16_50_55-15575526398489765243?project=apache-beam-testing
File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.7/runpy.py", line 85, in _run_code
exec(code, run_globals)
Worker logs:
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-26_17_06_24-2737973249188852113?project=apache-beam-testing
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/io/gcp/pubsub_io_perf_test.py";,>
line 219, in <module>
PubsubReadPerfTest().run()
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/load_test.py";,>
line 150, in run
self.result = self.pipeline.run()
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,>
line 114, in run
False if self.not_use_test_runner_api else test_runner_api))
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 577, in run
return self.runner.run_pipeline(self, self._options)
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py";,>
line 70, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/hamcrest/core/assert_that.py";,>
line 58, in assert_that
_assert_match(actual=actual_or_assertion, matcher=matcher, reason=reason)
File
"<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages/hamcrest/core/assert_that.py";,>
line 73, in _assert_match
raise AssertionError(description)
AssertionError:
Expected: (Expected 1 messages.)
but: Expected 1 messages. Got 0 messages. Diffs (item, count):
Expected but not in actual: dict_items([(b'2097152', 1)])
Unexpected: dict_items([])
Unexpected (with all details): []
> Task :sdks:python:apache_beam:testing:load_tests:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PerformanceTests_PubsubIOIT_Python_Streaming/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'>
line: 63
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 47m 26s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://ge.apache.org/s/vibj2y5n6j2zi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
