See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5083/display/redirect>
Changes:
------------------------------------------
[...truncated 1.63 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e1d27ba
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@61d6015a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2525ff7e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@524d6d96
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@152aa092
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@44a7bfbc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4ef37659
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@776b83cc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37858383
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e268090
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb266b3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:bigquery_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@306cf3ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:bigquery_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2beee7ff
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_write:v2:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_globally:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_grouped_values:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_per_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:create_view:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:flatten:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_by_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_into_batches:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_into_batches_with_sharded_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:impulse:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:reshuffle:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:sdf_process_keyed_elements:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:teststream:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:window_into:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:write_files:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$81/2109798150@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:02:54 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:02:54 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:02:55 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT
COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:02:57 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to
"apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7fc782c94280>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function lift_combiners at 0x7fc782c94310>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7fc782c94a60>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function
annotate_downstream_side_inputs at 0x7f93f99e59d0> ====================
INFO root:portable_runner.py:543 ==================== <function
fix_side_input_pcoll_coders at 0x7f93f99e5af0> ====================
INFO root:portable_runner.py:543 ==================== <function
pack_combiners at 0x7f93f99e6040> ====================
INFO root:portable_runner.py:543 ==================== <function
lift_combiners at 0x7f93f99e60d0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf
at 0x7f93f99e6280> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk
at 0x7f93f99e6310> ====================
INFO root:portable_runner.py:543 ==================== <function
sink_flattens at 0x7f93f99e6430> ====================
INFO root:portable_runner.py:543 ==================== <function
greedily_fuse at 0x7f93f99e64c0> ====================
INFO root:portable_runner.py:543 ==================== <function
read_to_impulse at 0x7f93f99e6550> ====================
INFO root:portable_runner.py:543 ==================== <function
impulse_to_input at 0x7f93f99e65e0> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages
at 0x7f93f99e6820> ====================
INFO root:portable_runner.py:543 ==================== <function
add_impulse_to_dangling_transforms at 0x7f93f99e6940> ====================
INFO root:portable_runner.py:543 ==================== <function
setup_timer_mapping at 0x7f93f99e6790> ====================
INFO root:portable_runner.py:543 ==================== <function
populate_data_channel_coders at 0x7f93f99e68b0> ====================
INFO root:portable_runner.py:543 starting control server on port 41771
INFO root:portable_runner.py:543 starting data server on port 37323
INFO root:portable_runner.py:543 starting state server on port 34125
INFO root:portable_runner.py:543 starting logging server on port 36135
INFO root:portable_runner.py:543 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f942df23580> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image
apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image
apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:543 Docker container is running. container_id
= b'e76cd2dea4895fe116b2c8974d4b595369f83acedf9f0d9affccaff416b9ee32',
worker_id = worker_87
INFO root:portable_runner.py:543 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler
object at 0x7f942dfe0250> for environment external_8beam:env:anyof:v1
(beam:env:external:v1, b'\n\x11\n\x0flocalhost:52427')
INFO root:portable_runner.py:543 Requesting worker at localhost:52427
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:03:07 AM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Starting worker worker_88 pointing at
apache-ci-beam-jenkins-16.c.apache-beam-testing.internal:41771.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:03:16 AM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 20,
2024 11:03:16 AM org.apache.beam.fn.harness.ExternalWorkerService
lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Successfully started worker worker_88.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",>
line 302, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",>
line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",>
line 302, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",>
line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to FAILED
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
- RuntimeError: Pipeline job-d40b8520-b1a0-402d-9ff5-2b113ab55ac4 failed in
state FAILED: Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py",>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py",>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",>
line 302, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py",>
line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py",>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7304 deselected in 294.89s (0:04:54) =====
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 986297
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 987191.
Stopping expansion service pid: 987192.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'>
line: 235
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 37m 18s
261 actionable tasks: 179 executed, 72 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/lr3uwqirvoyqk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]