See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/5040/display/redirect?page=changes>
Changes:
[noreply] Update MLTransform docs (#29910)
------------------------------------------
[...truncated 984.10 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:bigquery_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@5136d012
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:org.apache.beam:bigquery_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@5939a379
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@e1de817
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@52102734
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:pubsub_write:v2:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@3541cb24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_globally:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@2177849e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_grouped_values:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@40cb8df7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:combine_per_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@13b13b5d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:create_view:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@2892dae4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:flatten:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@355ce81c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_by_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@29647f75
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_into_batches:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@3315d2d7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:group_into_batches_with_sharded_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@d6e7bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:impulse:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@5fa07e12
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:reshuffle:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@55b53d44
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:sdf_process_keyed_elements:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@482bce4f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:teststream:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@366647c2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:window_into:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@6a6afff2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:transform:write_files:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1136768342@1649b0e6
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:filter-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:map_to_fields-java:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:generate_sequence:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
beam:schematransform:org.apache.beam:yaml:explode:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:21 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:21 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:22 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:23 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SELECT
COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:24 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO root:environments.py:318 No image given, using default Python SDK image
INFO root:environments.py:321 Python SDK container image set to
"apache/beam_python3.8_sdk:2.54.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7f74c20e1670>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function lift_combiners at 0x7f74c20e1700>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7f74c20e1e50>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to RUNNING
INFO root:portable_runner.py:543 ==================== <function
annotate_downstream_side_inputs at 0x7f5053019700> ====================
INFO root:portable_runner.py:543 ==================== <function
fix_side_input_pcoll_coders at 0x7f5053019820> ====================
INFO root:portable_runner.py:543 ==================== <function
pack_combiners at 0x7f5053019d30> ====================
INFO root:portable_runner.py:543 ==================== <function
lift_combiners at 0x7f5053019dc0> ====================
INFO root:portable_runner.py:543 ==================== <function expand_sdf
at 0x7f5053019f70> ====================
INFO root:portable_runner.py:543 ==================== <function expand_gbk
at 0x7f505301a040> ====================
INFO root:portable_runner.py:543 ==================== <function
sink_flattens at 0x7f505301a160> ====================
INFO root:portable_runner.py:543 ==================== <function
greedily_fuse at 0x7f505301a1f0> ====================
INFO root:portable_runner.py:543 ==================== <function
read_to_impulse at 0x7f505301a280> ====================
INFO root:portable_runner.py:543 ==================== <function
impulse_to_input at 0x7f505301a310> ====================
INFO root:portable_runner.py:543 ==================== <function sort_stages
at 0x7f505301a550> ====================
INFO root:portable_runner.py:543 ==================== <function
add_impulse_to_dangling_transforms at 0x7f505301a670> ====================
INFO root:portable_runner.py:543 ==================== <function
setup_timer_mapping at 0x7f505301a4c0> ====================
INFO root:portable_runner.py:543 ==================== <function
populate_data_channel_coders at 0x7f505301a5e0> ====================
INFO root:portable_runner.py:543 starting control server on port 33127
INFO root:portable_runner.py:543 starting data server on port 35421
INFO root:portable_runner.py:543 starting state server on port 43387
INFO root:portable_runner.py:543 starting logging server on port 45661
INFO root:portable_runner.py:543 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f5088028880> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.8_sdk:2.54.0.dev')
INFO root:portable_runner.py:543 Attempting to pull image
apache/beam_python3.8_sdk:2.54.0.dev
INFO root:portable_runner.py:543 Unable to pull image
apache/beam_python3.8_sdk:2.54.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:543 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:543 Docker container is running. container_id
= b'3f01a092206a8d98e56899135cb66394af52eea0d02fea522de7f0e18d61b825',
worker_id = worker_60
INFO root:portable_runner.py:543 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.ExternalWorkerHandler
object at 0x7f508806ac70> for environment external_8beam:env:anyof:v1
(beam:env:external:v1, b'\n\x11\n\x0flocalhost:34235')
INFO root:portable_runner.py:543 Requesting worker at localhost:34235
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:33 PM org.apache.beam.fn.harness.ExternalWorkerService startWorker
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Starting worker worker_61 pointing at
apache-ci-beam-jenkins-15.c.apache-beam-testing.internal:33127.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** jamm
will use sun.misc.Unsafe to compute the size of objects on heap.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** This
is not safe and results in wrong assumptions of the free/occupied Java
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** heap
and potentially in OOMs. The implementation performs arithmetics on the
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
"cookies" returned by Unsafe.objectFieldOffset(), althought the Javadoc says:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** "Do
not expect to perform any sort of arithmetic on this offset;
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** it is
just a cookie which is passed to the unsafe heap memory accessors."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** The
implementation does not always consider Java object layouts in under
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** all
circumstances for all JVMs.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 **
Solutions:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Use
a JDK/JVM with JEP-8249196
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 ** - Load
jamm as an agent into the JVM
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
***********************************************************************************
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:42 PM org.apache.beam.fn.harness.FnHarness main
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Shutting SDK harness down.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 08,
2024 5:41:42 PM org.apache.beam.fn.harness.ExternalWorkerService
lambda$startWorker$0
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Successfully started worker worker_61.
ERROR root:portable_runner.py:543 Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 302, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
ERROR root:portable_runner.py:543 Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 302, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to FAILED
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
- RuntimeError: Pipeline job-5ae3cfa0-34bb-4d78-8ee4-f11b6cd446c4 failed in
state FAILED: Error running pipeline.
Traceback (most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 297, in _run_job
self.result = self._invoke_runner()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/local_job_service.py";,>
line 319, in _invoke_runner
return fn_runner.FnApiRunner(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 224, in run_via_runner_api
return self.run_stages(stage_context, stages)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 466, in run_stages
bundle_results = self._execute_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 794, in _execute_bundle
self._run_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1031, in _run_bundle
result, splits = bundle_manager.process_bundle(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1358, in process_bundle
self._send_input_to_worker(process_bundle_id, transform_id, elements)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/fn_runner.py";,>
line 1232, in _send_input_to_worker
for byte_stream in (byte_streams or []):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 302, in __iter__
return itertools.chain(*self.partition(1))
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/runners/portability/fn_api_runner/execution.py";,>
line 288, in partition
for wkvs in windowed_key_values(key, windowed_values):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1224, in process_entire_key
for wvalue in self.process_elements(state,
File
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/apache_beam/transforms/trigger.py";,>
line 1376, in process_elements
if input_watermark > window.end + self.allowed_lateness:
AttributeError: 'bytes' object has no attribute 'end'
===== 1 failed, 8 passed, 17 skipped, 7276 deselected in 277.67s (0:04:37) =====
> Task
> :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 935237
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 939364.
Stopping expansion service pid: 939365.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':release:go-licenses:go:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
==============================================================================
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 31m 55s
257 actionable tasks: 168 executed, 79 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/kdje7zisekxig
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
