See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4661/display/redirect>
Changes:
------------------------------------------
[...truncated 1.54 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:43:53 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:43:53 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:43:54 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:43:55 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:43:56 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:43:56 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to
"apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7fb08cd55f70>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function lift_combiners at 0x7fb08cd56040>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7fb08cd56790>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function
annotate_downstream_side_inputs at 0x7f7ee4b5baf0> ====================
INFO root:portable_runner.py:542 ==================== <function
fix_side_input_pcoll_coders at 0x7f7ee4b5bc10> ====================
INFO root:portable_runner.py:542 ==================== <function
pack_combiners at 0x7f7ee4b5e160> ====================
INFO root:portable_runner.py:542 ==================== <function
lift_combiners at 0x7f7ee4b5e1f0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf
at 0x7f7ee4b5e3a0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk
at 0x7f7ee4b5e430> ====================
INFO root:portable_runner.py:542 ==================== <function
sink_flattens at 0x7f7ee4b5e550> ====================
INFO root:portable_runner.py:542 ==================== <function
greedily_fuse at 0x7f7ee4b5e5e0> ====================
INFO root:portable_runner.py:542 ==================== <function
read_to_impulse at 0x7f7ee4b5e670> ====================
INFO root:portable_runner.py:542 ==================== <function
impulse_to_input at 0x7f7ee4b5e700> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages
at 0x7f7ee4b5e940> ====================
INFO root:portable_runner.py:542 ==================== <function
add_impulse_to_dangling_transforms at 0x7f7ee4b5ea60> ====================
INFO root:portable_runner.py:542 ==================== <function
setup_timer_mapping at 0x7f7ee4b5e8b0> ====================
INFO root:portable_runner.py:542 ==================== <function
populate_data_channel_coders at 0x7f7ee4b5e9d0> ====================
INFO root:portable_runner.py:542 starting control server on port 38203
INFO root:portable_runner.py:542 starting data server on port 45631
INFO root:portable_runner.py:542 starting state server on port 44119
INFO root:portable_runner.py:542 starting logging server on port 37541
INFO root:portable_runner.py:542 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f7f1a596790> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image
apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image
apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:542 Docker container is running. container_id
= b'c06e12c522e792944a63381bc53ee48da4955658f3d3b2feaa451cdb0475a6c7',
worker_id = worker_85
INFO root:portable_runner.py:542 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f7f1a561f10> for environment external_8beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image
apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image
apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:542 Docker container is running. container_id
= b'11a38065a3cfed19713ad6e282283979019ad58a32c9ac648f6bebcb254f5ca2',
worker_id = worker_86
INFO root:portable_runner.py:542 Completed job in 12.87888479232788 seconds
with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'>
'45183'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting
expansion service at localhost:45183
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:44:17 AM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1,
beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2,
beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1,
beam:transform:combine_per_key:v1, beam:transform:create_view:v1,
beam:transform:flatten:v1, beam:transform:group_by_key:v1,
beam:transform:group_into_batches:v1,
beam:transform:group_into_batches_with_sharded_key:v1,
beam:transform:impulse:v1, beam:transform:reshuffle:v1,
beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1,
beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7ee8290b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1f59a598
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1e178745
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@192c3f1e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@26b3fd41
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7494f96a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@561b6512
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@2e377400
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1757cd72
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@445b295b
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@49e5f737
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c671d7f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@757277dc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@687e99d8
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@e4487af
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@6aaceffd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@c86b9e3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:pubsub_write:v2:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@10aa41f2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:combine_globally:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@3af9c5b7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:combine_grouped_values:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@37271612
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:combine_per_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:create_view:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:flatten:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:group_by_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:group_into_batches:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:group_into_batches_with_sharded_key:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:impulse:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:reshuffle:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:sdf_process_keyed_elements:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:teststream:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:window_into:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:write_files:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1153447573@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:44:19 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:44:19 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:44:19 AM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:44:21 AM com.google.zetasql.io.grpc.NameResolverRegistry
getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
No NameResolverProviders found via ServiceLoader, including for DNS. This is
probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Sep 30,
2023 11:44:23 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner
convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT],
expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1],
str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to
"apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function pack_combiners at 0x7fb08cd55f70>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function lift_combiners at 0x7fb08cd56040>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:712
==================== <function sort_stages at 0x7fb08cd56790>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function
annotate_downstream_side_inputs at 0x7f7ee4b5baf0> ====================
INFO root:portable_runner.py:542 ==================== <function
fix_side_input_pcoll_coders at 0x7f7ee4b5bc10> ====================
INFO root:portable_runner.py:542 ==================== <function
pack_combiners at 0x7f7ee4b5e160> ====================
INFO root:portable_runner.py:542 ==================== <function
lift_combiners at 0x7f7ee4b5e1f0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf
at 0x7f7ee4b5e3a0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk
at 0x7f7ee4b5e430> ====================
INFO root:portable_runner.py:542 ==================== <function
sink_flattens at 0x7f7ee4b5e550> ====================
INFO root:portable_runner.py:542 ==================== <function
greedily_fuse at 0x7f7ee4b5e5e0> ====================
INFO root:portable_runner.py:542 ==================== <function
read_to_impulse at 0x7f7ee4b5e670> ====================
INFO root:portable_runner.py:542 ==================== <function
impulse_to_input at 0x7f7ee4b5e700> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages
at 0x7f7ee4b5e940> ====================
INFO root:portable_runner.py:542 ==================== <function
add_impulse_to_dangling_transforms at 0x7f7ee4b5ea60> ====================
INFO root:portable_runner.py:542 ==================== <function
setup_timer_mapping at 0x7f7ee4b5e8b0> ====================
INFO root:portable_runner.py:542 ==================== <function
populate_data_channel_coders at 0x7f7ee4b5e9d0> ====================
INFO root:portable_runner.py:542 starting control server on port 38061
INFO root:portable_runner.py:542 starting data server on port 46261
INFO root:portable_runner.py:542 starting state server on port 38473
INFO root:portable_runner.py:542 starting logging server on port 35645
INFO root:portable_runner.py:542 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f7f1a866340> for environment external_9beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image
apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image
apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:542 Docker container is running. container_id
= b'd4bf2b1aec1eccb4817c05150b1bf6c44069596eaf1afd51bedd092fa2d54303',
worker_id = worker_87
INFO root:portable_runner.py:542 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f7f1a8f3460> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image
apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image
apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:542 Docker container is running. container_id
= b'b3735078f9f0cccc5bf821a4088a7a21af54ac3bd9621a9a0ad941e9a0303180',
worker_id = worker_88
INFO root:portable_runner.py:542 Completed job in 15.435957431793213
seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549
Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
apache_beam/transforms/sql_test.py::SqlTransformTest::test_agg
apache_beam/transforms/sql_test.py::SqlTransformTest::test_filter
apache_beam/transforms/sql_test.py::SqlTransformTest::test_generate_data
apache_beam/transforms/sql_test.py::SqlTransformTest::test_map
apache_beam/transforms/sql_test.py::SqlTransformTest::test_project
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/transforms/external.py>:725:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self._expansion_service, pipeline.options)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
=== 9 passed, 17 skipped, 7194 deselected, 10 warnings in 243.80s (0:04:03) ====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 762910
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 765009.
Stopping expansion service pid: 765010.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'>
line: 235
* What went wrong:
Execution failed for task
':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 34m 23s
259 actionable tasks: 168 executed, 79 from cache, 12 up-to-date
Publishing build scan...
https://ge.apache.org/s/4vwxmosgotsbe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
