See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/1776/display/redirect?page=changes>
Changes:
[git] BEAM-13592 Add getOrderingKey in
[git] Add CHANGES entry
[git] Rename transform name according to review comment
[git] Update to pass ordering key
[egalpin] Adds ordering key to OutgoingMessage builder, adds new coders to
pubsub
[egalpin] Fixes pubsub bounded writer allowing for orderingKey
[egalpin] Alters order of pubsub message support in registrar
[egalpin] Removed publishTime and messageId in grpc pubsub client publish
[egalpin] Attempts to allow different pubsub root url for PubsubIO.Write
[egalpin] Fixes pubsub tests root url
[egalpin] Puts PubsubMessageCoder last in registrar
[egalpin] Uses MoreObjects over Objects
[egalpin] Renames PubsubMessageCoder to
[Robert Bradshaw] Add a multi-process shared utility.
[Robert Bradshaw] Add fastener dependency.
[Robert Bradshaw] Refactor to have an explicit acquire/release API.
[Robert Bradshaw] Drop a TODO about deferred construction parameterization.
[Robert Bradshaw] Fix unused import/var.
[Moritz Mack] Replace website references to deprecated aws / kinesis modules
with more
[noreply] fix distribution example in golang guide (#23567)
[noreply] Add database role to SpannerConfig for role-based access control.
------------------------------------------
[...truncated 1.49 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@59474f18
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@65fb9ffc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3e694b3f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb5a082
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@78691363
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:27 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:27 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:28 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:30 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
`PCOLLECTION`.`a` * `PCOLLECTION`.`a` AS `s`, `LENGTH`(`PCOLLECTION`.`b`) AS `c`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:30 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalProject(s=[*($0, $0)], c=[LENGTH($1)])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:30 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamCalcRel(expr#0..1=[{inputs}], expr#2=[*($t0, $t0)], expr#3=[LENGTH($t1)],
s=[$t2], c=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.43.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f245774f320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f245774f3b0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f245774fb00>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [ 66%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar>
INFO root:external.py:773 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar'>
'49853'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting
expansion service at localhost:49853
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:51 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@59474f18
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@65fb9ffc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3e694b3f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb5a082
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@78691363
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:53 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:53 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:53 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
`simple`.`id` AS `id`, `enrich`.`metadata` AS `metadata`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`simple` AS `simple`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INNER
JOIN `beam`.`enrich` AS `enrich` ON `simple`.`id` = `enrich`.`id`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalProject(id=[$0], metadata=[$4])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalJoin(condition=[=($0, $3)], joinType=[inner])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, simple]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, enrich]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:11:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamCalcRel(expr#0..4=[{inputs}], id=[$t0], metadata=[$t4])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamCoGBKJoinRel(condition=[=($0, $3)], joinType=[inner])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, simple]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, enrich]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.43.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f245774f320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f245774f3b0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f245774fb00>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar>
INFO root:external.py:773 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar'>
'58003'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting
expansion service at localhost:58003
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:17 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@59474f18
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@65fb9ffc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3e694b3f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb5a082
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@78691363
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:19 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:19 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:19 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT
COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:21 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.43.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f245774f320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f245774f3b0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f245774fb00>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar>
INFO root:external.py:773 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar'>
'37255'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.43.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting
expansion service at localhost:37255
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:41 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@59474f18
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@65fb9ffc
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3e694b3f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1bb5a082
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@78691363
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:42 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:42 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:43 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:45 PM com.google.zetasql.io.grpc.NameResolverRegistry
getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
No NameResolverProviders found via ServiceLoader, including for DNS. This is
probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11,
2022 6:12:46 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner
convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT],
expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1],
str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.43.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.43.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f245774f320>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f245774f3b0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f245774fb00>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
===== 9 passed, 3 skipped, 6683 deselected, 1 warning in 236.02s (0:03:56) =====
> Task :runners:samza:job-server:samzaJobServerCleanup
Stopping job server pid: 839303.
> Task :runners:samza:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 850016.
Stopping expansion service pid: 850017.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/go/test/build.gradle'>
line: 195
* What went wrong:
Execution failed for task
':runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 30m 46s
260 actionable tasks: 172 executed, 76 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/icknqv6l2425e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
