See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/5402/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13015] Update the SDK harness grouping table to be memory
bounded
[noreply] [BEAM-13982] Added output of logging for python E2E pytests (#17637)
------------------------------------------
[...truncated 1.81 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:43:42 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
SQLPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'LogicalProject(s=[*($0, $0)], c=[LENGTH($1)])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:43:43 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'BeamCalcRel(expr#0..1=[{inputs}], expr#2=[*($t0, $t0)], expr#3=[LENGTH($t1)],
s=[$t2], c=[$t3])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:302 Python SDK container image set to
"apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7fb3c60865e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7fb3c6086670>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7fb3c6086dc0>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to DONE
PASSED [ 66%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:751 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'>
'37087'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'Starting expansion service at localhost:37087'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:02 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:03 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:03 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"WARNING: Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:04 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"WARNING: Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
SQL:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT
`simple`.`id` AS `id`, `enrich`.`metadata` AS `metadata`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM
`beam`.`simple` AS `simple`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INNER
JOIN `beam`.`enrich` AS `enrich` ON `simple`.`id` = `enrich`.`id`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
SQLPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'LogicalProject(id=[$0], metadata=[$4])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
LogicalJoin(condition=[=($0, $3)], joinType=[inner])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, simple]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, enrich]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:06 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'BeamCalcRel(expr#0..4=[{inputs}], id=[$t0], metadata=[$t4])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamCoGBKJoinRel(condition=[=($0, $3)], joinType=[inner])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, simple]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, enrich]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:302 Python SDK container image set to
"apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7fb3c60865e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7fb3c6086670>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7fb3c6086dc0>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to DONE
PASSED [ 77%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:751 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'>
'57165'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'Starting expansion service at localhost:57165'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:27 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:30 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:30 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"WARNING: Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:31 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"WARNING: Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:33 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
SQL:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT
COUNT(*) AS `count`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:34 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
SQLPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:34 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:302 Python SDK container image set to
"apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7fb3c60865e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7fb3c6086670>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7fb3c6086dc0>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using
pre-built snapshot at
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:751 Starting a JAR-based expansion service from JAR
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'>
'39619'
'--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'Starting expansion service at localhost:39619'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:56 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'\tbeam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:59 PM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:59 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"WARNING: Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:44:59 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"WARNING: Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:45:02 PM com.google.zetasql.io.grpc.NameResolverRegistry
getDefaultRegistry'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b'WARNING: No NameResolverProviders found via ServiceLoader, including for DNS.
This is probably due to a broken build. If using ProGuard, check your
configuration'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 16,
2022 5:45:04 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner
convertToBeamRelInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125
b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT],
expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1],
str=[$t2], flt=[$t3])"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
BeamValuesRel(tuples=[[{ 0 }]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.40.0.dev
INFO root:environments.py:302 Python SDK container image set to
"apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7fb3c60865e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7fb3c6086670>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7fb3c6086dc0>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to RUNNING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580
Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
<unknown>:54
<unknown>:54: DeprecationWarning: invalid escape sequence \c
<unknown>:62
<unknown>:62: DeprecationWarning: invalid escape sequence \d
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml>
-
====== 9 passed, 1 skipped, 5575 deselected, 3 warnings in 247.96 seconds ======
> Task :runners:flink:1.13:job-server:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3313325.
Stopping expansion service pid: 3313326.
> Task :runners:flink:1.13:job-server:flinkJobServerCleanup
Stopping job server pid: 3284084.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go/test/build.gradle'>
line: 195
* What went wrong:
Execution failed for task
':runners:flink:1.13:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 41m 36s
241 actionable tasks: 35 executed, 206 up-to-date
Publishing build scan...
https://gradle.com/s/t4vcxc4m2ljxc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
