See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/1688/display/redirect?page=changes>
Changes: [noreply] [BEAM-14139] Remove unused Flink 1.11 directory (#17750) [noreply] [BEAM-14044] Allow ModelLoader to forward BatchElements args (#17527) [noreply] [BEAM-14481] Remove unnecessary context (#17737) [noreply] [BEAM-9324] Fix incompatibility of direct runner with cython (#17728) [noreply] [BEAM-14503] Add support for Flink 1.15 (#17739) [noreply] Update Beam website to release 2.39.0 (#17690) [noreply] [BEAM-14509] Add several flags to dataflow runner (#17752) ------------------------------------------ [...truncated 2.07 MB...] INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:299 No image given, using default Python SDK image WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fa813d3b9d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fa813d3ba60> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fa813d3d1f0> ==================== INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STOPPED INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STARTING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to RUNNING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to DONE PASSED [ 66%] apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join -------------------------------- live log call --------------------------------- INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar> INFO root:external.py:751 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar> INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '37829' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']> INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:37829' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:13 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:14 PM org.apache.beam.sdk.expansion.service.ExpansionService expand' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'" INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:14 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:14 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:16 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQL:' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT `simple`.`id` AS `id`, `enrich`.`metadata` AS `metadata`' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM `beam`.`simple` AS `simple`' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INNER JOIN `beam`.`enrich` AS `enrich` ON `simple`.`id` = `enrich`.`id`' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:17 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQLPlan>' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'LogicalProject(id=[$0], metadata=[$4])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' LogicalJoin(condition=[=($0, $3)], joinType=[inner])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, simple]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, enrich]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:17 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'BeamCalcRel(expr#0..4=[{inputs}], id=[$t0], metadata=[$t4])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamCoGBKJoinRel(condition=[=($0, $3)], joinType=[inner])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, simple]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, enrich]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:299 No image given, using default Python SDK image WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fa813d3b9d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fa813d3ba60> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fa813d3d1f0> ==================== INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STOPPED INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STARTING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to RUNNING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to DONE PASSED [ 77%] apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql -------------------------------- live log call --------------------------------- INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar> INFO root:external.py:751 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar> INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '49369' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']> INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:49369' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:40 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:41 PM org.apache.beam.sdk.expansion.service.ExpansionService expand' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'" INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:42 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQL:' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT COUNT(*) AS `count`' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQLPlan>' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'LogicalAggregate(group=[{}], count=[COUNT()])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:47:44 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'BeamAggregationRel(group=[{}], count=[COUNT()])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:299 No image given, using default Python SDK image WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fa813d3b9d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fa813d3ba60> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fa813d3d1f0> ==================== INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STOPPED INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STARTING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to RUNNING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to DONE PASSED [ 88%] apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data -------------------------------- live log call --------------------------------- INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar> INFO root:external.py:751 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar> INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '34969' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']> INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:34969' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:48:07 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:48:07 PM org.apache.beam.sdk.expansion.service.ExpansionService expand' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'" INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:48:07 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:48:08 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach." INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:48:10 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'May 25, 2022 9:48:12 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])" INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamValuesRel(tuples=[[{ 0 }]])' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:299 No image given, using default Python SDK image WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.9 interpreter. INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.40.0.dev INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.40.0.dev" for Docker environment INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fa813d3b9d0> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fa813d3ba60> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fa813d3d1f0> ==================== INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STOPPED INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to STARTING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to RUNNING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:580 Job state changed to DONE PASSED [100%] =============================== warnings summary =============================== <unknown>:54 <unknown>:54: DeprecationWarning: invalid escape sequence \c <unknown>:62 <unknown>:62: DeprecationWarning: invalid escape sequence \d <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html warnings.warn( <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/_pytest/mark/structures.py>:331: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html warnings.warn( -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ====== 9 passed, 1 skipped, 5577 deselected, 6 warnings in 256.67 seconds ====== > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 1459190. Stopping expansion service pid: 1459191. > Task :runners:spark:3:job-server:sparkJobServerCleanup Stopping job server pid: 1395948. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 195 * What went wrong: Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 40m 12s 235 actionable tasks: 32 executed, 203 up-to-date Publishing build scan... https://gradle.com/s/ha4eznfdhnsiq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
