See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3031/display/redirect?page=changes>
Changes: [noreply] Label kata changes with the language they're modifying (#22764) [noreply] [Website] Add GitHub issue link (#22774) [noreply] Fix some typos in the ML doc (#22763) [noreply] Go stateful DoFns user side changes (#22761) [noreply] fixed column width in tables in Getting started from Spark guide ------------------------------------------ [...truncated 1.70 MB...] INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f64520f6dc0> ==================== INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f64520f6ee0> ==================== INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f64520f9430> ==================== INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f64520f94c0> ==================== INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f64520f9670> ==================== INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f64520f9700> ==================== INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f64520f9820> ==================== INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f64520f98b0> ==================== INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f64520f9940> ==================== INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f64520f99d0> ==================== INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f64520f9c10> ==================== INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f64520f9d30> ==================== INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f64520f9b80> ==================== INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f64520f9ca0> ==================== INFO root:portable_runner.py:574 starting control server on port 37079 INFO root:portable_runner.py:574 starting data server on port 38475 INFO root:portable_runner.py:574 starting state server on port 40315 INFO root:portable_runner.py:574 starting logging server on port 33539 INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f647e1cd850> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.9_sdk:2.42.0.dev') INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.9_sdk:2.42.0.dev INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.9_sdk:2.42.0.dev, defaulting to local image if it exists INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running INFO root:portable_runner.py:574 Docker container is running. container_id = b'd4bf8893c576613a9d3d8547c9859fef7865aa34832134f99c7079e0f9cace95', worker_id = worker_58 INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f647e1c6940> for environment external_7beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev') INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.42.0.dev INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running INFO root:portable_runner.py:574 Docker container is running. container_id = b'e6732e9b669302c917c037cf87ee0b656f770b2c8b06fd32d875b26a11645e6a', worker_id = worker_59 INFO root:portable_runner.py:574 Completed job in 13.298463582992554 seconds with state DONE. INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE PASSED [ 77%] apache_beam/transforms/sql_test.py::SqlTransformTest::test_windowing_before_sql -------------------------------- live log call --------------------------------- INFO apache_beam.utils.subprocess_server:subprocess_server.py:254 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar> INFO root:external.py:769 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar> INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar'> '44361' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar']> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Starting expansion service at localhost:44361 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:42 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:44 PM org.apache.beam.sdk.expansion.service.ExpansionService expand INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1' INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:44 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach. INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:44 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach. INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:46 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQL: INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 SELECT COUNT(*) AS `count` INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION` INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:46 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQLPlan> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 LogicalAggregate(group=[{}], count=[COUNT()]) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamIOSourceRel(table=[[beam, PCOLLECTION]]) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:58:46 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: BEAMPlan> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamAggregationRel(group=[{}], count=[COUNT()]) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamIOSourceRel(table=[[beam, PCOLLECTION]]) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:environments.py:299 No image given, using default Python SDK image INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.42.0.dev" for Docker environment INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fb1d1ca0b80> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fb1d1ca0c10> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fb1d1c9f3a0> ==================== INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f64520f6dc0> ==================== INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f64520f6ee0> ==================== INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f64520f9430> ==================== INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f64520f94c0> ==================== INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f64520f9670> ==================== INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f64520f9700> ==================== INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f64520f9820> ==================== INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f64520f98b0> ==================== INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f64520f9940> ==================== INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f64520f99d0> ==================== INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f64520f9c10> ==================== INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f64520f9d30> ==================== INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f64520f9b80> ==================== INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f64520f9ca0> ==================== INFO root:portable_runner.py:574 starting control server on port 38257 INFO root:portable_runner.py:574 starting data server on port 37149 INFO root:portable_runner.py:574 starting state server on port 34105 INFO root:portable_runner.py:574 starting logging server on port 36815 INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f647e709160> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.9_sdk:2.42.0.dev') INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.9_sdk:2.42.0.dev INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.9_sdk:2.42.0.dev, defaulting to local image if it exists INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running INFO root:portable_runner.py:574 Docker container is running. container_id = b'3dd0183dae2362bf1a0ee07e35b8393c93a8ed6f13cca46b55ec69fb111ec6c5', worker_id = worker_60 INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f64507b70d0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev') INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.42.0.dev INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running INFO root:portable_runner.py:574 Docker container is running. container_id = b'35b1c81ffb2c72dc9d6d7ce55ad4a87249eafb43fcc6232d2626195001d78820', worker_id = worker_61 INFO root:portable_runner.py:574 Completed job in 12.962108850479126 seconds with state DONE. INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE PASSED [ 88%] apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data -------------------------------- live log call --------------------------------- INFO apache_beam.utils.subprocess_server:subprocess_server.py:254 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar> INFO root:external.py:769 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar> INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar'> '33189' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar']> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Starting expansion service at localhost:33189 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:59:08 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:59:10 PM org.apache.beam.sdk.expansion.service.ExpansionService expand INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1' INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:59:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach. INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:59:10 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach. INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:59:12 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 18, 2022 5:59:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: BEAMPlan> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3]) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 BeamValuesRel(tuples=[[{ 0 }]]) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:environments.py:299 No image given, using default Python SDK image INFO root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:environments.py:302 Python SDK container image set to "apache/beam_python3.9_sdk:2.42.0.dev" for Docker environment INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fb1d1ca0b80> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fb1d1ca0c10> ==================== INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fb1d1c9f3a0> ==================== INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING INFO root:portable_runner.py:574 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.42.0.dev INFO root:portable_runner.py:574 ==================== <function annotate_downstream_side_inputs at 0x7f64520f6dc0> ==================== INFO root:portable_runner.py:574 ==================== <function fix_side_input_pcoll_coders at 0x7f64520f6ee0> ==================== INFO root:portable_runner.py:574 ==================== <function pack_combiners at 0x7f64520f9430> ==================== INFO root:portable_runner.py:574 ==================== <function lift_combiners at 0x7f64520f94c0> ==================== INFO root:portable_runner.py:574 ==================== <function expand_sdf at 0x7f64520f9670> ==================== INFO root:portable_runner.py:574 ==================== <function expand_gbk at 0x7f64520f9700> ==================== INFO root:portable_runner.py:574 ==================== <function sink_flattens at 0x7f64520f9820> ==================== INFO root:portable_runner.py:574 ==================== <function greedily_fuse at 0x7f64520f98b0> ==================== INFO root:portable_runner.py:574 ==================== <function read_to_impulse at 0x7f64520f9940> ==================== INFO root:portable_runner.py:574 ==================== <function impulse_to_input at 0x7f64520f99d0> ==================== INFO root:portable_runner.py:574 ==================== <function sort_stages at 0x7f64520f9c10> ==================== INFO root:portable_runner.py:574 ==================== <function add_impulse_to_dangling_transforms at 0x7f64520f9d30> ==================== INFO root:portable_runner.py:574 ==================== <function setup_timer_mapping at 0x7f64520f9b80> ==================== INFO root:portable_runner.py:574 ==================== <function populate_data_channel_coders at 0x7f64520f9ca0> ==================== INFO root:portable_runner.py:574 starting control server on port 40185 INFO root:portable_runner.py:574 starting data server on port 39495 INFO root:portable_runner.py:574 starting state server on port 43787 INFO root:portable_runner.py:574 starting logging server on port 40595 INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f647e677a60> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev') INFO root:portable_runner.py:574 Attempting to pull image apache/beam_java8_sdk:2.42.0.dev INFO root:portable_runner.py:574 Unable to pull image apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running INFO root:portable_runner.py:574 Docker container is running. container_id = b'387e3574df4939c4d985c337d42b45351477a875dcb92a1d25ac1d2e1c70f3ce', worker_id = worker_62 INFO root:portable_runner.py:574 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f647e1f2dc0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.9_sdk:2.42.0.dev') INFO root:portable_runner.py:574 Attempting to pull image apache/beam_python3.9_sdk:2.42.0.dev INFO root:portable_runner.py:574 Unable to pull image apache/beam_python3.9_sdk:2.42.0.dev, defaulting to local image if it exists INFO root:portable_runner.py:574 Waiting for docker to start up. Current status is running INFO root:portable_runner.py:574 Docker container is running. container_id = b'429d45e8ec5ed854c6095fb840ccd5c77c6b012c39b70f9b38f0bf2383ea71d5', worker_id = worker_63 INFO root:portable_runner.py:574 Completed job in 11.520599365234375 seconds with state DONE. INFO apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to DONE PASSED [100%] =============================== warnings summary =============================== ../../build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py:42 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ==== 9 passed, 2 skipped, 6542 deselected, 2 warnings in 235.15s (0:03:55) ===== > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 279989. Stopping expansion service pid: 279990. > Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup Killing process at 277271 FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 199 * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 22m 51s 232 actionable tasks: 32 executed, 200 up-to-date Publishing build scan... https://gradle.com/s/dqrgprfbqs5ow Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
