See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/3075/display/redirect?page=changes>
Changes:
[Robert Bradshaw] [BEAM-22923] Allow sharding specification for dataframe
writes.
[noreply] Add set state in Go (#22919)
[noreply] Go Map State integration test (#22898)
[noreply] Add clear function for bag state types (#22917)
[noreply] [Playground] Update build_playground_backend.yml - add "Index
creation"
------------------------------------------
[...truncated 980.70 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:42607.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:42607.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:42607.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:39:45 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:39:45 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:39:46 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:39:51 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 SELECT
`PCOLLECTION`.`id`, `PCOLLECTION`.`flt`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:39:52 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
LogicalProject(id=[$0], flt=[$2])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:39:52 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamCalcRel(expr#0..2=[{inputs}], id=[$t0], flt=[$t2])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.42.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.42.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.42.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7fe1f1d20ef0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7fe1f1d20f80>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7fe1f1d23710>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment
is apache/beam_python3.7_sdk:2.42.0.dev
INFO root:portable_runner.py:577 ==================== <function
annotate_downstream_side_inputs at 0x7f91734a5c20> ====================
INFO root:portable_runner.py:577 ==================== <function
fix_side_input_pcoll_coders at 0x7f91734a5d40> ====================
INFO root:portable_runner.py:577 ==================== <function
pack_combiners at 0x7f91734a8290> ====================
INFO root:portable_runner.py:577 ==================== <function
lift_combiners at 0x7f91734a8320> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf
at 0x7f91734a84d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk
at 0x7f91734a8560> ====================
INFO root:portable_runner.py:577 ==================== <function
sink_flattens at 0x7f91734a8680> ====================
INFO root:portable_runner.py:577 ==================== <function
greedily_fuse at 0x7f91734a8710> ====================
INFO root:portable_runner.py:577 ==================== <function
read_to_impulse at 0x7f91734a87a0> ====================
INFO root:portable_runner.py:577 ==================== <function
impulse_to_input at 0x7f91734a8830> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages
at 0x7f91734a8a70> ====================
INFO root:portable_runner.py:577 ==================== <function
add_impulse_to_dangling_transforms at 0x7f91734a8b90> ====================
INFO root:portable_runner.py:577 ==================== <function
setup_timer_mapping at 0x7f91734a89e0> ====================
INFO root:portable_runner.py:577 ==================== <function
populate_data_channel_coders at 0x7f91734a8b00> ====================
INFO root:portable_runner.py:577 starting control server on port 38817
INFO root:portable_runner.py:577 starting data server on port 42277
INFO root:portable_runner.py:577 starting state server on port 39127
INFO root:portable_runner.py:577 starting logging server on port 40039
INFO root:portable_runner.py:577 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f918c208650> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.7_sdk:2.42.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image
apache/beam_python3.7_sdk:2.42.0.dev
INFO root:portable_runner.py:577 Unable to pull image
apache/beam_python3.7_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'6a63be853da42cc46fffc25b02848956adf746bb34e51ab9d2622049d27c77c4',
worker_id = worker_79
INFO root:portable_runner.py:577 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f918c1fe1d0> for environment external_5beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image
apache/beam_java8_sdk:2.42.0.dev
INFO root:portable_runner.py:577 Unable to pull image
apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'6b74acae13309b1b9dfa4e5f32dba4170808fa5a3c4f002a79e7f7a8c0813af7',
worker_id = worker_80
INFO root:portable_runner.py:577 Completed job in 30.150435209274292
seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [ 55%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_row
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:254 Using
pre-built snapshot at
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar
INFO root:external.py:773 Starting a JAR-based expansion service from JAR
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar'
'39187'
'--filesToStage=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Starting
expansion service at localhost:39187
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:41 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:39187.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:39187.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:39187.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:39187.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:47 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:48 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:49 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:53 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 SELECT
`PCOLLECTION`.`a` * `PCOLLECTION`.`a` AS `s`, `LENGTH`(`PCOLLECTION`.`b`) AS `c`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 FROM
`beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
LogicalProject(s=[*($0, $0)], c=[LENGTH($1)])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:40:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamCalcRel(expr#0..1=[{inputs}], expr#2=[*($t0, $t0)], expr#3=[LENGTH($t1)],
s=[$t2], c=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.42.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.42.0.dev
INFO root:environments.py:304 Python SDK container image set to
"apache/beam_python3.7_sdk:2.42.0.dev" for Docker environment
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7fe1f1d20ef0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7fe1f1d20f80>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7fe1f1d23710>
====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to RUNNING
INFO root:portable_runner.py:577 Default Python SDK image for environment
is apache/beam_python3.7_sdk:2.42.0.dev
INFO root:portable_runner.py:577 ==================== <function
annotate_downstream_side_inputs at 0x7f91734a5c20> ====================
INFO root:portable_runner.py:577 ==================== <function
fix_side_input_pcoll_coders at 0x7f91734a5d40> ====================
INFO root:portable_runner.py:577 ==================== <function
pack_combiners at 0x7f91734a8290> ====================
INFO root:portable_runner.py:577 ==================== <function
lift_combiners at 0x7f91734a8320> ====================
INFO root:portable_runner.py:577 ==================== <function expand_sdf
at 0x7f91734a84d0> ====================
INFO root:portable_runner.py:577 ==================== <function expand_gbk
at 0x7f91734a8560> ====================
INFO root:portable_runner.py:577 ==================== <function
sink_flattens at 0x7f91734a8680> ====================
INFO root:portable_runner.py:577 ==================== <function
greedily_fuse at 0x7f91734a8710> ====================
INFO root:portable_runner.py:577 ==================== <function
read_to_impulse at 0x7f91734a87a0> ====================
INFO root:portable_runner.py:577 ==================== <function
impulse_to_input at 0x7f91734a8830> ====================
INFO root:portable_runner.py:577 ==================== <function sort_stages
at 0x7f91734a8a70> ====================
INFO root:portable_runner.py:577 ==================== <function
add_impulse_to_dangling_transforms at 0x7f91734a8b90> ====================
INFO root:portable_runner.py:577 ==================== <function
setup_timer_mapping at 0x7f91734a89e0> ====================
INFO root:portable_runner.py:577 ==================== <function
populate_data_channel_coders at 0x7f91734a8b00> ====================
INFO root:portable_runner.py:577 starting control server on port 35719
INFO root:portable_runner.py:577 starting data server on port 38243
INFO root:portable_runner.py:577 starting state server on port 42601
INFO root:portable_runner.py:577 starting logging server on port 44807
INFO root:portable_runner.py:577 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f918c202e90> for environment
ref_Environment_default_environment_2 (beam:env:docker:v1,
b'\n$apache/beam_python3.7_sdk:2.42.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image
apache/beam_python3.7_sdk:2.42.0.dev
INFO root:portable_runner.py:577 Unable to pull image
apache/beam_python3.7_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'3c53d249f7adeac8f3547826b5e6e04124471d3ac8890ca00403116b1d1040ab',
worker_id = worker_81
INFO root:portable_runner.py:577 Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler
object at 0x7f918c208490> for environment external_6beam:env:docker:v1
(beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.42.0.dev')
INFO root:portable_runner.py:577 Attempting to pull image
apache/beam_java8_sdk:2.42.0.dev
INFO root:portable_runner.py:577 Unable to pull image
apache/beam_java8_sdk:2.42.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:577 Waiting for docker to start up. Current
status is running
INFO root:portable_runner.py:577 Docker container is running. container_id
= b'd4f7792cc061fc2518397148e13b8cb85629f09745955d236d401cab8cfded37',
worker_id = worker_82
INFO root:portable_runner.py:577 Completed job in 36.76409029960632 seconds
with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [ 66%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_tagged_join
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:254 Using
pre-built snapshot at
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar
INFO root:external.py:773 Starting a JAR-based expansion service from JAR
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting
service with ['java' '-jar'
'/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar'
'40095'
'--filesToStage=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_XVR_Direct/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.42.0-SNAPSHOT.jar']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Starting
expansion service at localhost:40095
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:40095.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:40095.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:41:53 PM org.apache.beam.sdk.expansion.service.ExpansionService
loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Registering external transforms: [beam:external:java:sql:v1,
beam:transform:org.apache.beam:pubsub_read:v1,
beam:transform:org.apache.beam:pubsub_write:v1,
beam:transform:org.apache.beam:pubsublite_write:v1,
beam:transform:org.apache.beam:pubsublite_read:v1,
beam:transform:org.apache.beam:spanner_insert:v1,
beam:transform:org.apache.beam:spanner_update:v1,
beam:transform:org.apache.beam:spanner_replace:v1,
beam:transform:org.apache.beam:spanner_insert_or_update:v1,
beam:transform:org.apache.beam:spanner_delete:v1,
beam:transform:org.apache.beam:spanner_read:v1,
beam:transform:org.apache.beam:kafka_read_with_metadata:v1,
beam:transform:org.apache.beam:kafka_read_without_metadata:v1,
beam:transform:org.apache.beam:kafka_write:v1,
beam:external:java:generate_sequence:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsub_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsub_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsublite_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:pubsublite_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_insert:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_replace:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_insert_or_update:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_delete:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:spanner_read:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_read_with_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@71d44a3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_read_without_metadata:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b98f307
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:transform:org.apache.beam:kafka_write:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4802796d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@34123d65
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:40095.
WARNING root:subprocess_server.py:98 Waiting for grpc channel to be ready at
localhost:40095.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:41:57 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN
'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:41:57 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:41:58 PM
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader
payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 WARNING:
Configuration class
'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration'
has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:42:03 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 SELECT
`simple`.`id` AS `id`, `enrich`.`metadata` AS `metadata`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 FROM
`beam`.`simple` AS `simple`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INNER
JOIN `beam`.`enrich` AS `enrich` ON `simple`.`id` = `enrich`.`id`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:42:04 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
LogicalProject(id=[$0], metadata=[$4])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
LogicalJoin(condition=[=($0, $3)], joinType=[inner])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, simple]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, enrich]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Aug 29,
2022 5:42:04 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner
convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO:
BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamCalcRel(expr#0..4=[{inputs}], id=[$t0], metadata=[$t4])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamCoGBKJoinRel(condition=[=($0, $3)], joinType=[inner])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, simple]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
BeamIOSourceRel(table=[[beam, enrich]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:132
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-11' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy138.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
Caused by: Command Close created at
at hudson.remoting.Command.<init>(Command.java:70)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1306)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1304)
at hudson.remoting.Channel.close(Channel.java:1480)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312)
... 2 more
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-11 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
