See
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/6189/display/redirect>
Changes:
------------------------------------------
[...truncated 12.86 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-24
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-56
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-52
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-47
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-42
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-39
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-33
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-48
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-62
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-34
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-28
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-35
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-45
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-26
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-31
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-65
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-36
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-60
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-58
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-23
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-54
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-30
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-20
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-57
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-32
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:49 PM
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
getProcessBundleDescriptor
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
getProcessBundleDescriptor request with id 2-25
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:50 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Beam Fn Data client connected.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:51 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Connecting to SpannerConfig{projectId=beam-testing, instanceId=beam-test,
databaseId=xlang_beam48d0791bc2074c3babda,
host=https://batch-spanner.googleapis.com/,
emulatorHost=http://localhost:34095, isLocalChannelProvider=null,
commitDeadline=PT15S, maxCumulativeBackoff=PT900S,
executeStreamingSqlRetrySettings=null, commitRetrySettings=null,
retryableCodes=null, rpcPriority=MEDIUM, databaseRole=null, serviceFactory=null}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:52 PM
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient
unref
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Closing environment urn: "beam:env:docker:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 payload:
"\n apache/beam_java8_sdk:2.45.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bytes:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bool:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:varint:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:string_utf8:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:timer:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:kv:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:length_prefix:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:global_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:interval_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:custom_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:double:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:row:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:param_windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:state_backed_iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:nullable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:progress_reporting:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:control_request_elements_embedding:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:state_caching:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.45.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
dependencies {
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
type_urn: "beam:artifact:type:file:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
type_payload:
"\n\316\001/tmp/beam-temp4deywjc8/artifacts7t97wn09/8c0dcd890e4623637d1832efa0245c0dd4d38548d6eb3f17e0a2c222a035bc46/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHO"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
role_urn: "beam:artifact:role:staging_to:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
role_payload:
"\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-hsRFi7XFiiaegTixX8uCbd3zPeReRta_O_v8Ptl_dlM.jar"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 }
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:52 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService
close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 1
Beam Fn Logging clients still connected during shutdown.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:52 PM
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver
onCompleted
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Hanged up for unknown endpoint.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:52 PM
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Closing Docker container
0290ce0d4d7e9a78636faacc67f2d8c70cd24994fa8dc49433b0edcf7d0a3848. Logs:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
2023/01/10 13:42:46 Provision info:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1"
value:{bool_value:false}}
fields:{key:"beam:option:allow_non_restored_state:v1"
value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1"
value:{bool_value:false}} fields:{key:"beam:option:app_name:v1"
value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1"
value:{string_value:"0"}}
fields:{key:"beam:option:auto_balance_write_files_sharding_enabled:v1"
value:{bool_value:false}} fields:{key:"beam:option:beam_services:v1"
value:{struct_value:{}}} fields:{key:"beam:option:block_on_run:v1"
value:{bool_value:true}} fields:{key:"beam:option:dataflow_endpoint:v1"
value:{string_value:"https://dataflow.googleapis.com"}}
fields:{key:"beam:option:direct_embed_docker_python:v1"
value:{bool_value:false}} fields:{key:"beam:option:direct_num_workers:v1"
value:{string_value:"1"}}
fields:{key:"beam:option:direct_runner_bundle_repeat:v1"
value:{string_value:"0"}}
fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"
value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1"
value:{string_value:"in_memory"}}
fields:{key:"beam:option:direct_test_splits:v1" value:{struct_value:{}}}
fields:{key:"beam:option:disable_metrics:v1" value:{bool_value:false}}
fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_artifact_caching:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_streaming_engine:v1"
value:{bool_value:false}} fields:{key:"beam:option:enforce_encodability:v1"
value:{bool_value:true}} fields:{key:"beam:option:enforce_immutability:v1"
value:{bool_value:true}} fields:{key:"beam:option:environment_cache_millis:v1"
value:{string_value:"0"}} fields:{key:"beam:option:environment_config:v1"
value:{string_value:"localhost:43839"}}
fields:{key:"beam:option:environment_type:v1" value:{string_value:"LOOPBACK"}}
fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:externalized_checkpoints_enabled:v1"
value:{bool_value:false}}
fields:{key:"beam:option:fail_on_checkpointing_errors:v1"
value:{bool_value:true}} fields:{key:"beam:option:faster_copy:v1"
value:{bool_value:false}}
fields:{key:"beam:option:finish_bundle_before_checkpointing:v1"
value:{bool_value:false}} fields:{key:"beam:option:flink_conf_dir:v1"
value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:flink_job_server_jar:v1"
value:{string_value:"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.45.0-SNAPSHOT.jar"}}
fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}}
fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:false}}
fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.15"}}
fields:{key:"beam:option:gcp_oauth_scopes:v1"
value:{list_value:{values:{string_value:"https://www.googleapis.com/auth/bigquery"}
values:{string_value:"https://www.googleapis.com/auth/cloud-platform"}
values:{string_value:"https://www.googleapis.com/auth/devstorage.full_control"}
values:{string_value:"https://www.googleapis.com/auth/userinfo.email"}
values:{string_value:"https://www.googleapis.com/auth/datastore"}
values:{string_value:"https://www.googleapis.com/auth/spanner.admin"}
values:{string_value:"https://www.googleapis.com/auth/spanner.data"}}}}
fields:{key:"beam:option:gcs_performance_metrics:v1" value:{bool_value:false}}
fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}}
fields:{key:"beam:option:job_name:v1"
value:{string_value:"BeamApp-jenkins-0110134230-92152eea"}}
fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}}
fields:{key:"beam:option:job_server_java_launcher:v1"
value:{string_value:"java"}}
fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}}
fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}}
fields:{key:"beam:option:load_balance_bundles:v1" value:{bool_value:false}}
fields:{key:"beam:option:max_parallelism:v1" value:{string_value:"-1"}}
fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}}
fields:{key:"beam:option:object_reuse:v1" value:{bool_value:false}}
fields:{key:"beam:option:options_id:v1" value:{number_value:2}}
fields:{key:"beam:option:output_executable_path:v1"
value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1"
value:{string_value:"-1"}}
fields:{key:"beam:option:performance_runtime_type_check:v1"
value:{bool_value:false}} fields:{key:"beam:option:pickle_library:v1"
value:{string_value:"default"}}
fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}}
fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}}
fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}}
fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}}
fields:{key:"beam:option:project:v1"
value:{string_value:"apache-beam-testing"}}
fields:{key:"beam:option:re_iterable_group_by_key_result:v1"
value:{bool_value:false}}
fields:{key:"beam:option:requirements_cache_only_sources:v1"
value:{bool_value:false}} fields:{key:"beam:option:resource_hints:v1"
value:{list_value:{}}} fields:{key:"beam:option:retain_docker_containers:v1"
value:{bool_value:false}}
fields:{key:"beam:option:retain_externalized_checkpoints_on_cancellation:v1"
value:{bool_value:false}} fields:{key:"beam:option:runner:v1"
value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:runner_determined_sharding:v1"
value:{bool_value:true}} fields:{key:"beam:option:runtime_type_check:v1"
value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1"
value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1"
value:{bool_value:false}}
fields:{key:"beam:option:sdk_harness_log_level_overrides:v1"
value:{struct_value:{fields:{key:"org.apache.beam.runners.flink.FlinkPipelineRunner"
value:{string_value:"WARN"}} fields:{key:"org.apache.flink.runtime"
value:{string_value:"WARN"}}
fields:{key:"org.apache.flink.runtime.metrics.groups"
value:{string_value:"ERROR"}}}}} fields:{key:"beam:option:sdk_location:v1"
value:{string_value:"container"}}
fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}}
fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}}
fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}}
fields:{key:"beam:option:spark_version:v1" value:{string_value:"3"}}
fields:{key:"beam:option:streaming:v1" value:{bool_value:false}}
fields:{key:"beam:option:temp_location:v1"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-it"}}
fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}}
fields:{key:"beam:option:type_check_strictness:v1"
value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1"
value:{bool_value:false}}
fields:{key:"beam:option:use_storage_api_connection_pool:v1"
value:{bool_value:false}} fields:{key:"beam:option:use_storage_write_api:v1"
value:{bool_value:false}}
fields:{key:"beam:option:use_storage_write_api_at_least_once:v1"
value:{bool_value:false}} fields:{key:"beam:option:verify_row_values:v1"
value:{bool_value:false}}} logging_endpoint:{url:"localhost:41139"}
artifact_endpoint:{url:"localhost:34155"}
control_endpoint:{url:"localhost:33655"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\xce\x01/tmp/beam-temp4deywjc8/artifacts7t97wn09/8c0dcd890e4623637d1832efa0245c0dd4d38548d6eb3f17e0a2c222a035bc46/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHO"
role_urn:"beam:artifact:role:staging_to:v1"
role_payload:"\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-hsRFi7XFiiaegTixX8uCbd3zPeReRta_O_v8Ptl_dlM.jar"}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
2023/01/10 13:42:46 Initializing java harness: /opt/apache/beam/boot --id=2-1
--provision_endpoint=localhost:45271
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
2023/01/10 13:42:46 Downloaded:
/tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-hsRFi7XFiiaegTixX8uCbd3zPeReRta_O_v8Ptl_dlM.jar
(sha256: 86c4458bb5c58a269e8138b15fcb826dddf33de45e46d6bf3bfbfc3ed97f7653,
size: 115775122)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
2023/01/10 13:42:46 Loaded meta-option 'java-security'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
2023/01/10 13:42:46 Executing: java -Xmx76799219302 -XX:+UseParallelGC
-XX:+AlwaysActAsServerClassMachine -XX:-OmitStackTraceInFastThrow -cp
/opt/apache/beam/jars/slf4j-api.jar:/opt/apache/beam/jars/slf4j-jdk14.jar:/opt/apache/beam/jars/jcl-over-slf4j.jar:/opt/apache/beam/jars/log4j-over-slf4j.jar:/opt/apache/beam/jars/log4j-to-slf4j.jar:/opt/apache/beam/jars/beam-sdks-java-harness.jar:/opt/apache/beam/jars/beam-sdks-java-io-kafka.jar:/opt/apache/beam/jars/kafka-clients.jar:/tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-hsRFi7XFiiaegTixX8uCbd3zPeReRta_O_v8Ptl_dlM.jar
-javaagent:/opt/apache/beam/jars/jamm.jar
-Djava.security.properties=/opt/apache/beam/options/java8-security.properties
org.apache.beam.fn.harness.FnHarness
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J:
Class path contains multiple SLF4J bindings.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J:
Found binding in
[jar:file:/opt/apache/beam/jars/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J:
Found binding in
[jar:file:/tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.45.0-SNAPSHOT-hsRFi7XFiiaegTixX8uCbd3zPeReRta_O_v8Ptl_dlM.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J:
See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J:
Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SDK Fn
Harness started
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Harness
ID 2-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Logging
location url: "localhost:41139"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Control
location url: "localhost:33655"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Status
location null
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Pipeline
options
{"beam:option:allow_non_deterministic_key_coders:v1":false,"beam:option:allow_non_restored_state:v1":false,"beam:option:allow_unsafe_triggers:v1":false,"beam:option:app_name:v1":null,"beam:option:artifact_port:v1":"0","beam:option:auto_balance_write_files_sharding_enabled:v1":false,"beam:option:beam_services:v1":{},"beam:option:block_on_run:v1":true,"beam:option:dataflow_endpoint:v1":"https://dataflow.googleapis.com","beam:option:direct_embed_docker_python:v1":false,"beam:option:direct_num_workers:v1":"1","beam:option:direct_runner_bundle_repeat:v1":"0","beam:option:direct_runner_use_stacked_bundle:v1":true,"beam:option:direct_running_mode:v1":"in_memory","beam:option:direct_test_splits:v1":{},"beam:option:disable_metrics:v1":false,"beam:option:dry_run:v1":false,"beam:option:enable_artifact_caching:v1":false,"beam:option:enable_hot_key_logging:v1":false,"beam:option:enable_streaming_engine:v1":false,"beam:option:enforce_encodability:v1":true,"beam:option:enforce_immutability:v1":true,"beam:option:environment_cache_millis:v1":"0","beam:option:environment_config:v1":"localhost:43839","beam:option:environment_type:v1":"LOOPBACK","beam:option:expansion_port:v1":"0","beam:option:experiments:v1":["beam_fn_api"],"beam:option:externalized_checkpoints_enabled:v1":false,"beam:option:fail_on_checkpointing_errors:v1":true,"beam:option:faster_copy:v1":false,"beam:option:finish_bundle_before_checkpointing:v1":false,"beam:option:flink_conf_dir:v1":null,"beam:option:flink_job_server_jar:v1":"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.45.0-SNAPSHOT.jar","beam:option:flink_master:v1":"[auto]","beam:option:flink_submit_uber_jar:v1":false,"beam:option:flink_version:v1":"1.15","beam:option:gcp_oauth_scopes:v1":["https://www.googleapis.com/auth/bigquery","https://www.googleapis.com/auth/cloud-platform","https://www.googleapis.com/auth/devstorage.full_control","https://www.googleapis.com/auth/userinfo.email","https://www.googleapis.com/auth/datastore","https://www.googleapis.com/auth/spanner.admin","https://www.googleapis.com/auth/spanner.data"],"beam:option:gcs_performance_metrics:v1":false,"beam:option:hdfs_full_urls:v1":false,"beam:option:job_name:v1":"BeamApp-jenkins-0110134230-92152eea","beam:option:job_port:v1":"0","beam:option:job_server_java_launcher:v1":"java","beam:option:job_server_jvm_properties:v1":[],"beam:option:job_server_timeout:v1":"60","beam:option:load_balance_bundles:v1":false,"beam:option:max_parallelism:v1":"-1","beam:option:no_auth:v1":false,"beam:option:object_reuse:v1":false,"beam:option:options_id:v1":2,"beam:option:output_executable_path:v1":null,"beam:option:parallelism:v1":"-1","beam:option:performance_runtime_type_check:v1":false,"beam:option:pickle_library:v1":"default","beam:option:pipeline_type_check:v1":true,"beam:option:profile_cpu:v1":false,"beam:option:profile_memory:v1":false,"beam:option:profile_sample_rate:v1":1,"beam:option:project:v1":"apache-beam-testing","beam:option:re_iterable_group_by_key_result:v1":false,"beam:option:requirements_cache_only_sources:v1":false,"beam:option:resource_hints:v1":[],"beam:option:retain_docker_containers:v1":false,"beam:option:retain_externalized_checkpoints_on_cancellation:v1":false,"beam:option:runner:v1":null,"beam:option:runner_determined_sharding:v1":true,"beam:option:runtime_type_check:v1":false,"beam:option:s3_disable_ssl:v1":false,"beam:option:save_main_session:v1":false,"beam:option:sdk_harness_log_level_overrides:v1":{"org.apache.beam.runners.flink.FlinkPipelineRunner":"WARN","org.apache.flink.runtime":"WARN","org.apache.flink.runtime.metrics.groups":"ERROR"},"beam:option:sdk_location:v1":"container","beam:option:sdk_worker_parallelism:v1":"1","beam:option:spark_master_url:v1":"local[4]","beam:option:spark_submit_uber_jar:v1":false,"beam:option:spark_version:v1":"3","beam:option:streaming:v1":false,"beam:option:temp_location:v1":"gs://temp-storage-for-end-to-end-tests/temp-it","beam:option:type_check_additional:v1":"","beam:option:type_check_strictness:v1":"DEFAULT_TO_ANY","beam:option:update:v1":false,"beam:option:use_storage_api_connection_pool:v1":false,"beam:option:use_storage_write_api:v1":false,"beam:option:use_storage_write_api_at_least_once:v1":false,"beam:option:verify_row_values:v1":false}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:54 PM
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient
unref
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO:
Closing environment urn: "beam:env:external:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 payload:
"\n\021\n\017localhost:43839"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bytes:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:string_utf8:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:kv:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bool:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:varint:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:double:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:timer:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:interval_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:length_prefix:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:global_window:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:264 No more
requests from control plane
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:windowed_value:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:265 SDK Harness
waiting for in-flight requests to complete
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:param_windowed_value:v1"
ERROR apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read
inputs in the data plane.
Traceback (most recent call last):
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/worker/data_plane.py",
line 654, in _read_inputs
for elements in elements_iterator:
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",
line 426, in __next__
return self._next()
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:45373 {created_time:"2023-01-10T13:42:54.062788236+00:00",
grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
INFO apache_beam.runners.worker.data_plane:data_plane.py:805 Closing all
cached grpc data channels.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:state_backed_iterable:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:875 Closing all
cached gRPC state handlers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:custom_window:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:277 Done consuming
work.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:row:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:nullable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:progress_reporting:v0"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:worker_status:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:combinefn:packed_python:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.45.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jan 10,
2023 1:42:54 PM
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver
onCompleted
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING:
Hanged up for unknown endpoint.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583
Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/pytest_postCommitIT-flink-py37.xml
-
=================== 7 passed, 1 warning in 258.15s (0:04:18) ===================
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/worker/data_plane.py",
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/worker/data_plane.py",
line 654, in _read_inputs
for elements in elements_iterator:
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",
line 426, in __next__
return self._next()
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:40115 {grpc_message:"Multiplexer hanging up", grpc_status:1,
created_time:"2023-01-10T13:40:30.367796863+00:00"}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/worker/data_plane.py",
line 671, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/worker/data_plane.py",
line 654, in _read_inputs
for elements in elements_iterator:
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",
line 426, in __next__
return self._next()
File
"/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",
line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:45373 {created_time:"2023-01-10T13:42:54.062788236+00:00",
grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-3' is disconnected.
at
hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy147.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException: Pipe closed after 0 cycles
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
at
org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
at
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
at
hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
at
hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
at
hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
at
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-3 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
