See
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/2801/display/redirect>
Changes:
------------------------------------------
[...truncated 10.89 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.grpc.v1p60p1.com.google.common.base.Preconditions.checkState(Preconditions.java:512)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:208)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.grpc.v1p60p1.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:395)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:63)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:156)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:649)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:649)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:665)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:596)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1850)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3503)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3479)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3252)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4343)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4960)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:326)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:213)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.$closeResource(ExecutableStageDoFnOperator.java:550)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.cleanUp(ExecutableStageDoFnOperator.java:743)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.beam.runners.flink.translation.wrappers.streaming.AbstractStreamOperatorCompat.close(AbstractStreamOperatorCompat.java:86)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:163)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:125)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1025)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:903)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:786)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 at
java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24,
2024 12:42:11 AM
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient
unref
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Closing environment urn: "beam:env:docker:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 payload:
"\n apache/beam_java8_sdk:2.54.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:bytes:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:bool:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:varint:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:string_utf8:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:timer:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:kv:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:length_prefix:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:global_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:interval_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:custom_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:double:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:row:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:param_windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:state_backed_iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:coder:nullable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:protocol:progress_reporting:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:protocol:control_request_elements_embedding:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:protocol:state_caching:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.54.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
capabilities: "beam:protocol:data_sampling:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
dependencies {
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
type_urn: "beam:artifact:type:file:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
type_payload:
"\n\316\001/tmp/beam-tempz5_enx_b/artifactsov9_5wt0/9cdb454fa7be137118b35b8968a45585f12270d75eb0a489b012ee06faae8be5/1-0:external_12beam:env:any-beam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT-M_6yopps0jJ"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
role_urn: "beam:artifact:role:staging_to:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
role_payload:
"\nlbeam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT-M_6yopps0jJEwfIY80Ghh-hoTQuq0gCY0_cfQWHOD4Q.jar"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 }
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24,
2024 12:42:11 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService
close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO: 2
Beam Fn Logging clients still connected during shutdown.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24,
2024 12:42:11 AM
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver
onCompleted
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Hanged up for unknown endpoint.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Jan 24,
2024 12:42:11 AM
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 INFO:
Closing Docker container
7c14ca6688ad875f11676029c715b099003c16f198dd1b578ed654c8107d806d. Logs:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
2024/01/24 00:42:05 Provision info:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1"
value:{bool_value:false}}
fields:{key:"beam:option:allow_non_restored_state:v1" value:{bool_value:false}}
fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:false}}
fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}}
fields:{key:"beam:option:attached_mode:v1" value:{bool_value:true}}
fields:{key:"beam:option:auto_balance_write_files_sharding_enabled:v1"
value:{bool_value:false}} fields:{key:"beam:option:auto_unique_labels:v1"
value:{bool_value:false}} fields:{key:"beam:option:beam_services:v1"
value:{struct_value:{}}} fields:{key:"beam:option:block_on_run:v1"
value:{bool_value:true}} fields:{key:"beam:option:dataflow_endpoint:v1"
value:{string_value:"https://dataflow.googleapis.com"}}
fields:{key:"beam:option:direct_embed_docker_python:v1"
value:{bool_value:false}} fields:{key:"beam:option:direct_num_workers:v1"
value:{string_value:"1"}}
fields:{key:"beam:option:direct_runner_bundle_repeat:v1"
value:{string_value:"0"}}
fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"
value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1"
value:{string_value:"in_memory"}}
fields:{key:"beam:option:direct_test_splits:v1" value:{struct_value:{}}}
fields:{key:"beam:option:disable_metrics:v1" value:{bool_value:false}}
fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_artifact_caching:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_bundling:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_heap_dumps:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}}
fields:{key:"beam:option:enable_stable_input_drain:v1"
value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1"
value:{bool_value:false}} fields:{key:"beam:option:enforce_encodability:v1"
value:{bool_value:true}} fields:{key:"beam:option:enforce_immutability:v1"
value:{bool_value:true}} fields:{key:"beam:option:environment_cache_millis:v1"
value:{string_value:"0"}} fields:{key:"beam:option:environment_type:v1"
value:{string_value:"LOOPBACK"}} fields:{key:"beam:option:expansion_port:v1"
value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:externalized_checkpoints_enabled:v1"
value:{bool_value:false}}
fields:{key:"beam:option:fail_on_checkpointing_errors:v1"
value:{bool_value:true}} fields:{key:"beam:option:faster_copy:v1"
value:{bool_value:false}}
fields:{key:"beam:option:finish_bundle_before_checkpointing:v1"
value:{bool_value:false}} fields:{key:"beam:option:flink_conf_dir:v1"
value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:flink_job_server_jar:v1"
value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.54.0-SNAPSHOT.jar"}}>
fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}}
fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:false}}
fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.16"}}
fields:{key:"beam:option:gcp_oauth_scopes:v1"
value:{list_value:{values:{string_value:"https://www.googleapis.com/auth/bigquery"}
values:{string_value:"https://www.googleapis.com/auth/cloud-platform"}
values:{string_value:"https://www.googleapis.com/auth/devstorage.full_control"}
values:{string_value:"https://www.googleapis.com/auth/userinfo.email"}
values:{string_value:"https://www.googleapis.com/auth/datastore"}
values:{string_value:"https://www.googleapis.com/auth/spanner.admin"}
values:{string_value:"https://www.googleapis.com/auth/spanner.data"}}}}
fields:{key:"beam:option:gcs_performance_metrics:v1" value:{bool_value:false}}
fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}}
fields:{key:"beam:option:job_name:v1"
value:{string_value:"BeamApp-jenkins-0124004158-75a26fd0"}}
fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}}
fields:{key:"beam:option:job_server_java_launcher:v1"
value:{string_value:"java"}}
fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}}
fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}}
fields:{key:"beam:option:load_balance_bundles:v1" value:{bool_value:false}}
fields:{key:"beam:option:log_mdc:v1" value:{bool_value:true}}
fields:{key:"beam:option:max_cache_memory_usage_mb:v1"
value:{string_value:"100"}} fields:{key:"beam:option:max_parallelism:v1"
value:{string_value:"-1"}} fields:{key:"beam:option:no_auth:v1"
value:{bool_value:false}} fields:{key:"beam:option:object_reuse:v1"
value:{bool_value:false}} fields:{key:"beam:option:operator_chaining:v1"
value:{bool_value:true}} fields:{key:"beam:option:options_id:v1"
value:{number_value:2}} fields:{key:"beam:option:output_executable_path:v1"
value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1"
value:{string_value:"-1"}}
fields:{key:"beam:option:performance_runtime_type_check:v1"
value:{bool_value:false}} fields:{key:"beam:option:pickle_library:v1"
value:{string_value:"default"}}
fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}}
fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}}
fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}}
fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}}
fields:{key:"beam:option:project:v1"
value:{string_value:"apache-beam-testing"}}
fields:{key:"beam:option:re_iterable_group_by_key_result:v1"
value:{bool_value:false}}
fields:{key:"beam:option:requirements_cache_only_sources:v1"
value:{bool_value:false}} fields:{key:"beam:option:resource_hints:v1"
value:{list_value:{}}} fields:{key:"beam:option:retain_docker_containers:v1"
value:{bool_value:false}}
fields:{key:"beam:option:retain_externalized_checkpoints_on_cancellation:v1"
value:{bool_value:false}} fields:{key:"beam:option:runner:v1"
value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:runner_determined_sharding:v1"
value:{bool_value:true}} fields:{key:"beam:option:runtime_type_check:v1"
value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1"
value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1"
value:{bool_value:false}}
fields:{key:"beam:option:sdk_harness_log_level_overrides:v1"
value:{struct_value:{fields:{key:"org.apache.beam.runners.flink.FlinkPipelineRunner"
value:{string_value:"WARN"}} fields:{key:"org.apache.flink.runtime"
value:{string_value:"WARN"}}
fields:{key:"org.apache.flink.runtime.metrics.groups"
value:{string_value:"ERROR"}}}}} fields:{key:"beam:option:sdk_location:v1"
value:{string_value:"container"}}
fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}}
fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}}
fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}}
fields:{key:"beam:option:spark_version:v1" value:{string_value:"3"}}
fields:{key:"beam:option:streaming:v1" value:{bool_value:false}}
fields:{key:"beam:option:temp_location:v1"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-it"}}
fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}}
fields:{key:"beam:option:type_check_strictness:v1"
value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1"
value:{bool_value:false}}
fields:{key:"beam:option:use_data_stream_for_batch:v1"
value:{bool_value:false}}
fields:{key:"beam:option:use_storage_api_connection_pool:v1"
value:{bool_value:false}} fields:{key:"beam:option:use_storage_write_api:v1"
value:{bool_value:false}}
fields:{key:"beam:option:use_storage_write_api_at_least_once:v1"
value:{bool_value:false}} fields:{key:"beam:option:use_transform_service:v1"
value:{bool_value:false}} fields:{key:"beam:option:verify_row_values:v1"
value:{bool_value:false}}} logging_endpoint:{url:"localhost:36491"}
artifact_endpoint:{url:"localhost:40661"}
control_endpoint:{url:"localhost:36887"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\xce\x01/tmp/beam-tempz5_enx_b/artifactsov9_5wt0/9cdb454fa7be137118b35b8968a45585f12270d75eb0a489b012ee06faae8be5/1-0:external_12beam:env:any-beam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT-M_6yopps0jJ"
role_urn:"beam:artifact:role:staging_to:v1"
role_payload:"\nlbeam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT-M_6yopps0jJEwfIY80Ghh-hoTQuq0gCY0_cfQWHOD4Q.jar"}
runner_capabilities:"beam:protocol:control_response_elements_embedding:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
2024/01/24 00:42:06 Downloaded:
/tmp/1-2/staged/beam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT-M_6yopps0jJEwfIY80Ghh-hoTQuq0gCY0_cfQWHOD4Q.jar
(sha256: 33feb2a29a6cd23244c1f218f341a187e8684d0baad20098d3f71f4161ce0f84,
size: 78791353)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SLF4J:
Class path contains multiple SLF4J bindings.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SLF4J:
Found binding in
[jar:file:/opt/apache/beam/jars/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SLF4J:
Found binding in
[jar:file:/tmp/1-2/staged/beam-sdks-java-io-debezium-expansion-service-2.54.0-SNAPSHOT-M_6yopps0jJEwfIY80Ghh-hoTQuq0gCY0_cfQWHOD4Q.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SLF4J:
See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SLF4J:
Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 SDK Fn
Harness started
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Harness
ID 1-2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Logging
location url: "localhost:36491"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Control
location url: "localhost:36887"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Status
location null
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Pipeline
Options File pipeline_options.json
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Pipeline
Options File pipeline_options.json exists. Overriding existing options.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:213 Pipeline
options
{"beam:option:allow_non_deterministic_key_coders:v1":false,"beam:option:allow_non_restored_state:v1":false,"beam:option:allow_unsafe_triggers:v1":false,"beam:option:app_name:v1":null,"beam:option:artifact_port:v1":"0","beam:option:attached_mode:v1":true,"beam:option:auto_balance_write_files_sharding_enabled:v1":false,"beam:option:auto_unique_labels:v1":false,"beam:option:beam_services:v1":{},"beam:option:block_on_run:v1":true,"beam:option:dataflow_endpoint:v1":"https://dataflow.googleapis.com","beam:option:direct_embed_docker_python:v1":false,"beam:option:direct_num_workers:v1":"1","beam:option:direct_runner_bundle_repeat:v1":"0","beam:option:direct_runner_use_stacked_bundle:v1":true,"beam:option:direct_running_mode:v1":"in_memory","beam:option:direct_test_splits:v1":{},"beam:option:disable_metrics:v1":false,"beam:option:dry_run:v1":false,"beam:option:enable_artifact_caching:v1":false,"beam:option:enable_bundling:v1":false,"beam:option:enable_heap_dumps:v1":false,"beam:option:enable_hot_key_logging:v1":false,"beam:option:enable_stable_input_drain:v1":false,"beam:option:enable_streaming_engine:v1":false,"beam:option:enforce_encodability:v1":true,"beam:option:enforce_immutability:v1":true,"beam:option:environment_cache_millis:v1":"0","beam:option:environment_type:v1":"LOOPBACK","beam:option:expansion_port:v1":"0","beam:option:experiments:v1":["beam_fn_api"],"beam:option:externalized_checkpoints_enabled:v1":false,"beam:option:fail_on_checkpointing_errors:v1":true,"beam:option:faster_copy:v1":false,"beam:option:finish_bundle_before_checkpointing:v1":false,"beam:option:flink_conf_dir:v1":null,"beam:option:flink_job_server_jar:v1":";<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.54.0-SNAPSHOT.jar","beam>:option:flink_master:v1":"[auto]","beam:option:flink_submit_uber_jar:v1":false,"beam:option:flink_version:v1":"1.16","beam:option:gcp_oauth_scopes:v1":["https://www.googleapis.com/auth/bigquery","https://www.googleapis.com/auth/cloud-platform","https://www.googleapis.com/auth/devstorage.full_control","https://www.googleapis.com/auth/userinfo.email","https://www.googleapis.com/auth/datastore","https://www.googleapis.com/auth/spanner.admin","https://www.googleapis.com/auth/spanner.data"],"beam:option:gcs_performance_metrics:v1":false,"beam:option:hdfs_full_urls:v1":false,"beam:option:job_name:v1":"BeamApp-jenkins-0124004158-75a26fd0","beam:option:job_port:v1":"0","beam:option:job_server_java_launcher:v1":"java","beam:option:job_server_jvm_properties:v1":[],"beam:option:job_server_timeout:v1":"60","beam:option:load_balance_bundles:v1":false,"beam:option:log_mdc:v1":true,"beam:option:max_cache_memory_usage_mb:v1":"100","beam:option:max_parallelism:v1":"-1","beam:option:no_auth:v1":false,"beam:option:object_reuse:v1":false,"beam:option:operator_chaining:v1":true,"beam:option:options_id:v1":2,"beam:option:output_executable_path:v1":null,"beam:option:parallelism:v1":"-1","beam:option:performance_runtime_type_check:v1":false,"beam:option:pickle_library:v1":"default","beam:option:pipeline_type_check:v1":true,"beam:option:profile_cpu:v1":false,"beam:option:profile_memory:v1":false,"beam:option:profile_sample_rate:v1":1,"beam:option:project:v1":"apache-beam-testing","beam:option:re_iterable_group_by_key_result:v1":false,"beam:option:requirements_cache_only_sources:v1":false,"beam:option:resource_hints:v1":[],"beam:option:retain_docker_containers:v1":false,"beam:option:retain_externalized_checkpoints_on_cancellation:v1":false,"beam:option:runner:v1":null,"beam:option:runner_determined_sharding:v1":true,"beam:option:runtime_type_check:v1":false,"beam:option:s3_disable_ssl:v1":false,"beam:option:save_main_session:v1":false,"beam:option:sdk_harness_log_level_overrides:v1":{"org.apache.beam.runners.flink.FlinkPipelineRunner":"WARN","org.apache.flink.runtime":"WARN","org.apache.flink.runtime.metrics.groups":"ERROR"},"beam:option:sdk_location:v1":"container","beam:option:sdk_worker_parallelism:v1":"1","beam:option:spark_master_url:v1":"local[4]","beam:option:spark_submit_uber_jar:v1":false,"beam:option:spark_version:v1":"3","beam:option:streaming:v1":false,"beam:option:temp_location:v1":"gs://temp-storage-for-end-to-end-tests/temp-it","beam:option:type_check_additional:v1":"","beam:option:type_check_strictness:v1":"DEFAULT_TO_ANY","beam:option:update:v1":false,"beam:option:use_data_stream_for_batch:v1":false,"beam:option:use_storage_api_connection_pool:v1":false,"beam:option:use_storage_write_api:v1":false,"beam:option:use_storage_write_api_at_least_once:v1":false,"beam:option:use_transform_service:v1":false,"beam:option:verify_row_values:v1":false}
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:550
Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
apache_beam/io/external/xlang_jdbcio_it_test.py::CrossLanguageJdbcIOTest::test_xlang_jdbc_write_read_0_postgres
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/io/external/xlang_jdbcio_it_test.py>:132:
RemovedIn20Warning: Deprecated API features detected! These feature(s) are not
compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to
updating applications, ensure requirements files are pinned to
"sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all
deprecation warnings. Set environment variable
SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on
SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
self.engine.execute(
apache_beam/io/external/xlang_jdbcio_it_test.py::CrossLanguageJdbcIOTest::test_xlang_jdbc_write_read_0_postgres
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
read_grpc_client_inputs
Traceback (most recent call last):
File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 686, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 669, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 540, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 966, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:45747 {grpc_message:"Multiplexer hanging up", grpc_status:1,
created_time:"2024-01-24T00:37:47.069406675+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/io/external/xlang_jdbcio_it_test.py::CrossLanguageJdbcIOTest::test_xlang_jdbc_write_read_1_mysql
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
read_grpc_client_inputs
Traceback (most recent call last):
File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 686, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 669, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 540, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 966, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:44021 {grpc_message:"Multiplexer hanging up", grpc_status:1,
created_time:"2024-01-24T00:39:28.547541461+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/io/external/xlang_kafkaio_it_test.py::CrossLanguageKafkaIOTest::test_local_kafkaio_null_key
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
read_grpc_client_inputs
Traceback (most recent call last):
File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 686, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 669, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 540, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 966, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:38407 {created_time:"2024-01-24T00:40:14.838872697+00:00",
grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
apache_beam/io/external/xlang_kinesisio_it_test.py::CrossLanguageKinesisIOTest::test_kinesis_write
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73:
PytestUnhandledThreadExceptionWarning: Exception in thread
read_grpc_client_inputs
Traceback (most recent call last):
File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
self.run()
File "/usr/lib/python3.9/threading.py", line 910, in run
self._target(*self._args, **self._kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 686, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,>
line 669, in _read_inputs
for elements in elements_iterator:
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 540, in __next__
return self._next()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py";,>
line 966, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that
terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer
ipv6:%5B::1%5D:43439 {grpc_message:"Multiplexer hanging up", grpc_status:1,
created_time:"2024-01-24T00:41:40.719421118+00:00"}"
>
warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/pytest_postCommitIT-flink-py39.xml>
-
============ 20 passed, 7 skipped, 5 warnings in 656.76s (0:10:56) =============
> Task :sdks:python:test-suites:portable:py39:postCommitPy39
> Task :sdks:python:test-suites:dataflow:py39:postCommitIT
<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/build/gradleenv/-1734967050/bin/python3.9>:
No module named build
warning: sdist: standard file not found: should have one of README, README.rst,
README.txt, README.md
warning: check: missing required meta-data: url
warning: check: missing meta-data: either (author and author_email) or
(maintainer and maintainer_email) should be supplied
> Task :sdks:python:test-suites:dataflow:py39:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python39/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 139
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
For more on this, please refer to
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
in the Gradle documentation.
BUILD FAILED in 1h 47m 15s
222 actionable tasks: 197 executed, 21 from cache, 4 up-to-date
Publishing build scan...
https://ge.apache.org/s/du6l3cmyapltg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
