See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6546/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/storage from 1.25.0 to 1.26.0 in /sdks
(#22954)
[noreply] [BEAM-22859] Allow the specification of extra packages for external
[noreply] [Tour of Beam]: Welcome Screen frontend layout (#22794)
[noreply] Remove redundant testEventTimeTimerSetWithinAllowedLateness sickbay
[noreply] Adding support for Beam Schema Rows with BQ DIRECT_READ (#22926)
[noreply] Add java Bigquery IO known issue to beam 2.40 release blogpost
(#22611)
[noreply] Update playground_deploy_examples.yml
[noreply] Add run-inference component for autolabeling (#22971)
------------------------------------------
[...truncated 2.52 MB...]
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/02 20:53:24 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn
Logging clients still connected during shutdown.
22/09/02 20:53:24 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer:
Hanged up for unknown endpoint.
22/09/02 20:53:24 INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment:
Closing Docker container
682a1a0b8416e37c8034e0bd8a6cf27c97d1d4ecb63c1419b68e02051f1d5ee3. Logs:
2022/09/02 20:53:24 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-testemitpardoaftergbk-684"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}}
fields:{key:"endpoint" value:{string_value:"localhost:55375"}}
fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}}
fields:{key:"environment_type" value:{string_value:"DOCKER"}}
fields:{key:"expansion_jar"
value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}>
fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}}
fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}}
fields:{key:"project" value:{string_value:"apache-beam-testing"}}
fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner"
value:{string_value:"spark"}} fields:{key:"staging_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test23689"}}
fields:{key:"temp_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test23689"}}
fields:{key:"test.paniconexit0" value:{string_value:"true"}}
fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v"
value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1"
value:{string_value:"go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba"}}
fields:{key:"beam:option:options_id:v1" value:{number_value:39}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}}
fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}}
logging_endpoint:{url:"localhost:43981"}
artifact_endpoint:{url:"localhost:41447"}
control_endpoint:{url:"localhost:36903"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\x83\x01/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/02 20:53:24 Initializing Go harness: /opt/apache/beam/boot --id=268-1
--provision_endpoint=localhost:38983
2022/09/02 20:53:24 Downloaded: /tmp/staged/1-worker-13-1662151999670798319
(sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887,
size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/02 20:53:24 control response channel closed
22/09/02 20:53:25 WARN
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to
retrieve the requested metadata.
22/09/02 20:53:25 WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull
docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command
'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon:
manifest for apache/beam_go_sdk:dev not found
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging
client connected.
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 269-1
22/09/02 20:53:26 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:33683 for control ...
22/09/02 20:53:26 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:45629 for logging ...
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 269-2
22/09/02 20:53:26 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:34361 for data ...
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client
connected.
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn
Logging clients still connected during shutdown.
22/09/02 20:53:26 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer:
Hanged up for unknown endpoint.
22/09/02 20:53:26 INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment:
Closing Docker container
4c10ed7e2c031ef0a5310c3a2547cf9d84edf46899626466007f016e75fcd142. Logs:
2022/09/02 20:53:25 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-testemitpardoaftergbk-684"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}}
fields:{key:"endpoint" value:{string_value:"localhost:55375"}}
fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}}
fields:{key:"environment_type" value:{string_value:"DOCKER"}}
fields:{key:"expansion_jar"
value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}>
fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}}
fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}}
fields:{key:"project" value:{string_value:"apache-beam-testing"}}
fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner"
value:{string_value:"spark"}} fields:{key:"staging_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test23689"}}
fields:{key:"temp_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test23689"}}
fields:{key:"test.paniconexit0" value:{string_value:"true"}}
fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v"
value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1"
value:{string_value:"go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba"}}
fields:{key:"beam:option:options_id:v1" value:{number_value:39}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}}
fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}}
logging_endpoint:{url:"localhost:45629"}
artifact_endpoint:{url:"localhost:35405"}
control_endpoint:{url:"localhost:33683"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\x83\x01/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/02 20:53:25 Initializing Go harness: /opt/apache/beam/boot --id=269-1
--provision_endpoint=localhost:35701
2022/09/02 20:53:26 Downloaded: /tmp/staged/1-worker-13-1662151999670798319
(sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887,
size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/02 20:53:26 control response channel closed
22/09/02 20:53:26 WARN
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to
retrieve the requested metadata.
22/09/02 20:53:27 WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull
docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command
'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon:
manifest for apache/beam_go_sdk:dev not found
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 270-1
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging
client connected.
22/09/02 20:53:27 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:45309 for control ...
22/09/02 20:53:27 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:36129 for logging ...
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 270-2
22/09/02 20:53:27 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:45533 for data ...
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client
connected.
22/09/02 20:53:27 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:34617 for state ...
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn
Logging clients still connected during shutdown.
22/09/02 20:53:27 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer:
Hanged up for unknown endpoint.
22/09/02 20:53:27 INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment:
Closing Docker container
ed2b0e8439b7d0bfed588e8a0e35e702d41680c919ef3e384f1aa5039c38d176. Logs:
2022/09/02 20:53:27 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-testemitpardoaftergbk-684"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}}
fields:{key:"endpoint" value:{string_value:"localhost:55375"}}
fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}}
fields:{key:"environment_type" value:{string_value:"DOCKER"}}
fields:{key:"expansion_jar"
value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}>
fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}}
fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}}
fields:{key:"project" value:{string_value:"apache-beam-testing"}}
fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner"
value:{string_value:"spark"}} fields:{key:"staging_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test23689"}}
fields:{key:"temp_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test23689"}}
fields:{key:"test.paniconexit0" value:{string_value:"true"}}
fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v"
value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1"
value:{string_value:"go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba"}}
fields:{key:"beam:option:options_id:v1" value:{number_value:39}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}}
fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}}
logging_endpoint:{url:"localhost:36129"}
artifact_endpoint:{url:"localhost:35039"}
control_endpoint:{url:"localhost:45309"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\x83\x01/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/02 20:53:27 Initializing Go harness: /opt/apache/beam/boot --id=270-1
--provision_endpoint=localhost:36569
2022/09/02 20:53:27 Downloaded: /tmp/staged/1-worker-13-1662151999670798319
(sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887,
size: 26517776)
Error Setting Rlimit operation not permitted
2022/09/02 20:53:27 control response channel closed
Worker exited successfully!
22/09/02 20:53:28 WARN
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to
retrieve the requested metadata.
22/09/02 20:53:28 WARN
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to
retrieve the requested metadata.
22/09/02 20:53:28 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba_0ce26b87-17a7-42dd-90eb-42e44d08c3bb:
Pipeline translated successfully. Computing outputs
22/09/02 20:53:28 WARN
software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to
retrieve the requested metadata.
22/09/02 20:53:28 WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull
docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command
'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon:
manifest for apache/beam_go_sdk:dev not found
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging
client connected.
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 271-1
22/09/02 20:53:29 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:46565 for control ...
22/09/02 20:53:29 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:45919 for logging ...
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 271-2
22/09/02 20:53:29 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:38031 for data ...
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client
connected.
22/09/02 20:53:29 INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677:
Connecting via grpc @ localhost:46593 for state ...
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\203\001/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn
Logging clients still connected during shutdown.
22/09/02 20:53:29 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer:
Hanged up for unknown endpoint.
22/09/02 20:53:29 INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment:
Closing Docker container
3c5c0236d75fd99823eb26f4bdf107477cfc01c0417926bd5bc2a627a9b641db. Logs:
2022/09/02 20:53:29 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-testemitpardoaftergbk-684"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}}
fields:{key:"endpoint" value:{string_value:"localhost:55375"}}
fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}}
fields:{key:"environment_type" value:{string_value:"DOCKER"}}
fields:{key:"expansion_jar"
value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}>
fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}}
fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}}
fields:{key:"project" value:{string_value:"apache-beam-testing"}}
fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner"
value:{string_value:"spark"}} fields:{key:"staging_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test23689"}}
fields:{key:"temp_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test23689"}}
fields:{key:"test.paniconexit0" value:{string_value:"true"}}
fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v"
value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1"
value:{string_value:"go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba"}}
fields:{key:"beam:option:options_id:v1" value:{number_value:39}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}}
fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}}
fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}}
logging_endpoint:{url:"localhost:45919"}
artifact_endpoint:{url:"localhost:42957"}
control_endpoint:{url:"localhost:46565"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\x83\x01/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/1-go-/tmp/worker-13-1662151999670798319"
role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/02 20:53:29 Initializing Go harness: /opt/apache/beam/boot --id=271-1
--provision_endpoint=localhost:39661
2022/09/02 20:53:29 Downloaded: /tmp/staged/1-worker-13-1662151999670798319
(sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887,
size: 26517776)
Error Setting Rlimit operation not permitted
2022/09/02 20:53:29 control response channel closed
Worker exited successfully!
22/09/02 20:53:30 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba_0ce26b87-17a7-42dd-90eb-42e44d08c3bb
finished.
22/09/02 20:53:30 WARN
org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job
staging directory for token
go-testemitpardoaftergbk-684_487cd392-9bbd-43f4-a225-2d87ecf04f4b.
java.io.FileNotFoundException: No files found for spec:
/tmp/beam-artifact-staging/ce2d82a7558687c23ef5c2c9fa2059b2cce703d13673a49825f8ab59481e61d9/*
in working directory
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at
org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at
org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at
org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at
org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at
org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at
org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at
org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at
org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at
org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022/09/02 20:53:30 Job state: DONE
22/09/02 20:53:30 INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics
for
go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba_0ce26b87-17a7-42dd-90eb-42e44d08c3bb
22/09/02 20:53:30 INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job
metrics for
go0testemitpardoaftergbk0684-jenkins-0902205321-ce387fba_0ce26b87-17a7-42dd-90eb-42e44d08c3bb
--- PASS: TestEmitParDoAfterGBK (10.38s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 122.475s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'>
line: 121
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 14m 2s
114 actionable tasks: 76 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/pkp73kfqirxka
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
