See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/4677/display/redirect?page=changes>
Changes:
[ajamato] [BEAM-11994] Refactor BigQueryTornadoes to make more options
[zyichi] [BEAM-12221] Add experimental pipeline option to control the execution
[Kenneth Knowles] Add View.toList pipeline to translator tests
[Kenneth Knowles] Temporarily disable FnApiDoFnRunnerTest.testUsingMetrics
[Kenneth Knowles] Resolve beam_fn_api experiment for side inputs, using
portable expansion
[noreply] [BEAM-12232] Expose public factory methods in SparkJobServerDriver
[Kyle Weaver] [BEAM-12009] Enable Calc splitting rule by default.
[noreply] [BEAM-12016] Initial implementation for add_suffix, add_prefix
(#14623)
------------------------------------------
[...truncated 1.90 MB...]
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n7"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n14"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n14:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n1"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n1:0"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"PTRANSFORM": "fn/read/RDoKoHGzISExternal/ParMultiDo(Partition).out1:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out1"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n20:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n20"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out2"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"PTRANSFORM": "fn/read/RDoKoHGzISExternal/ParMultiDo(Partition).out2:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out1"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out0"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Bg==",
"labels": {
"PTRANSFORM": "fn/read/n2:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Bg==",
"labels": {
"PCOLLECTION": "n2"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "Aw==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out2"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "AwMBAQ==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out2"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "AwMBAQ==",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out1"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "AAD//////////3+AgICAgICAgIAB",
"labels": {
"PCOLLECTION": "RDoKoHGzISExternal/ParMultiDo(Partition).out0"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "BgYBAQ==",
"labels": {
"PCOLLECTION": "n2"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n16:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n16"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PCOLLECTION": "n9"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AQ==",
"labels": {
"PTRANSFORM": "fn/read/n9:0"
}
}]
}
}
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 3223d7ed27c5e349d2dcb50cc07da8ef from job leader monitoring.
Apr 28, 2021 12:25:12 AM
org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Getting job metrics for
go0job0501619569469154954258-jenkins-0428002439-d7dd0b6c_fbdf22c5-35c1-4b59-8f1d-cb5876655b7b
Apr 28, 2021 12:25:12 AM
org.apache.beam.runners.jobsubmission.InMemoryJobService getJobMetrics
INFO: Finished getting job metrics for
go0job0501619569469154954258-jenkins-0428002439-d7dd0b6c_fbdf22c5-35c1-4b59-8f1d-cb5876655b7b
Apr 28, 2021 12:25:12 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
disconnectJobManagerConnection
INFO: Close JobManager connection for job 3223d7ed27c5e349d2dcb50cc07da8ef.
Apr 28, 2021 12:25:12 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
onStop
INFO: Stopping TaskExecutor akka://flink/user/rpc/taskmanager_72.
Apr 28, 2021 12:25:12 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
closeResourceManagerConnection
INFO: Close ResourceManager connection 4b322ca864e64b24b213e27efbd29258.
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.resourcemanager.ResourceManager
closeTaskManagerConnection
INFO: Closing TaskExecutor connection 787fbb0b-320d-4ba4-a453-b4decde94063
because: The TaskExecutor is shutting down.
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-io-8fee1b60-29ca-4b38-b484-bde4b0ab6b2c
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-d5e2378b-db3f-423c-9d9e-2bed26e4e1c3
Apr 28, 2021 12:25:12 AM org.apache.flink.runtime.taskexecutor.KvStateService
shutdown
INFO: Shutting down the kvState service and its components.
Apr 28, 2021 12:25:12 AM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Apr 28, 2021 12:25:12 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory
/tmp/flink-dist-cache-8243a893-3a0e-4562-b98d-b09a82020c03
Apr 28, 2021 12:25:12 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_72.
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'>
line: 92
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 24m 50s
139 actionable tasks: 125 executed, 12 from cache, 2 up-to-date
Gradle was unable to watch the file system for changes. The inotify watches
limit is too low.
Publishing build scan...
https://gradle.com/s/kcjmmjz7znjle
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
