[
https://issues.apache.org/jira/browse/FLINK-30823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Biao Liu updated FLINK-30823:
-----------------------------
Description:
After the Sink supports speculative execution, here we enable speculative
execution for some built-in sinks. For each type of Sink (SinkV2, SinkFunction,
OutputFormat) we picked some typical sinks that do not require any or only
minor changes.
In this ticket, we would enable DiscardingSink, PrintSinkFunction, PrintSink,
FileSink, FileSystemOutputFormat to support speculative execution.
Speculative execution might not be meaningful for some of these sinks, like
DiscardingSink, PrintSinkFunction and PrintSink. However, when these sinks are
chained with other operators, the chained task could not support speculative
execution if there is any operator in chain does not support speculative
execution. That's the main idea behind this.
FileSink and FileSystemOutputFormat are the most typical implementation for
SinkV2 and OutputFormat. We would not enable speculative execution for the
StreamingFileSink, because it's marked as deprecated.
was:After the Sink supports speculative execution, here we enable speculative
execution for some built-in sinks. For each type of Sink (SinkV2, SinkFunction,
OutputFormat) we picked some typical sinks that do not require any or only
minor changes.
> Enable speculative execution for some of the typical built-in sinks
> -------------------------------------------------------------------
>
> Key: FLINK-30823
> URL: https://issues.apache.org/jira/browse/FLINK-30823
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Reporter: Biao Liu
> Assignee: Biao Liu
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.17.0
>
>
> After the Sink supports speculative execution, here we enable speculative
> execution for some built-in sinks. For each type of Sink (SinkV2,
> SinkFunction, OutputFormat) we picked some typical sinks that do not require
> any or only minor changes.
> In this ticket, we would enable DiscardingSink, PrintSinkFunction, PrintSink,
> FileSink, FileSystemOutputFormat to support speculative execution.
> Speculative execution might not be meaningful for some of these sinks, like
> DiscardingSink, PrintSinkFunction and PrintSink. However, when these sinks
> are chained with other operators, the chained task could not support
> speculative execution if there is any operator in chain does not support
> speculative execution. That's the main idea behind this.
> FileSink and FileSystemOutputFormat are the most typical implementation for
> SinkV2 and OutputFormat. We would not enable speculative execution for the
> StreamingFileSink, because it's marked as deprecated.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
