Hi Vishwas, I guess this link [1] can help understand how it works and how to use in practice for StreamingFileSink.
[1] https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/connectors/streamfile_sink.html Best, Zhijiang ------------------------------------------------------------------ From:Vishwas Siravara <[email protected]> Send Time:2020 Feb. 12 (Wed.) 05:19 To:Khachatryan Roman <[email protected]> Cc:user <[email protected]> Subject:Re: Exactly once semantics for hdfs sink Hi Khachatryan, Thanks for your reply. Can you help me understand how it works with hdfs specifically , even a link to a document will help. Best, Vishwas On Mon, Feb 10, 2020 at 10:32 AM Khachatryan Roman <[email protected]> wrote: Hi Vishwas, Yes, Streaming File Sink does support exactly-once semantics and can be used with HDFS. Regards, Roman On Mon, Feb 10, 2020 at 5:20 PM Vishwas Siravara <[email protected]> wrote: Hi all, I want to use the StreamingFile sink for writing data to hdfs. Can I achieve exactly once semantics with this sink ? Best, HW.
