Thank you, Paul. The answer is so clear and helpful. But I'm still wondering what is the purpose of the sink.partition-commit.success-file.name <https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/table/filesystem/#sink-partition-commit-success-file-name> option if the sink files must be named in that specific way.
On Fri, Nov 5, 2021 at 3:23 PM Fabian Paul <fabianp...@ververica.com> wrote: > Hi, > > Currently this is expected because the FileSink is built to support > running with higher parallelism. Therefore it needs to periodically write > files. The > respective file names always have a descriptor that the File Sink knows > which files have already been written. You can read more about the FileSink > here [1]. > > Best, > Fabian > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/docs/connectors/datastream/file_sink/ -- ------------------------------------------------------------ -------------------------------------------------- Nguyen Dich Long, School of Information and Communication Technology (SoICT - https://www.soict.hust.edu.vn) Hanoi University of Science and Technology (https://www.hust.edu.vn) 601, B1 Building - No 1, Dai Co Viet Street, Hai Ba Trung District, Ha Noi, Vietnam Tel: +84 (0)3.54.41.76.76 Email: long.nd162...@sis.hust.edu.vn; longnguyen25111...@gmail.com
