isunjin commented on issue #6684: [FLINK-10205] Batch Job: InputSplit Fault tolerant for DataSource… URL: https://github.com/apache/flink/pull/6684#issuecomment-430451645 @tillrohrmann i think the splits need be strictly consumed by failed job. otherwise the logic to make data consistent (make sure split be consumed exactly once) is complicated. Streaming is good at this as it internally treat split as a record, the framework will make sure every split (record) be processed exactly once.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
