wenlong88 commented on issue #6684: [FLINK-10205] Batch Job: InputSplit Fault tolerant for DataSource… URL: https://github.com/apache/flink/pull/6684#issuecomment-430524769 @tillrohrmann I think in most cases, it is ok the split on failed task taken over by other tasks and it is more friendly for failover. But for some special cases, it is not ok, because the assigner can be customized, all of the assignment of input split should comes from the assigner implemented. eg: when the assigner implemented to make sure each task processes the same number of input splits, we should not allow the input splits of failed task taken over by other task. Maybe it is better to add a new interface for assigner to do fine grained failover ?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
