tweise commented on issue #6567: [FLINK-10074] Allowable number of checkpoint 
failures
URL: https://github.com/apache/flink/pull/6567#issuecomment-421971822
 
 
   @yanghua @tillrohrmann I think a user would normally expect this count to 
apply globally, but please also consider the case of an intermittent failure 
(like S3 rate limit or storage backend unavailable for other reason). In a 
large job that would cause potentially many subtasks to fail in parallel. While 
this could be addressed by setting a corresponding very high threshold, it 
would in turn mean a problem that is isolated to a single task would not hit 
the threshold until much much later, leaving the job in flipflop status instead 
of failing. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to