squito commented on issue #24462: [SPARK-26268][CORE] Do not resubmit tasks when executors are lost URL: https://github.com/apache/spark/pull/24462#issuecomment-520556153 The "reasonable balance" I was talking about was between extending the spark api to cover more use cases, while still keeping it supportable and maintainable, by making incremental improvements where we can. For example, I completely think that having multiple block locations is reasonable; but I'd rather not take it on right now. thanks for providing your benchmarks. Those are pretty compelling numbers ... still I'm hesitant to add a config for just this one use case right now. I'm open to hearing from others about more use cases that would benefit from this
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
