warrenzhu25 commented on PR #38441: URL: https://github.com/apache/spark/pull/38441#issuecomment-1297651992
> If the original contribution [SPARK-40481](https://issues.apache.org/jira/browse/SPARK-40481) is insufficient for you still, we can revert it first before pursuing this kind of big change. We need to revisit from the bottom, @warrenzhu25 . The original PR works for most cases, but some lost executors due to decommission cannot be ignored as we lost such info so I want to improve this. I understand the concern of keeping removed executor. What do you think of keeping only most recent 100 lost executors due to decommission in a separate set? @dongjoon-hyun @mridulm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
