Github user squito commented on the issue:
https://github.com/apache/spark/pull/21656
> Ideally I think for speculation we want to look at the task time for all
stage attempts. But that is probably a bigger change then this
yeah I agree, on both points. One thing which is a little tricky is that
you probably want to make sure you're only counting times from different
partitions -- you might times from the same partition from multiple attempts,
but that shouldn't count. (or maybe we don't really care that much as its just
a heuristic anyway ...)
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
