Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21656
In this case one of the older stage attempts (that is a zombie) marked the
task as successful but then the newest stage attempt checked to see if it
needed to speculate. Is that correct?
Ideally I think for speculation we want to look at the task time for all
stage attempts. But that is probably a bigger change then this. If we aren't
doing that then I think ignoring it for speculation is ok. Otherwise how hard
is it to send the actual task info into here so it could use the real time the
successful task took?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
