mridulm edited a comment on pull request #30650:
URL: https://github.com/apache/spark/pull/30650#issuecomment-773512448
> Before this PR, we always recommend users disable delay scheduling by
setting delay to 0 as a workaround in the error message.
That will set it for all stages ... I was asking if we want to do it
specifically only for barrier stages in code directly : when in legacy mode ?
Something like -
```
private def getLocalityWait(level: TaskLocality.TaskLocality): Long = {
if (legacyLocalityWaitReset && isBarrier) return 0
```
(With an explicit comment on why we are doing this ofcourse !)
Thoughts @Ngone51, @tgravescs ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
