Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/20888
I mean on my machine the stage ID is zero for long long time here:
```
DataFrameRangeSuite.stageToKill = TaskContext.get().stageId()
```
and after 200 seconds the other thread still stands on this (increased the
timeout to play):
```
eventually(timeout(300.seconds), interval(1.millis)) {
assert(DataFrameRangeSuite.stageToKill !=
DataFrameRangeSuite.INVALID_STAGE_ID)
}
```
and `cancelStage` never called. Based on that the first non-invalid stage
ID on my machine is 0. The actual code miss that edge case.
When I start the whole suite then other tests are pre-initializing
something and the ID is not 0 anymore.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
