Github user advancedxy commented on the issue:
https://github.com/apache/spark/pull/20082
>Please explain in the JIRA/PR description about your use case that need to
access the stageAttemptId in the executor - we must provide a very good reason
to make such a change to a public interface.
@jiangxb1987 quoted from SPARK-22897:
>Currently, there's no easy way for Executor to detect a new stage is
launched as stageAttemptId is missing.
In one of our use case, spark task needs to reset some internal state once
the stage is changed(we don't want to reset the state for every task as there
may be a lot of tasks).
IMHO, stageAttemptId is as important as stageId or taskAttemptId and should
be provided to user.
As for compatibility, we should do our best to avoid any incompatibility in
minor releases. However,
this change should be source and binary compatible with previous releases.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
