Github user liyinan926 commented on the issue:
https://github.com/apache/spark/pull/19954
@vanzin @mccheah @foxish Variables names have been shortened in
https://github.com/apache/spark/pull/19954/commits/d50c61e46c43049b9ede615ffabd89a55c4adb0c,
and traits with only a single implementation have been removed in
https://github.com/apache/spark/pull/19954/commits/5b82fc06a5fff2a3ff2062c46a21d069640eeec7.
Regarding the documentation of the concepts around steps and orchestrators and
how they fit together, I would suggest that we have a separate PR for the
architecture docs. I also think we can refactor the orchestrator logic in a
future PR to also cover executor pods so we use the same mechanism for both the
driver and executor pods. WDYT?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
