Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/19388
I agree with @vanzin - this looks very complicated for a enforcing a fairly
simple constraint.
It would be easier to depend on a AtomicInteger in driver for the id - and
propagate that to executors via Configuration (so that driver and executors use
the same id).
Will that not be simpler @rezasafi ?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
