Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/18004
Sorry, forgot one comment.
> With what you propose, the implementation will be much more complex and I
think that it is not valuable yet while there is no concrete need of this
mechanism.
Yes, the implementation might become a little more complex (I disagree with
"much more"), but as I've tried to say multiple times, there are concrete needs
and it's a much better solution to the more general problem.
It also happens to make the code more unit testable by isolating that
behavior in a separate class.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
