Github user MLnick commented on the issue:
https://github.com/apache/spark/pull/14579
After looking at it and considering all the above, I would say the options
are (1) do nothing; or (2) if we want to support this use case, then we
implement a single utility method (I would say called `persisted`) that is a
context manager.
Even though we could _almost_ achieve things with subclassing, we do sort
of break something and add too much risk/complexity vs reward of the feature
IMHO.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
