Github user sryza commented on the pull request:
https://github.com/apache/spark/pull/4293#issuecomment-72538956
Ah, so the failing tests expose the possibility that someone could write
their own `InputFormat` that doesn't reuse a single object, and caching that
would be fine. So changing it to logWarning sounds fine to me.
It might also be worthwhile to suppress the warning for `BinaryFilesRDD`
and `WholeTextFileRDD`, though it would look fairly weird, because `persist`
would need to be overridden in these methods to call the grandparent class's
version of the method. So I can add that if y'all prefer but will leave it out
otherwise.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
