Github user aarondav commented on the pull request:
https://github.com/apache/spark/pull/1293#issuecomment-47959115
data.count() is actually a very expensive operation, as it has to scan all
the data. If cached, it may not be as much a problem, but it is still probably
not worth it for this check. Which part throws the exception?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
