Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15511
OK, I think in both cases "standard" JSON is read, and in both cases, each
record is a JSON document. These aren't different cases. If you mean to read
small JSON files as records, you just use wholeTextFiles, as you show. I do not
think wrapping this up with an extra flag helps enough to justify this because
callers can easily implement this. There are a hundred other variations on
this, and the reason we don't implement them all is exactly because there are
so many variations to bottle up like this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
