Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/15354
I understand it might be good to mention (and I have thought for a while)
but I feel a bit hesitant because we could express json strings in dataframe
are stored without newline separators in a way (I am not nitpicking).
The function itself produces each json string which can be the standard
json and held in memory. This might not be applied to the standard (it says
"text file format"..).
I am actually rather neutral. We could also mention that too just to simply
say it is in-line. I am going to submit another PR to deal with the schema
verification for other JSON functionalities and if we should mention this, we
should do it for other JSON functionalities (such as `Dataset.toJSON`). Maybe
we could talk about this further if it sounds okay.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
