Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18581#discussion_r126606327
--- Diff: python/pyspark/sql/readwriter.py ---
@@ -234,6 +234,8 @@ def json(self, path, schema=None,
primitivesAsString=None, prefersDecimal=None,
default value,
``yyyy-MM-dd'T'HH:mm:ss.SSSXXX``.
:param multiLine: parse one record, which may span multiple lines,
per file. If None is
set, it uses the default value, ``false``.
+ :param lineSep: defines the line separator that should be used for
parsing. If None is
+ set, it uses the default value, ``\\r\\n`` or
``\\n``.
--- End diff --
It has a different value for reading and writing individually. I tried to
not change both. So, the related pointers for JSON read should be ...
https://github.com/apache/spark/pull/18581/files#diff-5ac20b8d75a20117deaa9ba4af814090R142
for data
https://github.com/apache/spark/pull/18581/files#diff-5ac20b8d75a20117deaa9ba4af814090R132
for schema inference.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
