Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20877#discussion_r176945815
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -268,6 +268,8 @@ final class DataStreamReader private[sql](sparkSession:
SparkSession) extends Lo
* `java.text.SimpleDateFormat`. This applies to timestamp type.</li>
* <li>`multiLine` (default `false`): parse one record, which may span
multiple lines,
* per file</li>
+ * <li>`lineSep` (default covers all `\r`, `\r\n` and `\n`): defines the
line separator
--- End diff --
Add a test case for testing the default covers `\r`, `\r\n` and `\n`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]