Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20727#discussion_r172015316
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -400,6 +400,10 @@ final class DataStreamReader
private[sql](sparkSession: SparkSession) extends Lo
* <ul>
* <li>`maxFilesPerTrigger` (default: no max limit): sets the maximum
number of new files to be
* considered in every trigger.</li>
+ * <li>`wholetext` (default `false`): If true, read a file as a single
row and not split by "\n".
--- End diff --
I also added some changes missed for `wholetext` too while I am here.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
