Github user ep1804 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20004#discussion_r157391102
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/DataStreamReader.scala
---
@@ -249,6 +249,8 @@ final class DataStreamReader private[sql](sparkSession:
SparkSession) extends Lo
* `com.databricks.spark.csv`.</li>
* <li>`escape` (default `\`): sets the single character used for
escaping quotes inside
* an already quoted value.</li>
+ * <li>`escapeQuoteEscaping` (default `\0`): sets the single character
used for escaping
+ * the quote-escape character.</li>
--- End diff --
About the naming, Univocity and spark uses little bit different option
namings as follows:
| univocity | spark |
| :-- | :-- |
| delimiter | sep |
| quote | quote |
| quoteEscape | escape |
| charToEscapeQuoteEscaping | escapeQuoteEscaping |
I tried to follow Spark's way by simply removing `charTo`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
