Github user HyukjinKwon commented on a diff in the pull request:
    --- Diff: 
    @@ -39,9 +39,12 @@ private[text] class TextOptions(@transient private val 
parameters: CaseInsensiti
       val wholeText = parameters.getOrElse(WHOLETEXT, "false").toBoolean
    +  val lineSeparator: String = parameters.getOrElse(LINE_SEPARATOR, "\n")
    +  require(lineSeparator.nonEmpty, s"'$LINE_SEPARATOR' cannot be an empty 
     private[text] object TextOptions {
       val COMPRESSION = "compression"
       val WHOLETEXT = "wholetext"
    +  val LINE_SEPARATOR = "lineSep"
    --- End diff --
    To be clear, the name "lineSep" is taken after Python, R's `sep` and our 
supporting option `sep`. Here was another discussion -
    "line" is taken after Univocity CSV parser and seems making sense in Hadoop 
too. I think we documented JSON is in lines, and I think it makes sense to CSV 
and text.


To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to