Re: DataFrameWriter - Where to find list of Options applicable to particular format(datasource)

Thanks Kwon. Goal is to preserve whitespace. Not to alter data in general or do it with user provided options. It's causing our downstream jobs to fail. On Mon, Mar 13, 2017 at 7:23 PM, Hyukjin Kwon wrote: > Hi, all the options are documented in https://spark.apache.org/ >

Re: DataFrameWriter - Where to find list of Options applicable to particular format(datasource)

Hi, all the options are documented in https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.DataFrameWriter It seems we don't have both options for writing. If the goal is trimming the whitespaces, I think we could do this within dataframe operations (as we talked in the

DataFrameWriter - Where to find list of Options applicable to particular format(datasource)

Hi, Is there a document for each datasource (csv, tsv, parquet, json, avro) with available options ? I need to find one for csv to "ignoreLeadingWhiteSpace" and "ignoreTrailingWhiteSpace" Thanks -- [image: What's New with Xactly]