Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22453#discussion_r219719299
--- Diff: docs/sql-programming-guide.md ---
@@ -1002,6 +1002,15 @@ Configuration of Parquet can be done using the
`setConf` method on `SparkSession
</p>
</td>
</tr>
+<tr>
+ <td><code>spark.sql.parquet.writeLegacyFormat</code></td>
--- End diff --
This is, of course, something we should remove in long term but my
impression is that it's better to expose and explicitly mention we deprecate
this later, and the remove it out.
I already argued a bit (for instance in SPARK-20297) to explain how to
workaround and why it is. Was thinking it's better document this and reduce
such overhead at least.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
