Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20894#discussion_r178577209
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ---
@@ -524,6 +524,8 @@ class DataFrameReader private[sql](sparkSession:
SparkSession) extends Logging {
* <li>`comment` (default empty string): sets a single character used
for skipping lines
* beginning with this character. By default, it is disabled.</li>
* <li>`header` (default `false`): uses the first line as names of
columns.</li>
+ * <li>`enforceSchema` (default `true`): Forcibly apply the specified or
inferred schema to
+ * datasource files. If it is set, CSV headers are ignored. </li>
--- End diff --
Also need to explain the behavior when it is set to false.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]