Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20929#discussion_r190447504
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala ---
@@ -379,6 +379,8 @@ class DataFrameReader private[sql](sparkSession:
SparkSession) extends Logging {
* that should be used for parsing.</li>
* <li>`samplingRatio` (default is 1.0): defines fraction of input JSON
objects used
* for schema inferring.</li>
+ * <li>`dropFieldIfAllNull` (default `false`): whether to ignore column
of all null values or
--- End diff --
Python side too.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
