Github user habren commented on a diff in the pull request:
https://github.com/apache/spark/pull/21868#discussion_r210887308
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -459,6 +460,29 @@ object SQLConf {
.intConf
.createWithDefault(4096)
+ val IS_PARQUET_PARTITION_ADAPTIVE_ENABLED =
buildConf("spark.sql.parquet.adaptiveFileSplit")
+ .doc("For columnar file format (e.g., Parquet), it's possible that
only few (not all) " +
--- End diff --
I updated it accordingly
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
