Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21123#discussion_r204264532
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -1191,6 +1191,20 @@ object SQLConf {
.timeConf(TimeUnit.MILLISECONDS)
.createWithDefault(100)
+ val DISABLED_V2_FILE_DATA_SOURCE_READERS =
buildConf("spark.sql.disabledV2FileDataSourceReaders")
--- End diff --
Hm.... are we going to leave this out for 2.4, and target to completely
migrate in 3.0? Do you guys also plan to migrate them within 2.4? Looks
there's not much gain by doing this change alone when the release is being
close.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
