Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20851#discussion_r175276718
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala
---
@@ -148,6 +193,15 @@ private[parquet] object ParquetFilters {
case BinaryType =>
(n: String, v: Any) =>
FilterApi.gtEq(binaryColumn(n),
Binary.fromReusedByteArray(v.asInstanceOf[Array[Byte]]))
+ case DateType =>
--- End diff --
Add a new SQLConf to make it configurable. Users can turn it off if they
hit a bug introduced in this PR
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]