Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21882#discussion_r205935245
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/PartitionBatchPruningSuite.scala
---
@@ -95,6 +111,17 @@ class PartitionBatchPruningSuite
checkBatchPruning("SELECT key FROM pruningData WHERE 11 >= key", 1, 2)(1
to 11)
checkBatchPruning("SELECT key FROM pruningData WHERE 88 < key", 1, 2)(89
to 100)
checkBatchPruning("SELECT key FROM pruningData WHERE 89 <= key", 1,
2)(89 to 100)
+ // Do not filter on array type
+ checkBatchPruning("SELECT _1 FROM pruningArrayData WHERE _1 = array(1)",
5, 10)(Seq(Array(1)))
+ checkBatchPruning("SELECT _1 FROM pruningArrayData WHERE _1 <=
array(1)", 5, 10)(Seq(Array(1)))
+ checkBatchPruning("SELECT _1 FROM pruningArrayData WHERE _1 >=
array(1)", 5, 10)(
+ testArrayData.map(_._1))
+ // Do not filter on binary type
+ checkBatchPruning(
--- End diff --
Before this change, `Expected Array(Array(1)), but got Array() Wrong query
result`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
