Repository: spark Updated Branches: refs/heads/master a8d2f4c5f -> c2520f501
[SPARK-9935] [SQL] EqualNotNull not processed in ORC https://issues.apache.org/jira/browse/SPARK-9935 Author: hyukjinkwon <[email protected]> Closes #8163 from HyukjinKwon/master. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2520f50 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c2520f50 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c2520f50 Branch: refs/heads/master Commit: c2520f501a200cf794bbe5dc9c385100f518d020 Parents: a8d2f4c Author: hyukjinkwon <[email protected]> Authored: Thu Aug 13 16:07:03 2015 -0700 Committer: Reynold Xin <[email protected]> Committed: Thu Aug 13 16:07:03 2015 -0700 ---------------------------------------------------------------------- .../main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala | 5 +++++ 1 file changed, 5 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/c2520f50/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala ---------------------------------------------------------------------- diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala index 86142e5..b3d9f7f 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala +++ b/sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala @@ -107,6 +107,11 @@ private[orc] object OrcFilters extends Logging { .filter(isSearchableLiteral) .map(builder.equals(attribute, _)) + case EqualNullSafe(attribute, value) => + Option(value) + .filter(isSearchableLiteral) + .map(builder.nullSafeEquals(attribute, _)) + case LessThan(attribute, value) => Option(value) .filter(isSearchableLiteral) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
