This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4e60638 [SPARK-38432][SQL][FOLLOWUP] Supplement test case for overflow and add comments add 1f4e4c8 [SPARK-32268][SQL] Row-level Runtime Filtering No new revisions were added by this update. Summary of changes: .../org/apache/spark/util/sketch/BloomFilter.java | 7 + .../apache/spark/util/sketch/BloomFilterImpl.java | 5 + .../expressions/BloomFilterMightContain.scala | 113 +++++ .../aggregate/BloomFilterAggregate.scala | 179 ++++++++ .../sql/catalyst/expressions/objects/objects.scala | 2 + .../sql/catalyst/expressions/predicates.scala | 16 + .../catalyst/expressions/regexpExpressions.scala | 5 +- .../catalyst/optimizer/InjectRuntimeFilter.scala | 303 +++++++++++++ .../spark/sql/catalyst/trees/TreePatterns.scala | 3 + .../org/apache/spark/sql/internal/SQLConf.scala | 80 ++++ .../spark/sql/execution/SparkOptimizer.scala | 2 + .../dynamicpruning/PartitionPruning.scala | 15 - .../spark/sql/BloomFilterAggregateQuerySuite.scala | 215 +++++++++ .../spark/sql/InjectRuntimeFilterSuite.scala | 503 +++++++++++++++++++++ 14 files changed, 1432 insertions(+), 16 deletions(-) create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BloomFilterMightContain.scala create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/BloomFilterAggregate.scala create mode 100644 sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/InjectRuntimeFilter.scala create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/BloomFilterAggregateQuerySuite.scala create mode 100644 sql/core/src/test/scala/org/apache/spark/sql/InjectRuntimeFilterSuite.scala --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org