Sameer Agarwal created SPARK-13871:
--------------------------------------
Summary: Add support for inferring filters from data constraints
Key: SPARK-13871
URL: https://issues.apache.org/jira/browse/SPARK-13871
Project: Spark
Issue Type: Sub-task
Components: SQL
Reporter: Sameer Agarwal
Priority: Minor
Now that we have an infrastructure for propagating data constraints, we should
generalize the NullFiltering optimizer rule in catalyst to
InferFiltersFromConstraints that can automatically infer all relevant filters
based on an operator's constraints while making sure of 2 things:
(a) no redundant filters are generated, and
(b) filters that do not contribute to any further optimizations are not
generated.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
