Tejas Patil created SPARK-17254:
-----------------------------------
Summary: Filter operator should have “stop if false” semantics for
sorted data
Key: SPARK-17254
URL: https://issues.apache.org/jira/browse/SPARK-17254
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Tejas Patil
Priority: Minor
>From
>https://issues.apache.org/jira/secure/attachment/12778890/BucketedTables.pdf:
Filter on sorted data
If the data is sorted by a key, filters on the key could stop as soon as the
data is out of range. For example, WHERE ticker_id < “F” should stop as soon as
the first row starting with “F” is seen. This can be done adding a Filter
operator that has “stop if false” semantics. This is generally useful.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
