[ https://issues.apache.org/jira/browse/SPARK-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319642#comment-14319642 ]
Michael Armbrust commented on SPARK-5296: ----------------------------------------- As I mentioned on the mailing list, I think you are right about passing down a tree. I would only pass down ORs though, as we already split up ANDs and filter/pass them down already implicitly. > Predicate Pushdown (BaseRelation) to have an interface that will accept OR > filters > ---------------------------------------------------------------------------------- > > Key: SPARK-5296 > URL: https://issues.apache.org/jira/browse/SPARK-5296 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Corey J. Nolet > > Currently, the BaseRelation API allows a FilteredRelation to handle an > Array[Filter] which represents filter expressions that are applied as an AND > operator. > We should support OR operations in a BaseRelation as well. I'm not sure what > this would look like in terms of API changes, but it almost seems like a > FilteredUnionedScan BaseRelation (the name stinks but you get the idea) would > be useful. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org