Vitalii Diravka created DRILL-6379:
--------------------------------------
Summary: Pushing additional filters for disjunction of expressions
past JOIN
Key: DRILL-6379
URL: https://issues.apache.org/jira/browse/DRILL-6379
Project: Apache Drill
Issue Type: Improvement
Components: Query Planning & Optimization
Affects Versions: 1.13.0
Reporter: Vitalii Diravka
Assignee: Vitalii Diravka
Fix For: Future
For queries with JOIN operator and filter as disjunction of expressions
the additional filters can be derived and pushed down to prevent of unnecessary
scanning.
Query example:
{code}
SELECT * FROM t1 JOIN t2 ON T1.COLUMN = T2.COLUMN WHERE
(PC = X AND <other filters>) OR (PC = Y AND <some other filters>)
{code}
Unit test for _TestParquetFilterPushdownWithTransitivePredicates.java_:
{code}
@Test
public void testForOrOperatorTestOr() throws Exception {
String query = String.format("SELECT * FROM %s t1 " +
"JOIN %s t2 ON t1.`month` = t2.`month` " +
"WHERE ((t1.`period` = 4 AND t2.`year` = 1991) OR (t1.`period` = 3
AND t1.`year` = 1991)) ",
FIRST_TABLE_NAME, SECOND_TABLE_NAME);
final String[] expectedPlan = {"first.*numRowGroups=2",
"second.*numRowGroups=1"};
testPlanMatchingPatterns(query, expectedPlan);
}
{code}
{code}
LogicalProject(**=[$0], **0=[$4])
LogicalFilter(condition=[OR(AND(=($2, 4), =($6, 1991)), AND(=($2, 3), =($3,
1991)))])
LogicalJoin(condition=[=($1, $5)], joinType=[inner])
EnumerableTableScan(table=[[dfs,
parquetFilterPush/transitiveClosure/first]])
EnumerableTableScan(table=[[dfs,
parquetFilterPush/transitiveClosure/second]])
{code}
This improvement can be solved by CALCITE-2296.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
