Gautam Kumar Parai created DRILL-6099: -----------------------------------------
Summary: Drill does not push limit past project (flatten) if it cannot be pushed into scan Key: DRILL-6099 URL: https://issues.apache.org/jira/browse/DRILL-6099 Project: Apache Drill Issue Type: Bug Affects Versions: 1.12.0 Reporter: Gautam Kumar Parai Assignee: Gautam Kumar Parai Fix For: 1.13.0 It would be useful to have pushdown occur past flatten(project). Here is an example to illustrate the issue: {{explain plan without implementation for }}{{select name, flatten(categories) as category from dfs.`/tmp/t_json_20` LIMIT 1;}} {{DrillScreenRel}}{{ }} {{ DrillLimitRel(fetch=[1])}}{{ }} {{ DrillProjectRel(name=[$0], category=[FLATTEN($1)])}} {{ DrillScanRel(table=[[dfs, /tmp/t_json_20]], groupscan=[EasyGroupScan [selectionRoot=maprfs:/tmp/t_json_20, numFiles=1, columns=[`name`, `categories`], files=[maprfs:///tmp/t_json_20/0_0_0.json]]])}} ================================================================= Content of 0_0_0.json ================================================================= { "name" : "Eric Goldberg, MD", "categories" : [ "Doctors", "Health & Medical" ] } { "name" : "Pine Cone Restaurant", "categories" : [ "Restaurants" ] } { "name" : "Deforest Family Restaurant", "categories" : [ "American (Traditional)", "Restaurants" ] } { "name" : "Culver's", "categories" : [ "Food", "Ice Cream & Frozen Yogurt", "Fast Food", "Restaurants" ] } { "name" : "Chang Jiang Chinese Kitchen", "categories" : [ "Chinese", "Restaurants" ] } -- This message was sent by Atlassian JIRA (v7.6.3#76005)