[
https://issues.apache.org/jira/browse/DRILL-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462842#comment-17462842
]
Paul Rogers commented on DRILL-8085:
------------------------------------
[~luoc], thanks for the offer! Most of the scan stuff has been designed to be
self-contained, and to be testable via unit tests. That said, there is one item
were I could really use your cluster: the LIMIT push-down. My PR will fix how
LIMIT is applied within a single fragment. In a many-fragment query, each scan
might apply a limit of 10, say, but we also must include a LIMIT operator in
the main fragment to limit the limited data. We might have 5 nodes all doing
limit 10, and thus return 50 rows to the root, which must apply the final
limit. We have to push the limit to all the scans, and do all of them, because
it could be that each file has only 1 record, so even with 5 fragments, we
still don't reach the limit.
The risk of limit pushdown is that we may not be adding that final limit
operator. Your cluster test can easily test if this is the case.
> EVF V2 support in the "Easy" format plugin
> ------------------------------------------
>
> Key: DRILL-8085
> URL: https://issues.apache.org/jira/browse/DRILL-8085
> Project: Apache Drill
> Issue Type: Bug
> Affects Versions: 1.19.0
> Reporter: Paul Rogers
> Assignee: Paul Rogers
> Priority: Major
>
> Add support for EVF V2 to the {{EasyFormatPlugin}} similar to how EVF V1
> support already exists. Provide examples for others to follow.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
