[
https://issues.apache.org/jira/browse/DRILL-7985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17397598#comment-17397598
]
ASF GitHub Bot commented on DRILL-7985:
---------------------------------------
cgivre commented on pull request #2289:
URL: https://github.com/apache/drill/pull/2289#issuecomment-897109218
> @vvysotskyi Of course it depends what is feasible for Drill, given its
current APIs, users, and code base.
>
> But I introduced Calcite's model of adapters and am still a big believer.
(Indeed I tried to convince Drill to use Calcite's model in the early days.) I
observed that if you build a simple adapter that supports scan, you have to add
another parameter for filter, a way to handle rejected filters (or parts of
filters), add another parameter to push down expressions and project columns
(and handle rejected expressions), and it becomes exponentially more complex as
you add additional operations (aggregate, join, sort, limit).
>
> So I proposed the model where you write rewrite rules, each of which
matches a particular relational operator. The rules tend to compose fairly well.
>
> Maybe Drill could keep its existing Mongo adapter but also support generic
Calcite adapters (powered by Calcite rewrite rules). Then Drill could pull in
Calcite's Mongo adapter. If there are use cases that Calcite's Mongo adapter
does not handle, they could be dealt with as Calcite bugs.
@julianhyde Thanks for the response! @vvysotskyi One other thing to
consider is that Drill needs these rules for query planning and
parallelization. From my recollection, that was the major challenge in using
the Calcite adapters as written. IMHO it would be great if we could find a way
to accomplish both goals using the Calcite adapters.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Support Mongo aggregate, union, project, limit, sort pushdowns
> --------------------------------------------------------------
>
> Key: DRILL-7985
> URL: https://issues.apache.org/jira/browse/DRILL-7985
> Project: Apache Drill
> Issue Type: New Feature
> Affects Versions: 1.20.0
> Reporter: Vova Vysotskyi
> Assignee: Vova Vysotskyi
> Priority: Major
> Fix For: 1.20.0
>
>
> Add support for more mongo pushdowns:
> - aggregate
> - project (including expressions)
> - limit (including offset)
> - union / union all
> - sort
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
