[
https://issues.apache.org/jira/browse/DRILL-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136556#comment-15136556
]
ASF GitHub Bot commented on DRILL-4132:
---------------------------------------
GitHub user yufeldman opened a pull request:
https://github.com/apache/drill/pull/368
DRILL-4132 Ability to submit simple type of physical plan directly to…
… EndPoint DrillBit for execution.
There are multiple changes to achieve this:
1. During physical planning split single plan into multiple based on the
number of minor fragments of the Leaf Major fragment.
a. Removing exchange operators during planning
b. Producing just root fragments (that will be also leaf fragments)
2. Each fragment can be executed against Drillbit it is assigned to, so to
keep locality
Design document can be found in the JIRA: DRILL-4132
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yufeldman/incubator-drill DRILL-4132
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/drill/pull/368.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #368
----
commit 2a35967396dd66c3e371973fe8baf14f720ed219
Author: Yuliya Feldman <[email protected]>
Date: 2016-02-04T22:09:21Z
DRILL-4132 Ability to submit simple type of physical plan directly to
EndPoint DrillBit for execution.
There are multiple changes to achieve this:
1. During physical planning split single plan into multiple based on the
number of minor fragments of the Leaf Major fragment.
a. Removing exchange operators during planning
b. Producing just root fragments (that will be also leaf fragments)
2. Each fragment can be executed against Drillbit it is assigned to, so to
keep locality
Design document can be found in the JIRA: DRILL-4132
----
> Ability to submit simple type of physical plan directly to EndPoint DrillBit
> for execution
> ------------------------------------------------------------------------------------------
>
> Key: DRILL-4132
> URL: https://issues.apache.org/jira/browse/DRILL-4132
> Project: Apache Drill
> Issue Type: New Feature
> Components: Execution - Flow, Execution - RPC, Query Planning &
> Optimization
> Reporter: Yuliya Feldman
> Assignee: Yuliya Feldman
>
> Today Drill Query execution is optimistic and stateful (at least due to data
> exchanges) - if any of the stages of query execution fails whole query fails.
> If query is just simple scan, filter push down and project where no data
> exchange happens between DrillBits there is no need to fail whole query when
> one DrillBit fails, as minor fragments running on that DrillBit can be rerun
> on the other DrillBit. There are probably multiple ways to achieve this. This
> JIRA is to open discussion on:
> 1. agreement that we need to support above use case
> 2. means of achieving it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
