[ 
https://issues.apache.org/jira/browse/DRILL-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993406#comment-15993406
 ] 

Paul Rogers commented on DRILL-1170:
------------------------------------

DoY is quasi-closed source: only in the sense that we have no PR, the goal 
remains that we want to contribute it to Apache Drill. DoY is is hosted in my 
own personal, open repo. I will go ahead and rebase the code onto the latest 
master, then post the repo here. I like your idea of doing a PR. Once I have 
the rebased branch, I'll post a PR for it.

> YARN support for Drill
> ----------------------
>
>                 Key: DRILL-1170
>                 URL: https://issues.apache.org/jira/browse/DRILL-1170
>             Project: Apache Drill
>          Issue Type: New Feature
>            Reporter: Neeraja
>            Assignee: Paul Rogers
>             Fix For: Future
>
>         Attachments: Drill-on-YARNDesignOverview.pdf, 
> Drill-on-YARNUserGuide.pdf
>
>
> This is a tracking item to make Drill work with YARN.
> Below are few requirements/needs to consider.
> - Drill should run as an YARN based application, side by side with other YARN 
> enabled applications (on same nodes or different nodes). Both memory and CPU 
> resources of Drill should be controlled in this mechanism.
> - As an YARN enabled application, Drill resource consumption should be 
> adaptive to the load on the cluster. For ex: When there is no load on the 
> Drill , Drill should consume no resources on the cluster.  As the load on 
> Drill increases, resources permitting, usage should grow proportionally.
> - Low latency is a key requirement for Apache Drill along with support for 
> multiple users (concurrency in 100s-1000s). This should be supported when run 
> as YARN application as well.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to