Dril, in it's current form, has had all the features required to be run on cluster managers with multi-tenacy. There are many caveats but mostly realted to how things are configured, not limitations of Drill itself. The work being done for Drill in containers and Drill on K8s not only provides a roadmap of how to do it, but reviewing the yaml and docker files is a great way to see how devs are approaching a proper multitenant capable Drill cluster. This is exciting work!
On Thu, Jul 26, 2018, 11:40 AM Abhishek Girish <[email protected]> wrote: > Hey everyone, > > Like John and Saurabh mentioned, yes this is possible. We've been using > Drill on Kubernetes for a while now. I have a draft of my work > (Dockerfiles + YAML definitions) available in [1]. Drill should come up > successfully in distributed mode (multiple Drillbits) under K8S. Please > give it a try when you can and reach out to me if you need any > clarifications. > > For 1.14.0, we added official support for Docker. For the next release, i'm > working on incorporating the K8S support into the Apache Drill repo. > > [1] https://github.com/Agirish/drill-containers > > On Thu, Jul 26, 2018 at 8:59 AM Saurabh Mahapatra < > [email protected]> wrote: > > > Hey Arjun, > > > > Is the need for kubernetes a top down requirement in your architecture? > > > > John is right when it comes to running Drill inside a container. But > there > > was some talk of addressing the other problem which is whether K8 can be > a > > resource manager for multiple Drill clusters...an alternative to > splitting > > up interactive and batch loads. I know this has been done within a YARN > > setting. > > > > Paul and Abhishek are more knowledgeable about this. Thoughts? > > > > Maybe a topic for this year’s conference? > > > > Thanks, > > Saurabh > > > > Sent from my iPhone > > > > > > > > > On Jul 26, 2018, at 8:48 AM, John Omernik <[email protected]> wrote: > > > > > > Absolutely it can! I don't have a docker file for it handy but I know > it > > > works well! > > > > > >> On Thu, Jul 26, 2018, 10:45 AM Arjun Rao <[email protected]> > > wrote: > > >> > > >> Hi, > > >> I am new to this forum and am excited to use Drill. This might have > been > > >> discussed in the past but I wanted to know if Apache Drill can be run > on > > >> Kubernetes and if not, if it's on the roadmap for Drill? > > >> > > >> Appreciate the help! > > >> > > >> Best, > > >> Arjun > > >> > > >
