Scott, Can u post the drill profile for the run with 40 nodes and 60 nodes?
I am assuming that you are using the same version of drill in both scenarios. If not let us know. Rahul On Aug 31, 2016 8:28 AM, "scott" <[email protected]> wrote: > > Hello, > I'm having some performance issues testing Drill on a large MapR cluster. > I've been building a cluster of 100 nodes for the past few weeks. When the > cluster had only 40 nodes, I ran a benchmark test where Drill performed > very well, returning in 80 seconds from counting a large table. After > adding the additional 60 nodes, the same benchmark test is not finishing. > It times out after approx. 5 minutes due to configured timeout value of > 300000. My understanding of Drill is that performance should improve when > you increase the cluster size. Each drillbit is configured with 16G. Can > someone tell me if there are some configuration settings that can improve > this? Or, is there some point where Drill performance decreases when the > size of the cluster is too large? > > Thanks, > Scott
