It is relatively tough to estimate the direct memory need without knowing the workload, level of parallelism and kind of queries that you are intended to run et cedera. Perhaps someone else can comment on this.
-can the Drillbits be allocated unequal amounts of memory? I believe you can but beware that afaik Drill planner does not take resources available on each node into consideration. You may end up in a situation that impairs query execution if resource distribution is badly heterogenous. Either way, in a shared nothing system with no resource manager I would recommend sticking with a more homogenous deployment scheme. -Hanifi On Thu, Jun 18, 2015 at 9:55 AM, Qiu, Kathy <[email protected]> wrote: > Hi, > > I was looking at the documentation on your website, and it says that the > default memory for a Drillbit is 8GB (though it prefers at least 16GB). > Would you have more info on how much direct memory needs to be allocated > for each Drillbit based on the data size, how many nodes are in the > cluster, the number of queries being run concurrently, and other relevant > factors? In addition, can the Drillbits be allocated unequal amounts of > memory? > > Thanks, > Kathy > ________________________________________________________ > > The information contained in this e-mail is confidential and/or > proprietary to Capital One and/or its affiliates and may only be used > solely in performance of work or services for Capital One. The information > transmitted herewith is intended only for use by the individual or entity > to which it is addressed. If the reader of this message is not the intended > recipient, you are hereby notified that any review, retransmission, > dissemination, distribution, copying or other use of, or taking of any > action in reliance upon this information is strictly prohibited. If you > have received this communication in error, please contact the sender and > delete the material from your computer. >
