I think compute stats will help estimates be more accurate. On Thu, Feb 22, 2018 at 4:48 AM, Fawze Abujaber <[email protected]> wrote:
> Hi Guys, > > In Impala version 2.10 i see a lot that the Estimate per Mode peak memory > can reach X30 times of the Per Node Peak Memory usage. > > For example one of the query the estimate was 9GB while the usage was 30GB. > > I have 3 questions: > > 1- Do you think the compute stats will help here? > 2- How i can reduce this gap? > 3- Does the resource pools based on the Estimate per Mode peak memory? so > if for such query i put the default max memory limit to 5GB, will this > query fail? > > >
