I think compute stats will help estimates be more accurate.
On Thu, Feb 22, 2018 at 4:48 AM, Fawze Abujaber <fawz...@gmail.com> wrote:
> Hi Guys,
> In Impala version 2.10 i see a lot that the Estimate per Mode peak memory
> can reach X30 times of the Per Node Peak Memory usage.
> For example one of the query the estimate was 9GB while the usage was 30GB.
> I have 3 questions:
> 1- Do you think the compute stats will help here?
> 2- How i can reduce this gap?
> 3- Does the resource pools based on the Estimate per Mode peak memory? so
> if for such query i put the default max memory limit to 5GB, will this
> query fail?