Hi Community , In the last impala versions, impala is estimating the memory required for the query, and in case the estimated memory required beyonds the configured memory or the configured memory per pool, impala is not submitting this query, taking the fact that many times and specially running query on tables without stats there is a huge difference between the estimated and the actual memory used, the estimated can be 31 GB per node and the actual use is 1 or 2 GB, that’s mean to submit a query I need at least 1.5 T memory configured which I see it too much.
I’m curios to know if there is an option making this to configuration ( Un submitting query if we he estimated memory required beyond the configured memory) as an optional choice. Such issue can block using impala dynamic resource pools. -- Take Care Fawze Abujaber
