Zoltán Borók-Nagy created IMPALA-8883:
-----------------------------------------

             Summary: Update statistics of ACID tables during writes
                 Key: IMPALA-8883
                 URL: https://issues.apache.org/jira/browse/IMPALA-8883
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Zoltán Borók-Nagy


When Impala INSERTs or TRUNCATEs an ACID table it simply removes the 
COLUMN_STATS_ACCURATE property to invalidate the statistics in order to prevent 
Hive using it.

Instead of it Impala should properly update the statistics. It should be 
relatively simple for TRUNCATE since it erases all the data, but a bit more 
complicated for INSERT, e.g.:
 * Properly update _number of distinct values_
 * INSERT OVERWRITE partition should properly update table level _number of 
rows_.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to