[ 
https://issues.apache.org/jira/browse/IMPALA-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexander Behm updated IMPALA-5095:
-----------------------------------
    Description: 
{code}
select min(int_col), max(bigint_col) from parquet_table
{code}

The slot values for int_col and bigint_col can be directly filled in from the 
parquet::Statistics, assuming stats are available for both columns. No columns 
need to be scanned/materialized.

This JIRA focuses on implementing this optimization in the simple case where 
all scanned columns feed into min/max aggregates and where all columns have 
parquet::Statistics. Those conditions can be relaxed, but should be addressed 
separately.

This optimization opportunity must be detected by the planner and is not 
applicable when there are scan predicates.



> Use parquet::Statistics for simple min/max aggregates
> -----------------------------------------------------
>
>                 Key: IMPALA-5095
>                 URL: https://issues.apache.org/jira/browse/IMPALA-5095
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Backend
>    Affects Versions: Impala 2.8.0
>            Reporter: Alexander Behm
>
> {code}
> select min(int_col), max(bigint_col) from parquet_table
> {code}
> The slot values for int_col and bigint_col can be directly filled in from the 
> parquet::Statistics, assuming stats are available for both columns. No 
> columns need to be scanned/materialized.
> This JIRA focuses on implementing this optimization in the simple case where 
> all scanned columns feed into min/max aggregates and where all columns have 
> parquet::Statistics. Those conditions can be relaxed, but should be addressed 
> separately.
> This optimization opportunity must be detected by the planner and is not 
> applicable when there are scan predicates.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to