Riza Suminto created IMPALA-12601:
-------------------------------------

             Summary: Add a fully partitioned TPC-DS dataset for planner tests
                 Key: IMPALA-12601
                 URL: https://issues.apache.org/jira/browse/IMPALA-12601
             Project: IMPALA
          Issue Type: Test
          Components: Infrastructure
    Affects Versions: Impala 4.3.0
            Reporter: Riza Suminto
            Assignee: Riza Suminto


testdata/datasets/tpcds only have store_sales table fully-partitioned and leave 
other facts table unpartitioned. This is probably intended for faster data 
loading during test. However, this is not an accurate reflection of larger 
scale TPC-DS dataset where all facts tables are partitioned. Impala planner may 
change the detail of query plan if partition column exist.

Today, Impala can load a small scale, fully-partitioned TPC-DS dataset in 
parquet format to minicluster in reasonable speed. We should consider adding 
such test db and change PlannerTests to test against that fully-partitioned db 
instead of current tpcds/tpcds_parquet test db.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to