[
https://issues.apache.org/jira/browse/IMPALA-4482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe McDonnell resolved IMPALA-4482.
-----------------------------------
Fix Version/s: Not Applicable
Resolution: Later
> Loading Impala's test data produces different TPCDS data on local vs. remote
> clusters for partitioned tables
> ------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-4482
> URL: https://issues.apache.org/jira/browse/IMPALA-4482
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 2.8.0
> Reporter: David Knupp
> Assignee: David Knupp
> Priority: Major
> Labels: remote_cluster_test, test-infra
> Fix For: Not Applicable
>
>
> For example:
> *Local mini-cluster*
> {noformat}
> [localhost:21000] > show table stats store_sales;
> Query: show table stats store_sales
> +-----------------+--------+--------+----------+--------------+-------------------+--------+-------------------+---------------------------------------------------------------------------------+
> | ss_sold_date_sk | #Rows | #Files | Size | Bytes Cached | Cache
> Replication | Format | Incremental stats | Location
> |
> +-----------------+--------+--------+----------+--------------+-------------------+--------+-------------------+---------------------------------------------------------------------------------+
> | 2450829 | 1071 | 1 | 127.20KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://localhost:20500/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450829
> |
> | 2450846 | 839 | 1 | 99.89KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://localhost:20500/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450846
> |
> | 2450860 | 747 | 1 | 88.97KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://localhost:20500/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450860
> |
> | 2450874 | 922 | 1 | 109.33KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://localhost:20500/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450874
> |
> | 2450888 | 856 | 1 | 102.36KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://localhost:20500/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450888
> |
> | 2450905 | 969 | 1 | 115.28KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://localhost:20500/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450905
> |
> [...]
> | Total | 183592 | 120 | 21.31MB | 0B |
> | | |
> |
> {noformat}
> *Same table, remote cluster*
> {noformat}
> [impala-new-test-cluster-4.gce.cloudera.com:21000] > show table stats
> store_sales;
> Query: show table stats store_sales
> +-----------------+--------+--------+----------+--------------+-------------------+--------+-------------------+-----------------------------------------------------------------------------------------------------------------+
> | ss_sold_date_sk | #Rows | #Files | Size | Bytes Cached | Cache
> Replication | Format | Incremental stats | Location
> |
> +-----------------+--------+--------+----------+--------------+-------------------+--------+-------------------+-----------------------------------------------------------------------------------------------------------------+
> | 2450829 | 2142 | 2 | 254.39KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://impala-new-test-cluster-1.gce.cloudera.com:8020/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450829
> |
> | 2450846 | 1678 | 2 | 199.79KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://impala-new-test-cluster-1.gce.cloudera.com:8020/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450846
> |
> | 2450860 | 1494 | 2 | 177.94KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://impala-new-test-cluster-1.gce.cloudera.com:8020/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450860
> |
> | 2450874 | 922 | 1 | 109.33KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://impala-new-test-cluster-1.gce.cloudera.com:8020/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450874
> |
> | 2450888 | 1712 | 2 | 204.72KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://impala-new-test-cluster-1.gce.cloudera.com:8020/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450888
> |
> | 2450905 | 1938 | 2 | 230.56KB | NOT CACHED | NOT CACHED
> | TEXT | false |
> hdfs://impala-new-test-cluster-1.gce.cloudera.com:8020/test-warehouse/tpcds.store_sales/ss_sold_date_sk=2450905
> |
> [...]
> | Total | 334969 | 219 | 38.88MB | 0B |
> | | |
> |
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
