Joe McDonnell created IMPALA-15155:
--------------------------------------

             Summary: Dataload for TPC-DS does not fail for some errors
                 Key: IMPALA-15155
                 URL: https://issues.apache.org/jira/browse/IMPALA-15155
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 5.0.0
            Reporter: Joe McDonnell


On a faulty patch for parallel TPC-DS datagen 
([https://gerrit.cloudera.org/#/c/23092/] ), TPC-DS dataload was not loading 
data properly, but dataload itself succeeded. The job subsequently had many 
test failures due to the wrong data being in the TPC-DS tables.

This should fail dataload. It seems that bin/load-data.py returned a non-zero 
error code, but somehow that was ignored. My best guess is that this is the 
problem:
{noformat}
function load-tpcds-data {
  load-data "tpcds" "core"
  load-data "tpcds_partitioned" "core"
}{noformat}
The first call to load-data is failing, but the second is succeeding (because 
the first step did actually create the tables but didn't populate them). It 
seems like it is ignoring the non-zero return code here.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to