Internal Jenkins has submitted this change and it was merged. Change subject: IMPALA-1657: Rework detection and reporting of corrupt table stats. ......................................................................
IMPALA-1657: Rework detection and reporting of corrupt table stats. 1. Minor fixes for cardinality estimation of unpartitioned tables. 2. Reworks handling of corrupt table stats as follows: The stats of a table or partition are reported as corrupt if the numRows < -1, or if numRows == 0 but the table size is positive. 3. Removes the Preconditions check reported in IMPALA-1657 in favor or issuing a corrupt table stats warning. 4. Fixes a few tests to set numRows together with STATS_GENERATED_VIA_STATS_TASK so that the numRows is definitely set in the HMS. Change-Id: I1d3305791d96e1c23a901af7b7c109af9352bb44 Reviewed-on: http://gerrit.cloudera.org:8080/4166 Reviewed-by: Alex Behm <[email protected]> Tested-by: Internal Jenkins --- M fe/src/main/java/com/cloudera/impala/planner/HdfsScanNode.java M fe/src/main/java/com/cloudera/impala/planner/Planner.java M testdata/workloads/functional-query/queries/QueryTest/corrupt-stats.test M tests/metadata/test_compute_stats.py 4 files changed, 81 insertions(+), 22 deletions(-) Approvals: Internal Jenkins: Verified Alex Behm: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/4166 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: I1d3305791d96e1c23a901af7b7c109af9352bb44 Gerrit-PatchSet: 4 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Alex Behm <[email protected]> Gerrit-Reviewer: Alex Behm <[email protected]> Gerrit-Reviewer: Dimitris Tsirogiannis <[email protected]> Gerrit-Reviewer: Internal Jenkins Gerrit-Reviewer: Marcel Kornacker <[email protected]>
