[
https://issues.apache.org/jira/browse/IMPALA-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337699#comment-17337699
]
ASF subversion and git services commented on IMPALA-10652:
----------------------------------------------------------
Commit 98aca0f416d1bd4eb967cc3800ad95c3c712c0df in impala's branch
refs/heads/master from liuyao
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=98aca0f ]
IMPALA-10652: Optimize the checking of the size of incremental stats
Modify the estimation method of incremental statistics size:
incremental statistics size = Existing partition statistics
+ This time calculation partition stats
- Repeated calculation partition stats
Testing:
All partitions of a table have no incremental stats.
--Calculate the incremental stats of all partitions,
the incremental stats size exceeds the threshold,
an error is reported.
--Calculate the incremental stats of one partition,
no error is reported.
Change-Id: I4f35ea936445015a3b8b8102b1891db29751b5ee
Reviewed-on: http://gerrit.cloudera.org:8080/17299
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Zoltan Borok-Nagy <[email protected]>
> False positives when calculating incremental statistics
> -------------------------------------------------------
>
> Key: IMPALA-10652
> URL: https://issues.apache.org/jira/browse/IMPALA-10652
> Project: IMPALA
> Issue Type: Improvement
> Components: Frontend
> Affects Versions: Impala 4.0
> Reporter: liuyao
> Assignee: liuyao
> Priority: Major
> Fix For: Impala 4.0
>
>
> A table has 10,000 partitions and 300 columns. There is no incremental
> statistics for each partition of this table. I execute a query to calculate
> the incremental statistics of a partition, and an error will be reported.The
> error message is "Incremental stats size estimate exceeds 200M. Please try
> COMPUTE STATS instead."In this case, no error should be reported, because
> each partition of this table does not have incremental statistics
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
