[
https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15566591#comment-15566591
]
Siddharth Seth commented on HIVE-14803:
---------------------------------------
[~pxiong] - as far as I know, every commit is at least supposed to verify that
the test failures in the run are not caused by the patch. For the past month or
so - there's been a consistent set of failures, and that is retained across
commits (by validating additional failures). The number of failures has gone
down to 1-3 recently, and should be at 0 soon.
I'll send out a discuss thread on the mailing list regarding this.
> S3: Stats gathering for insert queries can be expensive for partitioned
> dataset
> -------------------------------------------------------------------------------
>
> Key: HIVE-14803
> URL: https://issues.apache.org/jira/browse/HIVE-14803
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
> Affects Versions: 2.1.0
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Priority: Minor
> Attachments: HIVE-14803.1.patch
>
>
> StatsTask's aggregateStats populates stats details for all partitions by
> checking the file sizes which turns out to be expensive when larger number of
> partitions are inserted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
