[ https://issues.apache.org/jira/browse/HIVE-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423661#comment-13423661 ]
Hudson commented on HIVE-1653: ------------------------------ Integrated in Hive-trunk-h0.21 #1569 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1569/]) HIVE-1653. Ability to enforce correct stats. (njain via kevinwilfong) (Revision 1366103) Result = FAILURE kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1366103 Files : * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/conf/hive-default.xml.template * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TableScanOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/StatsWork.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/stats * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/stats/DummyStatsAggregator.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/stats/DummyStatsPublisher.java * /hive/trunk/ql/src/test/queries/clientnegative/stats_aggregator_error_1.q * /hive/trunk/ql/src/test/queries/clientnegative/stats_aggregator_error_2.q * /hive/trunk/ql/src/test/queries/clientnegative/stats_publisher_error_1.q * /hive/trunk/ql/src/test/queries/clientnegative/stats_publisher_error_2.q * /hive/trunk/ql/src/test/queries/clientpositive/stats_aggregator_error_1.q * /hive/trunk/ql/src/test/queries/clientpositive/stats_publisher_error_1.q * /hive/trunk/ql/src/test/results/clientnegative/stats_aggregator_error_1.q.out * /hive/trunk/ql/src/test/results/clientnegative/stats_aggregator_error_2.q.out * /hive/trunk/ql/src/test/results/clientnegative/stats_publisher_error_1.q.out * /hive/trunk/ql/src/test/results/clientnegative/stats_publisher_error_2.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats_aggregator_error_1.q.out * /hive/trunk/ql/src/test/results/clientpositive/stats_publisher_error_1.q.out > Ability to enforce correct stats > -------------------------------- > > Key: HIVE-1653 > URL: https://issues.apache.org/jira/browse/HIVE-1653 > Project: Hive > Issue Type: Improvement > Components: Query Processor > Reporter: Namit Jain > Assignee: Namit Jain > Fix For: 0.10.0 > > > This is a follow-up for https://issues.apache.org/jira/browse/HIVE-1361. > If one of the mappers/reducers cannot publish stats, it may lead to wrong > aggregated stats. > There should be a way to avoid this - at the least, a configuration variable > which fails the > task if stats cannot be published -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira