[
https://issues.apache.org/jira/browse/HIVE-21430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792337#comment-16792337
]
Ashutosh Bapat commented on HIVE-21430:
---------------------------------------
[~ashutoshc], I have seen users disable this config, e.g
[https://stackoverflow.com/questions/24812626/hive-any-way-to-disable-partition-statistics,]
[https://community.hortonworks.com/questions/5372/disable-hive-metastore-statitics.html.|https://community.hortonworks.com/questions/5372/disable-hive-metastore-statitics.html).]
Both these links are 3/4 years old and so it's possible that the issues have
been solved. Nonetheless they show that this config is useful when statistics
collection becomes a problem. Said that if we can get rid of the config
altogether, that will be great.
About b), AFAIU, when hive.stats.autogather is disabled, the stats invalidation
doesn't happen through a separate task. It's done as part of MoveTask. May be I
am missing something.
The fix in this particular case is much smaller than the code cleanup after
removing hive.stats.autogather.
> INSERT into a dynamically partitioned table with hive.stats.autogather =
> false throws a MetaException
> -----------------------------------------------------------------------------------------------------
>
> Key: HIVE-21430
> URL: https://issues.apache.org/jira/browse/HIVE-21430
> Project: Hive
> Issue Type: Bug
> Reporter: Ashutosh Bapat
> Assignee: Ashutosh Bapat
> Priority: Major
> Attachments: metaexception_repro.patch,
> org.apache.hadoop.hive.ql.stats.TestStatsUpdaterThread-output.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> When the test TestStatsUpdaterThread#testTxnDynamicPartitions added in the
> attached patch is run it throws exception (full logs attached.)
> org.apache.hadoop.hive.metastore.api.MetaException: Cannot change stats state
> for a transactional table default.simple_stats without providing the
> transactional write state for verification (new write ID 5, valid write IDs
> null; current state \{"BASIC_STATS":"true","COLUMN_STATS":{"s":"true"}}; new
> state null
> at
> org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4328)
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
