[
https://issues.apache.org/jira/browse/HIVE-18571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377941#comment-16377941
]
Sergey Shelukhin commented on HIVE-18571:
-----------------------------------------
Update again to try and use ACID state in more locations when updating stats.
Unfortunately it looks like write ID for the target table of an insert is
missing during the insert; I left a comment in HIVE-18192: "When I get the
config setting where txn state is stored as string for an insert query in
autoColumnStats_4 (insert into acid table from non-acid table), the setting is
"4" - basically it has txn ID, but no write Id for any table. Is that by
design? How does it write into the table without having a write ID for that
table?"
Need to clarify that and update the patch either with/after the write ID fix,
or based on the next test run, update the ACID table stats to be cleared in
more tests when ACID state cannot be obtained.
[~ekoifman] can you please review this patch?
I think write ID and/or some out files aside it is ready.
> stats issues for MM tables
> --------------------------
>
> Key: HIVE-18571
> URL: https://issues.apache.org/jira/browse/HIVE-18571
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Priority: Major
> Attachments: HIVE-18571.01.patch, HIVE-18571.02.patch,
> HIVE-18571.03.patch, HIVE-18571.patch
>
>
> There are multiple stats aggregation issues with MM tables.
> Some simple stats are double counted and some stats (simple stats) are
> invalid for ACID table dirs altogether.
> I have a patch almost ready, need to fix some more stuff and clean up.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
