[
https://issues.apache.org/jira/browse/HIVE-21109?focusedWorklogId=217846&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-217846
]
ASF GitHub Bot logged work on HIVE-21109:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Mar/19 06:45
Start Date: 25/Mar/19 06:45
Worklog Time Spent: 10m
Work Description: ashutosh-bapat commented on pull request #579:
HIVE-21109 : Support stats replication for ACID tables.
URL: https://github.com/apache/hive/pull/579
During bootstrap we use a method similar to non-ACID tables to transfer
statistics of an ACID table
from source to replica. However installing statistics of an ACID table
requires a valid writeId and
writeId list. We use the table/partition's latest writeId and a valid
transaction list containing
only that writeId to install the statistics in the metastore.
During incremental replication writeId is obtained from the UpdateStats
event and valid writeId list
with that writeId marked as valid is used to install the column statistics.
Table level statistics is
replicated by replaying corresponding ALTER_TABLE/ALTER_PARTITION event.
Further this commit has following related changes.
1. The table or the partition associated with the commit transaction event
should have been created
when replaying corresponding events before commit transaction event. Thus
there is no need to add
tasks for creating the table or the partition.
2 Maintain a list of open replicated transactions and use that to create
valid transactions list
when replaying a replicated event.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 217846)
Time Spent: 10m
Remaining Estimate: 0h
> Stats replication for ACID tables.
> ----------------------------------
>
> Key: HIVE-21109
> URL: https://issues.apache.org/jira/browse/HIVE-21109
> Project: Hive
> Issue Type: Sub-task
> Reporter: Ashutosh Bapat
> Assignee: Ashutosh Bapat
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21109.01.patch, HIVE-21109.02.patch,
> HIVE-21109.03.patch, HIVE-21109.04.patch, HIVE-21109.05.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Transactional tables require a writeID associated with the stats update. This
> writeId needs to be in sync with the writeId on the source and hence needs to
> be replicated from the source.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
