[
https://issues.apache.org/jira/browse/HIVE-18781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389909#comment-16389909
]
Hive QA commented on HIVE-18781:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12913333/HIVE-18781.03.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/9535/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/9535/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-9535/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetAllResourcePlanResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetTriggersForResourePlanResponse.java:346
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetTriggersForResourePlanResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMValidateResourcePlanResponse.java:441
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMValidateResourcePlanResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-php/metastore/ThriftHiveMetastore.php:13190
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-php/metastore/ThriftHiveMetastore.php'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-php/metastore/Types.php:14574
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-php/metastore/Types.php' with
conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py:13865
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py:10099
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py' with
conflicts.
error: patch failed:
standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java:74
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java'
with conflicts.
Going to apply patch with: git apply -p1
/data/hiveptest/working/scratch/build.patch:10357: trailing whitespace.
tmpMap.put(_Fields.REPL_POLICY, new
org.apache.thrift.meta_data.FieldMetaData("replPolicy",
org.apache.thrift.TFieldRequirementType.OPTIONAL,
/data/hiveptest/working/scratch/build.patch:10514: trailing whitespace.
} else {
/data/hiveptest/working/scratch/build.patch:11019: trailing whitespace.
tmpMap.put(_Fields.REPL_POLICY, new
org.apache.thrift.meta_data.FieldMetaData("replPolicy",
org.apache.thrift.TFieldRequirementType.OPTIONAL,
/data/hiveptest/working/scratch/build.patch:11176: trailing whitespace.
} else {
/data/hiveptest/working/scratch/build.patch:12618: trailing whitespace.
tmpMap.put(_Fields.REPL_POLICY, new
org.apache.thrift.meta_data.FieldMetaData("replPolicy",
org.apache.thrift.TFieldRequirementType.OPTIONAL,
error: patch failed:
itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/TestDbNotificationListener.java:76
Falling back to three-way merge...
Applied patch to
'itests/hcatalog-unit/src/test/java/org/apache/hive/hcatalog/listener/TestDbNotificationListener.java'
cleanly.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp:1240
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp' with
conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp:14442
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp' with
conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AbortTxnsRequest.java:351
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AbortTxnsRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AddDynamicPartitions.java:816
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AddDynamicPartitions.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsRequest.java:521
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsResponse.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClearFileMetadataRequest.java:351
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClearFileMetadataRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClientCapabilities.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClientCapabilities.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CompactionRequest.java:814
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CompactionRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CreationMetadata.java:619
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CreationMetadata.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/FireEventRequest.java:713
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/FireEventRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetAllFunctionsResponse.java:346
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetAllFunctionsResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataByExprRequest.java:619
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataByExprRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataByExprResult.java:444
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataByExprResult.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataRequest.java:351
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataResult.java:433
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataResult.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetTablesRequest.java:525
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetTablesRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetTablesResult.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetTablesResult.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsRequest.java:436
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsResponse.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/HeartbeatTxnRangeResponse.java:453
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/HeartbeatTxnRangeResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/InsertEventRequestData.java:538
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/InsertEventRequestData.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/LockRequest.java:689
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/LockRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Materialization.java:518
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Materialization.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/NotificationEventResponse.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/NotificationEventResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/OpenTxnsResponse.java:351
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/OpenTxnsResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PutFileMetadataRequest.java:547
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PutFileMetadataRequest.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ShowCompactResponse.java:354
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ShowCompactResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ShowLocksResponse.java:350
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ShowLocksResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/TableValidWriteIds.java:708
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/TableValidWriteIds.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:34664
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMFullResourcePlan.java:755
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMFullResourcePlan.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetAllResourcePlanResponse.java:346
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetAllResourcePlanResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetTriggersForResourePlanResponse.java:346
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetTriggersForResourePlanResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMValidateResourcePlanResponse.java:441
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMValidateResourcePlanResponse.java'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-php/metastore/ThriftHiveMetastore.php:13190
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-php/metastore/ThriftHiveMetastore.php'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-php/metastore/Types.php:14574
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-php/metastore/Types.php' with
conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py:13865
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py'
with conflicts.
error: patch failed:
standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py:10099
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py' with
conflicts.
error: patch failed:
standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java:74
Falling back to three-way merge...
Applied patch to
'standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java'
with conflicts.
U standalone-metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
U standalone-metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AbortTxnsRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AddDynamicPartitions.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/AllocateTableWriteIdsResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClearFileMetadataRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ClientCapabilities.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CompactionRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/CreationMetadata.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/FireEventRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetAllFunctionsResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataByExprRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataByExprResult.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetFileMetadataResult.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetTablesRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetTablesResult.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/GetValidWriteIdsResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/HeartbeatTxnRangeResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/InsertEventRequestData.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/LockRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Materialization.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/NotificationEventResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/OpenTxnsResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/PutFileMetadataRequest.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ShowCompactResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ShowLocksResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/TableValidWriteIds.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMFullResourcePlan.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetAllResourcePlanResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMGetTriggersForResourePlanResponse.java
U
standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/WMValidateResourcePlanResponse.java
U standalone-metastore/src/gen/thrift/gen-php/metastore/ThriftHiveMetastore.php
U standalone-metastore/src/gen/thrift/gen-php/metastore/Types.php
U
standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py
U standalone-metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py
U
standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java
warning: squelched 6 whitespace errors
warning: 11 lines add whitespace errors.
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12913333 - PreCommit-HIVE-Build
> Create/Replicate Open, Commit (without writes) and Abort Txn events
> -------------------------------------------------------------------
>
> Key: HIVE-18781
> URL: https://issues.apache.org/jira/browse/HIVE-18781
> Project: Hive
> Issue Type: Sub-task
> Components: repl, Transactions
> Affects Versions: 3.0.0
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
> Fix For: 3.0.0
>
> Attachments: HIVE-18781.01.patch, HIVE-18781.02.patch,
> HIVE-18781.03.patch
>
>
> *EVENT_OPEN_TXN:*
> *Source Warehouse:*
> - Create new event type EVENT_OPEN_TXN with related message format etc.
> - When any transaction is opened either by auto-commit mode or
> multi-statement mode, need to capture this event.
> - Repl dump should read this event from EventNotificationTable and dump the
> message.
> *Target Warehouse:*
> - Repl load should read the event from the dump and get the message.
> - Open a txn in target warehouse.
> - Create a map of source txn ID against target txn ID and persist the same
> in metastore. There should be one map per replication policy (DBName.* incase
> of DB level replication, DBName.TableName incase of table level replication)
>
> *EVENT_COMMIT_TXN (Without writes)*
> Add new EVENT_COMMIT_TXN to log the metadata/data of all tables/partitions
> modified within the txn.
> *Source warehouse:*
> - Create EVENT_COMMIT_TXN event type with corresponding message format etc.
> *Target warehouse:*
> - Repl load should read this event from the dump.
> - Validate the source txn ID from the event using the Source-Target Txn ID
> map maintained in target metastore. Also, need to check if corresponding
> target txn ID is valid.
> - If valid, then apply the event and commit the corresponding target
> transaction.
> - This new event should be idempotent such that if it is applied twice, then
> second time it should be loop.
>
> *EVENT_ABORT_TXN*
> Source Warehouse:
> - Create new event type EVENT_ABORT_TXN with related message format etc.
> - Capture this event when abort the txn.
> - Repl dump should read this event from EventNotificationTable and dump the
> message.
> *Target Warehouse:*
> - Repl load should read the event from the dump and get the message.
> - Validate if source txn ID from the event is there in the source-target txn
> ID map. If not there, just noop the event.
> - If valid, then Abort the corresponding target txn and remove the entry
> from source-target txn ID map.
> All these new events should be idempotent such that if it is applied twice,
> then second time it should be noop.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
