[
https://issues.apache.org/jira/browse/HIVE-25602?focusedWorklogId=663849&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-663849
]
ASF GitHub Bot logged work on HIVE-25602:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Oct/21 02:32
Start Date: 12/Oct/21 02:32
Worklog Time Spent: 10m
Work Description: hmangla98 commented on a change in pull request #2707:
URL: https://github.com/apache/hive/pull/2707#discussion_r726713731
##########
File path:
itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/parse/TestScheduledReplicationScenarios.java
##########
@@ -251,6 +253,97 @@ public void testExternalTablesReplLoadBootstrapIncr()
throws Throwable {
}
}
+ @Test
+ public void testCompleteFailoverWithReverseBootstrap() throws Throwable {
+ String withClause =
+ "'" + HiveConf.ConfVars.HIVE_IN_TEST + "' = 'true'" + ",'"
+ + HiveConf.ConfVars.REPL_SOURCE_CLUSTER_NAME + "' =
'cluster0'"
+ + ",'" + HiveConf.ConfVars.REPL_TARGET_CLUSTER_NAME
+ + "' = 'cluster1'";
+
+ // Create a table with some data at source DB.
+ primary.run("use " + primaryDbName).run("create table t2 (id int)")
+ .run("insert into t2 values(1)").run("insert into t2 values(2)");
+
+ // Schedule Dump & Load and verify the data is replicated properly.
+ try (ScheduledQueryExecutionService schqS = ScheduledQueryExecutionService
+ .startScheduledQueryExecutorService(primary.hiveConf)) {
+ int next = -1;
+ ReplDumpWork.injectNextDumpDirForTest(String.valueOf(next), true);
+ primary.run("create scheduled query repl_dump_p1 every 5 seconds as repl
dump "
+ + primaryDbName + " WITH(" + withClause + ')');
Review comment:
This will by-default choose different dump directories for both the
policies since db_name is different. We can't choose same db_name for src and
replica as we are testing this in single cluster only.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 663849)
Time Spent: 0.5h (was: 20m)
> Fix failover metadata file path in repl load execution.
> -------------------------------------------------------
>
> Key: HIVE-25602
> URL: https://issues.apache.org/jira/browse/HIVE-25602
> Project: Hive
> Issue Type: Bug
> Reporter: Haymant Mangla
> Assignee: Haymant Mangla
> Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> When executed through scheduled queries, repl load fails with following error:
>
> {code:java}
> Reading failover metadata from file:
> 2021-10-08 02:02:51,824 ERROR org.apache.hadoop.hive.ql.Driver: [Scheduled
> Query Executor(schedule:repl_load_p1, execution_id:43)]: FAILED:
> SemanticException java.io.FileNotFoundException: File does not exist:
> /user/hive/repl/c291cmNl/36d04dfd-ee5d-4faf-bc0a-ae8d665f95f9/_failovermetadata
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:87)
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:77)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirStatAndListingOp.getBlockLocations(FSDirStatAndListingOp.java:159)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:2035)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:737)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:454)
> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:533)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
