hmangla98 commented on a change in pull request #2529:
URL: https://github.com/apache/hive/pull/2529#discussion_r678751529
##########
File path: ql/src/java/org/apache/hadoop/hive/ql/exec/repl/ReplLoadTask.java
##########
@@ -554,6 +555,29 @@ public void run() throws SemanticException {
}
}
});
+ if (work.shouldFailover()) {
+ listOfPreAckTasks.add(new PreAckTask() {
+ @Override
+ public void run() throws SemanticException {
+ try {
+ Database db = getHive().getDatabase(work.getTargetDatabase());
+ Map<String, String> params = db.getParameters();
+ if (params == null) {
+ params = new HashMap<>();
+ db.setParameters(params);
+ } else if (MetaStoreUtils.isTargetOfReplication(db)) {
+ params.remove(ReplConst.TARGET_OF_REPLICATION);
Review comment:
In rollback, this prop would be again set in incremental load.
##########
File path: ql/src/java/org/apache/hadoop/hive/ql/exec/repl/ReplLoadWork.java
##########
@@ -129,16 +130,20 @@ public ReplLoadWork(HiveConf hiveConf, String
dumpDirectory,
if (metricCollector != null) {
metricCollector.setMetricsMBean(name);
}
+ Path failoverReadyMarker = new Path(dumpDirectory,
ReplAck.FAILOVER_READY_MARKER.toString());
+ FileSystem fs = failoverReadyMarker.getFileSystem(hiveConf);
+ shouldFailover =
hiveConf.getBoolVar(HiveConf.ConfVars.HIVE_REPL_FAILOVER_START)
+ && fs.exists(failoverReadyMarker);
incrementalLoadTasksBuilder = new
IncrementalLoadTasksBuilder(dbNameToLoadIn, dumpDirectory,
new IncrementalLoadEventsIterator(dumpDirectory, hiveConf),
hiveConf, eventTo, metricCollector,
- replStatsTracker);
+ replStatsTracker, shouldFailover);
/*
* If the current incremental dump also includes bootstrap for some
tables, then create iterator
* for the same.
*/
Path incBootstrapDir = new Path(dumpDirectory,
ReplUtils.INC_BOOTSTRAP_ROOT_DIR_NAME);
- FileSystem fs = incBootstrapDir.getFileSystem(hiveConf);
+ fs = incBootstrapDir.getFileSystem(hiveConf);
Review comment:
Removed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
