-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/42150/
-----------------------------------------------------------

(Updated Jan. 13, 2016, 11:36 a.m.)


Review request for Falcon.


Bugs: FALCON-1677
    https://issues.apache.org/jira/browse/FALCON-1677


Repository: falcon-git


Description
-------

Currently, Falcon retries only on failure. We should extend support in case of 
timed-out instances too. Earlier, since we were relying on post-processing to 
notify the instance status, this was not possible. Now that Falcon relies on 
Oozie JMS notifications, we can support retries for timed out instances too.
If a dataset is expected to get delayed for a long time, the user is currently 
forced to supply a large timeout value. This is an overhead in terms of Oozie 
having to poll for that long. If we introduce retries, the timeout can be a 
reasonable value with periodic/exponential back-off retries.


Diffs (updated)
-----

  
addons/recipes/hdfs-replication/src/main/resources/hdfs-replication.properties 
7ef4095 
  
addons/recipes/hive-disaster-recovery/src/main/resources/hive-disaster-recovery-secure.properties
 df4a8fd 
  
addons/recipes/hive-disaster-recovery/src/main/resources/hive-disaster-recovery.properties
 c2915fb 
  client/src/main/java/org/apache/falcon/recipe/RecipeToolOptions.java 0ece90b 
  
client/src/main/java/org/apache/falcon/recipe/util/RecipeProcessBuilderUtils.java
 9477bb4 
  client/src/main/resources/process-0.1.xsd 256a29f 
  common/src/main/java/org/apache/falcon/entity/EntityUtil.java f448d70 
  
common/src/test/java/org/apache/falcon/entity/parser/ProcessEntityParserTest.java
 da22d56 
  docs/src/site/twiki/EntitySpecification.twiki c4f5f76 
  
falcon-regression/merlin/src/test/resources/HdfsRecipe/hive-disaster-recovery.properties
 fb2a4fc 
  
falcon-regression/merlin/src/test/resources/HiveDrRecipe/hive-disaster-recovery.properties
 dd781a5 
  
falcon-regression/merlin/src/test/resources/HiveDrSecureRecipe/hive-disaster-recovery-secure.properties
 da0bcd1 
  rerun/src/main/java/org/apache/falcon/rerun/handler/RetryHandler.java 84cd93f 
  src/conf/runtime.properties f535b0f 
  webapp/src/test/resources/hdfs-replication.properties bd77a1c 

Diff: https://reviews.apache.org/r/42150/diff/


Testing
-------

Done.


Thanks,

Narayan Periwal

Reply via email to