Repository: falcon Updated Branches: refs/heads/master a3e2320f8 -> fcc0bc20f
FALCON-1485 Add documentation for data transfer details of filesystem replication. Contributed by Peeyush Bishnoi Project: http://git-wip-us.apache.org/repos/asf/falcon/repo Commit: http://git-wip-us.apache.org/repos/asf/falcon/commit/fcc0bc20 Tree: http://git-wip-us.apache.org/repos/asf/falcon/tree/fcc0bc20 Diff: http://git-wip-us.apache.org/repos/asf/falcon/diff/fcc0bc20 Branch: refs/heads/master Commit: fcc0bc20fd2c4e30cc6b6c4f6619859a4f8871dc Parents: a3e2320 Author: Sowmya Ramesh <[email protected]> Authored: Wed Oct 21 13:01:42 2015 -0700 Committer: Sowmya Ramesh <[email protected]> Committed: Wed Oct 21 13:01:42 2015 -0700 ---------------------------------------------------------------------- CHANGES.txt | 2 ++ docs/src/site/twiki/FalconDocumentation.twiki | 10 ++++++++++ docs/src/site/twiki/Recipes.twiki | 4 ++++ 3 files changed, 16 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/falcon/blob/fcc0bc20/CHANGES.txt ---------------------------------------------------------------------- diff --git a/CHANGES.txt b/CHANGES.txt index d5e0bf0..65a84b7 100755 --- a/CHANGES.txt +++ b/CHANGES.txt @@ -6,6 +6,8 @@ Trunk (Unreleased) FALCON-1401 MetadataMappingService fails to add an edge for a process instance(Pallavi Rao) NEW FEATURES + FALCON-1485 Add documentation for data transfer details of filesystem replication(Peeyush Bishnoi via Sowmya Ramesh) + FALCON-1213 Base framework of the native scheduler(Pallavi Rao) FALCON-1315 Update falcon ui for HiveDR, secure clusters and bug fixes(Armando Reyna/Venkat Ranganathan via Sowmya Ramesh) http://git-wip-us.apache.org/repos/asf/falcon/blob/fcc0bc20/docs/src/site/twiki/FalconDocumentation.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/FalconDocumentation.twiki b/docs/src/site/twiki/FalconDocumentation.twiki index 26a11e4..f384a42 100644 --- a/docs/src/site/twiki/FalconDocumentation.twiki +++ b/docs/src/site/twiki/FalconDocumentation.twiki @@ -321,6 +321,16 @@ replication instance delays. If the frequency of the feed is hours(2) and delay instance will run every 2 hours and replicates data with an offset of 1 hour, i.e. at 09:00 UTC, feed instance which is eligible for replication is 08:00; and 11:00 UTC, feed instance of 10:00 UTC is eligible and so on. +If it is required to capture the feed replication metrics like TIMETAKEN, COPY, BYTESCOPIED, set the parameter "job.counter" to "true" +in feed entity properties section. Captured metrics from instance will be populated to the GraphDB for display on UI. + +*Example:* +<verbatim> +<properties> + <property name="job.counter" value="true" /> +</properties> +</verbatim> + ---+++ Where is the feed path defined for File System Storage? It's defined in the feed xml within the location tag. http://git-wip-us.apache.org/repos/asf/falcon/blob/fcc0bc20/docs/src/site/twiki/Recipes.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/Recipes.twiki b/docs/src/site/twiki/Recipes.twiki index c6cfec3..ea29d94 100644 --- a/docs/src/site/twiki/Recipes.twiki +++ b/docs/src/site/twiki/Recipes.twiki @@ -62,6 +62,10 @@ Recipe template will have <workflow name="##workflow.name##">. Recipe tool will and replace it with the property value "hdfs-dr-workflow". Substituted template will have <workflow name="hdfs-dr-workflow"> </verbatim> +---++ Metrics +HDFS DR recipes will capture the replication metrics like TIMETAKEN, COPY, BYTESCOPIED for an instance and populate to the +GraphDB for display on UI. + ---++ Managing the scheduled recipe process * Scheduled recipe process is similar to regular process * List : falcon entity -type process -name <recipe-process-name> -list
