FALCON-744 Document existing falcon data archival to cloud store. Contributed by Venkatesh Seetharam
Project: http://git-wip-us.apache.org/repos/asf/incubator-falcon/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-falcon/commit/839d2507 Tree: http://git-wip-us.apache.org/repos/asf/incubator-falcon/tree/839d2507 Diff: http://git-wip-us.apache.org/repos/asf/incubator-falcon/diff/839d2507 Branch: refs/heads/master Commit: 839d25077982699af5ee0167eece027d79e889bf Parents: 40c3e94 Author: Venkatesh Seetharam <venkat...@apache.org> Authored: Thu Nov 13 17:52:17 2014 -0800 Committer: Venkatesh Seetharam <venkat...@apache.org> Committed: Thu Nov 13 17:52:17 2014 -0800 ---------------------------------------------------------------------- CHANGES.txt | 3 +++ docs/src/site/twiki/FalconDocumentation.twiki | 22 ++++++++++++++++++++++ 2 files changed, 25 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-falcon/blob/839d2507/CHANGES.txt ---------------------------------------------------------------------- diff --git a/CHANGES.txt b/CHANGES.txt index 896116b..f313e63 100755 --- a/CHANGES.txt +++ b/CHANGES.txt @@ -41,6 +41,9 @@ Trunk (Unreleased) FALCON-263 API to get workflow parameters. (pavan kumar kolamuri via Shwetha GS) IMPROVEMENTS + FALCON-744 Document existing falcon data archival to cloud store + (Venkatesh Seetharam) + FALCON-869 Clean up required in the instance API calls. (Suhas Vasu) FALCON-878 Move falcon html files to HTML5. (Ajay Yadav via Srikanth Sundarrajan) http://git-wip-us.apache.org/repos/asf/incubator-falcon/blob/839d2507/docs/src/site/twiki/FalconDocumentation.twiki ---------------------------------------------------------------------- diff --git a/docs/src/site/twiki/FalconDocumentation.twiki b/docs/src/site/twiki/FalconDocumentation.twiki index 722a3bf..17dc25c 100644 --- a/docs/src/site/twiki/FalconDocumentation.twiki +++ b/docs/src/site/twiki/FalconDocumentation.twiki @@ -370,6 +370,28 @@ such as schema, storage format, etc. cluster, (no dirty reads) +---+++ Archival as Replication + +Falcon allows users to archive data from on-premice to cloud, either Azure WASB or S3. +It uses the underlying replication for archiving data from source to target. The archival URI is +specified as the overridden location for the target cluster. + +*Example:* +<verbatim> + <clusters> + <cluster name="on-premise-cluster" type="source"> + <validity start="2021-11-01T00:00Z" end="2021-12-31T00:00Z"/> + </cluster> + <cluster name="cloud-cluster" type="target"> + <validity start="2011-11-01T00:00Z" end="2011-12-31T00:00Z"/> + <locations> + <location type="data" + path="wasb://t...@blah.blob.core.windows.net/data/${YEAR}-${MONTH}-${DAY}-${HOUR}"/> + </locations> + </cluster> + </clusters> +</verbatim> + ---+++ Relation between feed's retention limit and feed's late arrival cut off period: For reasons that are obvious, Falcon has an external validation that ensures that the user
