Modified: falcon/site/index.html URL: http://svn.apache.org/viewvc/falcon/site/index.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/index.html (original) +++ falcon/site/index.html Wed Feb 18 10:55:56 2015 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> - <title>Falcon - Apache Falcon - Data management and processing platform</title> + <title>Falcon - Falcon - Feed management and data processing platform</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> @@ -241,11 +241,11 @@ Falcon</a> </li> <li class="divider ">/</li> - <li class="">Apache Falcon - Data management and processing platform</li> + <li class="">Falcon - Feed management and data processing platform</li> - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -255,15 +255,40 @@ <div id="bodyColumn" > <div class="section"> -<h2>Apache Falcon - Data management and processing platform<a name="Apache_Falcon_-_Data_management_and_processing_platform"></a></h2> -<p>Apache Falcon is a data processing and management solution for Hadoop designed for data motion, coordination of data pipelines, lifecycle management, and data discovery. Falcon enables end consumers to quickly onboard their data and its associated processing and management tasks on Hadoop clusters.</p> -<p>Data Management on Hadoop encompasses data motion, process orchestration, lifecycle management, data discovery, etc. among other concerns. Falcon is a new data processing and management platform for Hadoop that solves this problem and creates additional opportunities by building on existing components within the Hadoop ecosystem without reinventing the wheel.</p> -<p>Falcon will enable easy data management via declarative mechanism for Hadoop. Users of Falcon platform simply define infrastructure endpoints, data sets and processing rules declaratively. These declarative configurations are expressed in such a way that the dependencies between these configured entities are explicitly described. This information about inter-dependencies between various entities allows Falcon to orchestrate and manage various data management functions.</p> -<p>Falcon has gradauted to a top level project in Dec 2014.</p> -<p><div id="components" class="carousel slide"> <!-- Carousel items --> <div class="carousel-inner"> <div class="active item"> <div class="hero-unit"> <h3>Provides key services for data processing apps</h3> <p>Complex data processing logic handled by Falcon instead of hard-coded in apps</p> <!-- <p> <a class="btn btn-primary pull-right" href="././docs/GettingStarted.html">Learn more</a> </p> --> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Introduces higher layer of abstractions</h3> <p>Data Set, Infrastructure (Cluster, Database, Filer, etc.), Process</p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Declarative language for expressing data management functions</h3> <p>Data management expressed as simple directives, instead of verbosely defining it repeate dly</p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Promotes Separation of Concerns</h3> <p> Allow process owners to keep application/user workflow specific to their application logic than muddy them with the common management functions. </p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Promotes Polyglot programming</h3> <p> Does not do any heavy lifting but delegates to tools with in the Hadoop ecosystem, Enhances productivity </p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Data Motion</h3> <p>Data Import & Export from DBs, Filers into HDFS</p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Process orchestration</h3> <p> La te Data Handling, Retries, etc. Multi-cluster management to support Local/Global Aggregations, Rollups, etc. <a href="http://oozie.apache.org/";>Scheduler</a> integration </p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Data Lifecycle Management</h3> <p>Retention, Replication/BCP/DR, Anonymization of PII Data, Archival, etc.</p> </div> </div> <div class="item"> <div class="hero-unit"> <h3>Data Discovery</h3> <p>Data Classification, Audit, Lineage.</p> </div> </div> </div> </div></p></div> +<h2>Falcon - Feed management and data processing platform<a name="Falcon_-_Feed_management_and_data_processing_platform"></a></h2> +<p>Falcon is a feed processing and feed management system aimed at making it easier for end consumers to onboard their feed processing and feed management on hadoop clusters.</p></div> <div class="section"> -<h3>Getting Involved<a name="Getting_Involved"></a></h3> -<p>Developers interested in getting involved with Falcon may join the <a href="././mail-lists.html">mailing lists</a>, <a class="externalLink" href="https://issues.apache.org/jira/browse/FALCON";>report bugs</a>, retrieve code from the <a href="././source-repository.html">version control system</a>, and make <a class="externalLink" href="https://cwiki.apache.org/confluence/display/FALCON/How+To+Contribute";>contributions</a>.</p></div> +<h3>Why?<a name="Why"></a></h3> +<p></p> +<ul> +<li>Establishes relationship between various data and processing elements on a Hadoop environment</li></ul> +<p></p> +<ul> +<li>Feed management services such as feed retention, replications across clusters, archival etc.</li></ul> +<p></p> +<ul> +<li>Easy to onboard new workflows/pipelines, with support for late data handling, retry policies</li></ul> +<p></p> +<ul> +<li>Integration with metastore/catalog such as Hive/HCatalog</li></ul> +<p></p> +<ul> +<li>Provide notification to end customer based on availability of feed groups</li></ul>(logical group of related feeds, which are likely to be used together) +<p></p> +<ul> +<li>Enables use cases for local processing in colo and global aggregations</li></ul> +<p></p> +<ul> +<li>Captures Lineage information for feeds and processes</li></ul></div> +<div class="section"> +<h2>Getting Started<a name="Getting_Started"></a></h2> +<p>Start with these simple steps to install an falcon instance <a href="./InstallationSteps.html">Simple setup</a>. Also refer to Falcon architecture and documentation in <a href="./FalconDocumentation.html">Documentation</a>. <a href="./OnBoarding.html">On boarding</a> describes steps to on-board a pipeline to Falcon. It also gives a sample pipeline for reference. <a href="./EntitySpecification.html">Entity Specification</a> gives complete details of all Falcon entities.</p> +<p><a href="./FalconCLI.html">Falcon CLI</a> implements <a href="./Restapi/ResourceList.html">Falcon's RESTful API</a> and describes various options for the command line utility provided by Falcon.</p> +<p>Falcon provides OOTB <a href="./HiveIntegration.html">lifecycle management for Tables in Hive (HCatalog)</a> such as table replication for BCP and table eviction. Falcon also enforces <a href="./Security.html">Security</a> on protected resources and enables SSL.</p> +<p><a name="LicenseInfo"></a></p></div> +<div class="section"> +<h2>Licensing Information<a name="Licensing_Information"></a></h2> +<p>Falcon is distributed under <a class="externalLink" href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License 2.0</a>.</p></div> </div> </div>
Modified: falcon/site/issue-tracking.html URL: http://svn.apache.org/viewvc/falcon/site/issue-tracking.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/issue-tracking.html (original) +++ falcon/site/issue-tracking.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - Issue Tracking</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/license.html URL: http://svn.apache.org/viewvc/falcon/site/license.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/license.html (original) +++ falcon/site/license.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - Project License</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/mail-lists.html URL: http://svn.apache.org/viewvc/falcon/site/mail-lists.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/mail-lists.html (original) +++ falcon/site/mail-lists.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - Project Mailing Lists</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/project-info.html URL: http://svn.apache.org/viewvc/falcon/site/project-info.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/project-info.html (original) +++ falcon/site/project-info.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - Project Information</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Added: falcon/site/recipes.html URL: http://svn.apache.org/viewvc/falcon/site/recipes.html?rev=1660589&view=auto ============================================================================== --- falcon/site/recipes.html (added) +++ falcon/site/recipes.html Wed Feb 18 10:55:56 2015 @@ -0,0 +1,359 @@ +<!DOCTYPE html> +<!-- + | Generated by Apache Maven Doxia at 2015-02-18 + | Rendered using Apache Maven Fluido Skin 1.3.0 +--> +<html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> + <head> + <meta charset="UTF-8" /> + <meta name="viewport" content="width=device-width, initial-scale=1.0" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> + <meta http-equiv="Content-Language" content="en" /> + <title>Falcon - Falcon Recipes</title> + <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> + <link rel="stylesheet" href="./css/site.css" /> + <link rel="stylesheet" href="./css/print.css" media="print" /> + + + <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script> + + + +<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script> + + </head> + <body class="topBarEnabled"> + + + + + + <div id="topbar" class="navbar navbar-fixed-top "> + <div class="navbar-inner"> + <div class="container" style="width: 68%;"><div class="nav-collapse"> + + + <ul class="nav"> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Falcon <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="index.html" title="About">About</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/Index"; title="Wiki">Wiki</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/News"; title="News">News</a> +</li> + + <li> <a href="https://git-wip-us.apache.org/repos/asf/falcon.git"; title="Git">Git</a> +</li> + + <li> <a href="https://svn.apache.org/repos/asf/falcon"; title="Svn">Svn</a> +</li> + + <li> <a href="https://issues.apache.org/jira/browse/FALCON"; title="Jira">Jira</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/PoweredBy"; title="Powered by">Powered by</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/Acknowledgements"; title="Acknowledgements">Acknowledgements</a> +</li> + + <li> <a href="http://blogs.apache.org/falcon/"; title="Blog">Blog</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="project-info.html" title="Summary">Summary</a> +</li> + + <li> <a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a> +</li> + + <li> <a href="http://webchat.freenode.net?channels=apachefalcon&uio=d4"; title="IRC">IRC</a> +</li> + + <li> <a href="team-list.html" title="Team">Team</a> +</li> + + <li> <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a> +</li> + + <li> <a href="source-repository.html" title="Source Repository">Source Repository</a> +</li> + + <li> <a href="license.html" title="License">License</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="http://www.apache.org/dyn/closer.cgi/falcon/0.6-incubating"; title="0.6-incubating">0.6-incubating</a> +</li> + + <li> <a href="http://archive.apache.org/dist/incubator/falcon/0.5-incubating"; title="0.5-incubating">0.5-incubating</a> +</li> + + <li> <a href="http://archive.apache.org/dist/incubator/falcon/0.4-incubating"; title="0.4-incubating">0.4-incubating</a> +</li> + + <li> <a href="http://archive.apache.org/dist/incubator/falcon/0.3-incubating"; title="0.3-incubating">0.3-incubating</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/Roadmap"; title="Coming soon">Coming soon</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="0.6-incubating/index.html" title="current">current</a> +</li> + + <li> <a href="0.6-incubating/index.html" title="0.6-incubating">0.6-incubating</a> +</li> + + <li> <a href="0.5-incubating/index.html" title="0.5-incubating">0.5-incubating</a> +</li> + + <li> <a href="0.4-incubating/index.html" title="0.4-incubating">0.4-incubating</a> +</li> + + <li> <a href="0.3-incubating/index.html" title="0.3-incubating">0.3-incubating</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Resources <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="slides/falcon-overview.html" title="Overview">Overview</a> +</li> + + <li> <a href="slides/falcon-user-guide.html" title="User Guide">User Guide</a> +</li> + + <li> <a href="GettingStarted.html" title="Getting Started">Getting Started</a> +</li> + + <li> <a href="FalconDocumentation.html" title="Architecture">Architecture</a> +</li> + + <li> <a href="InstallationSteps.html" title="Installation">Installation</a> +</li> + + <li> <a href="OnBoarding.html" title="On Boarding">On Boarding</a> +</li> + + <li> <a href="EntitySpecification.html" title="Entity Specification">Entity Specification</a> +</li> + + <li> <a href="FalconCLI.html" title="Client (Falcon CLI)">Client (Falcon CLI)</a> +</li> + + <li> <a href="restapi/ResourceList.html" title="Rest API">Rest API</a> +</li> + + <li> <a href="HiveIntegration.html" title="Hive Integration">Hive Integration</a> +</li> + + <li> <a href="Security.html" title="Security">Security</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a> +</li> + + <li> <a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a> +</li> + + <li> <a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a> +</li> + + <li> <a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a> +</li> + </ul> + </li> + </ul> + + + + + + + <iframe src="http://www.facebook.com/plugins/like.php?href=http://falcon.apache.org/falcon-website-general&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; + scrolling="no" frameborder="0" + style="border:none; width:80px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> + + <script type="text/javascript" src="https://apis.google.com/js/plusone.js";></script> + + <ul class="nav pull-right"><li style="margin-top: 10px;"> + + <div class="g-plusone" data-href="http://falcon.apache.org/falcon-website-general"; data-size="medium" width="60px" align="right" ></div> + + </li></ul> + + + </div> + + </div> + </div> + </div> + + <div class="container"> + <div id="banner"> + <div class="pull-left"> + <a href="../index.html" id="bannerLeft"> + <img src="images/falcon-logo.png" alt="Falcon" width="200px" height="45px"/> + </a> + </div> + <div class="pull-right"> <a href="http://www.apache.org"; id="bannerRight"> + <img src="images/apache-feather-tm.gif" alt="Falcon" height="45px"/> + </a> + </div> + <div class="clear"><hr/></div> + </div> + + <div id="breadcrumbs"> + <ul class="breadcrumb"> + + + <li class=""> + <a href="http://www.apache.org"; class="externalLink" title="Apache"> + Apache</a> + </li> + <li class="divider ">/</li> + <li class=""> + <a href="index.html" title="Falcon"> + Falcon</a> + </li> + <li class="divider ">/</li> + <li class="">Falcon Recipes</li> + + + + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> + + </ul> + </div> + + + + <div id="bodyColumn" > + + <div class="section"> +<h2>Falcon Recipes<a name="Falcon_Recipes"></a></h2></div> +<div class="section"> +<h3>Overview<a name="Overview"></a></h3> +<p>A Falcon recipe is a static process template with parameterized workflow to realize a specific use case. Recipes are defined in user space. Recipes will not have support for update or lifecycle management.</p> +<p>For example:</p> +<p></p> +<ul> +<li>Replicating directories from one HDFS cluster to another (not timed partitions)</li> +<li>Replicating hive metadata (database, table, views, etc.)</li> +<li>Replicating between HDFS and Hive - either way</li> +<li>Data masking etc.</li></ul></div> +<div class="section"> +<h3>Proposal<a name="Proposal"></a></h3> +<p>Falcon provides a Process abstraction that encapsulates the configuration for a user workflow with scheduling controls. All recipes can be modeled as a Process with in Falcon which executes the user workflow periodically. The process and its associated workflow are parameterized. The user will provide a properties file with name value pairs that are substituted by falcon before scheduling it. Falcon translates these recipes as a process entity by replacing the parameters in the workflow definition.</p></div> +<div class="section"> +<h3>Falcon CLI recipe support<a name="Falcon_CLI_recipe_support"></a></h3> +<p><a href="./FalconCLI.html">Recipe command usage is defined here.</a></p> +<p>CLI accepts recipe option with a recipe name and optional tool and does the following:</p> +<ul> +<li>Validates the options; name option is mandatory and tool is optional and should be provided if user wants to override the base recipe tool</li> +<li>Looks for <name>-workflow.xml, <name>-template.xml and <name>.properties file in the path specified by falcon.recipe.path in client.properties. If files cannot be found then Falcon CLI will fail</li> +<li>Invokes a Tool to substitute the properties in the templated process for the recipe. By default invokes base tool if tool option is not passed. Tool is responsible for generating process entity at the path specified by FalconCLI</li> +<li>Validates the generated entity</li> +<li>Submit and schedule this entity</li> +<li>Generated process entity files are stored in tmp directory</li></ul></div> +<div class="section"> +<h3>Base Recipe tool<a name="Base_Recipe_tool"></a></h3> +<p>Falcon provides a base tool that recipes can override. Base Recipe tool does the following:</p> +<ul> +<li>Expects recipe template file path, recipe properties file path and path where process entity to be submitted should be generated. Validates these arguments</li> +<li>Validates the artifacts i.e. workflow and/or lib files specified in the recipe template exists on local filesystem or HDFS at the specified path else returns error</li> +<li>Copies if the artifacts exists on local filesystem +<ul> +<li>If workflow is on local FS then falcon.recipe.workflow.path in recipe property file is mandatory for it to be copied to HDFS. If templated process requires custom libs falcon.recipe.workflow.lib.path property is mandatory for them to be copied from Local FS to HDFS. Recipe tool will copy the local artifacts only if these properties are set in properties file</li></ul></li> +<li>Looks for the patten ##[A-Za-z0-9_.]*## in the templated process and substitutes it with the properties. Process entity generated after the substitution is written to the empty file passed by FalconCLI</li></ul></div> +<div class="section"> +<h3>Recipe template file format<a name="Recipe_template_file_format"></a></h3> +<p></p> +<ul> +<li>Any templatized string should be in the format ##[A-Za-z0-9_.]*##.</li> +<li>There should be a corresponding entry in the recipe properties file "falcon.recipe.<templatized-string> = <value to be substituted>"</li></ul> +<div class="source"> +<pre> +Example: If the entry in recipe template is <workflow name="##workflow.name##"> there should be a corresponding entry in the recipe properties file falcon.recipe.workflow.name=hdfs-dr-workflow + +</pre></div></div> +<div class="section"> +<h3>Recipe properties file format<a name="Recipe_properties_file_format"></a></h3> +<p></p> +<ul> +<li>Regular key value pair properties file</li> +<li>Property key should be prefixed by "falcon.recipe."</li></ul> +<div class="source"> +<pre> +Example: falcon.recipe.workflow.name=hdfs-dr-workflow +Recipe template will have <workflow name="##workflow.name##">. Recipe tool will look for the patten ##workflow.name## +and replace it with the property value "hdfs-dr-workflow". Substituted template will have <workflow name="hdfs-dr-workflow"> + +</pre></div></div> +<div class="section"> +<h3>Managing the scheduled recipe process<a name="Managing_the_scheduled_recipe_process"></a></h3> +<p></p> +<ul> +<li>Scheduled recipe process is similar to regular process +<ul> +<li>List : falcon entity -type process -name <recipe-process-name> -list</li> +<li>Status : falcon entity -type process -name <recipe-process-name> -status</li> +<li>Delete : falcon entity -type process -name <recipe-process-name> -delete</li></ul></li></ul></div> +<div class="section"> +<h3>Sample recipes<a name="Sample_recipes"></a></h3> +<p></p> +<ul> +<li>Sample recipes are published in addons/recipes</li></ul></div> +<div class="section"> +<h3>Packaging<a name="Packaging"></a></h3> +<p></p> +<ul> +<li>There is no packaging for recipes at this time but will be added soon.</li></ul></div> + </div> + </div> + + <hr/> + + <footer> + <div class="container"> + <div class="row span12">Copyright © 2013-2015 + <a href="http://www.apache.org";>Apache Software Foundation</a>. + All Rights Reserved. + + </div> + + + <p id="poweredBy" class="pull-right"> + <a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> + <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> + </a> + </p> + + </div> + </footer> + </body> +</html> Modified: falcon/site/restapi/AdjacentVertices.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/AdjacentVertices.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/AdjacentVertices.html (original) +++ falcon/site/restapi/AdjacentVertices.html Wed Feb 18 10:55:56 2015 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> - <title>Falcon - GET api/graphs/lineage/vertices/:id/:direction</title> + <title>Falcon - GET api/metadata/lineage/vertices/:id/:direction</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="../css/site.css" /> <link rel="stylesheet" href="../css/print.css" media="print" /> @@ -241,11 +241,11 @@ Falcon</a> </li> <li class="divider ">/</li> - <li class="">GET api/graphs/lineage/vertices/:id/:direction</li> + <li class="">GET api/metadata/lineage/vertices/:id/:direction</li> - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -255,7 +255,7 @@ <div id="bodyColumn" > <div class="section"> -<h3>GET api/graphs/lineage/vertices/:id/:direction<a name="GET_apigraphslineagevertices:id:direction"></a></h3> +<h3>GET api/metadata/lineage/vertices/:id/:direction<a name="GET_apimetadatalineagevertices:id:direction"></a></h3> <p></p> <ul> <li><a href="#Description">Description</a></li> @@ -294,7 +294,7 @@ <h4>Rest Call<a name="Rest_Call"></a></h4> <div class="source"> <pre> -GET http://localhost:15000/api/graphs/lineage/vertices/4/out +GET http://localhost:15000/api/metadata/lineage/vertices/4/out </pre></div></div> <div class="section"> @@ -319,7 +319,7 @@ GET http://localhost:15000/api/graphs/li <h4>Rest Call<a name="Rest_Call"></a></h4> <div class="source"> <pre> -GET http://localhost:15000/api/graphs/lineage/vertices/4/bothE +GET http://localhost:15000/api/metadata/lineage/vertices/4/bothE </pre></div></div> <div class="section"> Modified: falcon/site/restapi/AdminConfig.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/AdminConfig.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/AdminConfig.html (original) +++ falcon/site/restapi/AdminConfig.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/admin/config/:config-type</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/AdminStack.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/AdminStack.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/AdminStack.html (original) +++ falcon/site/restapi/AdminStack.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/admin/stack</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/AdminVersion.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/AdminVersion.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/AdminVersion.html (original) +++ falcon/site/restapi/AdminVersion.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/admin/version</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/AllEdges.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/AllEdges.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/AllEdges.html (original) +++ falcon/site/restapi/AllEdges.html Wed Feb 18 10:55:56 2015 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> - <title>Falcon - GET pi/graphs/lineage//edges/all</title> + <title>Falcon - GET pi/metadata/lineage//edges/all</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="../css/site.css" /> <link rel="stylesheet" href="../css/print.css" media="print" /> @@ -241,11 +241,11 @@ Falcon</a> </li> <li class="divider ">/</li> - <li class="">GET pi/graphs/lineage//edges/all</li> + <li class="">GET pi/metadata/lineage//edges/all</li> - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -255,7 +255,7 @@ <div id="bodyColumn" > <div class="section"> -<h3>GET pi/graphs/lineage//edges/all<a name="GET_pigraphslineageedgesall"></a></h3> +<h3>GET pi/metadata/lineage//edges/all<a name="GET_pimetadatalineageedgesall"></a></h3> <p></p> <ul> <li><a href="#Description">Description</a></li> @@ -277,7 +277,7 @@ <h4>Rest Call<a name="Rest_Call"></a></h4> <div class="source"> <pre> -GET http://localhost:15000/api/graphs/lineage/edges/all +GET http://localhost:15000/api/metadata/lineage/edges/all </pre></div></div> <div class="section"> Modified: falcon/site/restapi/AllVertices.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/AllVertices.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/AllVertices.html (original) +++ falcon/site/restapi/AllVertices.html Wed Feb 18 10:55:56 2015 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> - <title>Falcon - GET api/graphs/lineage/vertices/all</title> + <title>Falcon - GET api/metadata/lineage/vertices/all</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="../css/site.css" /> <link rel="stylesheet" href="../css/print.css" media="print" /> @@ -241,11 +241,11 @@ Falcon</a> </li> <li class="divider ">/</li> - <li class="">GET api/graphs/lineage/vertices/all</li> + <li class="">GET api/metadata/lineage/vertices/all</li> - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -255,7 +255,7 @@ <div id="bodyColumn" > <div class="section"> -<h3>GET api/graphs/lineage/vertices/all<a name="GET_apigraphslineageverticesall"></a></h3> +<h3>GET api/metadata/lineage/vertices/all<a name="GET_apimetadatalineageverticesall"></a></h3> <p></p> <ul> <li><a href="#Description">Description</a></li> @@ -277,7 +277,7 @@ <h4>Rest Call<a name="Rest_Call"></a></h4> <div class="source"> <pre> -GET http://localhost:15000/api/graphs/lineage/vertices/all +GET http://localhost:15000/api/metadata/lineage/vertices/all </pre></div></div> <div class="section"> Modified: falcon/site/restapi/Edge.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/Edge.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/Edge.html (original) +++ falcon/site/restapi/Edge.html Wed Feb 18 10:55:56 2015 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> - <title>Falcon - GET api/graphs/lineage/edges/:id</title> + <title>Falcon - GET api/metadata/lineage/edges/:id</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="../css/site.css" /> <link rel="stylesheet" href="../css/print.css" media="print" /> @@ -241,11 +241,11 @@ Falcon</a> </li> <li class="divider ">/</li> - <li class="">GET api/graphs/lineage/edges/:id</li> + <li class="">GET api/metadata/lineage/edges/:id</li> - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -255,7 +255,7 @@ <div id="bodyColumn" > <div class="section"> -<h3>GET api/graphs/lineage/edges/:id<a name="GET_apigraphslineageedges:id"></a></h3> +<h3>GET api/metadata/lineage/edges/:id<a name="GET_apimetadatalineageedges:id"></a></h3> <p></p> <ul> <li><a href="#Description">Description</a></li> @@ -279,7 +279,7 @@ <h4>Rest Call<a name="Rest_Call"></a></h4> <div class="source"> <pre> -GET http://localhost:15000/api/graphs/lineage/edges/Q6t-c-5g +GET http://localhost:15000/api/metadata/lineage/edges/Q6t-c-5g </pre></div></div> <div class="section"> Modified: falcon/site/restapi/EntityDefinition.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityDefinition.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntityDefinition.html (original) +++ falcon/site/restapi/EntityDefinition.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/entities/definition/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntityDelete.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityDelete.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntityDelete.html (original) +++ falcon/site/restapi/EntityDelete.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - DELETE /api/entities/delete/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntityDependencies.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityDependencies.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntityDependencies.html (original) +++ falcon/site/restapi/EntityDependencies.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/entities/dependencies/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Added: falcon/site/restapi/EntityLineage.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityLineage.html?rev=1660589&view=auto ============================================================================== --- falcon/site/restapi/EntityLineage.html (added) +++ falcon/site/restapi/EntityLineage.html Wed Feb 18 10:55:56 2015 @@ -0,0 +1,330 @@ +<!DOCTYPE html> +<!-- + | Generated by Apache Maven Doxia at 2015-02-18 + | Rendered using Apache Maven Fluido Skin 1.3.0 +--> +<html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> + <head> + <meta charset="UTF-8" /> + <meta name="viewport" content="width=device-width, initial-scale=1.0" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> + <meta http-equiv="Content-Language" content="en" /> + <title>Falcon - GET api/metadata/lineage/entities?pipeline=:pipeline</title> + <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> + <link rel="stylesheet" href="../css/site.css" /> + <link rel="stylesheet" href="../css/print.css" media="print" /> + + + <script type="text/javascript" src="../js/apache-maven-fluido-1.3.0.min.js"></script> + + + +<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script> + + </head> + <body class="topBarEnabled"> + + + + + + <div id="topbar" class="navbar navbar-fixed-top "> + <div class="navbar-inner"> + <div class="container" style="width: 68%;"><div class="nav-collapse"> + + + <ul class="nav"> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Falcon <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="../index.html" title="About">About</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/Index"; title="Wiki">Wiki</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/News"; title="News">News</a> +</li> + + <li> <a href="https://git-wip-us.apache.org/repos/asf/falcon.git"; title="Git">Git</a> +</li> + + <li> <a href="https://svn.apache.org/repos/asf/falcon"; title="Svn">Svn</a> +</li> + + <li> <a href="https://issues.apache.org/jira/browse/FALCON"; title="Jira">Jira</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/PoweredBy"; title="Powered by">Powered by</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/Acknowledgements"; title="Acknowledgements">Acknowledgements</a> +</li> + + <li> <a href="http://blogs.apache.org/falcon/"; title="Blog">Blog</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="../project-info.html" title="Summary">Summary</a> +</li> + + <li> <a href="../mail-lists.html" title="Mailing Lists">Mailing Lists</a> +</li> + + <li> <a href="http://webchat.freenode.net?channels=apachefalcon&uio=d4"; title="IRC">IRC</a> +</li> + + <li> <a href="../team-list.html" title="Team">Team</a> +</li> + + <li> <a href="../issue-tracking.html" title="Issue Tracking">Issue Tracking</a> +</li> + + <li> <a href="../source-repository.html" title="Source Repository">Source Repository</a> +</li> + + <li> <a href="../license.html" title="License">License</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="http://www.apache.org/dyn/closer.cgi/falcon/0.6-incubating"; title="0.6-incubating">0.6-incubating</a> +</li> + + <li> <a href="http://archive.apache.org/dist/incubator/falcon/0.5-incubating"; title="0.5-incubating">0.5-incubating</a> +</li> + + <li> <a href="http://archive.apache.org/dist/incubator/falcon/0.4-incubating"; title="0.4-incubating">0.4-incubating</a> +</li> + + <li> <a href="http://archive.apache.org/dist/incubator/falcon/0.3-incubating"; title="0.3-incubating">0.3-incubating</a> +</li> + + <li> <a href="https://cwiki.apache.org/confluence/display/FALCON/Roadmap"; title="Coming soon">Coming soon</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="../0.6-incubating/index.html" title="current">current</a> +</li> + + <li> <a href="../0.6-incubating/index.html" title="0.6-incubating">0.6-incubating</a> +</li> + + <li> <a href="../0.5-incubating/index.html" title="0.5-incubating">0.5-incubating</a> +</li> + + <li> <a href="../0.4-incubating/index.html" title="0.4-incubating">0.4-incubating</a> +</li> + + <li> <a href="../0.3-incubating/index.html" title="0.3-incubating">0.3-incubating</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">Resources <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="../slides/falcon-overview.html" title="Overview">Overview</a> +</li> + + <li> <a href="../slides/falcon-user-guide.html" title="User Guide">User Guide</a> +</li> + + <li> <a href="../GettingStarted.html" title="Getting Started">Getting Started</a> +</li> + + <li> <a href="../FalconDocumentation.html" title="Architecture">Architecture</a> +</li> + + <li> <a href="../InstallationSteps.html" title="Installation">Installation</a> +</li> + + <li> <a href="../OnBoarding.html" title="On Boarding">On Boarding</a> +</li> + + <li> <a href="../EntitySpecification.html" title="Entity Specification">Entity Specification</a> +</li> + + <li> <a href="../FalconCLI.html" title="Client (Falcon CLI)">Client (Falcon CLI)</a> +</li> + + <li> <a href="../restapi/ResourceList.html" title="Rest API">Rest API</a> +</li> + + <li> <a href="../HiveIntegration.html" title="Hive Integration">Hive Integration</a> +</li> + + <li> <a href="../Security.html" title="Security">Security</a> +</li> + </ul> + </li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> + <ul class="dropdown-menu"> + + <li> <a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a> +</li> + + <li> <a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a> +</li> + + <li> <a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a> +</li> + + <li> <a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a> +</li> + </ul> + </li> + </ul> + + + + + + + <iframe src="http://www.facebook.com/plugins/like.php?href=http://falcon.apache.org/falcon-website-general&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; + scrolling="no" frameborder="0" + style="border:none; width:80px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> + + <script type="text/javascript" src="https://apis.google.com/js/plusone.js";></script> + + <ul class="nav pull-right"><li style="margin-top: 10px;"> + + <div class="g-plusone" data-href="http://falcon.apache.org/falcon-website-general"; data-size="medium" width="60px" align="right" ></div> + + </li></ul> + + + </div> + + </div> + </div> + </div> + + <div class="container"> + <div id="banner"> + <div class="pull-left"> + <a href="../../index.html" id="bannerLeft"> + <img src="../images/falcon-logo.png" alt="Falcon" width="200px" height="45px"/> + </a> + </div> + <div class="pull-right"> <a href="http://www.apache.org"; id="bannerRight"> + <img src="../images/apache-feather-tm.gif" alt="Falcon" height="45px"/> + </a> + </div> + <div class="clear"><hr/></div> + </div> + + <div id="breadcrumbs"> + <ul class="breadcrumb"> + + + <li class=""> + <a href="http://www.apache.org"; class="externalLink" title="Apache"> + Apache</a> + </li> + <li class="divider ">/</li> + <li class=""> + <a href="../index.html" title="Falcon"> + Falcon</a> + </li> + <li class="divider ">/</li> + <li class="">GET api/metadata/lineage/entities?pipeline=:pipeline</li> + + + + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> + + </ul> + </div> + + + + <div id="bodyColumn" > + + <div class="section"> +<h3>GET api/metadata/lineage/entities?pipeline=:pipeline<a name="GET_apimetadatalineageentitiespipeline:pipeline"></a></h3> +<p></p> +<ul> +<li><a href="#Description">Description</a></li> +<li><a href="#Parameters">Parameters</a></li> +<li><a href="#Results">Results</a></li> +<li><a href="#Examples">Examples</a></li></ul></div> +<div class="section"> +<h3>Description<a name="Description"></a></h3> +<p>It returns the graph depicting the relationship between the various processes and feeds in a given pipeline.</p></div> +<div class="section"> +<h3>Parameters<a name="Parameters"></a></h3> +<p></p> +<ul> +<li>:pipeline is the name of the pipeline</li></ul></div> +<div class="section"> +<h3>Results<a name="Results"></a></h3> +<p>It returns a json graph</p></div> +<div class="section"> +<h3>Examples<a name="Examples"></a></h3></div> +<div class="section"> +<h4>Rest Call<a name="Rest_Call"></a></h4> +<div class="source"> +<pre> +GET http://localhost:15000/api/metadata/lineage/entities?pipeline=my-pipeline + +</pre></div></div> +<div class="section"> +<h4>Result<a name="Result"></a></h4> +<div class="source"> +<pre> +{ + "vertices": ["my-minutely-process", "my-hourly-process"], + "edges": + [ + { + "from" : "my-minutely-process", + "to" : "my-hourly-process", + "label" : "my-minutely-feed" + }, + { + "from" : "my-hourly-process", + "to" : "my-minutely-process", + "label" : "my-hourly-feedback" + } + ] +} + +</pre></div></div> + </div> + </div> + + <hr/> + + <footer> + <div class="container"> + <div class="row span12">Copyright © 2013-2015 + <a href="http://www.apache.org";>Apache Software Foundation</a>. + All Rights Reserved. + + </div> + + + <p id="poweredBy" class="pull-right"> + <a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> + <img class="builtBy" alt="Built by Maven" src="../images/logos/maven-feather.png" /> + </a> + </p> + + </div> + </footer> + </body> +</html> Modified: falcon/site/restapi/EntityList.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityList.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntityList.html (original) +++ falcon/site/restapi/EntityList.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/entities/list/:entity-type?fields=:fields</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -273,6 +273,8 @@ <li>fields <optional param> Fields of entity that the user wants to view, separated by commas. <ul> <li>Valid options are STATUS, TAGS, PIPELINES.</li></ul></li> +<li>pattern <optional param> Find string which contains this sequence of characters. Example: pattern=abc</li></ul>* matching is case insensitive. * For example a pattern mhs will match a process named New-My-Hourly-Summary. +<ul> <li>filterBy <optional param> Filter results by list of field:value pairs. Example: filterBy=STATUS:RUNNING,PIPELINES:clickLogs <ul> <li>Supported filter fields are NAME, STATUS, PIPELINES, CLUSTER.</li> Modified: falcon/site/restapi/EntityResume.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityResume.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntityResume.html (original) +++ falcon/site/restapi/EntityResume.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - POST /api/entities/resume/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntitySchedule.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntitySchedule.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntitySchedule.html (original) +++ falcon/site/restapi/EntitySchedule.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - POST /api/entities/schedule/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntityStatus.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntityStatus.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntityStatus.html (original) +++ falcon/site/restapi/EntityStatus.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - GET /api/entities/status/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntitySubmit.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntitySubmit.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntitySubmit.html (original) +++ falcon/site/restapi/EntitySubmit.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - POST api/entities/submit/:entity-type</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntitySubmitAndSchedule.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntitySubmitAndSchedule.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntitySubmitAndSchedule.html (original) +++ falcon/site/restapi/EntitySubmitAndSchedule.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - POST /api/entities/submitAndSchedule/:entity-type</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> Modified: falcon/site/restapi/EntitySummary.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntitySummary.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntitySummary.html (original) +++ falcon/site/restapi/EntitySummary.html Wed Feb 18 10:55:56 2015 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> - <title>Falcon - GET /api/entities/summary/:entity-type/:cluster</title> + <title>Falcon - GET /api/entities/summary/:entity-type</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="../css/site.css" /> <link rel="stylesheet" href="../css/print.css" media="print" /> @@ -241,11 +241,11 @@ Falcon</a> </li> <li class="divider ">/</li> - <li class="">GET /api/entities/summary/:entity-type/:cluster</li> + <li class="">GET /api/entities/summary/:entity-type</li> - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div> @@ -255,7 +255,7 @@ <div id="bodyColumn" > <div class="section"> -<h3>GET /api/entities/summary/:entity-type/:cluster<a name="GET_apientitiessummary:entity-type:cluster"></a></h3> +<h3>GET /api/entities/summary/:entity-type<a name="GET_apientitiessummary:entity-type"></a></h3> <p></p> <ul> <li><a href="#Description">Description</a></li> @@ -269,8 +269,8 @@ <h3>Parameters<a name="Parameters"></a></h3> <p></p> <ul> -<li>:entity-type Valid options are cluster, feed or process.</li> -<li>:cluster Show entities that belong to this cluster.</li> +<li>:entity-type Valid options are feed or process.</li> +<li>cluster Show entities that belong to this cluster.</li> <li>start <optional param> Show entity summaries from this date. Date format is yyyy-MM-dd'T'HH:mm'Z'. <ul> <li>By default, it is set to (end - 2 days).</li></ul></li> @@ -303,7 +303,7 @@ <h4>Rest Call<a name="Rest_Call"></a></h4> <div class="source"> <pre> -GET http://localhost:15000/api/entities/summary/feed/primary-cluster?filterBy=STATUS:RUNNING&fields=status&[email protected]&orderBy=name&offset=0&numResults=1&numInstances=2 +GET http://localhost:15000/api/entities/summary/feed?cluster=primary-cluster&filterBy=STATUS:RUNNING&fields=status&[email protected]&orderBy=name&offset=0&numResults=1&numInstances=2 </pre></div></div> <div class="section"> Modified: falcon/site/restapi/EntitySuspend.html URL: http://svn.apache.org/viewvc/falcon/site/restapi/EntitySuspend.html?rev=1660589&r1=1660588&r2=1660589&view=diff ============================================================================== --- falcon/site/restapi/EntitySuspend.html (original) +++ falcon/site/restapi/EntitySuspend.html Wed Feb 18 10:55:56 2015 @@ -1,13 +1,13 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2015-01-11 + | Generated by Apache Maven Doxia at 2015-02-18 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20150111" /> + <meta name="Date-Revision-yyyymmdd" content="20150218" /> <meta http-equiv="Content-Language" content="en" /> <title>Falcon - POST /api/entities/suspend/:entity-type/:entity-name</title> <link rel="stylesheet" href="../css/apache-maven-fluido-1.3.0.min.css" /> @@ -245,7 +245,7 @@ - <li id="publishDate" class="pull-right">Last Published: 2015-01-11</li> + <li id="publishDate" class="pull-right">Last Published: 2015-02-18</li> </ul> </div>
