http://git-wip-us.apache.org/repos/asf/atlas-website/blob/c3e5130b/Export-HDFS-API.html ---------------------------------------------------------------------- diff --git a/Export-HDFS-API.html b/Export-HDFS-API.html index 831f505..8f2380f 100644 --- a/Export-HDFS-API.html +++ b/Export-HDFS-API.html @@ -1,221 +1,118 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-08-09 - | Rendered using Apache Maven Fluido Skin 1.3.0 + | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Export-HDFS-API.twiki at 2018-01-25 + | Rendered using Apache Maven Fluido Skin 1.7 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170809" /> + <meta name="Date-Revision-yyyymmdd" content="20180125" /> <meta http-equiv="Content-Language" content="en" /> <title>Apache Atlas – Export & Import APIs for HDFS Path</title> - <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> + <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> - - - <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script> - - - -<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script> - - </head> - <body class="topBarEnabled"> - - - - - + <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script> + </head> + <body class="topBarEnabled"> <div id="topbar" class="navbar navbar-fixed-top "> <div class="navbar-inner"> - <div class="container" style="width: 68%;"><div class="nav-collapse"> - - - <ul class="nav"> - <li class="dropdown"> + <div class="container" style="width: 68%;"><div class="nav-collapse"> + <ul class="nav"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Atlas <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="index.html" title="About">About</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a> -</li> - - <li> <a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a> -</li> - - <li> <a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a> -</li> - - <li> <a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a> -</li> - </ul> + <li><a href="index.html" title="About">About</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a></li> + <li><a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a></li> + <li><a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a></li> + <li><a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="project-info.html" title="Summary">Summary</a> -</li> - - <li> <a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a> -</li> - - <li> <a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a> -</li> - - <li> <a href="team-list.html" title="Team">Team</a> -</li> - - <li> <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a> -</li> - - <li> <a href="source-repository.html" title="Source Repository">Source Repository</a> -</li> - - <li> <a href="license.html" title="License">License</a> -</li> - </ul> + <li><a href="project-info.html" title="Summary">Summary</a></li> + <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li> + <li><a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a></li> + <li><a href="team-list.html" title="Team">Team</a></li> + <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li> + <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li> + <li><a href="license.html" title="License">License</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/1.0.0-alpha/"; title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.1/"; title="0.8.1">0.8.1</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="1.0.0-alpha/index.html" title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="0.8.1/index.html" title="0.8.1">0.8.1</a></li> + <li><a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li> + <li><a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li> + <li><a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li> + <li><a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a> -</li> - - <li> <a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a> -</li> - - <li> <a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a> -</li> - - <li> <a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a> -</li> - </ul> + <li><a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a></li> + <li><a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a></li> + </ul> </li> - </ul> - - <form id="search-form" action="http://www.google.com/search"; method="get" class="navbar-search pull-right" > - + </ul> +<form id="search-form" action="https://www.google.com/search"; method="get" class="navbar-search pull-right" > <input value="http://atlas.apache.org"; name="sitesearch" type="hidden"/> <input class="search-query" name="q" id="query" type="text" /> </form> -<script type="text/javascript" src="http://www.google.com/coop/cse/brand?form=search-form";></script> - - - - - - <iframe src="http://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; +<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script> + <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; scrolling="no" frameborder="0" - style="border:none; width:80px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> - - <script type="text/javascript" src="https://apis.google.com/js/plusone.js";></script> - - <ul class="nav pull-right"><li style="margin-top: 10px;"> - + style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> + <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script> + <ul class="nav pull-right"><li style="margin-top: 10px;"> <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs"; data-size="medium" width="60px" align="right" ></div> - - </li></ul> - - - </div> - + </li></ul> + </div> </div> </div> </div> - - <div class="container"> - <div id="banner"> - <div class="pull-left"> - <a href=".." id="bannerLeft"> - <img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/> - </a> - </div> - <div class="pull-right"> </div> + <div class="container"> + <div id="banner"> + <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div> + <div class="pull-right"></div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> - - - <li class=""> - <a href="http://www.apache.org"; class="externalLink" title="Apache"> - Apache</a> - </li> - <li class="divider ">/</li> - <li class=""> - <a href="index.html" title="Atlas"> - Atlas</a> - </li> - <li class="divider ">/</li> - <li class="">Export & Import APIs for HDFS Path</li> - - - - <li id="publishDate" class="pull-right">Last Published: 2017-08-09</li> <li class="divider pull-right">|</li> - <li id="projectVersion" class="pull-right">Version: 0.9-SNAPSHOT</li> - - </ul> + <li class=""><a href="http://www.apache.org"; class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li> + <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li> + <li class="active ">Export & Import APIs for HDFS Path</li> + <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2018-01-25</li> + <li id="projectVersion" class="pull-right">Version: 1.0.0-alpha</li> + </ul> </div> - - - <div id="bodyColumn" > - - <div class="section"> -<h2><a name="Export__Import_APIs_for_HDFS_Path"></a>Export & Import APIs for HDFS Path</h2></div> +<div class="section"> +<h2><a name="Export_.26_Import_APIs_for_HDFS_Path"></a>Export & Import APIs for HDFS Path</h2></div> <div class="section"> <h4><a name="Introduction"></a>Introduction</h4> <p>The general approach for using the Import-Export APIs for HDFS Paths remain the same. There are minor variations caused how HDFS paths are handled within Atlas.</p> @@ -229,8 +126,7 @@ <div class="section"> <h4><a name="Example_Using_CURL_Calls"></a>Example Using CURL Calls</h4> <p>Below are sample CURL calls that performs export operation on the <i>Sample HDFS Setup</i> shown above.</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> curl -X POST -u adminuser:password -H "Content-Type: application/json" -H "Cache-Control: no-cache" -d '{ "itemsToExport": [ { "typeName": "hdfs_path", "uniqueAttributes": { "name": "FinanceAll" } @@ -243,27 +139,17 @@ curl -X POST -u adminuser:password -H "Content-Type: application/json" }' "http://localhost:21000/api/atlas/admin/export" > financeAll.zip </pre></div></div> - </div> - </div> - + </div> + </div> <hr/> - <footer> - <div class="container"> - <div class="row span12">Copyright © 2015-2017 - <a href="http://www.apache.org";>Apache Software Foundation</a>. - All Rights Reserved. - + <div class="container"> + <div class="row"> +Copyright é 2018 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. + </div> + <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a> +</p> </div> - - - <p id="poweredBy" class="pull-right"> - <a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> - <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> - </a> - </p> - - </div> </footer> </body> </html>
http://git-wip-us.apache.org/repos/asf/atlas-website/blob/c3e5130b/HighAvailability.html ---------------------------------------------------------------------- diff --git a/HighAvailability.html b/HighAvailability.html index f56ca1a..12d896c 100644 --- a/HighAvailability.html +++ b/HighAvailability.html @@ -1,220 +1,117 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-08-09 - | Rendered using Apache Maven Fluido Skin 1.3.0 + | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/HighAvailability.twiki at 2018-01-25 + | Rendered using Apache Maven Fluido Skin 1.7 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170809" /> + <meta name="Date-Revision-yyyymmdd" content="20180125" /> <meta http-equiv="Content-Language" content="en" /> <title>Apache Atlas – Fault Tolerance and High Availability Options</title> - <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> + <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> - - - <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script> - - - -<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script> - - </head> - <body class="topBarEnabled"> - - - - - + <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script> + </head> + <body class="topBarEnabled"> <div id="topbar" class="navbar navbar-fixed-top "> <div class="navbar-inner"> - <div class="container" style="width: 68%;"><div class="nav-collapse"> - - - <ul class="nav"> - <li class="dropdown"> + <div class="container" style="width: 68%;"><div class="nav-collapse"> + <ul class="nav"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Atlas <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="index.html" title="About">About</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a> -</li> - - <li> <a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a> -</li> - - <li> <a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a> -</li> - - <li> <a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a> -</li> - </ul> + <li><a href="index.html" title="About">About</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a></li> + <li><a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a></li> + <li><a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a></li> + <li><a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="project-info.html" title="Summary">Summary</a> -</li> - - <li> <a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a> -</li> - - <li> <a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a> -</li> - - <li> <a href="team-list.html" title="Team">Team</a> -</li> - - <li> <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a> -</li> - - <li> <a href="source-repository.html" title="Source Repository">Source Repository</a> -</li> - - <li> <a href="license.html" title="License">License</a> -</li> - </ul> + <li><a href="project-info.html" title="Summary">Summary</a></li> + <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li> + <li><a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a></li> + <li><a href="team-list.html" title="Team">Team</a></li> + <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li> + <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li> + <li><a href="license.html" title="License">License</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/1.0.0-alpha/"; title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.1/"; title="0.8.1">0.8.1</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="1.0.0-alpha/index.html" title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="0.8.1/index.html" title="0.8.1">0.8.1</a></li> + <li><a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li> + <li><a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li> + <li><a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li> + <li><a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a> -</li> - - <li> <a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a> -</li> - - <li> <a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a> -</li> - - <li> <a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a> -</li> - </ul> + <li><a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a></li> + <li><a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a></li> + </ul> </li> - </ul> - - <form id="search-form" action="http://www.google.com/search"; method="get" class="navbar-search pull-right" > - + </ul> +<form id="search-form" action="https://www.google.com/search"; method="get" class="navbar-search pull-right" > <input value="http://atlas.apache.org"; name="sitesearch" type="hidden"/> <input class="search-query" name="q" id="query" type="text" /> </form> -<script type="text/javascript" src="http://www.google.com/coop/cse/brand?form=search-form";></script> - - - - - - <iframe src="http://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; +<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script> + <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; scrolling="no" frameborder="0" - style="border:none; width:80px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> - - <script type="text/javascript" src="https://apis.google.com/js/plusone.js";></script> - - <ul class="nav pull-right"><li style="margin-top: 10px;"> - + style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> + <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script> + <ul class="nav pull-right"><li style="margin-top: 10px;"> <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs"; data-size="medium" width="60px" align="right" ></div> - - </li></ul> - - - </div> - + </li></ul> + </div> </div> </div> </div> - - <div class="container"> - <div id="banner"> - <div class="pull-left"> - <a href=".." id="bannerLeft"> - <img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/> - </a> - </div> - <div class="pull-right"> </div> + <div class="container"> + <div id="banner"> + <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div> + <div class="pull-right"></div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> - - - <li class=""> - <a href="http://www.apache.org"; class="externalLink" title="Apache"> - Apache</a> - </li> - <li class="divider ">/</li> - <li class=""> - <a href="index.html" title="Atlas"> - Atlas</a> - </li> - <li class="divider ">/</li> - <li class="">Fault Tolerance and High Availability Options</li> - - - - <li id="publishDate" class="pull-right">Last Published: 2017-08-09</li> <li class="divider pull-right">|</li> - <li id="projectVersion" class="pull-right">Version: 0.9-SNAPSHOT</li> - - </ul> + <li class=""><a href="http://www.apache.org"; class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li> + <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li> + <li class="active ">Fault Tolerance and High Availability Options</li> + <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2018-01-25</li> + <li id="projectVersion" class="pull-right">Version: 1.0.0-alpha</li> + </ul> </div> - - - <div id="bodyColumn" > - - <div class="section"> +<div class="section"> <h2><a name="Fault_Tolerance_and_High_Availability_Options"></a>Fault Tolerance and High Availability Options</h2></div> <div class="section"> <h3><a name="Introduction"></a>Introduction</h3> @@ -247,8 +144,7 @@ <li>For each physical machine, list the IP Address/hostname and port as the value of the configuration <tt>atlas.server.address.id</tt>, where <tt>id</tt> refers to the identifier string for this physical machine. <ul> <li>For e.g., if you have selected 2 machines with hostnames <tt>host1.company.com</tt> and <tt>host2.company.com</tt>, you can define the configuration options as below:</li></ul></li></ul> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> atlas.server.ids=id1,id2 atlas.server.address.id1=host1.company.com:21000 atlas.server.address.id2=host2.company.com:21000 @@ -257,8 +153,7 @@ <p></p> <ul> <li>Define the Zookeeper quorum which will be used by the Atlas High Availability feature.</li></ul> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> atlas.server.ha.zookeeper.connect=zk1.company.com:2181,zk2.company.com:2181,zk3.company.com:2181 </pre></div> @@ -271,8 +166,7 @@ <li>Start the dependent components.</li> <li>Start each instance of the Atlas Web Service.</li></ul> <p>To verify that High Availability is working, run the following script on each of the instances where Atlas Web Service is installed.</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> $ATLAS_HOME/bin/atlas_admin.py -status </pre></div> @@ -296,8 +190,7 @@ $ATLAS_HOME/bin/atlas_admin.py -status <h5><a name="Using_an_intermediate_proxy"></a>Using an intermediate proxy</h5> <p>The simplest solution to enable highly available access to Atlas is to install and configure some intermediate proxy that has a capability to transparently switch services based on status. One such proxy solution is <a class="externalLink" href="http://www.haproxy.org/";>HAProxy</a>.</p> <p>Here is an example HAProxy configuration that can be used. Note this is provided for illustration only, and not as a recommended production configuration. For that, please refer to the HAProxy documentation for appropriate instructions.</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> frontend atlas_fe bind *:41000 default_backend atlas_be @@ -332,7 +225,7 @@ listen atlas <li>A servlet filter ensures that only the active instance services user requests. If a passive instance receives these requests, it automatically redirects them to the current active instance.</li></ul></div> <div class="section"> <h3><a name="Metadata_Store"></a>Metadata Store</h3> -<p>As described above, Atlas uses Titan to store the metadata it manages. By default, Atlas uses a standalone HBase instance as the backing store for Titan. In order to provide HA for the metadata store, we recommend that Atlas be configured to use distributed HBase as the backing store for Titan. Doing this implies that you could benefit from the HA guarantees HBase provides. In order to configure Atlas to use HBase in HA mode, do the following:</p> +<p>As described above, Atlas uses <a href="./JanusGraph.html">JanusGraph</a> to store the metadata it manages. By default, Atlas uses a standalone HBase instance as the backing store for <a href="./JanusGraph.html">JanusGraph</a>. In order to provide HA for the metadata store, we recommend that Atlas be configured to use distributed HBase as the backing store for <a href="./JanusGraph.html">JanusGraph</a>. Doing this implies that you could benefit from the HA guarantees HBase provides. In order to configure Atlas to use HBase in HA mode, do the following:</p> <p></p> <ul> <li>Choose an existing HBase cluster that is set up in HA mode to configure in Atlas (OR) Set up a new HBase cluster in <a class="externalLink" href="http://hbase.apache.org/book.html#quickstart_fully_distributed";>HA mode</a>. @@ -343,7 +236,7 @@ listen atlas <li>Refer to the <a href="./Configuration.html">Configuration page</a> for the options to configure in atlas.properties to setup Atlas with HBase.</li></ul></li></ul></div> <div class="section"> <h3><a name="Index_Store"></a>Index Store</h3> -<p>As described above, Atlas indexes metadata through Titan to support full text search queries. In order to provide HA for the index store, we recommend that Atlas be configured to use Solr as the backing index store for Titan. In order to configure Atlas to use Solr in HA mode, do the following:</p> +<p>As described above, Atlas indexes metadata through <a href="./JanusGraph.html">JanusGraph</a> to support full text search queries. In order to provide HA for the index store, we recommend that Atlas be configured to use Solr as the backing index store for <a href="./JanusGraph.html">JanusGraph</a>. In order to configure Atlas to use Solr in HA mode, do the following:</p> <p></p> <ul> <li>Choose an existing SolrCloud cluster setup in HA mode to configure in Atlas (OR) Set up a new <a class="externalLink" href="https://cwiki.apache.org/confluence/display/solr/SolrCloud";>SolrCloud cluster</a>. @@ -366,8 +259,7 @@ listen atlas <li>The number of partitions for the ATLAS topics should be set to 1 (numPartitions)</li> <li>Decide number of replicas for Kafka topic: Set this to at least 2 for redundancy.</li> <li>Run the following commands:</li></ul></li></ul> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> $KAFKA_HOME/bin/kafka-topics.sh --create --zookeeper <list of zookeeper host:port entries> --topic ATLAS_HOOK --replication-factor <numReplicas> --partitions 1 $KAFKA_HOME/bin/kafka-topics.sh --create --zookeeper <list of zookeeper host:port entries> --topic ATLAS_ENTITIES --replication-factor <numReplicas> --partitions 1 Here KAFKA_HOME points to the Kafka installation directory. @@ -376,8 +268,7 @@ listen atlas <p></p> <ul> <li>In atlas-application.properties, set the following configuration:</li></ul> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> atlas.notification.embedded=false atlas.kafka.zookeeper.connect=<comma separated list of servers forming Zookeeper quorum used by Kafka> atlas.kafka.bootstrap.servers=<comma separated list of Kafka broker endpoints in host:port form> - Give at least 2 for redundancy. @@ -387,28 +278,18 @@ listen atlas <h3><a name="Known_Issues"></a>Known Issues</h3> <p></p> <ul> -<li>If the HBase region servers hosting the Atlas ‘titan’ HTable are down, Atlas would not be able to store or retrieve metadata from HBase until they are brought back online.</li></ul></div> - </div> - </div> - +<li>If the HBase region servers hosting the Atlas table are down, Atlas would not be able to store or retrieve metadata from HBase until they are brought back online.</li></ul></div> + </div> + </div> <hr/> - <footer> - <div class="container"> - <div class="row span12">Copyright © 2015-2017 - <a href="http://www.apache.org";>Apache Software Foundation</a>. - All Rights Reserved. - + <div class="container"> + <div class="row"> +Copyright é 2018 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. + </div> + <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a> +</p> </div> - - - <p id="poweredBy" class="pull-right"> - <a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> - <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> - </a> - </p> - - </div> </footer> </body> </html> http://git-wip-us.apache.org/repos/asf/atlas-website/blob/c3e5130b/Import-API-Options.html ---------------------------------------------------------------------- diff --git a/Import-API-Options.html b/Import-API-Options.html index beb6b38..61a865d 100644 --- a/Import-API-Options.html +++ b/Import-API-Options.html @@ -1,226 +1,122 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-08-09 - | Rendered using Apache Maven Fluido Skin 1.3.0 + | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Import-API-Options.twiki at 2018-01-25 + | Rendered using Apache Maven Fluido Skin 1.7 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170809" /> + <meta name="Date-Revision-yyyymmdd" content="20180125" /> <meta http-equiv="Content-Language" content="en" /> <title>Apache Atlas – Import API Options</title> - <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> + <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> - - - <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script> - - - -<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script> - - </head> - <body class="topBarEnabled"> - - - - - + <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script> + </head> + <body class="topBarEnabled"> <div id="topbar" class="navbar navbar-fixed-top "> <div class="navbar-inner"> - <div class="container" style="width: 68%;"><div class="nav-collapse"> - - - <ul class="nav"> - <li class="dropdown"> + <div class="container" style="width: 68%;"><div class="nav-collapse"> + <ul class="nav"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Atlas <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="index.html" title="About">About</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a> -</li> - - <li> <a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a> -</li> - - <li> <a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a> -</li> - - <li> <a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a> -</li> - </ul> + <li><a href="index.html" title="About">About</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a></li> + <li><a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a></li> + <li><a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a></li> + <li><a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="project-info.html" title="Summary">Summary</a> -</li> - - <li> <a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a> -</li> - - <li> <a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a> -</li> - - <li> <a href="team-list.html" title="Team">Team</a> -</li> - - <li> <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a> -</li> - - <li> <a href="source-repository.html" title="Source Repository">Source Repository</a> -</li> - - <li> <a href="license.html" title="License">License</a> -</li> - </ul> + <li><a href="project-info.html" title="Summary">Summary</a></li> + <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li> + <li><a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a></li> + <li><a href="team-list.html" title="Team">Team</a></li> + <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li> + <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li> + <li><a href="license.html" title="License">License</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/1.0.0-alpha/"; title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.1/"; title="0.8.1">0.8.1</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="1.0.0-alpha/index.html" title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="0.8.1/index.html" title="0.8.1">0.8.1</a></li> + <li><a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li> + <li><a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li> + <li><a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li> + <li><a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a> -</li> - - <li> <a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a> -</li> - - <li> <a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a> -</li> - - <li> <a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a> -</li> - </ul> + <li><a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a></li> + <li><a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a></li> + </ul> </li> - </ul> - - <form id="search-form" action="http://www.google.com/search"; method="get" class="navbar-search pull-right" > - + </ul> +<form id="search-form" action="https://www.google.com/search"; method="get" class="navbar-search pull-right" > <input value="http://atlas.apache.org"; name="sitesearch" type="hidden"/> <input class="search-query" name="q" id="query" type="text" /> </form> -<script type="text/javascript" src="http://www.google.com/coop/cse/brand?form=search-form";></script> - - - - - - <iframe src="http://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; +<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script> + <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; scrolling="no" frameborder="0" - style="border:none; width:80px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> - - <script type="text/javascript" src="https://apis.google.com/js/plusone.js";></script> - - <ul class="nav pull-right"><li style="margin-top: 10px;"> - + style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> + <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script> + <ul class="nav pull-right"><li style="margin-top: 10px;"> <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs"; data-size="medium" width="60px" align="right" ></div> - - </li></ul> - - - </div> - + </li></ul> + </div> </div> </div> </div> - - <div class="container"> - <div id="banner"> - <div class="pull-left"> - <a href=".." id="bannerLeft"> - <img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/> - </a> - </div> - <div class="pull-right"> </div> + <div class="container"> + <div id="banner"> + <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div> + <div class="pull-right"></div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> - - - <li class=""> - <a href="http://www.apache.org"; class="externalLink" title="Apache"> - Apache</a> - </li> - <li class="divider ">/</li> - <li class=""> - <a href="index.html" title="Atlas"> - Atlas</a> - </li> - <li class="divider ">/</li> - <li class="">Import API Options</li> - - - - <li id="publishDate" class="pull-right">Last Published: 2017-08-09</li> <li class="divider pull-right">|</li> - <li id="projectVersion" class="pull-right">Version: 0.9-SNAPSHOT</li> - - </ul> + <li class=""><a href="http://www.apache.org"; class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li> + <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li> + <li class="active ">Import API Options</li> + <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2018-01-25</li> + <li id="projectVersion" class="pull-right">Version: 1.0.0-alpha</li> + </ul> </div> - - - <div id="bodyColumn" > - - <div class="section"> +<div class="section"> <h2><a name="Import_API_Options"></a>Import API Options</h2> <p>Import API options are specified as <i>options</i> JSON. Since the API accepts multi-part form data, it is possible to sepecify multipls input streams within the CURL call.</p></div> <div class="section"> <h4><a name="Examples_Using_CURL_Calls"></a>Examples Using CURL Calls</h4> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data" -H "Cache-Control: no-cache" -F [email protected] @@ -229,8 +125,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data </pre></div> <p>To use the defaults, set the contents of <i>importOptions.json</i> to:</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> { "options": { } @@ -256,8 +151,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data <p>Example:</p> <p>The example below applies couple of transforms to the the <i>qualifiedName</i> attribute of hive_table. It converts the value to lower case, then searches for 'cl1', if found, replaces it with 'cl2'.</p> <p>To use the option, set the contents of <i>importOptions.json</i> to:</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> { "options": { "transforms": "{ \"hive_table\": { \"qualifiedName\": [ \"replace:@cl1:@cl2\" ] }, \"hive_db\": { \"qualifiedName\": [ \"replace:@cl1:@cl2\" ] } }" @@ -271,8 +165,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data <p>When an import operation is in progress and the server goes down, it would be possible to resume import from the last successfully imported entity. This would allow the import to resume from where it left off.</p> <p>Server-side logging is improved to display the detail of the last successfully imported entity, this includes the index within the import list and the entity's guid. Either can be used specify the point to resume import.</p> <p>To use the option, set the contents of <i>importOptions.json</i> to:</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> { "options": { @@ -281,13 +174,12 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data } </pre></div> -<p>To use <i>startIndex</i>, use the following in the <i>importOptions.json</i>:</p> -<div class="source"> -<pre> +<p>To use <i>startPosition</i>, use the following in the <i>importOptions.json</i>:</p> +<div class="source"><pre class="prettyprint"> { "options": { - "startIndex": "332" + "startPosition": "332" } } @@ -302,7 +194,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data <div class="section"> <h5><a name="Optional_Importing_Type_Definition"></a>Optional Importing Type Definition</h5> <p>The output of Export has <i>atlas-typedef.json</i> that contains the type definitions for the entities exported.</p> -<p>By default (that is if no options is specified), the type definitions are imported and applied to the system. The entity import is then performed.</p> +<p>By default (that is if no options is specified), the type definitions are imported and applied to the system being imported to. The entity import is performed after this.</p> <p>In some cases, you would not want to modify the type definitions. Import may be better off failing than the types be modified.</p> <p>This option allows for optionally importing of type definition. The option is set to <i>true</i> by default, which means that type definition is imported. With this option set to <i>false</i>, type definitions preseneraent in the source will not be imported. In case of mismatch between the entities being imported the types present in the system where the import is being performed, the operation will fail.</p> <p>Table below enumerates the conditions that get addressed as part of type definition import:</p> @@ -319,9 +211,8 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data <td>No change</td></tr> <tr class="b"> <td>Type to be imported and type in target system differ by some attributes</td> -<td>Target system type is updated to the attributes present in the source. It is possible that the target system will have attributes in addition to the one present in the source. In that case, the target system's type attributes will be an union of the attributes. (Attributes in target system will not be deleted to match the source.)</td></tr></table>To use the option, set the contents of <i>importOptions.json</i> to: -<div class="source"> -<pre> +<td>Target system type is updated to the attributes present in the source. It is possible that the target system will have attributes in addition to the one present in the source. In that case, the target system's type attributes will be an union of the attributes. Attributes in target system will not be deleted to match the source. If the type of the attribute differ, import process will be aborted and exception logged.</td></tr></table>To use the option, set the contents of <i>importOptions.json</i> to: +<div class="source"><pre class="prettyprint"> { "options": { @@ -334,8 +225,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data <h5><a name="Specifying_File_to_be_Imported_From_Server_Location"></a>Specifying File to be Imported From Server Location</h5> <p>In scenario where the file to be imported is present at a location on the server, the <i>importfile</i> API can be used. It behaves like the Import API.</p> <p>To use the option, set the contents of <i>importOptions.json</i> to:</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> { "options": { @@ -345,35 +235,24 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data </pre></div> <p><i>CURL</i></p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> curl -g -X POST -u adminuser:password -H "Content-Type: application/json" -H "Cache-Control: no-cache" -d [email protected] "http://localhost:21000/api/atlas/admin/importfile" </pre></div></div> - </div> - </div> - + </div> + </div> <hr/> - <footer> - <div class="container"> - <div class="row span12">Copyright © 2015-2017 - <a href="http://www.apache.org";>Apache Software Foundation</a>. - All Rights Reserved. - + <div class="container"> + <div class="row"> +Copyright é 2018 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. + </div> + <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a> +</p> </div> - - - <p id="poweredBy" class="pull-right"> - <a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> - <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> - </a> - </p> - - </div> </footer> </body> </html> http://git-wip-us.apache.org/repos/asf/atlas-website/blob/c3e5130b/Import-API.html ---------------------------------------------------------------------- diff --git a/Import-API.html b/Import-API.html index 4ab24fe..36e0f69 100644 --- a/Import-API.html +++ b/Import-API.html @@ -1,220 +1,117 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at 2017-08-09 - | Rendered using Apache Maven Fluido Skin 1.3.0 + | Generated by Apache Maven Doxia Site Renderer 1.8 from src/site/twiki/Import-API.twiki at 2018-01-25 + | Rendered using Apache Maven Fluido Skin 1.7 --> <html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20170809" /> + <meta name="Date-Revision-yyyymmdd" content="20180125" /> <meta http-equiv="Content-Language" content="en" /> <title>Apache Atlas – Import API</title> - <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> + <link rel="stylesheet" href="./css/apache-maven-fluido-1.7.min.css" /> <link rel="stylesheet" href="./css/site.css" /> <link rel="stylesheet" href="./css/print.css" media="print" /> - - - <script type="text/javascript" src="./js/apache-maven-fluido-1.3.0.min.js"></script> - - - -<script type="text/javascript">$( document ).ready( function() { $( '.carousel' ).carousel( { interval: 3500 } ) } );</script> - - </head> - <body class="topBarEnabled"> - - - - - + <script type="text/javascript" src="./js/apache-maven-fluido-1.7.min.js"></script> + </head> + <body class="topBarEnabled"> <div id="topbar" class="navbar navbar-fixed-top "> <div class="navbar-inner"> - <div class="container" style="width: 68%;"><div class="nav-collapse"> - - - <ul class="nav"> - <li class="dropdown"> + <div class="container" style="width: 68%;"><div class="nav-collapse"> + <ul class="nav"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Atlas <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="index.html" title="About">About</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a> -</li> - - <li> <a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a> -</li> - - <li> <a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a> -</li> - - <li> <a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a> -</li> - - <li> <a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a> -</li> - </ul> + <li><a href="index.html" title="About">About</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="Wiki">Wiki</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS"; title="News">News</a></li> + <li><a href="https://git-wip-us.apache.org/repos/asf/atlas.git"; title="Git">Git</a></li> + <li><a href="https://issues.apache.org/jira/browse/ATLAS"; title="Jira">Jira</a></li> + <li><a href="https://cwiki.apache.org/confluence/display/ATLAS/PoweredBy"; title="Powered by">Powered by</a></li> + <li><a href="http://blogs.apache.org/atlas/"; title="Blog">Blog</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Project Information <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="project-info.html" title="Summary">Summary</a> -</li> - - <li> <a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a> -</li> - - <li> <a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a> -</li> - - <li> <a href="team-list.html" title="Team">Team</a> -</li> - - <li> <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a> -</li> - - <li> <a href="source-repository.html" title="Source Repository">Source Repository</a> -</li> - - <li> <a href="license.html" title="License">License</a> -</li> - </ul> + <li><a href="project-info.html" title="Summary">Summary</a></li> + <li><a href="mail-lists.html" title="Mailing Lists">Mailing Lists</a></li> + <li><a href="http://webchat.freenode.net?channels=apacheatlas&uio=d4"; title="IRC">IRC</a></li> + <li><a href="team-list.html" title="Team">Team</a></li> + <li><a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a></li> + <li><a href="source-repository.html" title="Source Repository">Source Repository</a></li> + <li><a href="license.html" title="License">License</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Releases <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/1.0.0-alpha/"; title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="http://www.apache.org/dyn/closer.cgi/atlas/0.8.1/"; title="0.8.1">0.8.1</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.8.0-incubating/"; title="0.8-incubating">0.8-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.1-incubating/"; title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.7.0-incubating/"; title="0.7-incubating">0.7-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.6.0-incubating/"; title="0.6-incubating">0.6-incubating</a></li> + <li><a href="http://archive.apache.org/dist/incubator/atlas/0.5.0-incubating/"; title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">Documentation <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a> -</li> - - <li> <a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a> -</li> - - <li> <a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a> -</li> - - <li> <a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a> -</li> - - <li> <a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a> -</li> - </ul> + <li><a href="1.0.0-alpha/index.html" title="1.0.0-alpha">1.0.0-alpha</a></li> + <li><a href="0.8.1/index.html" title="0.8.1">0.8.1</a></li> + <li><a href="0.8.0-incubating/index.html" title="0.8-incubating">0.8-incubating</a></li> + <li><a href="0.7.1-incubating/index.html" title="0.7.1-incubating">0.7.1-incubating</a></li> + <li><a href="0.7.0-incubating/index.html" title="0.7-incubating">0.7-incubating</a></li> + <li><a href="0.6.0-incubating/index.html" title="0.6-incubating">0.6-incubating</a></li> + <li><a href="0.5.0-incubating/index.html" title="0.5-incubating">0.5-incubating</a></li> + </ul> </li> - <li class="dropdown"> + <li class="dropdown"> <a href="#" class="dropdown-toggle" data-toggle="dropdown">ASF <b class="caret"></b></a> <ul class="dropdown-menu"> - - <li> <a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a> -</li> - - <li> <a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a> -</li> - - <li> <a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a> -</li> - - <li> <a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a> -</li> - </ul> + <li><a href="http://www.apache.org/foundation/how-it-works.html"; title="How Apache Works">How Apache Works</a></li> + <li><a href="http://www.apache.org/foundation/"; title="Foundation">Foundation</a></li> + <li><a href="http://www.apache.org/foundation/sponsorship.html"; title="Sponsoring Apache">Sponsoring Apache</a></li> + <li><a href="http://www.apache.org/foundation/thanks.html"; title="Thanks">Thanks</a></li> + </ul> </li> - </ul> - - <form id="search-form" action="http://www.google.com/search"; method="get" class="navbar-search pull-right" > - + </ul> +<form id="search-form" action="https://www.google.com/search"; method="get" class="navbar-search pull-right" > <input value="http://atlas.apache.org"; name="sitesearch" type="hidden"/> <input class="search-query" name="q" id="query" type="text" /> </form> -<script type="text/javascript" src="http://www.google.com/coop/cse/brand?form=search-form";></script> - - - - - - <iframe src="http://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; +<script type="text/javascript">asyncJs( 'https://cse.google.com/brand?form=search-form' )</script> + <iframe src="https://www.facebook.com/plugins/like.php?href=http://atlas.apache.org/atlas-docs&send=false&layout=button_count&show-faces=false&action=like&colorscheme=dark"; scrolling="no" frameborder="0" - style="border:none; width:80px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> - - <script type="text/javascript" src="https://apis.google.com/js/plusone.js";></script> - - <ul class="nav pull-right"><li style="margin-top: 10px;"> - + style="border:none; width:100px; height:20px; margin-top: 10px;" class="pull-right" ></iframe> + <script type="text/javascript">asyncJs( 'https://apis.google.com/js/plusone.js' )</script> + <ul class="nav pull-right"><li style="margin-top: 10px;"> <div class="g-plusone" data-href="http://atlas.apache.org/atlas-docs"; data-size="medium" width="60px" align="right" ></div> - - </li></ul> - - - </div> - + </li></ul> + </div> </div> </div> </div> - - <div class="container"> - <div id="banner"> - <div class="pull-left"> - <a href=".." id="bannerLeft"> - <img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/> - </a> - </div> - <div class="pull-right"> </div> + <div class="container"> + <div id="banner"> + <div class="pull-left"><a href=".." id="bannerLeft"><img src="images/atlas-logo.png" alt="Apache Atlas" width="200px" height="45px"/></a></div> + <div class="pull-right"></div> <div class="clear"><hr/></div> </div> <div id="breadcrumbs"> <ul class="breadcrumb"> - - - <li class=""> - <a href="http://www.apache.org"; class="externalLink" title="Apache"> - Apache</a> - </li> - <li class="divider ">/</li> - <li class=""> - <a href="index.html" title="Atlas"> - Atlas</a> - </li> - <li class="divider ">/</li> - <li class="">Import API</li> - - - - <li id="publishDate" class="pull-right">Last Published: 2017-08-09</li> <li class="divider pull-right">|</li> - <li id="projectVersion" class="pull-right">Version: 0.9-SNAPSHOT</li> - - </ul> + <li class=""><a href="http://www.apache.org"; class="externalLink" title="Apache">Apache</a><span class="divider">/</span></li> + <li class=""><a href="index.html" title="Atlas">Atlas</a><span class="divider">/</span></li> + <li class="active ">Import API</li> + <li id="publishDate" class="pull-right"><span class="divider">|</span> Last Published: 2018-01-25</li> + <li id="projectVersion" class="pull-right">Version: 1.0.0-alpha</li> + </ul> </div> - - - <div id="bodyColumn" > - - <div class="section"> +<div class="section"> <h2><a name="Import_API"></a>Import API</h2> <p>The general approach is:</p> <ul> @@ -286,8 +183,7 @@ <tr class="b"> <td><i>Notes</i></td> <td>The file to be imported needs to be present on the server at the location specified by the <i>FILENAME</i> parameter.</td></tr></table><b><i>Method Signature for Import</i></b> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> @POST @Path("/import") @Produces("application/json; charset=UTF-8") @@ -295,8 +191,7 @@ </pre></div> <p><b><i>Method Signature for Import File</i></b></p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> @POST @Path("/importfile") @Produces("application/json; charset=UTF-8") @@ -313,8 +208,7 @@ <div class="section"> <h4><a name="Examples_Using_CURL_Calls"></a>Examples Using CURL Calls</h4> <p>The call below performs Import of <i>QuickStart</i> database using POST.</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data" -H "Cache-Control: no-cache" -F [email protected] @@ -323,8 +217,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data </pre></div> <p>The <i>request</i> parameter is optional. If import has to be run without any options use:</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data" -H "Cache-Control: no-cache" -F [email protected] @@ -332,8 +225,7 @@ curl -g -X POST -u adminuser:password -H "Content-Type: multipart/form-data </pre></div> <p>The call below performs Import of <i>QuickStart</i> database using a ZIP file available on server.</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> curl -X POST -u adminuser:password -H "Cache-Control: no-cache" -d ./importOptions.json "http://localhost:21000/api/atlas/admin/importFile" > quickStartDB-import-result.json @@ -341,8 +233,7 @@ curl -X POST -u adminuser:password -H "Cache-Control: no-cache" -d ./i <p>Below is the <i>AtlasImportResult</i> JSON for an import that contains <i>hive</i>db_.</p> <p>The <i>processedEntities</i> contains the <i>guids</i> of all the entities imported.</p> <p>The <i>metrics</i> contain a breakdown of the types and entities imported along with the operation performed on them viz. <i>created</i> or <i>updated</i>.</p> -<div class="source"> -<pre> +<div class="source"><pre class="prettyprint"> { "request": { "options": {} @@ -377,27 +268,17 @@ curl -X POST -u adminuser:password -H "Cache-Control: no-cache" -d ./i } </pre></div></div> - </div> - </div> - + </div> + </div> <hr/> - <footer> - <div class="container"> - <div class="row span12">Copyright © 2015-2017 - <a href="http://www.apache.org";>Apache Software Foundation</a>. - All Rights Reserved. - + <div class="container"> + <div class="row"> +Copyright é 2018 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. + </div> + <p id="poweredBy" class="pull-right"><a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"><img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /></a> +</p> </div> - - - <p id="poweredBy" class="pull-right"> - <a href="http://maven.apache.org/"; title="Built by Maven" class="poweredBy"> - <img class="builtBy" alt="Built by Maven" src="./images/logos/maven-feather.png" /> - </a> - </p> - - </div> </footer> </body> </html>
