Author: hao
Date: Tue Jan 3 01:19:05 2017
New Revision: 1777047
URL: http://svn.apache.org/viewvc?rev=1777047&view=rev
Log:
Updating eagle incubating status after graduating as TLP
Modified:
eagle/site/README.md
eagle/site/docs/FAQ.html
eagle/site/docs/ambari-plugin-install.html
eagle/site/docs/community.html
eagle/site/docs/configuration.html
eagle/site/docs/deployment-env.html
eagle/site/docs/deployment-in-docker.html
eagle/site/docs/deployment-in-production.html
eagle/site/docs/deployment-in-sandbox.html
eagle/site/docs/development-in-intellij.html
eagle/site/docs/development-in-macosx.html
eagle/site/docs/development-quick-guide.html
eagle/site/docs/download-latest.html
eagle/site/docs/download.html
eagle/site/docs/ecosystem.html
eagle/site/docs/hbase-auth-activity-monitoring.html
eagle/site/docs/hbase-data-activity-monitoring.html
eagle/site/docs/hdfs-auth-activity-monitoring.html
eagle/site/docs/hdfs-data-activity-monitoring.html
eagle/site/docs/hive-query-activity-monitoring.html
eagle/site/docs/import-hdfs-auditLog.html
eagle/site/docs/index.html
eagle/site/docs/installation.html
eagle/site/docs/jmx-metric-monitoring.html
eagle/site/docs/mapr-integration.html
eagle/site/docs/metadata-api.html
eagle/site/docs/quick-start-0.3.0.html
eagle/site/docs/quick-start.html
eagle/site/docs/serviceconfiguration.html
eagle/site/docs/terminology.html
eagle/site/docs/tutorial/classification-0.3.0.html
eagle/site/docs/tutorial/classification.html
eagle/site/docs/tutorial/ldap.html
eagle/site/docs/tutorial/notificationplugin.html
eagle/site/docs/tutorial/policy-capabilities.html
eagle/site/docs/tutorial/policy.html
eagle/site/docs/tutorial/site-0.3.0.html
eagle/site/docs/tutorial/topologymanagement.html
eagle/site/docs/tutorial/userprofile.html
eagle/site/docs/usecases.html
eagle/site/docs/user-profile-ml.html
eagle/site/feed.xml
eagle/site/index.html
eagle/site/post/2015/10/27/apache-eagle-announce-cn.html
eagle/site/sup/index.html
Modified: eagle/site/README.md
URL:
http://svn.apache.org/viewvc/eagle/site/README.md?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/README.md (original)
+++ eagle/site/README.md Tue Jan 3 01:19:05 2017
@@ -1,5 +1,5 @@
# Eagle Documentation Site
-Welcome to the Apache Eagle (incubating) documentation!
+Welcome to the Apache Eagle documentation!
## Prerequisites
Modified: eagle/site/docs/FAQ.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/FAQ.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/FAQ.html (original)
+++ eagle/site/docs/FAQ.html Tue Jan 3 01:19:05 2017
@@ -225,16 +225,14 @@
<p>Add the following line in host machineâs hosts file</p>
</blockquote>
- <div class="highlighter-rouge"><pre class="highlight"><code>127.0.0.1
sandbox.hortonworks.com
+ <pre><code>127.0.0.1 sandbox.hortonworks.com
</code></pre>
- </div>
</li>
<li>
<p><strong>Q2. Not able to send data into kafka using kafka console
producer</strong>:</p>
- <div class="highlighter-rouge"><pre
class="highlight"><code>/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh
--broker-list localhost:6667 --topic sandbox_hdfs_audit_log
+ <pre><code>/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh
--broker-list localhost:6667 --topic sandbox_hdfs_audit_log
</code></pre>
- </div>
<blockquote>
<p>Apache Kafka broker are binding to host sandbox.hortonworks.com</p>
Modified: eagle/site/docs/ambari-plugin-install.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/ambari-plugin-install.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/ambari-plugin-install.html (original)
+++ eagle/site/docs/ambari-plugin-install.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - Install Apache Eagle (incubating) Ambari Plugin</title>
+ <title>Eagle - Install Apache Eagle Ambari Plugin</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,8 +216,8 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">Install Apache Eagle
(incubating) Ambari Plugin</h1>
- <p>Assume Apache Eagle (incubating, called Eagle in the following)
package has been copied and exacted under /usr/hdp/current/eagle.</p>
+ <h1 class="page-header" style="margin-top: 0px">Install Apache Eagle
Ambari Plugin</h1>
+ <p>Assume Apache Eagle (called Eagle in the following) package has
been copied and exacted under /usr/hdp/current/eagle.</p>
<blockquote>
<p><strong>WARNING</strong>: the following instructions work in sandbox
currently.</p>
@@ -229,9 +229,8 @@
<li>
<p>Create a Kafka<sup id="fnref:KAFKA"><a href="#fn:KAFKA"
class="footnote">1</a></sup> topic if you have not. Here is an example
command.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$
/usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper
localhost:2181 --replication-factor 1 --partitions 1 --topic
sandbox_hdfs_audit_log
+ <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create
--zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic
sandbox_hdfs_audit_log
</code></pre>
- </div>
</li>
<li>
<p>Stream HDFS log data to Kafka, and refer to <a
href="/docs/import-hdfs-auditLog.html">here</a> on how to do it .</p>
@@ -247,9 +246,8 @@
<li>
<p>Install Eagle Ambari plugin</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$
/usr/hdp/current/eagle/bin/eagle-ambari.sh install
+ <pre><code>$ /usr/hdp/current/eagle/bin/eagle-ambari.sh install
</code></pre>
- </div>
</li>
<li>
<p>Restart <a href="http://127.0.0.1:8000/";>Ambari</a> click on disable
and enable Ambari back.</p>
@@ -263,11 +261,10 @@
<li>
<p>Add Policies and meta data required by running the below script.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$ cd
<eagle-home>
+ <pre><code>$ cd <eagle-home>
$ examples/sample-sensitivity-resource-create.sh
$ examples/sample-policy-create.sh
</code></pre>
- </div>
</li>
</ol>
Modified: eagle/site/docs/community.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/community.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/community.html (original)
+++ eagle/site/docs/community.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - Apache Eagle (incubating) Community</title>
+ <title>Eagle - Apache Eagle Community</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,7 +216,7 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">Apache Eagle
(incubating) Community</h1>
+ <h1 class="page-header" style="margin-top: 0px">Apache Eagle
Community</h1>
<h3 id="mailing-lists">Mailing Lists</h3>
<table>
@@ -244,13 +244,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:user@eagle.incubator.apache.org">user@eagle.incubator.apache.org</a></td>
+ <td><a
href="mailto:user@eagle.apache.org">user@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:user-subscribe@eagle.incubator.apache.org">subscribe</a></td>
- <td><a
href="mailto:user-unsubscribe@eagle.incubator.apache.org">unsubscribe</a></td>
+ <td><a
href="mailto:user-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a
href="mailto:user-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a
href="http://mail-archives.apache.org/mod_mbox/eagle-user/";>eagle-user</a></td>
</tr>
<tr>
@@ -259,13 +259,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:dev@eagle.incubator.apache.org">dev@eagle.incubator.apache.org</a></td>
+ <td><a
href="mailto:dev@eagle.apache.org">dev@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:dev-subscribe@eagle.incubator.apache.org">subscribe</a></td>
- <td><a
href="mailto:dev-unsubscribe@eagle.incubator.apache.org">unsubscribe</a></td>
+ <td><a
href="mailto:dev-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a
href="mailto:dev-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a
href="http://mail-archives.apache.org/mod_mbox/eagle-dev/";>eagle-dev</a></td>
</tr>
<tr>
@@ -274,13 +274,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:issues@eagle.incubator.apache.org">issues@eagle.incubator.apache.org</a></td>
+ <td><a
href="mailto:issues@eagle.apache.org">issues@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:issues-subscribe@eagle.incubator.apache.org">subscribe</a></td>
- <td><a
href="mailto:issues-unsubscribe@eagle.incubator.apache.org">unsubscribe</a></td>
+ <td><a
href="mailto:issues-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a
href="mailto:issues-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a
href="http://mail-archives.apache.org/mod_mbox/eagle-issues/";>eagle-issues</a></td>
</tr>
<tr>
@@ -289,13 +289,13 @@
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:commits@eagle.incubator.apache.org">commits@eagle.incubator.apache.org</a></td>
+ <td><a
href="mailto:commits@eagle.apache.org">commits@eagle.apache.org</a></td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
<td>Â </td>
- <td><a
href="mailto:commits-subscribe@eagle.incubator.apache.org">subscribe</a></td>
- <td><a
href="mailto:commits-unsubscribe@eagle.incubator.apache.org">unsubscribe</a></td>
+ <td><a
href="mailto:commits-subscribe@eagle.apache.org">subscribe</a></td>
+ <td><a
href="mailto:commits-unsubscribe@eagle.apache.org">unsubscribe</a></td>
<td><a
href="http://mail-archives.apache.org/mod_mbox/eagle-commits/";>eagle-commits</a></td>
</tr>
</tbody>
Modified: eagle/site/docs/configuration.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/configuration.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/configuration.html (original)
+++ eagle/site/docs/configuration.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Application
Configuration</h1>
- <p>Apache Eagle (incubating, called Eagle in the following) requires
you to create a configuration file under <code
class="highlighter-rouge">$EAGLE_HOME/conf/</code> for each application.
Basically, there are some common properties shared, e.g., envContextConfig,
eagleProps, and dynamicConfigSource. While dataSourceConfig differs from
application to application.</p>
+ <p>Apache Eagle (called Eagle in the following) requires you to create
a configuration file under <code>$EAGLE_HOME/conf/</code> for each application.
Basically, there are some common properties shared, e.g., envContextConfig,
eagleProps, and dynamicConfigSource. While dataSourceConfig differs from
application to application.</p>
<p>In this page we take the following two application as examples</p>
Modified: eagle/site/docs/deployment-env.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/deployment-env.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/deployment-env.html (original)
+++ eagle/site/docs/deployment-env.html Tue Jan 3 01:19:05 2017
@@ -219,7 +219,7 @@
<h1 class="page-header" style="margin-top: 0px">Deploy Environment</h1>
<h3 id="setup-environment">Setup Environment</h3>
-<p>Apache Eagle (incubating, called Eagle in the following) as an analytics
solution for identifying security and performance issues instantly, relies on
streaming platform <code class="highlighter-rouge">Storm</code><sup
id="fnref:STORM"><a href="#fn:STORM" class="footnote">1</a></sup> + <code
class="highlighter-rouge">Kafka</code><sup id="fnref:KAFKA"><a href="#fn:KAFKA"
class="footnote">2</a></sup> to meet the realtime criteria, and persistence
storage to store metadata and some metrics. As for the persistence storage, it
supports three types of database: <code
class="highlighter-rouge">HBase</code><sup id="fnref:HBASE"><a href="#fn:HBASE"
class="footnote">3</a></sup>, <code class="highlighter-rouge">Derby</code><sup
id="fnref:DERBY"><a href="#fn:DERBY" class="footnote">4</a></sup>, and <code
class="highlighter-rouge">Mysql</code></p>
+<p>Apache Eagle (called Eagle in the following) as an analytics solution for
identifying security and performance issues instantly, relies on streaming
platform <code>Storm</code><sup id="fnref:STORM"><a href="#fn:STORM"
class="footnote">1</a></sup> + <code>Kafka</code><sup id="fnref:KAFKA"><a
href="#fn:KAFKA" class="footnote">2</a></sup> to meet the realtime criteria,
and persistence storage to store metadata and some metrics. As for the
persistence storage, it supports three types of database:
<code>HBase</code><sup id="fnref:HBASE"><a href="#fn:HBASE"
class="footnote">3</a></sup>, <code>Derby</code><sup id="fnref:DERBY"><a
href="#fn:DERBY" class="footnote">4</a></sup>, and <code>Mysql</code></p>
<p>To run monitoring applications, Eagle requires the following
dependencies.</p>
Modified: eagle/site/docs/deployment-in-docker.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/deployment-in-docker.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/deployment-in-docker.html (original)
+++ eagle/site/docs/deployment-in-docker.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Get Started with
Docker</h1>
- <p>Another way to get started with Apache Eagle (incubating, called
Eagle in the following) is to run with <a
href="https://github.com/docker/docker";>docker</a> by one of following
options:</p>
+ <p>Another way to get started with Apache Eagle (called Eagle in the
following) is to run with <a href="https://github.com/docker/docker";>docker</a>
by one of following options:</p>
<ul>
<li>
@@ -227,24 +227,22 @@
<li>
<p>Pull latest eagle docker image from <a
href="https://hub.docker.com/r/apacheeagle/sandbox/";>docker hub</a>
directly:</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>docker
pull apacheeagle/sandbox
+ <pre><code>docker pull apacheeagle/sandbox
</code></pre>
- </div>
</li>
<li>
<p>Then run eagle docker image:</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>docker run
-p 9099:9099 -p 8080:8080 -p 8744:8744 -p 2181:2181 -p 2888:2888 \
+ <pre><code>docker run -p 9099:9099 -p 8080:8080 -p 8744:8744 -p
2181:2181 -p 2888:2888 \
-p 6667:6667 -p 60020:60020 -p 60030:60030 -p 60010:60010 -d --dns 127.0.0.1
\
--entrypoint /usr/local/serf/bin/start-serf-agent.sh -e KEYCHAIN= \
- --env EAGLE_SERVER_HOST=sandbox.eagle.incubator.apache.org --name sandbox \
- -h sandbox.eagle.incubator.apache.org --privileged=true \
+ --env EAGLE_SERVER_HOST=sandbox.eagle.apache.org --name sandbox \
+ -h sandbox.eagle.apache.org --privileged=true \
apacheeagle/sandbox:latest --tag ambari-server=true
docker run -it --rm -e EXPECTED_HOST_COUNT=1 -e BLUEPRINT=hdp-singlenode-eagle
\
--link sandbox:ambariserver --entrypoint /bin/sh apacheeagle/sandbox:latest \
-c /tmp/install-cluster.sh
</code></pre>
- </div>
</li>
</ul>
</li>
@@ -255,16 +253,14 @@ docker run -it --rm -e EXPECTED_HOST_COU
<li>
<p>Get latest source code of eagle.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>git clone
https://github.com/apache/incubator-eagle.git
+ <pre><code>git clone https://github.com/apache/eagle.git
</code></pre>
- </div>
</li>
<li>
<p>Then run eagle docker command.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>cd
incubator-eagle && ./eagle-docker boot
+ <pre><code>cd eagle && ./eagle-docker boot
</code></pre>
- </div>
</li>
</ul>
</li>
Modified: eagle/site/docs/deployment-in-production.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/deployment-in-production.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/deployment-in-production.html (original)
+++ eagle/site/docs/deployment-in-production.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - Deploy Apache Eagle (incubating) in the
Production</title>
+ <title>Eagle - Deploy Apache Eagle in the Production</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,8 +216,8 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">Deploy Apache Eagle
(incubating) in the Production</h1>
- <p>This page outlines the steps for deploying Apache Eagle
(incubating, called Eagle in the following) in the production environment.</p>
+ <h1 class="page-header" style="margin-top: 0px">Deploy Apache Eagle in
the Production</h1>
+ <p>This page outlines the steps for deploying Apache Eagle (called
Eagle in the following) in the production environment.</p>
<p>Hereâs the main content of this page:</p>
@@ -245,9 +245,9 @@
<ul>
<li>
- <p>Edit <code class="highlighter-rouge">bin/eagle-env.sh</code></p>
+ <p>Edit <code>bin/eagle-env.sh</code></p>
- <div class="highlighter-rouge"><pre class="highlight"><code> # TODO:
make sure java version is 1.7.x
+ <pre><code> # TODO: make sure java version is 1.7.x
export JAVA_HOME=
# TODO: Apache Storm nimbus host. Default is localhost
@@ -256,12 +256,11 @@
# TODO: EAGLE_SERVICE_HOST, default is `hostname -f`
export EAGLE_SERVICE_HOST=localhost
</code></pre>
- </div>
</li>
<li>
- <p>Edit <code class="highlighter-rouge">conf/eagle-service.conf</code>
to configure the database to use (for example: HBase<sup id="fnref:HBASE"><a
href="#fn:HBASE" class="footnote">1</a></sup>)</p>
+ <p>Edit <code>conf/eagle-service.conf</code> to configure the database
to use (for example: HBase<sup id="fnref:HBASE"><a href="#fn:HBASE"
class="footnote">1</a></sup>)</p>
- <div class="highlighter-rouge"><pre class="highlight"><code> # TODO:
hbase.zookeeper.quorum in the format host1,host2,host3,...
+ <pre><code> # TODO: hbase.zookeeper.quorum in the format
host1,host2,host3,...
# default is "localhost"
hbase-zookeeper-quorum="localhost"
@@ -273,14 +272,13 @@
# default is "/hbase"
zookeeper-znode-parent="/hbase"
</code></pre>
- </div>
</li>
</ul>
</li>
<li>
<p>Step 2: Install metadata for policies</p>
- <div class="highlighter-rouge"><pre class="highlight"><code> $ cd
<eagle-home>
+ <pre><code> $ cd <eagle-home>
# start Eagle web service
$ bin/eagle-service.sh start
@@ -288,7 +286,6 @@
# import metadata after Eagle service is successfully started
$ bin/eagle-topology-init.sh
</code></pre>
- </div>
</li>
</ul>
@@ -324,9 +321,8 @@
<li>
<p>Stop eagle service</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$
bin/eagle-service.sh stop
+ <pre><code>$ bin/eagle-service.sh stop
</code></pre>
- </div>
</li>
</ul>
Modified: eagle/site/docs/deployment-in-sandbox.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/deployment-in-sandbox.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/deployment-in-sandbox.html (original)
+++ eagle/site/docs/deployment-in-sandbox.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Get Started with
Sandbox</h1>
- <p>Here is the summary of the steps for setting up Apache Eagle
(incubating, called Eagle in the following) in Hortonworks sandbox:</p>
+ <p>Here is the summary of the steps for setting up Apache Eagle
(called Eagle in the following) in Hortonworks sandbox:</p>
<ul>
<li>Step 1: Setup sandbox image in a virtual machine</li>
@@ -262,23 +262,21 @@
<p><strong>Option 1</strong>: Download eagle jar from <a
href="http://66.211.190.194/eagle-0.1.0.tar.gz";>here</a>.</p>
</li>
<li>
- <p><strong>Option 2</strong>: Build form source code <a
href="https://github.com/apache/incubator-eagle";>eagle github</a>. After
successful build, âeagle-xxx-bin.tar.gzâ will be generated under <code
class="highlighter-rouge">./eagle-assembly/target</code></p>
+ <p><strong>Option 2</strong>: Build form source code <a
href="https://github.com/apache/eagle";>eagle github</a>. After successful
build, âeagle-xxx-bin.tar.gzâ will be generated under
<code>./eagle-assembly/target</code></p>
- <div class="highlighter-rouge"><pre class="highlight"><code>#
installed npm is required before compiling
+ <pre><code># installed npm is required before compiling
$ mvn clean install -DskipTests=true
</code></pre>
- </div>
</li>
</ul>
</li>
<li>
<p><strong>Copy and extract the package to sandbox</strong></p>
- <div class="highlighter-rouge"><pre class="highlight"><code>#extract
+ <pre><code>#extract
$ tar -zxvf eagle-0.1.0-bin.tar.gz
$ mv eagle-0.1.0 /usr/hdp/current/eagle
</code></pre>
- </div>
</li>
</ul>
@@ -292,10 +290,9 @@ $ mv eagle-0.1.0 /usr/hdp/current/eagle
<li>
<p><strong>Option 1</strong>: Install Eagle using command line</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$ cd
/usr/hdp/current/eagle
+ <pre><code>$ cd /usr/hdp/current/eagle
$ examples/eagle-sandbox-starter.sh
</code></pre>
- </div>
</li>
<li>
<p><strong>Option 2</strong>: Install Eagle using <a
href="/docs/ambari-plugin-install.html">Eagle Ambari plugin</a></p>
@@ -310,7 +307,7 @@ $ examples/eagle-sandbox-starter.sh
<li>
<p><strong>Step 1</strong>: Configure Advanced hadoop-log4j via <a
href="http://localhost:8080/#/main/services/HDFS/configs";
target="_blank">Ambari UI</a>, and add below âKAFKA_HDFS_AUDITâ log4j
appender to hdfs audit logging.</p>
- <div class="highlighter-rouge"><pre
class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+
<pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -320,25 +317,22 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
#log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1
#log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J
Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a
href="http://localhost:8080/#/main/services/HDFS/configs";
target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to
HADOOP_NAMENODE_OPTS.</p>
- <div class="highlighter-rouge"><pre
class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment
Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 4</strong>: Edit Advanced hadoop-env via <a
href="http://localhost:8080/#/main/services/HDFS/configs";
target="_blank">Ambari UI</a>, and append the following command to it.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <pre><code>export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment
Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -346,15 +340,14 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<p><strong>Step 5</strong>: save the changes and restart the namenode.</p>
</li>
<li>
- <p><strong>Step 6</strong>: Check whether logs are flowing into topic
<code class="highlighter-rouge">sandbox_hdfs_audit_log</code></p>
+ <p><strong>Step 6</strong>: Check whether logs are flowing into topic
<code>sandbox_hdfs_audit_log</code></p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$
/usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper
localhost:2181 --topic sandbox_hdfs_audit_log
+ <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh
--zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
</code></pre>
- </div>
</li>
</ul>
-<p>Now please login to Eagle web http://localhost:9099/eagle-service with
account <code class="highlighter-rouge">admin/secret</code>, and try the sample
demos on
+<p>Now please login to Eagle web http://localhost:9099/eagle-service with
account <code>admin/secret</code>, and try the sample demos on
<a href="/docs/quick-start.html">Quick Starer</a></p>
<p>(If the NAT network is used in a virtual machine, itâs required to add
port 9099 to forwarding ports)
Modified: eagle/site/docs/development-in-intellij.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/development-in-intellij.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/development-in-intellij.html (original)
+++ eagle/site/docs/development-in-intellij.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Development in
Intellij</h1>
- <p>Apache Eagle (incubating, called Eagle in the following) can be
developed in popular IDE, e.g. Intellij and Eclipse. Here we focus on
development in Intellij.</p>
+ <p>Apache Eagle (called Eagle in the following) can be developed in
popular IDE, e.g. Intellij and Eclipse. Here we focus on development in
Intellij.</p>
<h3 id="prepare-hadoophadoop-environment">1. Prepare Hadoop<sup
id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup>
environment</h3>
Modified: eagle/site/docs/development-in-macosx.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/development-in-macosx.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/development-in-macosx.html (original)
+++ eagle/site/docs/development-in-macosx.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - How to Setup Apache Eagle (incubating) Development
Environment on Mac OSX</title>
+ <title>Eagle - How to Setup Apache Eagle Development Environment on Mac
OSX</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,11 +216,11 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">How to Setup Apache
Eagle (incubating) Development Environment on Mac OSX</h1>
- <h2
id="how-to-setup-apache-eagle-incubating-development-environment-on-mac-osx">How
to Setup Apache Eagle (incubating) Development Environment on Mac OSX</h2>
+ <h1 class="page-header" style="margin-top: 0px">How to Setup Apache
Eagle Development Environment on Mac OSX</h1>
+ <h2
id="how-to-setup-apache-eagle-development-environment-on-mac-osx">How to Setup
Apache Eagle Development Environment on Mac OSX</h2>
-<p><em>Apache Eagle (incubating) will be called Eagle in the
following.</em><br />
-This tutorial is based <code class="highlighter-rouge">Mac OS X</code>. It can
be used as a reference guide for other OS like Linux or Windows as well. To
save your time of jumping back and forth between different web pages, all
necessary references will be pointed out.</p>
+<p><em>Apache Eagle will be called Eagle in the following.</em><br />
+This tutorial is based <code>Mac OS X</code>. It can be used as a reference
guide for other OS like Linux or Windows as well. To save your time of jumping
back and forth between different web pages, all necessary references will be
pointed out.</p>
<h3 id="prerequisite">Prerequisite</h3>
@@ -230,9 +230,8 @@ This tutorial is based <code class="high
<p>Make sure you have HomeBrew installed on your mac. If not, please run:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ ruby -e "$(curl
-fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
+<pre><code>$ ruby -e "$(curl -fsSL
https://raw.githubusercontent.com/Homebrew/install/master/install)"
</code></pre>
-</div>
<p>you can find more information about HomeBrew at http://brew.sh/ .</p>
@@ -242,10 +241,9 @@ This tutorial is based <code class="high
<p>Some core eagle modules are written with scala. To install Scala and SBT,
just run:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install
scala
+<pre><code> $ brew install scala
$ brew install sbt
</code></pre>
-</div>
<ul>
<li><strong>NPM</strong></li>
@@ -253,9 +251,8 @@ This tutorial is based <code class="high
<p>Eagle-webservice module uses npm. To install it, run:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install npm
+<pre><code> $ brew install npm
</code></pre>
-</div>
<ul>
<li><strong>Apache Maven</strong></li>
@@ -263,9 +260,8 @@ This tutorial is based <code class="high
<p>Eagle is built with maven:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install
maven
+<pre><code> $ brew install maven
</code></pre>
-</div>
<ul>
<li>
@@ -275,9 +271,8 @@ This tutorial is based <code class="high
<li>
<p>Install HomeBrew Cask:</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$ brew
install caskroom/cask/brew-cask
+ <pre><code>$ brew install caskroom/cask/brew-cask
</code></pre>
- </div>
</li>
<li>
<p>Next, install JDK via HomeBrew:</p>
@@ -290,9 +285,8 @@ This tutorial is based <code class="high
<p>you will see all available JDK versions and you can install multiple JDK
versions in this way. For eagle please choose java7 to install:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code> $ brew cask
install java7
+<pre><code> $ brew cask install java7
</code></pre>
-</div>
<p><strong>Note:</strong>
- During this writing SBT has issue with JDK 8. This issue has been tested
confirmed by using:
@@ -309,15 +303,13 @@ This tutorial is based <code class="high
<p>you can use Jenv to manage installed multiple Java versions. To install
it:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ brew install
https://raw.githubusercontent.com/entrypass/jenv/homebrew/homebrew/jenv.rb
+<pre><code>$ brew install
https://raw.githubusercontent.com/entrypass/jenv/homebrew/homebrew/jenv.rb
</code></pre>
-</div>
<p>and make sure activate it automatically:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ echo 'eval
"$(jenv init -)"' >> ~/.bash_profile
+<pre><code>$ echo 'eval "$(jenv init -)"' >> ~/.bash_profile
</code></pre>
-</div>
<p><strong>Note:</strong>
- There is a known issue at this writing:
https://github.com/gcuisinier/jenv/wiki/Trouble-Shooting
@@ -326,34 +318,29 @@ This tutorial is based <code class="high
<p>Now let Jenv manage JDK versions (remember In OSX all JVMs are located at
/Library/Java/JavaVirtualMachines):</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv add
/Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/
+<pre><code>$ jenv add
/Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/
$ jenv add /Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/
</code></pre>
-</div>
<p>and</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv rehash
+<pre><code>$ jenv rehash
</code></pre>
-</div>
<p>You can see all managed JDK versions:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv versions
+<pre><code>$ jenv versions
</code></pre>
-</div>
<p>set global java version:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv global
oracle64-1.8.0.66
+<pre><code>$ jenv global oracle64-1.8.0.66
</code></pre>
-</div>
<p>switch to your eagle home directory and set the local JDK version for
eagle:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv local
oracle64-1.7.0.80
+<pre><code>$ jenv local oracle64-1.7.0.80
</code></pre>
-</div>
<p>you can find more information about Jenv at https://github.com/rbenv/rbenv
and
http://hanxue-it.blogspot.com/2014/05/installing-java-8-managing-multiple.html.</p>
@@ -361,9 +348,8 @@ $ jenv add /Library/Java/JavaVirtualMach
<p>Go to Eagle home directory and run:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>mvn -DskipTests
clean package
+<pre><code>mvn -DskipTests clean package
</code></pre>
-</div>
<p>Thatâs all. Now you have runnable eagle on your Mac. Have fun. :-)</p>
Modified: eagle/site/docs/development-quick-guide.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/development-quick-guide.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/development-quick-guide.html (original)
+++ eagle/site/docs/development-quick-guide.html Tue Jan 3 01:19:05 2017
@@ -219,15 +219,15 @@
<h1 class="page-header" style="margin-top: 0px">Development Quick
Guide</h1>
<h3 id="source-code"><strong>Source Code</strong></h3>
-<p>Apache Eagle (incubating) source code is version controlled using Git
version control:
-<a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git";>Commits
Summary</a></p>
+<p>Apache Eagle source code is version controlled using Git version control:
+<a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git";>Commits
Summary</a></p>
<ul>
<li>
- <p><strong>Source Repo</strong>: <a
href="https://git-wip-us.apache.org/repos/asf/incubator-eagle.git";>https://git-wip-us.apache.org/repos/asf/incubator-eagle.git</a></p>
+ <p><strong>Source Repo</strong>: <a
href="https://git-wip-us.apache.org/repos/asf/eagle.git";>https://git-wip-us.apache.org/repos/asf/eagle.git</a></p>
</li>
<li>
- <p><strong>Github</strong>: <a
href="https://github.com/apache/incubator-eagle";>https://github.com/apache/incubator-eagle</a>
+ <p><strong>Github</strong>: <a
href="https://github.com/apache/eagle";>https://github.com/apache/eagle</a>
<br /><br /></p>
</li>
</ul>
@@ -239,7 +239,7 @@
<h3 id="setup-development-env"><strong>Setup Development Env</strong></h3>
-<p>Refer to this link for how to setup dev env: <a
href="https://github.com/apache/incubator-eagle/blob/master/eagle-docs/development/eagle_development_setup.md";>Setup
Development Env</a>
+<p>Refer to this link for how to setup dev env: <a
href="https://cwiki.apache.org/confluence/display/EAG/Setup+Development+Environment";>Setup
Development Env</a>
<br /><br /></p>
<h3 id="how-to-contribute"><strong>How to Contribute</strong></h3>
Modified: eagle/site/docs/download-latest.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/download-latest.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/download-latest.html (original)
+++ eagle/site/docs/download-latest.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - Apache Eagle (incubating) Latest Download</title>
+ <title>Eagle - Apache Eagle Latest Download</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,11 +216,11 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">Apache Eagle
(incubating) Latest Download</h1>
+ <h1 class="page-header" style="margin-top: 0px">Apache Eagle Latest
Download</h1>
<blockquote>
- <p>Version <strong>0.4.0-incubating</strong> is the latest release and
0.5.0-incubating-SNAPSHOT is under active development on <a
href="https://github.com/apache/incubator-eagle/tree/master";>master</a>
branch.</p>
+ <p>Version <strong>0.4.0-incubating</strong> is the latest release and
0.5.0-SNAPSHOT is under active development on <a
href="https://github.com/apache/eagle/tree/master";>master</a> branch.</p>
- <p>You can verify your download by following these <a
href="https://www.apache.org/info/verification.html";>procedures</a> and using
these <a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/KEYS";>KEYS</a>.</p>
+ <p>You can verify your download by following these <a
href="https://www.apache.org/info/verification.html";>procedures</a> and using
these <a
href="https://dist.apache.org/repos/dist/release/eagle/KEYS";>KEYS</a>.</p>
</blockquote>
<h1 id="incubating">0.4.0-incubating</h1>
@@ -230,21 +230,21 @@
<ul>
<li>Release notes:
<ul>
- <li><a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.4.0-incubating";>Eagle
0.4.0 Release Notes</a></li>
+ <li><a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.4.0-incubating";>Eagle
0.4.0 Release Notes</a></li>
</ul>
</li>
<li>Source download:
<ul>
<li><a
href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.4.0-incubating";>apache-eagle-0.4.0-incubating-src.tar.gz</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.md5";>apache-eagle-0.4.0-incubating-src.tar.gz.md5</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.sha1";>apache-eagle-0.4.0-incubating-src.tar.gz.sha1</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.asc";>apache-eagle-0.4.0-incubating-src.tar.gz.asc</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.md5";>apache-eagle-0.4.0-incubating-src.tar.gz.md5</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.sha1";>apache-eagle-0.4.0-incubating-src.tar.gz.sha1</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.asc";>apache-eagle-0.4.0-incubating-src.tar.gz.asc</a></li>
</ul>
</li>
<li>Git revision:
<ul>
- <li>tag: <a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=commit;h=refs/tags/v0.4.0-incubating";>v0.4.0-incubating</a></li>
- <li>commit: <a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=commit;h=eac0f27958f2ed8c6842938dad0a995a87fd0715";>eac0f27958f2ed8c6842938dad0a995a87fd0715</a></li>
+ <li>tag: <a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.4.0-incubating";>v0.4.0-incubating</a></li>
+ <li>commit: <a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=eac0f27958f2ed8c6842938dad0a995a87fd0715";>eac0f27958f2ed8c6842938dad0a995a87fd0715</a></li>
</ul>
</li>
</ul>
Modified: eagle/site/docs/download.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/download.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/download.html (original)
+++ eagle/site/docs/download.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - Apache Eagle (incubating) Releases</title>
+ <title>Eagle - Apache Eagle Releases</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,30 +216,30 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">Apache Eagle
(incubating) Releases</h1>
+ <h1 class="page-header" style="margin-top: 0px">Apache Eagle
Releases</h1>
<blockquote>
- <p>You can verify your download by following these <a
href="https://www.apache.org/info/verification.html";>procedures</a> and using
these <a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/KEYS";>KEYS</a>.</p>
+ <p>You can verify your download by following these <a
href="https://www.apache.org/info/verification.html";>procedures</a> and using
these <a
href="https://dist.apache.org/repos/dist/release/eagle/KEYS";>KEYS</a>.</p>
</blockquote>
<h1 id="incubating">0.4.0-incubating</h1>
<ul>
<li>Release notes:
<ul>
- <li><a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.4.0-incubating";>Eagle
0.4.0 Release Notes</a></li>
+ <li><a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.4.0-incubating";>Eagle
0.4.0 Release Notes</a></li>
</ul>
</li>
<li>Source download:
<ul>
<li><a
href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.4.0-incubating";>apache-eagle-0.4.0-incubating-src.tar.gz</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.md5";>apache-eagle-0.4.0-incubating-src.tar.gz.md5</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.sha1";>apache-eagle-0.4.0-incubating-src.tar.gz.sha1</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.asc";>apache-eagle-0.4.0-incubating-src.tar.gz.asc</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.md5";>apache-eagle-0.4.0-incubating-src.tar.gz.md5</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.sha1";>apache-eagle-0.4.0-incubating-src.tar.gz.sha1</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.asc";>apache-eagle-0.4.0-incubating-src.tar.gz.asc</a></li>
</ul>
</li>
<li>Git revision:
<ul>
- <li>tag: <a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=commit;h=refs/tags/v0.4.0-incubating";>v0.4.0-incubating</a></li>
- <li>commit: <a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=commit;h=eac0f27958f2ed8c6842938dad0a995a87fd0715";>eac0f27958f2ed8c6842938dad0a995a87fd0715</a></li>
+ <li>tag: <a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.4.0-incubating";>v0.4.0-incubating</a></li>
+ <li>commit: <a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=eac0f27958f2ed8c6842938dad0a995a87fd0715";>eac0f27958f2ed8c6842938dad0a995a87fd0715</a></li>
</ul>
</li>
</ul>
@@ -249,21 +249,21 @@
<ul>
<li>Release notes:
<ul>
- <li><a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/heads/branch-0.3";>Eagle
0.3.0 Release Notes</a></li>
+ <li><a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/heads/branch-0.3";>Eagle
0.3.0 Release Notes</a></li>
</ul>
</li>
<li>Source download:
<ul>
<li><a
href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.3.0-incubating";>apache-eagle-0.3.0-incubating-src.tar.gz</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.3.0-incubating/apache-eagle-0.3.0-incubating-src.tar.gz.md5";>apache-eagle-0.3.0-incubating-src.tar.gz.md5</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.3.0-incubating/apache-eagle-0.3.0-incubating-src.tar.gz.sha1";>apache-eagle-0.3.0-incubating-src.tar.gz.sha1</a></li>
- <li><a
href="https://dist.apache.org/repos/dist/release/incubator/eagle/apache-eagle-0.3.0-incubating/apache-eagle-0.3.0-incubating-src.tar.gz.asc";>apache-eagle-0.3.0-incubating-src.tar.gz.asc</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.3.0-incubating/apache-eagle-0.3.0-incubating-src.tar.gz.md5";>apache-eagle-0.3.0-incubating-src.tar.gz.md5</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.3.0-incubating/apache-eagle-0.3.0-incubating-src.tar.gz.sha1";>apache-eagle-0.3.0-incubating-src.tar.gz.sha1</a></li>
+ <li><a
href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.3.0-incubating/apache-eagle-0.3.0-incubating-src.tar.gz.asc";>apache-eagle-0.3.0-incubating-src.tar.gz.asc</a></li>
</ul>
</li>
<li>Git revision:
<ul>
- <li>tag: <a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=commit;h=refs/tags/v0.3.0-incubating";>v0.3.0-incubating</a></li>
- <li>commit: <a
href="https://git-wip-us.apache.org/repos/asf?p=incubator-eagle.git;a=commit;h=8183edad341bdec80a7d2acd56a5b5e24f28681c";>8183edad341bdec80a7d2acd56a5b5e24f28681c</a></li>
+ <li>tag: <a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.3.0-incubating";>v0.3.0-incubating</a></li>
+ <li>commit: <a
href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=8183edad341bdec80a7d2acd56a5b5e24f28681c";>8183edad341bdec80a7d2acd56a5b5e24f28681c</a></li>
</ul>
</li>
</ul>
Modified: eagle/site/docs/ecosystem.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/ecosystem.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/ecosystem.html (original)
+++ eagle/site/docs/ecosystem.html Tue Jan 3 01:19:05 2017
@@ -219,7 +219,7 @@
<h1 class="page-header" style="margin-top: 0px">Ecosystem</h1>
<h3 id="core">Core</h3>
-<p>The core of Apache Eagle (incubating, called Eagle in the following) is the
highly scalable real-time alert engine, including coordinator, metadata
service, and policy processing topology, so on. Around Eagle alert engine,
community can integrate more data sources and also can write applications to
listen to alerts and respond.</p>
+<p>The core of Apache Eagle (called Eagle in the following) is the highly
scalable real-time alert engine, including coordinator, metadata service, and
policy processing topology, so on. Around Eagle alert engine, community can
integrate more data sources and also can write applications to listen to alerts
and respond.</p>
<h3 id="extension">Extension</h3>
<p>Eagle exposes a few places where community can extend Eagle existing
capabilities.</p>
Modified: eagle/site/docs/hbase-auth-activity-monitoring.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/hbase-auth-activity-monitoring.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/hbase-auth-activity-monitoring.html (original)
+++ eagle/site/docs/hbase-auth-activity-monitoring.html Tue Jan 3 01:19:05 2017
@@ -225,7 +225,7 @@
<p>Note: when testing in HDP sandbox, sometimes Apache Ranger will take over
access controll for HBase, so maybe you need change that back to native hbase
access controller, i.e. change
com.xasecure.authorization.hbase.XaSecureAuthorizationCoprocessor to
org.apache.hadoop.hbase.security.access.AccessController</p>
-<div class="highlighter-rouge"><pre class="highlight"><code><property>
+<pre><code><property>
<name>hbase.security.authorization</name>
<value>true</value>
</property>
@@ -238,11 +238,10 @@
<value>org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController</value>
</property>
</code></pre>
-</div>
<h4 id="log4jproperties">2. log4j.properties</h4>
-<div class="highlighter-rouge"><pre class="highlight"><code>#
+<pre><code>#
# Security audit appender
#
hbase.security.log.file=SecurityAuth.audit
@@ -258,7 +257,6 @@ log4j.category.SecurityLogger=${hbase.se
log4j.additivity.SecurityLogger=false
log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE
</code></pre>
-</div>
<hr />
Modified: eagle/site/docs/hbase-data-activity-monitoring.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/hbase-data-activity-monitoring.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/hbase-data-activity-monitoring.html (original)
+++ eagle/site/docs/hbase-data-activity-monitoring.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">HBase Data Activity
Monitoring</h1>
- <p><em>On this page, any mention of Eagle points to Apache Eagle
(incubating).</em></p>
+ <p><em>On this page, any mention of Eagle points to Apache
Eagle.</em></p>
<p>This page will introduce how to monitoring HBase data activity in the
following aspects:</p>
@@ -235,16 +235,15 @@
<ol>
<li>
- <p>edit Advanced hbase-log4j via Ambari<sup id="fnref:AMBARI"><a
href="#fn:AMBARI" class="footnote">3</a></sup> UI, and append below sentence to
<code class="highlighter-rouge">Security audit appender</code></p>
+ <p>edit Advanced hbase-log4j via Ambari<sup id="fnref:AMBARI"><a
href="#fn:AMBARI" class="footnote">3</a></sup> UI, and append below sentence to
<code>Security audit appender</code></p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS
+ <pre><code>
log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS
</code></pre>
- </div>
</li>
<li>
<p>edit Advanced hbase-site.xml</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
<property>
+ <pre><code> <property>
<name>hbase.security.authorization</name>
<value>true</value>
</property>
@@ -259,7 +258,6 @@
<value>org.apache.hadoop.hbase.security.access.AccessController</value>
</property>
</code></pre>
- </div>
</li>
<li>
<p>Save and restart HBase</p>
@@ -271,22 +269,21 @@
<h3 id="how-to-add-a-kafka-log4j-appender">How to add a Kafka log4j
appender</h3>
<blockquote>
- <p>Notice: if you are willing to use sample logs under <code
class="highlighter-rouge">eagle-security-hbase-security/test/resources/securityAuditLog</code>,
please skip this part.</p>
+ <p>Notice: if you are willing to use sample logs under
<code>eagle-security-hbase-security/test/resources/securityAuditLog</code>,
please skip this part.</p>
</blockquote>
<ol>
<li>
- <p>create Kafka topic <code
class="highlighter-rouge">sandbox_hbase_security_log</code></p>
+ <p>create Kafka topic <code>sandbox_hbase_security_log</code></p>
- <div class="highlighter-rouge"><pre class="highlight"><code> $
/usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper
localhost:2181 --replication-factor 1 --partitions 1 --topic
sandbox_hbase_security_log
+ <pre><code> $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create
--zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic
sandbox_hbase_security_log
</code></pre>
- </div>
</li>
<li>
- <p>add below âKAFKA_HBASE_AUDITâ log4j appender to <code
class="highlighter-rouge">Security audit appender</code>
+ <p>add below âKAFKA_HBASE_AUDITâ log4j appender to <code>Security
audit appender</code>
Please refer to http://goeagle.io/docs/import-hdfs-auditLog.html.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <pre><code>
log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HBASE_AUDIT.Topic=sandbox_hbase_security_log
log4j.appender.KAFKA_HBASE_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HBASE_AUDIT.Layout=org.apache.log4j.PatternLayout
@@ -295,21 +292,18 @@ Please refer to http://goeagle.io/docs/i
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.GenericLogKeyer
log4j.appender.KAFKA_HDFS_AUDIT.KeyPattern=user=(\\w+),\\s+
</code></pre>
- </div>
</li>
<li>
<p>add the reference to KAFKA_HBASE_AUDIT to log4j appender</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS,KAFKA_HBASE_AUDIT
+ <pre><code>
log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS,KAFKA_HBASE_AUDIT
</code></pre>
- </div>
</li>
<li>
<p>add Eagle log4j appender jars into HBASE_CLASSPATH BY editing Advanced
hbase-env via Ambari UI</p>
- <div class="highlighter-rouge"><pre class="highlight"><code> export
HBASE_CLASSPATH=${HBASE_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <pre><code> export
HBASE_CLASSPATH=${HBASE_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
- </div>
</li>
<li>
<p>Save and restart HBase</p>
@@ -320,36 +314,32 @@ Please refer to http://goeagle.io/docs/i
<ol>
<li>
- <p>create tables (<code class="highlighter-rouge">skip if you do not use
hbase</code>)</p>
+ <p>create tables (<code>skip if you do not use hbase</code>)</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
bin/eagle-service-init.sh
+ <pre><code> bin/eagle-service-init.sh
</code></pre>
- </div>
</li>
<li>
<p>start Eagle service</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
bin/eagle-service.sh start
+ <pre><code> bin/eagle-service.sh start
</code></pre>
- </div>
</li>
<li>
<p>import metadata</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
bin/eagle-topology-init.sh
+ <pre><code> bin/eagle-topology-init.sh
</code></pre>
- </div>
</li>
<li>
<p>submit topology</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
bin/eagle-topology.sh --main
org.apache.eagle.security.hbase.HbaseAuditLogProcessorMain --config
conf/sandbox-hbaseSecurityLog-application.conf start
+ <pre><code> bin/eagle-topology.sh --main
org.apache.eagle.security.hbase.HbaseAuditLogProcessorMain --config
conf/sandbox-hbaseSecurityLog-application.conf start
</code></pre>
- </div>
</li>
</ol>
-<p>(sample sensitivity data at <code
class="highlighter-rouge">examples/sample-sensitivity-resource-create.sh</code>)</p>
+<p>(sample sensitivity data at
<code>examples/sample-sensitivity-resource-create.sh</code>)</p>
<h3 id="q--a">Q & A</h3>
Modified: eagle/site/docs/hdfs-auth-activity-monitoring.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/hdfs-auth-activity-monitoring.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/hdfs-auth-activity-monitoring.html (original)
+++ eagle/site/docs/hdfs-auth-activity-monitoring.html Tue Jan 3 01:19:05 2017
@@ -221,25 +221,23 @@
<h4 id="sample-authorization-logs">Sample authorization logs</h4>
-<div class="highlighter-rouge"><pre class="highlight"><code>2016-06-08
02:55:07,742 INFO
SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager:
Authorization successful for hdfs (auth:SIMPLE) for protocol=interface
org.apache.hadoop.hdfs.protocol.ClientProtocol
+<pre><code>2016-06-08 02:55:07,742 INFO
SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager:
Authorization successful for hdfs (auth:SIMPLE) for protocol=interface
org.apache.hadoop.hdfs.protocol.ClientProtocol
2016-06-08 02:55:35,304 INFO
SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager:
Authorization successful for hdfs (auth:SIMPLE) for protocol=interface
org.apache.hadoop.hdfs.server.protocol.NamenodeProtocol
2016-06-08 02:55:36,862 INFO
SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager:
Authorization successful for hive (auth:SIMPLE) for protocol=interface
org.apache.hadoop.hdfs.protocol.ClientProtocol
</code></pre>
-</div>
<p>Steps for enabling service-level authorization activity</p>
<h4 id="enable-hdfs-authorization-security-in-core-sitexml">1. Enable HDFS
Authorization Security in core-site.xml</h4>
-<div class="highlighter-rouge"><pre class="highlight"><code> <property>
+<pre><code> <property>
<name>hadoop.security.authorization</name>
<value>true</value>
</property>
</code></pre>
-</div>
<h4 id="enable-hdfs-security-log-in-log4jproperties">2. Enable HDFS security
log in log4j.properties</h4>
-<div class="highlighter-rouge"><pre class="highlight"><code>#
+<pre><code>#
#Security audit appender
#
hadoop.security.logger=INFO,DRFAS
@@ -253,7 +251,6 @@ log4j.appender.DRFAS.layout=org.apache.l
log4j.appender.DRFAS.layout.ConversionPattern=%d{ISO8601} %p %c: %m%n
log4j.appender.DRFAS.DatePattern=.yyyy-MM-dd
</code></pre>
-</div>
</div><!--end of loadcontent-->
</div>
Modified: eagle/site/docs/hdfs-data-activity-monitoring.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/hdfs-data-activity-monitoring.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/hdfs-data-activity-monitoring.html (original)
+++ eagle/site/docs/hdfs-data-activity-monitoring.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">HDFS Data Activity
Monitoring Quick Start</h1>
- <p><em>Since Apache Eagle 0.3.0-incubating. Apache Eagle (incubating)
will be called Eagle in the following.</em></p>
+ <p><em>Since Apache Eagle 0.3.0-incubating. Apache Eagle will be
called Eagle in the following.</em></p>
<p>This Guide describes the steps to enable data activity monitoring of
âHDFS File Systemâ.</p>
@@ -242,7 +242,7 @@
<li>
<p><strong>Step 1</strong>: Configure Advanced hdfs-log4j via <a
href="http://localhost:8080/#/main/services/HDFS/configs";
target="_blank">Ambari UI</a><sup id="fnref:AMBARI"><a href="#fn:AMBARI"
class="footnote">2</a></sup>, by adding below âKAFKA_HDFS_AUDITâ log4j
appender to hdfs audit logging.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>
log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <pre><code>
log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -250,25 +250,22 @@
log4j.appender.KAFKA_HDFS_AUDIT.Layout.ConversionPattern=%d{ISO8601} %p
%c{2}: %m%n
log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J
Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 2</strong>: Edit Advanced hadoop-env via <a
href="http://localhost:8080/#/main/services/HDFS/configs";
target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to
HADOOP_NAMENODE_OPTS.</p>
- <div class="highlighter-rouge"><pre
class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment
Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a
href="http://localhost:8080/#/main/services/HDFS/configs";
target="_blank">Ambari UI</a>, and append the following command to it.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <pre><code>export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment
Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -287,11 +284,10 @@
<ul>
<li>
- <p><strong>Step 7</strong>: Check whether logs from
â/var/log/hadoop/hdfs/hdfs-audit.logâ are flowing into topic <code
class="highlighter-rouge">sandbox_hdfs_audit_log</code></p>
+ <p><strong>Step 7</strong>: Check whether logs from
â/var/log/hadoop/hdfs/hdfs-audit.logâ are flowing into topic
<code>sandbox_hdfs_audit_log</code></p>
- <div class="highlighter-rouge"><pre class="highlight"><code> $
/usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper
sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log
+ <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh
--zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log
</code></pre>
- </div>
</li>
</ul>
Modified: eagle/site/docs/hive-query-activity-monitoring.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/hive-query-activity-monitoring.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/hive-query-activity-monitoring.html (original)
+++ eagle/site/docs/hive-query-activity-monitoring.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Hive Query Activity
Monitoring Quick Start</h1>
- <p><em>Since Apache Eagle 0.3.0-incubating. Apache Eagle (incubating)
will be called Eagle in the following.</em></p>
+ <p><em>Since Apache Eagle 0.3.0-incubating. Apache Eagle will be
called Eagle in the following.</em></p>
<p>This Guide describes the steps to enable HIVE<sup id="fnref:HIVE"><a
href="#fn:HIVE" class="footnote">1</a></sup> query activity monitoring.</p>
@@ -248,13 +248,12 @@
</li>
</ul>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ su hive
+<pre><code>$ su hive
$ hive
$ set hive.execution.engine=mr;
$ use xademo;
$ select a.phone_number from customer_details a, call_detail_records b where
a.phone_number=b.phone_number;
</code></pre>
-</div>
<p>From UI click on alert tab and you should see alert for your attempt to
read restricted column.</p>
Modified: eagle/site/docs/import-hdfs-auditLog.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/import-hdfs-auditLog.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/import-hdfs-auditLog.html (original)
+++ eagle/site/docs/import-hdfs-auditLog.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">How to stream hdfs log
data into Kafka</h1>
- <p>As Apache Eagle (incubating) consumes the data via Kafka<sup
id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">1</a></sup> topics in
some topologies, such as HDFS audit log. To enable the full function of
monitoring, a user needs to stream its data into a Kafka topic.</p>
+ <p>As Apache Eagle consumes the data via Kafka<sup id="fnref:KAFKA"><a
href="#fn:KAFKA" class="footnote">1</a></sup> topics in some topologies, such
as HDFS audit log. To enable the full function of monitoring, a user needs to
stream its data into a Kafka topic.</p>
<p>There are two ways to do that. The first one is <strong>Logstash</strong>,
which naturally supports Kafka as the output plugin; the second one is to
install a <strong>namenode log4j Kafka appender</strong>.</p>
@@ -230,10 +230,9 @@ install a <strong>namenode log4j Kafka a
<p>Here is an sample Kafka command to create topic
âsandbox_hdfs_audit_logâ</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>cd
<kafka-home>
+ <pre><code>cd <kafka-home>
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1
--partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
- </div>
</li>
<li>
<p><strong>Step 2</strong>: Install Logstash-kafka plugin</p>
@@ -251,7 +250,7 @@ bin/kafka-topics.sh --create --zookeeper
<li>
<p><strong>Step 3</strong>: Create a Logstash configuration file under
${LOGSTASH_HOME}/conf. Here is a sample.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code> input {
+ <pre><code> input {
file {
type => "hdp-nn-audit"
path => "/path/to/audit.log"
@@ -292,17 +291,15 @@ bin/kafka-topics.sh --create --zookeeper
}
}
</code></pre>
- </div>
</li>
<li>
<p><strong>Step 4</strong>: Start Logstash</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>bin/logstash
-f conf/sample.conf
+ <pre><code>bin/logstash -f conf/sample.conf
</code></pre>
- </div>
</li>
<li>
- <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka
topic specified by <code class="highlighter-rouge">topic_id</code></p>
+ <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka
topic specified by <code>topic_id</code></p>
</li>
</ul>
@@ -316,15 +313,14 @@ bin/kafka-topics.sh --create --zookeeper
<li>
<p><strong>Step 1</strong>: Create a Kafka topic. Here is a example Kafka
command for creating topic âsandbox_hdfs_audit_logâ</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>cd
<kafka-home>
+ <pre><code>cd <kafka-home>
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1
--partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
- </div>
</li>
<li>
<p><strong>Step 2</strong>: Configure $HADOOP_CONF_DIR/log4j.properties,
and add a log4j appender âKAFKA_HDFS_AUDITâ to hdfs audit logging</p>
- <div class="highlighter-rouge"><pre
class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+
<pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -334,25 +330,22 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
#log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1
#log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J
Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and add
the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p>
- <div class="highlighter-rouge"><pre
class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment
Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 4</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and
append the following command to it.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/*
+ <pre><code>export
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/*
</code></pre>
- </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment
Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -362,9 +355,8 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<li>
<p><strong>Step 6</strong>: Check whether logs are flowing into Topic
sandbox_hdfs_audit_log</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$
/usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper
localhost:2181 --topic sandbox_hdfs_audit_log
+ <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh
--zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
</code></pre>
- </div>
</li>
</ul>
Modified: eagle/site/docs/index.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/index.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/index.html (original)
+++ eagle/site/docs/index.html Tue Jan 3 01:19:05 2017
@@ -217,10 +217,10 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Introduction</h1>
- <h3 id="welcome-to-apache-eagle-incubating">Welcome to Apache Eagle
(incubating)</h3>
+ <h3 id="welcome-to-apache-eagle">Welcome to Apache Eagle</h3>
<blockquote>
- <p>Apache Eagle (incubating, called Eagle in the following) is an open
source analytics solution for identifying security and performance issues
instantly on big data platforms e.g. Hadoop<sup id="fnref:HADOOP"><a
href="#fn:HADOOP" class="footnote">1</a></sup>, Spark<sup id="fnref:SPARK"><a
href="#fn:SPARK" class="footnote">2</a></sup>, NoSQL etc. It analyzes data
activities, yarn applications, jmx metrics, and daemon logs etc., provides
state-of-the-art alert engine to identify security breach, performance issues
and shows insights.</p>
+ <p>Apache Eagle (called Eagle in the following) is an open source analytics
solution for identifying security and performance issues instantly on big data
platforms e.g. Hadoop<sup id="fnref:HADOOP"><a href="#fn:HADOOP"
class="footnote">1</a></sup>, Spark<sup id="fnref:SPARK"><a href="#fn:SPARK"
class="footnote">2</a></sup>, NoSQL etc. It analyzes data activities, yarn
applications, jmx metrics, and daemon logs etc., provides state-of-the-art
alert engine to identify security breach, performance issues and shows
insights.</p>
</blockquote>
<h3 id="basic-analytics-and-monitoring-flow">Basic Analytics and Monitoring
Flow</h3>
Modified: eagle/site/docs/installation.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/installation.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/installation.html (original)
+++ eagle/site/docs/installation.html Tue Jan 3 01:19:05 2017
@@ -3,7 +3,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Eagle - Install Apache Eagle (incubating)</title>
+ <title>Eagle - Install Apache Eagle</title>
<meta name="description" content="Eagle - Analyze Big Data Platforms
for Security and Performance">
<meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
@@ -216,8 +216,8 @@
</ul>
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
- <h1 class="page-header" style="margin-top: 0px">Install Apache Eagle
(incubating)</h1>
- <h3
id="install-apache-eagle-incubating-called-eagle-in-the-following-to-sandbox">Install
Apache Eagle (incubating, called Eagle in the following) to Sandbox</h3>
+ <h1 class="page-header" style="margin-top: 0px">Install Apache
Eagle</h1>
+ <h3
id="install-apache-eagle-called-eagle-in-the-following-to-sandbox">Install
Apache Eagle (called Eagle in the following) to Sandbox</h3>
<h4 id="pre-requisites">Pre-requisites</h4>
@@ -242,7 +242,7 @@
<ul>
<li>
- <p><strong>Step 1</strong>: Clone stable version from <a
href="https://github.com/apache/incubator-eagle/releases/tag/v0.4.0-incubating";>eagle
github</a>
+ <p><strong>Step 1</strong>: Clone stable version from <a
href="https://github.com/apache/eagle/releases/tag/v0.4.0-incubating";>eagle
github</a>
> Build project mvn clean install -DskipTests=true</p>
</li>
<li>
@@ -250,7 +250,7 @@
<ul>
<li>
- <p>Option 1: <code class="highlighter-rouge">scp -P 2222
eagle/eagle-assembly/target/eagle-0.1.0-bin.tar.gz
[email protected]:/usr/hdp/current/</code></p>
+ <p>Option 1: <code>scp -P 2222
eagle/eagle-assembly/target/eagle-0.1.0-bin.tar.gz
[email protected]:/usr/hdp/current/</code></p>
</li>
<li>
<p>Option 2: Create shared directory between host and Sandbox, and
restart Sandbox. Then you can find the shared directory under /media in
Sandbox.</p>
@@ -260,11 +260,10 @@
<li>
<p><strong>Step 3</strong>: Extract eagle tarball package</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$ cd
/usr/hdp/current
+ <pre><code>$ cd /usr/hdp/current
$ tar -zxvf eagle-0.1.0-bin.tar.gz
$ mv eagle-0.1.0 eagle
</code></pre>
- </div>
</li>
<li>
<p><strong>Step 4</strong>: Add root as a HBase<sup id="fnref:HBASE"><a
href="#fn:HBASE" class="footnote">1</a></sup> superuser via <a
href="http://127.0.0.1:8080/#/main/services/HBASE/configs";>Ambari</a>
(Optional, a user can operate HBase by sudo su hbase, as an alternative).</p>
@@ -303,10 +302,9 @@ EagleServiceSuccess</p>
<li>
<p><strong>Step 9</strong>: Add Policies and meta data required by running
below script.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code>$
/usr/hdp/current/eagle/examples/sample-sensitivity-resource-create.sh
+ <pre><code>$
/usr/hdp/current/eagle/examples/sample-sensitivity-resource-create.sh
$ /usr/hdp/current/eagle/examples/sample-policy-create.sh
</code></pre>
- </div>
</li>
</ul>
Modified: eagle/site/docs/jmx-metric-monitoring.html
URL:
http://svn.apache.org/viewvc/eagle/site/docs/jmx-metric-monitoring.html?rev=1777047&r1=1777046&r2=1777047&view=diff
==============================================================================
--- eagle/site/docs/jmx-metric-monitoring.html (original)
+++ eagle/site/docs/jmx-metric-monitoring.html Tue Jan 3 01:19:05 2017
@@ -217,7 +217,7 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left:
-15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">JMX Metric
Monitoring</h1>
- <p>JMX metric for Apache Hadoop namenode url <a
href="http://127.0.0.1:50070/jmx";>http://127.0.0.1:50070/jmx</a> can be
monitored using Apache Eagle (incubating, called Eagle in the following).
Follow below steps to enable this feature in Eagle.</p>
+ <p>JMX metric for Apache Hadoop namenode url <a
href="http://127.0.0.1:50070/jmx";>http://127.0.0.1:50070/jmx</a> can be
monitored using Apache Eagle (called Eagle in the following). Follow below
steps to enable this feature in Eagle.</p>
<ol>
<li>Install Python script (To populate JMX metric values to Kafka<sup
id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">1</a></sup> topic
periodically).</li>
@@ -238,10 +238,9 @@
<h3 id="setup"><strong>Setup</strong></h3>
<p>From Hortonworks sandbox just run below setup script to Install Pyton JMX
script, Create Kafka topic, update Apache Hbase tables and deploy
âhadoopjmxâ Storm topology.</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$
/usr/hdp/current/eagle/examples/hadoop-metric-sandbox-starter.sh
+<pre><code>$ /usr/hdp/current/eagle/examples/hadoop-metric-sandbox-starter.sh
$ /usr/hdp/current/eagle/examples/hadoop-metric-policy-create.sh
</code></pre>
-</div>
<p><br /></p>
@@ -266,17 +265,15 @@ $ /usr/hdp/current/eagle/examples/hadoop
<li>
<p>First make sure that Kafka topic ânn_jmx_metric_sandboxâ is
populated with JMX metric data periodically.(To make sure that python script is
running)</p>
- <div class="highlighter-rouge"><pre class="highlight"><code> $
/usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper
sandbox.hortonworks.com:2181 --topic nn_jmx_metric_sandbox
+ <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh
--zookeeper sandbox.hortonworks.com:2181 --topic nn_jmx_metric_sandbox
</code></pre>
- </div>
</li>
<li>
<p>Genrate Alert by producing alert triggering message into Kafka
topic.</p>
- <div class="highlighter-rouge"><pre class="highlight"><code> $
/usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-producer.sh --broker-list
sandbox.hortonworks.com:6667 --topic nn_jmx_metric_sandbox
+ <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-producer.sh
--broker-list sandbox.hortonworks.com:6667 --topic nn_jmx_metric_sandbox
$ {"host": "localhost", "timestamp": 1457033916718, "metric":
"hadoop.namenode.fsnamesystemstate.fsstate", "component": "namenode", "site":
"sandbox", "value": 1.0}
</code></pre>
- </div>
</li>
</ul>
