Update site
Project: http://git-wip-us.apache.org/repos/asf/eagle/repo Commit: http://git-wip-us.apache.org/repos/asf/eagle/commit/0094010b Tree: http://git-wip-us.apache.org/repos/asf/eagle/tree/0094010b Diff: http://git-wip-us.apache.org/repos/asf/eagle/diff/0094010b Branch: refs/heads/site Commit: 0094010b853e3d86acd253649fe21d32f418a0c9 Parents: 038bde7 Author: Hao Chen <hch...@ebay.com> Authored: Wed Nov 22 13:55:06 2017 +0800 Committer: Hao Chen <hch...@ebay.com> Committed: Wed Nov 22 13:55:06 2017 +0800 ---------------------------------------------------------------------- .gitignore | 1 + .../_base.scssc | Bin 14569 -> 0 bytes .../_layout.scssc | Bin 43155 -> 0 bytes .../_syntax-highlighting.scssc | Bin 40242 -> 0 bytes _site/docs/FAQ.html | 6 +- _site/docs/ambari-plugin-install.html | 19 ++-- _site/docs/cloudera-integration.html | 62 +++++++------ _site/docs/community.html | 28 +++--- _site/docs/configuration.html | 14 +-- _site/docs/deployment-env.html | 14 +-- _site/docs/deployment-in-docker.html | 12 ++- _site/docs/deployment-in-production.html | 22 +++-- _site/docs/deployment-in-sandbox.html | 37 ++++---- _site/docs/development-in-intellij.html | 16 ++-- _site/docs/development-in-macosx.html | 68 +++++++++------ _site/docs/download-latest.html | 46 ++-------- _site/docs/download.html | 27 +++++- _site/docs/hbase-auth-activity-monitoring.html | 12 +-- _site/docs/hbase-data-activity-monitoring.html | 48 +++++++---- _site/docs/hdfs-auth-activity-monitoring.html | 13 +-- _site/docs/hdfs-data-activity-monitoring.html | 20 +++-- _site/docs/hive-query-activity-monitoring.html | 5 +- _site/docs/import-hdfs-auditLog.html | 30 ++++--- _site/docs/index.html | 6 +- _site/docs/installation.html | 45 ++++++---- _site/docs/jmx-metric-monitoring.html | 13 +-- _site/docs/mapr-integration.html | 61 +++++++------ _site/docs/quick-start-0.3.0.html | 10 ++- _site/docs/quick-start.html | 17 ++-- _site/docs/security.html | 2 +- _site/docs/serviceconfiguration.html | 9 +- _site/docs/terminology.html | 4 +- _site/docs/tutorial/classification.html | 22 +++-- _site/docs/tutorial/ldap.html | 6 +- _site/docs/tutorial/notificationplugin.html | 34 ++++---- _site/docs/tutorial/policy.html | 8 +- _site/docs/tutorial/site-0.3.0.html | 86 ++++++++++--------- _site/docs/tutorial/topologymanagement.html | 14 +-- _site/docs/tutorial/userprofile.html | 25 +++--- _site/docs/usecases.html | 8 +- _site/feed.xml | 42 +++++---- .../2015/10/27/apache-eagle-announce-cn.html | 36 ++++---- 42 files changed, 545 insertions(+), 403 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/.gitignore ---------------------------------------------------------------------- diff --git a/.gitignore b/.gitignore index 173da0c..9be3c2a 100644 --- a/.gitignore +++ b/.gitignore @@ -84,3 +84,4 @@ logs/ **/*.db docs/site +.sass-cache/ http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_base.scssc ---------------------------------------------------------------------- diff --git a/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_base.scssc b/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_base.scssc deleted file mode 100644 index 93239c2..0000000 Binary files a/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_base.scssc and /dev/null differ http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_layout.scssc ---------------------------------------------------------------------- diff --git a/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_layout.scssc b/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_layout.scssc deleted file mode 100644 index 6fd7426..0000000 Binary files a/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_layout.scssc and /dev/null differ http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_syntax-highlighting.scssc ---------------------------------------------------------------------- diff --git a/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_syntax-highlighting.scssc b/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_syntax-highlighting.scssc deleted file mode 100644 index ae4fd0e..0000000 Binary files a/.sass-cache/bde63e899d42a91f9035e0b509e18ff435977dba/_syntax-highlighting.scssc and /dev/null differ http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/FAQ.html ---------------------------------------------------------------------- diff --git a/_site/docs/FAQ.html b/_site/docs/FAQ.html index 78881fd..4dc3f45 100644 --- a/_site/docs/FAQ.html +++ b/_site/docs/FAQ.html @@ -164,14 +164,16 @@ <p>Add the following line in host machineâs hosts file</p> </blockquote> - <pre><code>127.0.0.1 sandbox.hortonworks.com + <div class="highlighter-rouge"><pre class="highlight"><code>127.0.0.1 sandbox.hortonworks.com </code></pre> + </div> </li> <li> <p><strong>Q2. Not able to send data into kafka using kafka console producer</strong>:</p> - <pre><code>/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list localhost:6667 --topic sandbox_hdfs_audit_log + <div class="highlighter-rouge"><pre class="highlight"><code>/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list localhost:6667 --topic sandbox_hdfs_audit_log </code></pre> + </div> <blockquote> <p>Apache Kafka broker are binding to host sandbox.hortonworks.com</p> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/ambari-plugin-install.html ---------------------------------------------------------------------- diff --git a/_site/docs/ambari-plugin-install.html b/_site/docs/ambari-plugin-install.html index b1f6578..ecb4cb7 100644 --- a/_site/docs/ambari-plugin-install.html +++ b/_site/docs/ambari-plugin-install.html @@ -168,8 +168,9 @@ <li> <p>Create a Kafka<sup id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">1</a></sup> topic if you have not. Here is an example command.</p> - <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log + <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log </code></pre> + </div> </li> <li> <p>Stream HDFS log data to Kafka, and refer to <a href="/docs/import-hdfs-auditLog.html">here</a> on how to do it .</p> @@ -185,8 +186,9 @@ <li> <p>Install Eagle Ambari plugin</p> - <pre><code>$ /usr/hdp/current/eagle/bin/eagle-ambari.sh install + <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/eagle/bin/eagle-ambari.sh install </code></pre> + </div> </li> <li> <p>Restart <a href="http://127.0.0.1:8000/";>Ambari</a> click on disable and enable Ambari back.</p> @@ -200,10 +202,11 @@ <li> <p>Add Policies and meta data required by running the below script.</p> - <pre><code>$ cd <eagle-home> + <div class="highlighter-rouge"><pre class="highlight"><code>$ cd <eagle-home> $ examples/sample-sensitivity-resource-create.sh $ examples/sample-policy-create.sh </code></pre> + </div> </li> </ol> @@ -214,19 +217,19 @@ $ examples/sample-policy-create.sh <div class="footnotes"> <ol> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:STORM"> - <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> + <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> </li> <li id="fn:SPARK"> - <p><em>Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p> + <p><em>Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p> </li> <li id="fn:HBASE"> - <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:AMBARI"> - <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> + <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/cloudera-integration.html ---------------------------------------------------------------------- diff --git a/_site/docs/cloudera-integration.html b/_site/docs/cloudera-integration.html index 20dbf64..f39b50f 100644 --- a/_site/docs/cloudera-integration.html +++ b/_site/docs/cloudera-integration.html @@ -168,8 +168,8 @@ This tutorial is to address these issues before you continue to follow the tutor <ul> <li>Zookeeper (installed through Cloudera Manager)</li> <li>Kafka (installed through Cloudera Manager)</li> - <li>Storm (<code>0.9.x</code> or <code>0.10.x</code>, installed manually)</li> - <li>Logstash (<code>2.X</code>, installed manually on NameNode)</li> + <li>Storm (<code class="highlighter-rouge">0.9.x</code> or <code class="highlighter-rouge">0.10.x</code>, installed manually)</li> + <li>Logstash (<code class="highlighter-rouge">2.X</code>, installed manually on NameNode)</li> </ul> <h3 id="kafka">Kafka</h3> @@ -180,17 +180,18 @@ This tutorial is to address these issues before you continue to follow the tutor <ul> <li> - <p>Open Cloudera Manager and open âkafkaâ configuration, then set <code>âzookeeper Rootâ</code> to <code>â/â</code>.</p> + <p>Open Cloudera Manager and open âkafkaâ configuration, then set <code class="highlighter-rouge">âzookeeper Rootâ</code> to <code class="highlighter-rouge">â/â</code>.</p> </li> <li> - <p>If Kafka cannot be started successfully, check kafkaâs log. If stack trace shows: <code>âjava.lang.OutOfMemoryError: Java heap spaceâ</code>. Increase heap size by setting <code>"KAFKA_HEAP_OPTS"</code>in <code>/bin/kafka-server-start.sh</code>.</p> + <p>If Kafka cannot be started successfully, check kafkaâs log. If stack trace shows: <code class="highlighter-rouge">âjava.lang.OutOfMemoryError: Java heap spaceâ</code>. Increase heap size by setting <code class="highlighter-rouge">"KAFKA_HEAP_OPTS"</code>in <code class="highlighter-rouge">/bin/kafka-server-start.sh</code>.</p> </li> </ul> <p>Example:</p> -<pre><code> export KAFKA_HEAP_OPTS="-Xmx2G -Xms2G" +<div class="highlighter-rouge"><pre class="highlight"><code> export KAFKA_HEAP_OPTS="-Xmx2G -Xms2G" </code></pre> +</div> <h4 id="verification">Verification</h4> @@ -198,15 +199,17 @@ This tutorial is to address these issues before you continue to follow the tutor <li>Step1: create a kafka topic (here I created a topic called âtestâ, which will be used in logstash configuration file to receive hdfsAudit log messages from Cloudera.</li> </ul> -<pre><code>bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test +<div class="highlighter-rouge"><pre class="highlight"><code>bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test </code></pre> +</div> <ul> <li>Step2: check if topic has been created successfully.</li> </ul> -<pre><code>bin/kafka-topics.sh --list --zookeeper 127.0.0.1:2181 +<div class="highlighter-rouge"><pre class="highlight"><code>bin/kafka-topics.sh --list --zookeeper 127.0.0.1:2181 </code></pre> +</div> <p>this command will show all created topics.</p> @@ -214,9 +217,10 @@ This tutorial is to address these issues before you continue to follow the tutor <li>Step3: open two terminals, start âproducerâ and âconsumerâ separately.</li> </ul> -<pre><code>/usr/bin/kafka-console-producer --broker-list hostname:9092 --topic test +<div class="highlighter-rouge"><pre class="highlight"><code>/usr/bin/kafka-console-producer --broker-list hostname:9092 --topic test /usr/bin/kafka-console-consumer --zookeeper hostname:2181 --topic test </code></pre> +</div> <ul> <li>Step4: type in some message in producer. If consumer can receive the messages sent from producer, then kafka is working fine. Otherwise please check the configuration and logs to identify the root cause of issues.</li> @@ -228,33 +232,36 @@ This tutorial is to address these issues before you continue to follow the tutor <p>You can follow <a href="https://www.elastic.co/downloads/logstash";>logstash online doc</a> to download and install logstash on your machine:</p> -<p>Or you can install it through <code>yum</code> if you are using centos:</p> +<p>Or you can install it through <code class="highlighter-rouge">yum</code> if you are using centos:</p> <ul> <li>download and install the public signing key:</li> </ul> -<pre><code>rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch +<div class="highlighter-rouge"><pre class="highlight"><code>rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch </code></pre> +</div> <ul> - <li>Add the following lines in <code>/etc/yum.repos.d/</code> directory in a file with a <code>.repo</code> suffix, for example <code>logstash.repo</code>.</li> + <li>Add the following lines in <code class="highlighter-rouge">/etc/yum.repos.d/</code> directory in a file with a <code class="highlighter-rouge">.repo</code> suffix, for example <code class="highlighter-rouge">logstash.repo</code>.</li> </ul> -<pre><code>[logstash-2.3] +<div class="highlighter-rouge"><pre class="highlight"><code>[logstash-2.3] name=Logstash repository for 2.3.x packages baseurl=https://packages.elastic.co/logstash/2.3/centos gpgcheck=1 gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch enabled=1 </code></pre> +</div> <ul> - <li>Then install it using <code>yum</code>:</li> + <li>Then install it using <code class="highlighter-rouge">yum</code>:</li> </ul> -<pre><code>yum install logstash +<div class="highlighter-rouge"><pre class="highlight"><code>yum install logstash </code></pre> +</div> <h4 id="create-conf-file">Create conf file</h4> @@ -262,8 +269,9 @@ enabled=1 <h4 id="start-logstash">Start logstash</h4> -<pre><code>bin/logstash -f conf/first-pipeline.conf +<div class="highlighter-rouge"><pre class="highlight"><code>bin/logstash -f conf/first-pipeline.conf </code></pre> +</div> <h4 id="verification-1">Verification</h4> @@ -274,51 +282,55 @@ enabled=1 <h4 id="installation-1">Installation</h4> -<p>Download Apache Storm from <a href="http://storm.apache.org/downloads.html";>here</a>, the version you choose should be <code>0.10.x</code> or <code>0.9.x</code> release. +<p>Download Apache Storm from <a href="http://storm.apache.org/downloads.html";>here</a>, the version you choose should be <code class="highlighter-rouge">0.10.x</code> or <code class="highlighter-rouge">0.9.x</code> release. Then follow <a href="http://storm.apache.org/releases/0.10.0/Setting-up-a-Storm-cluster.html";>Apache Storm online doc</a>) to install Apache Storm on your cluster.</p> -<p>In <code>/etc/profile</code>, add this:</p> +<p>In <code class="highlighter-rouge">/etc/profile</code>, add this:</p> -<pre><code>export PATH=$PATH:/opt/apache-storm-0.10.1/bin/ +<div class="highlighter-rouge"><pre class="highlight"><code>export PATH=$PATH:/opt/apache-storm-0.10.1/bin/ </code></pre> +</div> <p>save the profile and then type:</p> -<pre><code>source /etc/profile +<div class="highlighter-rouge"><pre class="highlight"><code>source /etc/profile </code></pre> +</div> <p>to make it work.</p> <h4 id="configuration-1">Configuration</h4> -<p>In <code>storm/conf/storm.yaml</code>, change the hostname to your own host.</p> +<p>In <code class="highlighter-rouge">storm/conf/storm.yaml</code>, change the hostname to your own host.</p> <h4 id="start-apache-storm">Start Apache Storm</h4> <p>In Termial, type:</p> -<pre><code>$: storm nimbus +<div class="highlighter-rouge"><pre class="highlight"><code>$: storm nimbus $: storm supervisor $: storm UI </code></pre> +</div> <h4 id="verification-2">Verification</h4> -<p>Open storm UI in your browser, default URL is : <code>http://hostname:8080/index.html</code>.</p> +<p>Open storm UI in your browser, default URL is : <code class="highlighter-rouge">http://hostname:8080/index.html</code>.</p> <h3 id="apache-eagle">Apache Eagle</h3> <p>To download and install Apache Eagle, please refer to <a href="http://eagle.incubator.apache.org/docs/quick-start.html";>Get Started with Sandbox.</a> .</p> -<p>One thing need to mention is: in <code>â/bin/eagle-topology.shâ</code>, line 102:</p> +<p>One thing need to mention is: in <code class="highlighter-rouge">â/bin/eagle-topology.shâ</code>, line 102:</p> -<pre><code> storm_ui=http://localhost:8080 +<div class="highlighter-rouge"><pre class="highlight"><code> storm_ui=http://localhost:8080 </code></pre> +</div> <p>If you are not using the default port number, change this to your own Storm UI url.</p> <p>I know it takes time to finish these configuration, but now it is time to have fun! -Just try <code>HDFS Data Activity Monitoring</code> with <code>Demo</code> listed in <a href="http://eagle.incubator.apache.org/docs/hdfs-data-activity-monitoring.html";>HDFS Data Activity Monitoring.</a></p> +Just try <code class="highlighter-rouge">HDFS Data Activity Monitoring</code> with <code class="highlighter-rouge">Demo</code> listed in <a href="http://eagle.incubator.apache.org/docs/hdfs-data-activity-monitoring.html";>HDFS Data Activity Monitoring.</a></p> </div><!--end of loadcontent--> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/community.html ---------------------------------------------------------------------- diff --git a/_site/docs/community.html b/_site/docs/community.html index 9df21e5..f616802 100644 --- a/_site/docs/community.html +++ b/_site/docs/community.html @@ -183,13 +183,13 @@ <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:user@eagle.apache.org">user@eagle.apache.org</a></td> + <td><a href="mailto:u...@eagle.apache.org";>u...@eagle.apache.org</a></td> <td>Â </td> <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:user-subscribe@eagle.apache.org">subscribe</a></td> - <td><a href="mailto:user-unsubscribe@eagle.apache.org">unsubscribe</a></td> + <td><a href="mailto:user-subscr...@eagle.apache.org";>subscribe</a></td> + <td><a href="mailto:user-unsubscr...@eagle.apache.org";>unsubscribe</a></td> <td><a href="http://mail-archives.apache.org/mod_mbox/eagle-user/";>eagle-user</a></td> </tr> <tr> @@ -198,13 +198,13 @@ <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:dev@eagle.apache.org">dev@eagle.apache.org</a></td> + <td><a href="mailto:d...@eagle.apache.org";>d...@eagle.apache.org</a></td> <td>Â </td> <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:dev-subscribe@eagle.apache.org">subscribe</a></td> - <td><a href="mailto:dev-unsubscribe@eagle.apache.org">unsubscribe</a></td> + <td><a href="mailto:dev-subscr...@eagle.apache.org";>subscribe</a></td> + <td><a href="mailto:dev-unsubscr...@eagle.apache.org";>unsubscribe</a></td> <td><a href="http://mail-archives.apache.org/mod_mbox/eagle-dev/";>eagle-dev</a></td> </tr> <tr> @@ -213,13 +213,13 @@ <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:issues@eagle.apache.org">issues@eagle.apache.org</a></td> + <td><a href="mailto:iss...@eagle.apache.org";>iss...@eagle.apache.org</a></td> <td>Â </td> <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:issues-subscribe@eagle.apache.org">subscribe</a></td> - <td><a href="mailto:issues-unsubscribe@eagle.apache.org">unsubscribe</a></td> + <td><a href="mailto:issues-subscr...@eagle.apache.org";>subscribe</a></td> + <td><a href="mailto:issues-unsubscr...@eagle.apache.org";>unsubscribe</a></td> <td><a href="http://mail-archives.apache.org/mod_mbox/eagle-issues/";>eagle-issues</a></td> </tr> <tr> @@ -228,13 +228,13 @@ <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:commits@eagle.apache.org">commits@eagle.apache.org</a></td> + <td><a href="mailto:commits@eagle.apache.org";>commits@eagle.apache.org</a></td> <td>Â </td> <td>Â </td> <td>Â </td> <td>Â </td> - <td><a href="mailto:commits-subscribe@eagle.apache.org">subscribe</a></td> - <td><a href="mailto:commits-unsubscribe@eagle.apache.org">unsubscribe</a></td> + <td><a href="mailto:commits-subscr...@eagle.apache.org";>subscribe</a></td> + <td><a href="mailto:commits-unsubscr...@eagle.apache.org";>unsubscribe</a></td> <td><a href="http://mail-archives.apache.org/mod_mbox/eagle-commits/";>eagle-commits</a></td> </tr> </tbody> @@ -317,7 +317,7 @@ <li><strong>Wechat</strong>: Apache_Eagle</li> </ul> -<h3 id="events-and-meetupshadoop">Events and Meetups<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup></h3> +<h3 id="events-and-meetups">Events and Meetups<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup></h3> <p><strong>Conferences</strong></p> @@ -335,7 +335,7 @@ <div class="footnotes"> <ol> <li id="fn:HADOOP"> - <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/configuration.html ---------------------------------------------------------------------- diff --git a/_site/docs/configuration.html b/_site/docs/configuration.html index 83501ae..d664d26 100644 --- a/_site/docs/configuration.html +++ b/_site/docs/configuration.html @@ -156,7 +156,7 @@ </div> <div class="col-xs-6 col-sm-9 page-main-content" style="margin-left: -15px" id="loadcontent"> <h1 class="page-header" style="margin-top: 0px">Application Configuration</h1> - <p>Apache Eagle (called Eagle in the following) requires you to create a configuration file under <code>$EAGLE_HOME/conf/</code> for each application. Basically, there are some common properties shared, e.g., envContextConfig, eagleProps, and dynamicConfigSource. While dataSourceConfig differs from application to application.</p> + <p>Apache Eagle (called Eagle in the following) requires you to create a configuration file under <code class="highlighter-rouge">$EAGLE_HOME/conf/</code> for each application. Basically, there are some common properties shared, e.g., envContextConfig, eagleProps, and dynamicConfigSource. While dataSourceConfig differs from application to application.</p> <p>In this page we take the following two application as examples</p> @@ -610,22 +610,22 @@ <div class="footnotes"> <ol> <li id="fn:HIVE"> - <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> </li> <li id="fn:STORM"> - <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> + <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> </li> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:ZOOKEEPER"> - <p><em>All mentions of âzookeeperâ on this page represent Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p> + <p><em>All mentions of âzookeeperâ on this page represent Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p> </li> <li id="fn:HBASE"> - <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:TOMCAT"> - <p><em>Apache Tomcat.</em> <a href="#fnref:TOMCAT" class="reversefootnote">↩</a></p> + <p><em>Apache Tomcat.</em> <a href="#fnref:TOMCAT" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/deployment-env.html ---------------------------------------------------------------------- diff --git a/_site/docs/deployment-env.html b/_site/docs/deployment-env.html index 73cea54..8fc2f3d 100644 --- a/_site/docs/deployment-env.html +++ b/_site/docs/deployment-env.html @@ -158,7 +158,7 @@ <h1 class="page-header" style="margin-top: 0px">Deploy Environment</h1> <h3 id="setup-environment">Setup Environment</h3> -<p>Apache Eagle (called Eagle in the following) as an analytics solution for identifying security and performance issues instantly, relies on streaming platform <code>Storm</code><sup id="fnref:STORM"><a href="#fn:STORM" class="footnote">1</a></sup> + <code>Kafka</code><sup id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">2</a></sup> to meet the realtime criteria, and persistence storage to store metadata and some metrics. As for the persistence storage, it supports three types of database: <code>HBase</code><sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">3</a></sup>, <code>Derby</code><sup id="fnref:DERBY"><a href="#fn:DERBY" class="footnote">4</a></sup>, and <code>Mysql</code></p> +<p>Apache Eagle (called Eagle in the following) as an analytics solution for identifying security and performance issues instantly, relies on streaming platform <code class="highlighter-rouge">Storm</code><sup id="fnref:STORM"><a href="#fn:STORM" class="footnote">1</a></sup> + <code class="highlighter-rouge">Kafka</code><sup id="fnref:KAFKA"><a href="#fn:KAFKA" class="footnote">2</a></sup> to meet the realtime criteria, and persistence storage to store metadata and some metrics. As for the persistence storage, it supports three types of database: <code class="highlighter-rouge">HBase</code><sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">3</a></sup>, <code class="highlighter-rouge">Derby</code><sup id="fnref:DERBY"><a href="#fn:DERBY" class="footnote">4</a></sup>, and <code class="highlighter-rouge">Mysql</code></p> <p>To run monitoring applications, Eagle requires the following dependencies.</p> @@ -226,22 +226,22 @@ <div class="footnotes"> <ol> <li id="fn:STORM"> - <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> + <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> </li> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:HBASE"> - <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:DERBY"> - <p><em>All mentions of âderbyâ on this page represent Apache Derby.</em> <a href="#fnref:DERBY" class="reversefootnote">↩</a></p> + <p><em>All mentions of âderbyâ on this page represent Apache Derby.</em> <a href="#fnref:DERBY" class="reversefootnote">↩</a></p> </li> <li id="fn:HADOOP"> - <p><em>Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> + <p><em>Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> </li> <li id="fn:AMBARI"> - <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> + <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/deployment-in-docker.html ---------------------------------------------------------------------- diff --git a/_site/docs/deployment-in-docker.html b/_site/docs/deployment-in-docker.html index 8b8b009..f9c3cee 100644 --- a/_site/docs/deployment-in-docker.html +++ b/_site/docs/deployment-in-docker.html @@ -166,13 +166,14 @@ <li> <p>Pull latest eagle docker image from <a href="https://hub.docker.com/r/apacheeagle/sandbox/";>docker hub</a> directly:</p> - <pre><code>docker pull apacheeagle/sandbox + <div class="highlighter-rouge"><pre class="highlight"><code>docker pull apacheeagle/sandbox </code></pre> + </div> </li> <li> <p>Then run eagle docker image:</p> - <pre><code>docker run -p 9099:9099 -p 8080:8080 -p 8744:8744 -p 2181:2181 -p 2888:2888 \ + <div class="highlighter-rouge"><pre class="highlight"><code>docker run -p 9099:9099 -p 8080:8080 -p 8744:8744 -p 2181:2181 -p 2888:2888 \ -p 6667:6667 -p 60020:60020 -p 60030:60030 -p 60010:60010 -d --dns 127.0.0.1 \ --entrypoint /usr/local/serf/bin/start-serf-agent.sh -e KEYCHAIN= \ --env EAGLE_SERVER_HOST=sandbox.eagle.apache.org --name sandbox \ @@ -182,6 +183,7 @@ docker run -it --rm -e EXPECTED_HOST_COUNT=1 -e BLUEPRINT=hdp-singlenode-eagle \ --link sandbox:ambariserver --entrypoint /bin/sh apacheeagle/sandbox:latest \ -c /tmp/install-cluster.sh </code></pre> + </div> </li> </ul> </li> @@ -192,14 +194,16 @@ docker run -it --rm -e EXPECTED_HOST_COUNT=1 -e BLUEPRINT=hdp-singlenode-eagle \ <li> <p>Get latest source code of eagle.</p> - <pre><code>git clone https://github.com/apache/eagle.git + <div class="highlighter-rouge"><pre class="highlight"><code>git clone https://github.com/apache/eagle.git </code></pre> + </div> </li> <li> <p>Then run eagle docker command.</p> - <pre><code>cd eagle && ./eagle-docker boot + <div class="highlighter-rouge"><pre class="highlight"><code>cd eagle && ./eagle-docker boot </code></pre> + </div> </li> </ul> </li> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/deployment-in-production.html ---------------------------------------------------------------------- diff --git a/_site/docs/deployment-in-production.html b/_site/docs/deployment-in-production.html index 49f6c78..cc3af9a 100644 --- a/_site/docs/deployment-in-production.html +++ b/_site/docs/deployment-in-production.html @@ -184,9 +184,9 @@ <ul> <li> - <p>Edit <code>bin/eagle-env.sh</code></p> + <p>Edit <code class="highlighter-rouge">bin/eagle-env.sh</code></p> - <pre><code> # TODO: make sure java version is 1.7.x + <div class="highlighter-rouge"><pre class="highlight"><code> # TODO: make sure java version is 1.7.x export JAVA_HOME= # TODO: Apache Storm nimbus host. Default is localhost @@ -195,11 +195,12 @@ # TODO: EAGLE_SERVICE_HOST, default is `hostname -f` export EAGLE_SERVICE_HOST=localhost </code></pre> + </div> </li> <li> - <p>Edit <code>conf/eagle-service.conf</code> to configure the database to use (for example: HBase<sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">1</a></sup>)</p> + <p>Edit <code class="highlighter-rouge">conf/eagle-service.conf</code> to configure the database to use (for example: HBase<sup id="fnref:HBASE"><a href="#fn:HBASE" class="footnote">1</a></sup>)</p> - <pre><code> # TODO: hbase.zookeeper.quorum in the format host1,host2,host3,... + <div class="highlighter-rouge"><pre class="highlight"><code> # TODO: hbase.zookeeper.quorum in the format host1,host2,host3,... # default is "localhost" hbase-zookeeper-quorum="localhost" @@ -211,13 +212,14 @@ # default is "/hbase" zookeeper-znode-parent="/hbase" </code></pre> + </div> </li> </ul> </li> <li> <p>Step 2: Install metadata for policies</p> - <pre><code> $ cd <eagle-home> + <div class="highlighter-rouge"><pre class="highlight"><code> $ cd <eagle-home> # start Eagle web service $ bin/eagle-service.sh start @@ -225,6 +227,7 @@ # import metadata after Eagle service is successfully started $ bin/eagle-topology-init.sh </code></pre> + </div> </li> </ul> @@ -260,8 +263,9 @@ <li> <p>Stop eagle service</p> - <pre><code>$ bin/eagle-service.sh stop + <div class="highlighter-rouge"><pre class="highlight"><code>$ bin/eagle-service.sh stop </code></pre> + </div> </li> </ul> @@ -272,13 +276,13 @@ <div class="footnotes"> <ol> <li id="fn:HBASE"> - <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:HADOOP"> - <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> </li> <li id="fn:HIVE"> - <p><em>Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> + <p><em>Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/deployment-in-sandbox.html ---------------------------------------------------------------------- diff --git a/_site/docs/deployment-in-sandbox.html b/_site/docs/deployment-in-sandbox.html index 239ed7d..c6868b0 100644 --- a/_site/docs/deployment-in-sandbox.html +++ b/_site/docs/deployment-in-sandbox.html @@ -201,21 +201,23 @@ <p><strong>Option 1</strong>: Download eagle jar from <a href="http://66.211.190.194/eagle-0.1.0.tar.gz";>here</a>.</p> </li> <li> - <p><strong>Option 2</strong>: Build form source code <a href="https://github.com/apache/eagle";>eagle github</a>. After successful build, âeagle-xxx-bin.tar.gzâ will be generated under <code>./eagle-assembly/target</code></p> + <p><strong>Option 2</strong>: Build form source code <a href="https://github.com/apache/eagle";>eagle github</a>. After successful build, âeagle-xxx-bin.tar.gzâ will be generated under <code class="highlighter-rouge">./eagle-assembly/target</code></p> - <pre><code># installed npm is required before compiling + <div class="highlighter-rouge"><pre class="highlight"><code># installed npm is required before compiling $ mvn clean install -DskipTests=true </code></pre> + </div> </li> </ul> </li> <li> <p><strong>Copy and extract the package to sandbox</strong></p> - <pre><code>#extract + <div class="highlighter-rouge"><pre class="highlight"><code>#extract $ tar -zxvf eagle-0.1.0-bin.tar.gz $ mv eagle-0.1.0 /usr/hdp/current/eagle </code></pre> + </div> </li> </ul> @@ -229,9 +231,10 @@ $ mv eagle-0.1.0 /usr/hdp/current/eagle <li> <p><strong>Option 1</strong>: Install Eagle using command line</p> - <pre><code>$ cd /usr/hdp/current/eagle + <div class="highlighter-rouge"><pre class="highlight"><code>$ cd /usr/hdp/current/eagle $ examples/eagle-sandbox-starter.sh </code></pre> + </div> </li> <li> <p><strong>Option 2</strong>: Install Eagle using <a href="/docs/ambari-plugin-install.html">Eagle Ambari plugin</a></p> @@ -246,7 +249,7 @@ $ examples/eagle-sandbox-starter.sh <li> <p><strong>Step 1</strong>: Configure Advanced hadoop-log4j via <a href="http://localhost:8080/#/main/services/HDFS/configs"; target="_blank">Ambari UI</a>, and add below âKAFKA_HDFS_AUDITâ log4j appender to hdfs audit logging.</p> - <pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender + <div class="highlighter-rouge"><pre class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667 log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer @@ -256,22 +259,25 @@ log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async #log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1 #log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1 </code></pre> + </div> <p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p> </li> <li> <p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs"; target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p> - <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT + <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT </code></pre> + </div> <p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p> </li> <li> <p><strong>Step 4</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs"; target="_blank">Ambari UI</a>, and append the following command to it.</p> - <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/* + <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/* </code></pre> + </div> <p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p> </li> @@ -279,14 +285,15 @@ log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async <p><strong>Step 5</strong>: save the changes and restart the namenode.</p> </li> <li> - <p><strong>Step 6</strong>: Check whether logs are flowing into topic <code>sandbox_hdfs_audit_log</code></p> + <p><strong>Step 6</strong>: Check whether logs are flowing into topic <code class="highlighter-rouge">sandbox_hdfs_audit_log</code></p> - <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log + <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log </code></pre> + </div> </li> </ul> -<p>Now please login to Eagle web http://localhost:9099/eagle-service with account <code>admin/secret</code>, and try the sample demos on +<p>Now please login to Eagle web http://localhost:9099/eagle-service with account <code class="highlighter-rouge">admin/secret</code>, and try the sample demos on <a href="/docs/quick-start.html">Quick Starer</a></p> <p>(If the NAT network is used in a virtual machine, itâs required to add port 9099 to forwarding ports) @@ -300,19 +307,19 @@ log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async <div class="footnotes"> <ol> <li id="fn:HADOOP"> - <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> </li> <li id="fn:AMBARI"> - <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> + <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> </li> <li id="fn:HBASE"> - <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:STORM"> - <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> + <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> </li> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/development-in-intellij.html ---------------------------------------------------------------------- diff --git a/_site/docs/development-in-intellij.html b/_site/docs/development-in-intellij.html index e6c8536..2c67818 100644 --- a/_site/docs/development-in-intellij.html +++ b/_site/docs/development-in-intellij.html @@ -158,7 +158,7 @@ <h1 class="page-header" style="margin-top: 0px">Development in Intellij</h1> <p>Apache Eagle (called Eagle in the following) can be developed in popular IDE, e.g. Intellij and Eclipse. Here we focus on development in Intellij.</p> -<h3 id="prepare-hadoophadoop-environment">1. Prepare Hadoop<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup> environment</h3> +<h3 id="1-prepare-hadoop-environment">1. Prepare Hadoop<sup id="fnref:HADOOP"><a href="#fn:HADOOP" class="footnote">1</a></sup> environment</h3> <p>Normally HDP sandbox is needed for testing Hadoop monitoring. Please reference <a href="/docs/quick-start.html">Quick Start</a> for setting up HDP sandbox.</p> @@ -185,7 +185,7 @@ </li> </ul> -<h3 id="start-eagle-web-service-in-intellij">2. Start Eagle web service in Intellij</h3> +<h3 id="2-start-eagle-web-service-in-intellij">2. Start Eagle web service in Intellij</h3> <p>Import source code into Intellij, and find eagle-webservice project. Intellij Ultimate supports launching J2EE server within Intellij. If you donât have Intellij Ultimate version, Eclipse is another option.</p> @@ -208,7 +208,7 @@ Intellij Ultimate version, Eclipse is another option.</p> <p>Configure Intellij for running Apache Tomcat server with eagle-service artifacts</p> -<h3 id="start-topology-in-intellij">3. Start topology in Intellij</h3> +<h3 id="3-start-topology-in-intellij">3. Start topology in Intellij</h3> <ul> <li><strong>Check topology configuration</strong></li> @@ -237,19 +237,19 @@ Intellij Ultimate version, Eclipse is another option.</p> <div class="footnotes"> <ol> <li id="fn:HADOOP"> - <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> </li> <li id="fn:HBASE"> - <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:ZOOKEEPER"> - <p><em>Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p> + <p><em>Apache ZooKeeper.</em> <a href="#fnref:ZOOKEEPER" class="reversefootnote">↩</a></p> </li> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:STORM"> - <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> + <p><em>All mentions of âstormâ on this page represent Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/development-in-macosx.html ---------------------------------------------------------------------- diff --git a/_site/docs/development-in-macosx.html b/_site/docs/development-in-macosx.html index 671be47..21f6e1d 100644 --- a/_site/docs/development-in-macosx.html +++ b/_site/docs/development-in-macosx.html @@ -159,7 +159,7 @@ <h2 id="how-to-setup-apache-eagle-development-environment-on-mac-osx">How to Setup Apache Eagle Development Environment on Mac OSX</h2> <p><em>Apache Eagle will be called Eagle in the following.</em><br /> -This tutorial is based <code>Mac OS X</code>. It can be used as a reference guide for other OS like Linux or Windows as well. To save your time of jumping back and forth between different web pages, all necessary references will be pointed out.</p> +This tutorial is based <code class="highlighter-rouge">Mac OS X</code>. It can be used as a reference guide for other OS like Linux or Windows as well. To save your time of jumping back and forth between different web pages, all necessary references will be pointed out.</p> <h3 id="prerequisite">Prerequisite</h3> @@ -169,8 +169,9 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <p>Make sure you have HomeBrew installed on your mac. If not, please run:</p> -<pre><code>$ ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" +<div class="highlighter-rouge"><pre class="highlight"><code>$ ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" </code></pre> +</div> <p>you can find more information about HomeBrew at http://brew.sh/ .</p> @@ -180,9 +181,10 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <p>Some core eagle modules are written with scala. To install Scala and SBT, just run:</p> -<pre><code> $ brew install scala +<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install scala $ brew install sbt </code></pre> +</div> <ul> <li><strong>NPM</strong></li> @@ -190,8 +192,9 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <p>Eagle-webservice module uses npm. To install it, run:</p> -<pre><code> $ brew install npm +<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install npm </code></pre> +</div> <ul> <li><strong>Apache Maven</strong></li> @@ -199,8 +202,9 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <p>Eagle is built with maven:</p> -<pre><code> $ brew install maven +<div class="highlighter-rouge"><pre class="highlight"><code> $ brew install maven </code></pre> +</div> <ul> <li> @@ -210,8 +214,9 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <li> <p>Install HomeBrew Cask:</p> - <pre><code>$ brew install caskroom/cask/brew-cask + <div class="highlighter-rouge"><pre class="highlight"><code>$ brew install caskroom/cask/brew-cask </code></pre> + </div> </li> <li> <p>Next, install JDK via HomeBrew:</p> @@ -224,15 +229,18 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <p>you will see all available JDK versions and you can install multiple JDK versions in this way. For eagle please choose java7 to install:</p> -<pre><code> $ brew cask install java7 +<div class="highlighter-rouge"><pre class="highlight"><code> $ brew cask install java7 </code></pre> +</div> -<p><strong>Note:</strong> -- During this writing SBT has issue with JDK 8. This issue has been tested confirmed by using: -- Java 1.8.0_66 -- Maven 3.3.9 -- Scala 2.11.7 -- Sbt 0.13.9</p> +<p><strong>Note:</strong></p> +<ul> + <li>During this writing SBT has issue with JDK 8. This issue has been tested confirmed by using:</li> + <li>Java 1.8.0_66</li> + <li>Maven 3.3.9</li> + <li>Scala 2.11.7</li> + <li>Sbt 0.13.9</li> +</ul> <p>you can find more information about HomeBrew Cask at <a href="http://caskroom.io";>http://caskroom.io</a></p> @@ -242,44 +250,53 @@ This tutorial is based <code>Mac OS X</code>. It can be used as a reference guid <p>you can use Jenv to manage installed multiple Java versions. To install it:</p> -<pre><code>$ brew install https://raw.githubusercontent.com/entrypass/jenv/homebrew/homebrew/jenv.rb +<div class="highlighter-rouge"><pre class="highlight"><code>$ brew install https://raw.githubusercontent.com/entrypass/jenv/homebrew/homebrew/jenv.rb </code></pre> +</div> <p>and make sure activate it automatically:</p> -<pre><code>$ echo 'eval "$(jenv init -)"' >> ~/.bash_profile +<div class="highlighter-rouge"><pre class="highlight"><code>$ echo 'eval "$(jenv init -)"' >> ~/.bash_profile </code></pre> +</div> -<p><strong>Note:</strong> -- There is a known issue at this writing: https://github.com/gcuisinier/jenv/wiki/Trouble-Shooting -- Please make sure JENV_ROOT has been set before jenv init: -- $ export JENV_ROOT=/usr/local/opt/jenv</p> +<p><strong>Note:</strong></p> +<ul> + <li>There is a known issue at this writing: https://github.com/gcuisinier/jenv/wiki/Trouble-Shooting</li> + <li>Please make sure JENV_ROOT has been set before jenv init:</li> + <li>$ export JENV_ROOT=/usr/local/opt/jenv</li> +</ul> <p>Now let Jenv manage JDK versions (remember In OSX all JVMs are located at /Library/Java/JavaVirtualMachines):</p> -<pre><code>$ jenv add /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/ +<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv add /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/ $ jenv add /Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/ </code></pre> +</div> <p>and</p> -<pre><code>$ jenv rehash +<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv rehash </code></pre> +</div> <p>You can see all managed JDK versions:</p> -<pre><code>$ jenv versions +<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv versions </code></pre> +</div> <p>set global java version:</p> -<pre><code>$ jenv global oracle64-1.8.0.66 +<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv global oracle64-1.8.0.66 </code></pre> +</div> <p>switch to your eagle home directory and set the local JDK version for eagle:</p> -<pre><code>$ jenv local oracle64-1.7.0.80 +<div class="highlighter-rouge"><pre class="highlight"><code>$ jenv local oracle64-1.7.0.80 </code></pre> +</div> <p>you can find more information about Jenv at https://github.com/rbenv/rbenv and http://hanxue-it.blogspot.com/2014/05/installing-java-8-managing-multiple.html.</p> @@ -287,8 +304,9 @@ $ jenv add /Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/ <p>Go to Eagle home directory and run:</p> -<pre><code>mvn -DskipTests clean package +<div class="highlighter-rouge"><pre class="highlight"><code>mvn -DskipTests clean package </code></pre> +</div> <p>Thatâs all. Now you have runnable eagle on your Mac. Have fun. :-)</p> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/download-latest.html ---------------------------------------------------------------------- diff --git a/_site/docs/download-latest.html b/_site/docs/download-latest.html index 32afb60..639b18f 100644 --- a/_site/docs/download-latest.html +++ b/_site/docs/download-latest.html @@ -157,58 +157,29 @@ <div class="col-xs-6 col-sm-9 page-main-content" style="margin-left: -15px" id="loadcontent"> <h1 class="page-header" style="margin-top: 0px">Apache Eagle Latest Download</h1> <blockquote> - <p>Version <code>0.4.0-incubating</code> is the latest release and <code>0.5.0-SNAPSHOT</code> is under active development on <a href="https://github.com/apache/eagle/tree/master";>master</a> branch.</p> + <p>Version <strong>0.5.0</strong> is the latest release and 0.5.0-SNAPSHOT is under active development on <a href="https://github.com/apache/eagle/tree/master";>master</a> branch.</p> <p>You can verify your download by following these <a href="https://www.apache.org/info/verification.html";>procedures</a> and using these <a href="https://dist.apache.org/repos/dist/release/eagle/KEYS";>KEYS</a>.</p> </blockquote> -<h1 id="snapshot">0.5.0-SNAPSHOT</h1> - -<blockquote> - <p>The first GA version <code>v0.5.0</code> with fantastic improvements and features is coming soon!</p> -</blockquote> - -<ul> - <li> - <p>Build from source code:</p> - - <pre><code> git clone https://github.com/apache/eagle.git -</code></pre> - </li> - <li>Release notes for preview: - <ul> - <li><a href="https://cwiki.apache.org/confluence/display/EAG/Eagle+Version+0.5.0";>Eagle 0.5.0 Release Notes</a></li> - </ul> - </li> - <li>Documentation: - <ul> - <li><a href="/docs/latest/">Eagle 0.5.0 Documentations</a></li> - </ul> - </li> -</ul> - -<h1 id="incubating">0.4.0-incubating</h1> - -<p><a href="http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.eagle%22%20AND%20a%3A%22eagle-parent%22";><img src="https://maven-badges.herokuapp.com/maven-central/org.apache.eagle/eagle-parent/badge.svg"; alt="Eagle Latest Maven Release" /></a></p> - +<h1 id="050">0.5.0</h1> <ul> <li>Release notes: <ul> - <li><a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.4.0-incubating";>Eagle 0.4.0 Release Notes</a></li> + <li><a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.5.0";>Eagle 0.5.0 Release Notes</a></li> </ul> </li> <li>Source download: <ul> - <li><a href="http://www.apache.org/dyn/closer.cgi?path=/eagle/apache-eagle-0.4.0-incubating";>apache-eagle-0.4.0-incubating-src.tar.gz</a></li> - <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.md5";>apache-eagle-0.4.0-incubating-src.tar.gz.md5</a></li> - <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.sha1";>apache-eagle-0.4.0-incubating-src.tar.gz.sha1</a></li> - <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.4.0-incubating/apache-eagle-0.4.0-incubating-src.tar.gz.asc";>apache-eagle-0.4.0-incubating-src.tar.gz.asc</a></li> + <li><a href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.5.0-incubating";>apache-eagle-0.5.0-src.tar.gz</a></li> + <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.md5";>apache-eagle-0.5.0-src.tar.gz.md5</a></li> + <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.sha1";>apache-eagle-0.5.0-src.tar.gz.sha1</a></li> + <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.asc";>apache-eagle-0.5.0-src.tar.gz.asc</a></li> </ul> </li> <li>Git revision: <ul> - <li>tag: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.4.0-incubating";>v0.4.0-incubating</a></li> - <li>commit: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=eac0f27958f2ed8c6842938dad0a995a87fd0715";>eac0f27958f2ed8c6842938dad0a995a87fd0715</a></li> + <li>tag: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.5.0";>v0.5.0</a></li> </ul> </li> </ul> @@ -216,6 +187,7 @@ <h1 id="previous-releases">Previous Releases</h1> <ul> + <li><a href="/docs/download.html#0.4.0-incubating">Eagle 0.4.0-incubating</a></li> <li><a href="/docs/download.html#0.3.0-incubating">Eagle 0.3.0-incubating</a></li> </ul> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/download.html ---------------------------------------------------------------------- diff --git a/_site/docs/download.html b/_site/docs/download.html index bc50dad..fdfa701 100644 --- a/_site/docs/download.html +++ b/_site/docs/download.html @@ -160,7 +160,30 @@ <p>You can verify your download by following these <a href="https://www.apache.org/info/verification.html";>procedures</a> and using these <a href="https://dist.apache.org/repos/dist/release/eagle/KEYS";>KEYS</a>.</p> </blockquote> -<h1 id="incubating">0.4.0-incubating</h1> +<h1 id="050">0.5.0</h1> +<ul> + <li>Release notes: + <ul> + <li><a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=blob_plain;f=CHANGELOG.txt;hb=refs/tags/v0.5.0";>Eagle 0.5.0 Release Notes</a></li> + </ul> + </li> + <li>Source download: + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi?path=/incubator/eagle/apache-eagle-0.5.0-incubating";>apache-eagle-0.5.0-src.tar.gz</a></li> + <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.md5";>apache-eagle-0.5.0-src.tar.gz.md5</a></li> + <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.sha1";>apache-eagle-0.5.0-src.tar.gz.sha1</a></li> + <li><a href="https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/apache-eagle-0.5.0-src.tar.gz.asc";>apache-eagle-0.5.0-src.tar.gz.asc</a></li> + </ul> + </li> + <li>Git revision: + <ul> + <li>tag: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=refs/tags/v0.5.0";>v0.5.0</a></li> + <li>commit: <a href="https://git-wip-us.apache.org/repos/asf?p=eagle.git;a=commit;h=c930a7ab4a4fb78a1cbacd8f8419de3b5dbf1bd7";>c930a7ab4a4fb78a1cbacd8f8419de3b5dbf1bd7</a></li> + </ul> + </li> +</ul> + +<h1 id="040-incubating">0.4.0-incubating</h1> <ul> <li>Release notes: <ul> @@ -183,7 +206,7 @@ </li> </ul> -<h1 id="incubating-1">0.3.0-incubating</h1> +<h1 id="030-incubating">0.3.0-incubating</h1> <ul> <li>Release notes: http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/hbase-auth-activity-monitoring.html ---------------------------------------------------------------------- diff --git a/_site/docs/hbase-auth-activity-monitoring.html b/_site/docs/hbase-auth-activity-monitoring.html index af4c45c..bda9f52 100644 --- a/_site/docs/hbase-auth-activity-monitoring.html +++ b/_site/docs/hbase-auth-activity-monitoring.html @@ -160,11 +160,11 @@ <p>Please follow below steps to enable HBase authorization auditing in HDP sandbox and Cloudera</p> -<h4 id="in-hbase-sitexml">1. in hbase-site.xml</h4> +<h4 id="1-in-hbase-sitexml">1. in hbase-site.xml</h4> <p>Note: when testing in HDP sandbox, sometimes Apache Ranger will take over access controll for HBase, so maybe you need change that back to native hbase access controller, i.e. change com.xasecure.authorization.hbase.XaSecureAuthorizationCoprocessor to org.apache.hadoop.hbase.security.access.AccessController</p> -<pre><code><property> +<div class="highlighter-rouge"><pre class="highlight"><code><property> <name>hbase.security.authorization</name> <value>true</value> </property> @@ -177,10 +177,11 @@ <value>org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController</value> </property> </code></pre> +</div> -<h4 id="log4jproperties">2. log4j.properties</h4> +<h4 id="2-log4jproperties">2. log4j.properties</h4> -<pre><code># +<div class="highlighter-rouge"><pre class="highlight"><code># # Security audit appender # hbase.security.log.file=SecurityAuth.audit @@ -196,6 +197,7 @@ log4j.category.SecurityLogger=${hbase.security.logger} log4j.additivity.SecurityLogger=false log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE </code></pre> +</div> <hr /> @@ -204,7 +206,7 @@ log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessContro <div class="footnotes"> <ol> <li id="fn:HBASE"> - <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/hbase-data-activity-monitoring.html ---------------------------------------------------------------------- diff --git a/_site/docs/hbase-data-activity-monitoring.html b/_site/docs/hbase-data-activity-monitoring.html index 119a7bd..63a4e77 100644 --- a/_site/docs/hbase-data-activity-monitoring.html +++ b/_site/docs/hbase-data-activity-monitoring.html @@ -174,15 +174,16 @@ <ol> <li> - <p>edit Advanced hbase-log4j via Ambari<sup id="fnref:AMBARI"><a href="#fn:AMBARI" class="footnote">3</a></sup> UI, and append below sentence to <code>Security audit appender</code></p> + <p>edit Advanced hbase-log4j via Ambari<sup id="fnref:AMBARI"><a href="#fn:AMBARI" class="footnote">3</a></sup> UI, and append below sentence to <code class="highlighter-rouge">Security audit appender</code></p> - <pre><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS + <div class="highlighter-rouge"><pre class="highlight"><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS </code></pre> + </div> </li> <li> <p>edit Advanced hbase-site.xml</p> - <pre><code> <property> + <div class="highlighter-rouge"><pre class="highlight"><code> <property> <name>hbase.security.authorization</name> <value>true</value> </property> @@ -197,6 +198,7 @@ <value>org.apache.hadoop.hbase.security.access.AccessController</value> </property> </code></pre> + </div> </li> <li> <p>Save and restart HBase</p> @@ -208,21 +210,22 @@ <h3 id="how-to-add-a-kafka-log4j-appender">How to add a Kafka log4j appender</h3> <blockquote> - <p>Notice: if you are willing to use sample logs under <code>eagle-security-hbase-security/test/resources/securityAuditLog</code>, please skip this part.</p> + <p>Notice: if you are willing to use sample logs under <code class="highlighter-rouge">eagle-security-hbase-security/test/resources/securityAuditLog</code>, please skip this part.</p> </blockquote> <ol> <li> - <p>create Kafka topic <code>sandbox_hbase_security_log</code></p> + <p>create Kafka topic <code class="highlighter-rouge">sandbox_hbase_security_log</code></p> - <pre><code> $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hbase_security_log + <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hbase_security_log </code></pre> + </div> </li> <li> - <p>add below âKAFKA_HBASE_AUDITâ log4j appender to <code>Security audit appender</code> + <p>add below âKAFKA_HBASE_AUDITâ log4j appender to <code class="highlighter-rouge">Security audit appender</code> Please refer to http://goeagle.io/docs/import-hdfs-auditLog.html.</p> - <pre><code> log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender + <div class="highlighter-rouge"><pre class="highlight"><code> log4j.appender.KAFKA_HBASE_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender log4j.appender.KAFKA_HBASE_AUDIT.Topic=sandbox_hbase_security_log log4j.appender.KAFKA_HBASE_AUDIT.BrokerList=sandbox.hortonworks.com:6667 log4j.appender.KAFKA_HBASE_AUDIT.Layout=org.apache.log4j.PatternLayout @@ -231,18 +234,21 @@ Please refer to http://goeagle.io/docs/import-hdfs-auditLog.html.</p> log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.GenericLogKeyer log4j.appender.KAFKA_HDFS_AUDIT.KeyPattern=user=(\\w+),\\s+ </code></pre> + </div> </li> <li> <p>add the reference to KAFKA_HBASE_AUDIT to log4j appender</p> - <pre><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS,KAFKA_HBASE_AUDIT + <div class="highlighter-rouge"><pre class="highlight"><code> log4j.logger.SecurityLogger.org.apache.hadoop.hbase.security.access.AccessController=TRACE,RFAS,KAFKA_HBASE_AUDIT </code></pre> + </div> </li> <li> <p>add Eagle log4j appender jars into HBASE_CLASSPATH BY editing Advanced hbase-env via Ambari UI</p> - <pre><code> export HBASE_CLASSPATH=${HBASE_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/* + <div class="highlighter-rouge"><pre class="highlight"><code> export HBASE_CLASSPATH=${HBASE_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/* </code></pre> + </div> </li> <li> <p>Save and restart HBase</p> @@ -253,32 +259,36 @@ Please refer to http://goeagle.io/docs/import-hdfs-auditLog.html.</p> <ol> <li> - <p>create tables (<code>skip if you do not use hbase</code>)</p> + <p>create tables (<code class="highlighter-rouge">skip if you do not use hbase</code>)</p> - <pre><code> bin/eagle-service-init.sh + <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-service-init.sh </code></pre> + </div> </li> <li> <p>start Eagle service</p> - <pre><code> bin/eagle-service.sh start + <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-service.sh start </code></pre> + </div> </li> <li> <p>import metadata</p> - <pre><code> bin/eagle-topology-init.sh + <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-topology-init.sh </code></pre> + </div> </li> <li> <p>submit topology</p> - <pre><code> bin/eagle-topology.sh --main org.apache.eagle.security.hbase.HbaseAuditLogProcessorMain --config conf/sandbox-hbaseSecurityLog-application.conf start + <div class="highlighter-rouge"><pre class="highlight"><code> bin/eagle-topology.sh --main org.apache.eagle.security.hbase.HbaseAuditLogProcessorMain --config conf/sandbox-hbaseSecurityLog-application.conf start </code></pre> + </div> </li> </ol> -<p>(sample sensitivity data at <code>examples/sample-sensitivity-resource-create.sh</code>)</p> +<p>(sample sensitivity data at <code class="highlighter-rouge">examples/sample-sensitivity-resource-create.sh</code>)</p> <h3 id="q--a">Q & A</h3> @@ -293,13 +303,13 @@ Please refer to http://goeagle.io/docs/import-hdfs-auditLog.html.</p> <div class="footnotes"> <ol> <li id="fn:HBASE"> - <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhbaseâ on this page represent Apache HBase.</em> <a href="#fnref:HBASE" class="reversefootnote">↩</a></p> </li> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:AMBARI"> - <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> + <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/hdfs-auth-activity-monitoring.html ---------------------------------------------------------------------- diff --git a/_site/docs/hdfs-auth-activity-monitoring.html b/_site/docs/hdfs-auth-activity-monitoring.html index bf7500f..d8b77c5 100644 --- a/_site/docs/hdfs-auth-activity-monitoring.html +++ b/_site/docs/hdfs-auth-activity-monitoring.html @@ -160,23 +160,25 @@ <h4 id="sample-authorization-logs">Sample authorization logs</h4> -<pre><code>2016-06-08 02:55:07,742 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hdfs (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.protocol.ClientProtocol +<div class="highlighter-rouge"><pre class="highlight"><code>2016-06-08 02:55:07,742 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hdfs (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.protocol.ClientProtocol 2016-06-08 02:55:35,304 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hdfs (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.server.protocol.NamenodeProtocol 2016-06-08 02:55:36,862 INFO SecurityLogger.org.apache.hadoop.security.authorize.ServiceAuthorizationManager: Authorization successful for hive (auth:SIMPLE) for protocol=interface org.apache.hadoop.hdfs.protocol.ClientProtocol </code></pre> +</div> <p>Steps for enabling service-level authorization activity</p> -<h4 id="enable-hdfs-authorization-security-in-core-sitexml">1. Enable HDFS Authorization Security in core-site.xml</h4> +<h4 id="1-enable-hdfs-authorization-security-in-core-sitexml">1. Enable HDFS Authorization Security in core-site.xml</h4> -<pre><code> <property> +<div class="highlighter-rouge"><pre class="highlight"><code> <property> <name>hadoop.security.authorization</name> <value>true</value> </property> </code></pre> +</div> -<h4 id="enable-hdfs-security-log-in-log4jproperties">2. Enable HDFS security log in log4j.properties</h4> -<pre><code># +<h4 id="2-enable-hdfs-security-log-in-log4jproperties">2. Enable HDFS security log in log4j.properties</h4> +<div class="highlighter-rouge"><pre class="highlight"><code># #Security audit appender # hadoop.security.logger=INFO,DRFAS @@ -190,6 +192,7 @@ log4j.appender.DRFAS.layout=org.apache.log4j.PatternLayout log4j.appender.DRFAS.layout.ConversionPattern=%d{ISO8601} %p %c: %m%n log4j.appender.DRFAS.DatePattern=.yyyy-MM-dd </code></pre> +</div> </div><!--end of loadcontent--> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/hdfs-data-activity-monitoring.html ---------------------------------------------------------------------- diff --git a/_site/docs/hdfs-data-activity-monitoring.html b/_site/docs/hdfs-data-activity-monitoring.html index b0a694e..eeefe05 100644 --- a/_site/docs/hdfs-data-activity-monitoring.html +++ b/_site/docs/hdfs-data-activity-monitoring.html @@ -181,7 +181,7 @@ <li> <p><strong>Step 1</strong>: Configure Advanced hdfs-log4j via <a href="http://localhost:8080/#/main/services/HDFS/configs"; target="_blank">Ambari UI</a><sup id="fnref:AMBARI"><a href="#fn:AMBARI" class="footnote">2</a></sup>, by adding below âKAFKA_HDFS_AUDITâ log4j appender to hdfs audit logging.</p> - <pre><code> log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender + <div class="highlighter-rouge"><pre class="highlight"><code> log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667 log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer @@ -189,22 +189,25 @@ log4j.appender.KAFKA_HDFS_AUDIT.Layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async </code></pre> + </div> <p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p> </li> <li> <p><strong>Step 2</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs"; target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p> - <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT + <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT </code></pre> + </div> <p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p> </li> <li> <p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs"; target="_blank">Ambari UI</a>, and append the following command to it.</p> - <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/* + <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/* </code></pre> + </div> <p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p> </li> @@ -223,10 +226,11 @@ <ul> <li> - <p><strong>Step 7</strong>: Check whether logs from â/var/log/hadoop/hdfs/hdfs-audit.logâ are flowing into topic <code>sandbox_hdfs_audit_log</code></p> + <p><strong>Step 7</strong>: Check whether logs from â/var/log/hadoop/hdfs/hdfs-audit.logâ are flowing into topic <code class="highlighter-rouge">sandbox_hdfs_audit_log</code></p> - <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log + <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log </code></pre> + </div> </li> </ul> @@ -260,13 +264,13 @@ <div class="footnotes"> <ol> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:AMBARI"> - <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> + <p><em>All mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> </li> <li id="fn:STORM"> - <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> + <p><em>Apache Storm.</em> <a href="#fnref:STORM" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/hive-query-activity-monitoring.html ---------------------------------------------------------------------- diff --git a/_site/docs/hive-query-activity-monitoring.html b/_site/docs/hive-query-activity-monitoring.html index d128562..cc19300 100644 --- a/_site/docs/hive-query-activity-monitoring.html +++ b/_site/docs/hive-query-activity-monitoring.html @@ -187,12 +187,13 @@ </li> </ul> -<pre><code>$ su hive +<div class="highlighter-rouge"><pre class="highlight"><code>$ su hive $ hive $ set hive.execution.engine=mr; $ use xademo; $ select a.phone_number from customer_details a, call_detail_records b where a.phone_number=b.phone_number; </code></pre> +</div> <p>From UI click on alert tab and you should see alert for your attempt to read restricted column.</p> @@ -203,7 +204,7 @@ $ select a.phone_number from customer_details a, call_detail_records b where a.p <div class="footnotes"> <ol> <li id="fn:HIVE"> - <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhiveâ on this page represent Apache Hive.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/import-hdfs-auditLog.html ---------------------------------------------------------------------- diff --git a/_site/docs/import-hdfs-auditLog.html b/_site/docs/import-hdfs-auditLog.html index 5a18853..f23ddfd 100644 --- a/_site/docs/import-hdfs-auditLog.html +++ b/_site/docs/import-hdfs-auditLog.html @@ -169,9 +169,10 @@ install a <strong>namenode log4j Kafka appender</strong>.</p> <p>Here is an sample Kafka command to create topic âsandbox_hdfs_audit_logâ</p> - <pre><code>cd <kafka-home> + <div class="highlighter-rouge"><pre class="highlight"><code>cd <kafka-home> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log </code></pre> + </div> </li> <li> <p><strong>Step 2</strong>: Install Logstash-kafka plugin</p> @@ -189,7 +190,7 @@ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 - <li> <p><strong>Step 3</strong>: Create a Logstash configuration file under ${LOGSTASH_HOME}/conf. Here is a sample.</p> - <pre><code> input { + <div class="highlighter-rouge"><pre class="highlight"><code> input { file { type => "hdp-nn-audit" path => "/path/to/audit.log" @@ -230,15 +231,17 @@ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 - } } </code></pre> + </div> </li> <li> <p><strong>Step 4</strong>: Start Logstash</p> - <pre><code>bin/logstash -f conf/sample.conf + <div class="highlighter-rouge"><pre class="highlight"><code>bin/logstash -f conf/sample.conf </code></pre> + </div> </li> <li> - <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka topic specified by <code>topic_id</code></p> + <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka topic specified by <code class="highlighter-rouge">topic_id</code></p> </li> </ul> @@ -252,14 +255,15 @@ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 - <li> <p><strong>Step 1</strong>: Create a Kafka topic. Here is a example Kafka command for creating topic âsandbox_hdfs_audit_logâ</p> - <pre><code>cd <kafka-home> + <div class="highlighter-rouge"><pre class="highlight"><code>cd <kafka-home> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log </code></pre> + </div> </li> <li> <p><strong>Step 2</strong>: Configure $HADOOP_CONF_DIR/log4j.properties, and add a log4j appender âKAFKA_HDFS_AUDITâ to hdfs audit logging</p> - <pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender + <div class="highlighter-rouge"><pre class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667 log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer @@ -269,22 +273,25 @@ log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async #log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1 #log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1 </code></pre> + </div> <p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p> </li> <li> <p><strong>Step 3</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p> - <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT + <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT </code></pre> + </div> <p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p> </li> <li> <p><strong>Step 4</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and append the following command to it.</p> - <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/* + <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/* </code></pre> + </div> <p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p> </li> @@ -294,8 +301,9 @@ log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async <li> <p><strong>Step 6</strong>: Check whether logs are flowing into Topic sandbox_hdfs_audit_log</p> - <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log + <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log </code></pre> + </div> </li> </ul> @@ -306,10 +314,10 @@ log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async <div class="footnotes"> <ol> <li id="fn:KAFKA"> - <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> + <p><em>All mentions of âkafkaâ on this page represent Apache Kafka.</em> <a href="#fnref:KAFKA" class="reversefootnote">↩</a></p> </li> <li id="fn:AMBARI"> - <p><em>all mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> + <p><em>all mentions of âambariâ on this page represent Apache Ambari.</em> <a href="#fnref:AMBARI" class="reversefootnote">↩</a></p> </li> </ol> </div> http://git-wip-us.apache.org/repos/asf/eagle/blob/0094010b/_site/docs/index.html ---------------------------------------------------------------------- diff --git a/_site/docs/index.html b/_site/docs/index.html index 7e607b4..c3ff024 100644 --- a/_site/docs/index.html +++ b/_site/docs/index.html @@ -204,13 +204,13 @@ <div class="footnotes"> <ol> <li id="fn:HADOOP"> - <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhadoopâ on this page represent Apache Hadoop.</em> <a href="#fnref:HADOOP" class="reversefootnote">↩</a></p> </li> <li id="fn:SPARK"> - <p><em>All mentions of âsparkâ on this page represent Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p> + <p><em>All mentions of âsparkâ on this page represent Apache Spark.</em> <a href="#fnref:SPARK" class="reversefootnote">↩</a></p> </li> <li id="fn:HIVE"> - <p><em>All mentions of âhiveâ on this page represent Apache HIVE.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> + <p><em>All mentions of âhiveâ on this page represent Apache HIVE.</em> <a href="#fnref:HIVE" class="reversefootnote">↩</a></p> </li> </ol> </div>
![https://maven-badges.herokuapp.com/maven-central/org.apache.eagle/eagle-parent/badge.svg"](https://maven-badges.herokuapp.com/maven-central/org.apache.eagle/eagle-parent/badge.svg"){kind=link}