This is an automated email from the ASF dual-hosted git repository.
nickallen pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/metron.git
The following commit(s) were added to refs/heads/master by this push:
new c58062a METRON-2082 Update the README document steps to run Batch
Profiler (MohanDV via nickwallen) closes apache/metron#1387
c58062a is described below
commit c58062a263927a4c41edd0315d58077e0a91446a
Author: MohanDV <[email protected]>
AuthorDate: Wed Apr 17 11:32:27 2019 -0400
METRON-2082 Update the README document steps to run Batch Profiler (MohanDV
via nickwallen) closes apache/metron#1387
---
metron-analytics/metron-profiler-spark/README.md | 6 ++++++
1 file changed, 6 insertions(+)
diff --git a/metron-analytics/metron-profiler-spark/README.md
b/metron-analytics/metron-profiler-spark/README.md
index 5ed5f4b..5ee8510 100644
--- a/metron-analytics/metron-profiler-spark/README.md
+++ b/metron-analytics/metron-profiler-spark/README.md
@@ -67,6 +67,12 @@ For an introduction to the Profiler, see the [Profiler
README](../metron-profile
hdfs dfs -cat /apps/metron/indexing/indexed/*/* | wc -l
```
+1. Copy the `hbase-site.xml` file from `/etc/hbase/conf` to
`/etc/spark2/conf`. It is advised to create a symlink to avoid the duplication
of file, also to keep consistency between files while config updates.
+
+ ```
+ ln -s /etc/hbase/conf/hbase-site.xml /etc/spark2/conf/hbase-site.xml
+ ```
+
1. Review the Batch Profiler's properties located at
`$METRON_HOME/config/batch-profiler.properties`. See [Configuring the
Profiler](#configuring-the-profiler) for more information on these properties.
1. You may want to edit the log4j properties that sits in your config
directory in `${SPARK_HOME}` or create one. It may be helpful to turn on
`DEBUG` logging for the Profiler by adding the following line.