On 2019/03/18 20:18:20, [email protected] <[email protected]> wrote:
>
>
> On 2019/03/18 18:57:48, Edward Zhang <[email protected]> wrote:
> > I think @hao <[email protected]> has set up eagle in local environment well.
> > The problem is like you said, Eagle local mode has some issues because
> > originally we want to run everything in one box including storm, zookeeper,
> > which has made things difficult to manage. There is a discussion about
> > simplifying the set up, but that really needs some time and you may not
> > want to wait.
> >
> > But if @hao <[email protected]> can quickly identify the issue, probably you
> > can move forward.
> >
> > Thanks
> > Edward
> >
> > On Mon, Mar 18, 2019 at 11:47 AM [email protected] <
> > [email protected]> wrote:
> >
> > >
> > > Thank you very much for the help at the Apache Eagle Forum (
> > > https://lists.apache.org/[email protected]) from Jayesh. .
> > > I am trying to do Proof of concept with Eagle and encountering constant
> > > issues.
> > >
> > > I can successfully compile Eagle 0.50 and Launch Eagle (
> > > bin/eagle-server.sh start). . I have new HDP 2.6 cluster running with
> > > normal Ambari based GUI.
> > > I am following http://eagle.apache.org/docs/latest/using-eagle/ as my
> > > reference .
> > > The basic Apache Eagle GUI works. However I have several major
> > > issues.
> > >
> > > 1) I can not define the sites ( like Sandbox), define
> > > applications ( HDFS Audit log, Hadoop Metrics Monitor
> > > (HADOOP_METRIC_MONITOR) but can not define policy . “Apply” button
> > > remains greyed out.
> > > 2) Some of the web pages work intermittently, I can not navigate
> > > but can circumvent intermittently (http://<IP>:9090/#/login and
> > > http://<ip:9090/ /#//integration/siteList) vis URL .
> > > 3) The moment I start the Eagle server. The server logs keeps
> > > getting flooded with Zookeper connection refused errors. I am not running
> > > any firewall.as belwo.
> > >
> > >
> > > I wonder who else have been user of the Apache Eagle besides eBay,
> > > PayPal, DataGuise ? Few individuals I communicated told me that they
> > > gave
> > > up due to lack of user participation at the Eagle forum and so lack of
> > > support. Not sure if that is an accurate assesment.
> > > Tushar Shah
> > > [email protected]
> > >
> > >
> > Edward ,
> Thank you for such a prompt reply. I am running Hortonworks 2.6 in a cluster
> of 10 nodes. I installed Eagle on node 1 whichis running the Ambari. Zookeper
> is rnning on node 2. I changed Eagle .cnf to point to my zookeper at node 2.
> Stll same problem after eagle restart. Orignal eage.conf
> eagle.conf
> Tushar(3:20:30 PM): zookeeper {
> zkQuorum = "localhost:2181"
> zkSessionTimeoutMs : 15000
> zkRetryTimes : 3
> zkRetryInterval : 20000
> }
>
> Changed from from zkQuorum = "localhost:2181" to
> 101-02-08-node2.internal.bigtdata.io:2181.
> port 2181 is listening but same problem.
>
> You may share your eagle .conf file. I tried sandbox at VM aswell, There I
> can not even bring up the Eagle GUI.
>
> Thanks again
> Tushar Shah
> [email protected]
>
>
Hi Edward
Thanks again for your reply. Wonder if you or Hao plan to work on issue
with Eagle in loal mode as you mentioned above.
Meanwhile I, could circumvent the problem of the log flooding with connection
refused errors for the zookeeper by specifying the the zookeeper at the
actual node ( and not the local host).
However I still have issue in defining the application. After defining the
site m defining apllication, I am try to install using the following stes at
the Web interface.
How to Install
1. Create two kafka topics: hdfs_audit_log_{SITE_ID},
hdfs_audit_log_enriched_{SITE_ID}
2. Setup a log collecting tool you like to stream audit log into topic
hdfs_audit_log_{SITE_ID}
3. Click "Install" button and edit configurations in general and advanced
lists according to your requirements
4. Check the new generated stream HDFS_AUDIT_LOG_ENRICHED_STREAM_{SITE_ID}
at Alert -> Streams
is it necessary for Eagle to have Kafka topics and collection working before
one can define a policy ? At present I have issue in making kafka publishing
and collection work.
Tushar Shah
[email protected]
732 420 3139
