Akshay, Please find comments inline below.
1. We are trying things on Cloudier environment with Apache Eagle , as observed all the mentioned examples are referenced to Hortonworks in the documentation and as mentioned Hortonworks supports Eagle plugins.Are there similar things available for Cloudera, also currently we are able to build and run the service on Cloudera Quickstart VM [ for v0.4 and v0.5 ] as a standalone service but as observed v0.4 and v0.5 are totally different [in case of UI no default applications are seen in v0.4]. For stable version 0.4 there is no documentation provided all the doc can be found is for v0.3 and v0.5. *- Apache Eagle does not have any bindings with either hadoop distro.* *- Apache Eagle provides plugins to easily integrate with Hortonworks / Cloudera and MAPR* *- along with ambari integraton there is also cloudera plugin ( eagle/eagle-external/eagle-cdh )* 2. If we need to replace the Strom service with Apache Spark , we don't have any pointers for how to get Spark enabled in place of Storm in Eagle. *-although you can run alert engine and some other stuff on spark, there is a limited support for this flexibility as of today.* 3. Can you please provide pointers to how we can pass the raw events from kafka topic to enriched events [ processed event ex. Kafka ingest --> log parser --> Kafka sink ] that can be used in Policies for querying though these are present in doc, they are not clear to understand. *- refer to the latest docs which has this example covered: https://eagle.apache.org/docs/latest <https://eagle.apache.org/docs/latest> ( version 0.5)* 4. v0.4 has the Save All option to save changes but v0.5 don't have option to save changes ex. in case of site creation etc, observed that if the service goes down and we restart it all the previous changes are gone.Do we need any specific changes in configs,as here as observed our Storage is MySql and it is working fine as all the required tables were created when the service was up. *- as Sudha pointed out, you will have to use mysql or hbase specific config to store things from UI. * Please provide suggestions for the above mentioned problems. Also please suggest in case of version which one is stable to use [ v0.4 or v0.5 ]. *- pls use V0.5 ( official release is coming soon ) - in mean time take release from here: https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/ <https://dist.apache.org/repos/dist/release/eagle/apache-eagle-0.5.0/>* let us know how it goes. Thanks - Jayesh On Fri, Sep 15, 2017 at 7:23 AM, SUDHA JENSLIN <[email protected]> wrote: > Hi Akshay, > > To address the point number 4. > > Do you have the following in your configuration: > > metadata { > store ="org.apache.eagle.metadata.store.jdbc.JDBCMetadataStore" > > jdbc { > username = "" > password = "" > driverClassName= com.mysql.jdbc.Driver > connection = "jdbc:mysql://hostname:3306/eagle_db" > connectionProperties = "encoding=UTF8;timeout=60;autoReconnect=true" > } > } > > > > > Regards, > Sudha Jenslin > > On Thu, Sep 14, 2017 at 3:41 PM, Akshay Thali < > [email protected]> wrote: > >> Hi Team, >> >> I am Akshay working at Clairvoyantsoft as a Hadoop Developer.We are >> currently planning to do some analytics on Cloudera Cluster for Audit and >> access logs using Apache Eagle. >> >> *Use Case : * >> 1. To detect unauthorised user access >> 2. Monitor user level access >> >> Both the cases are supported by Apache Eagle but there are some problem >> which we are facing while using version 0.4 and version 0.5.We need some >> help in this case. >> >> *Problem :* >> >> 1. We are trying things on Cloudier environment with Apache Eagle , as >> observed all the mentioned examples are referenced to Hortonworks in the >> documentation and as mentioned Hortonworks supports Eagle plugins.Are >> there similar things available for Cloudera, also currently we are able to >> build and run the service on Cloudera Quickstart VM [ for v0.4 and v0.5 ] >> as a standalone service but as observed v0.4 and v0.5 are totally different >> [in case of UI no default applications are seen in v0.4]. For stable >> version 0.4 there is no documentation provided all the doc can be found is >> for v0.3 and v0.5. >> >> 2. If we need to replace the Strom service with Apache Spark , we don't >> have any pointers for how to get Spark enabled in place of Storm in Eagle. >> >> 3. Can you please provide pointers to how we can pass the raw events >> from kafka topic to enriched events [ processed event ex. Kafka ingest --> >> log parser --> Kafka sink ] that can be used in Policies for querying >> though these are present in doc, they are not clear to understand. >> >> 4. v0.4 has the Save All option to save changes but v0.5 don't have >> option to save changes ex. in case of site creation etc, observed that if >> the service goes down and we restart it all the previous changes are >> gone.Do we need any specific changes in configs,as here as observed our >> Storage is MySql and it is working fine as all the required tables were >> created when the service was up. >> >> Please provide suggestions for the above mentioned problems. Also please >> suggest in case of version which one is stable to use [ v0.4 or v0.5 ]. >> It would be of great help for us. >> Thanks in Advance. >> >> Regards, >> Akshay >> >> >> >
