你好，我配置了mysql如下，
# Eagle Metadata Store Configuration
# ---------------------------------------------
metadata {
store = org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore
#store = org.apache.eagle.metadata.service.memory.MemoryMetadataStore
jdbc {
username = "hive"
password = "test"
driverClassName = com.mysql.jdbc.Driver
database = "eagle"
connection = "jdbc:mysql://10.25.20.35:3306/eagle"
}
}
但启动时报错，
ERROR [2017-12-19 20:39:50,448]
org.apache.eagle.metadata.persistence.MetadataStore: Failed to instantiate
org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore
! java.lang.ClassNotFoundException:
org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore
! at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[na:1.8.0_40]
! at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_40]
! at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
~[na:1.8.0_40]
! at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_40]
! at java.lang.Class.forName0(Native Method) ~[na:1.8.0_40]
! at java.lang.Class.forName(Class.java:264) ~[na:1.8.0_40]
! at
org.apache.eagle.metadata.persistence.MetadataStoreModuleFactory.getModule(MetadataStoreModuleFactory.java:43)
~[eagle-topology-0.5.0-assembly.jar:na]
! at
org.apache.eagle.server.module.ServerModule.configure(ServerModule.java:36)
[eagle-topology-0.5.0-assembly.jar:na]
! at com.google.inject.AbstractModule.configure(AbstractModule.java:59)
[eagle-topology-0.5.0-assembly.jar:na]
! at com.google.inject.spi.Elements$RecordingBinder.install(Elements.java:223)
[eagle-topology-0.5.0-assembly.jar:na]
! at com.google.inject.spi.Elements.getElements(Elements.java:101)
[eagle-topology-0.5.0-assembly.jar:na]
! at
com.google.inject.internal.InjectorShell$Builder.build(InjectorShell.java:133)
[eagle-topology-0.5.0-assembly.jar:na]
! at
com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:103)
[eagle-topology-0.5.0-assembly.jar:na]
! at com.google.inject.Guice.createInjector(Guice.java:95)
[eagle-topology-0.5.0-assembly.jar:na]
! at com.google.inject.Guice.createInjector(Guice.java:72)
[eagle-topology-0.5.0-assembly.jar:na]
! at com.google.inject.Guice.createInjector(Guice.java:62)
[eagle-topology-0.5.0-assembly.jar:na]
! at
org.apache.eagle.app.module.ApplicationExtensionLoader.load(ApplicationExtensionLoader.java:33)
[eagle-topology-0.5.0-assembly.jar:na]
! at
org.apache.eagle.server.module.GuiceBundleLoader.load(GuiceBundleLoader.java:52)
[eagle-topology-0.5.0-assembly.jar:na]
! at
org.apache.eagle.server.module.GuiceBundleLoader.load(GuiceBundleLoader.java:82)
[eagle-topology-0.5.0-assembly.jar:na]
! at
org.apache.eagle.server.ServerApplication.initialize(ServerApplication.java:69)
[eagle-topology-0.5.0-assembly.jar:na]
! at io.dropwizard.Application.run(Application.java:70)
[dropwizard-core-0.7.1.jar:0.7.1]
! at org.apache.eagle.server.ServerMain.main(ServerMain.java:44)
[eagle-topology-0.5.0-assembly.jar:na]
Exception in thread "main"
com.google.inject.internal.util.$ComputationException:
java.lang.ArrayIndexOutOfBoundsException: 22333
at
com.google.inject.internal.util.$MapMaker$StrategyImpl.compute(MapMaker.java:553)
at
com.google.inject.internal.util.$MapMaker$StrategyImpl.compute(MapMaker.java:419)
at
com.google.inject.internal.util.$CustomConcurrentHashMap$ComputingImpl.get(CustomConcurrentHashMap.java:2041)
at
com.google.inject.internal.util.$StackTraceElements.forMember(StackTraceElements.java:53)
at
com.google.inject.internal.Errors.formatInjectionPoint(Errors.java:716)
at com.google.inject.internal.Errors.formatSource(Errors.java:678)
at com.google.inject.internal.Errors.format(Errors.java:555)
at
com.google.inject.CreationException.getMessage(CreationException.java:48)
at org.apache.eagle.server.ServerMain.main(ServerMain.java:46)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 22333
at com.google.inject.internal.asm.$ClassReader.<init>(Unknown Source)
at com.google.inject.internal.asm.$ClassReader.<init>(Unknown Source)
at com.google.inject.internal.asm.$ClassReader.<init>(Unknown Source)
at
com.google.inject.internal.util.$LineNumbers.<init>(LineNumbers.java:62)
at
com.google.inject.internal.util.$StackTraceElements$1.apply(StackTraceElements.java:36)
at
com.google.inject.internal.util.$StackTraceElements$1.apply(StackTraceElements.java:33)
at
com.google.inject.internal.util.$MapMaker$StrategyImpl.compute(MapMaker.java:549)
你能帮我看看什么地方错了吗？
谢谢。
________________________________
发件人: Chen, Hao <[email protected]>
发送时间: 2017年12月6日 11:01
收件人: Yuan George; 绿飕飕
抄送: [email protected]; [email protected]
主题: RE: 请教关于 eagle v0.5.0 的问题
你们好 :)
1. 关于配置
请把https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/conf/eagle.conf#L77
[https://avatars3.githubusercontent.com/u/47359?s=400&v=4]<https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/conf/eagle.conf#L77>
apache/eagle<https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/conf/eagle.conf#L77>
github.com
eagle - Mirror of Apache Eagle
metadata.store = org.apache.eagle.metadata.service.memory.MemoryMetadataStore
更改为
metadata.store = org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore
2.
关于数据库表的ddl，请通过https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/doc/metadata-ddl.sql
[https://avatars3.githubusercontent.com/u/47359?s=400&v=4]<https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/doc/metadata-ddl.sql>
apache/eagle<https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/doc/metadata-ddl.sql>
github.com
eagle - Mirror of Apache Eagle
手动创建
谢谢
陈浩
From: Yuan George [mailto:[email protected]]
Sent: 2017年12月6日 9:01
To: 绿飕飕 <[email protected]>; Chen, Hao <[email protected]>
Subject: 答复: 请教关于 eagle v0.5.0 的问题
你好，
我还没有配置成功，最近忙其他，没有什么进展。所以没法给你提建议。要不，你直接问问陈浩吧
[email protected]，他应该能够回答<mailto:[email protected]，他应该能够回答>。
我发现重启eagle后，前面创建的site就没有了，估计是没能保存进mysql数据库吧？
我手工在mysql里面创建了eagle库，启动eagle后，发现库中没有任何表。请问是不是需要初始化下数据库并先把表创建起来才行？
另外，你看方便把你的eagle.conf文件发给我看看嘛？
谢谢。
袁兆国
________________________________
发件人: 绿飕飕 <[email protected]<mailto:[email protected]>>
发送时间: 2017年12月5日 17:27
收件人: [email protected]<mailto:[email protected]>
主题: 请教关于 eagle v0.5.0 的问题
袁兆国 你好!
我从eagle的邮件列表中得知,你也在安装使用eagle,
不知你是否成功运行?
我在配置 Hdfs Audit Log Monitor 的时候出现问题,配置完成后,尝试出发警告,但通过kafka的脚本只发现
hdfs_audit_log_sandbox有消息, 而hdfs_audit_log_enriched_sanbox无消息.
我配置步骤如下:
1.按照要求在 kafka 中创建了 SITE_ID 为 sandbox 名字如下
hdfs_audit_log_{SITE_ID}, hdfs_audit_log_enriched_{SITE_ID}
这两个 topic.
2. Hdfs AUdit Log Monitor 的部分配置(Settings)
Execution Mode --> Cluster Mode
ExcecutionFile -->
/home/eagle/software/eagle-0.5.0/lib/eagle-topology-0.5.0-assembly.jar
Kafka Consumer Topic for HDFS Auditlog --> hdfs_audit_log_sandbox
Kafka Topic for Auditlog Event Sink --> hdfs_audit_log_event_sandbox
fs.defaultFS --> hdfs://localhost:9000(我的hadoop中hdfs配置是9000端口)
3. Alert Engine 的配置(Settings)
Execution Mode --> Cluster Mode
ExcecutionFile -->
/home/eagle/software/eagle-0.5.0/lib/eagle-topology-0.5.0-assembly.jar
Kafka Spout Broker Zookeeper Quorum --> localhost:2181
Spout Consumer ID --> eagle_consumer
其余配置
{
"workers": "1",
"topology.numOfSpoutTasks": "1",
"topology.numOfRouterBolts": "4",
"topology.numOfAlertBolts": "10",
"topology.numOfPublishExecutors": "1",
"topology.numOfPublishTasks": "1",
"topology.message.timeout.secs": "300",
"spout.kafkaBrokerZkQuorum": "localhost:2181",
"spout.kafkaBrokerZkBasePath": "/brokers",
"spout.stormKafkaUseSameZkQuorumWithKafkaBroker": "true",
"spout.stormKafkaTransactionZkQuorum": "",
"spout.stormKafkaTransactionZkPath": "/consumers",
"spout.stormKafkaEagleConsumer": "eagle_consumer"
}
