Sorry for the mistake, please change to "org.apache.eagle.metadata.store.jdbc.JDBCMetadataStore"
________________________________ From: Yuan George <[email protected]> Sent: Tuesday, December 19, 2017 8:47:14 PM To: Chen, Hao; 绿飕飕 Cc: [email protected]; [email protected] Subject: 答复: 请教关于 eagle v0.5.0 的问题 你好，我配置了mysql如下， # Eagle Metadata Store Configuration # --------------------------------------------- metadata { store = org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore #store = org.apache.eagle.metadata.service.memory.MemoryMetadataStore jdbc { username = "hive" password = "test" driverClassName = com.mysql.jdbc.Driver database = "eagle" connection = "jdbc:mysql://10.25.20.35:3306/eagle" } } 但启动时报错， ERROR [2017-12-19 20:39:50,448] org.apache.eagle.metadata.persistence.MetadataStore: Failed to instantiate org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore ! java.lang.ClassNotFoundException: org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore ! at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[na:1.8.0_40] ! at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_40] ! at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[na:1.8.0_40] ! at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_40] ! at java.lang.Class.forName0(Native Method) ~[na:1.8.0_40] ! at java.lang.Class.forName(Class.java:264) ~[na:1.8.0_40] ! at org.apache.eagle.metadata.persistence.MetadataStoreModuleFactory.getModule(MetadataStoreModuleFactory.java:43) ~[eagle-topology-0.5.0-assembly.jar:na] ! at org.apache.eagle.server.module.ServerModule.configure(ServerModule.java:36) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.AbstractModule.configure(AbstractModule.java:59) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.spi.Elements$RecordingBinder.install(Elements.java:223) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.spi.Elements.getElements(Elements.java:101) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.internal.InjectorShell$Builder.build(InjectorShell.java:133) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:103) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.Guice.createInjector(Guice.java:95) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.Guice.createInjector(Guice.java:72) [eagle-topology-0.5.0-assembly.jar:na] ! at com.google.inject.Guice.createInjector(Guice.java:62) [eagle-topology-0.5.0-assembly.jar:na] ! at org.apache.eagle.app.module.ApplicationExtensionLoader.load(ApplicationExtensionLoader.java:33) [eagle-topology-0.5.0-assembly.jar:na] ! at org.apache.eagle.server.module.GuiceBundleLoader.load(GuiceBundleLoader.java:52) [eagle-topology-0.5.0-assembly.jar:na] ! at org.apache.eagle.server.module.GuiceBundleLoader.load(GuiceBundleLoader.java:82) [eagle-topology-0.5.0-assembly.jar:na] ! at org.apache.eagle.server.ServerApplication.initialize(ServerApplication.java:69) [eagle-topology-0.5.0-assembly.jar:na] ! at io.dropwizard.Application.run(Application.java:70) [dropwizard-core-0.7.1.jar:0.7.1] ! at org.apache.eagle.server.ServerMain.main(ServerMain.java:44) [eagle-topology-0.5.0-assembly.jar:na] Exception in thread "main" com.google.inject.internal.util.$ComputationException: java.lang.ArrayIndexOutOfBoundsException: 22333 at com.google.inject.internal.util.$MapMaker$StrategyImpl.compute(MapMaker.java:553) at com.google.inject.internal.util.$MapMaker$StrategyImpl.compute(MapMaker.java:419) at com.google.inject.internal.util.$CustomConcurrentHashMap$ComputingImpl.get(CustomConcurrentHashMap.java:2041) at com.google.inject.internal.util.$StackTraceElements.forMember(StackTraceElements.java:53) at com.google.inject.internal.Errors.formatInjectionPoint(Errors.java:716) at com.google.inject.internal.Errors.formatSource(Errors.java:678) at com.google.inject.internal.Errors.format(Errors.java:555) at com.google.inject.CreationException.getMessage(CreationException.java:48) at org.apache.eagle.server.ServerMain.main(ServerMain.java:46) Caused by: java.lang.ArrayIndexOutOfBoundsException: 22333 at com.google.inject.internal.asm.$ClassReader.<init>(Unknown Source) at com.google.inject.internal.asm.$ClassReader.<init>(Unknown Source) at com.google.inject.internal.asm.$ClassReader.<init>(Unknown Source) at com.google.inject.internal.util.$LineNumbers.<init>(LineNumbers.java:62) at com.google.inject.internal.util.$StackTraceElements$1.apply(StackTraceElements.java:36) at com.google.inject.internal.util.$StackTraceElements$1.apply(StackTraceElements.java:33) at com.google.inject.internal.util.$MapMaker$StrategyImpl.compute(MapMaker.java:549) 你能帮我看看什么地方错了吗？ 谢谢。 ________________________________ 发件人: Chen, Hao <[email protected]> 发送时间: 2017年12月6日 11:01 收件人: Yuan George; 绿飕飕 抄送: [email protected]; [email protected] 主题: RE: 请教关于 eagle v0.5.0 的问题 你们好 :) 1. 关于配置 请把https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/conf/eagle.conf#L77<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Feagle%2Fblob%2Fmaster%2Feagle-assembly%2Fsrc%2Fmain%2Fconf%2Feagle.conf%23L77&data=02%7C01%7CHao.Chen3%40ebay.com%7C3e08061616f0438edaac08d546debe39%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636492844853591203&sdata=Z68d2Nn3A0ZuY4Wb5mT1rv8t%2BvHiHTGZ%2Fx10GWN%2B2TE%3D&reserved=0> [https://avatars3.githubusercontent.com/u/47359?s=400&v=4]<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Feagle%2Fblob%2Fmaster%2Feagle-assembly%2Fsrc%2Fmain%2Fconf%2Feagle.conf%23L77&data=02%7C01%7CHao.Chen3%40ebay.com%7C3e08061616f0438edaac08d546debe39%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636492844853591203&sdata=Z68d2Nn3A0ZuY4Wb5mT1rv8t%2BvHiHTGZ%2Fx10GWN%2B2TE%3D&reserved=0> apache/eagle<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Feagle%2Fblob%2Fmaster%2Feagle-assembly%2Fsrc%2Fmain%2Fconf%2Feagle.conf%23L77&data=02%7C01%7CHao.Chen3%40ebay.com%7C3e08061616f0438edaac08d546debe39%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636492844853591203&sdata=Z68d2Nn3A0ZuY4Wb5mT1rv8t%2BvHiHTGZ%2Fx10GWN%2B2TE%3D&reserved=0> github.com eagle - Mirror of Apache Eagle metadata.store = org.apache.eagle.metadata.service.memory.MemoryMetadataStore 更改为 metadata.store = org.apache.eagle.metadata.service.jdbc.JDBCMetadataStore 2. 关于数据库表的ddl，请通过https://github.com/apache/eagle/blob/master/eagle-assembly/src/main/doc/metadata-ddl.sql<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Feagle%2Fblob%2Fmaster%2Feagle-assembly%2Fsrc%2Fmain%2Fdoc%2Fmetadata-ddl.sql&data=02%7C01%7CHao.Chen3%40ebay.com%7C3e08061616f0438edaac08d546debe39%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636492844853591203&sdata=4BEYThnca0tJ9XXUy%2FCz7JcFQIv1yOCq4OwSkF5B0eY%3D&reserved=0> [https://avatars3.githubusercontent.com/u/47359?s=400&v=4]<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Feagle%2Fblob%2Fmaster%2Feagle-assembly%2Fsrc%2Fmain%2Fdoc%2Fmetadata-ddl.sql&data=02%7C01%7CHao.Chen3%40ebay.com%7C3e08061616f0438edaac08d546debe39%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636492844853591203&sdata=4BEYThnca0tJ9XXUy%2FCz7JcFQIv1yOCq4OwSkF5B0eY%3D&reserved=0> apache/eagle<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Feagle%2Fblob%2Fmaster%2Feagle-assembly%2Fsrc%2Fmain%2Fdoc%2Fmetadata-ddl.sql&data=02%7C01%7CHao.Chen3%40ebay.com%7C3e08061616f0438edaac08d546debe39%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636492844853591203&sdata=4BEYThnca0tJ9XXUy%2FCz7JcFQIv1yOCq4OwSkF5B0eY%3D&reserved=0> github.com eagle - Mirror of Apache Eagle 手动创建 谢谢 陈浩 From: Yuan George [mailto:[email protected]] Sent: 2017年12月6日 9:01 To: 绿飕飕 <[email protected]>; Chen, Hao <[email protected]> Subject: 答复: 请教关于 eagle v0.5.0 的问题 你好， 我还没有配置成功，最近忙其他，没有什么进展。所以没法给你提建议。要不，你直接问问陈浩吧 [email protected]，他应该能够回答<mailto:[email protected]，他应该能够回答>。 我发现重启eagle后，前面创建的site就没有了，估计是没能保存进mysql数据库吧？ 我手工在mysql里面创建了eagle库，启动eagle后，发现库中没有任何表。请问是不是需要初始化下数据库并先把表创建起来才行？ 另外，你看方便把你的eagle.conf文件发给我看看嘛？ 谢谢。 袁兆国 ________________________________ 发件人: 绿飕飕 <[email protected]<mailto:[email protected]>> 发送时间: 2017年12月5日 17:27 收件人: [email protected]<mailto:[email protected]> 主题: 请教关于 eagle v0.5.0 的问题 袁兆国 你好! 我从eagle的邮件列表中得知,你也在安装使用eagle, 不知你是否成功运行? 我在配置 Hdfs Audit Log Monitor 的时候出现问题,配置完成后,尝试出发警告,但通过kafka的脚本只发现 hdfs_audit_log_sandbox有消息, 而hdfs_audit_log_enriched_sanbox无消息. 我配置步骤如下: 1.按照要求在 kafka 中创建了 SITE_ID 为 sandbox 名字如下 hdfs_audit_log_{SITE_ID}, hdfs_audit_log_enriched_{SITE_ID} 这两个 topic. 2. Hdfs AUdit Log Monitor 的部分配置(Settings) Execution Mode --> Cluster Mode ExcecutionFile --> /home/eagle/software/eagle-0.5.0/lib/eagle-topology-0.5.0-assembly.jar Kafka Consumer Topic for HDFS Auditlog --> hdfs_audit_log_sandbox Kafka Topic for Auditlog Event Sink --> hdfs_audit_log_event_sandbox fs.defaultFS --> hdfs://localhost:9000(我的hadoop中hdfs配置是9000端口) 3. Alert Engine 的配置(Settings) Execution Mode --> Cluster Mode ExcecutionFile --> /home/eagle/software/eagle-0.5.0/lib/eagle-topology-0.5.0-assembly.jar Kafka Spout Broker Zookeeper Quorum --> localhost:2181 Spout Consumer ID --> eagle_consumer 其余配置 { "workers": "1", "topology.numOfSpoutTasks": "1", "topology.numOfRouterBolts": "4", "topology.numOfAlertBolts": "10", "topology.numOfPublishExecutors": "1", "topology.numOfPublishTasks": "1", "topology.message.timeout.secs": "300", "spout.kafkaBrokerZkQuorum": "localhost:2181", "spout.kafkaBrokerZkBasePath": "/brokers", "spout.stormKafkaUseSameZkQuorumWithKafkaBroker": "true", "spout.stormKafkaTransactionZkQuorum": "", "spout.stormKafkaTransactionZkPath": "/consumers", "spout.stormKafkaEagleConsumer": "eagle_consumer" }
