[
https://issues.apache.org/jira/browse/EAGLE-469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15423252#comment-15423252
]
ASF GitHub Bot commented on EAGLE-469:
--------------------------------------
GitHub user yonzhang opened a pull request:
https://github.com/apache/incubator-eagle/pull/353
EAGLE-469 make dataSource configuration extremely simple
https://issues.apache.org/jira/browse/EAGLE-469
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yonzhang/incubator-eagle develop
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-eagle/pull/353.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #353
----
commit 5cf6a7f4a0918af79f8426dc1e83b435744a3b7e
Author: yonzhang <[email protected]>
Date: 2016-08-16T18:19:34Z
kafka datasource be made very simple
commit 256fda5db755ce1f4cb215c4482fec07f2d72338
Author: yonzhang <[email protected]>
Date: 2016-08-16T18:20:58Z
Merge remote-tracking branch 'upstream/develop' into develop
----
> make dataSource configuration extremely simple
> ----------------------------------------------
>
> Key: EAGLE-469
> URL: https://issues.apache.org/jira/browse/EAGLE-469
> Project: Eagle
> Issue Type: Improvement
> Affects Versions: v0.5.0
> Reporter: Edward Zhang
> Assignee: Edward Zhang
> Priority: Minor
> Fix For: v0.5.0
>
>
> Today dataSource configuration is very cumbersome, we actually can reduce
> significantly the size of config entries as most of configurations use the
> default values.
> "dataSourceConfig": {
> "topic" : "sandbox_hbase_security_log",
> "zkConnection" : "sandbox.hortonworks.com:2181",
> "zkConnectionTimeoutMS" : 15000,
> "consumerGroupId" : "EagleConsumer",
> "fetchSize" : 1048586,
> "deserializerClass" :
> "org.apache.eagle.security.hbase.HbaseAuditLogKafkaDeserializer",
> "transactionZKServers" : "sandbox.hortonworks.com",
> "transactionZKPort" : 2181,
> "transactionZKRoot" : "/consumers",
> "consumerGroupId" : "eagle.hbasesecurity.consumer",
> "transactionStateUpdateMS" : 2000
> }
> The new data source config would be like:
> "dataSourceConfig": {
> "topic" : "hbase_audit_log",
> "zkConnection" : "server.eagle.apache.org:2181",
> "txZkServers" : "server.eagle.apache.org:2181",
> "schemeCls" : "storm.kafka.StringScheme"
> }
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
