[
https://issues.apache.org/jira/browse/FLUME-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921192#comment-13921192
]
wolfgang hoschek commented on FLUME-2340:
-----------------------------------------
[~otis] Once someone put together the above parts we could take the next step -
refactoring to have three flume maven modules: one module as a base, another
module for solr dependencies, and yet another module for ES dependencies:
- Add a new flume module flume-ng-morphline-sink that's a copy n paste of
flume-ng-morphline-solr-sink except that it has a minimum of dependencies:
depends on kite-morphlines-core instead of kite-morphlines-all, and in
particular doesn't contain tests and classes that depend on solr (or ES). E.g.
it contains MorphlineSink.java and MorphlineInterceptor.java but not
MorphlineSolrSink.java.
- Add flume-ng-morphline-elasticsearch-sink that depends on
flume-ng-morphline-sink and also kite-morphlines-all-except-solr, plus
kite-morphlines-elasticsearch. This means you can use class MorphlineSink from
flume-ng-morphline-sink as is for ES.
- Change flume-ng-morphline-solr-sink to depend on flume-ng-morphline-sink and
also kite-morphlines-all. Retain backwards compat by retaining existing classes
in flume-ng-morphline-solr-sink, yet pointing them to extend or use relevant
things in flume-ng-morphline-sink
> Refactor to make room for Morphlines Elasticsearch Sink
> -------------------------------------------------------
>
> Key: FLUME-2340
> URL: https://issues.apache.org/jira/browse/FLUME-2340
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Reporter: Otis Gospodnetic
> Fix For: v1.5.0
>
>
> Right now there are some non-Solr-specific classes in
> org.apache.flume.sink.solr.morphline and everything assumes data will get
> loaded into Solr. This should be refactored to make it possible to use
> Morphlines and send data to Elasticsearch, too, for example.
> See
> http://search-hadoop.com/m/Jrb3G1tSCQK1&subj=Re+Questions+about+Morphline+Solr+Sink+structure
--
This message was sent by Atlassian JIRA
(v6.2#6252)
