[ 
https://issues.apache.org/jira/browse/FLUME-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532758#comment-13532758
 ] 

Brock Noland commented on FLUME-1735:
-------------------------------------

Hi,

Let me know what you think about the attached patch. It looks for a plugin.d 
directory in FLUME_HOME. Each plugin (subdirectory) could have up to three sub 
directories, lib (plugin itself), libext (libs for the plugin), and native 
(.so's).


{noformat}
$ find plugins.d
plugins.d
plugins.d/custom-source-0
plugins.d/custom-source-0/lib
plugins.d/custom-source-0/libext
plugins.d/custom-source-1
plugins.d/custom-source-1/lib
plugins.d/custom-source-1/lib/custom.jar
plugins.d/custom-source-1/native
{noformat}

which results in the following command:

{noformat}
java -Xmx20m -cp 
'/Users/noland/tmp/FLUME-1735-POC-0/apache-flume-1.4.0-SNAPSHOT-bin/lib/*:/Users/noland/tmp/FLUME-1735-POC-0/apache-flume-1.4.0-SNAPSHOT-bin/plugins.d/custom-source-0/lib/*:/Users/noland/tmp/FLUME-1735-POC-0/apache-flume-1.4.0-SNAPSHOT-bin/plugins.d/custom-source-1/lib/*:/Users/noland/tmp/FLUME-1735-POC-0/apache-flume-1.4.0-SNAPSHOT-bin/plugins.d/custom-source-0/libext/*:/opt/local/hadoop....
 
-Djava.library.path=/Users/noland/tmp/FLUME-1735-POC-0/apache-flume-1.4.0-SNAPSHOT-bin/plugins.d/custom-source-1/native:/opt/local/hadoop...
{noformat}

If that looks good I can add documentation to the patch.
                
> Add support for a plugins.d directory
> -------------------------------------
>
>                 Key: FLUME-1735
>                 URL: https://issues.apache.org/jira/browse/FLUME-1735
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Mike Percy
>            Assignee: Brock Noland
>             Fix For: v1.4.0
>
>         Attachments: FLUME-1735-0.patch
>
>
> It would be nice to have a directory, called something like plugins.d, which 
> had the following structure:
> {noformat}
> flume/
>   bin/
>   conf/
>   lib/
>   plugins.d/
>     custom-source-1/
>       custom-source-1-base.jar
>       custom-source-1-ext.jar
>     custom-interceptor-2/
>       custom-interceptor-2-main.jar
>       custom-interceptor-2-lib.jar
> {noformat}
> This would make it easy for users to easily install new plugins (sources, 
> sinks, interceptors, etc) and in the case of some conflict, they can easily 
> be differentiated and moved out of the include path. This helps with 
> management and debugging of plugin issues, and avoids the current requirement 
> for users to add these plugins to their FLUME_CLASSPATH.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to