[
https://issues.apache.org/jira/browse/FLUME-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13634633#comment-13634633
]
Mike Percy commented on FLUME-2003:
-----------------------------------
Hi Thiruvalluvan, fair points. OK let's do this:
1. For these new properties that are literally HDFS properties overriding the
behavior in the hdfs-site.xml config file, let's come up with a convention to
name them according to their HDFS config property names. For example, instead
of "hdfs.bufferSize" let's call it "hdfs.hdfsIoFileBufferSize", because the
property in hdfs-site.xml is "io.file.buffer.size". Please do the same for the
other two also.
2. Please add an implementation of this feature for the
{{CompressedDataStream}} class as well.
3. Please document these new parameters in the [user
guide|http://flume.apache.org/FlumeUserGuide.html] under the HDFS Sink section.
The source file is at
[flume-ng-doc/sphinx/FlumeUserGuide.rst|https://git-wip-us.apache.org/repos/asf?p=flume.git;a=blob;f=flume-ng-doc/sphinx/FlumeUserGuide.rst;hb=trunk]
Finally, please also post your patch on http://reviews.apache.org/groups/Flume
for easier review and link to it here. The source repository to use is
flume-git. Details here:
https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
> It'll be nice if we can control the HDFS block-size and replication for
> specific HDFS-sink instances
> ----------------------------------------------------------------------------------------------------
>
> Key: FLUME-2003
> URL: https://issues.apache.org/jira/browse/FLUME-2003
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Reporter: Thiruvalluvan M. G.
> Fix For: v1.4.0
>
> Attachments: FLUME-2003.patch
>
>
> The forthcoming patch provides that functionality.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
