Sachin Gupta created FLUME-1668:
-----------------------------------

             Summary: Hdfs Sink File Rollover
                 Key: FLUME-1668
                 URL: https://issues.apache.org/jira/browse/FLUME-1668
             Project: Flume
          Issue Type: Bug
          Components: Sinks+Sources
         Environment: Centos 
            Reporter: Sachin Gupta
            Priority: Critical
             Fix For: v1.2.0


With HDFS Sink with following config , files are rolling after every 510 bytes 

Hadoop Environment : 1.0.0

Flume-Ng - 1.2.0

Config below 

yum.sinks.ad-error-sink.type=hdfs
yum.sinks.ad-erorr-sink.hdfs.timeZone=UTC
yum.sinks.ad-error-sink.hdfs.path=hdfs://10.16.1.156:9000/home/data/flume-data/ad-error
yum.sinks.ad-error-sink.hdfs.filePrefix=aderror
yum.sinks.ad-error-sink.hdfs.fileType=DataStream
yum.sinks.ad-error-sink.hdfs.writeFormat=Text
yum.sinks.ad-error.sink.hdfs.rollInterval=0
yum.sinks.ad-error.sink.hdfs.rollSize=134217728
yum.sinks.ad-error.sink.hdfs.rollCount=0


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to