[
https://issues.apache.org/jira/browse/FLUME-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399343#comment-13399343
]
Hudson commented on FLUME-1301:
-------------------------------
Integrated in flume-trunk #249 (See
[https://builds.apache.org/job/flume-trunk/249/])
FLUME-1301. HDFSCompressedDataStream can lose data.
(Mike Percy via Hari Shreedharan) (Revision 1352766)
Result = SUCCESS
hshreedharan : http://svn.apache.org/viewvc/?view=rev&rev=1352766
Files :
*
/incubator/flume/trunk/flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSCompressedDataStream.java
*
/incubator/flume/trunk/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSCompressedDataStream.java
*
/incubator/flume/trunk/flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSinkOnMiniCluster.java
> HDFSCompressedDataStream can lose data
> --------------------------------------
>
> Key: FLUME-1301
> URL: https://issues.apache.org/jira/browse/FLUME-1301
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources
> Affects Versions: v1.1.0
> Reporter: Mike Percy
> Assignee: Mike Percy
> Priority: Blocker
> Fix For: v1.2.0
>
> Attachments: FLUME-1301-2.patch
>
>
> HDFSCompressedDataStream currently uses flush() to flush the compressed
> streams. Unfortunately, in at least Snappy and GZip, those operations are
> no-ops. So we have to go back to using finish() in order to ensure the
> durability of writes at Transaction boundaries.
> In addition to finish(), resetState() must be called.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
