[
https://issues.apache.org/jira/browse/STORM-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Zowalla closed STORM-3698.
----------------------------------
Resolution: Won't Fix
Storm 1.x isn't maintained anymore.
> AbstractHdfsBolt does not sync Writers that are purged
> ------------------------------------------------------
>
> Key: STORM-3698
> URL: https://issues.apache.org/jira/browse/STORM-3698
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-hdfs
> Affects Versions: 1.2.2
> Reporter: Max Schmidt
> Priority: Critical
>
> We just discovered when using a SequenceFileBolt (although it might happen
> with other implementations as well) that the writers it uses, held in the map
> AbstractHdfsBolt.writers are not closed/synced when they are removed from the
> map by the removeEldestEntry method.
> This leads to data loss.
> Can be reproduced by creating a SequenceFileBolt.withMaxOpenFiles(1) and
> writing to just two different files.
> One will have a size of zero, the other has the data in it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)