GitHub user dossett opened a pull request:
https://github.com/apache/storm/pull/1044
STORM-1494: Support multiple file outputs
This PR will enable storm-hdfs to write to multiple files in a couple of
different circumstances:
- If a bolt requires multiple output files. For example, the avro bolt
needs to write different Avro records with different schemas to different
files. Schema evolution is a common use of Avro so I expect this to be common
use.
- Partitioning output of the HDFS bolt. Based on mailing discussion, there
is demand for this feature.
It does introduce a couple of incompatible changes. The most obvious is
adding a method to the FileRotationPolicy interface. I tried to minimize other
API changes at the expense of some less than elegant code in a couple of places.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dossett/storm STORM-1494
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/1044.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1044
----
commit 4e16d7a60771155a9c294e43c7c0db7bcebed646
Author: Aaron Dossett <aaron.doss...@target.com>
Date: 2016-01-25T23:12:57Z
STORM-1494: Support multiple file outputs
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
