Ranadip created HADOOP-9188:
-------------------------------
Summary: FileUtil.CopyMerge can support optional headers and
footers when merging files
Key: HADOOP-9188
URL: https://issues.apache.org/jira/browse/HADOOP-9188
Project: Hadoop Common
Issue Type: Improvement
Reporter: Ranadip
Similar to addString - which is added at the end of each merged file - there
should be the option to add some rows of header strings and footer strings
globally at the beginning and end of the single merged file.
Background: My experience has been that this method is mostly used to aggregate
part-files into a single file that can be sent, for example, as a data feed
file or a report to business customers. In such cases there is often a
requirement to provide header and footer rows - with headers describing the
schema of the data and the footers (or even headers in some cases) containing
stats like total counts, bad record counts, etc. Along with [#HADOOP-9187], I
have found myself replicating this method to add these features at least in 3
different use cases.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
