Make index interval configuable when using MapFileOutputFormat for map-reduce
job
---------------------------------------------------------------------------------
Key: HADOOP-3152
URL: https://issues.apache.org/jira/browse/HADOOP-3152
Project: Hadoop Core
Issue Type: Bug
Components: io
Affects Versions: 0.16.0
Environment: ubuntu, 64bit, jdk1.6
Reporter: Rong-En Fan
Attachments: mapfile.diff
Per discussion with Doug Cutting on hadoop user mailing around Mar 21,
thread title "MapFile and MapFileOutputFormat". Currently, there is no way
to change the index interval for the output MapFile in a map-reduce job.
As suggested, adding a static method MapFile(Configuration, int) to set the
index interval and stores in Configuration, then MapFile.Writer constructor
reads the setting from configuration may be a good idea.
I also noticed that Hbase did similar things in HBASE-364.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
