[
https://issues.apache.org/jira/browse/HADOOP-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jothi Padmanabhan updated HADOOP-3638:
--------------------------------------
Release Note: Implements the caching of the IFile index files in memory,
both at the map side (merging spill files) and at the task tracker (serving map
outputs to the reducers). The cache at the task tracker is bounded by the
configurable entry "mapred.tasktracker.indexcache.mb". The LRC (Least Recently
Created) Algorithm is used to maintain the cache in bounds.
> Cache the iFile index files in memory to reduce seeks during map output
> serving
> -------------------------------------------------------------------------------
>
> Key: HADOOP-3638
> URL: https://issues.apache.org/jira/browse/HADOOP-3638
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: Devaraj Das
> Assignee: Jothi Padmanabhan
> Fix For: 0.19.0
>
> Attachments: hadoop-3638-v1.patch, hadoop-3638-v10.patch,
> hadoop-3638-v2.patch, hadoop-3638-v3.patch, hadoop-3638-v4.patch,
> hadoop-3638-v5.patch, hadoop-3638-v6.patch, hadoop-3638-v7.patch,
> hadoop-3638-v8.patch, hadoop-3638-v9.patch
>
>
> The iFile index files can be cached in memory to reduce seeks during map
> output serving.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
