[
https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-4949:
------------------------------
Attachment: hdfs-4949-branch-2.patch
Attached is a consolidated patch for branch-2. Unfortunately we left the
HDFS-4949 branch fallow while development continued in trunk, but I did my best
to squash all of the caching-related patches committed thus far into this mega
patch. A preliminary test run of HDFS and Common looked good, but I'm running
another right now on this version of the patch to verify.
> Centralized cache management in HDFS
> ------------------------------------
>
> Key: HDFS-4949
> URL: https://issues.apache.org/jira/browse/HDFS-4949
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: datanode, namenode
> Affects Versions: 3.0.0, 2.4.0
> Reporter: Andrew Wang
> Assignee: Andrew Wang
> Attachments: HDFS-4949-consolidated.patch,
> caching-design-doc-2013-07-02.pdf, caching-design-doc-2013-08-09.pdf,
> caching-design-doc-2013-10-24.pdf, caching-testplan.pdf,
> hdfs-4949-branch-2.patch
>
>
> HDFS currently has no support for managing or exposing in-memory caches at
> datanodes. This makes it harder for higher level application frameworks like
> Hive, Pig, and Impala to effectively use cluster memory, because they cannot
> explicitly cache important datasets or place their tasks for memory locality.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
