Hadoop Distributed Caching Technology

2014-10-20 Thread Maity, Debashish
Hi, Is there a way to use some other cache technology instead of memcache which is out of box in Hadoop Map-Reduce jobs. Cheers, Deb

Re: Hadoop Distributed Caching Technology

2014-10-20 Thread Andrew Wang
Hi Deb, We added support for centralized cache management to HDFS, which is out of the box and works with MR jobs. See the docs here: http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html Best, Andrew On Mon, Oct 20, 2014 at 8:07 AM, Maity,

RE: Hadoop Distributed Caching Technology

2014-10-20 Thread Maity, Debashish
So how I am going to change to other cache technology like Hazelcast or ehcache etc. -Original Message- From: Andrew Wang [mailto:andrew.w...@cloudera.com] Sent: Monday, October 20, 2014 8:52 PM To: common-dev@hadoop.apache.org Subject: Re: Hadoop Distributed Caching Technology Hi

Re: Hadoop Distributed Caching Technology

2014-10-20 Thread Sandy Ryza
@hadoop.apache.org Subject: Re: Hadoop Distributed Caching Technology Hi Deb, We added support for centralized cache management to HDFS, which is out of the box and works with MR jobs. See the docs here: http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs