btw, just to let you know that I am running my job in a pseudo-distributed mode.

Thanks,

Neeral




________________________________
From: neeral beladia <[email protected]>
To: [email protected]
Sent: Tue, May 31, 2011 10:00:00 PM
Subject: DistributedCache - getLocalCacheFiles method returns null

Hi,

I have a file on amazon aws under :

s3n://<Access Key>:<Secret Key>@<Bucket Name>/file.txt

I want this file to be accessible by the slave nodes via Distributed Cache.

I put the following after the job configuration statements in the Driver 
program 

:

DistributedCache.addCacheFile(new Path("s3n://<Access Key>:<Secret Key>@<Bucket 
Name>/file.txt").toUri(), job.getConfiguration());

Also in my setup method in the mapper class, I have the below statement :
Path[] cacheFiles = 
DistributedCache.getLocalCacheFiles(context.getConfiguration());

cacheFiles is gettng assigned null.

Could you please let me know what I am doing wrong here ? The file does exist 
on 

S3.

Thanks,

Neeral

Reply via email to