You could use the org.apache.hadoop.filecache.DistributedCache API as: DistributedCache.addCacheFile(URI, job.getConfiguration());
On Sat, Nov 24, 2012 at 3:06 AM, Kartashov, Andy <andy.kartas...@mpac.ca> wrote: > Guys, > > > > I know that there is old and new API for MapReduce. The old API is found > under org.apache.hadoop.mapred and the new is under > org.apache.hadoop.mapreduce > > > > I successfully used both (the old and the new API) writing my MapReduce > drivers. > > > > The problem came up when I tried to use distributed cache. My new API Job > object could not locate > > public void addCacheFile(URI uri) method and I was scratching my head why. > > > > What I did not reaslise is that despite new and oold API there is also > Hadoop 0.20 vs Hadoop 2.0.0 APIs that use exact same packages. > > The old Hadoop.0.20.00 new Mapreduce API class Job simply doesn’t have that > method “addCacheFile(URI uri)”. > > > > I am running Hadoop 2.0.0. so could not understand why the method was not > inside the class. I ended up rewriting MR job under old API mapred package > and ran soccessfully. > > > > Can anyone shed some light on this? > > > > Thanks > > AK > > > > > > NOTICE: This e-mail message and any attachments are confidential, subject to > copyright and may be privileged. Any unauthorized use, copying or disclosure > is prohibited. If you are not the intended recipient, please delete and > contact the sender immediately. Please consider the environment before > printing this e-mail. AVIS : le présent courriel et toute pièce jointe qui > l'accompagne sont confidentiels, protégés par le droit d'auteur et peuvent > être couverts par le secret professionnel. Toute utilisation, copie ou > divulgation non autorisée est interdite. Si vous n'êtes pas le destinataire > prévu de ce courriel, supprimez-le et contactez immédiatement l'expéditeur. > Veuillez penser à l'environnement avant d'imprimer le présent courriel -- Harsh J