Dear All,
Is there any way to copy the intermediate output file of the mapper
into local folder after each map task complete.
Right now I am using
FileSystem.copyToLocalFile(hdfsLocation,localLocation);
indiste the cleanup of mapper task , but it is failing .
Exception file not found.
But if I am giving same statement after the job complete in driver class
,it is working fine. that i dont want.
protected void cleanup(Context context){
FileSystem.copyToLocalFile(hdfsLocation,localLocation);//failed
}
Note: I need to copy the inter mediate output of the mapper to local file
system just after each map task complete. I dont want any reducer.
If this is not the right solution then how to solve this type of
scenario.
Any help.............
regards,
samir.