You should use FileStatus to decide what files you want to include in the InputPath, and use the FileSystem class to delete or process the intermediate / final paths. Moving each job in your iteration logic into different methods would help keep things simple.
From: unmesha sreeveni <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Monday, June 9, 2014 at 6:02 AM To: User Hadoop <[email protected]<mailto:[email protected]>> Subject: Re: Counters in MapReduce Ok I will check out with counters. And after I st iteration the input file to job1 will be the output file of job 3.How to give that. Inorder to satisfy 2 conditions First iteration : users input file after first iteration :job 3 's output file as job 1 s input. -- Thanks & Regards Unmesha Sreeveni U.B Hadoop, Bigdata Developer Center for Cyber Security | Amrita Vishwa Vidyapeetham http://www.unmeshasreeveni.blogspot.in/ ________________________________ Kai Voigt Am Germaniahafen 1 [email protected]<mailto:[email protected]> 24143 Kiel +49 160 96683050 Germany @KaiVoigt -- Thanks & Regards Unmesha Sreeveni U.B Hadoop, Bigdata Developer Center for Cyber Security | Amrita Vishwa Vidyapeetham http://www.unmeshasreeveni.blogspot.in/
