Not quite sure if I got your question. These tidbits may help though, from what I can understand:
* LocalFileSystem's listing uses Java's APIs for file/dir listing, and has no concept of what a hidden file is on its own. It retrieves the whole list. * MR's FileInputFormat (and normal derivatives) does filter away "." and "_" starting path names, from added input paths to the job. On Wed, Apr 3, 2013 at 3:09 AM, Mohammad Tariq <[email protected]> wrote: > > Warm Regards, > Tariq > https://mtariq.jux.com/ > cloudfront.blogspot.com > > > ---------- Forwarded message ---------- > From: Mohammad Tariq <[email protected]> > Date: Tue, Apr 2, 2013 at 5:16 PM > Subject: MapReduce on Local files > To: [email protected] > > > Hello list, > > Is a MR job capable of reading even the hidden temp files present > inside a directory located on my local FS?I have noticed this thing today > for the first time because till now I never tried running MR jobs on local > files. > > Thank you so much for your time? > > Warm Regards, > Tariq > https://mtariq.jux.com/ > cloudfront.blogspot.com > -- Harsh J
