Hi, Please keep [email protected] in your further mails.
We do cache lastModifiedTime of file and do a check if the file modification time is latest than the cached time when we scan next time. You can take a look in FileSplitter code. "skipFile" method does the time comparison. So if file is not updated, it should not get scanned again. Can you put some debug statements and check if there is some problem with retrieving time samp etc? Your file is on HDFS or any other file system? -Priyanka On Wednesday, October 14, 2015 at 6:07:04 PM UTC+5:30, Chiru wrote: > > Hi Priyanka, > > It was a static file i have given. wile running the application it is > reading it again. > > Thanks-Chiru > > On Wednesday, 14 October 2015 16:44:14 UTC+5:30, Chiru wrote: >> >> Hi All, >> >> Iam reading a file from the directory using FileSplitter, but it is >> reading the same file again and again. >> -> Is there a way to restrict FileSplitter to read the same file again? >> >> Thanks - Chiru >> >
