Hi Chiru, The operator FileSplitter is not created for reading a file. The main purpose of this operator is to split the file virtually (create block metadata) so that downstream operators like BlockReader can process a single file in parallel.
For your purpose you can do one of the following: 1. Use AbstractFileInputOperator 2. Use FileSplitter in conjunction with BlockReader. The last block of the BlockMetadata has isLastBlock flag set with which you can detect EOF. Chandni On Tue, Oct 13, 2015 at 5:47 AM, Priyanka Gugale <[email protected]> wrote: > Hi Chiru, > > There is no direct way to detect EOF using FileSplitter. > I will suggest following options to achieve this: > 1. You can modify FileSplitter code to send special tuple which indicates > EOF. > 2. Add one operator which tracks tuples from FileSplitter and detects EOF > (The operator needs to receive file metadata as well to detect EOF). > > In case using FIleSPlitter is not must in your case, you can use > AbstractFileInputOperator. > > -Priyanka > > > On Mon, Oct 12, 2015 at 9:05 PM, amol kekre <[email protected]> wrote: > > > > > > > +dev@apex > > > > Amol > > > > > > On Fri, Oct 9, 2015 at 6:03 AM, Chiru <[email protected]> wrote: > > > >> Hi All, > >> > >> How i can find the entire file read when using the FileSplitter.I have > to > >> wait till the EOF then start processing. > >> > >> Please share sample code if possible. > >> > >> Thanks -Chiru > >> > >> -- > >> You received this message because you are subscribed to the Google > Groups > >> "Malhar" group. > >> To unsubscribe from this group and stop receiving emails from it, send > an > >> email to [email protected]. > >> To post to this group, send email to [email protected]. > >> Visit this group at http://groups.google.com/group/malhar-users. > >> For more options, visit https://groups.google.com/d/optout. > >> > > > > -- > > You received this message because you are subscribed to the Google Groups > > "Malhar" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [email protected]. > > To post to this group, send email to [email protected]. > > Visit this group at http://groups.google.com/group/malhar-users. > > For more options, visit https://groups.google.com/d/optout. > > >
