http://docs.datatorrent.com/operators/file_splitter/
Also documented in the Configuration section of the above document. Ram On Wed, Jan 27, 2016 at 9:14 AM, Sandeep Deshmukh <[email protected]> wrote: > You can use blocksThreshold for this purpose. Here is the relevant java doc > > /** > * This is a threshold on the no. of blocks emitted per window. A lot of > blocks emitted > * per window can overwhelm the downstream operators. This setting helps to > control that. > */ > @Min(1) > protected int blocksThreshold; > > Source: > > https://github.com/apache/incubator-apex-malhar/blob/master/library/src/main/java/com/datatorrent/lib/io/fs/FileSplitter.java > > Regards, > Sandeep > > On Wed, Jan 27, 2016 at 10:36 PM, Kottapalli, Venkatesh < > [email protected]> wrote: > > > Hi, > > > > Is there a way to limit the number of blocks that > > filesplitter emits per window? > > > > I have a custom reader that would read data from the > > blocks, I am looking for a way to adjust the speed of filesplitter to > that > > of the reader so that reader would require less resources to process the > > blocks. > > > > Please suggest. > > > > -Venkatesh. > > >
