rdhan (CWM-NR)" <
suryavamshivardhan.mukkam...@rbc.com> wrote:
> Hi,
>
> Can you please let me know, How would I add multiple directories to an
> Operator which extends ‘AbstractFileInputOperator’?
>
> I would like to read from multiple directories by a single operator b
, Priyanka Gugale <priya...@datatorrent.com>
wrote:
> Hi,
>
> Take a look at TimeBasedDirectoryScanner in FileSplitterInput, this
> scanner accepts list of files/directories to scan. Also it accepts regex to
> filter on file names. I think you can pick ides on how to scan multip
Hi,
Take a look at TimeBasedDirectoryScanner in FileSplitterInput, this scanner
accepts list of files/directories to scan. Also it accepts regex to filter
on file names. I think you can pick ides on how to scan multiple
directories from there.
-Priyanka
On Thu, Jul 7, 2016 at 6:59 PM, Mukkamula
Hi,
Can you please let me know, How would I add multiple directories to an Operator
which extends 'AbstractFileInputOperator'?
I would like to read from multiple directories by a single operator by
selecting multiple files using 'filePatternRegExp'.
Regards,
Surya Vamshi
Hi,
Thank you so much Ram, it worked !!
Regards,
Surya Vamshi
From: Munagala Ramanath [mailto:r...@datatorrent.com]
Sent: 2016, June, 28 4:12 PM
To: users@apex.apache.org
Subject: Re: Reading Multiple directories in parallel
The return collection should match the function return type:
List
193c1c by jenkins source checksum
> 48db4b572827c2e9c2da66982d14
>
> 7626",
>
> "resourceManagerVersion": "2.7.1.2.3.2.0-2950",
>
>"resourceManagerVersionBuiltOn": "2015-09-30T18:20Z",
>
> "rmStateStoreName&quo
Hi Ram,
Assuming that properties are set as Key,Value pairs. I have used the properties
as below and I can read the multiple directories in parallel. Thank you.
dt.application.FileIO.operator.read.prop.inputDirectory(source_123)
tmp/fileIO/source_123
