I have 10 files..I debugged the code and it seems that there's a loop in
the FileInputFormat when files are nested far away from the root directory
of the scan
On Tue, May 26, 2015 at 2:14 PM, Robert Metzger rmetz...@apache.org wrote:
Hi Flavio,
how many files are in the directory?
You can
Yes, there is a loop to recursively search for files in directory but that
should be ok. The code fails when adding a new InputSplit to an ArrayList.
This is a standard operation.
Oh, I think I found a bug in `addNestedFiles`. It does not pick up the
length of the recursively found files in line
Yeap, that definitively solves the problem! Could you make a PR to fix
that..?
Thank you in advance,
Flavio
On Tue, May 26, 2015 at 3:20 PM, Maximilian Michels m...@apache.org wrote:
Yes, there is a loop to recursively search for files in directory but that
should be ok. The code fails when
Pushed a fix to the master and will open a PR to programmatically fix this.
On Tue, May 26, 2015 at 4:22 PM, Flavio Pompermaier pomperma...@okkam.it
wrote:
Yeap, that definitively solves the problem! Could you make a PR to fix
that..?
Thank you in advance,
Flavio
On Tue, May 26, 2015 at
