Hi We have a custom build to read directories recursively, Currently we use it with fileStream like:
val lines = ssc.fileStream[LongWritable, Text, TextInputFormat]("/datadumps/", (t: Path) => true, true, *true*) Making the 4th argument true to read recursively. You could give it a try https://s3.amazonaws.com/sigmoidanalytics-builds/spark-1.2.0-bin-spark-1.2.0-hadoop2.4.0.tgz Thanks Best Regards On Wed, Mar 11, 2015 at 9:45 PM, Masf <masfwo...@gmail.com> wrote: > Hi all > > Is it possible to read recursively folders to read parquet files? > > > Thanks. > > -- > > > Saludos. > Miguel Ángel >