Re: Multiple dir support : newApiHadoopFile

2015-06-26 Thread Ted Yu 
See this related thread:
http://search-hadoop.com/m/q3RTtiYm8wgHego1

On Fri, Jun 26, 2015 at 9:43 AM, Bahubali Jain bahub...@gmail.com wrote:


 Hi,
 How do we read files from multiple directories using newApiHadoopFile () ?

 Thanks,
 Baahu
 --
 Twitter:http://twitter.com/Baahu

Re: Multiple dir support : newApiHadoopFile

2015-06-26 Thread Eugen Cepoi 
Comma separated paths works only with spark 1.4 and up

2015-06-26 18:56 GMT+02:00 Eugen Cepoi cepoi.eu...@gmail.com:

 You can comma separate them or use globbing patterns

 2015-06-26 18:54 GMT+02:00 Ted Yu yuzhih...@gmail.com:

 See this related thread:
 http://search-hadoop.com/m/q3RTtiYm8wgHego1

 On Fri, Jun 26, 2015 at 9:43 AM, Bahubali Jain bahub...@gmail.com
 wrote:


 Hi,
 How do we read files from multiple directories using newApiHadoopFile ()
 ?

 Thanks,
 Baahu
 --
 Twitter:http://twitter.com/Baahu

Re: Multiple dir support : newApiHadoopFile

2015-06-26 Thread Eugen Cepoi 
You can comma separate them or use globbing patterns

2015-06-26 18:54 GMT+02:00 Ted Yu yuzhih...@gmail.com:

 See this related thread:
 http://search-hadoop.com/m/q3RTtiYm8wgHego1

 On Fri, Jun 26, 2015 at 9:43 AM, Bahubali Jain bahub...@gmail.com wrote:


 Hi,
 How do we read files from multiple directories using newApiHadoopFile () ?

 Thanks,
 Baahu
 --
 Twitter:http://twitter.com/Baahu