Also - if you're doing a text file read you can pass the number of resulting partitions as the second argument. On Oct 17, 2014 9:05 PM, "Larry Liu" <larryli...@gmail.com> wrote:
> Thanks, Andrew. What about reading out of local? > > On Fri, Oct 17, 2014 at 5:38 PM, Andrew Ash <and...@andrewash.com> wrote: > >> When reading out of HDFS it's the HDFS block size. >> >> On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu <larryli...@gmail.com> wrote: >> >>> What is the default input split size? How to change it? >>> >> >> >
