Re: input split size

>>> Also - if you're doing a text file read you can pass the number of >>> resulting partitions as the second argument. >>> On Oct 17, 2014 9:05 PM, "Larry Liu" >> > wrote: >>> >>>> Thanks, Andrew. What about reading out of local? >>>> >>>> On Fri, Oct 17, 2014 at 5:38 PM, Andrew Ash >>> > wrote: >>>> >>>>> When reading out of HDFS it's the HDFS block size. >>>>> >>>>> On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu >>>> > wrote: >>>>> >>>>>> What is the default input split size? How to change it? >>>>>> >>>>> >>>>> >>>> >> >

Re: input split size

t;> >>> On Fri, Oct 17, 2014 at 5:38 PM, Andrew Ash >>> wrote: >>> >>>> When reading out of HDFS it's the HDFS block size. >>>> >>>> On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu >>>> wrote: >>>> >>>>> What is the default input split size? How to change it? >>>>> >>>> >>>> >>> >

Re: input split size

s, Andrew. What about reading out of local? >> >> On Fri, Oct 17, 2014 at 5:38 PM, Andrew Ash wrote: >> >>> When reading out of HDFS it's the HDFS block size. >>> >>> On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu wrote: >>> >>>> What is the default input split size? How to change it? >>>> >>> >>> >>

Re: input split size

>> When reading out of HDFS it's the HDFS block size. >> >> On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu wrote: >> >>> What is the default input split size? How to change it? >>> >> >> >

Re: input split size

Thanks, Andrew. What about reading out of local? On Fri, Oct 17, 2014 at 5:38 PM, Andrew Ash wrote: > When reading out of HDFS it's the HDFS block size. > > On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu wrote: > >> What is the default input split size? How to change it? >> > >

Re: input split size

When reading out of HDFS it's the HDFS block size. On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu wrote: > What is the default input split size? How to change it? >

input split size

What is the default input split size? How to change it?