subject:"How to disable input split"

Re: How to disable input split

2014-10-18 Thread Sonal Goyal

I am not sure if this works, but SparkContext seems to have hadoopFile and hadoopRDD methods which can accept Hadoop Input formats. If you have an InputFormat with isSplittable false, maybe it works? Best Regards, Sonal Nube Technologies

Re: How to disable input split

2014-10-17 Thread Davies Liu

You can call coalesce() to merge the small splits into bigger ones. Davies On Fri, Oct 17, 2014 at 5:35 PM, Larry Liu wrote: > Is it possible to disable input split if input is already small? - To unsubscribe, e-mail: user-unsu

How to disable input split

2014-10-17 Thread Larry Liu

Is it possible to disable input split if input is already small?