I am not sure if this works, but SparkContext seems to have hadoopFile and hadoopRDD methods which can accept Hadoop Input formats. If you have an InputFormat with isSplittable false, maybe it works?
Best Regards, Sonal Nube Technologies <http://www.nubetech.co> <http://in.linkedin.com/in/sonalgoyal> On Sat, Oct 18, 2014 at 11:29 AM, Davies Liu <dav...@databricks.com> wrote: > You can call coalesce() to merge the small splits into bigger ones. > > Davies > > On Fri, Oct 17, 2014 at 5:35 PM, Larry Liu <larryli...@gmail.com> wrote: > > Is it possible to disable input split if input is already small? > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
