What is the use case of this? You will reduce performance significantly.
Nevertheless, the way you propose is the way to go, but I do not recommend it.

> On 20 Oct 2016, at 14:00, Ashan Taha <at...@currenex.com> wrote:
> 
> Hi
>  
> What’s the best way to make sure an Avro file is NOT Splitable when read in 
> Spark?
> Would you override the AvroKeyInputFormat.issplitable (to return false) and 
> then call this using newAPIHadoopRDD? Or is there a better way using the 
> sqlContext.read?
>  
> Thanks in advance

Reply via email to