Hi Asmath,

Could you share the code you're running?

Daniel

On Fri, 11 Aug 2017, 17:53 KhajaAsmath Mohammed, <mdkhajaasm...@gmail.com>
wrote:

> Hi,
>
>
>
> I am using spark sql to write data back to hdfs and it is resulting in
> multiple output files.
>
>
>
> I tried changing number spark.sql.shuffle.partitions=1 but it resulted in
> very slow performance.
>
>
>
> Also tried coalesce and repartition still the same issue. any suggestions?
>
>
>
> Thanks,
>
> Asmath
>

Reply via email to