Write only one output file in Spark SQL

[KhajaAsmath Mohammed]

Hi,



I am using spark sql to write data back to hdfs and it is resulting in
multiple output files.



I tried changing number spark.sql.shuffle.partitions=1 but it resulted in
very slow performance.



Also tried coalesce and repartition still the same issue. any suggestions?



Thanks,

Asmath