Hi Asmath, Could you share the code you're running?
Daniel On Fri, 11 Aug 2017, 17:53 KhajaAsmath Mohammed, <mdkhajaasm...@gmail.com> wrote: > Hi, > > > > I am using spark sql to write data back to hdfs and it is resulting in > multiple output files. > > > > I tried changing number spark.sql.shuffle.partitions=1 but it resulted in > very slow performance. > > > > Also tried coalesce and repartition still the same issue. any suggestions? > > > > Thanks, > > Asmath >