Did you try implementing MultipleTextOutputFormat and use SaveAsHadoopFile
with keyClass, valueClass and OutputFormat instead of default parameters?
You need to implement toString for your keyClass and ValueClass inorder to
get field separator other than defaults.
Regards
Dhaval
On Tue, Jun 28,
Hi,
i have some files in the hdfs with FS as field separator and RS as record
separator, i am able to read the files and able to process successfully.
how can i write the spark DataFrame result into the HDFS file with same
delimeters (FS as field separator and RS as record separator instead of \n)
Hi,
i have some files in the hdfs with FS as field separator and RS as record
separator, i am able to read the files and able to process successfully.
how can i write the spark DataFrame result into the HDFS file with same
delimeters (FS as field separator and RS as record separator instead of \n)
