PenneyHuang commented on issue #5946:
URL: https://github.com/apache/seatunnel/issues/5946#issuecomment-1837927100
sink {
HdfsFile {
source_table_name = "access1"
hdfs_site_path = "/usr/hadoop/conf/hdfs-site.xml"
fs.defaultFS = "hdfs://testcluster"
path = "/warehouse/ods/ods__module__nd"
custom_filename = true
file_name_expression = "${transactionId}_${now}"
filename_time_format = "yyyy-MM-dd-HH.mm.ss"
file_format_type = "parquet"
field_delimiter = "\\001"
row_delimiter = "\n"
compress_codec = "snappy"
sink_columns = ["ID","Name"]
is_enable_transaction = true
save_mode="overwrite"
}
}
Every time, a new file is generated instead of overwriting the files in the
folder
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
