fuckingcodingisshit opened a new issue, #5318: URL: https://github.com/apache/seatunnel/issues/5318
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 使用sftp作为sink数据源,上游source数据已写入临时文件,但在rename文件时报错,以及我的作业脚本配置是否正确 ### SeaTunnel Version 2.3.2 ### SeaTunnel Config ```conf "transform" : [ { "query" : "SELECT name AS name FROM source_temp_table", "result_table_name" : "sink_temp_table", "source_table_name" : "source_temp_table", "plugin_name" : "Sql" } ], "sink" : [ { "sink_columns" : [ "name" ], "host" : "10.XX.XX.226", "port" : 22, "user" : "axxx", "password" : "toxxxx023", "path" : "/data01/sync_test", "file_format_type" : "text", "row_delimiter" : "\n", "field_delimiter" : ",", "skip_header_row_number" : 1, "source_table_name" : "sink_temp_table", "plugin_name" : "SftpFile", "type" : "text" } ], "source" : [ { "driver" : "com.aliyun.odps.jdbc.OdpsDriver", "query" : "SELECT * FROM sync_sink_test", "url" : "jdbc:odps:http://service.cn-hangzhou.maxcompute.aliyun.com/api?project=dm_v2", "plugin_name" : "Jdbc", "user" : "LTAI5g39PcdZUosH8iS9", "password" : "c6eniXBeSQVK9Rh95eXuUBmvLf", "connection_check_timeout_sec" : 100, "result_table_name" : "source_temp_table", "type" : "odps" } ], "env" : { "job.name" : "b94e94275b994304857f9b94e6b6ad19" } } ``` ### Running Command ```shell "transform" : [ { "query" : "SELECT name AS name FROM source_temp_table", "result_table_name" : "sink_temp_table", "source_table_name" : "source_temp_table", "plugin_name" : "Sql" } ], "sink" : [ { "sink_columns" : [ "name" ], "host" : "10.XX.XX.226", "port" : 22, "user" : "axxx", "password" : "toxxxx023", "path" : "/data01/sync_test", "file_format_type" : "text", "row_delimiter" : "\n", "field_delimiter" : ",", "skip_header_row_number" : 1, "source_table_name" : "sink_temp_table", "plugin_name" : "SftpFile", "type" : "text" } ], "source" : [ { "driver" : "com.aliyun.odps.jdbc.OdpsDriver", "query" : "SELECT * FROM sync_sink_test", "url" : "jdbc:odps:http://service.cn-hangzhou.maxcompute.aliyun.com/api?project=dm_v2", "plugin_name" : "Jdbc", "user" : "LTAI5g39PcdZUosH8iS9", "password" : "c6eniXBeSQVK9Rh95eXuUBmvLf", "connection_check_timeout_sec" : 100, "result_table_name" : "source_temp_table", "type" : "odps" } ], "env" : { "job.name" : "b94e94275b994304857f9b94e6b6ad19" } } ``` ### Error Exception ```log 2023-08-16 15:36:54,872 ERROR org.apache.seatunnel.connectors.seatunnel.file.sink.commit.FileSinkAggregatedCommitter - commit aggregatedCommitInfo error, aggregatedCommitInfo = FileAggregatedCommitInfo(transactionMap={/tmp/seatunnel/seatunnel/744097110248390657/6473b95eda/T_744097110248390657_6473b95eda_0_1={/tmp/seatunnel/seatunnel/744097110248390657/6473b95eda/T_744097110248390657_6473b95eda_0_1/NON_PARTITION/T_744097110248390657_6473b95eda_0_1_0.txt=/data01/sync_test/T_744097110248390657_6473b95eda_0_1_0.txt}}, partitionDirAndValuesMap={}) org.apache.seatunnel.connectors.seatunnel.file.exception.FileConnectorException: ErrorCode:[COMMON-01], ErrorDescription:[File operation failed, such as (read,list,write,move,copy,sync) etc...] - rename file :[/tmp/seatunnel/seatunnel/744097110248390657/6473b95eda/T_744097110248390657_6473b95eda_0_1/NON_PARTITION/T_744097110248390657_6473b95eda_0_1_0.txt] to [/data01/sync_test/T_744097110248390657_6473b95eda_0_1_0.txt] error at org.apache.seatunnel.connectors.seatunnel.file.sink.util.FileSystemUtils.renameFile(FileSystemUtils.java:170) ~[connector-file-sftp-2.3.1.jar:2.3.1] at org.apache.seatunnel.connectors.seatunnel.file.sink.commit.FileSinkAggregatedCommitter.lambda$commit$0(FileSinkAggregatedCommitter.java:52) ~[connector-file-sftp-2.3.1.jar:2.3.1] at java.util.ArrayList.forEach(ArrayList.java:1249) ~[?:1.8.0_60] at org.apache.seatunnel.connectors.seatunnel.file.sink.commit.FileSinkAggregatedCommitter.commit(FileSinkAggregatedCommitter.java:44) ~[connector-file-sftp-2.3.1.jar:2.3.1] ``` ### Zeta or Flink or Spark Version spark2 ### Java or Scala Version _No response_ ### Screenshots  ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
