fuckingcodingisshit opened a new issue, #5318:
URL: https://github.com/apache/seatunnel/issues/5318

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   使用sftp作为sink数据源,上游source数据已写入临时文件,但在rename文件时报错,以及我的作业脚本配置是否正确
   
   ### SeaTunnel Version
   
   2.3.2
   
   ### SeaTunnel Config
   
   ```conf
   "transform" : [
           {
               "query" : "SELECT name AS name FROM source_temp_table",
               "result_table_name" : "sink_temp_table",
               "source_table_name" : "source_temp_table",
               "plugin_name" : "Sql"
           }
       ],
       "sink" : [
           {
               "sink_columns" : [
                   "name"
               ],
               "host" : "10.XX.XX.226",
               "port" : 22,
               "user" : "axxx",
               "password" : "toxxxx023",
               "path" : "/data01/sync_test",
               "file_format_type" : "text",
               "row_delimiter" : "\n",
               "field_delimiter" : ",",
               "skip_header_row_number" : 1,
               "source_table_name" : "sink_temp_table",
               "plugin_name" : "SftpFile",
               "type" : "text"
           }
       ],
       "source" : [
           {
               "driver" : "com.aliyun.odps.jdbc.OdpsDriver",
               "query" : "SELECT * FROM sync_sink_test",
               "url" : 
"jdbc:odps:http://service.cn-hangzhou.maxcompute.aliyun.com/api?project=dm_v2";,
               "plugin_name" : "Jdbc",
               "user" : "LTAI5g39PcdZUosH8iS9",
               "password" : "c6eniXBeSQVK9Rh95eXuUBmvLf",
               "connection_check_timeout_sec" : 100,
               "result_table_name" : "source_temp_table",
               "type" : "odps"
           }
       ],
       "env" : {
           "job.name" : "b94e94275b994304857f9b94e6b6ad19"
       }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   "transform" : [
           {
               "query" : "SELECT name AS name FROM source_temp_table",
               "result_table_name" : "sink_temp_table",
               "source_table_name" : "source_temp_table",
               "plugin_name" : "Sql"
           }
       ],
       "sink" : [
           {
               "sink_columns" : [
                   "name"
               ],
               "host" : "10.XX.XX.226",
               "port" : 22,
               "user" : "axxx",
               "password" : "toxxxx023",
               "path" : "/data01/sync_test",
               "file_format_type" : "text",
               "row_delimiter" : "\n",
               "field_delimiter" : ",",
               "skip_header_row_number" : 1,
               "source_table_name" : "sink_temp_table",
               "plugin_name" : "SftpFile",
               "type" : "text"
           }
       ],
       "source" : [
           {
               "driver" : "com.aliyun.odps.jdbc.OdpsDriver",
               "query" : "SELECT * FROM sync_sink_test",
               "url" : 
"jdbc:odps:http://service.cn-hangzhou.maxcompute.aliyun.com/api?project=dm_v2";,
               "plugin_name" : "Jdbc",
               "user" : "LTAI5g39PcdZUosH8iS9",
               "password" : "c6eniXBeSQVK9Rh95eXuUBmvLf",
               "connection_check_timeout_sec" : 100,
               "result_table_name" : "source_temp_table",
               "type" : "odps"
           }
       ],
       "env" : {
           "job.name" : "b94e94275b994304857f9b94e6b6ad19"
       }
   }
   ```
   
   
   ### Error Exception
   
   ```log
   2023-08-16 15:36:54,872 ERROR 
org.apache.seatunnel.connectors.seatunnel.file.sink.commit.FileSinkAggregatedCommitter
 - commit aggregatedCommitInfo error, aggregatedCommitInfo = 
FileAggregatedCommitInfo(transactionMap={/tmp/seatunnel/seatunnel/744097110248390657/6473b95eda/T_744097110248390657_6473b95eda_0_1={/tmp/seatunnel/seatunnel/744097110248390657/6473b95eda/T_744097110248390657_6473b95eda_0_1/NON_PARTITION/T_744097110248390657_6473b95eda_0_1_0.txt=/data01/sync_test/T_744097110248390657_6473b95eda_0_1_0.txt}},
 partitionDirAndValuesMap={}) 
   
org.apache.seatunnel.connectors.seatunnel.file.exception.FileConnectorException:
 ErrorCode:[COMMON-01], ErrorDescription:[File operation failed, such as 
(read,list,write,move,copy,sync) etc...] - rename file 
:[/tmp/seatunnel/seatunnel/744097110248390657/6473b95eda/T_744097110248390657_6473b95eda_0_1/NON_PARTITION/T_744097110248390657_6473b95eda_0_1_0.txt]
 to [/data01/sync_test/T_744097110248390657_6473b95eda_0_1_0.txt] error
        at 
org.apache.seatunnel.connectors.seatunnel.file.sink.util.FileSystemUtils.renameFile(FileSystemUtils.java:170)
 ~[connector-file-sftp-2.3.1.jar:2.3.1]
        at 
org.apache.seatunnel.connectors.seatunnel.file.sink.commit.FileSinkAggregatedCommitter.lambda$commit$0(FileSinkAggregatedCommitter.java:52)
 ~[connector-file-sftp-2.3.1.jar:2.3.1]
        at java.util.ArrayList.forEach(ArrayList.java:1249) ~[?:1.8.0_60]
        at 
org.apache.seatunnel.connectors.seatunnel.file.sink.commit.FileSinkAggregatedCommitter.commit(FileSinkAggregatedCommitter.java:44)
 ~[connector-file-sftp-2.3.1.jar:2.3.1]
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   spark2
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   
![image](https://github.com/apache/seatunnel/assets/89760837/83f9b1fc-286a-4253-af95-ad11b91c17bf)
   
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to