[PR] [core] Optimize FileChannelManager.close with concurrent file deletion [paimon]

[via GitHub]

yunfengzhou-hub opened a new pull request, #5764:
URL: https://github.com/apache/paimon/pull/5764

   ### Purpose
   
   In a Flink job that writes to Paimon on Alibaba cloud, the user found out 
that it takes relatively long time for the Flink job to finish or be cancelled. 
Looking into the stack trace of the subtask, we discovered that the Paimon 
operator is busy deleting its temporary files in the closing process.
   
![image](https://github.com/user-attachments/assets/b9192b01-d005-4a21-841a-8b41e4e536e8)
   
![image](https://github.com/user-attachments/assets/fa75344c-714c-405b-b743-1e28d03aacdd)
   
   Therefore, this PR proposes to execute temporary file deletions concurrently 
to reduce the closing time of Paimon operators in cases like above.
   
   ### Tests
   
   <!-- List UT and IT cases to verify this change -->
   
   ### API and Format
   
   <!-- Does this change affect API or storage format -->
   
   ### Documentation
   
   <!-- Does this change introduce a new feature -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org