GangYang-HX commented on issue #4521:
URL: https://github.com/apache/paimon/issues/4521#issuecomment-2475289753

   **Background**
   
![image](https://github.com/user-attachments/assets/b6a22705-1310-438a-b070-c7089448b68c)
   
![image](https://github.com/user-attachments/assets/a2332d02-d4a3-47cb-922d-40d1ce4b9c7b)
   Here, each thread maintains a set of field information separately. If 
different threads process the same field one after another, the shema change 
check will be triggered. In this case, the latest schame information will be 
frequently obtained, resulting in a decrease in the overall throughput of the 
task, which will cause subsequent exceptions such as checkpoint failure.
   
   **Solution**
   Maintain a state cache for the latest shema information to avoid direct 
access to the file system.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to