cxxiii opened a new issue, #3729:
URL: https://github.com/apache/amoro/issues/3729

   ### Search before asking
   
   - [x] I have searched in the 
[issues](https://github.com/apache/amoro/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### What would you like to be improved?
   
   The AMS inserts records into the optimizing_process_state table at the start 
of each optimizing process, including a memory-consuming rewriteInput field of 
type longblob. This field can consume significant storage, especially as the 
number of tasks increases.
   
   Upon investigation, we found that the rewriteInput field is only needed for 
restoring tables that were abnormally interrupted but remain in the optimizing 
state. Once the optimizing process is successfully completed, retaining this 
large field is unnecessary and leads to excessive storage consumption.
   
   Therefore, clearing this data after optimizing can help reduce storage usage 
and improve system performance.
   
   ### How should we improve?
   
   Remove unnecessary records in table optimizing_process_state when completing 
optimizing.
   
   ### Are you willing to submit PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Subtasks
   
   _No response_
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to