LompleZ opened a new pull request, #64224:
URL: https://github.com/apache/doris/pull/64224
Refactoring the code logic of the broker file system cache:
1. Use the compute method of concurrent hash map to ensure the atomicity of
fs file system cache and to ensure the ideal singleton running mode for a
single file system as much as possible
2. Ensure that fs is eliminated from the cache, but the fs being read will
not be shut down abnormally:
2.1 BrowserFileSystem adds input/output stream reference counting
function, operation counting increases references
2.2 Add a fs recycle bin mechanism where fs is not directly removed,but
is first placed in the recycle bin
2.3 Add Recycle Bin Cleanup Thread
3. The execution failure issue may be caused by the FS being phased out due
to the execution failure of thread A being referenced by thread B to run
commands.
close #64138
<img width="10714" height="8736" alt="架构图与OOM改造"
src="https://github.com/user-attachments/assets/1aed12c1-fbb1-4002-9c82-d120bf6cd53e";
/>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
