Alexey Serbin created KUDU-3531:
-----------------------------------

             Summary: Limit the amount of resources used by tombstoned tablet 
replicas
                 Key: KUDU-3531
                 URL: https://issues.apache.org/jira/browse/KUDU-3531
             Project: Kudu
          Issue Type: Improvement
            Reporter: Alexey Serbin


I came across a case where a tablet server has just about 2K tablet replicas, 
but it opened about 24K files in its WAL and data directories.  The issue stems 
from the fact that tobmstoned tablet replica's files are opened by the FS 
manager as well, and those are kept open even if they are never about to change 
or receive any Raft updates.  It would be prudent to avoid keeping tombstoned 
tablet replicas' files open, if possible: maybe, just read the require 
information (last voted term and opId index?) and keep it in runtime 
structures, but close corresponding files right after bootstrapping?

Otherwise, this doesn't seem to scale well.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to