Andrew Wong created KUDU-3055:
---------------------------------

             Summary: Lazily open cold tablets
                 Key: KUDU-3055
                 URL: https://issues.apache.org/jira/browse/KUDU-3055
             Project: Kudu
          Issue Type: New Feature
          Components: master, tablet, tserver
            Reporter: Andrew Wong


It might be useful in larger deployments to have the ability to lazily 
bootstrap cold tablets.

Currently, WAL replay consumes a significant amount of bootstrapping time. If 
we know certain tablets are read infrequently, we ought to be able to indicate 
that we only want to bootstrap and replay the WALs for tablets that have been 
accessed recently.

[This patch|https://github.com/apache/kudu/commit/ca957fb] gave us a metric for 
hotness and coldness at the replica level -- we might want to consider 
aggregating this on the master to determine what partitions are hot and cold, 
and have the master signal to the appropriate tablet servers upon registering 
that certain replicas should be bootstrapped. We might also consider 
bootstrapping when a client first calls {{OpenTable()}}.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to