Andrew Wong created KUDU-2278:
---------------------------------

             Summary: Improve IO for writing deltas
                 Key: KUDU-2278
                 URL: https://issues.apache.org/jira/browse/KUDU-2278
             Project: Kudu
          Issue Type: Improvement
          Components: cfile, tablet
            Reporter: Andrew Wong


Today, writing new deltas entails rewriting entire tablet metadata files in 
order to track the newly-created block ids. Even if the delta were on the order 
of kilobytes, the tablet metadata files could be on the order of megabytes, so 
the relative cost for this small amount of data is quite high, considering the 
amount of the metadata.

This could be improved by batching such delta flushes, or by revamping tablet 
metadata entirely to batch any operations that require metadata updates.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to