[jira] [Updated] (KUDU-2278) Improve IO for writing deltas
[ https://issues.apache.org/jira/browse/KUDU-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KUDU-2278: -- Component/s: perf > Improve IO for writing deltas > - > > Key: KUDU-2278 > URL: https://issues.apache.org/jira/browse/KUDU-2278 > Project: Kudu > Issue Type: Improvement > Components: cfile, perf, tablet >Reporter: Andrew Wong >Priority: Major > > Today, writing new deltas entails rewriting entire tablet metadata files in > order to track the newly-created block ids. Even if the delta were on the > order of kilobytes, the tablet metadata files could be on the order of > megabytes, so the relative cost for this small amount of data is quite high, > considering the amount of the metadata. > This could be improved by batching such delta flushes, or by revamping tablet > metadata entirely to batch any operations that require metadata updates. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (KUDU-2278) Improve IO for writing deltas
[ https://issues.apache.org/jira/browse/KUDU-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KUDU-2278: -- Target Version/s: (was: 1.8.0) > Improve IO for writing deltas > - > > Key: KUDU-2278 > URL: https://issues.apache.org/jira/browse/KUDU-2278 > Project: Kudu > Issue Type: Improvement > Components: cfile, perf, tablet >Reporter: Andrew Wong >Priority: Major > > Today, writing new deltas entails rewriting entire tablet metadata files in > order to track the newly-created block ids. Even if the delta were on the > order of kilobytes, the tablet metadata files could be on the order of > megabytes, so the relative cost for this small amount of data is quite high, > considering the amount of the metadata. > This could be improved by batching such delta flushes, or by revamping tablet > metadata entirely to batch any operations that require metadata updates. -- This message was sent by Atlassian Jira (v8.3.4#803005)
