[ 
https://issues.apache.org/jira/browse/KUDU-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Grant Henke updated KUDU-2057:
------------------------------
    Component/s: compaction

> Dynamic budget for DRS compactions
> ----------------------------------
>
>                 Key: KUDU-2057
>                 URL: https://issues.apache.org/jira/browse/KUDU-2057
>             Project: Kudu
>          Issue Type: Improvement
>          Components: compaction, tablet
>            Reporter: Jean-Daniel Cryans
>            Priority: Major
>
> Clusters have busier and quieter periods, so by default Kudu leverages the 
> latter to schedule compactions because during the former it's mostly flushing.
> A further improvement would be to somehow recognize that a tserver is mostly 
> scheduling DRS compactions and to start giving them bigger and bigger 
> budgets. Compacting more DRSes at a time lowers the overall write 
> amplification, by running the risk of compacting for too long and not be able 
> to schedule important flushes. We could lower the risk by re-adding an 
> emergency flush thread, and/or making it possible to cancel tasks.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to