Alexey Serbin has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/19197


Change subject: KUDU-3406: add --memory_flush_prioritization_prob flag
......................................................................

KUDU-3406: add --memory_flush_prioritization_prob flag

WIP:
  * add a basic test to check the settings for 1.0 and 0.0

This patch introduces a new control knob to address KUDU-3406.  This
is rather a quick fix for the issue: set the flag to something lower
than 1.0 (e.g., 0.8) if the issue manifests itself in a busy Kudu
cluster.

The default value for the flag is currently set to 1.0 to preserve
the legacy behavior.

A proper long-term fix might include:
  * refactoring the implementation of CompactRowSetsOp to avoid
    allocating the memory for all the rowset's deltas at once
  * accounting for the amount of memory needed for a performance
    improvement operation, so if it's close to the amount of memory
    left before hitting the hard memory limit, prefer the operation
    over memory flushing operations even if under memory pressure

Change-Id: I07e33bcebe7284da20e57dfbc9d87070f92fd6f3
---
M src/kudu/util/maintenance_manager.cc
1 file changed, 56 insertions(+), 13 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/97/19197/1
--
To view, visit http://gerrit.cloudera.org:8080/19197
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I07e33bcebe7284da20e57dfbc9d87070f92fd6f3
Gerrit-Change-Number: 19197
Gerrit-PatchSet: 1
Gerrit-Owner: Alexey Serbin <[email protected]>

Reply via email to