http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/configuration_reference.html ---------------------------------------------------------------------- diff --git a/docs/configuration_reference.html b/docs/configuration_reference.html index f027ee5..59b3e6d 100644 --- a/docs/configuration_reference.html +++ b/docs/configuration_reference.html @@ -2,7 +2,7 @@ title: Apache Kudu Configuration Reference layout: default active_nav: docs -last_updated: 'Last updated 2017-05-15 12:46:02 PDT' +last_updated: 'Last updated 2017-06-13 10:50:35 PDT' --- <!-- @@ -1297,6 +1297,35 @@ considered final, and while they may be useful for tuning, they are subject to being changed or removed without notice.</p> </div> <div class="sect3"> +<h4 id="kudu-master_cfile_verify_checksums"><a class="link" href="#kudu-master_cfile_verify_checksums"><code>--cfile_verify_checksums</code></a></h4> +<div class="paragraph"> +<p>Verify the checksum for each block on read if one exists</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-master_cfile_default_block_size"><a class="link" href="#kudu-master_cfile_default_block_size"><code>--cfile_default_block_size</code></a></h4> <div class="paragraph"> <p>The default block size to use in cfiles</p> @@ -1355,9 +1384,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_fault_crash_after_leader_request_fraction"><a class="link" href="#kudu-master_fault_crash_after_leader_request_fraction"><code>--fault_crash_after_leader_request_fraction</code></a></h4> +<h4 id="kudu-master_cfile_write_checksums"><a class="link" href="#kudu-master_cfile_write_checksums"><code>--cfile_write_checksums</code></a></h4> <div class="paragraph"> -<p>Fraction of the time when the leader will crash on getting a response for an UpdateConsensus RPC. (For testing only!)</p> +<p>Write CRC32 checksums for each block</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1367,15 +1396,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -1384,9 +1413,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_raft_get_node_instance_timeout_ms"><a class="link" href="#kudu-master_raft_get_node_instance_timeout_ms"><code>--raft_get_node_instance_timeout_ms</code></a></h4> +<h4 id="kudu-master_consensus_rpc_timeout_ms"><a class="link" href="#kudu-master_consensus_rpc_timeout_ms"><code>--consensus_rpc_timeout_ms</code></a></h4> <div class="paragraph"> -<p>Timeout for retrieving node instance data over RPC.</p> +<p>Timeout used for all consensus internal RPC communications.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1400,11 +1429,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -1545,7 +1574,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1676,7 +1705,7 @@ being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-master_log_segment_size_mb"><a class="link" href="#kudu-master_log_segment_size_mb"><code>--log_segment_size_mb</code></a></h4> <div class="paragraph"> -<p>The default segment size for log roll-overs, in MB</p> +<p>The default size for log segments, in MB</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1690,7 +1719,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>64</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>8</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1821,7 +1850,7 @@ being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-master_block_manager_max_open_files"><a class="link" href="#kudu-master_block_manager_max_open_files"><code>--block_manager_max_open_files</code></a></h4> <div class="paragraph"> -<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit.</p> +<p>Maximum number of open file descriptors to be used for data blocks. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit. It is an error to use a value of 0.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1935,6 +1964,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-master_log_container_excess_space_before_cleanup_fraction"><a class="link" href="#kudu-master_log_container_excess_space_before_cleanup_fraction"><code>--log_container_excess_space_before_cleanup_fraction</code></a></h4> +<div class="paragraph"> +<p>Additional fraction of a log container’s calculated size that must be consumed on disk before the container is considered to be inconsistent and subject to excess space cleanup at block manager startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.10000000000000001</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-master_log_container_max_blocks"><a class="link" href="#kudu-master_log_container_max_blocks"><code>--log_container_max_blocks</code></a></h4> <div class="paragraph"> <p>Maximum number of blocks (soft) of a log container. Use 0 for no limit. Use -1 for no limit except in the case of a kernel bug with hole punching on ext4 (see KUDU-1508 for details).</p> @@ -2444,7 +2502,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>15000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>3000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -2544,6 +2602,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-master_trusted_subnets"><a class="link" href="#kudu-master_trusted_subnets"><code>--trusted_subnets</code></a></h4> +<div class="paragraph"> +<p>A trusted subnet whitelist. If set explicitly, all unauthenticated or unencrypted connections are prohibited except the ones from the specified address blocks. Otherwise, private network (127.0.0.0/8, etc.) and local subnets of all local network interfaces will be used. Set it to '0.0.0.0/0' to allow unauthenticated/unencrypted connections from all remote IP addresses. However, if network access is not otherwise restricted by a firewall, malicious users may be able to gain unauthorized access.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>127.0.0.0/8,10.0.0.0/8,172.16.0.0/12,192.168.0.0/16,169.254.0.0/16</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-master_rpc_max_message_size"><a class="link" href="#kudu-master_rpc_max_message_size"><code>--rpc_max_message_size</code></a></h4> <div class="paragraph"> <p>The maximum size of a message that any RPC that the server will accept. Must be at least 1MB.</p> @@ -2689,6 +2776,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-master_rpc_advertised_addresses"><a class="link" href="#kudu-master_rpc_advertised_addresses"><code>--rpc_advertised_addresses</code></a></h4> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for RPC connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound RPC addresses specified in --rpc_bind_addresses are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-master_rpc_num_acceptors_per_address"><a class="link" href="#kudu-master_rpc_num_acceptors_per_address"><code>--rpc_num_acceptors_per_address</code></a></h4> <div class="paragraph"> <p>Number of RPC acceptor threads for each bound address</p> @@ -2979,6 +3095,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-master_webserver_advertised_addresses"><a class="link" href="#kudu-master_webserver_advertised_addresses"><code>--webserver_advertised_addresses</code></a></h4> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for HTTP(S) connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound webserver address specified in --webserver_interface and --webserver_port are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-master_webserver_authentication_domain"><a class="link" href="#kudu-master_webserver_authentication_domain"><code>--webserver_authentication_domain</code></a></h4> <div class="paragraph"> <p>Domain used for debug webserver authentication</p> @@ -3735,7 +3880,7 @@ being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-master_redact"><a class="link" href="#kudu-master_redact"><code>--redact</code></a></h4> <div class="paragraph"> -<p>Comma-separated list of redactions. Supported redactions are 'flag', 'log' and 'all'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted.</p> +<p>Comma-separated list of redactions. Supported options are 'flag', 'log', 'all', and 'none'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted. If 'none' is specified, no redaction will occur.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3791,9 +3936,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h4> +<h4 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h4> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> +<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3807,11 +3952,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> </tr> </tbody> </table> @@ -3820,9 +3965,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h4> +<h4 id="kudu-master_enable_minidumps"><a class="link" href="#kudu-master_enable_minidumps"><code>--enable_minidumps</code></a></h4> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> +<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3832,15 +3977,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> </tr> </tbody> </table> @@ -3849,9 +3994,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h4> +<h4 id="kudu-master_max_minidumps"><a class="link" href="#kudu-master_max_minidumps"><code>--max_minidumps</code></a></h4> <div class="paragraph"> -<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +<p>Maximum number of minidump files to keep per daemon. Older files are removed first. Set to 0 to keep all minidump files.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3865,11 +4010,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>9</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -3878,9 +4023,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h4> +<h4 id="kudu-master_minidump_path"><a class="link" href="#kudu-master_minidump_path"><code>--minidump_path</code></a></h4> <div class="paragraph"> -<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> +<p>Directory to write minidump files to. This can be either an absolute path or a path relative to --log_dir. Each daemon will create an additional sub-directory to prevent naming conflicts and to make it easier to identify a crashing daemon. Minidump files contain crash-related information in a compressed format. Minidumps will be written when a daemon exits unexpectedly, for example on an unhandled exception or signal, or when a SIGUSR1 signal is sent to the process. Cannot be set to an empty value.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3890,15 +4035,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>minidumps</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -3907,9 +4052,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_enable_minidumps"><a class="link" href="#kudu-master_enable_minidumps"><code>--enable_minidumps</code></a></h4> +<h4 id="kudu-master_minidump_size_limit_hint_kb"><a class="link" href="#kudu-master_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h4> <div class="paragraph"> -<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> +<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3919,11 +4064,11 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -3936,9 +4081,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_max_minidumps"><a class="link" href="#kudu-master_max_minidumps"><code>--max_minidumps</code></a></h4> +<h4 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h4> <div class="paragraph"> -<p>Maximum number of minidump files to keep per daemon. Older files are removed first. Set to 0 to keep all minidump files.</p> +<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3952,11 +4097,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>9</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -3965,9 +4110,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_minidump_path"><a class="link" href="#kudu-master_minidump_path"><code>--minidump_path</code></a></h4> +<h4 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h4> <div class="paragraph"> -<p>Directory to write minidump files to. This can be either an absolute path or a path relative to --log_dir. Each daemon will create an additional sub-directory to prevent naming conflicts and to make it easier to identify a crashing daemon. Minidump files contain crash-related information in a compressed format. Minidumps will be written when a daemon exits unexpectedly, for example on an unhandled exception or signal, or when a SIGUSR1 signal is sent to the process. Cannot be set to an empty value.</p> +<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3977,15 +4122,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>minidumps</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -3994,9 +4139,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-master_minidump_size_limit_hint_kb"><a class="link" href="#kudu-master_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h4> +<h4 id="kudu-master_memory_pressure_percentage"><a class="link" href="#kudu-master_memory_pressure_percentage"><code>--memory_pressure_percentage</code></a></h4> <div class="paragraph"> -<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> +<p>Percentage of the hard memory limit that this daemon may consume before flushing of in-memory data becomes prioritized.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4010,11 +4155,40 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> +<h4 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h4> +<div class="paragraph"> +<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -4126,7 +4300,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>5</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -4137,19 +4311,48 @@ being changed or removed without notice.</p> <div class="paragraph"> <p> </p> </div> -<hr> -</div> -</div> -</div> </div> -<div class="sect1"> -<h2 id="kudu-tserver_supported"><a class="link" href="#kudu-tserver_supported"><code>kudu-tserver</code> Flags</a></h2> -<div class="sectionbody"> -<div class="sect2"> -<h3 id="kudu-tserver_stable"><a class="link" href="#kudu-tserver_stable">Stable Flags</a></h3> +<div class="sect3"> +<h4 id="kudu-master_logfile_mode"><a class="link" href="#kudu-master_logfile_mode"><code>--logfile_mode</code></a></h4> <div class="paragraph"> -<p>Flags tagged <code>stable</code> and not <code>advanced</code> are safe to use for common -configuration tasks.</p> +<p>Log file mode/permissions.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>436</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +<hr> +</div> +</div> +</div> +</div> +<div class="sect1"> +<h2 id="kudu-tserver_supported"><a class="link" href="#kudu-tserver_supported"><code>kudu-tserver</code> Flags</a></h2> +<div class="sectionbody"> +<div class="sect2"> +<h3 id="kudu-tserver_stable"><a class="link" href="#kudu-tserver_stable">Stable Flags</a></h3> +<div class="paragraph"> +<p>Flags tagged <code>stable</code> and not <code>advanced</code> are safe to use for common +configuration tasks.</p> </div> <div class="sect3"> <h4 id="kudu-tserver_block_cache_capacity_mb"><a class="link" href="#kudu-tserver_block_cache_capacity_mb"><code>--block_cache_capacity_mb</code></a></h4> @@ -5414,6 +5617,35 @@ considered final, and while they may be useful for tuning, they are subject to being changed or removed without notice.</p> </div> <div class="sect3"> +<h4 id="kudu-tserver_cfile_verify_checksums"><a class="link" href="#kudu-tserver_cfile_verify_checksums"><code>--cfile_verify_checksums</code></a></h4> +<div class="paragraph"> +<p>Verify the checksum for each block on read if one exists</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-tserver_cfile_default_block_size"><a class="link" href="#kudu-tserver_cfile_default_block_size"><code>--cfile_default_block_size</code></a></h4> <div class="paragraph"> <p>The default block size to use in cfiles</p> @@ -5472,9 +5704,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_fault_crash_after_leader_request_fraction"><a class="link" href="#kudu-tserver_fault_crash_after_leader_request_fraction"><code>--fault_crash_after_leader_request_fraction</code></a></h4> +<h4 id="kudu-tserver_cfile_write_checksums"><a class="link" href="#kudu-tserver_cfile_write_checksums"><code>--cfile_write_checksums</code></a></h4> <div class="paragraph"> -<p>Fraction of the time when the leader will crash on getting a response for an UpdateConsensus RPC. (For testing only!)</p> +<p>Write CRC32 checksums for each block</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5484,15 +5716,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -5501,9 +5733,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_raft_get_node_instance_timeout_ms"><a class="link" href="#kudu-tserver_raft_get_node_instance_timeout_ms"><code>--raft_get_node_instance_timeout_ms</code></a></h4> +<h4 id="kudu-tserver_consensus_rpc_timeout_ms"><a class="link" href="#kudu-tserver_consensus_rpc_timeout_ms"><code>--consensus_rpc_timeout_ms</code></a></h4> <div class="paragraph"> -<p>Timeout for retrieving node instance data over RPC.</p> +<p>Timeout used for all consensus internal RPC communications.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5517,11 +5749,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -5662,7 +5894,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -5793,7 +6025,7 @@ being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-tserver_log_segment_size_mb"><a class="link" href="#kudu-tserver_log_segment_size_mb"><code>--log_segment_size_mb</code></a></h4> <div class="paragraph"> -<p>The default segment size for log roll-overs, in MB</p> +<p>The default size for log segments, in MB</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5807,7 +6039,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>64</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>8</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -5938,7 +6170,7 @@ being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-tserver_block_manager_max_open_files"><a class="link" href="#kudu-tserver_block_manager_max_open_files"><code>--block_manager_max_open_files</code></a></h4> <div class="paragraph"> -<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit.</p> +<p>Maximum number of open file descriptors to be used for data blocks. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit. It is an error to use a value of 0.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6052,6 +6284,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-tserver_log_container_excess_space_before_cleanup_fraction"><a class="link" href="#kudu-tserver_log_container_excess_space_before_cleanup_fraction"><code>--log_container_excess_space_before_cleanup_fraction</code></a></h4> +<div class="paragraph"> +<p>Additional fraction of a log container’s calculated size that must be consumed on disk before the container is considered to be inconsistent and subject to excess space cleanup at block manager startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.10000000000000001</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-tserver_log_container_max_blocks"><a class="link" href="#kudu-tserver_log_container_max_blocks"><code>--log_container_max_blocks</code></a></h4> <div class="paragraph"> <p>Maximum number of blocks (soft) of a log container. Use 0 for no limit. Use -1 for no limit except in the case of a kernel bug with hole punching on ext4 (see KUDU-1508 for details).</p> @@ -6329,7 +6590,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>15000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>3000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -6429,6 +6690,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-tserver_trusted_subnets"><a class="link" href="#kudu-tserver_trusted_subnets"><code>--trusted_subnets</code></a></h4> +<div class="paragraph"> +<p>A trusted subnet whitelist. If set explicitly, all unauthenticated or unencrypted connections are prohibited except the ones from the specified address blocks. Otherwise, private network (127.0.0.0/8, etc.) and local subnets of all local network interfaces will be used. Set it to '0.0.0.0/0' to allow unauthenticated/unencrypted connections from all remote IP addresses. However, if network access is not otherwise restricted by a firewall, malicious users may be able to gain unauthorized access.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>127.0.0.0/8,10.0.0.0/8,172.16.0.0/12,192.168.0.0/16,169.254.0.0/16</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-tserver_rpc_max_message_size"><a class="link" href="#kudu-tserver_rpc_max_message_size"><code>--rpc_max_message_size</code></a></h4> <div class="paragraph"> <p>The maximum size of a message that any RPC that the server will accept. Must be at least 1MB.</p> @@ -6574,6 +6864,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-tserver_rpc_advertised_addresses"><a class="link" href="#kudu-tserver_rpc_advertised_addresses"><code>--rpc_advertised_addresses</code></a></h4> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for RPC connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound RPC addresses specified in --rpc_bind_addresses are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-tserver_rpc_num_acceptors_per_address"><a class="link" href="#kudu-tserver_rpc_num_acceptors_per_address"><code>--rpc_num_acceptors_per_address</code></a></h4> <div class="paragraph"> <p>Number of RPC acceptor threads for each bound address</p> @@ -6864,6 +7183,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> +<h4 id="kudu-tserver_webserver_advertised_addresses"><a class="link" href="#kudu-tserver_webserver_advertised_addresses"><code>--webserver_advertised_addresses</code></a></h4> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for HTTP(S) connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound webserver address specified in --webserver_interface and --webserver_port are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> <h4 id="kudu-tserver_webserver_authentication_domain"><a class="link" href="#kudu-tserver_webserver_authentication_domain"><code>--webserver_authentication_domain</code></a></h4> <div class="paragraph"> <p>Domain used for debug webserver authentication</p> @@ -7620,7 +7968,7 @@ being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-tserver_redact"><a class="link" href="#kudu-tserver_redact"><code>--redact</code></a></h4> <div class="paragraph"> -<p>Comma-separated list of redactions. Supported redactions are 'flag', 'log' and 'all'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted.</p> +<p>Comma-separated list of redactions. Supported options are 'flag', 'log', 'all', and 'none'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted. If 'none' is specified, no redaction will occur.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7676,9 +8024,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_memory_limit_soft_percentage"><a class="link" href="#kudu-tserver_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h4> +<h4 id="kudu-tserver_metrics_retirement_age_ms"><a class="link" href="#kudu-tserver_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h4> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> +<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7692,11 +8040,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> </tr> </tbody> </table> @@ -7705,9 +8053,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-tserver_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h4> +<h4 id="kudu-tserver_enable_minidumps"><a class="link" href="#kudu-tserver_enable_minidumps"><code>--enable_minidumps</code></a></h4> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> +<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7717,15 +8065,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> </tr> </tbody> </table> @@ -7734,9 +8082,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-tserver_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h4> +<h4 id="kudu-tserver_max_minidumps"><a class="link" href="#kudu-tserver_max_minidumps"><code>--max_minidumps</code></a></h4> <div class="paragraph"> -<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +<p>Maximum number of minidump files to keep per daemon. Older files are removed first. Set to 0 to keep all minidump files.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7750,11 +8098,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>9</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -7763,9 +8111,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_metrics_retirement_age_ms"><a class="link" href="#kudu-tserver_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h4> +<h4 id="kudu-tserver_minidump_path"><a class="link" href="#kudu-tserver_minidump_path"><code>--minidump_path</code></a></h4> <div class="paragraph"> -<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> +<p>Directory to write minidump files to. This can be either an absolute path or a path relative to --log_dir. Each daemon will create an additional sub-directory to prevent naming conflicts and to make it easier to identify a crashing daemon. Minidump files contain crash-related information in a compressed format. Minidumps will be written when a daemon exits unexpectedly, for example on an unhandled exception or signal, or when a SIGUSR1 signal is sent to the process. Cannot be set to an empty value.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7775,15 +8123,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>minidumps</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -7792,9 +8140,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_enable_minidumps"><a class="link" href="#kudu-tserver_enable_minidumps"><code>--enable_minidumps</code></a></h4> +<h4 id="kudu-tserver_minidump_size_limit_hint_kb"><a class="link" href="#kudu-tserver_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h4> <div class="paragraph"> -<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> +<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7804,11 +8152,11 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -7821,9 +8169,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_max_minidumps"><a class="link" href="#kudu-tserver_max_minidumps"><code>--max_minidumps</code></a></h4> +<h4 id="kudu-tserver_memory_limit_soft_percentage"><a class="link" href="#kudu-tserver_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h4> <div class="paragraph"> -<p>Maximum number of minidump files to keep per daemon. Older files are removed first. Set to 0 to keep all minidump files.</p> +<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7837,11 +8185,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>9</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -7850,9 +8198,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_minidump_path"><a class="link" href="#kudu-tserver_minidump_path"><code>--minidump_path</code></a></h4> +<h4 id="kudu-tserver_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-tserver_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h4> <div class="paragraph"> -<p>Directory to write minidump files to. This can be either an absolute path or a path relative to --log_dir. Each daemon will create an additional sub-directory to prevent naming conflicts and to make it easier to identify a crashing daemon. Minidump files contain crash-related information in a compressed format. Minidumps will be written when a daemon exits unexpectedly, for example on an unhandled exception or signal, or when a SIGUSR1 signal is sent to the process. Cannot be set to an empty value.</p> +<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7862,15 +8210,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>minidumps</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -7879,9 +8227,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_minidump_size_limit_hint_kb"><a class="link" href="#kudu-tserver_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h4> +<h4 id="kudu-tserver_memory_pressure_percentage"><a class="link" href="#kudu-tserver_memory_pressure_percentage"><code>--memory_pressure_percentage</code></a></h4> <div class="paragraph"> -<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> +<p>Percentage of the hard memory limit that this daemon may consume before flushing of in-memory data becomes prioritized.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7895,11 +8243,40 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> +<h4 id="kudu-tserver_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-tserver_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h4> +<div class="paragraph"> +<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -7937,9 +8314,38 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_log_backtrace_at"><a class="link" href="#kudu-tserver_log_backtrace_at"><code>--log_backtrace_at</code></a></h4> +<h4 id="kudu-tserver_log_backtrace_at"><a class="link" href="#kudu-tserver_log_backtrace_at"><code>--log_backtrace_at</code></a></h4> +<div class="paragraph"> +<p>Emit a backtrace when logging at file:linenum.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect3"> +<h4 id="kudu-tserver_logbuflevel"><a class="link" href="#kudu-tserver_logbuflevel"><code>--logbuflevel</code></a></h4> <div class="paragraph"> -<p>Emit a backtrace when logging at file:linenum.</p> +<p>Buffer log messages logged at this level or lower (-1 means don’t buffer; 0 means buffer INFO only; …​)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7949,15 +8355,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">runtime,advanced</p></td> </tr> </tbody> </table> @@ -7966,9 +8372,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_logbuflevel"><a class="link" href="#kudu-tserver_logbuflevel"><code>--logbuflevel</code></a></h4> +<h4 id="kudu-tserver_logbufsecs"><a class="link" href="#kudu-tserver_logbufsecs"><code>--logbufsecs</code></a></h4> <div class="paragraph"> -<p>Buffer log messages logged at this level or lower (-1 means don’t buffer; 0 means buffer INFO only; …​)</p> +<p>Buffer log messages for at most this many seconds</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -7982,7 +8388,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>5</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -7995,9 +8401,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect3"> -<h4 id="kudu-tserver_logbufsecs"><a class="link" href="#kudu-tserver_logbufsecs"><code>--logbufsecs</code></a></h4> +<h4 id="kudu-tserver_logfile_mode"><a class="link" href="#kudu-tserver_logfile_mode"><code>--logfile_mode</code></a></h4> <div class="paragraph"> -<p>Buffer log messages for at most this many seconds</p> +<p>Log file mode/permissions.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -8011,11 +8417,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>436</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">runtime,advanced</p></td> +<td class="tableblock halign-left valign-top"></td> </tr> </tbody> </table> @@ -8285,35 +8691,9 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect3"> -<h4 id="kudu-master_fault_crash_after_leader_request_fraction"><a class="link" href="#kudu-master_fault_crash_after_leader_request_fraction"><code>--fault_crash_after_leader_request_fraction</code></a></h4> -<div class="paragraph"> -<p>Fraction of the time when the leader will crash on getting a response for an UpdateConsensus RPC. (For testing only!)</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> -</tr> -</tbody> -</table> -</div> -<div class="sect3"> -<h4 id="kudu-master_raft_get_node_instance_timeout_ms"><a class="link" href="#kudu-master_raft_get_node_instance_timeout_ms"><code>--raft_get_node_instance_timeout_ms</code></a></h4> +<h4 id="kudu-master_consensus_rpc_timeout_ms"><a class="link" href="#kudu-master_consensus_rpc_timeout_ms"><code>--consensus_rpc_timeout_ms</code></a></h4> <div class="paragraph"> -<p>Timeout for retrieving node instance data over RPC.</p> +<p>Timeout used for all consensus internal RPC communications.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -8327,11 +8707,11 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -8457,7 +8837,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -8483,7 +8863,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -8599,7 +8979,7 @@ subject to being changed or removed without notice.</p> <div class="sect3"> <h4 id="kudu-master_log_segment_size_mb"><a class="link" href="#kudu-master_log_segment_size_mb"><code>--log_segment_size_mb</code></a></h4> <div class="paragraph"> -<p>The default segment size for log roll-overs, in MB</p> +<p>The default size for log segments, in MB</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -8613,7 +8993,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>64</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>8</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -8935,6 +9315,58 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect3"> +<h4 id="kudu-master_log_container_excess_space_before_cleanup_fraction"><a class="link" href="#kudu-master_log_container_excess_space_before_cleanup_fraction"><code>--log_container_excess_space_before_cleanup_fraction</code></a></h4> +<div class="paragraph"> +<p>Additional fraction of a log container’s calculated size that must be consumed on disk before the container is considered to be inconsistent and subject to excess space cleanup at block manager startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.10000000000000001</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect3"> +<h4 id="kudu-master_log_container_live_metadata_before_compact_ratio"><a class="link" href="#kudu-master_log_container_live_metadata_before_compact_ratio"><code>--log_container_live_metadata_before_compact_ratio</code></a></h4> +<div class="paragraph"> +<p>Desired ratio of live block metadata in log containers. If a container’s live to total block ratio dips below this value, the container’s metadata file will be compacted at startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.5</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect3"> <h4 id="kudu-master_log_container_max_blocks"><a class="link" href="#kudu-master_log_container_max_blocks"><code>--log_container_max_blocks</code></a></h4> <div class="paragraph"> <p>Maximum number of blocks (soft) of a log container. Use 0 for no limit. Use -1 for no limit except in the case of a kernel bug with hole punching on ext4 (see KUDU-1508 for details).</p> @@ -9627,7 +10059,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>15000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>3000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -9897,6 +10329,32 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect3"> +<h4 id="kudu-master_rpc_advertised_addresses"><a class="link" href="#kudu-master_rpc_advertised_addresses"><code>--rpc_advertised_addresses</code></a></h4> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for RPC connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound RPC addresses specified in --rpc_bind_addresses are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect3"> <h4 id="kudu-master_rpc_num_acceptors_per_address"><a class="link" href="#kudu-master_rpc_num_acceptors_per_address"><code>--rpc_num_acceptors_per_address</code></a></h4> <div class="paragraph"> <p>Number of RPC acceptor threads for each bound address</p> @@ -10157,6 +10615,32 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect3"> +<h4 id="kudu-master_webserver_advertised_addresses"><a class="link" href="#kudu-master_webserver_advertised_addresses"><code>--webserver_advertised_addresses</code></a></h4> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for HTTP(S) connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound webserver address specified in --webserver_interface and --webserver_port are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect3"> <h4 id="kudu-master_webserver_authentication_domain"><a class="link" href="#kudu-master_webserver_authentication_domain"><code>--webserver_authentication_domain</code></a></h4> <div class="paragraph"> <p>Domain used for debug webserver authentication</p> @@ -11223,9 +11707,9 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect3"> -<h4 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h4> +<h4 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h4> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> +<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -11239,19 +11723,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> </tr> </tbody> </table> </div> <div class="sect3"> -<h4 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h4> +<h4 id="kudu-master_local_ip_for_outbound_sockets"><a class="link" href="#kudu-master_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h4> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> +<p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -11261,23 +11745,23 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect3"> -<h4 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h4> +<h4 id="kudu-master_nvm_cache_allocation_retry_count"><a class="link" href="#kudu-master_nvm_cache_allocation_retry_count"><code>--nvm_cache_allocation_retry_count</code></a></h4> <div class="paragraph"> -<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +<p>The number of times that the NVM cache will retry attempts to allocate memory for new entries. In between attempts, a cache entry will be evicted.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -11295,15 +11779,41 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect3"> -<h4 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h4> +<h4 id="kudu-master_nvm_cache_path"><a class="link" href="#kudu-master_nvm_cache_path"><code>--nvm_cache_path</code></a></h4> <div class="paragraph"> -<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> +<p>The path at which the NVM cache will try to allocate its memory. This can be a tmpfs or ramfs for testing purposes.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>/vmem</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect3"> +<h4 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h4> +<div class="paragraph"> +<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -11317,19 +11827,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect3"> -<h4 id="kudu-master_local_ip_for_outbound_sockets"><a class="link" href="#kudu-master_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h4> +<h4 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h4> <div class="paragraph"> -<p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> +<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -11339,23 +11849,23 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect3"> -<h4 id="kudu-master_nvm_cache_allocation_retry_count"><a class="link" href="#kudu-master_nvm_cache_allocation_retry_count"><code>--nvm_cache_allocation_retry_count</code></a></h4> +<h4 id="kudu-master_memory_pressure_percentage"><a class="link" href="#kudu-master_memory_pressure_percentage"><code>--memory_pressure_percentage</code></a></h4> <div class="paragraph"> -<p>The number of times that the NVM cache will retry attempts to allocate memory for new entries. In between attempts, a cache entry will be evicted.</p> +<p>Percentage of the hard memory limit that this daemon may consume before flushing of in-memory data becomes prioritized.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -11369,19 +11879,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tablebl
<TRUNCATED>
