http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/configuration_reference_unsupported.html b/docs/configuration_reference_unsupported.html index c8eb238..0eb87d7 100644 --- a/docs/configuration_reference_unsupported.html +++ b/docs/configuration_reference_unsupported.html @@ -2,7 +2,7 @@ title: Apache Kudu Unsupported Configuration Flags layout: default active_nav: docs -last_updated: 'Last updated 2017-05-15 12:46:02 PDT' +last_updated: 'Last updated 2017-06-13 10:50:35 PDT' --- <!-- @@ -285,35 +285,9 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> -<h3 id="kudu-master_fault_crash_after_leader_request_fraction"><a class="link" href="#kudu-master_fault_crash_after_leader_request_fraction"><code>--fault_crash_after_leader_request_fraction</code></a></h3> +<h3 id="kudu-master_consensus_rpc_timeout_ms"><a class="link" href="#kudu-master_consensus_rpc_timeout_ms"><code>--consensus_rpc_timeout_ms</code></a></h3> <div class="paragraph"> -<p>Fraction of the time when the leader will crash on getting a response for an UpdateConsensus RPC. (For testing only!)</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> -</tr> -</tbody> -</table> -</div> -<div class="sect2"> -<h3 id="kudu-master_raft_get_node_instance_timeout_ms"><a class="link" href="#kudu-master_raft_get_node_instance_timeout_ms"><code>--raft_get_node_instance_timeout_ms</code></a></h3> -<div class="paragraph"> -<p>Timeout for retrieving node instance data over RPC.</p> +<p>Timeout used for all consensus internal RPC communications.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -327,11 +301,11 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -457,7 +431,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -483,7 +457,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -599,7 +573,7 @@ subject to being changed or removed without notice.</p> <div class="sect2"> <h3 id="kudu-master_log_segment_size_mb"><a class="link" href="#kudu-master_log_segment_size_mb"><code>--log_segment_size_mb</code></a></h3> <div class="paragraph"> -<p>The default segment size for log roll-overs, in MB</p> +<p>The default size for log segments, in MB</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -613,7 +587,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>64</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>8</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -935,6 +909,58 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> +<h3 id="kudu-master_log_container_excess_space_before_cleanup_fraction"><a class="link" href="#kudu-master_log_container_excess_space_before_cleanup_fraction"><code>--log_container_excess_space_before_cleanup_fraction</code></a></h3> +<div class="paragraph"> +<p>Additional fraction of a log container’s calculated size that must be consumed on disk before the container is considered to be inconsistent and subject to excess space cleanup at block manager startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.10000000000000001</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_log_container_live_metadata_before_compact_ratio"><a class="link" href="#kudu-master_log_container_live_metadata_before_compact_ratio"><code>--log_container_live_metadata_before_compact_ratio</code></a></h3> +<div class="paragraph"> +<p>Desired ratio of live block metadata in log containers. If a container’s live to total block ratio dips below this value, the container’s metadata file will be compacted at startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.5</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_log_container_max_blocks"><a class="link" href="#kudu-master_log_container_max_blocks"><code>--log_container_max_blocks</code></a></h3> <div class="paragraph"> <p>Maximum number of blocks (soft) of a log container. Use 0 for no limit. Use -1 for no limit except in the case of a kernel bug with hole punching on ext4 (see KUDU-1508 for details).</p> @@ -1627,7 +1653,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>15000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>3000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1897,6 +1923,32 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> +<h3 id="kudu-master_rpc_advertised_addresses"><a class="link" href="#kudu-master_rpc_advertised_addresses"><code>--rpc_advertised_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for RPC connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound RPC addresses specified in --rpc_bind_addresses are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_rpc_num_acceptors_per_address"><a class="link" href="#kudu-master_rpc_num_acceptors_per_address"><code>--rpc_num_acceptors_per_address</code></a></h3> <div class="paragraph"> <p>Number of RPC acceptor threads for each bound address</p> @@ -2157,6 +2209,32 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> +<h3 id="kudu-master_webserver_advertised_addresses"><a class="link" href="#kudu-master_webserver_advertised_addresses"><code>--webserver_advertised_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for HTTP(S) connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound webserver address specified in --webserver_interface and --webserver_port are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_webserver_authentication_domain"><a class="link" href="#kudu-master_webserver_authentication_domain"><code>--webserver_authentication_domain</code></a></h3> <div class="paragraph"> <p>Domain used for debug webserver authentication</p> @@ -3223,9 +3301,9 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> -<h3 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h3> +<h3 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h3> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> +<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3239,19 +3317,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h3> +<h3 id="kudu-master_local_ip_for_outbound_sockets"><a class="link" href="#kudu-master_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h3> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> +<p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3261,23 +3339,23 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h3> +<h3 id="kudu-master_nvm_cache_allocation_retry_count"><a class="link" href="#kudu-master_nvm_cache_allocation_retry_count"><code>--nvm_cache_allocation_retry_count</code></a></h3> <div class="paragraph"> -<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +<p>The number of times that the NVM cache will retry attempts to allocate memory for new entries. In between attempts, a cache entry will be evicted.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3295,15 +3373,41 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h3> +<h3 id="kudu-master_nvm_cache_path"><a class="link" href="#kudu-master_nvm_cache_path"><code>--nvm_cache_path</code></a></h3> <div class="paragraph"> -<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> +<p>The path at which the NVM cache will try to allocate its memory. This can be a tmpfs or ramfs for testing purposes.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>/vmem</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h3> +<div class="paragraph"> +<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3317,19 +3421,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_local_ip_for_outbound_sockets"><a class="link" href="#kudu-master_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h3> +<h3 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h3> <div class="paragraph"> -<p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> +<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3339,23 +3443,23 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_nvm_cache_allocation_retry_count"><a class="link" href="#kudu-master_nvm_cache_allocation_retry_count"><code>--nvm_cache_allocation_retry_count</code></a></h3> +<h3 id="kudu-master_memory_pressure_percentage"><a class="link" href="#kudu-master_memory_pressure_percentage"><code>--memory_pressure_percentage</code></a></h3> <div class="paragraph"> -<p>The number of times that the NVM cache will retry attempts to allocate memory for new entries. In between attempts, a cache entry will be evicted.</p> +<p>Percentage of the hard memory limit that this daemon may consume before flushing of in-memory data becomes prioritized.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3369,19 +3473,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_nvm_cache_path"><a class="link" href="#kudu-master_nvm_cache_path"><code>--nvm_cache_path</code></a></h3> +<h3 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h3> <div class="paragraph"> -<p>The path at which the NVM cache will try to allocate its memory. This can be a tmpfs or ramfs for testing purposes.</p> +<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3391,15 +3495,15 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>/vmem</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -3499,7 +3603,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>5</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -3507,6 +3611,32 @@ subject to being changed or removed without notice.</p> </tr> </tbody> </table> +</div> +<div class="sect2"> +<h3 id="kudu-master_logfile_mode"><a class="link" href="#kudu-master_logfile_mode"><code>--logfile_mode</code></a></h3> +<div class="paragraph"> +<p>Log file mode/permissions.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>436</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"></td> +</tr> +</tbody> +</table> <hr> </div> </div> @@ -3754,35 +3884,9 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_fault_crash_after_leader_request_fraction"><a class="link" href="#kudu-tserver_fault_crash_after_leader_request_fraction"><code>--fault_crash_after_leader_request_fraction</code></a></h3> +<h3 id="kudu-tserver_consensus_rpc_timeout_ms"><a class="link" href="#kudu-tserver_consensus_rpc_timeout_ms"><code>--consensus_rpc_timeout_ms</code></a></h3> <div class="paragraph"> -<p>Fraction of the time when the leader will crash on getting a response for an UpdateConsensus RPC. (For testing only!)</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> -</tr> -</tbody> -</table> -</div> -<div class="sect2"> -<h3 id="kudu-tserver_raft_get_node_instance_timeout_ms"><a class="link" href="#kudu-tserver_raft_get_node_instance_timeout_ms"><code>--raft_get_node_instance_timeout_ms</code></a></h3> -<div class="paragraph"> -<p>Timeout for retrieving node instance data over RPC.</p> +<p>Timeout used for all consensus internal RPC communications.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3796,11 +3900,11 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -3926,7 +4030,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -3952,7 +4056,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -4068,7 +4172,7 @@ subject to being changed or removed without notice.</p> <div class="sect2"> <h3 id="kudu-tserver_log_segment_size_mb"><a class="link" href="#kudu-tserver_log_segment_size_mb"><code>--log_segment_size_mb</code></a></h3> <div class="paragraph"> -<p>The default segment size for log roll-overs, in MB</p> +<p>The default size for log segments, in MB</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4082,7 +4186,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>64</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>8</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -4404,6 +4508,58 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_log_container_excess_space_before_cleanup_fraction"><a class="link" href="#kudu-tserver_log_container_excess_space_before_cleanup_fraction"><code>--log_container_excess_space_before_cleanup_fraction</code></a></h3> +<div class="paragraph"> +<p>Additional fraction of a log container’s calculated size that must be consumed on disk before the container is considered to be inconsistent and subject to excess space cleanup at block manager startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.10000000000000001</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_log_container_live_metadata_before_compact_ratio"><a class="link" href="#kudu-tserver_log_container_live_metadata_before_compact_ratio"><code>--log_container_live_metadata_before_compact_ratio</code></a></h3> +<div class="paragraph"> +<p>Desired ratio of live block metadata in log containers. If a container’s live to total block ratio dips below this value, the container’s metadata file will be compacted at startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.5</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_log_container_max_blocks"><a class="link" href="#kudu-tserver_log_container_max_blocks"><code>--log_container_max_blocks</code></a></h3> <div class="paragraph"> <p>Maximum number of blocks (soft) of a log container. Use 0 for no limit. Use -1 for no limit except in the case of a kernel bug with hole punching on ext4 (see KUDU-1508 for details).</p> @@ -4706,7 +4862,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>15000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>3000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -4950,6 +5106,32 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_rpc_advertised_addresses"><a class="link" href="#kudu-tserver_rpc_advertised_addresses"><code>--rpc_advertised_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for RPC connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound RPC addresses specified in --rpc_bind_addresses are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_rpc_num_acceptors_per_address"><a class="link" href="#kudu-tserver_rpc_num_acceptors_per_address"><code>--rpc_num_acceptors_per_address</code></a></h3> <div class="paragraph"> <p>Number of RPC acceptor threads for each bound address</p> @@ -5210,6 +5392,32 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_webserver_advertised_addresses"><a class="link" href="#kudu-tserver_webserver_advertised_addresses"><code>--webserver_advertised_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for HTTP(S) connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound webserver address specified in --webserver_interface and --webserver_port are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_webserver_authentication_domain"><a class="link" href="#kudu-tserver_webserver_authentication_domain"><code>--webserver_authentication_domain</code></a></h3> <div class="paragraph"> <p>Domain used for debug webserver authentication</p> @@ -6276,9 +6484,9 @@ subject to being changed or removed without notice.</p> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_memory_limit_soft_percentage"><a class="link" href="#kudu-tserver_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h3> +<h3 id="kudu-tserver_metrics_retirement_age_ms"><a class="link" href="#kudu-tserver_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h3> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> +<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6292,19 +6500,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-tserver_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h3> +<h3 id="kudu-tserver_local_ip_for_outbound_sockets"><a class="link" href="#kudu-tserver_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h3> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> +<p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6314,23 +6522,23 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-tserver_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h3> +<h3 id="kudu-tserver_nvm_cache_allocation_retry_count"><a class="link" href="#kudu-tserver_nvm_cache_allocation_retry_count"><code>--nvm_cache_allocation_retry_count</code></a></h3> <div class="paragraph"> -<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +<p>The number of times that the NVM cache will retry attempts to allocate memory for new entries. In between attempts, a cache entry will be evicted.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6348,15 +6556,41 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_metrics_retirement_age_ms"><a class="link" href="#kudu-tserver_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h3> +<h3 id="kudu-tserver_nvm_cache_path"><a class="link" href="#kudu-tserver_nvm_cache_path"><code>--nvm_cache_path</code></a></h3> <div class="paragraph"> -<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> +<p>The path at which the NVM cache will try to allocate its memory. This can be a tmpfs or ramfs for testing purposes.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>/vmem</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_memory_limit_soft_percentage"><a class="link" href="#kudu-tserver_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h3> +<div class="paragraph"> +<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6370,19 +6604,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_local_ip_for_outbound_sockets"><a class="link" href="#kudu-tserver_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h3> +<h3 id="kudu-tserver_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-tserver_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h3> <div class="paragraph"> -<p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> +<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6392,23 +6626,23 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_nvm_cache_allocation_retry_count"><a class="link" href="#kudu-tserver_nvm_cache_allocation_retry_count"><code>--nvm_cache_allocation_retry_count</code></a></h3> +<h3 id="kudu-tserver_memory_pressure_percentage"><a class="link" href="#kudu-tserver_memory_pressure_percentage"><code>--memory_pressure_percentage</code></a></h3> <div class="paragraph"> -<p>The number of times that the NVM cache will retry attempts to allocate memory for new entries. In between attempts, a cache entry will be evicted.</p> +<p>Percentage of the hard memory limit that this daemon may consume before flushing of in-memory data becomes prioritized.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6422,19 +6656,19 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_nvm_cache_path"><a class="link" href="#kudu-tserver_nvm_cache_path"><code>--nvm_cache_path</code></a></h3> +<h3 id="kudu-tserver_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-tserver_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h3> <div class="paragraph"> -<p>The path at which the NVM cache will try to allocate its memory. This can be a tmpfs or ramfs for testing purposes.</p> +<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -6444,15 +6678,15 @@ subject to being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>/vmem</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -6552,7 +6786,7 @@ subject to being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>5</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -6560,6 +6794,32 @@ subject to being changed or removed without notice.</p> </tr> </tbody> </table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_logfile_mode"><a class="link" href="#kudu-tserver_logfile_mode"><code>--logfile_mode</code></a></h3> +<div class="paragraph"> +<p>Log file mode/permissions.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>436</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"></td> +</tr> +</tbody> +</table> <hr> </div> </div>
http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/contributing.html ---------------------------------------------------------------------- diff --git a/docs/contributing.html b/docs/contributing.html index 7eacd47..20b9b58 100644 --- a/docs/contributing.html +++ b/docs/contributing.html @@ -2,7 +2,7 @@ title: Contributing to Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-05-04 13:08:22 PDT' +last_updated: 'Last updated 2017-05-15 17:12:37 PDT' --- <!-- http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/developing.html ---------------------------------------------------------------------- diff --git a/docs/developing.html b/docs/developing.html index 0ed0f32..931d6bf 100644 --- a/docs/developing.html +++ b/docs/developing.html @@ -2,7 +2,7 @@ title: Developing Applications With Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-05-15 12:38:07 PDT' +last_updated: 'Last updated 2017-05-18 13:38:03 PDT' --- <!-- @@ -247,8 +247,8 @@ assigned an alternate name when registered as a temporary table.</p> </li> <li> <p>Kudu tables with a column name containing upper case or non-ascii characters -may not be used with SparkSQL. Non-primary key columns may be renamed in Kudu -to work around this issue.</p> +may not be used with SparkSQL. Columns may be renamed in Kudu to work around +this issue.</p> </li> <li> <p><code><></code> and <code>OR</code> predicates are not pushed to Kudu, and instead will be evaluated http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/installation.html ---------------------------------------------------------------------- diff --git a/docs/installation.html b/docs/installation.html index feeea4a..b23b0ec 100644 --- a/docs/installation.html +++ b/docs/installation.html @@ -2,7 +2,7 @@ title: Installing Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-05-15 12:38:07 PDT' +last_updated: 'Last updated 2017-05-18 13:38:03 PDT' --- <!-- @@ -948,18 +948,8 @@ Other libraries and headers are internal to Kudu and have no stability guarantee <li> <p>Apache Maven 3.x</p> </li> -<li> -<p><code>protoc</code> 2.6 or newer installed in your path, or built from the <code>thirdparty/</code> directory. -You can run the following commands to build <code>protoc</code> from the third-party dependencies:</p> -</li> </ul> </div> -<div class="listingblock"> -<div class="content"> -<pre>$ thirdparty/download-thirdparty.sh -$ thirdparty/build-thirdparty.sh protobuf</pre> -</div> -</div> <div class="paragraph"> <p>To build the Java client, clone the Kudu Git repository, change to the <code>java</code> directory, and issue the following command:</p> @@ -1018,20 +1008,18 @@ in <code>java/kudu-client/target/apidocs/index.html</code>.</p> the version of Kudu that you are about to install. Pay close attention to the incompatibilities, upgrade, and downgrade notes that are documented there.</p> </div> -<div class="paragraph"> -<p>Additionally, during the beta period:</p> -</div> -<div class="ulist"> -<ul> -<li> -<p>Upgrades are only supported when going from the previous latest version to -the newest released version.</p> -</li> -<li> -<p>Rolling upgrades are not supported. Please shut down all Kudu services before -upgrading the software.</p> -</li> -</ul> +<div class="admonitionblock note"> +<table> +<tr> +<td class="icon"> +<i class="fa icon-note" title="Note"></i> +</td> +<td class="content"> +Currently rolling upgrades are not supported. Please shut down all Kudu services before + upgrading the software. +</td> +</tr> +</table> </div> <div class="sect2"> <h3 id="upgrade_procedure"><a class="link" href="#upgrade_procedure">Upgrade Procedure</a></h3> http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/known_issues.html ---------------------------------------------------------------------- diff --git a/docs/known_issues.html b/docs/known_issues.html index cdc960c..c0a063e 100644 --- a/docs/known_issues.html +++ b/docs/known_issues.html @@ -2,7 +2,7 @@ title: Known Issues and Limitations layout: default active_nav: docs -last_updated: 'Last updated 2017-05-15 12:38:07 PDT' +last_updated: 'Last updated 2017-06-08 18:46:50 PDT' --- <!-- @@ -33,10 +33,8 @@ limitations under the License. <div class="ulist"> <ul> <li> -<p>Columns that are part of the primary key cannot be renamed. -The primary key may not be changed after the table is created. -You must drop and recreate a table to select a new primary key -or rename key columns.</p> +<p>The primary key may not be changed after the table is created. +You must drop and recreate a table to select a new primary key.</p> </li> <li> <p>The columns which make up the primary key must be listed first in the schema.</p> @@ -66,10 +64,10 @@ composite-key encoding done by Kudu.</p> <div class="ulist"> <ul> <li> -<p>TIMESTAMP, DECIMAL, CHAR, VARCHAR, DATE, and complex types like ARRAY are not supported.</p> +<p>DECIMAL, CHAR, VARCHAR, DATE, and complex types like ARRAY are not supported.</p> </li> <li> -<p>Type, nullability, compression, and encoding of existing columns cannot be changed by altering the table.</p> +<p>Type and nullability of existing columns cannot be changed by altering the table.</p> </li> <li> <p>Tables can have a maximum of 300 columns.</p> @@ -95,7 +93,7 @@ composite-key encoding done by Kudu.</p> <div class="ulist"> <ul> <li> -<p>Cells cannot be larger than 64KB.</p> +<p>Cells cannot be larger than 64KB before encoding or compression.</p> </li> </ul> </div> @@ -280,7 +278,7 @@ require Kerberos authentication.</p> <li> <p>Kudu client instances retrieve authentication tokens upon first contact with the cluster. These tokens expire after one week. Use of a single Kudu client instance -for more than one week is not supported.</p> +for more than one week is only supported by the C++ client but not by the Java client.</p> </li> </ul> </div> @@ -306,6 +304,14 @@ to start up. It is recommended to limit the number of tablets per server to 100 Consider this limitation when pre-splitting your tables. If you notice slow start-up times, you can monitor the number of tablets per server in the web UI.</p> </li> +<li> +<p>Kerberos authentication does not function correctly on hosts which contain +capital letters in their hostname.</p> +</li> +<li> +<p>Kerberos authentication does not function correctly if <code>rdns = false</code> is configured +in <code>krb5.conf</code>.</p> +</li> </ul> </div> </div> http://git-wip-us.apache.org/repos/asf/kudu/blob/ce7ab97e/docs/kudu-master_configuration_reference.html ---------------------------------------------------------------------- diff --git a/docs/kudu-master_configuration_reference.html b/docs/kudu-master_configuration_reference.html index d5e84f1..3805ed6 100644 --- a/docs/kudu-master_configuration_reference.html +++ b/docs/kudu-master_configuration_reference.html @@ -2,7 +2,7 @@ title: kudu-master Flags layout: default active_nav: docs -last_updated: 'Last updated 2017-05-15 12:46:02 PDT' +last_updated: 'Last updated 2017-06-13 10:50:35 PDT' --- <!-- @@ -1299,6 +1299,35 @@ considered final, and while they may be useful for tuning, they are subject to being changed or removed without notice.</p> </div> <div class="sect2"> +<h3 id="kudu-master_cfile_verify_checksums"><a class="link" href="#kudu-master_cfile_verify_checksums"><code>--cfile_verify_checksums</code></a></h3> +<div class="paragraph"> +<p>Verify the checksum for each block on read if one exists</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_cfile_default_block_size"><a class="link" href="#kudu-master_cfile_default_block_size"><code>--cfile_default_block_size</code></a></h3> <div class="paragraph"> <p>The default block size to use in cfiles</p> @@ -1357,9 +1386,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_fault_crash_after_leader_request_fraction"><a class="link" href="#kudu-master_fault_crash_after_leader_request_fraction"><code>--fault_crash_after_leader_request_fraction</code></a></h3> +<h3 id="kudu-master_cfile_write_checksums"><a class="link" href="#kudu-master_cfile_write_checksums"><code>--cfile_write_checksums</code></a></h3> <div class="paragraph"> -<p>Fraction of the time when the leader will crash on getting a response for an UpdateConsensus RPC. (For testing only!)</p> +<p>Write CRC32 checksums for each block</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1369,15 +1398,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -1386,9 +1415,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_raft_get_node_instance_timeout_ms"><a class="link" href="#kudu-master_raft_get_node_instance_timeout_ms"><code>--raft_get_node_instance_timeout_ms</code></a></h3> +<h3 id="kudu-master_consensus_rpc_timeout_ms"><a class="link" href="#kudu-master_consensus_rpc_timeout_ms"><code>--consensus_rpc_timeout_ms</code></a></h3> <div class="paragraph"> -<p>Timeout for retrieving node instance data over RPC.</p> +<p>Timeout used for all consensus internal RPC communications.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1402,11 +1431,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -1547,7 +1576,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1678,7 +1707,7 @@ being changed or removed without notice.</p> <div class="sect2"> <h3 id="kudu-master_log_segment_size_mb"><a class="link" href="#kudu-master_log_segment_size_mb"><code>--log_segment_size_mb</code></a></h3> <div class="paragraph"> -<p>The default segment size for log roll-overs, in MB</p> +<p>The default size for log segments, in MB</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1692,7 +1721,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>64</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>8</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1823,7 +1852,7 @@ being changed or removed without notice.</p> <div class="sect2"> <h3 id="kudu-master_block_manager_max_open_files"><a class="link" href="#kudu-master_block_manager_max_open_files"><code>--block_manager_max_open_files</code></a></h3> <div class="paragraph"> -<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit.</p> +<p>Maximum number of open file descriptors to be used for data blocks. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit. It is an error to use a value of 0.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1937,6 +1966,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_log_container_excess_space_before_cleanup_fraction"><a class="link" href="#kudu-master_log_container_excess_space_before_cleanup_fraction"><code>--log_container_excess_space_before_cleanup_fraction</code></a></h3> +<div class="paragraph"> +<p>Additional fraction of a log container’s calculated size that must be consumed on disk before the container is considered to be inconsistent and subject to excess space cleanup at block manager startup.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.10000000000000001</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_log_container_max_blocks"><a class="link" href="#kudu-master_log_container_max_blocks"><code>--log_container_max_blocks</code></a></h3> <div class="paragraph"> <p>Maximum number of blocks (soft) of a log container. Use 0 for no limit. Use -1 for no limit except in the case of a kernel bug with hole punching on ext4 (see KUDU-1508 for details).</p> @@ -2446,7 +2504,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>15000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>3000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -2546,6 +2604,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_trusted_subnets"><a class="link" href="#kudu-master_trusted_subnets"><code>--trusted_subnets</code></a></h3> +<div class="paragraph"> +<p>A trusted subnet whitelist. If set explicitly, all unauthenticated or unencrypted connections are prohibited except the ones from the specified address blocks. Otherwise, private network (127.0.0.0/8, etc.) and local subnets of all local network interfaces will be used. Set it to '0.0.0.0/0' to allow unauthenticated/unencrypted connections from all remote IP addresses. However, if network access is not otherwise restricted by a firewall, malicious users may be able to gain unauthorized access.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>127.0.0.0/8,10.0.0.0/8,172.16.0.0/12,192.168.0.0/16,169.254.0.0/16</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_rpc_max_message_size"><a class="link" href="#kudu-master_rpc_max_message_size"><code>--rpc_max_message_size</code></a></h3> <div class="paragraph"> <p>The maximum size of a message that any RPC that the server will accept. Must be at least 1MB.</p> @@ -2691,6 +2778,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_rpc_advertised_addresses"><a class="link" href="#kudu-master_rpc_advertised_addresses"><code>--rpc_advertised_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for RPC connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound RPC addresses specified in --rpc_bind_addresses are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_rpc_num_acceptors_per_address"><a class="link" href="#kudu-master_rpc_num_acceptors_per_address"><code>--rpc_num_acceptors_per_address</code></a></h3> <div class="paragraph"> <p>Number of RPC acceptor threads for each bound address</p> @@ -2981,6 +3097,35 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_webserver_advertised_addresses"><a class="link" href="#kudu-master_webserver_advertised_addresses"><code>--webserver_advertised_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of addresses to advertise externally for HTTP(S) connections. Ephemeral ports (i.e. port 0) are not allowed. This should be configured when the locally bound webserver address specified in --webserver_interface and --webserver_port are not externally resolvable, for example, if Kudu is deployed in a container.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_webserver_authentication_domain"><a class="link" href="#kudu-master_webserver_authentication_domain"><code>--webserver_authentication_domain</code></a></h3> <div class="paragraph"> <p>Domain used for debug webserver authentication</p> @@ -3737,7 +3882,7 @@ being changed or removed without notice.</p> <div class="sect2"> <h3 id="kudu-master_redact"><a class="link" href="#kudu-master_redact"><code>--redact</code></a></h3> <div class="paragraph"> -<p>Comma-separated list of redactions. Supported redactions are 'flag', 'log' and 'all'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted.</p> +<p>Comma-separated list of redactions. Supported options are 'flag', 'log', 'all', and 'none'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted. If 'none' is specified, no redaction will occur.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3793,9 +3938,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h3> +<h3 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h3> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> +<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3809,11 +3954,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> </tr> </tbody> </table> @@ -3822,9 +3967,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h3> +<h3 id="kudu-master_enable_minidumps"><a class="link" href="#kudu-master_enable_minidumps"><code>--enable_minidumps</code></a></h3> <div class="paragraph"> -<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> +<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3834,15 +3979,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> </tr> </tbody> </table> @@ -3851,9 +3996,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h3> +<h3 id="kudu-master_max_minidumps"><a class="link" href="#kudu-master_max_minidumps"><code>--max_minidumps</code></a></h3> <div class="paragraph"> -<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +<p>Maximum number of minidump files to keep per daemon. Older files are removed first. Set to 0 to keep all minidump files.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3867,11 +4012,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>9</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -3880,9 +4025,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_metrics_retirement_age_ms"><a class="link" href="#kudu-master_metrics_retirement_age_ms"><code>--metrics_retirement_age_ms</code></a></h3> +<h3 id="kudu-master_minidump_path"><a class="link" href="#kudu-master_minidump_path"><code>--minidump_path</code></a></h3> <div class="paragraph"> -<p>The minimum number of milliseconds a metric will be kept for after it is no longer active. (Advanced option)</p> +<p>Directory to write minidump files to. This can be either an absolute path or a path relative to --log_dir. Each daemon will create an additional sub-directory to prevent naming conflicts and to make it easier to identify a crashing daemon. Minidump files contain crash-related information in a compressed format. Minidumps will be written when a daemon exits unexpectedly, for example on an unhandled exception or signal, or when a SIGUSR1 signal is sent to the process. Cannot be set to an empty value.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3892,15 +4037,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>minidumps</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> </tr> </tbody> </table> @@ -3909,9 +4054,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_enable_minidumps"><a class="link" href="#kudu-master_enable_minidumps"><code>--enable_minidumps</code></a></h3> +<h3 id="kudu-master_minidump_size_limit_hint_kb"><a class="link" href="#kudu-master_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h3> <div class="paragraph"> -<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> +<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3921,11 +4066,11 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -3938,9 +4083,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_max_minidumps"><a class="link" href="#kudu-master_max_minidumps"><code>--max_minidumps</code></a></h3> +<h3 id="kudu-master_memory_limit_soft_percentage"><a class="link" href="#kudu-master_memory_limit_soft_percentage"><code>--memory_limit_soft_percentage</code></a></h3> <div class="paragraph"> -<p>Maximum number of minidump files to keep per daemon. Older files are removed first. Set to 0 to keep all minidump files.</p> +<p>Percentage of the hard memory limit that this daemon may consume before memory throttling of writes begins. The greater the excess, the higher the chance of throttling. In general, a lower soft limit leads to smoother write latencies but decreased throughput, and vice versa for a higher soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3954,11 +4099,11 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>9</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>80</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -3967,9 +4112,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_minidump_path"><a class="link" href="#kudu-master_minidump_path"><code>--minidump_path</code></a></h3> +<h3 id="kudu-master_memory_limit_warn_threshold_percentage"><a class="link" href="#kudu-master_memory_limit_warn_threshold_percentage"><code>--memory_limit_warn_threshold_percentage</code></a></h3> <div class="paragraph"> -<p>Directory to write minidump files to. This can be either an absolute path or a path relative to --log_dir. Each daemon will create an additional sub-directory to prevent naming conflicts and to make it easier to identify a crashing daemon. Minidump files contain crash-related information in a compressed format. Minidumps will be written when a daemon exits unexpectedly, for example on an unhandled exception or signal, or when a SIGUSR1 signal is sent to the process. Cannot be set to an empty value.</p> +<p>Percentage of the hard memory limit that this daemon may consume before WARNING level messages are periodically logged.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3979,15 +4124,15 @@ being changed or removed without notice.</p> <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>minidumps</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>98</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -3996,9 +4141,9 @@ being changed or removed without notice.</p> </div> </div> <div class="sect2"> -<h3 id="kudu-master_minidump_size_limit_hint_kb"><a class="link" href="#kudu-master_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h3> +<h3 id="kudu-master_memory_pressure_percentage"><a class="link" href="#kudu-master_memory_pressure_percentage"><code>--memory_pressure_percentage</code></a></h3> <div class="paragraph"> -<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> +<p>Percentage of the hard memory limit that this daemon may consume before flushing of in-memory data becomes prioritized.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4012,11 +4157,40 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>60</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> +<h3 id="kudu-master_tcmalloc_max_free_bytes_percentage"><a class="link" href="#kudu-master_tcmalloc_max_free_bytes_percentage"><code>--tcmalloc_max_free_bytes_percentage</code></a></h3> +<div class="paragraph"> +<p>Maximum percentage of the RSS that tcmalloc is allowed to use for reserved but unallocated memory.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -4128,7 +4302,7 @@ being changed or removed without notice.</p> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>30</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>5</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -4139,6 +4313,35 @@ being changed or removed without notice.</p> <div class="paragraph"> <p> </p> </div> +</div> +<div class="sect2"> +<h3 id="kudu-master_logfile_mode"><a class="link" href="#kudu-master_logfile_mode"><code>--logfile_mode</code></a></h3> +<div class="paragraph"> +<p>Log file mode/permissions.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>436</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> <hr> </div> </div>
