http://git-wip-us.apache.org/repos/asf/kudu/blob/d114777e/docs/configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/configuration_reference_unsupported.html b/docs/configuration_reference_unsupported.html index 00772c3..b13c8b4 100644 --- a/docs/configuration_reference_unsupported.html +++ b/docs/configuration_reference_unsupported.html @@ -2,7 +2,7 @@ title: Apache Kudu Unsupported Configuration Flags layout: default active_nav: docs -last_updated: 'Last updated 2017-02-02 14:03:11 PST' +last_updated: 'Last updated 2017-03-20 16:43:12 PDT' --- <!-- @@ -81,6 +81,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_min_compression_ratio"><a class="link" href="#kudu-master_min_compression_ratio"><code>--min_compression_ratio</code></a></h3> +<div class="paragraph"> +<p>If a column compression codec is configured, but the codec is unable to achieve a compression ratio at least as good as the configured value, then the data will be written uncompressed. This will reduce CPU overhead on the read side at the expense of a small amount of extra space if the codec encounters portions of data that are not easily compressible.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.90000000000000002</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_cfile_default_block_size"><a class="link" href="#kudu-master_cfile_default_block_size"><code>--cfile_default_block_size</code></a></h3> <div class="paragraph"> <p>The default block size to use in cfiles</p> @@ -341,6 +367,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_log_compression_codec"><a class="link" href="#kudu-master_log_compression_codec"><code>--log_compression_codec</code></a></h3> +<div class="paragraph"> +<p>Codec to use for compressing WAL segments.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>LZ4</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_log_max_segments_to_retain"><a class="link" href="#kudu-master_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h3> <div class="paragraph"> <p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> @@ -811,7 +863,7 @@ for informational purposes only. They are subject to change or be removed withou <div class="sect2"> <h3 id="kudu-master_block_manager_max_open_files"><a class="link" href="#kudu-master_block_manager_max_open_files"><code>--block_manager_max_open_files</code></a></h3> <div class="paragraph"> -<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use half of its resource limit as per getrlimit(). This is a soft limit.</p> +<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1199,6 +1251,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_authn_token_validity_seconds"><a class="link" href="#kudu-master_authn_token_validity_seconds"><code>--authn_token_validity_seconds</code></a></h3> +<div class="paragraph"> +<p>Period of time for which an issued authentication token is valid. It’s not possible to renew a token, hence the token validity interval defines the longest possible lifetime of an external job which uses a token for authentication.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int64</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>604800</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_master_registration_rpc_timeout_ms"><a class="link" href="#kudu-master_master_registration_rpc_timeout_ms"><code>--master_registration_rpc_timeout_ms</code></a></h3> <div class="paragraph"> <p>Timeout for retrieving master registration over RPC.</p> @@ -1225,6 +1303,110 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_tsk_rotation_seconds"><a class="link" href="#kudu-master_tsk_rotation_seconds"><code>--tsk_rotation_seconds</code></a></h3> +<div class="paragraph"> +<p>Number of seconds between consecutive activations of newly generated TSKs (Token Signing Keys).</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int64</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>86400</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_ipki_ca_cert_expiration_seconds"><a class="link" href="#kudu-master_ipki_ca_cert_expiration_seconds"><code>--ipki_ca_cert_expiration_seconds</code></a></h3> +<div class="paragraph"> +<p>validity interval for self-signed root CA certifcate issued by Kudu IPKI (Internal Private Key Infrastructure, a.k.a. Internal Kudu CA)</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int64</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>315360000</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_ipki_ca_key_size"><a class="link" href="#kudu-master_ipki_ca_key_size"><code>--ipki_ca_key_size</code></a></h3> +<div class="paragraph"> +<p>the number of bits for self-signed root CA cert used by Kudu IPKI (Internal Private Key Infrastructure, a.k.a. Internal Kudu CA)</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2048</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_ipki_server_cert_expiration_seconds"><a class="link" href="#kudu-master_ipki_server_cert_expiration_seconds"><code>--ipki_server_cert_expiration_seconds</code></a></h3> +<div class="paragraph"> +<p>validity interval for server certificates issued by Kudu IPKI (Internal Private Key Infrastructure, a.k.a. Internal Kudu CA)</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int64</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>315360000</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_tserver_unresponsive_timeout_ms"><a class="link" href="#kudu-master_tserver_unresponsive_timeout_ms"><code>--tserver_unresponsive_timeout_ms</code></a></h3> <div class="paragraph"> <p>The period of time that a Master can go without receiving a heartbeat from a tablet server before considering it unresponsive. Unresponsive servers are not selected when assigning replicas during table creation or re-replication.</p> @@ -1277,9 +1459,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_rpc_default_keepalive_time_ms"><a class="link" href="#kudu-master_rpc_default_keepalive_time_ms"><code>--rpc_default_keepalive_time_ms</code></a></h3> +<h3 id="kudu-master_rpc_ca_certificate_file"><a class="link" href="#kudu-master_rpc_ca_certificate_file"><code>--rpc_ca_certificate_file</code></a></h3> <div class="paragraph"> -<p>If an RPC connection from a client is idle for this amount of time, the server will disconnect the client.</p> +<p>Path to the PEM encoded X509 certificate of the trusted external certificate authority. The provided certificate should be the root issuer of the certificate passed in '--rpc_certificate_file'.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1289,23 +1471,23 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>65000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_rpc_ssl_certificate_authority"><a class="link" href="#kudu-master_rpc_ssl_certificate_authority"><code>--rpc_ssl_certificate_authority</code></a></h3> +<h3 id="kudu-master_rpc_certificate_file"><a class="link" href="#kudu-master_rpc_certificate_file"><code>--rpc_certificate_file</code></a></h3> <div class="paragraph"> -<p>Path to the certificate authority to be used by the client side of the connection to verify the validity of the certificate presented by the server.</p> +<p>Path to a PEM encoded X509 certificate to use for securing RPC connections with SSL/TLS. If set, '--rpc_private_key_file' and '--rpc_ca_certificate_file' must be set as well.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1329,9 +1511,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_rpc_ssl_private_key"><a class="link" href="#kudu-master_rpc_ssl_private_key"><code>--rpc_ssl_private_key</code></a></h3> +<h3 id="kudu-master_rpc_default_keepalive_time_ms"><a class="link" href="#kudu-master_rpc_default_keepalive_time_ms"><code>--rpc_default_keepalive_time_ms</code></a></h3> <div class="paragraph"> -<p>Path to the private key to be used to complement the public key present in --ssl_server_certificate</p> +<p>If an RPC connection from a client is idle for this amount of time, the server will disconnect the client.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1341,23 +1523,23 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>65000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_rpc_ssl_server_certificate"><a class="link" href="#kudu-master_rpc_ssl_server_certificate"><code>--rpc_ssl_server_certificate</code></a></h3> +<h3 id="kudu-master_rpc_private_key_file"><a class="link" href="#kudu-master_rpc_private_key_file"><code>--rpc_private_key_file</code></a></h3> <div class="paragraph"> -<p>Path to the SSL certificate to be used for the RPC layer.</p> +<p>Path to a PEM encoded private key paired with the certificate from '--rpc_certificate_file'</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1381,9 +1563,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_server_require_kerberos"><a class="link" href="#kudu-master_server_require_kerberos"><code>--server_require_kerberos</code></a></h3> +<h3 id="kudu-master_rpc_encrypt_loopback_connections"><a class="link" href="#kudu-master_rpc_encrypt_loopback_connections"><code>--rpc_encrypt_loopback_connections</code></a></h3> <div class="paragraph"> -<p>Whether to force all inbound RPC connections to authenticate with Kerberos</p> +<p>Whether to encrypt data transfer on RPC connections that stay within a single host. Encryption here is likely to offer no additional security benefit since only a local 'root' user could intercept the traffic, and wire encryption does not suitably protect against such an attacker.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1401,7 +1583,7 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -1589,7 +1771,7 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_kerberos_principal"><a class="link" href="#kudu-master_kerberos_principal"><code>--kerberos_principal</code></a></h3> +<h3 id="kudu-master_principal"><a class="link" href="#kudu-master_principal"><code>--principal</code></a></h3> <div class="paragraph"> <p>Kerberos principal that this daemon will log in as. The special token _HOST will be replaced with the FQDN of the local host.</p> </div> @@ -1609,15 +1791,41 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">unsafe,experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_ipki_server_key_size"><a class="link" href="#kudu-master_ipki_server_key_size"><code>--ipki_server_key_size</code></a></h3> +<div class="paragraph"> +<p>the number of bits for server cert’s private key. The server cert is used for TLS connections to and from clients and other servers.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2048</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> <td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_keytab"><a class="link" href="#kudu-master_keytab"><code>--keytab</code></a></h3> +<h3 id="kudu-master_rpc_tls_ciphers"><a class="link" href="#kudu-master_rpc_tls_ciphers"><code>--rpc_tls_ciphers</code></a></h3> <div class="paragraph"> -<p>Path to the Kerberos Keytab for this server</p> +<p>The cipher suite preferences to use for TLS-secured RPC connections. Uses the OpenSSL cipher preference list format. See man (1) ciphers for more information.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1631,7 +1839,59 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256AES256-GCM-SHA384:AES128-GCM-SHA256:AES256-SHA256:AES128-SHA256:AES256-SHA:AES128-SHA</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_rpc_tls_min_protocol"><a class="link" href="#kudu-master_rpc_tls_min_protocol"><code>--rpc_tls_min_protocol</code></a></h3> +<div class="paragraph"> +<p>The minimum protocol version to allow when for securing RPC connections with TLS. May be one of 'TLSv1', 'TLSv1.1', or 'TLSv1.2'.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>TLSv1</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_tsk_num_rsa_bits"><a class="link" href="#kudu-master_tsk_num_rsa_bits"><code>--tsk_num_rsa_bits</code></a></h3> +<div class="paragraph"> +<p>Number of bits in RSA keys used for token signing.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2048</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1849,9 +2109,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_metrics_log_interval_ms"><a class="link" href="#kudu-master_metrics_log_interval_ms"><code>--metrics_log_interval_ms</code></a></h3> +<h3 id="kudu-master_webserver_enabled"><a class="link" href="#kudu-master_webserver_enabled"><code>--webserver_enabled</code></a></h3> <div class="paragraph"> -<p>Interval (in milliseconds) at which the server will dump its metrics to a local log file. The log files are located in the same directory as specified by the -log_dir flag. If this is not a positive value, then metrics logging will be disabled.</p> +<p>Whether to enable the web server on this daemon. NOTE: disabling the web server is also likely to prevent monitoring systems from properly capturing metrics.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -1861,11 +2121,11 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -1875,7 +2135,33 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_webserver_max_post_length_bytes"><a class="link" href="#kudu-master_webserver_max_post_length_bytes"><code>--webserver_max_post_length_bytes</code></a></h3> +<h3 id="kudu-master_metrics_log_interval_ms"><a class="link" href="#kudu-master_metrics_log_interval_ms"><code>--metrics_log_interval_ms</code></a></h3> +<div class="paragraph"> +<p>Interval (in milliseconds) at which the server will dump its metrics to a local log file. The log files are located in the same directory as specified by the -log_dir flag. If this is not a positive value, then metrics logging will be disabled.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_webserver_max_post_length_bytes"><a class="link" href="#kudu-master_webserver_max_post_length_bytes"><code>--webserver_max_post_length_bytes</code></a></h3> <div class="paragraph"> <p>The maximum length of a POST request that will be accepted by the embedded web server.</p> </div> @@ -1901,6 +2187,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_webserver_x_frame_options"><a class="link" href="#kudu-master_webserver_x_frame_options"><code>--webserver_x_frame_options</code></a></h3> +<div class="paragraph"> +<p>The webserver will add an 'X-Frame-Options' HTTP header with this value to all responses. This can help prevent clickjacking attacks.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>DENY</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_webserver_doc_root"><a class="link" href="#kudu-master_webserver_doc_root"><code>--webserver_doc_root</code></a></h3> <div class="paragraph"> <p>Files under <webserver_doc_root> are accessible via the debug webserver. Defaults to $KUDU_HOME/www, or if $KUDU_HOME is not set, disables the document root</p> @@ -2083,6 +2395,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_deltafile_default_compression_codec"><a class="link" href="#kudu-master_deltafile_default_compression_codec"><code>--deltafile_default_compression_codec</code></a></h3> +<div class="paragraph"> +<p>The compression codec used when writing deltafiles.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>lz4</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_default_composite_key_index_block_size_bytes"><a class="link" href="#kudu-master_default_composite_key_index_block_size_bytes"><code>--default_composite_key_index_block_size_bytes</code></a></h3> <div class="paragraph"> <p>Block size used for composite key indexes.</p> @@ -2343,6 +2681,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_undo_delta_block_gc_init_budget_millis"><a class="link" href="#kudu-master_undo_delta_block_gc_init_budget_millis"><code>--undo_delta_block_gc_init_budget_millis</code></a></h3> +<div class="paragraph"> +<p>The maximum number of milliseconds we will spend initializing UNDO delta blocks per invocation of UndoDeltaBlockGCOp. Existing delta blocks must be initialized once per process startup to determine when they can be deleted.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,evolving</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_flush_threshold_mb"><a class="link" href="#kudu-master_flush_threshold_mb"><code>--flush_threshold_mb</code></a></h3> <div class="paragraph"> <p>Size at which MemRowSet flushes are triggered. A MRS can still flush below this threshold if it if hasn’t flushed in a while, or if the server-wide memory limit has been reached.</p> @@ -2369,6 +2733,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_flush_threshold_secs"><a class="link" href="#kudu-master_flush_threshold_secs"><code>--flush_threshold_secs</code></a></h3> +<div class="paragraph"> +<p>Number of seconds after which a non-empty MemRowSet will become flushable even if it is not large.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_tablet_transaction_memory_limit_mb"><a class="link" href="#kudu-master_tablet_transaction_memory_limit_mb"><code>--tablet_transaction_memory_limit_mb</code></a></h3> <div class="paragraph"> <p>Maximum amount of memory that may be consumed by all in-flight transactions belonging to a particular tablet. When this limit is reached, new transactions will be rejected and clients will be forced to retry them. If -1, transaction memory tracking is disabled.</p> @@ -2681,9 +3071,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_never_fsync"><a class="link" href="#kudu-master_never_fsync"><code>--never_fsync</code></a></h3> +<h3 id="kudu-master_env_use_fsync"><a class="link" href="#kudu-master_env_use_fsync"><code>--env_use_fsync</code></a></h3> <div class="paragraph"> -<p>Never fsync() anything to disk. This is used by certain test cases to speed up runtime. This is very unsafe to use in production.</p> +<p>Use fsync(2) instead of fdatasync(2) for synchronizing dirty data to disk.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -2701,15 +3091,15 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">unsafe,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_suicide_on_eio"><a class="link" href="#kudu-master_suicide_on_eio"><code>--suicide_on_eio</code></a></h3> +<h3 id="kudu-master_never_fsync"><a class="link" href="#kudu-master_never_fsync"><code>--never_fsync</code></a></h3> <div class="paragraph"> -<p>Kill the process if an I/O operation results in EIO</p> +<p>Never fsync() anything to disk. This is used by certain test cases to speed up runtime. This is very unsafe to use in production.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -2723,19 +3113,19 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">unsafe,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-master_writable_file_use_fsync"><a class="link" href="#kudu-master_writable_file_use_fsync"><code>--writable_file_use_fsync</code></a></h3> +<h3 id="kudu-master_suicide_on_eio"><a class="link" href="#kudu-master_suicide_on_eio"><code>--suicide_on_eio</code></a></h3> <div class="paragraph"> -<p>Use fsync(2) instead of fdatasync(2) for synchronizing dirty data to disk.</p> +<p>Kill the process if an I/O operation results in EIO</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -2749,7 +3139,7 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -2811,9 +3201,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_log_redact_user_data"><a class="link" href="#kudu-master_log_redact_user_data"><code>--log_redact_user_data</code></a></h3> +<h3 id="kudu-master_redact"><a class="link" href="#kudu-master_redact"><code>--redact</code></a></h3> <div class="paragraph"> -<p>Whether log and error messages will have row data redacted.</p> +<p>Comma-separated list of redactions. Supported redactions are 'flag', 'log' and 'all'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -2823,15 +3213,41 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>all</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_umask"><a class="link" href="#kudu-master_umask"><code>--umask</code></a></h3> +<div class="paragraph"> +<p>The umask that will be used when creating files and directories. Permissions of top-level data directories will also be modified at start-up to conform to the given umask. Changing this value may enable unauthorized local users to read or modify data stored by Kudu.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>077</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -2863,6 +3279,58 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_data_gc_min_size_mb"><a class="link" href="#kudu-master_data_gc_min_size_mb"><code>--data_gc_min_size_mb</code></a></h3> +<div class="paragraph"> +<p>The (exclusive) minimum number of megabytes of ancient data on disk, per tablet, needed to prioritize deletion of that data.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int64</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_data_gc_prioritization_prob"><a class="link" href="#kudu-master_data_gc_prioritization_prob"><code>--data_gc_prioritization_prob</code></a></h3> +<div class="paragraph"> +<p>The probability that we will prioritize data GC over performance improvement operations. If set to 1.0, we will always prefer to delete old data before running performance improvement operations such as delta compaction.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.5</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_log_target_replay_size_mb"><a class="link" href="#kudu-master_log_target_replay_size_mb"><code>--log_target_replay_size_mb</code></a></h3> <div class="paragraph"> <p>The target maximum size of logs to be replayed at startup. If a tablet has in-memory operations that are causing more than this size of logs to be retained, then the maintenance manager will prioritize flushing these operations to disk.</p> @@ -2993,6 +3461,58 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_enable_minidumps"><a class="link" href="#kudu-master_enable_minidumps"><code>--enable_minidumps</code></a></h3> +<div class="paragraph"> +<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-master_minidump_size_limit_hint_kb"><a class="link" href="#kudu-master_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h3> +<div class="paragraph"> +<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_local_ip_for_outbound_sockets"><a class="link" href="#kudu-master_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h3> <div class="paragraph"> <p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p> @@ -3211,6 +3731,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_min_compression_ratio"><a class="link" href="#kudu-tserver_min_compression_ratio"><code>--min_compression_ratio</code></a></h3> +<div class="paragraph"> +<p>If a column compression codec is configured, but the codec is unable to achieve a compression ratio at least as good as the configured value, then the data will be written uncompressed. This will reduce CPU overhead on the read side at the expense of a small amount of extra space if the codec encounters portions of data that are not easily compressible.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.90000000000000002</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_cfile_default_block_size"><a class="link" href="#kudu-tserver_cfile_default_block_size"><code>--cfile_default_block_size</code></a></h3> <div class="paragraph"> <p>The default block size to use in cfiles</p> @@ -3471,6 +4017,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_log_compression_codec"><a class="link" href="#kudu-tserver_log_compression_codec"><code>--log_compression_codec</code></a></h3> +<div class="paragraph"> +<p>Codec to use for compressing WAL segments.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>LZ4</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_log_max_segments_to_retain"><a class="link" href="#kudu-tserver_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h3> <div class="paragraph"> <p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> @@ -3941,7 +4513,7 @@ for informational purposes only. They are subject to change or be removed withou <div class="sect2"> <h3 id="kudu-tserver_block_manager_max_open_files"><a class="link" href="#kudu-tserver_block_manager_max_open_files"><code>--block_manager_max_open_files</code></a></h3> <div class="paragraph"> -<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use half of its resource limit as per getrlimit(). This is a soft limit.</p> +<p>Maximum number of open file descriptors to be used for data blocks. If 0, there is no limit. If -1, Kudu will use 40% of its resource limit as per getrlimit(). This is a soft limit.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4147,9 +4719,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_rpc_default_keepalive_time_ms"><a class="link" href="#kudu-tserver_rpc_default_keepalive_time_ms"><code>--rpc_default_keepalive_time_ms</code></a></h3> +<h3 id="kudu-tserver_rpc_ca_certificate_file"><a class="link" href="#kudu-tserver_rpc_ca_certificate_file"><code>--rpc_ca_certificate_file</code></a></h3> <div class="paragraph"> -<p>If an RPC connection from a client is idle for this amount of time, the server will disconnect the client.</p> +<p>Path to the PEM encoded X509 certificate of the trusted external certificate authority. The provided certificate should be the root issuer of the certificate passed in '--rpc_certificate_file'.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4159,23 +4731,23 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>65000</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_rpc_ssl_certificate_authority"><a class="link" href="#kudu-tserver_rpc_ssl_certificate_authority"><code>--rpc_ssl_certificate_authority</code></a></h3> +<h3 id="kudu-tserver_rpc_certificate_file"><a class="link" href="#kudu-tserver_rpc_certificate_file"><code>--rpc_certificate_file</code></a></h3> <div class="paragraph"> -<p>Path to the certificate authority to be used by the client side of the connection to verify the validity of the certificate presented by the server.</p> +<p>Path to a PEM encoded X509 certificate to use for securing RPC connections with SSL/TLS. If set, '--rpc_private_key_file' and '--rpc_ca_certificate_file' must be set as well.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4199,9 +4771,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_rpc_ssl_private_key"><a class="link" href="#kudu-tserver_rpc_ssl_private_key"><code>--rpc_ssl_private_key</code></a></h3> +<h3 id="kudu-tserver_rpc_default_keepalive_time_ms"><a class="link" href="#kudu-tserver_rpc_default_keepalive_time_ms"><code>--rpc_default_keepalive_time_ms</code></a></h3> <div class="paragraph"> -<p>Path to the private key to be used to complement the public key present in --ssl_server_certificate</p> +<p>If an RPC connection from a client is idle for this amount of time, the server will disconnect the client.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4211,23 +4783,23 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>65000</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_rpc_ssl_server_certificate"><a class="link" href="#kudu-tserver_rpc_ssl_server_certificate"><code>--rpc_ssl_server_certificate</code></a></h3> +<h3 id="kudu-tserver_rpc_private_key_file"><a class="link" href="#kudu-tserver_rpc_private_key_file"><code>--rpc_private_key_file</code></a></h3> <div class="paragraph"> -<p>Path to the SSL certificate to be used for the RPC layer.</p> +<p>Path to a PEM encoded private key paired with the certificate from '--rpc_certificate_file'</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4251,9 +4823,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_server_require_kerberos"><a class="link" href="#kudu-tserver_server_require_kerberos"><code>--server_require_kerberos</code></a></h3> +<h3 id="kudu-tserver_rpc_encrypt_loopback_connections"><a class="link" href="#kudu-tserver_rpc_encrypt_loopback_connections"><code>--rpc_encrypt_loopback_connections</code></a></h3> <div class="paragraph"> -<p>Whether to force all inbound RPC connections to authenticate with Kerberos</p> +<p>Whether to encrypt data transfer on RPC connections that stay within a single host. Encryption here is likely to offer no additional security benefit since only a local 'root' user could intercept the traffic, and wire encryption does not suitably protect against such an attacker.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4271,7 +4843,7 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -4459,7 +5031,7 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_kerberos_principal"><a class="link" href="#kudu-tserver_kerberos_principal"><code>--kerberos_principal</code></a></h3> +<h3 id="kudu-tserver_principal"><a class="link" href="#kudu-tserver_principal"><code>--principal</code></a></h3> <div class="paragraph"> <p>Kerberos principal that this daemon will log in as. The special token _HOST will be replaced with the FQDN of the local host.</p> </div> @@ -4479,15 +5051,41 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">unsafe,experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_ipki_server_key_size"><a class="link" href="#kudu-tserver_ipki_server_key_size"><code>--ipki_server_key_size</code></a></h3> +<div class="paragraph"> +<p>the number of bits for server cert’s private key. The server cert is used for TLS connections to and from clients and other servers.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>2048</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> <td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_keytab"><a class="link" href="#kudu-tserver_keytab"><code>--keytab</code></a></h3> +<h3 id="kudu-tserver_rpc_tls_ciphers"><a class="link" href="#kudu-tserver_rpc_tls_ciphers"><code>--rpc_tls_ciphers</code></a></h3> <div class="paragraph"> -<p>Path to the Kerberos Keytab for this server</p> +<p>The cipher suite preferences to use for TLS-secured RPC connections. Uses the OpenSSL cipher preference list format. See man (1) ciphers for more information.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -4501,11 +5099,37 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256AES256-GCM-SHA384:AES128-GCM-SHA256:AES256-SHA256:AES128-SHA256:AES256-SHA:AES128-SHA</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_rpc_tls_min_protocol"><a class="link" href="#kudu-tserver_rpc_tls_min_protocol"><code>--rpc_tls_min_protocol</code></a></h3> +<div class="paragraph"> +<p>The minimum protocol version to allow when for securing RPC connections with TLS. May be one of 'TLSv1', 'TLSv1.1', or 'TLSv1.2'.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>TLSv1</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -4719,6 +5343,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_webserver_enabled"><a class="link" href="#kudu-tserver_webserver_enabled"><code>--webserver_enabled</code></a></h3> +<div class="paragraph"> +<p>Whether to enable the web server on this daemon. NOTE: disabling the web server is also likely to prevent monitoring systems from properly capturing metrics.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_metrics_log_interval_ms"><a class="link" href="#kudu-tserver_metrics_log_interval_ms"><code>--metrics_log_interval_ms</code></a></h3> <div class="paragraph"> <p>Interval (in milliseconds) at which the server will dump its metrics to a local log file. The log files are located in the same directory as specified by the -log_dir flag. If this is not a positive value, then metrics logging will be disabled.</p> @@ -4771,6 +5421,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_webserver_x_frame_options"><a class="link" href="#kudu-tserver_webserver_x_frame_options"><code>--webserver_x_frame_options</code></a></h3> +<div class="paragraph"> +<p>The webserver will add an 'X-Frame-Options' HTTP header with this value to all responses. This can help prevent clickjacking attacks.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>DENY</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_webserver_doc_root"><a class="link" href="#kudu-tserver_webserver_doc_root"><code>--webserver_doc_root</code></a></h3> <div class="paragraph"> <p>Files under <webserver_doc_root> are accessible via the debug webserver. Defaults to $KUDU_HOME/www, or if $KUDU_HOME is not set, disables the document root</p> @@ -4953,6 +5629,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_deltafile_default_compression_codec"><a class="link" href="#kudu-tserver_deltafile_default_compression_codec"><code>--deltafile_default_compression_codec</code></a></h3> +<div class="paragraph"> +<p>The compression codec used when writing deltafiles.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>lz4</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_default_composite_key_index_block_size_bytes"><a class="link" href="#kudu-tserver_default_composite_key_index_block_size_bytes"><code>--default_composite_key_index_block_size_bytes</code></a></h3> <div class="paragraph"> <p>Block size used for composite key indexes.</p> @@ -5213,6 +5915,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_undo_delta_block_gc_init_budget_millis"><a class="link" href="#kudu-tserver_undo_delta_block_gc_init_budget_millis"><code>--undo_delta_block_gc_init_budget_millis</code></a></h3> +<div class="paragraph"> +<p>The maximum number of milliseconds we will spend initializing UNDO delta blocks per invocation of UndoDeltaBlockGCOp. Existing delta blocks must be initialized once per process startup to determine when they can be deleted.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1000</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,evolving</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_flush_threshold_mb"><a class="link" href="#kudu-tserver_flush_threshold_mb"><code>--flush_threshold_mb</code></a></h3> <div class="paragraph"> <p>Size at which MemRowSet flushes are triggered. A MRS can still flush below this threshold if it if hasn’t flushed in a while, or if the server-wide memory limit has been reached.</p> @@ -5239,6 +5967,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_flush_threshold_secs"><a class="link" href="#kudu-tserver_flush_threshold_secs"><code>--flush_threshold_secs</code></a></h3> +<div class="paragraph"> +<p>Number of seconds after which a non-empty MemRowSet will become flushable even if it is not large.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>120</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_tablet_transaction_memory_limit_mb"><a class="link" href="#kudu-tserver_tablet_transaction_memory_limit_mb"><code>--tablet_transaction_memory_limit_mb</code></a></h3> <div class="paragraph"> <p>Maximum amount of memory that may be consumed by all in-flight transactions belonging to a particular tablet. When this limit is reached, new transactions will be rejected and clients will be forced to retry them. If -1, transaction memory tracking is disabled.</p> @@ -5551,9 +6305,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_never_fsync"><a class="link" href="#kudu-tserver_never_fsync"><code>--never_fsync</code></a></h3> +<h3 id="kudu-tserver_env_use_fsync"><a class="link" href="#kudu-tserver_env_use_fsync"><code>--env_use_fsync</code></a></h3> <div class="paragraph"> -<p>Never fsync() anything to disk. This is used by certain test cases to speed up runtime. This is very unsafe to use in production.</p> +<p>Use fsync(2) instead of fdatasync(2) for synchronizing dirty data to disk.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5571,15 +6325,15 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">unsafe,advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_suicide_on_eio"><a class="link" href="#kudu-tserver_suicide_on_eio"><code>--suicide_on_eio</code></a></h3> +<h3 id="kudu-tserver_never_fsync"><a class="link" href="#kudu-tserver_never_fsync"><code>--never_fsync</code></a></h3> <div class="paragraph"> -<p>Kill the process if an I/O operation results in EIO</p> +<p>Never fsync() anything to disk. This is used by certain test cases to speed up runtime. This is very unsafe to use in production.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5593,19 +6347,19 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">unsafe,advanced</p></td> </tr> </tbody> </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_writable_file_use_fsync"><a class="link" href="#kudu-tserver_writable_file_use_fsync"><code>--writable_file_use_fsync</code></a></h3> +<h3 id="kudu-tserver_suicide_on_eio"><a class="link" href="#kudu-tserver_suicide_on_eio"><code>--suicide_on_eio</code></a></h3> <div class="paragraph"> -<p>Use fsync(2) instead of fdatasync(2) for synchronizing dirty data to disk.</p> +<p>Kill the process if an I/O operation results in EIO</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5619,7 +6373,7 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> @@ -5681,9 +6435,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_log_redact_user_data"><a class="link" href="#kudu-tserver_log_redact_user_data"><code>--log_redact_user_data</code></a></h3> +<h3 id="kudu-tserver_redact"><a class="link" href="#kudu-tserver_redact"><code>--redact</code></a></h3> <div class="paragraph"> -<p>Whether log and error messages will have row data redacted.</p> +<p>Comma-separated list of redactions. Supported redactions are 'flag', 'log' and 'all'. If 'flag' is specified, configuration flags which may include sensitive data will be redacted whenever server configuration is emitted. If 'log' is specified, row data will be redacted from log and error messages. If 'all' is specified, all of above will be redacted.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -5693,15 +6447,41 @@ for informational purposes only. They are subject to change or be removed withou <tbody> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>all</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_umask"><a class="link" href="#kudu-tserver_umask"><code>--umask</code></a></h3> +<div class="paragraph"> +<p>The umask that will be used when creating files and directories. Permissions of top-level data directories will also be modified at start-up to conform to the given umask. Changing this value may enable unauthorized local users to read or modify data stored by Kudu.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>077</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> </tr> </tbody> </table> @@ -5733,6 +6513,58 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_data_gc_min_size_mb"><a class="link" href="#kudu-tserver_data_gc_min_size_mb"><code>--data_gc_min_size_mb</code></a></h3> +<div class="paragraph"> +<p>The (exclusive) minimum number of megabytes of ancient data on disk, per tablet, needed to prioritize deletion of that data.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int64</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_data_gc_prioritization_prob"><a class="link" href="#kudu-tserver_data_gc_prioritization_prob"><code>--data_gc_prioritization_prob</code></a></h3> +<div class="paragraph"> +<p>The probability that we will prioritize data GC over performance improvement operations. If set to 1.0, we will always prefer to delete old data before running performance improvement operations such as delta compaction.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>0.5</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_log_target_replay_size_mb"><a class="link" href="#kudu-tserver_log_target_replay_size_mb"><code>--log_target_replay_size_mb</code></a></h3> <div class="paragraph"> <p>The target maximum size of logs to be replayed at startup. If a tablet has in-memory operations that are causing more than this size of logs to be retained, then the maintenance manager will prioritize flushing these operations to disk.</p> @@ -5863,6 +6695,58 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_enable_minidumps"><a class="link" href="#kudu-tserver_enable_minidumps"><code>--enable_minidumps</code></a></h3> +<div class="paragraph"> +<p>Whether to enable minidump generation upon process crash or SIGUSR1. Currently only supported on Linux systems.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>true</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_minidump_size_limit_hint_kb"><a class="link" href="#kudu-tserver_minidump_size_limit_hint_kb"><code>--minidump_size_limit_hint_kb</code></a></h3> +<div class="paragraph"> +<p>Size limit hint for minidump files in KB. If a minidump exceeds this value, then breakpad will reduce the stack memory it collects for each thread from 8KB to 2KB. However it will always include the full stack memory for the first 20 threads, including the thread that crashed.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>20480</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">evolving,advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_local_ip_for_outbound_sockets"><a class="link" href="#kudu-tserver_local_ip_for_outbound_sockets"><code>--local_ip_for_outbound_sockets</code></a></h3> <div class="paragraph"> <p>IP to bind to when making outgoing socket connections. This must be an IP address of the form A.B.C.D, not a hostname. Advanced parameter, subject to change.</p>
http://git-wip-us.apache.org/repos/asf/kudu/blob/d114777e/docs/contributing.html ---------------------------------------------------------------------- diff --git a/docs/contributing.html b/docs/contributing.html index 73423c9..a6d1cbc 100644 --- a/docs/contributing.html +++ b/docs/contributing.html @@ -2,7 +2,7 @@ title: Contributing to Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-02-02 13:49:27 PST' +last_updated: 'Last updated 2017-03-01 12:43:33 PST' --- <!-- @@ -236,9 +236,15 @@ replacement does not exist in the Kudu code base. However:</p> <div class="ulist"> <ul> <li> -<p>Do not introduce dependencies on <code>boost</code> classes not already depended on. We -are actively trying to remove <code>boost</code> from the Kudu code base, and new -dependencies make that work more difficult.</p> +<p>Do not introduce dependencies on <code>boost</code> classes where equivalent functionality +exists in the standard C++ library or in <code>src/kudu/gutil/</code>. For example, prefer +<code>strings::Split()</code> from <code>gutil</code> rather than <code>boost::split</code>.</p> +</li> +<li> +<p>Prefer using functionality from <code>boost</code> rather than re-implementing the same +functionality, <em>unless</em> using the <code>boost</code> functionality requires excessive use of +C++ features which are disallowed by our style guidelines. For example, +<code>boost::spirit</code> is heavily based on template metaprogramming and should not be used.</p> </li> <li> <p>Do not use <code>boost</code> in any public headers for the Kudu C++ client, because @@ -247,6 +253,10 @@ dependencies make that work more difficult.</p> </li> </ul> </div> +<div class="paragraph"> +<p>When in doubt about introducing a new dependency on any <code>boost</code> functionality, +it is best to email <code>[email protected]</code> to start a discussion.</p> +</div> </div> <div class="sect2"> <h3 id="_line_length"><a class="link" href="#_line_length">Line length</a></h3> http://git-wip-us.apache.org/repos/asf/kudu/blob/d114777e/docs/developing.html ---------------------------------------------------------------------- diff --git a/docs/developing.html b/docs/developing.html index a5c6beb..c582423 100644 --- a/docs/developing.html +++ b/docs/developing.html @@ -2,7 +2,7 @@ title: Developing Applications With Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-01-26 16:14:09 PST' +last_updated: 'Last updated 2017-03-01 12:43:33 PST' --- <!-- @@ -188,6 +188,8 @@ Include the kudu-spark dependency using the --packages option:</p> <div class="listingblock"> <div class="content"> <pre class="highlight"><code class="language-scala" data-lang="scala">import org.apache.kudu.spark.kudu._ +import org.apache.kudu.client._ +import collection.JavaConverters._ // Read a table from Kudu val df = sqlContext.read.options(Map("kudu.master" -> "kudu.master:7051","kudu.table" -> "kudu_table")).kudu @@ -204,7 +206,11 @@ val kuduContext = new KuduContext("kudu.master:7051") // Create a new Kudu table from a dataframe schema // NB: No rows from the dataframe are inserted into the table -kuduContext.createTable("test_table", df.schema, Seq("key"), new CreateTableOptions().setNumReplicas(1)) +kuduContext.createTable( + "test_table", df.schema, Seq("key"), + new CreateTableOptions() + .setNumReplicas(1) + .addHashPartitions(List("key").asJava, 3)) // Insert data kuduContext.insertRows(df, "test_table") http://git-wip-us.apache.org/repos/asf/kudu/blob/d114777e/docs/export_control.html ---------------------------------------------------------------------- diff --git a/docs/export_control.html b/docs/export_control.html index bacf560..4c53fc8 100644 --- a/docs/export_control.html +++ b/docs/export_control.html @@ -2,7 +2,7 @@ title: Export Control Notice layout: default active_nav: docs -last_updated: 'Last updated 2017-01-20 13:15:18 PST' +last_updated: 'Last updated 2017-03-01 12:43:33 PST' --- <!-- @@ -56,7 +56,7 @@ software:</p> <ul> <li> <p>This software uses OpenSSL to enable TLS-encrypted connections, -generate keys for assymetric cryptography, and generate and +generate keys for asymmetric cryptography, and generate and verify signatures using those keys.</p> </li> <li> http://git-wip-us.apache.org/repos/asf/kudu/blob/d114777e/docs/index.html ---------------------------------------------------------------------- diff --git a/docs/index.html b/docs/index.html index bf032d0..284b7e5 100644 --- a/docs/index.html +++ b/docs/index.html @@ -2,7 +2,7 @@ title: Introducing Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-01-26 16:14:09 PST' +last_updated: 'Last updated 2017-02-03 10:13:21 PST' --- <!-- http://git-wip-us.apache.org/repos/asf/kudu/blob/d114777e/docs/installation.html ---------------------------------------------------------------------- diff --git a/docs/installation.html b/docs/installation.html index 83c2567..c5b5558 100644 --- a/docs/installation.html +++ b/docs/installation.html @@ -2,7 +2,7 @@ title: Installing Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2017-02-02 13:49:37 PST' +last_updated: 'Last updated 2017-03-01 12:43:33 PST' --- <!-- @@ -78,7 +78,7 @@ three tablet servers is necessary.</p> <p>RHEL 6, RHEL 7, CentOS 6, CentOS 7, Ubuntu 14.04 (Trusty), Ubuntu 16.04 (Xenial), Debian 8 (Jessie), or SLES 12.</p> </li> <li> -<p>A kernel and fileystem that support <em>hole punching</em>. Hole punching is the use of the +<p>A kernel and filesystem that support <em>hole punching</em>. Hole punching is the use of the <code>fallocate(2)</code> system call with the <code>FALLOC_FL_PUNCH_HOLE</code> option set. See <a href="troubleshooting.html#req_hole_punching">troubleshooting hole punching</a> for more information.</p> @@ -456,9 +456,21 @@ $ sudo yum install -y devtoolset-3-toolchain</pre> <p>Optional: Install some additional packages, including ruby, if you plan to build documentation.</p> <div class="listingblock"> <div class="content"> -<pre>$ sudo yum install gem ruby-devel zlib-devel</pre> +<pre>$ sudo yum install doxygen gem graphviz ruby-devel zlib-devel</pre> </div> </div> +<div class="admonitionblock note"> +<table> +<tr> +<td class="icon"> +<i class="fa icon-note" title="Note"></i> +</td> +<td class="content"> +If building on RHEL or CentOS older than 7.0, the gem package may need to be replaced with rubygems +</td> +</tr> +</table> +</div> </li> <li> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> @@ -567,10 +579,10 @@ make -j4</code></pre> </div> </li> <li> -<p>Optional: Install additional packages to build the documentation</p> +<p>Optional: Install some additional packages, including ruby, if you plan to build documentation.</p> <div class="listingblock"> <div class="content"> -<pre>$ sudo apt-get install xsltproc zlib1g-dev gem ruby-dev</pre> +<pre>$ sudo apt-get install doxygen gem graphviz ruby-dev xsltproc zlib1g-dev</pre> </div> </div> </li> @@ -773,7 +785,16 @@ for more information.</p> <div class="listingblock"> <div class="content"> <pre>$ brew tap homebrew/dupes -$ brew install autoconf automake cmake krb5 libtool openssl pkg-config pstree</pre> +$ brew install autoconf automake cmake git krb5 libtool openssl pkg-config pstree</pre> +</div> +</div> +</li> +<li> +<p>Optional: Install some additional packages, including ruby, if you plan to build documentation.</p> +<div class="listingblock"> +<div class="content"> +<pre>$ brew install doxygen graphviz ruby +$ brew install gnu-sed --with-default-names #The macOS default sed handles the -i parameter differently</pre> </div> </div> </li> @@ -850,7 +871,7 @@ are installed.</p> <pre>#!/bin/bash brew tap homebrew/dupes -brew install autoconf automake cmake krb5 libtool openssl pkg-config pstree +brew install autoconf automake cmake git krb5 libtool openssl pkg-config pstree git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh
