http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/configuration_reference_unsupported.html b/docs/configuration_reference_unsupported.html index d51b697..a49ea97 100644 --- a/docs/configuration_reference_unsupported.html +++ b/docs/configuration_reference_unsupported.html @@ -431,9 +431,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_log_min_seconds_to_retain"><a class="link" href="#kudu-master_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h3> +<h3 id="kudu-master_log_max_segments_to_retain"><a class="link" href="#kudu-master_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h3> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -447,11 +447,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -1159,32 +1159,6 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_master_addresses"><a class="link" href="#kudu-master_master_addresses"><code>--master_addresses</code></a></h3> -<div class="paragraph"> -<p>Comma-separated list of all the RPC addresses for Master config. This is used to configure the replicated Master process (currently considered experimental). NOTE: if not specified, configures a non-replicated Master.</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> -</tr> -</tbody> -</table> -</div> -<div class="sect2"> <h3 id="kudu-master_tserver_unresponsive_timeout_ms"><a class="link" href="#kudu-master_tserver_unresponsive_timeout_ms"><code>--tserver_unresponsive_timeout_ms</code></a></h3> <div class="paragraph"> <p>The period of time that a Master can go without receiving a heartbeat from a tablet server before considering it unresponsive. Unresponsive servers are not selected when assigning replicas during table creation or re-replication.</p> @@ -1783,6 +1757,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_compaction_approximation_ratio"><a class="link" href="#kudu-master_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h3> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_deltafile_default_block_size"><a class="link" href="#kudu-master_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h3> <div class="paragraph"> <p>Block size for delta files. In the future, this may become configurable on a per-table basis.</p> @@ -1965,6 +1965,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_tablet_history_max_age_sec"><a class="link" href="#kudu-master_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h3> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_tablet_throttler_burst_factor"><a class="link" href="#kudu-master_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h3> <div class="paragraph"> <p>Burst factor for write RPC throttling. The maximum rate the throttler allows within a token refill period (100ms) equals burst factor multiply base rate.</p> @@ -3015,9 +3041,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_log_min_seconds_to_retain"><a class="link" href="#kudu-tserver_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h3> +<h3 id="kudu-tserver_log_max_segments_to_retain"><a class="link" href="#kudu-tserver_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h3> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -3031,11 +3057,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -4081,6 +4107,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_compaction_approximation_ratio"><a class="link" href="#kudu-tserver_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h3> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_deltafile_default_block_size"><a class="link" href="#kudu-tserver_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h3> <div class="paragraph"> <p>Block size for delta files. In the future, this may become configurable on a per-table basis.</p> @@ -4263,6 +4315,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_tablet_history_max_age_sec"><a class="link" href="#kudu-tserver_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h3> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_tablet_throttler_burst_factor"><a class="link" href="#kudu-tserver_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h3> <div class="paragraph"> <p>Burst factor for write RPC throttling. The maximum rate the throttler allows within a token refill period (100ms) equals burst factor multiply base rate.</p> @@ -5088,7 +5166,7 @@ for informational purposes only. They are subject to change or be removed withou </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 23:33:19 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-19 19:01:39 PDT </p> </footer> </div>
http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/contributing.html ---------------------------------------------------------------------- diff --git a/docs/contributing.html b/docs/contributing.html index 24dd105..e2b5ee8 100644 --- a/docs/contributing.html +++ b/docs/contributing.html @@ -144,7 +144,7 @@ If you do not update your name, it will show up as "Anonymous Coward" in Gerrit is called <code>origin</code>. When you fetch or pull, you will do so from <code>origin</code>.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">git clone https://github.com/apache/incubator-kudu kudu</code></pre> +<pre class="highlight"><code class="language-bash" data-lang="bash">git clone https://github.com/apache/kudu</code></pre> </div> </div> </li> @@ -208,6 +208,19 @@ to the <code>master</code> branch:</p> <pre>git push gerrit HEAD:refs/for/gh-pages --no-thin</pre> </div> </div> +<div class="admonitionblock tip"> +<table> +<tr> +<td class="icon"> +<i class="fa icon-tip" title="Tip"></i> +</td> +<td class="content"> +While preparing a patch for review, it’s a good idea to follow +<a href="https://git-scm.com/book/en/v2/Distributed-Git-Contributing-to-a-Project#_commit_guidelines">generic git commit guidelines and good practices</a>. +</td> +</tr> +</table> +</div> <div class="admonitionblock note"> <table> <tr> @@ -330,7 +343,8 @@ keep under 80 where possible, but you can spill over to 100 or so if necessary.< <div class="title">Smart Pointers and Singly-Owned Pointers</div> <p>Generally, most objects should have clear "single-owner" semantics. Most of the time, singly-owned objects can be wrapped in a <code>gscoped_ptr<></code> -which ensures deletion on scope exit and prevents accidental copying. +or in a <code>unique_ptr</code> which ensures deletion on scope +exit and prevents accidental copying. <code>gscoped_ptr</code> is similar to C++11’s <code>unique_ptr</code> in that it has a <code>release</code> method and also provides emulated <code>move</code> semantics (see <em>gscoped_ptr.h</em> for example usage).</p> @@ -364,7 +378,8 @@ contained elements.</p> </td> <td class="content"> Using <code>std::auto_ptr</code> is strictly disallowed because of its difficult and -bug-prone semantics. +bug-prone semantics. Besides, <code>std::auto_ptr</code> is declared deprecated +since C++11. </td> </tr> </table> @@ -373,7 +388,7 @@ bug-prone semantics. <div class="title">Smart Pointers for Multiply-Owned Pointers:</div> <p>Although single ownership is ideal, sometimes it is not possible, particularly when multiple threads are in play and the lifetimes of the pointers are not -clearly defined. In these cases, you can use either <code>std::tr1::shared_ptr</code> or +clearly defined. In these cases, you can use either <code>std::shared_ptr</code> or Kudu’s own <code>scoped_refptr</code> from <em>gutil/ref_counted.hpp</em>. Each of these mechanisms relies on reference counting to automatically delete the referent once no more pointers remain. The key difference between these two types of pointers is that @@ -396,8 +411,31 @@ object deriving from a special base class</p> C++ developers</p> </li> <li> -<p><span class="icon red"><i class="fa fa-minus-circle"></i></span> creating a new object requires two allocations instead -of one (one to create the ref count, and one to create the object)</p> +<p><span class="icon green"><i class="fa fa-plus-circle"></i></span> supports the <code>weak_ptr</code> use cases:</p> +<div class="ulist"> +<ul> +<li> +<p>a temporary ownership when an object needs to be accessed only if it exists</p> +</li> +<li> +<p>break circular references of <code>shared_ptr</code>, if any exists due to aggregation</p> +</li> +</ul> +</div> +</li> +<li> +<p><span class="icon green"><i class="fa fa-minus-circle"></i></span> you can convert from the +<code>shared_ptr</code> into the <code>weak_ptr</code> and back</p> +</li> +<li> +<p><span class="icon green"><i class="fa fa-plus-circle"></i></span> if creating an instance with +<code>std::make_shared<>()</code> only one allocation is made (since C++11; +a non-binding requirement in the Standard, though)</p> +</li> +<li> +<p><span class="icon red"><i class="fa fa-minus-circle"></i></span> if creating a new object with +<code>shared_ptr<T> p(new T)</code> requires two allocations (one to create the ref count, +and one to create the object)</p> </li> <li> <p><span class="icon red"><i class="fa fa-minus-circle"></i></span> the ref count may not be near the object on the heap, @@ -407,10 +445,6 @@ so extra cache misses may be incurred on access</p> <p><span class="icon red"><i class="fa fa-minus-circle"></i></span> the <code>shared_ptr</code> instance itself requires 16 bytes (pointer to the ref count and pointer to the object)</p> </li> -<li> -<p><span class="icon red"><i class="fa fa-minus-circle"></i></span> if you convert from the <code>shared_ptr</code> to a raw pointer, -you can’t get back the <code>shared_ptr</code></p> -</li> </ul> </div> <div class="ulist none"> @@ -442,7 +476,7 @@ referent to help debug leaks.</p> from <code>RefCounted</code></p> </li> <li> -<p><span class="icon red"><i class="fa fa-minus-circle fa-con"></i></span> does not support <code>weak_ptr<></code> use cases</p> +<p><span class="icon red"><i class="fa fa-minus-circle fa-con"></i></span> does not support the <code>weak_ptr</code> use cases</p> </li> </ul> </div> @@ -716,7 +750,7 @@ to the official Kudu documentation.</p> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 23:17:27 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-08 16:11:36 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/developing.html ---------------------------------------------------------------------- diff --git a/docs/developing.html b/docs/developing.html index 424cb5f..dec75dd 100644 --- a/docs/developing.html +++ b/docs/developing.html @@ -317,9 +317,9 @@ kuduContext.deleteTable("unwanted_table")</code></pre> <div class="paragraph"> <p>Kudu was designed to integrate with MapReduce, YARN, Spark, and other frameworks in the Hadoop ecosystem. See -<a href="https://github.com/apache/incubator-kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/RowCounter.java">RowCounter.java</a> +<a href="https://github.com/apache/kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/RowCounter.java">RowCounter.java</a> and -<a href="https://github.com/apache/incubator-kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ImportCsv.java">ImportCsv.java</a> +<a href="https://github.com/apache/kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ImportCsv.java">ImportCsv.java</a> for examples which you can model your own integrations on. Stay tuned for more examples using YARN and Spark in the future.</p> </div> @@ -404,7 +404,7 @@ using YARN and Spark in the future.</p> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-19 17:48:32 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-06 15:17:09 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/index.html ---------------------------------------------------------------------- diff --git a/docs/index.html b/docs/index.html index f35deec..78b6d1f 100644 --- a/docs/index.html +++ b/docs/index.html @@ -548,7 +548,7 @@ formats using Impala, without the need to change your legacy systems.</p> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 12:38:14 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-06 15:17:09 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/installation.html ---------------------------------------------------------------------- diff --git a/docs/installation.html b/docs/installation.html index ac117da..61cca2c 100644 --- a/docs/installation.html +++ b/docs/installation.html @@ -148,7 +148,8 @@ version 5.4.7 or newer. If you use Cloudera Manager, see also Cloudera’s <div class="title">Hardware</div> <ul> <li> -<p>A host to run the Kudu master.</p> +<p>One or more hosts to run Kudu masters. It is recommended to have either one master +(no fault tolerance), three masters (can tolerate one failure), or five masters (two failures).</p> </li> <li> <p>One or more hosts to run Kudu tablet servers. When using replication, a minimum of @@ -164,7 +165,7 @@ three tablet servers is necessary.</p> <div class="ulist"> <ul> <li> -<p>RHEL 6, RHEL 7, Ubuntu 14.04 (Trusty), Debian 8 (Jessie), or SLES 12.</p> +<p>RHEL 6, RHEL 7, CentOS 6, CentOS 7, Ubuntu 14.04 (Trusty), Ubuntu 16.04 (Xenial), Debian 8 (Jessie), or SLES 12.</p> </li> <li> <p>A kernel and fileystem that support <em>hole punching</em>. Hole punching is the use of the @@ -246,45 +247,33 @@ Cloudera Manager 5.4.7 and newer provide better monitoring and administration op </thead> <tbody> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/cloudera-kudu.repo">RHEL 6</a>, - <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/cloudera-kudu.repo">RHEL 7</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/0.8.0/RPMS/x86_64/">RHEL 6</a>, - <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/0.8.0/RPMS/x86_64/">RHEL 7</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL or CentOS</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/cloudera-kudu.repo">RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/cloudera-kudu.repo">RHEL 7 or CentOS 7</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/0/RPMS/x86_64/">RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/0/RPMS/x86_64/">RHEL 7 or CentOS 7</a></p></td> </tr> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/cloudera.list">Trusty</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/pool/contrib/k/kudu/">Trusty</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>SLES</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/sles/12/x86_64/kudu/cloudera-kudu.repo">SLES 12</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/sles/12/x86_64/kudu/0/RPMS/x86_64/">SLES 12</a></p></td> </tr> -</tbody> -</table> -<div class="admonitionblock note"> -<table> <tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -For later versions of Ubuntu, the Ubuntu Trusty packages are reported to install, though they have not been extensively tested. -</td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/cloudera.list">Trusty</a>, + <a href="http://archive.cloudera.com/beta/kudu/ubuntu/xenial/amd64/kudu/cloudera.list">Xenial</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/pool/contrib/k/kudu/">Trusty</a>, + <a href="http://archive.cloudera.com/beta/kudu/ubuntu/xenial/amd64/kudu/pool/contrib/k/kudu/">Xenial</a></p></td> </tr> -</table> -</div> -<div class="admonitionblock note"> -<table> <tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -packages are not yet provided for SLES. -</td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Debian</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/debian/jessie/amd64/kudu/cloudera.list">Jessie</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/debian/jessie/amd64/kudu/pool/contrib/k/kudu/">Jessie</a></p></td> </tr> +</tbody> </table> -</div> <div class="sect2"> -<h3 id="_install_on_rhel_hosts"><a class="link" href="#_install_on_rhel_hosts">Install On RHEL Hosts</a></h3> +<h3 id="_install_on_rhel_or_centos_hosts"><a class="link" href="#_install_on_rhel_or_centos_hosts">Install on RHEL or CentOS Hosts</a></h3> <div class="olist arabic"> <ol class="arabic"> <li> @@ -306,15 +295,55 @@ sudo yum install kudu-client-devel # Kudu C++ client SDK</pre> </li> <li> <p>To manually install the Kudu RPMs, first download them, then use the command -<code>sudo rpm -ivh <RPM to install></code> and install the -<code>kudu-master</code> and <code>kudu-tserver</code> packages on the appropriate hosts. These packages -provide the operating system commands to start and stop Kudu.</p> +<code>sudo rpm -ivh <RPM to install></code> to install them.</p> +</li> +<li> +<p>Note: the <code>kudu-master</code> and <code>kudu-tserver</code> packages are only necessary on hosts +where there is a master or tserver respectively (and completely unnecessary if +using Cloudera Manager). Each provides configuration files and an init.d script to +manage the corresponding Kudu process. Once installed, the Kudu process is started +and stopped automatically when the host starts up and shuts down.</p> +</li> +</ol> +</div> +</div> +<div class="sect2"> +<h3 id="_install_on_sles_hosts"><a class="link" href="#_install_on_sles_hosts">Install on SLES Hosts</a></h3> +<div class="olist arabic"> +<ol class="arabic"> +<li> +<p>Download and configure the Kudu repositories for your operating system, or manually +download individual RPMs, using the appropriate link from <a href="#kudu_package_locations">Kudu Package Locations</a>.</p> +</li> +<li> +<p>If using a Zypper repository, use the following commands to install Kudu packages on +each host, after saving the <code>cloudera-kudu.repo</code> file to <code>/etc/zypp/repos.d</code>.</p> +<div class="listingblock"> +<div class="content"> +<pre>sudo zypper install kudu # Base Kudu files +sudo zypper install kudu-master # Kudu master init.d service script and default configuration +sudo zypper install kudu-tserver # Kudu tablet server init.d service script and default configuration +sudo zypper install kudu-client0 # Kudu C++ client shared library +sudo zypper install kudu-client-devel # Kudu C++ client SDK</pre> +</div> +</div> +</li> +<li> +<p>To manually install the Kudu RPMs, first download them, then use the command +<code>sudo rpm -ivh <RPM to install></code> to install them.</p> +</li> +<li> +<p>Note: the <code>kudu-master</code> and <code>kudu-tserver</code> packages are only necessary on hosts +where there is a master or tserver respectively (and completely unnecessary if +using Cloudera Manager). Each provides configuration files and an init.d script to +manage the corresponding Kudu process. Once installed, the Kudu process is started +and stopped automatically when the host starts up and shuts down.</p> </li> </ol> </div> </div> <div class="sect2"> -<h3 id="_install_on_ubuntu_or_debian_hosts"><a class="link" href="#_install_on_ubuntu_or_debian_hosts">Install On Ubuntu or Debian Hosts</a></h3> +<h3 id="_install_on_ubuntu_or_debian_hosts"><a class="link" href="#_install_on_ubuntu_or_debian_hosts">Install on Ubuntu or Debian Hosts</a></h3> <div class="olist arabic"> <ol class="arabic"> <li> @@ -331,8 +360,15 @@ sudo apt-get install libkuduclient-dev # Kudu C++ client SDK</pre> </div> </li> <li> -<p>To manually install individual DEBs, first download them, then use the command -<code>sudo dpkg -i <DEB to install></code> to install them.</p> +<p>To manually install the Kudu RPMs, first download them, then use the command +<code>sudo rpm -ivh <RPM to install></code> to install them.</p> +</li> +<li> +<p>Note: the <code>kudu-master</code> and <code>kudu-tserver</code> packages are only necessary on hosts +where there is a master or tserver respectively (and completely unnecessary if +using Cloudera Manager). Each provides configuration files and an init.d script to +manage the corresponding Kudu process. Once installed, the Kudu process is started +and stopped automatically when the host starts up and shuts down.</p> </li> </ol> </div> @@ -428,8 +464,8 @@ $ sudo service kudu-tserver stop</code></pre> them to the default runlevel.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ sudo chkconfig kudu-master on # RHEL / CentOS -$ sudo chkconfig kudu-tserver on # RHEL / CentOS +<pre class="highlight"><code class="language-bash" data-lang="bash">$ sudo chkconfig kudu-master on # RHEL / CentOS / SLES +$ sudo chkconfig kudu-tserver on # RHEL / CentOS / SLES $ sudo update-rc.d kudu-master defaults # Debian / Ubuntu $ sudo update-rc.d kudu-tserver defaults # Debian / Ubuntu</code></pre> @@ -517,7 +553,7 @@ $ sudo yum install -y devtoolset-3-toolchain</pre> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -628,7 +664,7 @@ make -j4</code></pre> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -690,7 +726,7 @@ the steps marked <strong>Optional</strong> above.</p> sudo apt-get -y install git autoconf automake \ curl gcc g++ libsasl2-dev libsasl2-modules \ libtool ntp patch pkg-config make rsync unzip vim-common gdb python lsb-release -git clone https://github.com/apache/incubator-kudu kudu +git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh mkdir -p build/release @@ -721,7 +757,7 @@ make -j4</code></pre> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -775,7 +811,7 @@ the steps marked <strong>Optional</strong> above.</p> sudo zypper install autoconf automake curl cyrus-sasl-devel gcc gcc-c++ \ gdb git libtool make ntp patch pkg-config python rsync unzip vim lsb-release -git clone https://github.com/apache/incubator-kudu kudu +git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh mkdir -p build/release @@ -827,7 +863,7 @@ for more information.</p> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -893,7 +929,7 @@ are installed.</p> <pre>#!/bin/bash brew install autoconf automake cmake libtool pkg-config pstree -git clone https://github.com/apache/incubator-kudu kudu +git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh mkdir -p build/release @@ -1047,6 +1083,15 @@ sudo yum upgrade kudu</code></pre> </div> </li> <li> +<p>On SLES hosts:</p> +<div class="listingblock"> +<div class="content"> +<pre class="highlight"><code class="language-bash" data-lang="bash">sudo zypper clean --all +sudo zypper update kudu</code></pre> +</div> +</div> +</li> +<li> <p>On Ubuntu or Debian hosts:</p> <div class="listingblock"> <div class="content"> @@ -1111,8 +1156,9 @@ $ sudo service kudu-tserver start</code></pre> <li><a href="#_prerequisites_and_requirements">Prerequisites and Requirements</a></li> <li><a href="#install_packages">Install Using Packages</a> <ul class="sectlevel2"> -<li><a href="#_install_on_rhel_hosts">Install On RHEL Hosts</a></li> -<li><a href="#_install_on_ubuntu_or_debian_hosts">Install On Ubuntu or Debian Hosts</a></li> +<li><a href="#_install_on_rhel_or_centos_hosts">Install on RHEL or CentOS Hosts</a></li> +<li><a href="#_install_on_sles_hosts">Install on SLES Hosts</a></li> +<li><a href="#_install_on_ubuntu_or_debian_hosts">Install on Ubuntu or Debian Hosts</a></li> <li><a href="#_verify_the_installation">Verify the Installation</a></li> <li><a href="#required_config_without_cm">Required Configuration</a></li> </ul> @@ -1183,7 +1229,7 @@ $ sudo service kudu-tserver start</code></pre> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 12:38:14 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-08 16:11:36 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/kudu-master_configuration_reference.html ---------------------------------------------------------------------- diff --git a/docs/kudu-master_configuration_reference.html b/docs/kudu-master_configuration_reference.html index c3b6750..56b7af4 100644 --- a/docs/kudu-master_configuration_reference.html +++ b/docs/kudu-master_configuration_reference.html @@ -239,6 +239,35 @@ configuration tasks.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_master_addresses"><a class="link" href="#kudu-master_master_addresses"><code>--master_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of the RPC addresses belonging to all Masters in this cluster. NOTE: if not specified, configures a non-replicated Master.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_rpc_bind_addresses"><a class="link" href="#kudu-master_rpc_bind_addresses"><code>--rpc_bind_addresses</code></a></h3> <div class="paragraph"> <p>Comma-separated list of addresses to bind to for RPC connections. Currently, ephemeral ports (i.e. port 0) are not allowed.</p> @@ -654,6 +683,64 @@ configuration tasks.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_unlock_experimental_flags"><a class="link" href="#kudu-master_unlock_experimental_flags"><code>--unlock_experimental_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'experimental'. These flags are not guaranteed to be maintained across releases of Kudu, and may enable features or behavior known to be unstable. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> +<h3 id="kudu-master_unlock_unsafe_flags"><a class="link" href="#kudu-master_unlock_unsafe_flags"><code>--unlock_unsafe_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'unsafe'. These flags are not guaranteed to be maintained across releases of Kudu, and enable features or behavior known to be unsafe. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_fromenv"><a class="link" href="#kudu-master_fromenv"><code>--fromenv</code></a></h3> <div class="paragraph"> <p>set flags from the environment [use 'export FLAGS_flag1=value']</p> @@ -1189,7 +1276,7 @@ configuration tasks.</p> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 23:33:19 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-19 19:01:39 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/kudu-master_configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/kudu-master_configuration_reference_unsupported.html b/docs/kudu-master_configuration_reference_unsupported.html index 051ec86..4314ab0 100644 --- a/docs/kudu-master_configuration_reference_unsupported.html +++ b/docs/kudu-master_configuration_reference_unsupported.html @@ -432,10 +432,10 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> -<h2 id="kudu-master_log_min_seconds_to_retain"><a class="link" href="#kudu-master_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h2> +<h2 id="kudu-master_log_max_segments_to_retain"><a class="link" href="#kudu-master_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h2> <div class="sectionbody"> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -449,11 +449,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -1216,34 +1216,6 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> -<h2 id="kudu-master_master_addresses"><a class="link" href="#kudu-master_master_addresses"><code>--master_addresses</code></a></h2> -<div class="sectionbody"> -<div class="paragraph"> -<p>Comma-separated list of all the RPC addresses for Master config. This is used to configure the replicated Master process (currently considered experimental). NOTE: if not specified, configures a non-replicated Master.</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> -</tr> -</tbody> -</table> -</div> -</div> -<div class="sect1"> <h2 id="kudu-master_tserver_unresponsive_timeout_ms"><a class="link" href="#kudu-master_tserver_unresponsive_timeout_ms"><code>--tserver_unresponsive_timeout_ms</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -1888,6 +1860,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-master_compaction_approximation_ratio"><a class="link" href="#kudu-master_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-master_deltafile_default_block_size"><a class="link" href="#kudu-master_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -2084,6 +2084,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-master_tablet_history_max_age_sec"><a class="link" href="#kudu-master_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-master_tablet_throttler_burst_factor"><a class="link" href="#kudu-master_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -2965,7 +2993,7 @@ for informational purposes only. They are subject to change or be removed withou </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 23:33:19 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-19 19:01:39 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/kudu-tserver_configuration_reference.html ---------------------------------------------------------------------- diff --git a/docs/kudu-tserver_configuration_reference.html b/docs/kudu-tserver_configuration_reference.html index 622da3a..c08b984 100644 --- a/docs/kudu-tserver_configuration_reference.html +++ b/docs/kudu-tserver_configuration_reference.html @@ -683,6 +683,64 @@ configuration tasks.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-tserver_unlock_experimental_flags"><a class="link" href="#kudu-tserver_unlock_experimental_flags"><code>--unlock_experimental_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'experimental'. These flags are not guaranteed to be maintained across releases of Kudu, and may enable features or behavior known to be unstable. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_unlock_unsafe_flags"><a class="link" href="#kudu-tserver_unlock_unsafe_flags"><code>--unlock_unsafe_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'unsafe'. These flags are not guaranteed to be maintained across releases of Kudu, and enable features or behavior known to be unsafe. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-tserver_fromenv"><a class="link" href="#kudu-tserver_fromenv"><code>--fromenv</code></a></h3> <div class="paragraph"> <p>set flags from the environment [use 'export FLAGS_flag1=value']</p> @@ -1218,7 +1276,7 @@ configuration tasks.</p> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 23:33:19 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-19 19:01:39 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/kudu-tserver_configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/kudu-tserver_configuration_reference_unsupported.html b/docs/kudu-tserver_configuration_reference_unsupported.html index 710c699..7ff9fc6 100644 --- a/docs/kudu-tserver_configuration_reference_unsupported.html +++ b/docs/kudu-tserver_configuration_reference_unsupported.html @@ -432,10 +432,10 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> -<h2 id="kudu-tserver_log_min_seconds_to_retain"><a class="link" href="#kudu-tserver_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h2> +<h2 id="kudu-tserver_log_max_segments_to_retain"><a class="link" href="#kudu-tserver_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h2> <div class="sectionbody"> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -449,11 +449,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -1580,6 +1580,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-tserver_compaction_approximation_ratio"><a class="link" href="#kudu-tserver_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-tserver_deltafile_default_block_size"><a class="link" href="#kudu-tserver_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -1776,6 +1804,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-tserver_tablet_history_max_age_sec"><a class="link" href="#kudu-tserver_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-tserver_tablet_throttler_burst_factor"><a class="link" href="#kudu-tserver_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -2657,7 +2713,7 @@ for informational purposes only. They are subject to change or be removed withou </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-22 23:33:19 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-19 19:01:39 PDT </p> </footer> </div> http://git-wip-us.apache.org/repos/asf/kudu-site/blob/1db5f764/docs/kudu_impala_integration.html ---------------------------------------------------------------------- diff --git a/docs/kudu_impala_integration.html b/docs/kudu_impala_integration.html index d449919..e7468eb 100644 --- a/docs/kudu_impala_integration.html +++ b/docs/kudu_impala_integration.html @@ -394,11 +394,11 @@ hosted on <code>cloudera.com</code>.</p> <div class="title">Procedure</div> <ul> <li> -<p>Download the <code>deploy.py</code> from <a href="https://github.com/cloudera/impala-kudu/blob/feature/kudu/infra/deploy/deploy.py" class="bare">https://github.com/cloudera/impala-kudu/blob/feature/kudu/infra/deploy/deploy.py</a> +<p>Download the <code>deploy.py</code> from <a href="https://github.com/apache/incubator-impala/blob/master/infra/deploy/deploy.py" class="bare">https://github.com/apache/incubator-impala/blob/master/infra/deploy/deploy.py</a> using <code>curl</code> or another utility of your choice.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ curl -O https://raw.githubusercontent.com/cloudera/impala-kudu/feature/kudu/infra/deploy/deploy.py</code></pre> +<pre class="highlight"><code class="language-bash" data-lang="bash">$ curl -O https://raw.githubusercontent.com/apache/incubator-impala/master/infra/deploy/deploy.py</code></pre> </div> </div> </li> @@ -492,9 +492,11 @@ alongside another Impala instance if you use packages.</p> </thead> <tbody> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo">RHEL 6</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0.5.0/RPMS/x86_64/">RHEL 6</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL or CentOS</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo">RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/cloudera-impala-kudu.repo">RHEL 7 or CentOS 7</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0/RPMS/x86_64/">RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/0/RPMS/x86_64/">RHEL 7 or CentOS 7</a></p></td> </tr> <tr> <td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> @@ -583,9 +585,11 @@ Instead, follow <a href="#install_impala_kudu_packages">Installing Impala_Kudu U </thead> <tbody> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo">RHEL 6</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0.5.0/RPMS/x86_64/">RHEL 6</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL or CentOS</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo">RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/cloudera-impala-kudu.repo">RHEL 7 or CentOS 7</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0/RPMS/x86_64/">RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/0/RPMS/x86_64/">RHEL 7 or CentOS 7</a></p></td> </tr> <tr> <td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> @@ -655,7 +659,7 @@ provides the Impala query to map to an existing Kudu table in the web UI.</p> <li> <p>Be sure you are using the <code>impala-shell</code> binary provided by the Impala_Kudu package, rather than the default CDH Impala binary. The following shows how to verify this -using the <code>alternatives</code> command on a RHEL 6 host.</p> +using the <code>alternatives</code> command on a RHEL or CentOS host.</p> <div class="listingblock"> <div class="content"> <pre class="highlight"><code class="language-bash" data-lang="bash">$ sudo alternatives --display impala-shell @@ -1751,7 +1755,7 @@ data.</p> </div> <footer class="footer"> <p class="small"> - Copyright © 2016 The Apache Software Foundation. Last updated 2016-08-19 17:48:32 PDT + Copyright © 2016 The Apache Software Foundation. Last updated 2016-09-08 16:11:36 PDT </p> </footer> </div>