http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/configuration_reference_unsupported.html b/docs/configuration_reference_unsupported.html index 619a784..53630ac 100644 --- a/docs/configuration_reference_unsupported.html +++ b/docs/configuration_reference_unsupported.html @@ -2,7 +2,7 @@ title: Apache Kudu Unsupported Configuration Flags layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 23:33:19 PDT' +last_updated: 'Last updated 2016-09-19 19:01:39 PDT' --- <!-- @@ -341,9 +341,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_log_min_seconds_to_retain"><a class="link" href="#kudu-master_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h3> +<h3 id="kudu-master_log_max_segments_to_retain"><a class="link" href="#kudu-master_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h3> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -357,11 +357,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -1069,32 +1069,6 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-master_master_addresses"><a class="link" href="#kudu-master_master_addresses"><code>--master_addresses</code></a></h3> -<div class="paragraph"> -<p>Comma-separated list of all the RPC addresses for Master config. This is used to configure the replicated Master process (currently considered experimental). NOTE: if not specified, configures a non-replicated Master.</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> -</tr> -</tbody> -</table> -</div> -<div class="sect2"> <h3 id="kudu-master_tserver_unresponsive_timeout_ms"><a class="link" href="#kudu-master_tserver_unresponsive_timeout_ms"><code>--tserver_unresponsive_timeout_ms</code></a></h3> <div class="paragraph"> <p>The period of time that a Master can go without receiving a heartbeat from a tablet server before considering it unresponsive. Unresponsive servers are not selected when assigning replicas during table creation or re-replication.</p> @@ -1693,6 +1667,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_compaction_approximation_ratio"><a class="link" href="#kudu-master_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h3> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_deltafile_default_block_size"><a class="link" href="#kudu-master_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h3> <div class="paragraph"> <p>Block size for delta files. In the future, this may become configurable on a per-table basis.</p> @@ -1875,6 +1875,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-master_tablet_history_max_age_sec"><a class="link" href="#kudu-master_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h3> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-master_tablet_throttler_burst_factor"><a class="link" href="#kudu-master_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h3> <div class="paragraph"> <p>Burst factor for write RPC throttling. The maximum rate the throttler allows within a token refill period (100ms) equals burst factor multiply base rate.</p> @@ -2925,9 +2951,9 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> -<h3 id="kudu-tserver_log_min_seconds_to_retain"><a class="link" href="#kudu-tserver_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h3> +<h3 id="kudu-tserver_log_max_segments_to_retain"><a class="link" href="#kudu-tserver_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h3> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -2941,11 +2967,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -3991,6 +4017,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_compaction_approximation_ratio"><a class="link" href="#kudu-tserver_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h3> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_deltafile_default_block_size"><a class="link" href="#kudu-tserver_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h3> <div class="paragraph"> <p>Block size for delta files. In the future, this may become configurable on a per-table basis.</p> @@ -4173,6 +4225,32 @@ for informational purposes only. They are subject to change or be removed withou </table> </div> <div class="sect2"> +<h3 id="kudu-tserver_tablet_history_max_age_sec"><a class="link" href="#kudu-tserver_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h3> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +<div class="sect2"> <h3 id="kudu-tserver_tablet_throttler_burst_factor"><a class="link" href="#kudu-tserver_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h3> <div class="paragraph"> <p>Burst factor for write RPC throttling. The maximum rate the throttler allows within a token refill period (100ms) equals burst factor multiply base rate.</p>
http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/contributing.html ---------------------------------------------------------------------- diff --git a/docs/contributing.html b/docs/contributing.html index 00609d3..a0d3cfe 100644 --- a/docs/contributing.html +++ b/docs/contributing.html @@ -2,7 +2,7 @@ title: Contributing to Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 23:17:27 PDT' +last_updated: 'Last updated 2016-09-08 16:11:36 PDT' --- <!-- @@ -54,7 +54,7 @@ If you do not update your name, it will show up as "Anonymous Coward" in Gerrit is called <code>origin</code>. When you fetch or pull, you will do so from <code>origin</code>.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">git clone https://github.com/apache/incubator-kudu kudu</code></pre> +<pre class="highlight"><code class="language-bash" data-lang="bash">git clone https://github.com/apache/kudu</code></pre> </div> </div> </li> @@ -118,6 +118,19 @@ to the <code>master</code> branch:</p> <pre>git push gerrit HEAD:refs/for/gh-pages --no-thin</pre> </div> </div> +<div class="admonitionblock tip"> +<table> +<tr> +<td class="icon"> +<i class="fa icon-tip" title="Tip"></i> +</td> +<td class="content"> +While preparing a patch for review, it’s a good idea to follow +<a href="https://git-scm.com/book/en/v2/Distributed-Git-Contributing-to-a-Project#_commit_guidelines";>generic git commit guidelines and good practices</a>. +</td> +</tr> +</table> +</div> <div class="admonitionblock note"> <table> <tr> @@ -240,7 +253,8 @@ keep under 80 where possible, but you can spill over to 100 or so if necessary.< <div class="title">Smart Pointers and Singly-Owned Pointers</div> <p>Generally, most objects should have clear "single-owner" semantics. Most of the time, singly-owned objects can be wrapped in a <code>gscoped_ptr<></code> -which ensures deletion on scope exit and prevents accidental copying. +or in a <code>unique_ptr</code> which ensures deletion on scope +exit and prevents accidental copying. <code>gscoped_ptr</code> is similar to C++11’s <code>unique_ptr</code> in that it has a <code>release</code> method and also provides emulated <code>move</code> semantics (see <em>gscoped_ptr.h</em> for example usage).</p> @@ -274,7 +288,8 @@ contained elements.</p> </td> <td class="content"> Using <code>std::auto_ptr</code> is strictly disallowed because of its difficult and -bug-prone semantics. +bug-prone semantics. Besides, <code>std::auto_ptr</code> is declared deprecated +since C++11. </td> </tr> </table> @@ -283,7 +298,7 @@ bug-prone semantics. <div class="title">Smart Pointers for Multiply-Owned Pointers:</div> <p>Although single ownership is ideal, sometimes it is not possible, particularly when multiple threads are in play and the lifetimes of the pointers are not -clearly defined. In these cases, you can use either <code>std::tr1::shared_ptr</code> or +clearly defined. In these cases, you can use either <code>std::shared_ptr</code> or Kudu’s own <code>scoped_refptr</code> from <em>gutil/ref_counted.hpp</em>. Each of these mechanisms relies on reference counting to automatically delete the referent once no more pointers remain. The key difference between these two types of pointers is that @@ -306,8 +321,31 @@ object deriving from a special base class</p> C++ developers</p> </li> <li> -<p><span class="icon red"><i class="fa fa-minus-circle"></i></span> creating a new object requires two allocations instead -of one (one to create the ref count, and one to create the object)</p> +<p><span class="icon green"><i class="fa fa-plus-circle"></i></span> supports the <code>weak_ptr</code> use cases:</p> +<div class="ulist"> +<ul> +<li> +<p>a temporary ownership when an object needs to be accessed only if it exists</p> +</li> +<li> +<p>break circular references of <code>shared_ptr</code>, if any exists due to aggregation</p> +</li> +</ul> +</div> +</li> +<li> +<p><span class="icon green"><i class="fa fa-minus-circle"></i></span> you can convert from the +<code>shared_ptr</code> into the <code>weak_ptr</code> and back</p> +</li> +<li> +<p><span class="icon green"><i class="fa fa-plus-circle"></i></span> if creating an instance with +<code>std::make_shared<>()</code> only one allocation is made (since C++11; +a non-binding requirement in the Standard, though)</p> +</li> +<li> +<p><span class="icon red"><i class="fa fa-minus-circle"></i></span> if creating a new object with +<code>shared_ptr<T> p(new T)</code> requires two allocations (one to create the ref count, +and one to create the object)</p> </li> <li> <p><span class="icon red"><i class="fa fa-minus-circle"></i></span> the ref count may not be near the object on the heap, @@ -317,10 +355,6 @@ so extra cache misses may be incurred on access</p> <p><span class="icon red"><i class="fa fa-minus-circle"></i></span> the <code>shared_ptr</code> instance itself requires 16 bytes (pointer to the ref count and pointer to the object)</p> </li> -<li> -<p><span class="icon red"><i class="fa fa-minus-circle"></i></span> if you convert from the <code>shared_ptr</code> to a raw pointer, -you can’t get back the <code>shared_ptr</code></p> -</li> </ul> </div> <div class="ulist none"> @@ -352,7 +386,7 @@ referent to help debug leaks.</p> from <code>RefCounted</code></p> </li> <li> -<p><span class="icon red"><i class="fa fa-minus-circle fa-con"></i></span> does not support <code>weak_ptr<></code> use cases</p> +<p><span class="icon red"><i class="fa fa-minus-circle fa-con"></i></span> does not support the <code>weak_ptr</code> use cases</p> </li> </ul> </div> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/developing.html ---------------------------------------------------------------------- diff --git a/docs/developing.html b/docs/developing.html index 0780142..80047ac 100644 --- a/docs/developing.html +++ b/docs/developing.html @@ -2,7 +2,7 @@ title: Developing Applications With Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2016-08-19 17:48:32 PDT' +last_updated: 'Last updated 2016-09-06 15:17:09 PDT' --- <!-- @@ -227,9 +227,9 @@ kuduContext.deleteTable("unwanted_table")</code></pre> <div class="paragraph"> <p>Kudu was designed to integrate with MapReduce, YARN, Spark, and other frameworks in the Hadoop ecosystem. See -<a href="https://github.com/apache/incubator-kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/RowCounter.java";>RowCounter.java</a> +<a href="https://github.com/apache/kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/RowCounter.java";>RowCounter.java</a> and -<a href="https://github.com/apache/incubator-kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ImportCsv.java";>ImportCsv.java</a> +<a href="https://github.com/apache/kudu/blob/master/java/kudu-client-tools/src/main/java/org/apache/kudu/mapreduce/tools/ImportCsv.java";>ImportCsv.java</a> for examples which you can model your own integrations on. Stay tuned for more examples using YARN and Spark in the future.</p> </div> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/index.html ---------------------------------------------------------------------- diff --git a/docs/index.html b/docs/index.html index 1f6e3fc..d02dc0f 100644 --- a/docs/index.html +++ b/docs/index.html @@ -2,7 +2,7 @@ title: Introducing Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 12:38:14 PDT' +last_updated: 'Last updated 2016-09-06 15:17:09 PDT' --- <!-- http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/installation.html ---------------------------------------------------------------------- diff --git a/docs/installation.html b/docs/installation.html index 2f28f2d..cf735e4 100644 --- a/docs/installation.html +++ b/docs/installation.html @@ -2,7 +2,7 @@ title: Installing Apache Kudu layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 12:38:14 PDT' +last_updated: 'Last updated 2016-09-08 16:11:36 PDT' --- <!-- @@ -58,7 +58,8 @@ version 5.4.7 or newer. If you use Cloudera Manager, see also Cloudera’s <div class="title">Hardware</div> <ul> <li> -<p>A host to run the Kudu master.</p> +<p>One or more hosts to run Kudu masters. It is recommended to have either one master +(no fault tolerance), three masters (can tolerate one failure), or five masters (two failures).</p> </li> <li> <p>One or more hosts to run Kudu tablet servers. When using replication, a minimum of @@ -74,7 +75,7 @@ three tablet servers is necessary.</p> <div class="ulist"> <ul> <li> -<p>RHEL 6, RHEL 7, Ubuntu 14.04 (Trusty), Debian 8 (Jessie), or SLES 12.</p> +<p>RHEL 6, RHEL 7, CentOS 6, CentOS 7, Ubuntu 14.04 (Trusty), Ubuntu 16.04 (Xenial), Debian 8 (Jessie), or SLES 12.</p> </li> <li> <p>A kernel and fileystem that support <em>hole punching</em>. Hole punching is the use of the @@ -156,45 +157,33 @@ Cloudera Manager 5.4.7 and newer provide better monitoring and administration op </thead> <tbody> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/cloudera-kudu.repo";>RHEL 6</a>, - <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/cloudera-kudu.repo";>RHEL 7</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/0.8.0/RPMS/x86_64/";>RHEL 6</a>, - <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/0.8.0/RPMS/x86_64/";>RHEL 7</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL or CentOS</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/cloudera-kudu.repo";>RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/cloudera-kudu.repo";>RHEL 7 or CentOS 7</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/redhat/6/x86_64/kudu/0/RPMS/x86_64/";>RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/kudu/redhat/7/x86_64/kudu/0/RPMS/x86_64/";>RHEL 7 or CentOS 7</a></p></td> </tr> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/cloudera.list";>Trusty</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/pool/contrib/k/kudu/";>Trusty</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>SLES</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/sles/12/x86_64/kudu/cloudera-kudu.repo";>SLES 12</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/sles/12/x86_64/kudu/0/RPMS/x86_64/";>SLES 12</a></p></td> </tr> -</tbody> -</table> -<div class="admonitionblock note"> -<table> <tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -For later versions of Ubuntu, the Ubuntu Trusty packages are reported to install, though they have not been extensively tested. -</td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/cloudera.list";>Trusty</a>, + <a href="http://archive.cloudera.com/beta/kudu/ubuntu/xenial/amd64/kudu/cloudera.list";>Xenial</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/ubuntu/trusty/amd64/kudu/pool/contrib/k/kudu/";>Trusty</a>, + <a href="http://archive.cloudera.com/beta/kudu/ubuntu/xenial/amd64/kudu/pool/contrib/k/kudu/";>Xenial</a></p></td> </tr> -</table> -</div> -<div class="admonitionblock note"> -<table> <tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -packages are not yet provided for SLES. -</td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Debian</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/debian/jessie/amd64/kudu/cloudera.list";>Jessie</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/kudu/debian/jessie/amd64/kudu/pool/contrib/k/kudu/";>Jessie</a></p></td> </tr> +</tbody> </table> -</div> <div class="sect2"> -<h3 id="_install_on_rhel_hosts"><a class="link" href="#_install_on_rhel_hosts">Install On RHEL Hosts</a></h3> +<h3 id="_install_on_rhel_or_centos_hosts"><a class="link" href="#_install_on_rhel_or_centos_hosts">Install on RHEL or CentOS Hosts</a></h3> <div class="olist arabic"> <ol class="arabic"> <li> @@ -216,15 +205,55 @@ sudo yum install kudu-client-devel # Kudu C++ client SDK</pre> </li> <li> <p>To manually install the Kudu RPMs, first download them, then use the command -<code>sudo rpm -ivh <RPM to install></code> and install the -<code>kudu-master</code> and <code>kudu-tserver</code> packages on the appropriate hosts. These packages -provide the operating system commands to start and stop Kudu.</p> +<code>sudo rpm -ivh <RPM to install></code> to install them.</p> +</li> +<li> +<p>Note: the <code>kudu-master</code> and <code>kudu-tserver</code> packages are only necessary on hosts +where there is a master or tserver respectively (and completely unnecessary if +using Cloudera Manager). Each provides configuration files and an init.d script to +manage the corresponding Kudu process. Once installed, the Kudu process is started +and stopped automatically when the host starts up and shuts down.</p> +</li> +</ol> +</div> +</div> +<div class="sect2"> +<h3 id="_install_on_sles_hosts"><a class="link" href="#_install_on_sles_hosts">Install on SLES Hosts</a></h3> +<div class="olist arabic"> +<ol class="arabic"> +<li> +<p>Download and configure the Kudu repositories for your operating system, or manually +download individual RPMs, using the appropriate link from <a href="#kudu_package_locations">Kudu Package Locations</a>.</p> +</li> +<li> +<p>If using a Zypper repository, use the following commands to install Kudu packages on +each host, after saving the <code>cloudera-kudu.repo</code> file to <code>/etc/zypp/repos.d</code>.</p> +<div class="listingblock"> +<div class="content"> +<pre>sudo zypper install kudu # Base Kudu files +sudo zypper install kudu-master # Kudu master init.d service script and default configuration +sudo zypper install kudu-tserver # Kudu tablet server init.d service script and default configuration +sudo zypper install kudu-client0 # Kudu C++ client shared library +sudo zypper install kudu-client-devel # Kudu C++ client SDK</pre> +</div> +</div> +</li> +<li> +<p>To manually install the Kudu RPMs, first download them, then use the command +<code>sudo rpm -ivh <RPM to install></code> to install them.</p> +</li> +<li> +<p>Note: the <code>kudu-master</code> and <code>kudu-tserver</code> packages are only necessary on hosts +where there is a master or tserver respectively (and completely unnecessary if +using Cloudera Manager). Each provides configuration files and an init.d script to +manage the corresponding Kudu process. Once installed, the Kudu process is started +and stopped automatically when the host starts up and shuts down.</p> </li> </ol> </div> </div> <div class="sect2"> -<h3 id="_install_on_ubuntu_or_debian_hosts"><a class="link" href="#_install_on_ubuntu_or_debian_hosts">Install On Ubuntu or Debian Hosts</a></h3> +<h3 id="_install_on_ubuntu_or_debian_hosts"><a class="link" href="#_install_on_ubuntu_or_debian_hosts">Install on Ubuntu or Debian Hosts</a></h3> <div class="olist arabic"> <ol class="arabic"> <li> @@ -241,8 +270,15 @@ sudo apt-get install libkuduclient-dev # Kudu C++ client SDK</pre> </div> </li> <li> -<p>To manually install individual DEBs, first download them, then use the command -<code>sudo dpkg -i <DEB to install></code> to install them.</p> +<p>To manually install the Kudu RPMs, first download them, then use the command +<code>sudo rpm -ivh <RPM to install></code> to install them.</p> +</li> +<li> +<p>Note: the <code>kudu-master</code> and <code>kudu-tserver</code> packages are only necessary on hosts +where there is a master or tserver respectively (and completely unnecessary if +using Cloudera Manager). Each provides configuration files and an init.d script to +manage the corresponding Kudu process. Once installed, the Kudu process is started +and stopped automatically when the host starts up and shuts down.</p> </li> </ol> </div> @@ -338,8 +374,8 @@ $ sudo service kudu-tserver stop</code></pre> them to the default runlevel.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ sudo chkconfig kudu-master on # RHEL / CentOS -$ sudo chkconfig kudu-tserver on # RHEL / CentOS +<pre class="highlight"><code class="language-bash" data-lang="bash">$ sudo chkconfig kudu-master on # RHEL / CentOS / SLES +$ sudo chkconfig kudu-tserver on # RHEL / CentOS / SLES $ sudo update-rc.d kudu-master defaults # Debian / Ubuntu $ sudo update-rc.d kudu-tserver defaults # Debian / Ubuntu</code></pre> @@ -427,7 +463,7 @@ $ sudo yum install -y devtoolset-3-toolchain</pre> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -538,7 +574,7 @@ make -j4</code></pre> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -600,7 +636,7 @@ the steps marked <strong>Optional</strong> above.</p> sudo apt-get -y install git autoconf automake \ curl gcc g++ libsasl2-dev libsasl2-modules \ libtool ntp patch pkg-config make rsync unzip vim-common gdb python lsb-release -git clone https://github.com/apache/incubator-kudu kudu +git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh mkdir -p build/release @@ -631,7 +667,7 @@ make -j4</code></pre> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -685,7 +721,7 @@ the steps marked <strong>Optional</strong> above.</p> sudo zypper install autoconf automake curl cyrus-sasl-devel gcc gcc-c++ \ gdb git libtool make ntp patch pkg-config python rsync unzip vim lsb-release -git clone https://github.com/apache/incubator-kudu kudu +git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh mkdir -p build/release @@ -737,7 +773,7 @@ for more information.</p> <p>Clone the Git repository and change to the new <code>kudu</code> directory.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/incubator-kudu kudu +<pre class="highlight"><code class="language-bash" data-lang="bash">$ git clone https://github.com/apache/kudu $ cd kudu</code></pre> </div> </div> @@ -803,7 +839,7 @@ are installed.</p> <pre>#!/bin/bash brew install autoconf automake cmake libtool pkg-config pstree -git clone https://github.com/apache/incubator-kudu kudu +git clone https://github.com/apache/kudu cd kudu thirdparty/build-if-necessary.sh mkdir -p build/release @@ -957,6 +993,15 @@ sudo yum upgrade kudu</code></pre> </div> </li> <li> +<p>On SLES hosts:</p> +<div class="listingblock"> +<div class="content"> +<pre class="highlight"><code class="language-bash" data-lang="bash">sudo zypper clean --all +sudo zypper update kudu</code></pre> +</div> +</div> +</li> +<li> <p>On Ubuntu or Debian hosts:</p> <div class="listingblock"> <div class="content"> @@ -1021,8 +1066,9 @@ $ sudo service kudu-tserver start</code></pre> <li><a href="#_prerequisites_and_requirements">Prerequisites and Requirements</a></li> <li><a href="#install_packages">Install Using Packages</a> <ul class="sectlevel2"> -<li><a href="#_install_on_rhel_hosts">Install On RHEL Hosts</a></li> -<li><a href="#_install_on_ubuntu_or_debian_hosts">Install On Ubuntu or Debian Hosts</a></li> +<li><a href="#_install_on_rhel_or_centos_hosts">Install on RHEL or CentOS Hosts</a></li> +<li><a href="#_install_on_sles_hosts">Install on SLES Hosts</a></li> +<li><a href="#_install_on_ubuntu_or_debian_hosts">Install on Ubuntu or Debian Hosts</a></li> <li><a href="#_verify_the_installation">Verify the Installation</a></li> <li><a href="#required_config_without_cm">Required Configuration</a></li> </ul> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/kudu-master_configuration_reference.html ---------------------------------------------------------------------- diff --git a/docs/kudu-master_configuration_reference.html b/docs/kudu-master_configuration_reference.html index af63678..b6e9e39 100644 --- a/docs/kudu-master_configuration_reference.html +++ b/docs/kudu-master_configuration_reference.html @@ -2,7 +2,7 @@ title: kudu-master Flags layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 23:33:19 PDT' +last_updated: 'Last updated 2016-09-19 19:01:39 PDT' --- <!-- @@ -149,6 +149,35 @@ configuration tasks.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_master_addresses"><a class="link" href="#kudu-master_master_addresses"><code>--master_addresses</code></a></h3> +<div class="paragraph"> +<p>Comma-separated list of the RPC addresses belonging to all Masters in this cluster. NOTE: if not specified, configures a non-replicated Master.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_rpc_bind_addresses"><a class="link" href="#kudu-master_rpc_bind_addresses"><code>--rpc_bind_addresses</code></a></h3> <div class="paragraph"> <p>Comma-separated list of addresses to bind to for RPC connections. Currently, ephemeral ports (i.e. port 0) are not allowed.</p> @@ -564,6 +593,64 @@ configuration tasks.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-master_unlock_experimental_flags"><a class="link" href="#kudu-master_unlock_experimental_flags"><code>--unlock_experimental_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'experimental'. These flags are not guaranteed to be maintained across releases of Kudu, and may enable features or behavior known to be unstable. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> +<h3 id="kudu-master_unlock_unsafe_flags"><a class="link" href="#kudu-master_unlock_unsafe_flags"><code>--unlock_unsafe_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'unsafe'. These flags are not guaranteed to be maintained across releases of Kudu, and enable features or behavior known to be unsafe. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-master_fromenv"><a class="link" href="#kudu-master_fromenv"><code>--fromenv</code></a></h3> <div class="paragraph"> <p>set flags from the environment [use 'export FLAGS_flag1=value']</p> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/kudu-master_configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/kudu-master_configuration_reference_unsupported.html b/docs/kudu-master_configuration_reference_unsupported.html index a6bdc9d..ac4b23b 100644 --- a/docs/kudu-master_configuration_reference_unsupported.html +++ b/docs/kudu-master_configuration_reference_unsupported.html @@ -2,7 +2,7 @@ title: kudu-master Unsupported Flags layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 23:33:19 PDT' +last_updated: 'Last updated 2016-09-19 19:01:39 PDT' --- <!-- @@ -342,10 +342,10 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> -<h2 id="kudu-master_log_min_seconds_to_retain"><a class="link" href="#kudu-master_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h2> +<h2 id="kudu-master_log_max_segments_to_retain"><a class="link" href="#kudu-master_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h2> <div class="sectionbody"> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -359,11 +359,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -1126,34 +1126,6 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> -<h2 id="kudu-master_master_addresses"><a class="link" href="#kudu-master_master_addresses"><code>--master_addresses</code></a></h2> -<div class="sectionbody"> -<div class="paragraph"> -<p>Comma-separated list of all the RPC addresses for Master config. This is used to configure the replicated Master process (currently considered experimental). NOTE: if not specified, configures a non-replicated Master.</p> -</div> -<table class="tableblock frame-all grid-all" style="width: 50%;"> -<colgroup> -<col style="width: 25%;"> -<col style="width: 75%;"> -</colgroup> -<tbody> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">string</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">none</p></td> -</tr> -<tr> -<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> -</tr> -</tbody> -</table> -</div> -</div> -<div class="sect1"> <h2 id="kudu-master_tserver_unresponsive_timeout_ms"><a class="link" href="#kudu-master_tserver_unresponsive_timeout_ms"><code>--tserver_unresponsive_timeout_ms</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -1798,6 +1770,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-master_compaction_approximation_ratio"><a class="link" href="#kudu-master_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-master_deltafile_default_block_size"><a class="link" href="#kudu-master_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -1994,6 +1994,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-master_tablet_history_max_age_sec"><a class="link" href="#kudu-master_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-master_tablet_throttler_burst_factor"><a class="link" href="#kudu-master_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h2> <div class="sectionbody"> <div class="paragraph"> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/kudu-tserver_configuration_reference.html ---------------------------------------------------------------------- diff --git a/docs/kudu-tserver_configuration_reference.html b/docs/kudu-tserver_configuration_reference.html index a1f2963..fc4170a 100644 --- a/docs/kudu-tserver_configuration_reference.html +++ b/docs/kudu-tserver_configuration_reference.html @@ -2,7 +2,7 @@ title: kudu-tserver Flags layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 23:33:19 PDT' +last_updated: 'Last updated 2016-09-19 19:01:39 PDT' --- <!-- @@ -593,6 +593,64 @@ configuration tasks.</p> </div> </div> <div class="sect2"> +<h3 id="kudu-tserver_unlock_experimental_flags"><a class="link" href="#kudu-tserver_unlock_experimental_flags"><code>--unlock_experimental_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'experimental'. These flags are not guaranteed to be maintained across releases of Kudu, and may enable features or behavior known to be unstable. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> +<h3 id="kudu-tserver_unlock_unsafe_flags"><a class="link" href="#kudu-tserver_unlock_unsafe_flags"><code>--unlock_unsafe_flags</code></a></h3> +<div class="paragraph"> +<p>Unlock flags marked as 'unsafe'. These flags are not guaranteed to be maintained across releases of Kudu, and enable features or behavior known to be unsafe. Use at your own risk.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">bool</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>false</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">stable,advanced</p></td> +</tr> +</tbody> +</table> +<div class="paragraph"> +<p> </p> +</div> +</div> +<div class="sect2"> <h3 id="kudu-tserver_fromenv"><a class="link" href="#kudu-tserver_fromenv"><code>--fromenv</code></a></h3> <div class="paragraph"> <p>set flags from the environment [use 'export FLAGS_flag1=value']</p> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/kudu-tserver_configuration_reference_unsupported.html ---------------------------------------------------------------------- diff --git a/docs/kudu-tserver_configuration_reference_unsupported.html b/docs/kudu-tserver_configuration_reference_unsupported.html index c6a6f8e..95fc341 100644 --- a/docs/kudu-tserver_configuration_reference_unsupported.html +++ b/docs/kudu-tserver_configuration_reference_unsupported.html @@ -2,7 +2,7 @@ title: kudu-tserver Unsupported Flags layout: default active_nav: docs -last_updated: 'Last updated 2016-08-22 23:33:19 PDT' +last_updated: 'Last updated 2016-09-19 19:01:39 PDT' --- <!-- @@ -342,10 +342,10 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> -<h2 id="kudu-tserver_log_min_seconds_to_retain"><a class="link" href="#kudu-tserver_log_min_seconds_to_retain"><code>--log_min_seconds_to_retain</code></a></h2> +<h2 id="kudu-tserver_log_max_segments_to_retain"><a class="link" href="#kudu-tserver_log_max_segments_to_retain"><code>--log_max_segments_to_retain</code></a></h2> <div class="sectionbody"> <div class="paragraph"> -<p>The minimum number of seconds for which to keep log segments to keep at all times, regardless of what is required for durability. Logs may be still retained for a longer amount of time if they are necessary for correct restart. This should be set long enough such that a tablet server which has temporarily failed can be restarted within the given time period. If a server is down for longer than this amount of time, it is possible that its tablets will be re-replicated on other machines.</p> +<p>The maximum number of past log segments to keep at all times for the purposes of catching up other peers.</p> </div> <table class="tableblock frame-all grid-all" style="width: 50%;"> <colgroup> @@ -359,11 +359,11 @@ for informational purposes only. They are subject to change or be removed withou </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock"><code>300</code></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>10</code></p></td> </tr> <tr> <th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> -<td class="tableblock halign-left valign-top"><p class="tableblock">advanced,runtime</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental,advanced,runtime</p></td> </tr> </tbody> </table> @@ -1490,6 +1490,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-tserver_compaction_approximation_ratio"><a class="link" href="#kudu-tserver_compaction_approximation_ratio"><code>--compaction_approximation_ratio</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Approximation ratio allowed for optimal compaction calculation. A value of 1.05 indicates that the policy may use an approximate result if it is known to be within 5% of the optimal solution.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">double</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>1.0499999523162842</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">experimental</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-tserver_deltafile_default_block_size"><a class="link" href="#kudu-tserver_deltafile_default_block_size"><code>--deltafile_default_block_size</code></a></h2> <div class="sectionbody"> <div class="paragraph"> @@ -1686,6 +1714,34 @@ for informational purposes only. They are subject to change or be removed withou </div> </div> <div class="sect1"> +<h2 id="kudu-tserver_tablet_history_max_age_sec"><a class="link" href="#kudu-tserver_tablet_history_max_age_sec"><code>--tablet_history_max_age_sec</code></a></h2> +<div class="sectionbody"> +<div class="paragraph"> +<p>Number of seconds to retain tablet history. Reads initiated at a snapshot that is older than this age will be rejected. To disable history removal, set to -1.</p> +</div> +<table class="tableblock frame-all grid-all" style="width: 50%;"> +<colgroup> +<col style="width: 25%;"> +<col style="width: 75%;"> +</colgroup> +<tbody> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Type</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">int32</p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Default</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock"><code>900</code></p></td> +</tr> +<tr> +<th class="tableblock halign-left valign-top"><p class="tableblock">Tags</p></th> +<td class="tableblock halign-left valign-top"><p class="tableblock">advanced</p></td> +</tr> +</tbody> +</table> +</div> +</div> +<div class="sect1"> <h2 id="kudu-tserver_tablet_throttler_burst_factor"><a class="link" href="#kudu-tserver_tablet_throttler_burst_factor"><code>--tablet_throttler_burst_factor</code></a></h2> <div class="sectionbody"> <div class="paragraph"> http://git-wip-us.apache.org/repos/asf/kudu/blob/9062ee65/docs/kudu_impala_integration.html ---------------------------------------------------------------------- diff --git a/docs/kudu_impala_integration.html b/docs/kudu_impala_integration.html index 52a5f35..7986b43 100644 --- a/docs/kudu_impala_integration.html +++ b/docs/kudu_impala_integration.html @@ -2,7 +2,7 @@ title: Using Apache Kudu with Apache Impala (incubating) layout: default active_nav: docs -last_updated: 'Last updated 2016-08-19 17:48:32 PDT' +last_updated: 'Last updated 2016-09-08 16:11:36 PDT' --- <!-- @@ -304,11 +304,11 @@ hosted on <code>cloudera.com</code>.</p> <div class="title">Procedure</div> <ul> <li> -<p>Download the <code>deploy.py</code> from <a href="https://github.com/cloudera/impala-kudu/blob/feature/kudu/infra/deploy/deploy.py"; class="bare">https://github.com/cloudera/impala-kudu/blob/feature/kudu/infra/deploy/deploy.py</a> +<p>Download the <code>deploy.py</code> from <a href="https://github.com/apache/incubator-impala/blob/master/infra/deploy/deploy.py"; class="bare">https://github.com/apache/incubator-impala/blob/master/infra/deploy/deploy.py</a> using <code>curl</code> or another utility of your choice.</p> <div class="listingblock"> <div class="content"> -<pre class="highlight"><code class="language-bash" data-lang="bash">$ curl -O https://raw.githubusercontent.com/cloudera/impala-kudu/feature/kudu/infra/deploy/deploy.py</code></pre> +<pre class="highlight"><code class="language-bash" data-lang="bash">$ curl -O https://raw.githubusercontent.com/apache/incubator-impala/master/infra/deploy/deploy.py</code></pre> </div> </div> </li> @@ -402,9 +402,11 @@ alongside another Impala instance if you use packages.</p> </thead> <tbody> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo";>RHEL 6</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0.5.0/RPMS/x86_64/";>RHEL 6</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL or CentOS</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo";>RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/cloudera-impala-kudu.repo";>RHEL 7 or CentOS 7</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0/RPMS/x86_64/";>RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/0/RPMS/x86_64/";>RHEL 7 or CentOS 7</a></p></td> </tr> <tr> <td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> @@ -493,9 +495,11 @@ Instead, follow <a href="#install_impala_kudu_packages">Installing Impala_Kudu U </thead> <tbody> <tr> -<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL</strong></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo";>RHEL 6</a></p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0.5.0/RPMS/x86_64/";>RHEL 6</a></p></td> +<td class="tableblock halign-right valign-top"><p class="tableblock"><strong>RHEL or CentOS</strong></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/cloudera-impala-kudu.repo";>RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/cloudera-impala-kudu.repo";>RHEL 7 or CentOS 7</a></p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock"><a href="http://archive.cloudera.com/beta/impala-kudu/redhat/6/x86_64/impala-kudu/0/RPMS/x86_64/";>RHEL 6 or CentOS 6</a>, + <a href="http://archive.cloudera.com/beta/impala-kudu/redhat/7/x86_64/impala-kudu/0/RPMS/x86_64/";>RHEL 7 or CentOS 7</a></p></td> </tr> <tr> <td class="tableblock halign-right valign-top"><p class="tableblock"><strong>Ubuntu</strong></p></td> @@ -565,7 +569,7 @@ provides the Impala query to map to an existing Kudu table in the web UI.</p> <li> <p>Be sure you are using the <code>impala-shell</code> binary provided by the Impala_Kudu package, rather than the default CDH Impala binary. The following shows how to verify this -using the <code>alternatives</code> command on a RHEL 6 host.</p> +using the <code>alternatives</code> command on a RHEL or CentOS host.</p> <div class="listingblock"> <div class="content"> <pre class="highlight"><code class="language-bash" data-lang="bash">$ sudo alternatives --display impala-shell
