Modified: tajo/site/docs/current/tsql/variables.html URL: http://svn.apache.org/viewvc/tajo/site/docs/current/tsql/variables.html?rev=1728394&r1=1728393&r2=1728394&view=diff ============================================================================== --- tajo/site/docs/current/tsql/variables.html (original) +++ tajo/site/docs/current/tsql/variables.html Thu Feb 4 00:29:05 2016 @@ -78,6 +78,7 @@ <li class="toctree-l2"><a class="reference internal" href="../configuration/service_config_defaults.html">Cluster Service Configuration Defaults</a></li> <li class="toctree-l2"><a class="reference internal" href="../configuration/tajo-site-xml.html">The tajo-site.xml File</a></li> <li class="toctree-l2"><a class="reference internal" href="../configuration/catalog-site-xml.html">The catalog-site.xml File</a></li> +<li class="toctree-l2"><a class="reference internal" href="../configuration/storage-site-json.html">The storage-site.json File</a></li> </ul> </li> <li class="toctree-l1 current"><a class="reference internal" href="../tsql.html">Tajo Shell (TSQL)</a><ul class="current"> @@ -100,6 +101,7 @@ <li class="toctree-l2"><a class="reference internal" href="../sql_language/joins.html">Joins</a></li> <li class="toctree-l2"><a class="reference internal" href="../sql_language/sql_expression.html">SQL Expressions</a></li> <li class="toctree-l2"><a class="reference internal" href="../sql_language/predicates.html">Predicates</a></li> +<li class="toctree-l2"><a class="reference internal" href="../sql_language/explain.html">EXPLAIN</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="../time_zone.html">Time Zone</a><ul> @@ -120,7 +122,7 @@ <li class="toctree-l1"><a class="reference internal" href="../table_management.html">Table Management</a><ul> <li class="toctree-l2"><a class="reference internal" href="../table_management/table_overview.html">Overview of Tajo Tables</a></li> <li class="toctree-l2"><a class="reference internal" href="../table_management/tablespaces.html">Tablespaces</a></li> -<li class="toctree-l2"><a class="reference internal" href="../table_management/file_formats.html">File Formats</a></li> +<li class="toctree-l2"><a class="reference internal" href="../table_management/data_formats.html">Data Formats</a></li> <li class="toctree-l2"><a class="reference internal" href="../table_management/compression.html">Compression</a></li> </ul> </li> @@ -209,7 +211,9 @@ <div class="section" id="session-variables"> <h1>Session Variables<a class="headerlink" href="#session-variables" title="Permalink to this headline">¶</a></h1> -<p>Each client connection to TajoMaster creates a unique session, and the client and TajoMaster uses the session until disconnect. A session provides session variables which are used for various configs per session.</p> +<p>Once a tajo client connects to the Tajo master, it assigns a unique session. This session is kept until the client is disconnected or it is expired.</p> +<p>For the sake of more convenient user configuration, Tajo provides <cite>session variables</cite>. +With session variables, different configurations are allowed for each session.</p> <p><code class="docutils literal"><span class="pre">tsql</span></code> provides the meta command <code class="docutils literal"><span class="pre">\set</span></code> to manipulate session variables. Just <code class="docutils literal"><span class="pre">\set</span></code> command shows all session variables.</p> <div class="highlight-python"><div class="highlight"><pre>default> \set 'name1'='val1' @@ -230,37 +234,614 @@ default> \set </pre></div> </div> <p>Also, <code class="docutils literal"><span class="pre">\unset</span> <span class="pre">key</span></code> will unset the session variable named <em>key</em>.</p> -<p>Now, tajo provides the following session variables.</p> -<ul class="simple"> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_BROADCAST_JOIN_THRESHOLD</span></code></li> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_JOIN_TASK_VOLUME</span></code></li> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_SORT_TASK_VOLUME</span></code></li> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_GROUPBY_TASK_VOLUME</span></code></li> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_JOIN_PARTITION_VOLUME</span></code></li> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_GROUPBY_PARTITION_VOLUME</span></code></li> -<li><code class="docutils literal"><span class="pre">DIST_QUERY_TABLE_PARTITION_VOLUME</span></code></li> -<li><code class="docutils literal"><span class="pre">EXECUTOR_EXTERNAL_SORT_BUFFER_SIZE</span></code></li> -<li><code class="docutils literal"><span class="pre">EXECUTOR_HASH_JOIN_SIZE_THRESHOLD</span></code></li> -<li><code class="docutils literal"><span class="pre">EXECUTOR_INNER_HASH_JOIN_SIZE_THRESHOLD</span></code></li> -<li><code class="docutils literal"><span class="pre">EXECUTOR_OUTER_HASH_JOIN_SIZE_THRESHOLD</span></code></li> -<li><code class="docutils literal"><span class="pre">EXECUTOR_GROUPBY_INMEMORY_HASH_THRESHOLD</span></code></li> -<li><code class="docutils literal"><span class="pre">MAX_OUTPUT_FILE_SIZE</span></code></li> -<li><code class="docutils literal"><span class="pre">CODEGEN</span></code></li> -<li><code class="docutils literal"><span class="pre">CLIENT_SESSION_EXPIRY_TIME</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_MAX_COLUMN</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_NULL_CHAR</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_PRINT_PAUSE_NUM_RECORDS</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_PRINT_PAUSE</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_PRINT_ERROR_TRACE</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_OUTPUT_FORMATTER_CLASS</span></code></li> -<li><code class="docutils literal"><span class="pre">CLI_ERROR_STOP</span></code></li> -<li><code class="docutils literal"><span class="pre">TIMEZONE</span></code></li> -<li><code class="docutils literal"><span class="pre">DATE_ORDER</span></code></li> -<li><code class="docutils literal"><span class="pre">TEXT_NULL</span></code></li> -<li><code class="docutils literal"><span class="pre">DEBUG_ENABLED</span></code></li> -<li><code class="docutils literal"><span class="pre">BEHAVIOR_ARITHMETIC_ABORT</span></code></li> -<li><code class="docutils literal"><span class="pre">RESULT_SET_FETCH_ROWNUM</span></code></li> +<p>Currently, tajo provides the following session variables.</p> +<dl class="describe"> +<dt> +<code class="descname">BROADCAST_NON_CROSS_JOIN_THRESHOLD</code></dt> +<dd></dd></dl> + +<p>A threshold for non-cross joins. When a non-cross join query is executed with the broadcast join, the whole size of broadcasted tables won’t exceed this threshold.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-broadcast-non-cross-join-threshold-kb"><span>tajo.dist-query.broadcast.non-cross-join.threshold-kb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: KB</li> +<li>Default value: 5120</li> +<li>Example</li> </ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et BROADCAST_NON_CROSS_JOIN_THRESHOLD 5120 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">BROADCAST_CROSS_JOIN_THRESHOLD</code></dt> +<dd></dd></dl> + +<p>A threshold for cross joins. When a cross join query is executed, the whole size of broadcasted tables won’t exceed this threshold.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-broadcast-cross-join-threshold-kb"><span>tajo.dist-query.broadcast.cross-join.threshold-kb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: KB</li> +<li>Default value: 1024</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et BROADCAST_CROSS_JOIN_THRESHOLD 1024 +</pre></div> +</div> +<div class="admonition warning"> +<p class="first admonition-title">Warning</p> +<p class="last">In Tajo, the broadcast join is only the way to perform cross joins. Since the cross join is a very expensive operation, this value need to be tuned carefully.</p> +</div> +<dl class="describe"> +<dt> +<code class="descname">JOIN_TASK_INPUT_SIZE</code></dt> +<dd></dd></dl> + +<p>The repartition join is executed in two stages. When a join query is executed with the repartition join, this value indicates the amount of input data processed by each task at the second stage. +As a result, it determines the degree of the parallel processing of the join query.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-join-task-volume-mb"><span>tajo.dist-query.join.task-volume-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et JOIN_TASK_INPUT_SIZE 64 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">JOIN_PER_SHUFFLE_SIZE</code></dt> +<dd></dd></dl> + +<p>The repartition join is executed in two stages. When a join query is executed with the repartition join, +this value indicates the output size of each task at the first stage, which determines the number of partitions to be shuffled between two stages.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-join-partition-volume-mb"><span>tajo.dist-query.join.partition-volume-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 128</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et JOIN_PER_SHUFFLE_SIZE 128 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">HASH_JOIN_SIZE_LIMIT</code></dt> +<dd></dd></dl> + +<p>This value provides the criterion to decide the algorithm to perform a join in a task. +If the input data is smaller than this value, join is performed with the in-memory hash join. +Otherwise, the sort-merge join is used.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-join-common-in-memory-hash-threshold-mb"><span>tajo.executor.join.common.in-memory-hash-threshold-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et HASH_JOIN_SIZE_LIMIT 64 +</pre></div> +</div> +<div class="admonition warning"> +<p class="first admonition-title">Warning</p> +<p class="last">This value is the size of the input stored on file systems. So, when the input data is loaded into JVM heap, +its actual size is usually much larger than the configured value, which means that too large threshold can cause unexpected OutOfMemory errors. +This value should be tuned carefully.</p> +</div> +<dl class="describe"> +<dt> +<code class="descname">INNER_HASH_JOIN_SIZE_LIMIT</code></dt> +<dd></dd></dl> + +<p>This value provides the criterion to decide the algorithm to perform an inner join in a task. +If the input data is smaller than this value, the inner join is performed with the in-memory hash join. +Otherwise, the sort-merge join is used.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-join-inner-in-memory-hash-threshold-mb"><span>tajo.executor.join.inner.in-memory-hash-threshold-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et INNER_HASH_JOIN_SIZE_LIMIT 64 +</pre></div> +</div> +<div class="admonition warning"> +<p class="first admonition-title">Warning</p> +<p class="last">This value is the size of the input stored on file systems. So, when the input data is loaded into JVM heap, +its actual size is usually much larger than the configured value, which means that too large threshold can cause unexpected OutOfMemory errors. +This value should be tuned carefully.</p> +</div> +<dl class="describe"> +<dt> +<code class="descname">OUTER_HASH_JOIN_SIZE_LIMIT</code></dt> +<dd></dd></dl> + +<p>This value provides the criterion to decide the algorithm to perform an outer join in a task. +If the input data is smaller than this value, the outer join is performed with the in-memory hash join. +Otherwise, the sort-merge join is used.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-join-outer-in-memory-hash-threshold-mb"><span>tajo.executor.join.outer.in-memory-hash-threshold-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et OUTER_HASH_JOIN_SIZE_LIMIT 64 +</pre></div> +</div> +<div class="admonition warning"> +<p class="first admonition-title">Warning</p> +<p class="last">This value is the size of the input stored on file systems. So, when the input data is loaded into JVM heap, +its actual size is usually much larger than the configured value, which means that too large threshold can cause unexpected OutOfMemory errors. +This value should be tuned carefully.</p> +</div> +<dl class="describe"> +<dt> +<code class="descname">JOIN_HASH_TABLE_SIZE</code></dt> +<dd></dd></dl> + +<p>The initial size of hash table for in-memory hash join.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-join-hash-table-size"><span>tajo.executor.join.hash-table.size</span></a></li> +<li>Property value: Integer</li> +<li>Default value: 100000</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et JOIN_HASH_TABLE_SIZE 100000 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">SORT_TASK_INPUT_SIZE</code></dt> +<dd></dd></dl> + +<p>The sort operation is executed in two stages. When a sort query is executed, this value indicates the amount of input data processed by each task at the second stage. +As a result, it determines the degree of the parallel processing of the sort query.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-sort-task-volume-mb"><span>tajo.dist-query.sort.task-volume-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et SORT_TASK_INPUT_SIZE 64 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">EXTSORT_BUFFER_SIZE</code></dt> +<dd></dd></dl> + +<p>A threshold to choose the sort algorithm. If the input data is larger than this threshold, the external sort algorithm is used.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-external-sort-buffer-mb"><span>tajo.executor.external-sort.buffer-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 200</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et EXTSORT_BUFFER_SIZE 200 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">SORT_LIST_SIZE</code></dt> +<dd></dd></dl> + +<p>The initial size of list for in-memory sort.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-sort-list-size"><span>tajo.executor.sort.list.size</span></a></li> +<li>Property value: Integer</li> +<li>Default value: 100000</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et SORT_LIST_SIZE 100000 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">GROUPBY_MULTI_LEVEL_ENABLED</code></dt> +<dd></dd></dl> + +<p>A flag to enable the multi-level algorithm for distinct aggregation. If this value is set, 3-phase aggregation algorithm is used. +Otherwise, 2-phase aggregation algorithm is used.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-groupby-multi-level-aggr"><span>tajo.dist-query.groupby.multi-level-aggr</span></a></li> +<li>Property value: Boolean</li> +<li>Default value: true</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et GROUPBY_MULTI_LEVEL_ENABLED <span class="nb">true</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">GROUPBY_PER_SHUFFLE_SIZE</code></dt> +<dd></dd></dl> + +<p>The aggregation is executed in two stages. When an aggregation query is executed, +this value indicates the output size of each task at the first stage, which determines the number of partitions to be shuffled between two stages.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-groupby-partition-volume-mb"><span>tajo.dist-query.groupby.partition-volume-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 256</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et GROUPBY_PER_SHUFFLE_SIZE 256 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">GROUPBY_TASK_INPUT_SIZE</code></dt> +<dd></dd></dl> + +<p>The aggregation operation is executed in two stages. When an aggregation query is executed, this value indicates the amount of input data processed by each task at the second stage. +As a result, it determines the degree of the parallel processing of the aggregation query.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-groupby-task-volume-mb"><span>tajo.dist-query.groupby.task-volume-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et GROUPBY_TASK_INPUT_SIZE 64 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">HASH_GROUPBY_SIZE_LIMIT</code></dt> +<dd></dd></dl> + +<p>This value provides the criterion to decide the algorithm to perform an aggregation in a task. +If the input data is smaller than this value, the aggregation is performed with the in-memory hash aggregation. +Otherwise, the sort-based aggregation is used.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-groupby-in-memory-hash-threshold-mb"><span>tajo.executor.groupby.in-memory-hash-threshold-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 64</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et HASH_GROUPBY_SIZE_LIMIT 64 +</pre></div> +</div> +<div class="admonition warning"> +<p class="first admonition-title">Warning</p> +<p class="last">This value is the size of the input stored on file systems. So, when the input data is loaded into JVM heap, +its actual size is usually much larger than the configured value, which means that too large threshold can cause unexpected OutOfMemory errors. +This value should be tuned carefully.</p> +</div> +<dl class="describe"> +<dt> +<code class="descname">AGG_HASH_TABLE_SIZE</code></dt> +<dd></dd></dl> + +<p>The initial size of hash table for in-memory aggregation.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-executor-aggregate-hash-table-size"><span>tajo.executor.aggregate.hash-table.size</span></a></li> +<li>Property value: Integer</li> +<li>Default value: 10000</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et AGG_HASH_TABLE_SIZE 10000 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">TIMEZONE</code></dt> +<dd></dd></dl> + +<p>Refer to <a class="reference internal" href="../time_zone.html"><em>Time Zone</em></a>.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-timezone"><span>tajo.timezone</span></a></li> +<li>Property value: Time zone id</li> +<li>Default value: Default time zone of JVM</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et TIMEZONE GMT+9 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">DATE_ORDER</code></dt> +<dd></dd></dl> + +<p>Date order specification.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-datetime-date-order"><span>tajo.datetime.date-order</span></a></li> +<li>Property value: One of YMD, DMY, MDY.</li> +<li>Default value: YMD</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et DATE_ORDER YMD +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">PARTITION_NO_RESULT_OVERWRITE_ENABLED</code></dt> +<dd></dd></dl> + +<p>If this value is true, a partitioned table is overwritten even if a subquery leads to no result. Otherwise, the table data will be kept if there is no result.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-partition-overwrite-even-if-no-result"><span>tajo.partition.overwrite.even-if-no-result</span></a></li> +<li>Property value: Boolean</li> +<li>Default value: false</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et PARTITION_NO_RESULT_OVERWRITE_ENABLED <span class="nb">false</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">TABLE_PARTITION_PER_SHUFFLE_SIZE</code></dt> +<dd></dd></dl> + +<p>In Tajo, storing a partition table is executed in two stages. +This value indicates the output size of a task of the former stage, which determines the number of partitions to be shuffled between two stages.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-dist-query-table-partition-task-volume-mb"><span>tajo.dist-query.table-partition.task-volume-mb</span></a></li> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 256</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et TABLE_PARTITION_PER_SHUFFLE_SIZE 256 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">ARITHABORT</code></dt> +<dd></dd></dl> + +<p>A flag to indicate how to handle the errors caused by invalid arithmetic operations. If true, a running query will be terminated with an overflow or a divide-by-zero.</p> +<blockquote> +<div><ul class="simple"> +<li>Configuration name: <a class="reference internal" href="../configuration/tajo-site-xml.html#tajo-behavior-arithmetic-abort"><span>tajo.behavior.arithmetic-abort</span></a></li> +<li>Property value: Boolean</li> +<li>Default value: false</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et ARITHABORT <span class="nb">false</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">MAX_OUTPUT_FILE_SIZE</code></dt> +<dd></dd></dl> + +<p>Maximum per-output file size. 0 means infinite.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Integer</li> +<li>Unit: MB</li> +<li>Default value: 0</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et MAX_OUTPUT_FILE_SIZE 0 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">SESSION_EXPIRY_TIME</code></dt> +<dd></dd></dl> + +<p>Session expiry time.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Integer</li> +<li>Unit: seconds</li> +<li>Default value: 3600</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et SESSION_EXPIRY_TIME 3600 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">CLI_COLUMNS</code></dt> +<dd></dd></dl> + +<p>Sets the width for the wrapped format.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Integer</li> +<li>Default value: 120</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et CLI_COLUMNS 120 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">CLI_NULL_CHAR</code></dt> +<dd></dd></dl> + +<p>Sets the string to be printed in place of a null value.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: String</li> +<li>Default value: ‘’</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et CLI_NULL_CHAR <span class="s1">''</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">CLI_PAGE_ROWS</code></dt> +<dd></dd></dl> + +<p>Sets the number of rows for paging.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Integer</li> +<li>Default value: 100</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et CLI_PAGE_ROWS 100 +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">CLI_PAGING_ENABLED</code></dt> +<dd></dd></dl> + +<p>Enable paging of result display.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Boolean</li> +<li>Default value: true</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et CLI_PAGING_ENABLED <span class="nb">true</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">CLI_DISPLAY_ERROR_TRACE</code></dt> +<dd></dd></dl> + +<p>Enable display of error trace.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Boolean</li> +<li>Default value: true</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et CLI_DISPLAY_ERROR_TRACE <span class="nb">true</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">CLI_FORMATTER_CLASS</code></dt> +<dd></dd></dl> + +<p>Sets the output format class to display results.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Class name</li> +<li>Default value: org.apache.tajo.cli.tsql.DefaultTajoCliOutputFormatter</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et CLI_FORMATTER_CLASS org.apache.tajo.cli.tsql.DefaultTajoCliOutputFormatter +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">ON_ERROR_STOP</code></dt> +<dd></dd></dl> + +<p>tsql will exit if an error occurs.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Boolean</li> +<li>Default value: false</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et ON_ERROR_STOP <span class="nb">false</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">NULL_CHAR</code></dt> +<dd></dd></dl> + +<p>Null char of text file output. This value is used when the table property <cite>text.null</cite> is not specified.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: String</li> +<li>Default value: ‘\N’</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et NULL_CHAR <span class="s1">'\\N'</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">DEBUG_ENABLED</code></dt> +<dd></dd></dl> + +<p>A flag to enable debug mode.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Boolean</li> +<li>Default value: false</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et DEBUG_ENABLED <span class="nb">false</span> +</pre></div> +</div> +<dl class="describe"> +<dt> +<code class="descname">FETCH_ROWNUM</code></dt> +<dd></dd></dl> + +<p>The number of rows to be fetched from Master each time.</p> +<blockquote> +<div><ul class="simple"> +<li>Property value: Integer</li> +<li>Default value: 200</li> +<li>Example</li> +</ul> +</div></blockquote> +<div class="highlight-sh"><div class="highlight"><pre><span class="se">\s</span>et FETCH_ROWNUM 200 +</pre></div> +</div> </div> @@ -281,7 +862,7 @@ default> \set <div role="contentinfo"> <p> - © Copyright 2014, Apache Tajo Team. + © Copyright 2015, Apache Tajo Team. </p> </div>
