Modified: tajo/site/docs/devel/sql_language/queries.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/sql_language/queries.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/sql_language/queries.html (original) +++ tajo/site/docs/devel/sql_language/queries.html Thu May 28 12:22:19 2015 @@ -215,13 +215,13 @@ <div class="highlight-sql"><div class="highlight"><pre><span class="p">[</span><span class="k">FROM</span> <span class="o"><</span><span class="k">table</span> <span class="n">reference</span><span class="o">></span> <span class="p">[[</span><span class="k">AS</span><span class="p">]</span> <span class="o"><</span><span class="k">table</span> <span class="k">alias</span> <span class="n">name</span><span class="o">></span><span class="p">]</span> <span class="p">[,</span> <span class="p">...]]</span> </pre></div> </div> -<p>The <tt class="docutils literal"><span class="pre">FROM</span></tt> clause specifies one or more other tables given in a comma-separated table reference list. +<p>The <code class="docutils literal"><span class="pre">FROM</span></code> clause specifies one or more other tables given in a comma-separated table reference list. A table reference can be a relation name , or a subquery, a table join, or complex combinations of them.</p> <div class="section" id="table-and-table-aliases"> <h3>Table and Table Aliases<a class="headerlink" href="#table-and-table-aliases" title="Permalink to this headline">¶</a></h3> <p>A temporary name can be given to tables and complex table references to be used for references to the derived table in the rest of the query. This is called a table alias.</p> -<p>To create a a table alias, please use <tt class="docutils literal"><span class="pre">AS</span></tt>:</p> +<p>To create a a table alias, please use <code class="docutils literal"><span class="pre">AS</span></code>:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">FROM</span> <span class="n">table_reference</span> <span class="k">AS</span> <span class="k">alias</span> </pre></div> </div> @@ -229,7 +229,7 @@ for references to the derived table in t <div class="highlight-sql"><div class="highlight"><pre><span class="k">FROM</span> <span class="n">table_reference</span> <span class="k">alias</span> </pre></div> </div> -<p>The <tt class="docutils literal"><span class="pre">AS</span></tt> keyword can be omitted, and <em>Alias</em> can be any identifier.</p> +<p>The <code class="docutils literal"><span class="pre">AS</span></code> keyword can be omitted, and <em>Alias</em> can be any identifier.</p> <p>A typical application of table aliases is to give short names to long table references. For example:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="o">*</span> <span class="k">FROM</span> <span class="n">long_table_name_1234</span> <span class="n">s</span> <span class="k">JOIN</span> <span class="n">another_long_table_name_5678</span> <span class="n">a</span> <span class="k">ON</span> <span class="n">s</span><span class="p">.</span><span class="n">id</span> <span class="o">=</span> <span class="n">a</span><span class="p">.</span><span class="n">num</span><span class="p">;</span> </pre></div> @@ -246,25 +246,25 @@ for references to the derived table in t </pre></div> </div> <p>Cross join, also called <em>Cartesian product</em>, results in every possible combination of rows from T1 and T2.</p> -<p><tt class="docutils literal"><span class="pre">FROM</span> <span class="pre">T1</span> <span class="pre">CROSS</span> <span class="pre">JOIN</span> <span class="pre">T2</span></tt> is equivalent to <tt class="docutils literal"><span class="pre">FROM</span> <span class="pre">T1,</span> <span class="pre">T2</span></tt>.</p> +<p><code class="docutils literal"><span class="pre">FROM</span> <span class="pre">T1</span> <span class="pre">CROSS</span> <span class="pre">JOIN</span> <span class="pre">T2</span></code> is equivalent to <code class="docutils literal"><span class="pre">FROM</span> <span class="pre">T1,</span> <span class="pre">T2</span></code>.</p> </div> <div class="section" id="qualified-joins"> <h5>Qualified joins<a class="headerlink" href="#qualified-joins" title="Permalink to this headline">¶</a></h5> <p>Qualified joins implicitly or explicitly have join conditions. Inner/Outer/Natural Joins all are qualified joins. -Except for natural join, <tt class="docutils literal"><span class="pre">ON</span></tt> or <tt class="docutils literal"><span class="pre">USING</span></tt> clause in each join is used to specify a join condition. +Except for natural join, <code class="docutils literal"><span class="pre">ON</span></code> or <code class="docutils literal"><span class="pre">USING</span></code> clause in each join is used to specify a join condition. A join condition must include at least one boolean expression, and it can also include just filter conditions.</p> <p><strong>Inner Join</strong></p> <div class="highlight-sql"><div class="highlight"><pre><span class="n">T1</span> <span class="p">[</span><span class="k">INNER</span><span class="p">]</span> <span class="k">JOIN</span> <span class="n">T2</span> <span class="k">ON</span> <span class="n">boolean_expression</span> <span class="n">T1</span> <span class="p">[</span><span class="k">INNER</span><span class="p">]</span> <span class="k">JOIN</span> <span class="n">T2</span> <span class="k">USING</span> <span class="p">(</span><span class="k">join</span> <span class="k">column</span> <span class="n">list</span><span class="p">)</span> </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">INNER</span></tt> keyword is the default, and so <tt class="docutils literal"><span class="pre">INNER</span></tt> can be omitted when you use inner join.</p> +<p><code class="docutils literal"><span class="pre">INNER</span></code> keyword is the default, and so <code class="docutils literal"><span class="pre">INNER</span></code> can be omitted when you use inner join.</p> <p><strong>Outer Join</strong></p> <div class="highlight-sql"><div class="highlight"><pre><span class="n">T1</span> <span class="p">(</span><span class="k">LEFT</span><span class="o">|</span><span class="k">RIGHT</span><span class="o">|</span><span class="k">FULL</span><span class="p">)</span> <span class="k">OUTER</span> <span class="k">JOIN</span> <span class="n">T2</span> <span class="k">ON</span> <span class="n">boolean_expression</span> <span class="n">T1</span> <span class="p">(</span><span class="k">LEFT</span><span class="o">|</span><span class="k">RIGHT</span><span class="o">|</span><span class="k">FULL</span><span class="p">)</span> <span class="k">OUTER</span> <span class="k">JOIN</span> <span class="n">T2</span> <span class="k">USING</span> <span class="p">(</span><span class="k">join</span> <span class="k">column</span> <span class="n">list</span><span class="p">)</span> </pre></div> </div> -<p>One of <tt class="docutils literal"><span class="pre">LEFT</span></tt>, <tt class="docutils literal"><span class="pre">RIGHT</span></tt>, or <tt class="docutils literal"><span class="pre">FULL</span></tt> must be specified for outer joins. +<p>One of <code class="docutils literal"><span class="pre">LEFT</span></code>, <code class="docutils literal"><span class="pre">RIGHT</span></code>, or <code class="docutils literal"><span class="pre">FULL</span></code> must be specified for outer joins. Join conditions in outer join will have different behavior according to corresponding table references of join conditions. To know outer join behavior in more detail, please refer to <a class="reference external" href="http://www.ibm.com/developerworks/data/library/techarticle/purcell/0201purcell.html";>Advanced outer join constructs</a>.</p> @@ -272,9 +272,9 @@ To know outer join behavior in more deta <div class="highlight-sql"><div class="highlight"><pre><span class="n">T1</span> <span class="k">NATURAL</span> <span class="k">JOIN</span> <span class="n">T2</span> </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">NATURAL</span></tt> is a short form of <tt class="docutils literal"><span class="pre">USING</span></tt>. It forms a <tt class="docutils literal"><span class="pre">USING</span></tt> list consisting of all common column names that appear in +<p><code class="docutils literal"><span class="pre">NATURAL</span></code> is a short form of <code class="docutils literal"><span class="pre">USING</span></code>. It forms a <code class="docutils literal"><span class="pre">USING</span></code> list consisting of all common column names that appear in both join tables. These common columns appear only once in the output table. If there are no common columns, -<tt class="docutils literal"><span class="pre">NATURAL</span></tt> behaves like <tt class="docutils literal"><span class="pre">CROSS</span> <span class="pre">JOIN</span></tt>.</p> +<code class="docutils literal"><span class="pre">NATURAL</span></code> behaves like <code class="docutils literal"><span class="pre">CROSS</span> <span class="pre">JOIN</span></code>.</p> <p><strong>Subqueries</strong></p> <p>Subqueries allow users to specify a derived table. It requires enclosing a SQL statement in parentheses and an alias name. For example:</p> @@ -292,7 +292,7 @@ For example:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">WHERE</span> <span class="n">search_condition</span> </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">search_condition</span></tt> can be any boolean expression. +<p><code class="docutils literal"><span class="pre">search_condition</span></code> can be any boolean expression. In order to know additional predicates, please refer to <a class="reference internal" href="predicates.html"><em>Predicates</em></a>.</p> </div> <div class="section" id="groupby-and-having-clauses"> @@ -305,19 +305,19 @@ In order to know additional predicates, <span class="p">[</span><span class="k">HAVING</span> <span class="n">boolean_expression</span><span class="p">]</span> </pre></div> </div> -<p>The rows which passes <tt class="docutils literal"><span class="pre">WHERE</span></tt> filter may be subject to grouping, specified by <tt class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></tt> clause. -Grouping combines a set of rows having common values into one group, and then computes rows in the group with aggregation functions. <tt class="docutils literal"><span class="pre">HAVING</span></tt> clause can be used with only <tt class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></tt> clause. It eliminates the unqualified result rows of grouping.</p> -<p><tt class="docutils literal"><span class="pre">grouping_column_reference</span></tt> can be a column reference, a complex expression including scalar functions and arithmetic operations.</p> +<p>The rows which passes <code class="docutils literal"><span class="pre">WHERE</span></code> filter may be subject to grouping, specified by <code class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></code> clause. +Grouping combines a set of rows having common values into one group, and then computes rows in the group with aggregation functions. <code class="docutils literal"><span class="pre">HAVING</span></code> clause can be used with only <code class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></code> clause. It eliminates the unqualified result rows of grouping.</p> +<p><code class="docutils literal"><span class="pre">grouping_column_reference</span></code> can be a column reference, a complex expression including scalar functions and arithmetic operations.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="n">l_orderkey</span><span class="p">,</span> <span class="k">SUM</span><span class="p">(</span><span class="n">l_quantity</span><span class="p">)</span> <span class="k">AS</span> <span class="n">quantity</span> <span class="k">FROM</span> <span class="n">lineitem</span> <span class="k">GROUP</span> <span class="k">BY</span> <span class="n">l_orderkey</span><span class="p">;</span> <span class="k">SELECT</span> <span class="n">substr</span><span class="p">(</span><span class="n">l_shipdate</span><span class="p">,</span><span class="mi">1</span><span class="p">,</span><span class="mi">4</span><span class="p">)</span> <span class="k">as</span> <span class="k">year</span><span class="p">,</span> <span class="k">SUM</span><span class="p">(</span><span class="n">l_orderkey</span><span class="p">)</span> <span class="k">AS</span> <span class="n">total2</span> <span class="k">FROM</span> <span class="n">lineitem</span> <span class="k">GROUP</span> <span class="k">BY</span> <span class="n">substr</span><span class="p">(</span><span class="n">l_shipdate</span><span class="p">,</span><span class="mi">1</span><span class="p">,</span><span class="mi">4</span><span class="p">);</span> </pre></div> </div> -<p>If a SQL statement includes <tt class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></tt> clause, expressions in select list must be either grouping_column_reference or aggregation function. For example, the following example query is not allowed because <tt class="docutils literal"><span class="pre">l_orderkey</span></tt> does not occur in <tt class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></tt> clause.</p> +<p>If a SQL statement includes <code class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></code> clause, expressions in select list must be either grouping_column_reference or aggregation function. For example, the following example query is not allowed because <code class="docutils literal"><span class="pre">l_orderkey</span></code> does not occur in <code class="docutils literal"><span class="pre">GROUP</span> <span class="pre">BY</span></code> clause.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="n">l_orderkey</span><span class="p">,</span> <span class="n">l_partkey</span><span class="p">,</span> <span class="k">SUM</span><span class="p">(</span><span class="n">l_orderkey</span><span class="p">)</span> <span class="k">AS</span> <span class="n">total</span> <span class="k">FROM</span> <span class="n">lineitem</span> <span class="k">GROUP</span> <span class="k">BY</span> <span class="n">l_partkey</span><span class="p">;</span> </pre></div> </div> -<p>Aggregation functions can be used with <tt class="docutils literal"><span class="pre">DISTINCT</span></tt> keywords. It forces an individual aggregate function to take only distinct values of the argument expression. <tt class="docutils literal"><span class="pre">DISTINCT</span></tt> keyword is used as follows:</p> +<p>Aggregation functions can be used with <code class="docutils literal"><span class="pre">DISTINCT</span></code> keywords. It forces an individual aggregate function to take only distinct values of the argument expression. <code class="docutils literal"><span class="pre">DISTINCT</span></code> keyword is used as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="n">l_partkey</span><span class="p">,</span> <span class="k">COUNT</span><span class="p">(</span><span class="k">distinct</span> <span class="n">l_quantity</span><span class="p">),</span> <span class="k">SUM</span><span class="p">(</span><span class="k">distinct</span> <span class="n">l_extendedprice</span><span class="p">)</span> <span class="k">AS</span> <span class="n">total</span> <span class="k">FROM</span> <span class="n">lineitem</span> <span class="k">GROUP</span> <span class="k">BY</span> <span class="n">l_partkey</span><span class="p">;</span> </pre></div> </div> @@ -328,12 +328,12 @@ Grouping combines a set of rows having c <div class="highlight-sql"><div class="highlight"><pre><span class="k">FROM</span> <span class="p">...</span> <span class="k">ORDER</span> <span class="k">BY</span> <span class="o"><</span><span class="n">sort_expr</span><span class="o">></span> <span class="p">[(</span><span class="k">ASC</span><span class="o">|</span><span class="k">DESC</span><span class="p">)]</span> <span class="p">[</span><span class="k">NULL</span> <span class="p">(</span><span class="k">FIRST</span><span class="o">|</span><span class="k">LAST</span><span class="p">)</span> <span class="p">[,...]</span> </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">sort_expr</span></tt> can be a column reference, aliased column reference, or a complex expression. -<tt class="docutils literal"><span class="pre">ASC</span></tt> indicates an ascending order of <tt class="docutils literal"><span class="pre">sort_expr</span></tt> values. <tt class="docutils literal"><span class="pre">DESC</span></tt> indicates a descending order of <tt class="docutils literal"><span class="pre">sort_expr</span></tt> values. -<tt class="docutils literal"><span class="pre">ASC</span></tt> is the default order.</p> -<p><tt class="docutils literal"><span class="pre">NULLS</span> <span class="pre">FIRST</span></tt> and <tt class="docutils literal"><span class="pre">NULLS</span> <span class="pre">LAST</span></tt> options can be used to determine whether nulls values appear +<p><code class="docutils literal"><span class="pre">sort_expr</span></code> can be a column reference, aliased column reference, or a complex expression. +<code class="docutils literal"><span class="pre">ASC</span></code> indicates an ascending order of <code class="docutils literal"><span class="pre">sort_expr</span></code> values. <code class="docutils literal"><span class="pre">DESC</span></code> indicates a descending order of <code class="docutils literal"><span class="pre">sort_expr</span></code> values. +<code class="docutils literal"><span class="pre">ASC</span></code> is the default order.</p> +<p><code class="docutils literal"><span class="pre">NULLS</span> <span class="pre">FIRST</span></code> and <code class="docutils literal"><span class="pre">NULLS</span> <span class="pre">LAST</span></code> options can be used to determine whether nulls values appear before or after non-null values in the sort ordering. By default, null values are dealt as if larger than any non-null value; -that is, <tt class="docutils literal"><span class="pre">NULLS</span> <span class="pre">FIRST</span></tt> is the default for <tt class="docutils literal"><span class="pre">DESC</span></tt> order, and <tt class="docutils literal"><span class="pre">NULLS</span> <span class="pre">LAST</span></tt> otherwise.</p> +that is, <code class="docutils literal"><span class="pre">NULLS</span> <span class="pre">FIRST</span></code> is the default for <code class="docutils literal"><span class="pre">DESC</span></code> order, and <code class="docutils literal"><span class="pre">NULLS</span> <span class="pre">LAST</span></code> otherwise.</p> </div> <div class="section" id="window-functions"> <h2>Window Functions<a class="headerlink" href="#window-functions" title="Permalink to this headline">¶</a></h2> @@ -352,15 +352,15 @@ the same partition as the current row.</ <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="n">l_orderkey</span><span class="p">,</span> <span class="k">sum</span><span class="p">(</span><span class="n">l_discount</span><span class="p">)</span> <span class="n">OVER</span> <span class="p">(</span><span class="n">PARTITION</span> <span class="k">BY</span> <span class="n">l_orderkey</span><span class="p">),</span> <span class="k">sum</span><span class="p">(</span><span class="n">l_quantity</span><span class="p">)</span> <span class="n">OVER</span> <span class="p">(</span><span class="n">PARTITION</span> <span class="k">BY</span> <span class="n">l_orderkey</span><span class="p">)</span> <span class="k">FROM</span> <span class="n">LINEITEM</span><span class="p">;</span> </pre></div> </div> -<p>If <tt class="docutils literal"><span class="pre">OVER()</span></tt> clause is empty as following, it makes all table rows into one window frame.</p> +<p>If <code class="docutils literal"><span class="pre">OVER()</span></code> clause is empty as following, it makes all table rows into one window frame.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="n">salary</span><span class="p">,</span> <span class="k">sum</span><span class="p">(</span><span class="n">salary</span><span class="p">)</span> <span class="n">OVER</span> <span class="p">()</span> <span class="k">FROM</span> <span class="n">empsalary</span><span class="p">;</span> </pre></div> </div> -<p>Also, <tt class="docutils literal"><span class="pre">ORDER</span> <span class="pre">BY</span></tt> clause can be used without <tt class="docutils literal"><span class="pre">PARTITION</span> <span class="pre">BY</span></tt> clause as follows:</p> +<p>Also, <code class="docutils literal"><span class="pre">ORDER</span> <span class="pre">BY</span></code> clause can be used without <code class="docutils literal"><span class="pre">PARTITION</span> <span class="pre">BY</span></code> clause as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SELECT</span> <span class="n">salary</span><span class="p">,</span> <span class="k">sum</span><span class="p">(</span><span class="n">salary</span><span class="p">)</span> <span class="n">OVER</span> <span class="p">(</span><span class="k">ORDER</span> <span class="k">BY</span> <span class="n">salary</span><span class="p">)</span> <span class="k">FROM</span> <span class="n">empsalary</span><span class="p">;</span> </pre></div> </div> -<p>Also, all expressions and aggregation functions are allowed in <tt class="docutils literal"><span class="pre">ORDER</span> <span class="pre">BY</span></tt> clause as follows:</p> +<p>Also, all expressions and aggregation functions are allowed in <code class="docutils literal"><span class="pre">ORDER</span> <span class="pre">BY</span></code> clause as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">select</span> <span class="n">l_orderkey</span><span class="p">,</span> <span class="k">count</span><span class="p">(</span><span class="o">*</span><span class="p">)</span> <span class="k">as</span> <span class="n">cnt</span><span class="p">,</span>
Modified: tajo/site/docs/devel/swift_integration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/swift_integration.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/swift_integration.html (original) +++ tajo/site/docs/devel/swift_integration.html Thu May 28 12:22:19 2015 @@ -201,13 +201,13 @@ You will also need to configure Swift an <p>For details, please see the following sections.</p> <div class="section" id="swift-configuration"> <h2>Swift configuration<a class="headerlink" href="#swift-configuration" title="Permalink to this headline">¶</a></h2> -<p>This step is not mandatory, but is strongly recommended to configure the Swift’s proxy-server with <tt class="docutils literal"><span class="pre">list_endpoints</span></tt> for better performance. +<p>This step is not mandatory, but is strongly recommended to configure the Swift’s proxy-server with <code class="docutils literal"><span class="pre">list_endpoints</span></code> for better performance. More information is available <a class="reference external" href="http://docs.openstack.org/developer/swift/middleware.html#module-swift.common.middleware.list_endpoints";>here</a>.</p> </div> <div class="section" id="hadoop-configurations"> <h2>Hadoop configurations<a class="headerlink" href="#hadoop-configurations" title="Permalink to this headline">¶</a></h2> <p>You need to configure Hadoop to specify how to access Swift objects. -Here is an example of <tt class="docutils literal"><span class="pre">${HADOOP_HOME}/etc/hadoop/core-site.xml</span></tt>.</p> +Here is an example of <code class="docutils literal"><span class="pre">${HADOOP_HOME}/etc/hadoop/core-site.xml</span></code>.</p> <div class="section" id="common-configurations"> <h3>Common configurations<a class="headerlink" href="#common-configurations" title="Permalink to this headline">¶</a></h3> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> @@ -269,7 +269,7 @@ Here is an example of <tt class="docutil </div> <div class="section" id="tajo-configuration"> <h2>Tajo configuration<a class="headerlink" href="#tajo-configuration" title="Permalink to this headline">¶</a></h2> -<p>Finally, you need to configure the classpath of Tajo by adding the following line to <tt class="docutils literal"><span class="pre">${TAJO_HOME}/conf/tajo-evn.sh</span></tt>.</p> +<p>Finally, you need to configure the classpath of Tajo by adding the following line to <code class="docutils literal"><span class="pre">${TAJO_HOME}/conf/tajo-evn.sh</span></code>.</p> <div class="highlight-sh"><div class="highlight"><pre><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span><span class="nv">$HADOOP_HOME</span>/share/hadoop/tools/lib/hadoop-openstack-x.x.x.jar </pre></div> </div> Modified: tajo/site/docs/devel/table_management/parquet.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/table_management/parquet.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/table_management/parquet.html (original) +++ tajo/site/docs/devel/table_management/parquet.html Thu May 28 12:22:19 2015 @@ -205,8 +205,8 @@ regardless of the choice of data process For more details, please refer to <a class="reference external" href="http://parquet.io/";>Parquet File Format</a>.</p> <div class="section" id="how-to-create-a-parquet-table"> <h2>How to Create a Parquet Table?<a class="headerlink" href="#how-to-create-a-parquet-table" title="Permalink to this headline">¶</a></h2> -<p>If you are not familiar with <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> statement, please refer to Data Definition Language <a class="reference internal" href="../sql_language/ddl.html"><em>Data Definition Language</em></a>.</p> -<p>In order to specify a certain file format for your table, you need to use the <tt class="docutils literal"><span class="pre">USING</span></tt> clause in your <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> +<p>If you are not familiar with <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement, please refer to Data Definition Language <a class="reference internal" href="../sql_language/ddl.html"><em>Data Definition Language</em></a>.</p> +<p>In order to specify a certain file format for your table, you need to use the <code class="docutils literal"><span class="pre">USING</span></code> clause in your <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement. Below is an example statement for creating a table using parquet files.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> @@ -220,13 +220,13 @@ statement. Below is an example statement <div class="section" id="physical-properties"> <h2>Physical Properties<a class="headerlink" href="#physical-properties" title="Permalink to this headline">¶</a></h2> <p>Some table storage formats provide parameters for enabling or disabling features and adjusting physical parameters. -The <tt class="docutils literal"><span class="pre">WITH</span></tt> clause in the CREATE TABLE statement allows users to set those parameters.</p> +The <code class="docutils literal"><span class="pre">WITH</span></code> clause in the CREATE TABLE statement allows users to set those parameters.</p> <p>Now, Parquet file provides the following physical properties.</p> <ul class="simple"> -<li><tt class="docutils literal"><span class="pre">parquet.block.size</span></tt>: The block size is the size of a row group being buffered in memory. This limits the memory usage when writing. Larger values will improve the I/O when reading but consume more memory when writing. Default size is 134217728 bytes (= 128 * 1024 * 1024).</li> -<li><tt class="docutils literal"><span class="pre">parquet.page.size</span></tt>: The page size is for compression. When reading, each page can be decompressed independently. A block is composed of pages. The page is the smallest unit that must be read fully to access a single record. If this value is too small, the compression will deteriorate. Default size is 1048576 bytes (= 1 * 1024 * 1024).</li> -<li><tt class="docutils literal"><span class="pre">parquet.compression</span></tt>: The compression algorithm used to compress pages. It should be one of <tt class="docutils literal"><span class="pre">uncompressed</span></tt>, <tt class="docutils literal"><span class="pre">snappy</span></tt>, <tt class="docutils literal"><span class="pre">gzip</span></tt>, <tt class="docutils literal"><span class="pre">lzo</span></tt>. Default is <tt class="docutils literal"><span class="pre">uncompressed</span></tt>.</li> -<li><tt class="docutils literal"><span class="pre">parquet.enable.dictionary</span></tt>: The boolean value is to enable/disable dictionary encoding. It should be one of either <tt class="docutils literal"><span class="pre">true</span></tt> or <tt class="docutils literal"><span class="pre">false</span></tt>. Default is <tt class="docutils literal"><span class="pre">true</span></tt>.</li> +<li><code class="docutils literal"><span class="pre">parquet.block.size</span></code>: The block size is the size of a row group being buffered in memory. This limits the memory usage when writing. Larger values will improve the I/O when reading but consume more memory when writing. Default size is 134217728 bytes (= 128 * 1024 * 1024).</li> +<li><code class="docutils literal"><span class="pre">parquet.page.size</span></code>: The page size is for compression. When reading, each page can be decompressed independently. A block is composed of pages. The page is the smallest unit that must be read fully to access a single record. If this value is too small, the compression will deteriorate. Default size is 1048576 bytes (= 1 * 1024 * 1024).</li> +<li><code class="docutils literal"><span class="pre">parquet.compression</span></code>: The compression algorithm used to compress pages. It should be one of <code class="docutils literal"><span class="pre">uncompressed</span></code>, <code class="docutils literal"><span class="pre">snappy</span></code>, <code class="docutils literal"><span class="pre">gzip</span></code>, <code class="docutils literal"><span class="pre">lzo</span></code>. Default is <code class="docutils literal"><span class="pre">uncompressed</span></code>.</li> +<li><code class="docutils literal"><span class="pre">parquet.enable.dictionary</span></code>: The boolean value is to enable/disable dictionary encoding. It should be one of either <code class="docutils literal"><span class="pre">true</span></code> or <code class="docutils literal"><span class="pre">false</span></code>. Default is <code class="docutils literal"><span class="pre">true</span></code>.</li> </ul> </div> <div class="section" id="compatibility-issues-with-apache-hive"> Modified: tajo/site/docs/devel/table_management/rcfile.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/table_management/rcfile.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/table_management/rcfile.html (original) +++ tajo/site/docs/devel/table_management/rcfile.html Thu May 28 12:22:19 2015 @@ -203,8 +203,8 @@ which shares many similarities with SequenceFile.</p> <div class="section" id="how-to-create-a-rcfile-table"> <h2>How to Create a RCFile Table?<a class="headerlink" href="#how-to-create-a-rcfile-table" title="Permalink to this headline">¶</a></h2> -<p>If you are not familiar with the <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> statement, please refer to the Data Definition Language <a class="reference internal" href="../sql_language/ddl.html"><em>Data Definition Language</em></a>.</p> -<p>In order to specify a certain file format for your table, you need to use the <tt class="docutils literal"><span class="pre">USING</span></tt> clause in your <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> +<p>If you are not familiar with the <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement, please refer to the Data Definition Language <a class="reference internal" href="../sql_language/ddl.html"><em>Data Definition Language</em></a>.</p> +<p>In order to specify a certain file format for your table, you need to use the <code class="docutils literal"><span class="pre">USING</span></code> clause in your <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement. Below is an example statement for creating a table using RCFile.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> @@ -218,12 +218,12 @@ statement. Below is an example statement <div class="section" id="physical-properties"> <h2>Physical Properties<a class="headerlink" href="#physical-properties" title="Permalink to this headline">¶</a></h2> <p>Some table storage formats provide parameters for enabling or disabling features and adjusting physical parameters. -The <tt class="docutils literal"><span class="pre">WITH</span></tt> clause in the CREATE TABLE statement allows users to set those parameters.</p> +The <code class="docutils literal"><span class="pre">WITH</span></code> clause in the CREATE TABLE statement allows users to set those parameters.</p> <p>Now, the RCFile storage type provides the following physical properties.</p> <ul class="simple"> -<li><tt class="docutils literal"><span class="pre">rcfile.serde</span></tt> : custom (De)serializer class. <tt class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></tt> is the default (de)serializer class.</li> -<li><tt class="docutils literal"><span class="pre">rcfile.null</span></tt> : NULL character. It is only used when a table uses <tt class="docutils literal"><span class="pre">org.apache.tajo.storage.TextSerializerDeserializer</span></tt>. The default NULL character is an empty string <tt class="docutils literal"><span class="pre">''</span></tt>. Hive’s default NULL character is <tt class="docutils literal"><span class="pre">'\\N'</span></tt>.</li> -<li><tt class="docutils literal"><span class="pre">compression.codec</span></tt> : Compression codec. You can enable compression feature and set specified compression algorithm. The compression algorithm used to compress files. The compression codec name should be the fully qualified class name inherited from <a class="reference external" href="https://hadoop.apache.org/docs/current/api/org/apache/hadoop/io/compress/CompressionCodec.html";>org.apache.hadoop.io.compress.CompressionCodec</a>. By default, compression is disabled.</li> +<li><code class="docutils literal"><span class="pre">rcfile.serde</span></code> : custom (De)serializer class. <code class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></code> is the default (de)serializer class.</li> +<li><code class="docutils literal"><span class="pre">rcfile.null</span></code> : NULL character. It is only used when a table uses <code class="docutils literal"><span class="pre">org.apache.tajo.storage.TextSerializerDeserializer</span></code>. The default NULL character is an empty string <code class="docutils literal"><span class="pre">''</span></code>. Hive’s default NULL character is <code class="docutils literal"><span class="pre">'\\N'</span></code>.</li> +<li><code class="docutils literal"><span class="pre">compression.codec</span></code> : Compression codec. You can enable compression feature and set specified compression algorithm. The compression algorithm used to compress files. The compression codec name should be the fully qualified class name inherited from <a class="reference external" href="https://hadoop.apache.org/docs/current/api/org/apache/hadoop/io/compress/CompressionCodec.html";>org.apache.hadoop.io.compress.CompressionCodec</a>. By default, compression is disabled.</li> </ul> <p>The following is an example for creating a table using RCFile that uses compression.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> @@ -239,14 +239,14 @@ The <tt class="docutils literal"><span c <h2>RCFile (De)serializers<a class="headerlink" href="#rcfile-de-serializers" title="Permalink to this headline">¶</a></h2> <p>Tajo provides two built-in (De)serializer for RCFile:</p> <ul class="simple"> -<li><tt class="docutils literal"><span class="pre">org.apache.tajo.storage.TextSerializerDeserializer</span></tt>: stores column values in a plain-text form.</li> -<li><tt class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></tt>: stores column values in a binary file format.</li> +<li><code class="docutils literal"><span class="pre">org.apache.tajo.storage.TextSerializerDeserializer</span></code>: stores column values in a plain-text form.</li> +<li><code class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></code>: stores column values in a binary file format.</li> </ul> <p>The RCFile format can store some metadata in the RCFile header. Tajo writes the (de)serializer class name into the metadata header of each RCFile when the RCFile is created in Tajo.</p> <div class="admonition note"> <p class="first admonition-title">Note</p> -<p class="last"><tt class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></tt> is the default (de) serializer for RCFile.</p> +<p class="last"><code class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></code> is the default (de) serializer for RCFile.</p> </div> </div> <div class="section" id="compatibility-issues-with-apache-hive"> @@ -257,16 +257,16 @@ In other words, Tajo can process RCFiles by setting a physical property.</p> <p>In Hive, there are two SerDe, and they correspond to the following (de)serializer in Tajo.</p> <ul class="simple"> -<li><tt class="docutils literal"><span class="pre">org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe</span></tt>: corresponds to <tt class="docutils literal"><span class="pre">TextSerializerDeserializer</span></tt> in Tajo.</li> -<li><tt class="docutils literal"><span class="pre">org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe</span></tt>: corresponds to <tt class="docutils literal"><span class="pre">BinarySerializerDeserializer</span></tt> in Tajo.</li> +<li><code class="docutils literal"><span class="pre">org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe</span></code>: corresponds to <code class="docutils literal"><span class="pre">TextSerializerDeserializer</span></code> in Tajo.</li> +<li><code class="docutils literal"><span class="pre">org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe</span></code>: corresponds to <code class="docutils literal"><span class="pre">BinarySerializerDeserializer</span></code> in Tajo.</li> </ul> <p>The compatibility issue mostly occurs when a user creates an external table pointing to data of an existing table. The following section explains two cases: 1) the case where Tajo reads RCFile written by Hive, and 2) the case where Hive reads RCFile written by Tajo.</p> <div class="section" id="when-tajo-reads-rcfile-generated-in-hive"> <h3>When Tajo reads RCFile generated in Hive<a class="headerlink" href="#when-tajo-reads-rcfile-generated-in-hive" title="Permalink to this headline">¶</a></h3> -<p>To create an external RCFile table generated with <tt class="docutils literal"><span class="pre">ColumnarSerDe</span></tt> in Hive, -you should set the physical property <tt class="docutils literal"><span class="pre">rcfile.serde</span></tt> in Tajo as follows:</p> +<p>To create an external RCFile table generated with <code class="docutils literal"><span class="pre">ColumnarSerDe</span></code> in Hive, +you should set the physical property <code class="docutils literal"><span class="pre">rcfile.serde</span></code> in Tajo as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">EXTERNAL</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> @@ -276,8 +276,8 @@ you should set the physical property <tt <span class="k">LOCATION</span> <span class="s1">'....'</span><span class="p">;</span> </pre></div> </div> -<p>To create an external RCFile table generated with <tt class="docutils literal"><span class="pre">LazyBinaryColumnarSerDe</span></tt> in Hive, -you should set the physical property <tt class="docutils literal"><span class="pre">rcfile.serde</span></tt> in Tajo as follows:</p> +<p>To create an external RCFile table generated with <code class="docutils literal"><span class="pre">LazyBinaryColumnarSerDe</span></code> in Hive, +you should set the physical property <code class="docutils literal"><span class="pre">rcfile.serde</span></code> in Tajo as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">EXTERNAL</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> @@ -289,14 +289,14 @@ you should set the physical property <tt </div> <div class="admonition note"> <p class="first admonition-title">Note</p> -<p class="last">As we mentioned above, <tt class="docutils literal"><span class="pre">BinarySerializerDeserializer</span></tt> is the default (de) serializer for RCFile. -So, you can omit the <tt class="docutils literal"><span class="pre">rcfile.serde</span></tt> only for <tt class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></tt>.</p> +<p class="last">As we mentioned above, <code class="docutils literal"><span class="pre">BinarySerializerDeserializer</span></code> is the default (de) serializer for RCFile. +So, you can omit the <code class="docutils literal"><span class="pre">rcfile.serde</span></code> only for <code class="docutils literal"><span class="pre">org.apache.tajo.storage.BinarySerializerDeserializer</span></code>.</p> </div> </div> <div class="section" id="when-hive-reads-rcfile-generated-in-tajo"> <h3>When Hive reads RCFile generated in Tajo<a class="headerlink" href="#when-hive-reads-rcfile-generated-in-tajo" title="Permalink to this headline">¶</a></h3> -<p>To create an external RCFile table written by Tajo with <tt class="docutils literal"><span class="pre">TextSerializerDeserializer</span></tt>, -you should set the <tt class="docutils literal"><span class="pre">SERDE</span></tt> as follows:</p> +<p>To create an external RCFile table written by Tajo with <code class="docutils literal"><span class="pre">TextSerializerDeserializer</span></code>, +you should set the <code class="docutils literal"><span class="pre">SERDE</span></code> as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="n">string</span><span class="p">,</span> @@ -306,8 +306,8 @@ you should set the <tt class="docutils l <span class="k">LOCATION</span> <span class="s1">'<hdfs_location>'</span><span class="p">;</span> </pre></div> </div> -<p>To create an external RCFile table written by Tajo with <tt class="docutils literal"><span class="pre">BinarySerializerDeserializer</span></tt>, -you should set the <tt class="docutils literal"><span class="pre">SERDE</span></tt> as follows:</p> +<p>To create an external RCFile table written by Tajo with <code class="docutils literal"><span class="pre">BinarySerializerDeserializer</span></code>, +you should set the <code class="docutils literal"><span class="pre">SERDE</span></code> as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="n">string</span><span class="p">,</span> Modified: tajo/site/docs/devel/table_management/sequencefile.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/table_management/sequencefile.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/table_management/sequencefile.html (original) +++ tajo/site/docs/devel/table_management/sequencefile.html Thu May 28 12:22:19 2015 @@ -203,7 +203,7 @@ <h2>Introduce<a class="headerlink" href="#introduce" title="Permalink to this headline">¶</a></h2> <p>SequenceFiles are flat files consisting of binary key/value pairs. SequenceFile is basic file format which provided by Hadoop, and Hive also provides it to create a table.</p> -<p>The <tt class="docutils literal"><span class="pre">USING</span> <span class="pre">sequencefile</span></tt> keywords let you create a SequecneFile. Here is an example statement to create a table using <tt class="docutils literal"><span class="pre">SequecneFile</span></tt>:</p> +<p>The <code class="docutils literal"><span class="pre">USING</span> <span class="pre">sequencefile</span></code> keywords let you create a SequecneFile. Here is an example statement to create a table using <code class="docutils literal"><span class="pre">SequecneFile</span></code>:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span><span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> <span class="n">score</span> <span class="nb">float</span><span class="p">,</span> <span class="k">type</span> <span class="nb">text</span><span class="p">)</span> <span class="k">USING</span> <span class="n">sequencefile</span><span class="p">;</span> </pre></div> @@ -223,7 +223,7 @@ SequenceFile is basic file format which <li>BinarySerializerDeserializer: This class can read and write data in binary file format.</li> </ul> </div></blockquote> -<p>The default is the SerDe for plain text file in Tajo. The above example statement created the table using TextSerializerDeserializer.If you want to use BinarySerializerDeserializer, you can specify it by <tt class="docutils literal"><span class="pre">sequencefile.serde</span></tt> keywords:</p> +<p>The default is the SerDe for plain text file in Tajo. The above example statement created the table using TextSerializerDeserializer.If you want to use BinarySerializerDeserializer, you can specify it by <code class="docutils literal"><span class="pre">sequencefile.serde</span></code> keywords:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span><span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> <span class="n">score</span> <span class="nb">float</span><span class="p">,</span> <span class="k">type</span> <span class="nb">text</span><span class="p">)</span> <span class="k">USING</span> <span class="n">sequencefile</span> <span class="k">with</span> <span class="p">(</span><span class="s1">'sequencefile.serde'</span><span class="o">=</span><span class="s1">'org.apache.tajo.storage.BinarySerializerDeserializer'</span><span class="p">)</span> </pre></div> @@ -246,7 +246,7 @@ SequenceFile is basic file format which <li>BlockCompressWriter : Block-compressed files, both keys & values are collected in ‘blocks’ separately and compressed. The size of the ‘block’ is configurable.</li> </ul> </div></blockquote> -<p>The default is Uncompressed Writer in Tajo. If you want to use RecordCompressWriter, you can specify it by <tt class="docutils literal"><span class="pre">compression.type</span></tt> keywords and <tt class="docutils literal"><span class="pre">compression.codec</span></tt> keywords:</p> +<p>The default is Uncompressed Writer in Tajo. If you want to use RecordCompressWriter, you can specify it by <code class="docutils literal"><span class="pre">compression.type</span></code> keywords and <code class="docutils literal"><span class="pre">compression.codec</span></code> keywords:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span><span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> <span class="n">score</span> <span class="nb">float</span><span class="p">,</span> <span class="k">type</span> <span class="nb">text</span><span class="p">)</span> <span class="k">USING</span> <span class="n">sequencefile</span> <span class="k">with</span> <span class="p">(</span><span class="s1">'compression.type'</span><span class="o">=</span><span class="s1">'RECORD'</span><span class="p">,</span><span class="s1">'compression.codec'</span><span class="o">=</span><span class="s1">'org.apache.hadoop.io.compress.SnappyCodec'</span><span class="p">)</span> </pre></div> @@ -258,7 +258,7 @@ SequenceFile is basic file format which <span class="n">hive</span><span class="o">></span> <span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span><span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="n">string</span><span class="p">,</span> <span class="n">score</span> <span class="nb">float</span><span class="p">,</span> <span class="k">type</span> <span class="n">string</span><span class="p">)</span> <span class="n">STORED</span> <span class="k">AS</span> <span class="n">sequencefile</span><span class="p">;;</span> </pre></div> </div> -<p>And if you want to use BlockCompressWriter, you can specify it by <tt class="docutils literal"><span class="pre">compression.type</span></tt> keywords and <tt class="docutils literal"><span class="pre">compression.codec</span></tt> keywords:</p> +<p>And if you want to use BlockCompressWriter, you can specify it by <code class="docutils literal"><span class="pre">compression.type</span></code> keywords and <code class="docutils literal"><span class="pre">compression.codec</span></code> keywords:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span><span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> <span class="n">score</span> <span class="nb">float</span><span class="p">,</span> <span class="k">type</span> <span class="nb">text</span><span class="p">)</span> <span class="k">USING</span> <span class="n">sequencefile</span> <span class="k">with</span> <span class="p">(</span><span class="s1">'compression.type'</span><span class="o">=</span><span class="s1">'BLOCK'</span><span class="p">,</span><span class="s1">'compression.codec'</span><span class="o">=</span><span class="s1">'org.apache.hadoop.io.compress.SnappyCodec'</span><span class="p">)</span> </pre></div> Modified: tajo/site/docs/devel/table_management/table_overview.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/table_management/table_overview.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/table_management/table_overview.html (original) +++ tajo/site/docs/devel/table_management/table_overview.html Thu May 28 12:22:19 2015 @@ -202,20 +202,39 @@ </div> <div class="section" id="managed-table"> <h2>Managed Table<a class="headerlink" href="#managed-table" title="Permalink to this headline">¶</a></h2> -<div class="admonition-todo admonition" id="index-0"> -<p class="first last admonition-title">Todo</p> +<p><code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement with <code class="docutils literal"><span class="pre">EXTERNAL</span></code> keyword lets you create a table located in the warehouse directory specified by the configuration property <code class="docutils literal"><span class="pre">tajo.warehouse.directory</span></code> or <code class="docutils literal"><span class="pre">${tajo.root}/warehouse</span></code> by default. For example:</p> +<div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">employee</span> <span class="p">(</span> + <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> + <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> + <span class="n">age</span> +<span class="p">);</span> +</pre></div> </div> </div> <div class="section" id="external-table"> <h2>External Table<a class="headerlink" href="#external-table" title="Permalink to this headline">¶</a></h2> -<div class="admonition-todo admonition" id="index-1"> -<p class="first last admonition-title">Todo</p> +<p><code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">EXTERNAL</span> <span class="pre">TABLE</span></code> statement lets you create a table located in a specify location so that Tajo does not use a default data warehouse location for the table. External tables are in common used if you already have data generated. LOCATION clause must be required for an external table.</p> +<div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">EXTERNAL</span> <span class="k">TABLE</span> <span class="n">employee</span> <span class="p">(</span> + <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> + <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> + <span class="n">age</span> +<span class="p">)</span> <span class="k">LOCATION</span> <span class="s1">'hdfs://table/path'</span><span class="p">;</span> +</pre></div> </div> +<p>The location can be a directory located in HDFS, Amazon S3, HBase, or local file system (if a Tajo cluster runs in a single machine). URI examples are as follows:</p> +<blockquote> +<div><ul class="simple"> +<li>HDFS - <code class="docutils literal"><span class="pre">hdfs://hostname:8020/table1</span></code></li> +<li>Amazon S3 - <code class="docutils literal"><span class="pre">s3://bucket-name/table1</span></code></li> +<li>local file system - <code class="docutils literal"><span class="pre">file:///dir/table1</span></code></li> +<li>Openstack Swift - <code class="docutils literal"><span class="pre">swift://bucket-name/table1</span></code></li> +</ul> +</div></blockquote> </div> <div class="section" id="table-properties"> <h2>Table Properties<a class="headerlink" href="#table-properties" title="Permalink to this headline">¶</a></h2> <p>All table formats provide parameters for enabling or disabling features and adjusting physical parameters. -The <tt class="docutils literal"><span class="pre">WITH</span></tt> clause in the CREATE TABLE statement allows users to set those properties.</p> +The <code class="docutils literal"><span class="pre">WITH</span></code> clause in the CREATE TABLE statement allows users to set those properties.</p> <p>The following example is to set a custom field delimiter, NULL character, and compression codec:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> @@ -234,13 +253,13 @@ The <tt class="docutils literal"><span c <p>There are some common table properties which are used in most tables.</p> <div class="section" id="compression"> <h3>Compression<a class="headerlink" href="#compression" title="Permalink to this headline">¶</a></h3> -<div class="admonition-todo admonition" id="index-2"> +<div class="admonition-todo admonition" id="index-0"> <p class="first last admonition-title">Todo</p> </div> </div> <div class="section" id="time-zone"> <h3>Time zone<a class="headerlink" href="#time-zone" title="Permalink to this headline">¶</a></h3> -<p>In Tajo, a table property <tt class="docutils literal"><span class="pre">timezone</span></tt> allows users to specify a time zone that the table uses for reading or writing.</p> +<p>In Tajo, a table property <code class="docutils literal"><span class="pre">timezone</span></code> allows users to specify a time zone that the table uses for reading or writing.</p> <p>You can specify a table time zone as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">EXTERNAL</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">t_timestamp</span> <span class="k">TIMESTAMP</span><span class="p">,</span> Modified: tajo/site/docs/devel/table_management/text.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/table_management/text.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/table_management/text.html (original) +++ tajo/site/docs/devel/table_management/text.html Thu May 28 12:22:19 2015 @@ -200,14 +200,14 @@ <div class="section" id="text"> <h1>TEXT<a class="headerlink" href="#text" title="Permalink to this headline">¶</a></h1> <p>A character-separated values plain-text file represents a tabular data set consisting of rows and columns. -Each row is a plan-text line. A line is usually broken by a character line feed <tt class="docutils literal"><span class="pre">\n</span></tt> or carriage-return <tt class="docutils literal"><span class="pre">\r</span></tt>. -The line feed <tt class="docutils literal"><span class="pre">\n</span></tt> is the default delimiter in Tajo. Each record consists of multiple fields, separated by -some other character or string, most commonly a literal vertical bar <tt class="docutils literal"><span class="pre">|</span></tt>, comma <tt class="docutils literal"><span class="pre">,</span></tt> or tab <tt class="docutils literal"><span class="pre">\t</span></tt>. +Each row is a plan-text line. A line is usually broken by a character line feed <code class="docutils literal"><span class="pre">\n</span></code> or carriage-return <code class="docutils literal"><span class="pre">\r</span></code>. +The line feed <code class="docutils literal"><span class="pre">\n</span></code> is the default delimiter in Tajo. Each record consists of multiple fields, separated by +some other character or string, most commonly a literal vertical bar <code class="docutils literal"><span class="pre">|</span></code>, comma <code class="docutils literal"><span class="pre">,</span></code> or tab <code class="docutils literal"><span class="pre">\t</span></code>. The vertical bar is used as the default field delimiter in Tajo.</p> <div class="section" id="how-to-create-a-text-table"> <h2>How to Create a TEXT Table ?<a class="headerlink" href="#how-to-create-a-text-table" title="Permalink to this headline">¶</a></h2> -<p>If you are not familiar with the <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> statement, please refer to the Data Definition Language <a class="reference internal" href="../sql_language/ddl.html"><em>Data Definition Language</em></a>.</p> -<p>In order to specify a certain file format for your table, you need to use the <tt class="docutils literal"><span class="pre">USING</span></tt> clause in your <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> +<p>If you are not familiar with the <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement, please refer to the Data Definition Language <a class="reference internal" href="../sql_language/ddl.html"><em>Data Definition Language</em></a>.</p> +<p>In order to specify a certain file format for your table, you need to use the <code class="docutils literal"><span class="pre">USING</span></code> clause in your <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement. The below is an example statement for creating a table using <em>TEXT</em> format.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> @@ -222,20 +222,20 @@ statement. The below is an example state <div class="section" id="physical-properties"> <h2>Physical Properties<a class="headerlink" href="#physical-properties" title="Permalink to this headline">¶</a></h2> <p>Some table storage formats provide parameters for enabling or disabling features and adjusting physical parameters. -The <tt class="docutils literal"><span class="pre">WITH</span></tt> clause in the CREATE TABLE statement allows users to set those parameters.</p> +The <code class="docutils literal"><span class="pre">WITH</span></code> clause in the CREATE TABLE statement allows users to set those parameters.</p> <p><em>TEXT</em> format provides the following physical properties.</p> <ul class="simple"> -<li><tt class="docutils literal"><span class="pre">text.delimiter</span></tt>: delimiter character. <tt class="docutils literal"><span class="pre">|</span></tt> or <tt class="docutils literal"><span class="pre">\u0001</span></tt> is usually used, and the default field delimiter is <tt class="docutils literal"><span class="pre">|</span></tt>.</li> -<li><tt class="docutils literal"><span class="pre">text.null</span></tt>: <tt class="docutils literal"><span class="pre">NULL</span></tt> character. The default <tt class="docutils literal"><span class="pre">NULL</span></tt> character is an empty string <tt class="docutils literal"><span class="pre">''</span></tt>. Hive’s default <tt class="docutils literal"><span class="pre">NULL</span></tt> character is <tt class="docutils literal"><span class="pre">'\\N'</span></tt>.</li> -<li><tt class="docutils literal"><span class="pre">compression.codec</span></tt>: Compression codec. You can enable compression feature and set specified compression algorithm. The compression algorithm used to compress files. The compression codec name should be the fully qualified class name inherited from <a class="reference external" href="https://hadoop.apache.org/docs/current/api/org/apache/hadoop/io/compress/CompressionCodec.html";>org.apache.hadoop.io.compress.CompressionCodec</a>. By default, compression is disabled.</li> -<li><tt class="docutils literal"><span class="pre">text.serde</span></tt>: custom (De)serializer class. <tt class="docutils literal"><span class="pre">org.apache.tajo.storage.text.CSVLineSerDe</span></tt> is the default (De)serializer class.</li> -<li><tt class="docutils literal"><span class="pre">timezone</span></tt>: the time zone that the table uses for writting. When table rows are read or written, <tt class="docutils literal"><span class="pre">`timestamp`</span></tt> and <tt class="docutils literal"><span class="pre">`time`</span></tt> column values are adjusted by this timezone if it is set. Time zone can be an abbreviation form like ‘PST’ or ‘DST’. Also, it accepts an offset-based form like ‘UTC+9’ or a location-based form like ‘Asia/Seoul’.</li> -<li><tt class="docutils literal"><span class="pre">text.error-tolerance.max-num</span></tt>: the maximum number of permissible parsing errors. This value should be an integer value. By default, <tt class="docutils literal"><span class="pre">text.error-tolerance.max-num</span></tt> is <tt class="docutils literal"><span class="pre">0</span></tt>. According to the value, parsing errors will be handled in different ways. -* If <tt class="docutils literal"><span class="pre">text.error-tolerance.max-num</span> <span class="pre"><</span> <span class="pre">0</span></tt>, all parsing errors are ignored. -* If <tt class="docutils literal"><span class="pre">text.error-tolerance.max-num</span> <span class="pre">==</span> <span class="pre">0</span></tt>, any parsing error is not allowed. If any error occurs, the query will be failed. (default) -* If <tt class="docutils literal"><span class="pre">text.error-tolerance.max-num</span> <span class="pre">></span> <span class="pre">0</span></tt>, the given number of parsing errors in each task will be pemissible.</li> +<li><code class="docutils literal"><span class="pre">text.delimiter</span></code>: delimiter character. <code class="docutils literal"><span class="pre">|</span></code> or <code class="docutils literal"><span class="pre">\u0001</span></code> is usually used, and the default field delimiter is <code class="docutils literal"><span class="pre">|</span></code>.</li> +<li><code class="docutils literal"><span class="pre">text.null</span></code>: <code class="docutils literal"><span class="pre">NULL</span></code> character. The default <code class="docutils literal"><span class="pre">NULL</span></code> character is an empty string <code class="docutils literal"><span class="pre">''</span></code>. Hive’s default <code class="docutils literal"><span class="pre">NULL</span></code> character is <code class="docutils literal"><span class="pre">'\\N'</span></code>.</li> +<li><code class="docutils literal"><span class="pre">compression.codec</span></code>: Compression codec. You can enable compression feature and set specified compression algorithm. The compression algorithm used to compress files. The compression codec name should be the fully qualified class name inherited from <a class="reference external" href="https://hadoop.apache.org/docs/current/api/org/apache/hadoop/io/compress/CompressionCodec.html";>org.apache.hadoop.io.compress.CompressionCodec</a>. By default, compression is disabled.</li> +<li><code class="docutils literal"><span class="pre">text.serde</span></code>: custom (De)serializer class. <code class="docutils literal"><span class="pre">org.apache.tajo.storage.text.CSVLineSerDe</span></code> is the default (De)serializer class.</li> +<li><code class="docutils literal"><span class="pre">timezone</span></code>: the time zone that the table uses for writting. When table rows are read or written, <code class="docutils literal"><span class="pre">`timestamp`</span></code> and <code class="docutils literal"><span class="pre">`time`</span></code> column values are adjusted by this timezone if it is set. Time zone can be an abbreviation form like ‘PST’ or ‘DST’. Also, it accepts an offset-based form like ‘UTC+9’ or a location-based form like ‘Asia/Seoul’.</li> +<li><code class="docutils literal"><span class="pre">text.error-tolerance.max-num</span></code>: the maximum number of permissible parsing errors. This value should be an integer value. By default, <code class="docutils literal"><span class="pre">text.error-tolerance.max-num</span></code> is <code class="docutils literal"><span class="pre">0</span></code>. According to the value, parsing errors will be handled in different ways. +* If <code class="docutils literal"><span class="pre">text.error-tolerance.max-num</span> <span class="pre"><</span> <span class="pre">0</span></code>, all parsing errors are ignored. +* If <code class="docutils literal"><span class="pre">text.error-tolerance.max-num</span> <span class="pre">==</span> <span class="pre">0</span></code>, any parsing error is not allowed. If any error occurs, the query will be failed. (default) +* If <code class="docutils literal"><span class="pre">text.error-tolerance.max-num</span> <span class="pre">></span> <span class="pre">0</span></code>, the given number of parsing errors in each task will be pemissible.</li> </ul> -<p>The following example is to set a custom field delimiter, <tt class="docutils literal"><span class="pre">NULL</span></tt> character, and compression codec:</p> +<p>The following example is to set a custom field delimiter, <code class="docutils literal"><span class="pre">NULL</span></code> character, and compression codec:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="nb">text</span><span class="p">,</span> @@ -248,7 +248,7 @@ The <tt class="docutils literal"><span c </div> <div class="admonition warning"> <p class="first admonition-title">Warning</p> -<p class="last">Be careful when using <tt class="docutils literal"><span class="pre">\n</span></tt> as the field delimiter because <em>TEXT</em> format tables use <tt class="docutils literal"><span class="pre">\n</span></tt> as the line delimiter. +<p class="last">Be careful when using <code class="docutils literal"><span class="pre">\n</span></code> as the field delimiter because <em>TEXT</em> format tables use <code class="docutils literal"><span class="pre">\n</span></code> as the line delimiter. At the moment, Tajo does not provide a way to specify the line delimiter.</p> </div> </div> @@ -257,7 +257,7 @@ At the moment, Tajo does not provide a w <p>The <em>TEXT</em> format not only provides reading and writing interfaces for text data but also allows users to process custom plan-text file formats with user-defined (De)serializer classes. For example, with custom (de)serializers, Tajo can process JSON file formats or any specialized plan-text file formats.</p> -<p>In order to specify a custom (De)serializer, set a physical property <tt class="docutils literal"><span class="pre">text.serde</span></tt>. +<p>In order to specify a custom (De)serializer, set a physical property <code class="docutils literal"><span class="pre">text.serde</span></code>. The property value should be a fully qualified class name.</p> <p>For example:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> @@ -271,24 +271,24 @@ The property value should be a fully qua </div> <div class="section" id="null-value-handling-issues"> <h2>Null Value Handling Issues<a class="headerlink" href="#null-value-handling-issues" title="Permalink to this headline">¶</a></h2> -<p>In default, <tt class="docutils literal"><span class="pre">NULL</span></tt> character in <em>TEXT</em> format is an empty string <tt class="docutils literal"><span class="pre">''</span></tt>. -In other words, an empty field is basically recognized as a <tt class="docutils literal"><span class="pre">NULL</span></tt> value in Tajo. -If a field domain is <tt class="docutils literal"><span class="pre">TEXT</span></tt>, an empty field is recognized as a string value <tt class="docutils literal"><span class="pre">''</span></tt> instead of <tt class="docutils literal"><span class="pre">NULL</span></tt> value. -Besides, You can also use your own <tt class="docutils literal"><span class="pre">NULL</span></tt> character by specifying a physical property <tt class="docutils literal"><span class="pre">text.null</span></tt>.</p> +<p>In default, <code class="docutils literal"><span class="pre">NULL</span></code> character in <em>TEXT</em> format is an empty string <code class="docutils literal"><span class="pre">''</span></code>. +In other words, an empty field is basically recognized as a <code class="docutils literal"><span class="pre">NULL</span></code> value in Tajo. +If a field domain is <code class="docutils literal"><span class="pre">TEXT</span></code>, an empty field is recognized as a string value <code class="docutils literal"><span class="pre">''</span></code> instead of <code class="docutils literal"><span class="pre">NULL</span></code> value. +Besides, You can also use your own <code class="docutils literal"><span class="pre">NULL</span></code> character by specifying a physical property <code class="docutils literal"><span class="pre">text.null</span></code>.</p> </div> <div class="section" id="compatibility-issues-with-apache-hive"> <h2>Compatibility Issues with Apache Hiveâ¢<a class="headerlink" href="#compatibility-issues-with-apache-hive" title="Permalink to this headline">¶</a></h2> <p><em>TEXT</em> tables generated in Tajo can be processed directly by Apache Hive⢠without further processing. In this section, we explain some compatibility issue for users who use both Hive and Tajo.</p> <p>If you set a custom field delimiter, the <em>TEXT</em> tables cannot be directly used in Hive. -In order to specify the custom field delimiter in Hive, you need to use <tt class="docutils literal"><span class="pre">ROW</span> <span class="pre">FORMAT</span> <span class="pre">DELIMITED</span> <span class="pre">FIELDS</span> <span class="pre">TERMINATED</span> <span class="pre">BY</span></tt> -clause in a Hive’s <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> statement as follows:</p> +In order to specify the custom field delimiter in Hive, you need to use <code class="docutils literal"><span class="pre">ROW</span> <span class="pre">FORMAT</span> <span class="pre">DELIMITED</span> <span class="pre">FIELDS</span> <span class="pre">TERMINATED</span> <span class="pre">BY</span></code> +clause in a Hive’s <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span><span class="n">id</span> <span class="nb">int</span><span class="p">,</span> <span class="n">name</span> <span class="n">string</span><span class="p">,</span> <span class="n">score</span> <span class="nb">float</span><span class="p">,</span> <span class="k">type</span> <span class="n">string</span><span class="p">)</span> <span class="k">ROW</span> <span class="n">FORMAT</span> <span class="n">DELIMITED</span> <span class="n">FIELDS</span> <span class="n">TERMINATED</span> <span class="k">BY</span> <span class="s1">'|'</span> <span class="n">STORED</span> <span class="k">AS</span> <span class="nb">TEXT</span> </pre></div> </div> -<p>To the best of our knowledge, there is not way to specify a custom <tt class="docutils literal"><span class="pre">NULL</span></tt> character in Hive.</p> +<p>To the best of our knowledge, there is not way to specify a custom <code class="docutils literal"><span class="pre">NULL</span></code> character in Hive.</p> </div> </div> Modified: tajo/site/docs/devel/time_zone.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/time_zone.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/time_zone.html (original) +++ tajo/site/docs/devel/time_zone.html Thu May 28 12:22:19 2015 @@ -194,7 +194,7 @@ <div class="section" id="time-zone"> <h1>Time Zone<a class="headerlink" href="#time-zone" title="Permalink to this headline">¶</a></h1> -<p>Time zone affects some data types (e.g., <tt class="docutils literal"><span class="pre">Timestamp</span></tt> and <tt class="docutils literal"><span class="pre">Time</span></tt>) and operations (e.g., <tt class="docutils literal"><span class="pre">to_char</span></tt>). Tables can have different time zones. Internally, Tajo translates all table rows to UTC values and processes them. It becomes easier for Tajo to handle multiple different time zones.</p> +<p>Time zone affects some data types (e.g., <code class="docutils literal"><span class="pre">Timestamp</span></code> and <code class="docutils literal"><span class="pre">Time</span></code>) and operations (e.g., <code class="docutils literal"><span class="pre">to_char</span></code>). Tables can have different time zones. Internally, Tajo translates all table rows to UTC values and processes them. It becomes easier for Tajo to handle multiple different time zones.</p> <p>In Tajo, there are some time zong settings.</p> <div class="section" id="server-cluster-time-zone"> <h2>Server Cluster Time Zone<a class="headerlink" href="#server-cluster-time-zone" title="Permalink to this headline">¶</a></h2> @@ -208,8 +208,8 @@ </div> <div class="section" id="table-time-zone"> <h2>Table Time Zone<a class="headerlink" href="#table-time-zone" title="Permalink to this headline">¶</a></h2> -<p>In Tajo, a table property <tt class="docutils literal"><span class="pre">timezone</span></tt> allows users to specify a time zone that the table uses for reading or writing. -When each table row are read or written, <tt class="docutils literal"><span class="pre">`timestamp`</span></tt> and <tt class="docutils literal"><span class="pre">`time`</span></tt> column values are adjusted by a given time zone if it is set.</p> +<p>In Tajo, a table property <code class="docutils literal"><span class="pre">timezone</span></code> allows users to specify a time zone that the table uses for reading or writing. +When each table row are read or written, <code class="docutils literal"><span class="pre">`timestamp`</span></code> and <code class="docutils literal"><span class="pre">`time`</span></code> column values are adjusted by a given time zone if it is set.</p> <p>You can specify a table time zone as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">EXTERNAL</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">t_timestamp</span> <span class="k">TIMESTAMP</span><span class="p">,</span> @@ -221,13 +221,13 @@ When each table row are read or written, </div> <div class="section" id="client-time-zone"> <h2>Client Time Zone<a class="headerlink" href="#client-time-zone" title="Permalink to this headline">¶</a></h2> -<p>Each client has its own time zone setting. It translates retrieved timestamp and time values by time zone. In order to set client time zone, you should set the session variable <tt class="docutils literal"><span class="pre">TIMEZONE</span></tt>. There are some ways to set this session variable.</p> -<p>In <tt class="docutils literal"><span class="pre">tsql</span></tt>, you can use <tt class="docutils literal"><span class="pre">\set</span> <span class="pre">timezone</span></tt> meta command as follows:</p> +<p>Each client has its own time zone setting. It translates retrieved timestamp and time values by time zone. In order to set client time zone, you should set the session variable <code class="docutils literal"><span class="pre">TIMEZONE</span></code>. There are some ways to set this session variable.</p> +<p>In <code class="docutils literal"><span class="pre">tsql</span></code>, you can use <code class="docutils literal"><span class="pre">\set</span> <span class="pre">timezone</span></code> meta command as follows:</p> <p><strong>tsql</strong></p> <div class="highlight-sh"><div class="highlight"><pre>default> <span class="se">\s</span>et timezone GMT+9 </pre></div> </div> -<p>The following ways use SQL statements. So, this way is available in <tt class="docutils literal"><span class="pre">tsql</span></tt>, JDBC, and Tajo Java API.</p> +<p>The following ways use SQL statements. So, this way is available in <code class="docutils literal"><span class="pre">tsql</span></code>, JDBC, and Tajo Java API.</p> <p><strong>SQL</strong></p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">SET</span> <span class="n">TIME</span> <span class="k">ZONE</span> <span class="s1">'GMT+9'</span><span class="p">;</span> @@ -251,20 +251,20 @@ When each table row are read or written, </div> <div class="section" id="examples-of-time-zone"> <h2>Examples of Time Zone<a class="headerlink" href="#examples-of-time-zone" title="Permalink to this headline">¶</a></h2> -<p>For example, consider that there is a list of delimited text lines where each rows are written with <tt class="docutils literal"><span class="pre">Asia/Seoul</span></tt> time zone (i.e., GMT + 9).</p> +<p>For example, consider that there is a list of delimited text lines where each rows are written with <code class="docutils literal"><span class="pre">Asia/Seoul</span></code> time zone (i.e., GMT + 9).</p> <div class="highlight-text"><div class="highlight"><pre>1980-4-1 01:50:30.010|1980-04-01 80/4/1 1:50:30 AM|80/4/1 1980 April 1 1:50:30|1980-04-01 </pre></div> </div> -<p>In order to register the table, we should put a table property <tt class="docutils literal"><span class="pre">'timezone'='Asia/Seoul'</span></tt> in <tt class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></tt> statement as follows:</p> +<p>In order to register the table, we should put a table property <code class="docutils literal"><span class="pre">'timezone'='Asia/Seoul'</span></code> in <code class="docutils literal"><span class="pre">CREATE</span> <span class="pre">TABLE</span></code> statement as follows:</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">CREATE</span> <span class="k">EXTERNAL</span> <span class="k">TABLE</span> <span class="n">table1</span> <span class="p">(</span> <span class="n">t_timestamp</span> <span class="k">TIMESTAMP</span><span class="p">,</span> <span class="n">t_date</span> <span class="nb">DATE</span> <span class="p">)</span> <span class="k">USING</span> <span class="nb">TEXT</span> <span class="k">WITH</span><span class="p">(</span><span class="s1">'text.delimiter'</span><span class="o">=</span><span class="s1">'|'</span><span class="p">,</span> <span class="s1">'timezone'</span><span class="o">=</span><span class="s1">'ASIA/Seoul'</span><span class="p">)</span> <span class="k">LOCATION</span> <span class="s1">'/path-to-table/'</span> </pre></div> </div> -<p>By default, <tt class="docutils literal"><span class="pre">tsql</span></tt> and <tt class="docutils literal"><span class="pre">TajoClient</span></tt> API use UTC time zone. So, timestamp values in the result are adjusted by the time zone offset. But, date is not adjusted because date type does not consider time zone.</p> +<p>By default, <code class="docutils literal"><span class="pre">tsql</span></code> and <code class="docutils literal"><span class="pre">TajoClient</span></code> API use UTC time zone. So, timestamp values in the result are adjusted by the time zone offset. But, date is not adjusted because date type does not consider time zone.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">default</span><span class="o">></span> <span class="k">SELECT</span> <span class="o">*</span> <span class="k">FROM</span> <span class="n">table1</span> <span class="n">t_timestamp</span><span class="p">,</span> <span class="n">t_date</span> <span class="c1">----------------------------------</span> Modified: tajo/site/docs/devel/tsql/admin_command.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/tsql/admin_command.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/tsql/admin_command.html (original) +++ tajo/site/docs/devel/tsql/admin_command.html Thu May 28 12:22:19 2015 @@ -213,14 +213,14 @@ usage: admin [options] </div> <div class="section" id="basic-usages"> <h3>Basic usages<a class="headerlink" href="#basic-usages" title="Permalink to this headline">¶</a></h3> -<p><tt class="docutils literal"><span class="pre">-list</span></tt> option shows a list of all running queries as follows:</p> +<p><code class="docutils literal"><span class="pre">-list</span></code> option shows a list of all running queries as follows:</p> <div class="highlight-python"><div class="highlight"><pre>default> \admin -list QueryId State StartTime Query -------------------- ------------------- ------------------- ----------------------------- q_1411357607375_0006 QUERY_RUNNING 2014-09-23 07:19:40 select count(*) from lineitem </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">-desc</span></tt> option shows a detailed description of a specified running query as follows:</p> +<p><code class="docutils literal"><span class="pre">-desc</span></code> option shows a detailed description of a specified running query as follows:</p> <div class="highlight-python"><div class="highlight"><pre>default> \admin -desc q_1411357607375_0006 Id: 1 Query Id: q_1411357607375_0006 @@ -232,12 +232,12 @@ Query Statement: select count(*) from lineitem </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">-kill</span></tt> option kills a specified running query as follows:</p> +<p><code class="docutils literal"><span class="pre">-kill</span></code> option kills a specified running query as follows:</p> <div class="highlight-python"><div class="highlight"><pre>default> \admin -kill q_1411357607375_0007 q_1411357607375_0007 is killed successfully. </pre></div> </div> -<p><tt class="docutils literal"><span class="pre">-showmasters</span></tt> option shows a list of all tajo masters as follows:</p> +<p><code class="docutils literal"><span class="pre">-showmasters</span></code> option shows a list of all tajo masters as follows:</p> <div class="highlight-python"><div class="highlight"><pre>default> \admin -showmasters grtajo01 </pre></div> Modified: tajo/site/docs/devel/tsql/dfs_command.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/tsql/dfs_command.html?rev=1682226&r1=1682225&r2=1682226&view=diff ============================================================================== --- tajo/site/docs/devel/tsql/dfs_command.html (original) +++ tajo/site/docs/devel/tsql/dfs_command.html Thu May 28 12:22:19 2015 @@ -197,7 +197,7 @@ <div class="section" id="executing-hdfs-commands"> <h1>Executing HDFS commands<a class="headerlink" href="#executing-hdfs-commands" title="Permalink to this headline">¶</a></h1> -<p>You can run the hadoop dfs command (FsShell) within tsql. <tt class="docutils literal"><span class="pre">\dfs</span></tt> command provides a shortcut to the hadoop dfs commands. If you want to use this command, just specify FsShell arguments and add the semicolon at the end as follows:</p> +<p>You can run the hadoop dfs command (FsShell) within tsql. <code class="docutils literal"><span class="pre">\dfs</span></code> command provides a shortcut to the hadoop dfs commands. If you want to use this command, just specify FsShell arguments and add the semicolon at the end as follows:</p> <div class="highlight-sql"><div class="highlight"><pre>default> \dfs -ls / Found 3 items drwxr-xr-x - tajo supergroup 0 2014-08-14 04:04 /tajo
