Modified: tajo/site/docs/devel/configuration/tajo-site-xml.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/tajo-site-xml.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/tajo-site-xml.html (original) +++ tajo/site/docs/devel/configuration/tajo-site-xml.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1 current"><a class="reference internal" href="../configuration.html">Configuration</a><ul class="current"> @@ -180,7 +180,7 @@ <div class="section" id="the-tajo-site-xml-file"> <h1>The tajo-site.xml File<a class="headerlink" href="#the-tajo-site-xml-file" title="Permalink to this headline">¶</a></h1> -<p>To the <tt class="docutils literal"><span class="pre">core-site.xml</span></tt> file on every host in your cluster, you must add the following information:</p> +<p>To the <code class="docutils literal"><span class="pre">core-site.xml</span></code> file on every host in your cluster, you must add the following information:</p> <div class="section" id="system-config"> <h2>System Config<a class="headerlink" href="#system-config" title="Permalink to this headline">¶</a></h2> </div>
Modified: tajo/site/docs/devel/configuration/tajo_master_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/tajo_master_configuration.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/tajo_master_configuration.html (original) +++ tajo/site/docs/devel/configuration/tajo_master_configuration.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1 current"><a class="reference internal" href="../configuration.html">Configuration</a><ul class="current"> @@ -189,12 +189,12 @@ <span class="nt"></property></span> </pre></div> </div> -<p>Tajo rootdir must be a url form like <tt class="docutils literal"><span class="pre">scheme://hostname:port/path</span></tt>. The current implementaion only supports <tt class="docutils literal"><span class="pre">hdfs://</span></tt> and <tt class="docutils literal"><span class="pre">file://</span></tt> schemes. The default value is <tt class="docutils literal"><span class="pre">file:///tmp/tajo-${user.name}/</span></tt>.</p> +<p>Tajo rootdir must be a url form like <code class="docutils literal"><span class="pre">scheme://hostname:port/path</span></code>. The current implementaion only supports <code class="docutils literal"><span class="pre">hdfs://</span></code> and <code class="docutils literal"><span class="pre">file://</span></code> schemes. The default value is <code class="docutils literal"><span class="pre">file:///tmp/tajo-${user.name}/</span></code>.</p> </div> <div class="section" id="tajomaster-heap-memory-size"> <h2>TajoMaster Heap Memory Size<a class="headerlink" href="#tajomaster-heap-memory-size" title="Permalink to this headline">¶</a></h2> <p>The environment variable TAJO_MASTER_HEAPSIZE in conf/tajo-env.sh allow Tajo Master to use the specified heap memory size.</p> -<p>If you want to adjust heap memory size, set <tt class="docutils literal"><span class="pre">TAJO_MASTER_HEAPSIZE</span></tt> variable in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> with a proper size as follows:</p> +<p>If you want to adjust heap memory size, set <code class="docutils literal"><span class="pre">TAJO_MASTER_HEAPSIZE</span></code> variable in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> with a proper size as follows:</p> <div class="highlight-sh"><div class="highlight"><pre><span class="nv">TAJO_MASTER_HEAPSIZE</span><span class="o">=</span>2000 </pre></div> </div> Modified: tajo/site/docs/devel/configuration/worker_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/worker_configuration.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/worker_configuration.html (original) +++ tajo/site/docs/devel/configuration/worker_configuration.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1 current"><a class="reference internal" href="../configuration.html">Configuration</a><ul class="current"> @@ -182,8 +182,8 @@ <h1>Worker Configuration<a class="headerlink" href="#worker-configuration" title="Permalink to this headline">¶</a></h1> <div class="section" id="worker-heap-memory-size"> <h2>Worker Heap Memory Size<a class="headerlink" href="#worker-heap-memory-size" title="Permalink to this headline">¶</a></h2> -<p>The environment variable <tt class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></tt> in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> allow Tajo Worker to use the specified heap memory size.</p> -<p>If you want to adjust heap memory size, set <tt class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></tt> variable in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> with a proper size as follows:</p> +<p>The environment variable <code class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></code> in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> allow Tajo Worker to use the specified heap memory size.</p> +<p>If you want to adjust heap memory size, set <code class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></code> variable in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> with a proper size as follows:</p> <div class="highlight-bash"><div class="highlight"><pre><span class="nv">TAJO_WORKER_HEAPSIZE</span><span class="o">=</span>8000 </pre></div> </div> @@ -192,7 +192,7 @@ <div class="section" id="temporary-data-directory"> <h2>Temporary Data Directory<a class="headerlink" href="#temporary-data-directory" title="Permalink to this headline">¶</a></h2> <p>TajoWorker stores temporary data on local file system due to out-of-core algorithms. It is possible to specify one or more temporary data directories where temporary data will be stored.</p> -<p><tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt></p> +<p><code class="docutils literal"><span class="pre">tajo-site.xml</span></code></p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.worker.tmpdir.locations<span class="nt"></name></span> <span class="nt"><value></span>/disk1/tmpdir,/disk2/tmpdir,/disk3/tmpdir<span class="nt"></value></span> @@ -208,7 +208,7 @@ <h2>Worker Resources<a class="headerlink" href="#worker-resources" title="Permalink to this headline">¶</a></h2> <p>Each worker can execute multiple tasks simultaneously. In Tajo, users can specify the total size of memory and the number of disks for each worker. Available resources affect how many tasks are executed simultaneously.</p> -<p>In order to specify the resource capacity of each worker, you should add the following configs to <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt> :</p> +<p>In order to specify the resource capacity of each worker, you should add the following configs to <code class="docutils literal"><span class="pre">tajo-site.xml</span></code> :</p> <table border="1" class="docutils"> <colgroup> <col width="32%" /> @@ -247,13 +247,13 @@ In Tajo, users can specify the total siz </div> <div class="admonition note"> <p class="first admonition-title">Note</p> -<p class="last">If <tt class="docutils literal"><span class="pre">tajo.worker.resource.dfs-dir-aware</span></tt> is set to <tt class="docutils literal"><span class="pre">true</span></tt> in <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt>, the worker will aware of and use the number of HDFS datanode’s data dirs in the node. -In other words, <tt class="docutils literal"><span class="pre">tajo.worker.resource.disks</span></tt> is ignored.</p> +<p class="last">If <code class="docutils literal"><span class="pre">tajo.worker.resource.dfs-dir-aware</span></code> is set to <code class="docutils literal"><span class="pre">true</span></code> in <code class="docutils literal"><span class="pre">tajo-site.xml</span></code>, the worker will aware of and use the number of HDFS datanode’s data dirs in the node. +In other words, <code class="docutils literal"><span class="pre">tajo.worker.resource.disks</span></code> is ignored.</p> </div> <div class="section" id="example"> <h3>Example<a class="headerlink" href="#example" title="Permalink to this headline">¶</a></h3> <p>Assume that you want to give 5120 MB memory, 4 disks, and 24 cores on each worker. The example configuration is as follows:</p> -<p><tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt></p> +<p><code class="docutils literal"><span class="pre">tajo-site.xml</span></code></p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.worker.resource.tajo.worker.resource.cpu-cores<span class="nt"></name></span> <span class="nt"><value></span>24<span class="nt"></value></span> @@ -273,7 +273,7 @@ In other words, <tt class="docutils lite </div> <div class="section" id="dedicated-mode"> <h3>Dedicated Mode<a class="headerlink" href="#dedicated-mode" title="Permalink to this headline">¶</a></h3> -<p>Tajo provides a dedicated mode that allows each worker in a Tajo cluster to use whole available system resources including cpu-cores, memory, and disks. For this mode, a user should add the following config to <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt> :</p> +<p>Tajo provides a dedicated mode that allows each worker in a Tajo cluster to use whole available system resources including cpu-cores, memory, and disks. For this mode, a user should add the following config to <code class="docutils literal"><span class="pre">tajo-site.xml</span></code> :</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.worker.resource.dedicated<span class="nt"></name></span> <span class="nt"><value></span>true<span class="nt"></value></span> Modified: tajo/site/docs/devel/faq.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/faq.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/faq.html (original) +++ tajo/site/docs/devel/faq.html Mon Jan 5 08:43:18 2015 @@ -59,11 +59,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> Modified: tajo/site/docs/devel/functions.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/functions.html (original) +++ tajo/site/docs/devel/functions.html Mon Jan 5 08:43:18 2015 @@ -60,11 +60,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> Modified: tajo/site/docs/devel/functions/datetime_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/datetime_func_and_operators.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/functions/datetime_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/datetime_func_and_operators.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="../configuration.html">Configuration</a><ul> @@ -187,7 +187,7 @@ </div></blockquote> <dl class="function"> <dt id="add_days"> -<tt class="descname">add_days</tt><big>(</big><em>date date|timestamp</em>, <em>day int</em><big>)</big><a class="headerlink" href="#add_days" title="Permalink to this definition">¶</a></dt> +<code class="descname">add_days</code><span class="sig-paren">(</span><em>date date|timestamp</em>, <em>day int</em><span class="sig-paren">)</span><a class="headerlink" href="#add_days" title="Permalink to this definition">¶</a></dt> <dd><p>Returns date value which is added with given day parameter.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -217,7 +217,7 @@ <dl class="function"> <dt id="add_months"> -<tt class="descname">add_months</tt><big>(</big><em>date date|timestamp</em>, <em>month int</em><big>)</big><a class="headerlink" href="#add_months" title="Permalink to this definition">¶</a></dt> +<code class="descname">add_months</code><span class="sig-paren">(</span><em>date date|timestamp</em>, <em>month int</em><span class="sig-paren">)</span><a class="headerlink" href="#add_months" title="Permalink to this definition">¶</a></dt> <dd><p>Returns date value which is added with given month parameter.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -244,7 +244,7 @@ <dl class="function"> <dt id="current_date"> -<tt class="descname">current_date</tt><big>(</big><big>)</big><a class="headerlink" href="#current_date" title="Permalink to this definition">¶</a></dt> +<code class="descname">current_date</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#current_date" title="Permalink to this definition">¶</a></dt> <dd><p>Returns current date</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -262,7 +262,7 @@ <dl class="function"> <dt id="current_time"> -<tt class="descname">current_time</tt><big>(</big><big>)</big><a class="headerlink" href="#current_time" title="Permalink to this definition">¶</a></dt> +<code class="descname">current_time</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#current_time" title="Permalink to this definition">¶</a></dt> <dd><p>Returns current time</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -280,7 +280,7 @@ <dl class="function"> <dt id="extract"> -<tt class="descname">extract</tt><big>(</big><em>field FROM source</em><big>)</big><a class="headerlink" href="#extract" title="Permalink to this definition">¶</a></dt> +<code class="descname">extract</code><span class="sig-paren">(</span><em>field FROM source</em><span class="sig-paren">)</span><a class="headerlink" href="#extract" title="Permalink to this definition">¶</a></dt> <dd><p>The extract function retrieves subfields such as year or hour from date/time values. <em>source</em> must be a value expression of type <em>timestamp</em>, or <em>time</em>. (Expressions of type <em>date</em> are cast to <em>timestamp</em> and can therefore be used as well.) <em>field</em> is an identifier that selects what field to extract from the source value. The extract function returns values of type double precision. The following are valid field names:</p> <p><strong>century</strong></p> <p>The century</p> @@ -396,7 +396,7 @@ <dl class="function"> <dt id="date_part"> -<tt class="descname">date_part</tt><big>(</big><em>'field'</em>, <em>source</em><big>)</big><a class="headerlink" href="#date_part" title="Permalink to this definition">¶</a></dt> +<code class="descname">date_part</code><span class="sig-paren">(</span><em>'field'</em>, <em>source</em><span class="sig-paren">)</span><a class="headerlink" href="#date_part" title="Permalink to this definition">¶</a></dt> <dd><p>Note that here the field parameter needs to be a string value, not a name. The valid field names for date_part are the same as for extract.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">select</span> <span class="n">date_part</span><span class="p">(</span><span class="s1">'day'</span><span class="p">,</span> <span class="k">timestamp</span> <span class="s1">'2001-02-16 20:38:40'</span><span class="p">);</span> <span class="o">></span> <span class="mi">16</span><span class="p">.</span><span class="mi">0</span> @@ -406,7 +406,7 @@ <dl class="function"> <dt id="now"> -<tt class="descname">now</tt><big>(</big><big>)</big><a class="headerlink" href="#now" title="Permalink to this definition">¶</a></dt> +<code class="descname">now</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#now" title="Permalink to this definition">¶</a></dt> <dd><p>Returns current timestamp</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -426,7 +426,7 @@ <dl class="function"> <dt id="to_char"> -<tt class="descname">to_char</tt><big>(</big><em>src timestamp</em>, <em>format text</em><big>)</big><a class="headerlink" href="#to_char" title="Permalink to this definition">¶</a></dt> +<code class="descname">to_char</code><span class="sig-paren">(</span><em>src timestamp</em>, <em>format text</em><span class="sig-paren">)</span><a class="headerlink" href="#to_char" title="Permalink to this definition">¶</a></dt> <dd><p>Converts timestamp to text. For more detailed, see ‘Date/Time Formatting and Conversion’ section below.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -451,7 +451,7 @@ <dl class="function"> <dt id="to_date"> -<tt class="descname">to_date</tt><big>(</big><em>src text</em>, <em>format text</em><big>)</big><a class="headerlink" href="#to_date" title="Permalink to this definition">¶</a></dt> +<code class="descname">to_date</code><span class="sig-paren">(</span><em>src text</em>, <em>format text</em><span class="sig-paren">)</span><a class="headerlink" href="#to_date" title="Permalink to this definition">¶</a></dt> <dd><p>Converts text to date. For more detailed, see ‘Date/Time Formatting and Conversion’ section below.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -476,7 +476,7 @@ <dl class="function"> <dt id="to_timestamp"> -<tt class="descname">to_timestamp</tt><big>(</big><em>epoch int</em><big>)</big><a class="headerlink" href="#to_timestamp" title="Permalink to this definition">¶</a></dt> +<code class="descname">to_timestamp</code><span class="sig-paren">(</span><em>epoch int</em><span class="sig-paren">)</span><a class="headerlink" href="#to_timestamp" title="Permalink to this definition">¶</a></dt> <dd><p>Converts int(UNIX epoch) to timestamp.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -496,7 +496,7 @@ <dl class="function"> <dt> -<tt class="descname">to_timestamp</tt><big>(</big><em>src text</em>, <em>format text</em><big>)</big></dt> +<code class="descname">to_timestamp</code><span class="sig-paren">(</span><em>src text</em>, <em>format text</em><span class="sig-paren">)</span></dt> <dd><p>Converts text timestamp. For more detailed, see ‘Date/Time Formatting and Conversion’ section below.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -521,7 +521,7 @@ <dl class="function"> <dt id="utc_usec_to"> -<tt class="descname">utc_usec_to</tt><big>(</big><em>string text</em>, <em>long timestamp</em>, <em>int dayOfWeek</em><big>)</big><a class="headerlink" href="#utc_usec_to" title="Permalink to this definition">¶</a></dt> +<code class="descname">utc_usec_to</code><span class="sig-paren">(</span><em>string text</em>, <em>long timestamp</em>, <em>int dayOfWeek</em><span class="sig-paren">)</span><a class="headerlink" href="#utc_usec_to" title="Permalink to this definition">¶</a></dt> <dd><ul> <li><p class="first">If the <strong>first parameter</strong> is ‘day’.</p> <p>Shifts and return a UNIX timestamp in microseconds to the beginning of the day it occurs in. Modified: tajo/site/docs/devel/functions/math_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/math_func_and_operators.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/functions/math_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/math_func_and_operators.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="../configuration.html">Configuration</a><ul> @@ -182,7 +182,7 @@ <h1>Math Functions and Operators<a class="headerlink" href="#math-functions-and-operators" title="Permalink to this headline">¶</a></h1> <dl class="function"> <dt id="abs"> -<tt class="descname">abs</tt><big>(</big><em>number int|float</em><big>)</big><a class="headerlink" href="#abs" title="Permalink to this definition">¶</a></dt> +<code class="descname">abs</code><span class="sig-paren">(</span><em>number int|float</em><span class="sig-paren">)</span><a class="headerlink" href="#abs" title="Permalink to this definition">¶</a></dt> <dd><p>Returns absolute value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -204,7 +204,7 @@ <dl class="function"> <dt id="acos"> -<tt class="descname">acos</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#acos" title="Permalink to this definition">¶</a></dt> +<code class="descname">acos</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#acos" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the arc cosine of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -226,7 +226,7 @@ <dl class="function"> <dt id="asin"> -<tt class="descname">asin</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#asin" title="Permalink to this definition">¶</a></dt> +<code class="descname">asin</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#asin" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the arc sine of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -248,7 +248,7 @@ <dl class="function"> <dt id="atan"> -<tt class="descname">atan</tt><big>(</big><em>number float8</em><big>)</big><a class="headerlink" href="#atan" title="Permalink to this definition">¶</a></dt> +<code class="descname">atan</code><span class="sig-paren">(</span><em>number float8</em><span class="sig-paren">)</span><a class="headerlink" href="#atan" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the arc tangent of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -270,7 +270,7 @@ <dl class="function"> <dt id="atan2"> -<tt class="descname">atan2</tt><big>(</big><em>y float</em>, <em>x float</em><big>)</big><a class="headerlink" href="#atan2" title="Permalink to this definition">¶</a></dt> +<code class="descname">atan2</code><span class="sig-paren">(</span><em>y float</em>, <em>x float</em><span class="sig-paren">)</span><a class="headerlink" href="#atan2" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the angle theta from the conversion of rectangular coordinates (x, y) to polar coordinates (r, theta)</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -297,7 +297,7 @@ <dl class="function"> <dt id="cbrt"> -<tt class="descname">cbrt</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#cbrt" title="Permalink to this definition">¶</a></dt> +<code class="descname">cbrt</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#cbrt" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the cube root of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -319,7 +319,7 @@ <dl class="function"> <dt id="ceil"> -<tt class="descname">ceil</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#ceil" title="Permalink to this definition">¶</a></dt> +<code class="descname">ceil</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#ceil" title="Permalink to this definition">¶</a></dt> <dd><p>Returns a smallest integer not less than argument</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -341,7 +341,7 @@ <dl class="function"> <dt id="cos"> -<tt class="descname">cos</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#cos" title="Permalink to this definition">¶</a></dt> +<code class="descname">cos</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#cos" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the cosine of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -363,7 +363,7 @@ <dl class="function"> <dt id="degrees"> -<tt class="descname">degrees</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#degrees" title="Permalink to this definition">¶</a></dt> +<code class="descname">degrees</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#degrees" title="Permalink to this definition">¶</a></dt> <dd><p>Converts radians to degrees</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -385,7 +385,7 @@ <dl class="function"> <dt id="div"> -<tt class="descname">div</tt><big>(</big><em>num1 int</em>, <em>num2 int</em><big>)</big><a class="headerlink" href="#div" title="Permalink to this definition">¶</a></dt> +<code class="descname">div</code><span class="sig-paren">(</span><em>num1 int</em>, <em>num2 int</em><span class="sig-paren">)</span><a class="headerlink" href="#div" title="Permalink to this definition">¶</a></dt> <dd><p>Integer division truncates resut</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -412,7 +412,7 @@ <dl class="function"> <dt id="exp"> -<tt class="descname">exp</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#exp" title="Permalink to this definition">¶</a></dt> +<code class="descname">exp</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#exp" title="Permalink to this definition">¶</a></dt> <dd><p>Returns Euler’s number e raised to the power of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -434,7 +434,7 @@ <dl class="function"> <dt id="floor"> -<tt class="descname">floor</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#floor" title="Permalink to this definition">¶</a></dt> +<code class="descname">floor</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#floor" title="Permalink to this definition">¶</a></dt> <dd><p>Returns a largest integer not greater than argument</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -456,7 +456,7 @@ <dl class="function"> <dt id="mod"> -<tt class="descname">mod</tt><big>(</big><em>num1 int</em>, <em>num2 int</em><big>)</big><a class="headerlink" href="#mod" title="Permalink to this definition">¶</a></dt> +<code class="descname">mod</code><span class="sig-paren">(</span><em>num1 int</em>, <em>num2 int</em><span class="sig-paren">)</span><a class="headerlink" href="#mod" title="Permalink to this definition">¶</a></dt> <dd><p>Returns remainder of num1 / num2</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -483,7 +483,7 @@ <dl class="function"> <dt id="pi"> -<tt class="descname">pi</tt><big>(</big><big>)</big><a class="headerlink" href="#pi" title="Permalink to this definition">¶</a></dt> +<code class="descname">pi</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#pi" title="Permalink to this definition">¶</a></dt> <dd><p>Returns constant value of pi</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -503,7 +503,7 @@ <dl class="function"> <dt id="pow"> -<tt class="descname">pow</tt><big>(</big><em>x float</em>, <em>y float</em><big>)</big><a class="headerlink" href="#pow" title="Permalink to this definition">¶</a></dt> +<code class="descname">pow</code><span class="sig-paren">(</span><em>x float</em>, <em>y float</em><span class="sig-paren">)</span><a class="headerlink" href="#pow" title="Permalink to this definition">¶</a></dt> <dd><p>Returns value of x raised to the power of y</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -530,7 +530,7 @@ <dl class="function"> <dt id="radians"> -<tt class="descname">radians</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#radians" title="Permalink to this definition">¶</a></dt> +<code class="descname">radians</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#radians" title="Permalink to this definition">¶</a></dt> <dd><p>Converts degrees to radians</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -552,7 +552,7 @@ <dl class="function"> <dt id="round"> -<tt class="descname">round</tt><big>(</big><em>number int|float</em><big>)</big><a class="headerlink" href="#round" title="Permalink to this definition">¶</a></dt> +<code class="descname">round</code><span class="sig-paren">(</span><em>number int|float</em><span class="sig-paren">)</span><a class="headerlink" href="#round" title="Permalink to this definition">¶</a></dt> <dd><p>Rounds to nearest integer</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -574,7 +574,7 @@ <dl class="function"> <dt id="sign"> -<tt class="descname">sign</tt><big>(</big><em>number int|float</em><big>)</big><a class="headerlink" href="#sign" title="Permalink to this definition">¶</a></dt> +<code class="descname">sign</code><span class="sig-paren">(</span><em>number int|float</em><span class="sig-paren">)</span><a class="headerlink" href="#sign" title="Permalink to this definition">¶</a></dt> <dd><p>Returns sign of argument as -1, 0, 1</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -596,7 +596,7 @@ <dl class="function"> <dt id="sin"> -<tt class="descname">sin</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#sin" title="Permalink to this definition">¶</a></dt> +<code class="descname">sin</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#sin" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the sine of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -618,7 +618,7 @@ <dl class="function"> <dt id="sqrt"> -<tt class="descname">sqrt</tt><big>(</big><em>number float8</em><big>)</big><a class="headerlink" href="#sqrt" title="Permalink to this definition">¶</a></dt> +<code class="descname">sqrt</code><span class="sig-paren">(</span><em>number float8</em><span class="sig-paren">)</span><a class="headerlink" href="#sqrt" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the square root of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -640,7 +640,7 @@ <dl class="function"> <dt id="tan"> -<tt class="descname">tan</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#tan" title="Permalink to this definition">¶</a></dt> +<code class="descname">tan</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#tan" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the tangent of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> Modified: tajo/site/docs/devel/functions/network_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/network_func_and_operators.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/functions/network_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/network_func_and_operators.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="../configuration.html">Configuration</a><ul> @@ -186,7 +186,7 @@ To use these functions and operations, the GeoIP database should be precedently installed in local disks of all the workers. (Please refer the install instruction in <a class="reference external" href="http://dev.maxmind.com/geoip/legacy/downloadable/";>http://dev.maxmind.com/geoip/legacy/downloadable/</a>)</p> -<p>Once the GeoIP database is installed, you should specify the install location in <tt class="docutils literal"><span class="pre">conf/tajo-site.xml</span></tt> +<p>Once the GeoIP database is installed, you should specify the install location in <code class="docutils literal"><span class="pre">conf/tajo-site.xml</span></code> as follows.</p> <div class="highlight-python"><div class="highlight"><pre><property> <name>tajo.function.geoip-database-location</name> @@ -199,7 +199,7 @@ as follows.</p> <h2>Supported Functions<a class="headerlink" href="#supported-functions" title="Permalink to this headline">¶</a></h2> <dl class="function"> <dt id="geoip_country_code"> -<tt class="descname">geoip_country_code</tt><big>(</big><em>string addr</em><big>)</big><a class="headerlink" href="#geoip_country_code" title="Permalink to this definition">¶</a></dt> +<code class="descname">geoip_country_code</code><span class="sig-paren">(</span><em>string addr</em><span class="sig-paren">)</span><a class="headerlink" href="#geoip_country_code" title="Permalink to this definition">¶</a></dt> <dd><p>Convert an ipv4 address string to a geoip country code.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -221,7 +221,7 @@ as follows.</p> <dl class="function"> <dt> -<tt class="descname">geoip_country_code</tt><big>(</big><em>inet4 addr</em><big>)</big></dt> +<code class="descname">geoip_country_code</code><span class="sig-paren">(</span><em>inet4 addr</em><span class="sig-paren">)</span></dt> <dd><p>Convert an ipv4 address to a geoip country code.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -243,7 +243,7 @@ as follows.</p> <dl class="function"> <dt id="geoip_in_country"> -<tt class="descname">geoip_in_country</tt><big>(</big><em>string addr</em>, <em>string code</em><big>)</big><a class="headerlink" href="#geoip_in_country" title="Permalink to this definition">¶</a></dt> +<code class="descname">geoip_in_country</code><span class="sig-paren">(</span><em>string addr</em>, <em>string code</em><span class="sig-paren">)</span><a class="headerlink" href="#geoip_in_country" title="Permalink to this definition">¶</a></dt> <dd><p>If the given country code is same with the country code of the given address, it returns true. Otherwise, returns false.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -270,7 +270,7 @@ as follows.</p> <dl class="function"> <dt> -<tt class="descname">geoip_in_country</tt><big>(</big><em>inet4 addr</em>, <em>string code</em><big>)</big></dt> +<code class="descname">geoip_in_country</code><span class="sig-paren">(</span><em>inet4 addr</em>, <em>string code</em><span class="sig-paren">)</span></dt> <dd><p>If the given country code is same with the country code of the given address, it returns true. Otherwise, returns false.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> Modified: tajo/site/docs/devel/functions/string_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/string_func_and_operators.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/functions/string_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/string_func_and_operators.html Mon Jan 5 08:43:18 2015 @@ -61,11 +61,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="../introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="../getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="../getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="../getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="../configuration.html">Configuration</a><ul> @@ -182,8 +182,8 @@ <h1>String Functions and Operators<a class="headerlink" href="#string-functions-and-operators" title="Permalink to this headline">¶</a></h1> <dl class="function"> <dt> -<tt class="descname">str1 || str2</tt></dt> -<dd><p>Returns the concatnenated string of both side strings <tt class="docutils literal"><span class="pre">str1</span></tt> and <tt class="docutils literal"><span class="pre">str2</span></tt>.</p> +<code class="descname">str1 || str2</code></dt> +<dd><p>Returns the concatnenated string of both side strings <code class="docutils literal"><span class="pre">str1</span></code> and <code class="docutils literal"><span class="pre">str2</span></code>.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> <col class="field-body" /> @@ -209,7 +209,7 @@ <dl class="function"> <dt id="char_length"> -<tt class="descname">char_length</tt><big>(</big><em>string text</em><big>)</big><a class="headerlink" href="#char_length" title="Permalink to this definition">¶</a></dt> +<code class="descname">char_length</code><span class="sig-paren">(</span><em>string text</em><span class="sig-paren">)</span><a class="headerlink" href="#char_length" title="Permalink to this definition">¶</a></dt> <dd><p>Returns Number of characters in string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -233,7 +233,7 @@ <dl class="function"> <dt id="trim"> -<tt class="descname">trim</tt><big>(</big><em>[leading | trailing | both] [characters] from string</em><big>)</big><a class="headerlink" href="#trim" title="Permalink to this definition">¶</a></dt> +<code class="descname">trim</code><span class="sig-paren">(</span><em>[leading | trailing | both] [characters] from string</em><span class="sig-paren">)</span><a class="headerlink" href="#trim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the start/end/both ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -260,7 +260,7 @@ <dl class="function"> <dt id="btrim"> -<tt class="descname">btrim</tt><big>(</big><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><big>)</big><a class="headerlink" href="#btrim" title="Permalink to this definition">¶</a></dt> +<code class="descname">btrim</code><span class="sig-paren">(</span><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><span class="sig-paren">)</span><a class="headerlink" href="#btrim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the both ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -290,7 +290,7 @@ <dl class="function"> <dt id="ltrim"> -<tt class="descname">ltrim</tt><big>(</big><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><big>)</big><a class="headerlink" href="#ltrim" title="Permalink to this definition">¶</a></dt> +<code class="descname">ltrim</code><span class="sig-paren">(</span><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><span class="sig-paren">)</span><a class="headerlink" href="#ltrim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the start ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -317,7 +317,7 @@ <dl class="function"> <dt id="rtrim"> -<tt class="descname">rtrim</tt><big>(</big><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><big>)</big><a class="headerlink" href="#rtrim" title="Permalink to this definition">¶</a></dt> +<code class="descname">rtrim</code><span class="sig-paren">(</span><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><span class="sig-paren">)</span><a class="headerlink" href="#rtrim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the end ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -344,7 +344,7 @@ <dl class="function"> <dt id="split_part"> -<tt class="descname">split_part</tt><big>(</big><em>string text</em>, <em>delimiter text</em>, <em>field int</em><big>)</big><a class="headerlink" href="#split_part" title="Permalink to this definition">¶</a></dt> +<code class="descname">split_part</code><span class="sig-paren">(</span><em>string text</em>, <em>delimiter text</em>, <em>field int</em><span class="sig-paren">)</span><a class="headerlink" href="#split_part" title="Permalink to this definition">¶</a></dt> <dd><p>Splits a string on delimiter and return the given field (counting from one)</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -372,7 +372,7 @@ <dl class="function"> <dt id="regexp_replace"> -<tt class="descname">regexp_replace</tt><big>(</big><em>string text</em>, <em>pattern text</em>, <em>replacement text</em><big>)</big><a class="headerlink" href="#regexp_replace" title="Permalink to this definition">¶</a></dt> +<code class="descname">regexp_replace</code><span class="sig-paren">(</span><em>string text</em>, <em>pattern text</em>, <em>replacement text</em><span class="sig-paren">)</span><a class="headerlink" href="#regexp_replace" title="Permalink to this definition">¶</a></dt> <dd><p>Replaces substrings matched to a given regular expression pattern</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -400,7 +400,7 @@ <dl class="function"> <dt id="upper"> -<tt class="descname">upper</tt><big>(</big><em>string text</em><big>)</big><a class="headerlink" href="#upper" title="Permalink to this definition">¶</a></dt> +<code class="descname">upper</code><span class="sig-paren">(</span><em>string text</em><span class="sig-paren">)</span><a class="headerlink" href="#upper" title="Permalink to this definition">¶</a></dt> <dd><p>makes an input text to be upper case</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -422,7 +422,7 @@ <dl class="function"> <dt id="lower"> -<tt class="descname">lower</tt><big>(</big><em>string text</em><big>)</big><a class="headerlink" href="#lower" title="Permalink to this definition">¶</a></dt> +<code class="descname">lower</code><span class="sig-paren">(</span><em>string text</em><span class="sig-paren">)</span><a class="headerlink" href="#lower" title="Permalink to this definition">¶</a></dt> <dd><p>makes an input text to be lower case</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> Modified: tajo/site/docs/devel/genindex.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/genindex.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/genindex.html (original) +++ tajo/site/docs/devel/genindex.html Mon Jan 5 08:43:18 2015 @@ -59,11 +59,11 @@ <ul> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> Modified: tajo/site/docs/devel/getting_started.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/getting_started.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/getting_started.html (original) +++ tajo/site/docs/devel/getting_started.html Mon Jan 5 08:43:18 2015 @@ -29,7 +29,7 @@ <link rel="top" title="Apache Tajo 0.8.0 documentation" href="index.html"/> - <link rel="next" title="Prerequisites" href="getting_started/prerequisites.html"/> + <link rel="next" title="Configuration" href="configuration.html"/> <link rel="prev" title="Introduction" href="introduction.html"/> @@ -60,11 +60,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1 current"><a class="current reference internal" href="">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> @@ -178,14 +178,156 @@ <div class="section" id="getting-started"> <h1>Getting Started<a class="headerlink" href="#getting-started" title="Permalink to this headline">¶</a></h1> <p>In this section, we explain setup of a standalone Tajo instance. It will run against the local filesystem. In later sections, we will present how to run Tajo cluster instance on Apache Hadoop’s HDFS, a distributed filesystem. This section shows you how to start up a Tajo cluster, create tables in your Tajo cluster, submit SQL queries via Tajo shell, and shutting down your Tajo cluster instance. The below exercise should take no more than ten minutes.</p> -<div class="toctree-wrapper compound"> -<ul> -<li class="toctree-l1"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l1"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l1"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l1"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l1"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<div class="section" id="prerequisites"> +<h2>Prerequisites<a class="headerlink" href="#prerequisites" title="Permalink to this headline">¶</a></h2> +<blockquote> +<div><ul class="simple"> +<li>Hadoop 2.3.0 or higher (up to 2.5.1)</li> +<li>Java 1.6 or 1.7</li> +<li>Protocol buffer 2.5.0</li> </ul> +</div></blockquote> +</div> +<div class="section" id="dowload-and-unpack-the-source-code"> +<h2>Dowload and unpack the source code<a class="headerlink" href="#dowload-and-unpack-the-source-code" title="Permalink to this headline">¶</a></h2> +<p>You can either download the source code release of Tajo or check out the development codebase from Git.</p> +<div class="section" id="download-the-latest-source-release"> +<h3>Download the latest source release<a class="headerlink" href="#download-the-latest-source-release" title="Permalink to this headline">¶</a></h3> +<p>Choose a download site from this list of <a class="reference external" href="http://www.apache.org/dyn/closer.cgi/tajo";>Apache Download Mirrors</a>. +Click on the suggested mirror link. This will take you to a mirror of Tajo Releases. +Download the file that ends in .tar.gz to your local filesystem, e.g. tajo-x.y.z-src.tar.gz.</p> +<p>Decompress and untar your downloaded file and then change into the unpacked directory.</p> +<div class="highlight-python"><div class="highlight"><pre>tar xzvf tajo-x.y.z-src.tar.gz +</pre></div> +</div> +</div> +<div class="section" id="check-out-the-source-code-via-git"> +<h3>Check out the source code via Git<a class="headerlink" href="#check-out-the-source-code-via-git" title="Permalink to this headline">¶</a></h3> +<p>The development codebase can also be downloaded from <a class="reference external" href="https://git-wip-us.apache.org/repos/asf/tajo.git";>the Apache git repository</a> as follows:</p> +<div class="highlight-python"><div class="highlight"><pre>git clone https://git-wip-us.apache.org/repos/asf/tajo.git +</pre></div> +</div> +<p>A read-only git repository is also mirrored on <a class="reference external" href="https://github.com/apache/tajo";>Github</a>.</p> +</div> +</div> +<div class="section" id="build-source-code"> +<h2>Build source code<a class="headerlink" href="#build-source-code" title="Permalink to this headline">¶</a></h2> +<p>You prepare the prerequisites and the source code, you can build the source code now.</p> +<p>The first step of the installation procedure is to configure the source tree for your system and choose the options you would like. This is done by running the configure script. For a default installation simply enter:</p> +<p>You can compile source code and get a binary archive as follows:</p> +<div class="highlight-bash"><div class="highlight"><pre><span class="nv">$ </span><span class="nb">cd </span>tajo-x.y.z +<span class="nv">$ </span>mvn clean install -DskipTests -Pdist -Dtar -Dhadoop.version<span class="o">=</span>2.X.X +<span class="nv">$ </span>ls tajo-dist/target/tajo-x.y.z-SNAPSHOT.tar.gz +</pre></div> +</div> +<div class="admonition note"> +<p class="first admonition-title">Note</p> +<p>If you don’t specify the hadoop version, tajo cluster may not run correctly. Thus, we highly recommend that you specify your hadoop version with maven build command.</p> +<p>Example:</p> +<blockquote class="last"> +<div>$ mvn clean install -DskipTests -Pdist -Dtar -Dhadoop.version=2.5.1</div></blockquote> +</div> +<p>Then, after you move some proper directory, discompress the tar.gz file as follows:</p> +<div class="highlight-bash"><div class="highlight"><pre><span class="nv">$ </span><span class="nb">cd</span> <span class="o">[</span>a directory to be parent of tajo binary<span class="o">]</span> +<span class="nv">$ </span>tar xzvf <span class="si">${</span><span class="nv">TAJO_SRC</span><span class="si">}</span>/tajo-dist/target/tajo-x.y.z-SNAPSHOT.tar.gz +</pre></div> +</div> +</div> +<div class="section" id="setting-up-a-local-tajo-cluster"> +<h2>Setting up a local Tajo cluster<a class="headerlink" href="#setting-up-a-local-tajo-cluster" title="Permalink to this headline">¶</a></h2> +<p>Apache Tajo⢠provides two run modes: local mode and fully distributed mode. Here, we explain only the local mode where a Tajo instance runs on a local file system. A local mode Tajo instance can start up with very simple configurations.</p> +<p>First of all, you need to add the environment variables to conf/tajo-env.sh.</p> +<div class="highlight-bash"><div class="highlight"><pre><span class="c"># Hadoop home. Required</span> +<span class="nb">export </span><span class="nv">HADOOP_HOME</span><span class="o">=</span> ... + +<span class="c"># The java implementation to use. Required.</span> +<span class="nb">export </span><span class="nv">JAVA_HOME</span><span class="o">=</span> ... +</pre></div> +</div> +<p>To launch the tajo master, execute start-tajo.sh.</p> +<div class="highlight-bash"><div class="highlight"><pre><span class="nv">$ $TAJO_HOME</span>/bin/start-tajo.sh +</pre></div> +</div> +<div class="admonition note"> +<p class="first admonition-title">Note</p> +<p class="last">If you want to how to setup a fully distributed mode of Tajo, please see <a class="reference internal" href="configuration/cluster_setup.html"><em>Cluster Setup</em></a>.</p> +</div> +<div class="admonition warning"> +<p class="first admonition-title">Warning</p> +<p class="last">By default, <em>Catalog server</em> which manages table meta data uses <a class="reference external" href="http://db.apache.org/derby/";>Apache Derby</a> as a persistent storage, and Derby stores data into <code class="docutils literal"><span class="pre">/tmp/tajo-catalog-${username}</span></code> directory. But, some operating systems may remove all contents in <code class="docutils literal"><span class="pre">/tmp</span></code> when booting up. In order to ensure persistent store of your catalog data, you need to set a proper location of derby directory. To learn Catalog configuration, please refer to <a class="reference internal" href="configuration/catalog_configuration.html"><em>Catalog Configuration</em></a>.</p> +</div> +</div> +<div class="section" id="first-query-execution"> +<h2>First query execution<a class="headerlink" href="#first-query-execution" title="Permalink to this headline">¶</a></h2> +<p>First of all, we need to prepare some table for query execution. For example, you can make a simple text-based table as follows:</p> +<div class="highlight-bash"><div class="highlight"><pre><span class="nv">$ </span>mkdir /home/x/table1 +<span class="nv">$ </span><span class="nb">cd</span> /home/x/table1 +<span class="nv">$ </span>cat > data.csv +1<span class="p">|</span>abc<span class="p">|</span>1.1<span class="p">|</span>a +2<span class="p">|</span>def<span class="p">|</span>2.3<span class="p">|</span>b +3<span class="p">|</span>ghi<span class="p">|</span>3.4<span class="p">|</span>c +4<span class="p">|</span>jkl<span class="p">|</span>4.5<span class="p">|</span>d +5<span class="p">|</span>mno<span class="p">|</span>5.6<span class="p">|</span>e +<CTRL + D> +</pre></div> +</div> +<p>Apache Tajo⢠provides a SQL shell which allows users to interactively submit SQL queries. In order to use this shell, please execute <code class="docutils literal"><span class="pre">bin/tsql</span></code></p> +<div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tsql +tajo> +</pre></div> +</div> +<p>In order to load the table we created above, we should think of a schema of the table. +Here, we assume the schema as (int, text, float, text).</p> +<div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tsql +tajo> create external table table1 ( + id int, + name text, + score float, + type text) + using csv with ('text.delimiter'='|') location 'file:/home/x/table1'; +</pre></div> +</div> +<p>To load an external table, you need to use âcreate external tableâ statement. +In the location clause, you should use the absolute directory path with an appropriate scheme. +If the table resides in HDFS, you should use âhdfsâ instead of âfileâ.</p> +<p>If you want to know DDL statements in more detail, please see Query Language.</p> +<div class="highlight-python"><div class="highlight"><pre> tajo> \d + table1 + +``\d`` command shows the list of tables. :: + + tajo> \d table1 + + table name: table1 + table path: file:/home/x/table1 + store type: CSV + number of rows: 0 + volume (bytes): 78 B + schema: + id INT + name TEXT + score FLOAT + type TEXT +</pre></div> +</div> +<p><code class="docutils literal"><span class="pre">\d</span> <span class="pre">[table</span> <span class="pre">name]</span></code> command shows the description of a given table.</p> +<p>Also, you can execute SQL queries as follows:</p> +<div class="highlight-python"><div class="highlight"><pre>tajo> select * from table1 where id > 2; +final state: QUERY_SUCCEEDED, init time: 0.069 sec, response time: 0.397 sec +result: file:/tmp/tajo-hadoop/staging/q_1363768615503_0001_000001/RESULT, 3 rows ( 35B) + +id, name, score, type +- - - - - - - - - - - - - +3, ghi, 3.4, c +4, jkl, 4.5, d +5, mno, 5.6, e + +tajo> \q +bye +</pre></div> +</div> +<p>Feel free to enjoy Tajo with SQL standards. +If you want to know more explanation for SQL supported by Tajo, please refer <a class="reference internal" href="sql_language.html"><em>SQL Language</em></a>.</p> </div> </div> @@ -195,7 +337,7 @@ <div class="rst-footer-buttons" role="navigation" aria-label="footer navigation"> - <a href="getting_started/prerequisites.html" class="btn btn-neutral float-right" title="Prerequisites"/>Next <span class="fa fa-arrow-circle-right"></span></a> + <a href="configuration.html" class="btn btn-neutral float-right" title="Configuration"/>Next <span class="fa fa-arrow-circle-right"></span></a> <a href="introduction.html" class="btn btn-neutral" title="Introduction"><span class="fa fa-arrow-circle-left"></span> Previous</a> Modified: tajo/site/docs/devel/hcatalog_integration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/hcatalog_integration.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/hcatalog_integration.html (original) +++ tajo/site/docs/devel/hcatalog_integration.html Mon Jan 5 08:43:18 2015 @@ -60,11 +60,11 @@ <ul class="current"> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> @@ -182,20 +182,20 @@ This integration allows Tajo to access a Depending on your purpose, you can execute either SQL queries or HiveQL queries on the same tables managed in Apache Hive.</p> <p>In order to use this feature, you need to build Tajo with a specified maven profile -and then add some configs into <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> and <tt class="docutils literal"><span class="pre">conf/catalog-site.xml</span></tt>. +and then add some configs into <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> and <code class="docutils literal"><span class="pre">conf/catalog-site.xml</span></code>. This section describes how to setup HCatalog integration. This instruction would take no more than ten minutes.</p> <p>First, you need to compile the source code with hcatalog profile. Currently, Tajo supports hcatalog-0.11.0 and hcatalog-0.12.0 profile. -So, if you want to use Hive 0.11.0, you need to set <tt class="docutils literal"><span class="pre">-Phcatalog-0.11.0</span></tt> as the maven profile</p> +So, if you want to use Hive 0.11.0, you need to set <code class="docutils literal"><span class="pre">-Phcatalog-0.11.0</span></code> as the maven profile</p> <div class="highlight-python"><div class="highlight"><pre>$ mvn clean package -DskipTests -Pdist -Dtar -Phcatalog-0.11.0 </pre></div> </div> -<p>Or, if you want to use Hive 0.12.0, you need to set <tt class="docutils literal"><span class="pre">-Phcatalog-0.12.0</span></tt> as the maven profile</p> +<p>Or, if you want to use Hive 0.12.0, you need to set <code class="docutils literal"><span class="pre">-Phcatalog-0.12.0</span></code> as the maven profile</p> <div class="highlight-python"><div class="highlight"><pre>$ mvn clean package -DskipTests -Pdist -Dtar -Phcatalog-0.12.0 </pre></div> </div> -<p>Then, you need to set your Hive home directory to the environment variable <tt class="docutils literal"><span class="pre">HIVE_HOME</span></tt> in conf/tajo-env.sh as follows:</p> +<p>Then, you need to set your Hive home directory to the environment variable <code class="docutils literal"><span class="pre">HIVE_HOME</span></code> in conf/tajo-env.sh as follows:</p> <div class="highlight-python"><div class="highlight"><pre>export HIVE_HOME=/path/to/your/hive/directory </pre></div> </div> @@ -204,7 +204,7 @@ Next, you should set the path of MySQL J <div class="highlight-python"><div class="highlight"><pre>export HIVE_JDBC_DRIVER_DIR==/path/to/your/mysql_jdbc_driver/mysql-connector-java-x.x.x-bin.jar </pre></div> </div> -<p>Finally, you should specify HCatalogStore as Tajo catalog driver class in <tt class="docutils literal"><span class="pre">conf/catalog-site.xml</span></tt> as follows:</p> +<p>Finally, you should specify HCatalogStore as Tajo catalog driver class in <code class="docutils literal"><span class="pre">conf/catalog-site.xml</span></code> as follows:</p> <div class="highlight-python"><div class="highlight"><pre><property> <name>tajo.catalog.store.class</name> <value>org.apache.tajo.catalog.store.HCatalogStore</value> @@ -215,10 +215,10 @@ Next, you should set the path of MySQL J <p class="first admonition-title">Note</p> <p>Hive stores a list of partitions for each table in its metastore. If new partitions are directly added to HDFS, HiveMetastore will not able aware of these partitions unless the user -<tt class="docutils literal"><span class="pre">ALTER</span> <span class="pre">TABLE</span> <span class="pre">table_name</span> <span class="pre">ADD</span> <span class="pre">PARTITION</span></tt> commands on each of the newly added partitions or -<tt class="docutils literal"><span class="pre">MSCK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span> <span class="pre">table_name</span></tt> command.</p> -<p>But current tajo doesn’t provide <tt class="docutils literal"><span class="pre">ADD</span> <span class="pre">PARTITION</span></tt> command and hive doesn’t provide an api for -responding to <tt class="docutils literal"><span class="pre">MSK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span></tt> command. Thus, if you insert data to hive partitioned +<code class="docutils literal"><span class="pre">ALTER</span> <span class="pre">TABLE</span> <span class="pre">table_name</span> <span class="pre">ADD</span> <span class="pre">PARTITION</span></code> commands on each of the newly added partitions or +<code class="docutils literal"><span class="pre">MSCK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span> <span class="pre">table_name</span></code> command.</p> +<p>But current tajo doesn’t provide <code class="docutils literal"><span class="pre">ADD</span> <span class="pre">PARTITION</span></code> command and hive doesn’t provide an api for +responding to <code class="docutils literal"><span class="pre">MSK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span></code> command. Thus, if you insert data to hive partitioned table and you want to scan the updated partitions through Tajo, you must run following command on hive</p> <div class="last highlight-python"><div class="highlight"><pre>$ MSCK REPAIR TABLE [table_name]; </pre></div> Modified: tajo/site/docs/devel/index.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/index.html?rev=1649478&r1=1649477&r2=1649478&view=diff ============================================================================== --- tajo/site/docs/devel/index.html (original) +++ tajo/site/docs/devel/index.html Mon Jan 5 08:43:18 2015 @@ -59,11 +59,11 @@ <ul> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> @@ -186,15 +186,15 @@ As a result, some contents can be mismat <ul> <li class="toctree-l1"><a class="reference internal" href="introduction.html">Introduction</a></li> <li class="toctree-l1"><a class="reference internal" href="getting_started.html">Getting Started</a><ul> -<li class="toctree-l2"><a class="reference internal" href="getting_started/prerequisites.html">Prerequisites</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/downloading_source.html">Dowload and unpack the source code</a><ul> -<li class="toctree-l3"><a class="reference internal" href="getting_started/downloading_source.html#download-the-latest-source-release">Download the latest source release</a></li> -<li class="toctree-l3"><a class="reference internal" href="getting_started/downloading_source.html#check-out-the-source-code-via-git">Check out the source code via Git</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#prerequisites">Prerequisites</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#dowload-and-unpack-the-source-code">Dowload and unpack the source code</a><ul> +<li class="toctree-l3"><a class="reference internal" href="getting_started.html#download-the-latest-source-release">Download the latest source release</a></li> +<li class="toctree-l3"><a class="reference internal" href="getting_started.html#check-out-the-source-code-via-git">Check out the source code via Git</a></li> </ul> </li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/building.html">Build source code</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/local_setup.html">Setting up a local Tajo cluster</a></li> -<li class="toctree-l2"><a class="reference internal" href="getting_started/first_query.html">First query execution</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#build-source-code">Build source code</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#setting-up-a-local-tajo-cluster">Setting up a local Tajo cluster</a></li> +<li class="toctree-l2"><a class="reference internal" href="getting_started.html#first-query-execution">First query execution</a></li> </ul> </li> <li class="toctree-l1"><a class="reference internal" href="configuration.html">Configuration</a><ul> @@ -223,6 +223,7 @@ As a result, some contents can be mismat <li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#derby-configuration">Derby Configuration</a></li> <li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#mysqlstore-configuration">MySQLStore Configuration</a></li> <li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#mariadbstore-configuration">MariaDBStore Configuration</a></li> +<li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#hcatalogstore-configuration">HCatalogStore Configuration</a></li> </ul> </li> <li class="toctree-l2"><a class="reference internal" href="configuration/ha_configuration.html">High Availability for TajoMaster</a><ul>
