Modified: tajo/site/docs/devel/configuration/catalog_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/catalog_configuration.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/catalog_configuration.html (original) +++ tajo/site/docs/devel/configuration/catalog_configuration.html Thu Jan 8 17:49:23 2015 @@ -180,7 +180,7 @@ <div class="section" id="catalog-configuration"> <h1>Catalog Configuration<a class="headerlink" href="#catalog-configuration" title="Permalink to this headline">¶</a></h1> -<p>If you want to customize the catalog service, copy <code class="docutils literal"><span class="pre">$TAJO_HOME/conf/catalog-site.xml.template</span></code> to <code class="docutils literal"><span class="pre">catalog-site.xml</span></code>. Then, add the following configs to catalog-site.xml. Note that the default configs are enough to launch Tajo cluster in most cases.</p> +<p>If you want to customize the catalog service, copy <tt class="docutils literal"><span class="pre">$TAJO_HOME/conf/catalog-site.xml.template</span></tt> to <tt class="docutils literal"><span class="pre">catalog-site.xml</span></tt>. Then, add the following configs to catalog-site.xml. Note that the default configs are enough to launch Tajo cluster in most cases.</p> <ul class="simple"> <li>tajo.catalog.master.addr - If you want to launch a Tajo cluster in distributed mode, you must specify this address. For more detail information, see [Default Ports](#DefaultPorts).</li> <li>tajo.catalog.store.class - If you want to change the persistent storage of the catalog server, specify the class name. Its default value is tajo.catalog.store.DerbyStore. In the current version, Tajo provides three persistent storage classes as follows:</li> @@ -218,7 +218,7 @@ tests.</td> <div class="section" id="derby-configuration"> <h2>Derby Configuration<a class="headerlink" href="#derby-configuration" title="Permalink to this headline">¶</a></h2> <p>By default, Tajo uses <a class="reference external" href="http://db.apache.org/derby/";>Apache Derby</a> as a persistent storage in order to manage table meta data. So, without any configuration, you can use Derby for catalog store.</p> -<p>Also, you can set manually configs in <code class="docutils literal"><span class="pre">conf/catalog-site.xml</span></code> as follows:</p> +<p>Also, you can set manually configs in <tt class="docutils literal"><span class="pre">conf/catalog-site.xml</span></tt> as follows:</p> <div class="highlight-xml"><div class="highlight"><pre><property> <name>tajo.catalog.store.class</name> <value>org.apache.tajo.catalog.store.DerbyStore</value> @@ -239,12 +239,14 @@ tests.</td> </div> <div class="admonition warning"> <p class="first admonition-title">Warning</p> -<p class="last">By default, <em>Catalog server</em> stores catalog data into <code class="docutils literal"><span class="pre">/tmp/tajo-catalog-${username}</span></code> directory. But, some operating systems may remove all contents in <code class="docutils literal"><span class="pre">/tmp</span></code> when booting up. In order to ensure persistent store of your catalog data, you need to set a proper location of derby directory.</p> +<p class="last">By default, <em>Catalog server</em> stores catalog data into <tt class="docutils literal"><span class="pre">/tmp/tajo-catalog-${username}</span></tt> directory. But, some operating systems may remove all contents in <tt class="docutils literal"><span class="pre">/tmp</span></tt> when booting up. In order to ensure persistent store of your catalog data, you need to set a proper location of derby directory.</p> </div> </div> -<div class="section" id="mysqlstore-configuration"> -<h2>MySQLStore Configuration<a class="headerlink" href="#mysqlstore-configuration" title="Permalink to this headline">¶</a></h2> -<p>In order to use MySQLStore, you need to create database and user on MySQL for Tajo.</p> +<div class="section" id="mysql-mariadb-postgresql-oracle-configuration"> +<h2>MySQL/MariaDB/PostgreSQL/Oracle Configuration<a class="headerlink" href="#mysql-mariadb-postgresql-oracle-configuration" title="Permalink to this headline">¶</a></h2> +<p>Tajo supports several database systems, including MySQL, MariaDB, PostgreSQL, and Oracle, as its catalog store. +In order to use these systems, you first need to create a database and a user for Tajo. +The following example shows the creation of a user and a database with MySQL.</p> <div class="highlight-sh"><div class="highlight"><pre>mysql> create user <span class="s1">'tajo'</span>@<span class="s1">'localhost'</span> identified by <span class="s1">'xxxxxx'</span><span class="p">;</span> Query OK, <span class="m">0</span> rows affected <span class="o">(</span>0.00 sec<span class="o">)</span> @@ -255,38 +257,43 @@ mysql> grant all on tajo.* to <span c Query OK, <span class="m">0</span> rows affected <span class="o">(</span>0.01 sec<span class="o">)</span> </pre></div> </div> -<p>And then, you need to prepare MySQL JDBC driver on the machine which can be ran TajoMaster. If you do, you should set <code class="docutils literal"><span class="pre">TAJO_CLASSPATH</span></code> variable in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> with it as follows:</p> -<div class="highlight-sh"><div class="highlight"><pre><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span>/usr/local/mysql/lib/mysql-connector-java-x.x.x.jar +<p>Second, you must install the proper JDBC driver on the TajoMaster node. And then, you need to set the <tt class="docutils literal"><span class="pre">TAJO_CLASSPATH</span></tt> variable in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> as follows:</p> +<div class="highlight-sh"><div class="highlight"><pre><span class="o">(</span>MySQL<span class="o">)</span> +<span class="nv">$ </span><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span>/usr/local/mysql/lib/mysql-connector-java-x.x.x.jar + +<span class="o">(</span>MariaDB<span class="o">)</span> +<span class="nv">$ </span><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span>/usr/local/mariadb/lib/mariadb-java-client-x.x.x.jar + +<span class="o">(</span>PostgreSQL<span class="o">)</span> +<span class="nv">$ </span><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span>/usr/share/java/postgresql-jdbc4.jar + +<span class="o">(</span>Oracle<span class="o">)</span> +<span class="nv">$ </span><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span>/path/to/oracle/driver/ojdbc7.jar </pre></div> </div> -<p>Or you just can copy jdbc driver into <code class="docutils literal"><span class="pre">$TAJO_HOME/lib</span></code>.</p> -<p>Finally, you should add the following config to <cite>conf/catalog-site.xml</cite> :</p> +<p>Alternatively, you can copy the jdbc driver into <tt class="docutils literal"><span class="pre">$TAJO_HOME/lib</span></tt>.</p> +<p>Finally, you must add the following configurations to <cite>conf/catalog-site.xml</cite> :</p> <div class="highlight-xml"><div class="highlight"><pre><property> - <name>tajo.catalog.store.class</name> - <value>org.apache.tajo.catalog.store.MySQLStore</value> -</property> -<property> <name>tajo.catalog.jdbc.connection.id</name> - <value><mysql user name></value> + <value><user name></value> </property> <property> <name>tajo.catalog.jdbc.connection.password</name> - <value><mysql user password></value> + <value><user password></value> +</property> + +<!-- MySQL --> +<property> + <name>tajo.catalog.store.class</name> + <value>org.apache.tajo.catalog.store.MySQLStore</value> </property> <property> <name>tajo.catalog.jdbc.uri</name> <value>jdbc:mysql://<mysql host name>:<mysql port>/<database name for tajo>?createDatabaseIfNotExist=true</value> </property> -</pre></div> -</div> -</div> -<div class="section" id="mariadbstore-configuration"> -<h2>MariaDBStore Configuration<a class="headerlink" href="#mariadbstore-configuration" title="Permalink to this headline">¶</a></h2> -<p>All configurations for using MariaDBStore is compatible with MySQLStore except following:</p> -<div class="highlight-sh"><div class="highlight"><pre><span class="nb">export </span><span class="nv">TAJO_CLASSPATH</span><span class="o">=</span>/usr/local/mariadb/lib/mariadb-java-client-x.x.x.jar -</pre></div> -</div> -<div class="highlight-xml"><div class="highlight"><pre><property> + +<!-- MariaDB --> +<property> <name>tajo.catalog.store.class</name> <value>org.apache.tajo.catalog.store.MariaDBStore</value> </property> @@ -294,6 +301,26 @@ Query OK, <span class="m">0</span> rows <name>tajo.catalog.jdbc.uri</name> <value>jdbc:mariadb://<mariadb host name>:<mariadb port>/<database name for tajo>?createDatabaseIfNotExist=true</value> </property> + +<!-- PostgreSQL --> +<property> + <name>tajo.catalog.store.class</name> + <value>org.apache.tajo.catalog.store.PostgreSQLStore</value> +</property> +<property> + <name>tajo.catalog.jdbc.uri</name> + <value>jdbc:postgresql://<postgresql host name>:<postgresql port>/<database name for tajo>?createDatabaseIfNotExist=true</value> +</property> + +<!-- Oracle --> +<property> + <name>tajo.catalog.store.class</name> + <value>org.apache.tajo.catalog.store.OracleStore</value> +</property> +<property> + <name>tajo.catalog.jdbc.uri</name> + <value>jdbc:oracle:thin:@//<oracle host name>:<oracle port>/<ServiceName for tajo database></value> +</property> </pre></div> </div> </div> @@ -306,16 +333,16 @@ Query OK, <span class="m">0</span> rows <span class="nv">$ </span>ls tajo-dist/target/tajo-x.y.z-SNAPSHOT.tar.gz </pre></div> </div> -<p>Currently Tajo supports hive 0.12.0, hive 0.13.0, hive 0.13.1. If you enables HCatalogStore, you set the maven profile as <code class="docutils literal"><span class="pre">-Phcatalog-0.12.0</span></code>.</p> -<p>Second, you must set your hive home directory to HIVE_HOME variable in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> with it as follows:</p> +<p>Currently Tajo supports hive 0.12.0, hive 0.13.0, hive 0.13.1. If you enables HCatalogStore, you set the maven profile as <tt class="docutils literal"><span class="pre">-Phcatalog-0.12.0</span></tt>.</p> +<p>Second, you must set your hive home directory to HIVE_HOME variable in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> with it as follows:</p> <div class="highlight-sh"><div class="highlight"><pre><span class="nb">export </span><span class="nv">HIVE_HOME</span><span class="o">=</span>/path/to/your/hive/directory </pre></div> </div> -<p>Third, if you need to use jdbc to connect HiveMetaStore, you have to prepare mysql jdbc driver on host which can be ran TajoMaster. If you prepare it, you should set jdbc driver file path to <code class="docutils literal"><span class="pre">HIVE_JDBC_DRIVER_DIR</span></code> variable in conf/tajo-env.sh with it as follows:</p> +<p>Third, if you need to use jdbc to connect HiveMetaStore, you have to prepare mysql jdbc driver on host which can be ran TajoMaster. If you prepare it, you should set jdbc driver file path to <tt class="docutils literal"><span class="pre">HIVE_JDBC_DRIVER_DIR</span></tt> variable in conf/tajo-env.sh with it as follows:</p> <div class="highlight-sh"><div class="highlight"><pre><span class="nb">export </span><span class="nv">HIVE_JDBC_DRIVER_DIR</span><span class="o">=</span>/path/to/your/mysql_jdbc_driver/mysql-connector-java-x.x.x-bin.jar </pre></div> </div> -<p>Lastly, you should add the following config to <code class="docutils literal"><span class="pre">conf/catalog-site.xml</span></code> :</p> +<p>Lastly, you should add the following config to <tt class="docutils literal"><span class="pre">conf/catalog-site.xml</span></tt> :</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.catalog.store.class<span class="nt"></name></span> <span class="nt"><value></span>org.apache.tajo.catalog.store.HCatalogStore<span class="nt"></value></span>
Modified: tajo/site/docs/devel/configuration/cluster_setup.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/cluster_setup.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/cluster_setup.html (original) +++ tajo/site/docs/devel/configuration/cluster_setup.html Thu Jan 8 17:49:23 2015 @@ -216,8 +216,8 @@ </div> <div class="section" id="workers"> <h3>Workers<a class="headerlink" href="#workers" title="Permalink to this headline">¶</a></h3> -<p>The file <code class="docutils literal"><span class="pre">conf/workers</span></code> lists all host names of workers, one per line. -By default, this file contains the single entry <code class="docutils literal"><span class="pre">localhost</span></code>. +<p>The file <tt class="docutils literal"><span class="pre">conf/workers</span></tt> lists all host names of workers, one per line. +By default, this file contains the single entry <tt class="docutils literal"><span class="pre">localhost</span></tt>. You can easily add host names of workers via your favorite text editor.</p> <p>For example:</p> <div class="highlight-python"><div class="highlight"><pre>$ cat > conf/workers @@ -240,7 +240,7 @@ $ $HADOOP_HOME/bin/hadoop fs -chmod g+w </div> <div class="section" id="launch-a-tajo-cluster"> <h3>Launch a Tajo cluster<a class="headerlink" href="#launch-a-tajo-cluster" title="Permalink to this headline">¶</a></h3> -<p>Then, execute <code class="docutils literal"><span class="pre">start-tajo.sh</span></code></p> +<p>Then, execute <tt class="docutils literal"><span class="pre">start-tajo.sh</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/start-tajo.sh </pre></div> </div> Modified: tajo/site/docs/devel/configuration/ha_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/ha_configuration.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/ha_configuration.html (original) +++ tajo/site/docs/devel/configuration/ha_configuration.html Thu Jan 8 17:49:23 2015 @@ -195,14 +195,14 @@ </div> <div class="section" id="configuration-file-settings"> <h2>Configuration File Settings<a class="headerlink" href="#configuration-file-settings" title="Permalink to this headline">¶</a></h2> -<p>If you want to use TajoMaster HA mode, specific your <code class="docutils literal"><span class="pre">tajo.master.ha.enable</span></code> as follows:</p> +<p>If you want to use TajoMaster HA mode, specific your <tt class="docutils literal"><span class="pre">tajo.master.ha.enable</span></tt> as follows:</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.master.ha.enable<span class="nt"></name></span> <span class="nt"><value></span>true<span class="nt"></value></span> <span class="nt"></property></span> </pre></div> </div> -<p>If you use HA mode, all back masters monitor the active master at 5 second intervals. If you update this period, specific your <code class="docutils literal"><span class="pre">tajo.master.ha.monitor.interval</span></code> as follows:</p> +<p>If you use HA mode, all back masters monitor the active master at 5 second intervals. If you update this period, specific your <tt class="docutils literal"><span class="pre">tajo.master.ha.monitor.interval</span></tt> as follows:</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.master.ha.monitor.interval<span class="nt"></name></span> <span class="nt"><value></span>monitor interval<span class="nt"></value></span> @@ -212,7 +212,7 @@ </div> <div class="section" id="backup-master-settings"> <h2>Backup Master Settings<a class="headerlink" href="#backup-master-settings" title="Permalink to this headline">¶</a></h2> -<p>If you want to run masters with <code class="docutils literal"><span class="pre">start-tajo.sh</span></code>, specific your masters in <code class="docutils literal"><span class="pre">conf/masters</span></code>. The file lists all host names of masters, one per line.By default, this file contains the single entry <code class="docutils literal"><span class="pre">localhost</span></code>. You can easily add host names of workers via your favorite text editor.</p> +<p>If you want to run masters with <tt class="docutils literal"><span class="pre">start-tajo.sh</span></tt>, specific your masters in <tt class="docutils literal"><span class="pre">conf/masters</span></tt>. The file lists all host names of masters, one per line.By default, this file contains the single entry <tt class="docutils literal"><span class="pre">localhost</span></tt>. You can easily add host names of workers via your favorite text editor.</p> <p>For example:</p> <div class="highlight-python"><div class="highlight"><pre>$ cat > conf/masters host1.domain.com @@ -225,7 +225,7 @@ host2.domain.com <p>And then, you need to setup tarball and set configuration files on backup masters.</p> <div class="admonition note"> <p class="first admonition-title">Note</p> -<p>If you want to run active master and backup master on the same host, you may find TajoMaster port conflicts. To avoid this problem, you must convert backup master primary ports to another port in <code class="docutils literal"><span class="pre">tajo-site.xml</span></code> as follows:</p> +<p>If you want to run active master and backup master on the same host, you may find TajoMaster port conflicts. To avoid this problem, you must convert backup master primary ports to another port in <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt> as follows:</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.master.umbilical-rpc.address<span class="nt"></name></span> <span class="nt"><value></span>localhost:36001<span class="nt"></value></span> @@ -257,12 +257,12 @@ host2.domain.com <span class="nt"></property></span> </pre></div> </div> -<p class="last">And you need to convert <code class="docutils literal"><span class="pre">TAJO_PID_DIR</span></code> to another directory in <code class="docutils literal"><span class="pre">tajo-env.sh</span></code>.</p> +<p class="last">And you need to convert <tt class="docutils literal"><span class="pre">TAJO_PID_DIR</span></tt> to another directory in <tt class="docutils literal"><span class="pre">tajo-env.sh</span></tt>.</p> </div> </div> <div class="section" id="launch-a-tajo-cluster"> <h2>Launch a Tajo cluster<a class="headerlink" href="#launch-a-tajo-cluster" title="Permalink to this headline">¶</a></h2> -<p>Then, execute <code class="docutils literal"><span class="pre">start-tajo.sh</span></code></p> +<p>Then, execute <tt class="docutils literal"><span class="pre">start-tajo.sh</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/start-tajo.sh </pre></div> </div> @@ -273,19 +273,19 @@ host2.domain.com </div> <div class="section" id="administration-ha-state"> <h2>Administration HA state<a class="headerlink" href="#administration-ha-state" title="Permalink to this headline">¶</a></h2> -<p>If you want to transit any backup master to active master, execute <code class="docutils literal"><span class="pre">tajo</span> <span class="pre">hadmin</span> <span class="pre">-transitionToActive</span></code></p> +<p>If you want to transit any backup master to active master, execute <tt class="docutils literal"><span class="pre">tajo</span> <span class="pre">hadmin</span> <span class="pre">-transitionToActive</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tajo haadmin -transitionToActive <target tajo.master.umbilical-rpc.address> </pre></div> </div> -<p>If you want to transit any active master to backup master, execute <code class="docutils literal"><span class="pre">tajo</span> <span class="pre">hadmin</span> <span class="pre">-transitionToBackup</span></code></p> +<p>If you want to transit any active master to backup master, execute <tt class="docutils literal"><span class="pre">tajo</span> <span class="pre">hadmin</span> <span class="pre">-transitionToBackup</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tajo haadmin -transitionToBackup <target tajo.master.umbilical-rpc.address> </pre></div> </div> -<p>If you want to find the state of any master, execute <code class="docutils literal"><span class="pre">tajo</span> <span class="pre">hadmin</span> <span class="pre">-getState</span></code></p> +<p>If you want to find the state of any master, execute <tt class="docutils literal"><span class="pre">tajo</span> <span class="pre">hadmin</span> <span class="pre">-getState</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tajo haadmin -getState <target tajo.master.umbilical-rpc.address> </pre></div> </div> -<p>If you want to initiate HA information, execute <code class="docutils literal"><span class="pre">tajo</span> <span class="pre">haadmin</span> <span class="pre">-formatHA</span></code></p> +<p>If you want to initiate HA information, execute <tt class="docutils literal"><span class="pre">tajo</span> <span class="pre">haadmin</span> <span class="pre">-formatHA</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tajo haadmin -formatHA </pre></div> </div> @@ -297,7 +297,7 @@ host2.domain.com <div class="section" id="how-to-test-automatic-failover"> <h2>How to Test Automatic Failover<a class="headerlink" href="#how-to-test-automatic-failover" title="Permalink to this headline">¶</a></h2> <p>If you want to verify automatic failover of TajoMaster, you must deploy your Tajo cluster with TajoMaster HA enable. And then, you need to find which node is active from Tajo web UI.</p> -<p>Once you find your active TajoMaster, you can cause a failure on that node. For example, you can use kill -9 <pid of TajoMaster> to simulate a JVM crash. Or you can shutdown the machine or disconnect network interface. And then, the backup TajoMaster will be automatically active within 5 seconds. The amount of time required to detect a failure and trigger a failover depends on the config <code class="docutils literal"><span class="pre">tajo.master.ha.monitor.interval</span></code>. If there is running queries, it will be finished successfully. Because your TajoClient will get the result data on TajoWorker. But you can’t find already query history. Because TajoMaster stores query history on memory. So, the other master can’t access already active master query history. And if there is no running query, the automatic failover run successfully.</p> +<p>Once you find your active TajoMaster, you can cause a failure on that node. For example, you can use kill -9 <pid of TajoMaster> to simulate a JVM crash. Or you can shutdown the machine or disconnect network interface. And then, the backup TajoMaster will be automatically active within 5 seconds. The amount of time required to detect a failure and trigger a failover depends on the config <tt class="docutils literal"><span class="pre">tajo.master.ha.monitor.interval</span></tt>. If there is running queries, it will be finished successfully. Because your TajoClient will get the result data on TajoWorker. But you can’t find already query history. Because TajoMaster stores query history on memory. So, the other master can’t access already active master query history. And if there is no running query, the automatic failover run successfully.</p> <div class="admonition note"> <p class="first admonition-title">Note</p> <p class="last">TajoMaster HA does not consider TajoWorker failure. It guarantees the high availability of both TajoResourceManager and QueryMaster.</p> Modified: tajo/site/docs/devel/configuration/preliminary.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/preliminary.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/preliminary.html (original) +++ tajo/site/docs/devel/configuration/preliminary.html Thu Jan 8 17:49:23 2015 @@ -187,7 +187,7 @@ <li>catalog-site.xml - configuration for the catalog server.</li> <li>tajo-site.xml - configuration for other tajo modules.</li> </ul> -<p>Each config consists of a pair of a name and a value. If you want to set the config name <code class="docutils literal"><span class="pre">a.b.c</span></code> with the value <code class="docutils literal"><span class="pre">123</span></code>, add the following element to an appropriate file.</p> +<p>Each config consists of a pair of a name and a value. If you want to set the config name <tt class="docutils literal"><span class="pre">a.b.c</span></tt> with the value <tt class="docutils literal"><span class="pre">123</span></tt>, add the following element to an appropriate file.</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>a.b.c<span class="nt"></name></span> <span class="nt"><value></span>123<span class="nt"></value></span> @@ -195,7 +195,7 @@ </pre></div> </div> <p>Tajo has a variety of internal configs. If you don’t set some config explicitly, the default config will be used for for that config. Tajo is designed to use only a few of configs in usual cases. You may not be concerned with the configuration.</p> -<p>In default, there is no <code class="docutils literal"><span class="pre">tajo-site.xml</span></code> in <code class="docutils literal"><span class="pre">${TAJO}/conf</span></code> directory. If you set some configs, first copy <code class="docutils literal"><span class="pre">$TAJO_HOME/conf/tajo-site.xml.templete</span></code> to <code class="docutils literal"><span class="pre">tajo-site.xml</span></code>. Then, add the configs to your tajo-site.</p> +<p>In default, there is no <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt> in <tt class="docutils literal"><span class="pre">${TAJO}/conf</span></tt> directory. If you set some configs, first copy <tt class="docutils literal"><span class="pre">$TAJO_HOME/conf/tajo-site.xml.templete</span></tt> to <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt>. Then, add the configs to your tajo-site.</p> </div> <div class="section" id="tajo-env-sh"> <h2>tajo-env.sh<a class="headerlink" href="#tajo-env-sh" title="Permalink to this headline">¶</a></h2> Modified: tajo/site/docs/devel/configuration/tajo-site-xml.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/tajo-site-xml.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/tajo-site-xml.html (original) +++ tajo/site/docs/devel/configuration/tajo-site-xml.html Thu Jan 8 17:49:23 2015 @@ -180,7 +180,7 @@ <div class="section" id="the-tajo-site-xml-file"> <h1>The tajo-site.xml File<a class="headerlink" href="#the-tajo-site-xml-file" title="Permalink to this headline">¶</a></h1> -<p>To the <code class="docutils literal"><span class="pre">core-site.xml</span></code> file on every host in your cluster, you must add the following information:</p> +<p>To the <tt class="docutils literal"><span class="pre">core-site.xml</span></tt> file on every host in your cluster, you must add the following information:</p> <div class="section" id="system-config"> <h2>System Config<a class="headerlink" href="#system-config" title="Permalink to this headline">¶</a></h2> </div> Modified: tajo/site/docs/devel/configuration/tajo_master_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/tajo_master_configuration.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/tajo_master_configuration.html (original) +++ tajo/site/docs/devel/configuration/tajo_master_configuration.html Thu Jan 8 17:49:23 2015 @@ -189,12 +189,12 @@ <span class="nt"></property></span> </pre></div> </div> -<p>Tajo rootdir must be a url form like <code class="docutils literal"><span class="pre">scheme://hostname:port/path</span></code>. The current implementaion only supports <code class="docutils literal"><span class="pre">hdfs://</span></code> and <code class="docutils literal"><span class="pre">file://</span></code> schemes. The default value is <code class="docutils literal"><span class="pre">file:///tmp/tajo-${user.name}/</span></code>.</p> +<p>Tajo rootdir must be a url form like <tt class="docutils literal"><span class="pre">scheme://hostname:port/path</span></tt>. The current implementaion only supports <tt class="docutils literal"><span class="pre">hdfs://</span></tt> and <tt class="docutils literal"><span class="pre">file://</span></tt> schemes. The default value is <tt class="docutils literal"><span class="pre">file:///tmp/tajo-${user.name}/</span></tt>.</p> </div> <div class="section" id="tajomaster-heap-memory-size"> <h2>TajoMaster Heap Memory Size<a class="headerlink" href="#tajomaster-heap-memory-size" title="Permalink to this headline">¶</a></h2> <p>The environment variable TAJO_MASTER_HEAPSIZE in conf/tajo-env.sh allow Tajo Master to use the specified heap memory size.</p> -<p>If you want to adjust heap memory size, set <code class="docutils literal"><span class="pre">TAJO_MASTER_HEAPSIZE</span></code> variable in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> with a proper size as follows:</p> +<p>If you want to adjust heap memory size, set <tt class="docutils literal"><span class="pre">TAJO_MASTER_HEAPSIZE</span></tt> variable in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> with a proper size as follows:</p> <div class="highlight-sh"><div class="highlight"><pre><span class="nv">TAJO_MASTER_HEAPSIZE</span><span class="o">=</span>2000 </pre></div> </div> Modified: tajo/site/docs/devel/configuration/worker_configuration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/configuration/worker_configuration.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/configuration/worker_configuration.html (original) +++ tajo/site/docs/devel/configuration/worker_configuration.html Thu Jan 8 17:49:23 2015 @@ -182,8 +182,8 @@ <h1>Worker Configuration<a class="headerlink" href="#worker-configuration" title="Permalink to this headline">¶</a></h1> <div class="section" id="worker-heap-memory-size"> <h2>Worker Heap Memory Size<a class="headerlink" href="#worker-heap-memory-size" title="Permalink to this headline">¶</a></h2> -<p>The environment variable <code class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></code> in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> allow Tajo Worker to use the specified heap memory size.</p> -<p>If you want to adjust heap memory size, set <code class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></code> variable in <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> with a proper size as follows:</p> +<p>The environment variable <tt class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></tt> in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> allow Tajo Worker to use the specified heap memory size.</p> +<p>If you want to adjust heap memory size, set <tt class="docutils literal"><span class="pre">TAJO_WORKER_HEAPSIZE</span></tt> variable in <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> with a proper size as follows:</p> <div class="highlight-bash"><div class="highlight"><pre><span class="nv">TAJO_WORKER_HEAPSIZE</span><span class="o">=</span>8000 </pre></div> </div> @@ -192,7 +192,7 @@ <div class="section" id="temporary-data-directory"> <h2>Temporary Data Directory<a class="headerlink" href="#temporary-data-directory" title="Permalink to this headline">¶</a></h2> <p>TajoWorker stores temporary data on local file system due to out-of-core algorithms. It is possible to specify one or more temporary data directories where temporary data will be stored.</p> -<p><code class="docutils literal"><span class="pre">tajo-site.xml</span></code></p> +<p><tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt></p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.worker.tmpdir.locations<span class="nt"></name></span> <span class="nt"><value></span>/disk1/tmpdir,/disk2/tmpdir,/disk3/tmpdir<span class="nt"></value></span> @@ -208,7 +208,7 @@ <h2>Worker Resources<a class="headerlink" href="#worker-resources" title="Permalink to this headline">¶</a></h2> <p>Each worker can execute multiple tasks simultaneously. In Tajo, users can specify the total size of memory and the number of disks for each worker. Available resources affect how many tasks are executed simultaneously.</p> -<p>In order to specify the resource capacity of each worker, you should add the following configs to <code class="docutils literal"><span class="pre">tajo-site.xml</span></code> :</p> +<p>In order to specify the resource capacity of each worker, you should add the following configs to <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt> :</p> <table border="1" class="docutils"> <colgroup> <col width="32%" /> @@ -247,13 +247,13 @@ In Tajo, users can specify the total siz </div> <div class="admonition note"> <p class="first admonition-title">Note</p> -<p class="last">If <code class="docutils literal"><span class="pre">tajo.worker.resource.dfs-dir-aware</span></code> is set to <code class="docutils literal"><span class="pre">true</span></code> in <code class="docutils literal"><span class="pre">tajo-site.xml</span></code>, the worker will aware of and use the number of HDFS datanode’s data dirs in the node. -In other words, <code class="docutils literal"><span class="pre">tajo.worker.resource.disks</span></code> is ignored.</p> +<p class="last">If <tt class="docutils literal"><span class="pre">tajo.worker.resource.dfs-dir-aware</span></tt> is set to <tt class="docutils literal"><span class="pre">true</span></tt> in <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt>, the worker will aware of and use the number of HDFS datanode’s data dirs in the node. +In other words, <tt class="docutils literal"><span class="pre">tajo.worker.resource.disks</span></tt> is ignored.</p> </div> <div class="section" id="example"> <h3>Example<a class="headerlink" href="#example" title="Permalink to this headline">¶</a></h3> <p>Assume that you want to give 5120 MB memory, 4 disks, and 24 cores on each worker. The example configuration is as follows:</p> -<p><code class="docutils literal"><span class="pre">tajo-site.xml</span></code></p> +<p><tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt></p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.worker.resource.tajo.worker.resource.cpu-cores<span class="nt"></name></span> <span class="nt"><value></span>24<span class="nt"></value></span> @@ -273,7 +273,7 @@ In other words, <code class="docutils li </div> <div class="section" id="dedicated-mode"> <h3>Dedicated Mode<a class="headerlink" href="#dedicated-mode" title="Permalink to this headline">¶</a></h3> -<p>Tajo provides a dedicated mode that allows each worker in a Tajo cluster to use whole available system resources including cpu-cores, memory, and disks. For this mode, a user should add the following config to <code class="docutils literal"><span class="pre">tajo-site.xml</span></code> :</p> +<p>Tajo provides a dedicated mode that allows each worker in a Tajo cluster to use whole available system resources including cpu-cores, memory, and disks. For this mode, a user should add the following config to <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt> :</p> <div class="highlight-xml"><div class="highlight"><pre><span class="nt"><property></span> <span class="nt"><name></span>tajo.worker.resource.dedicated<span class="nt"></name></span> <span class="nt"><value></span>true<span class="nt"></value></span> Modified: tajo/site/docs/devel/functions/datetime_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/datetime_func_and_operators.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/functions/datetime_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/datetime_func_and_operators.html Thu Jan 8 17:49:23 2015 @@ -187,7 +187,7 @@ </div></blockquote> <dl class="function"> <dt id="add_days"> -<code class="descname">add_days</code><span class="sig-paren">(</span><em>date date|timestamp</em>, <em>day int</em><span class="sig-paren">)</span><a class="headerlink" href="#add_days" title="Permalink to this definition">¶</a></dt> +<tt class="descname">add_days</tt><big>(</big><em>date date|timestamp</em>, <em>day int</em><big>)</big><a class="headerlink" href="#add_days" title="Permalink to this definition">¶</a></dt> <dd><p>Returns date value which is added with given day parameter.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -217,7 +217,7 @@ <dl class="function"> <dt id="add_months"> -<code class="descname">add_months</code><span class="sig-paren">(</span><em>date date|timestamp</em>, <em>month int</em><span class="sig-paren">)</span><a class="headerlink" href="#add_months" title="Permalink to this definition">¶</a></dt> +<tt class="descname">add_months</tt><big>(</big><em>date date|timestamp</em>, <em>month int</em><big>)</big><a class="headerlink" href="#add_months" title="Permalink to this definition">¶</a></dt> <dd><p>Returns date value which is added with given month parameter.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -244,7 +244,7 @@ <dl class="function"> <dt id="current_date"> -<code class="descname">current_date</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#current_date" title="Permalink to this definition">¶</a></dt> +<tt class="descname">current_date</tt><big>(</big><big>)</big><a class="headerlink" href="#current_date" title="Permalink to this definition">¶</a></dt> <dd><p>Returns current date</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -262,7 +262,7 @@ <dl class="function"> <dt id="current_time"> -<code class="descname">current_time</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#current_time" title="Permalink to this definition">¶</a></dt> +<tt class="descname">current_time</tt><big>(</big><big>)</big><a class="headerlink" href="#current_time" title="Permalink to this definition">¶</a></dt> <dd><p>Returns current time</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -280,7 +280,7 @@ <dl class="function"> <dt id="extract"> -<code class="descname">extract</code><span class="sig-paren">(</span><em>field FROM source</em><span class="sig-paren">)</span><a class="headerlink" href="#extract" title="Permalink to this definition">¶</a></dt> +<tt class="descname">extract</tt><big>(</big><em>field FROM source</em><big>)</big><a class="headerlink" href="#extract" title="Permalink to this definition">¶</a></dt> <dd><p>The extract function retrieves subfields such as year or hour from date/time values. <em>source</em> must be a value expression of type <em>timestamp</em>, or <em>time</em>. (Expressions of type <em>date</em> are cast to <em>timestamp</em> and can therefore be used as well.) <em>field</em> is an identifier that selects what field to extract from the source value. The extract function returns values of type double precision. The following are valid field names:</p> <p><strong>century</strong></p> <p>The century</p> @@ -396,7 +396,7 @@ <dl class="function"> <dt id="date_part"> -<code class="descname">date_part</code><span class="sig-paren">(</span><em>'field'</em>, <em>source</em><span class="sig-paren">)</span><a class="headerlink" href="#date_part" title="Permalink to this definition">¶</a></dt> +<tt class="descname">date_part</tt><big>(</big><em>'field'</em>, <em>source</em><big>)</big><a class="headerlink" href="#date_part" title="Permalink to this definition">¶</a></dt> <dd><p>Note that here the field parameter needs to be a string value, not a name. The valid field names for date_part are the same as for extract.</p> <div class="highlight-sql"><div class="highlight"><pre><span class="k">select</span> <span class="n">date_part</span><span class="p">(</span><span class="s1">'day'</span><span class="p">,</span> <span class="k">timestamp</span> <span class="s1">'2001-02-16 20:38:40'</span><span class="p">);</span> <span class="o">></span> <span class="mi">16</span><span class="p">.</span><span class="mi">0</span> @@ -406,7 +406,7 @@ <dl class="function"> <dt id="now"> -<code class="descname">now</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#now" title="Permalink to this definition">¶</a></dt> +<tt class="descname">now</tt><big>(</big><big>)</big><a class="headerlink" href="#now" title="Permalink to this definition">¶</a></dt> <dd><p>Returns current timestamp</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -426,7 +426,7 @@ <dl class="function"> <dt id="to_char"> -<code class="descname">to_char</code><span class="sig-paren">(</span><em>src timestamp</em>, <em>format text</em><span class="sig-paren">)</span><a class="headerlink" href="#to_char" title="Permalink to this definition">¶</a></dt> +<tt class="descname">to_char</tt><big>(</big><em>src timestamp</em>, <em>format text</em><big>)</big><a class="headerlink" href="#to_char" title="Permalink to this definition">¶</a></dt> <dd><p>Converts timestamp to text. For more detailed, see ‘Date/Time Formatting and Conversion’ section below.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -451,7 +451,7 @@ <dl class="function"> <dt id="to_date"> -<code class="descname">to_date</code><span class="sig-paren">(</span><em>src text</em>, <em>format text</em><span class="sig-paren">)</span><a class="headerlink" href="#to_date" title="Permalink to this definition">¶</a></dt> +<tt class="descname">to_date</tt><big>(</big><em>src text</em>, <em>format text</em><big>)</big><a class="headerlink" href="#to_date" title="Permalink to this definition">¶</a></dt> <dd><p>Converts text to date. For more detailed, see ‘Date/Time Formatting and Conversion’ section below.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -476,7 +476,7 @@ <dl class="function"> <dt id="to_timestamp"> -<code class="descname">to_timestamp</code><span class="sig-paren">(</span><em>epoch int</em><span class="sig-paren">)</span><a class="headerlink" href="#to_timestamp" title="Permalink to this definition">¶</a></dt> +<tt class="descname">to_timestamp</tt><big>(</big><em>epoch int</em><big>)</big><a class="headerlink" href="#to_timestamp" title="Permalink to this definition">¶</a></dt> <dd><p>Converts int(UNIX epoch) to timestamp.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -496,7 +496,7 @@ <dl class="function"> <dt> -<code class="descname">to_timestamp</code><span class="sig-paren">(</span><em>src text</em>, <em>format text</em><span class="sig-paren">)</span></dt> +<tt class="descname">to_timestamp</tt><big>(</big><em>src text</em>, <em>format text</em><big>)</big></dt> <dd><p>Converts text timestamp. For more detailed, see ‘Date/Time Formatting and Conversion’ section below.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -521,7 +521,7 @@ <dl class="function"> <dt id="utc_usec_to"> -<code class="descname">utc_usec_to</code><span class="sig-paren">(</span><em>string text</em>, <em>long timestamp</em>, <em>int dayOfWeek</em><span class="sig-paren">)</span><a class="headerlink" href="#utc_usec_to" title="Permalink to this definition">¶</a></dt> +<tt class="descname">utc_usec_to</tt><big>(</big><em>string text</em>, <em>long timestamp</em>, <em>int dayOfWeek</em><big>)</big><a class="headerlink" href="#utc_usec_to" title="Permalink to this definition">¶</a></dt> <dd><ul> <li><p class="first">If the <strong>first parameter</strong> is ‘day’.</p> <p>Shifts and return a UNIX timestamp in microseconds to the beginning of the day it occurs in. Modified: tajo/site/docs/devel/functions/math_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/math_func_and_operators.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/functions/math_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/math_func_and_operators.html Thu Jan 8 17:49:23 2015 @@ -182,7 +182,7 @@ <h1>Math Functions and Operators<a class="headerlink" href="#math-functions-and-operators" title="Permalink to this headline">¶</a></h1> <dl class="function"> <dt id="abs"> -<code class="descname">abs</code><span class="sig-paren">(</span><em>number int|float</em><span class="sig-paren">)</span><a class="headerlink" href="#abs" title="Permalink to this definition">¶</a></dt> +<tt class="descname">abs</tt><big>(</big><em>number int|float</em><big>)</big><a class="headerlink" href="#abs" title="Permalink to this definition">¶</a></dt> <dd><p>Returns absolute value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -204,7 +204,7 @@ <dl class="function"> <dt id="acos"> -<code class="descname">acos</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#acos" title="Permalink to this definition">¶</a></dt> +<tt class="descname">acos</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#acos" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the arc cosine of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -226,7 +226,7 @@ <dl class="function"> <dt id="asin"> -<code class="descname">asin</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#asin" title="Permalink to this definition">¶</a></dt> +<tt class="descname">asin</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#asin" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the arc sine of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -248,7 +248,7 @@ <dl class="function"> <dt id="atan"> -<code class="descname">atan</code><span class="sig-paren">(</span><em>number float8</em><span class="sig-paren">)</span><a class="headerlink" href="#atan" title="Permalink to this definition">¶</a></dt> +<tt class="descname">atan</tt><big>(</big><em>number float8</em><big>)</big><a class="headerlink" href="#atan" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the arc tangent of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -270,7 +270,7 @@ <dl class="function"> <dt id="atan2"> -<code class="descname">atan2</code><span class="sig-paren">(</span><em>y float</em>, <em>x float</em><span class="sig-paren">)</span><a class="headerlink" href="#atan2" title="Permalink to this definition">¶</a></dt> +<tt class="descname">atan2</tt><big>(</big><em>y float</em>, <em>x float</em><big>)</big><a class="headerlink" href="#atan2" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the angle theta from the conversion of rectangular coordinates (x, y) to polar coordinates (r, theta)</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -297,7 +297,7 @@ <dl class="function"> <dt id="cbrt"> -<code class="descname">cbrt</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#cbrt" title="Permalink to this definition">¶</a></dt> +<tt class="descname">cbrt</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#cbrt" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the cube root of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -319,7 +319,7 @@ <dl class="function"> <dt id="ceil"> -<code class="descname">ceil</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#ceil" title="Permalink to this definition">¶</a></dt> +<tt class="descname">ceil</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#ceil" title="Permalink to this definition">¶</a></dt> <dd><p>Returns a smallest integer not less than argument</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -341,7 +341,7 @@ <dl class="function"> <dt id="cos"> -<code class="descname">cos</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#cos" title="Permalink to this definition">¶</a></dt> +<tt class="descname">cos</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#cos" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the cosine of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -363,7 +363,7 @@ <dl class="function"> <dt id="degrees"> -<code class="descname">degrees</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#degrees" title="Permalink to this definition">¶</a></dt> +<tt class="descname">degrees</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#degrees" title="Permalink to this definition">¶</a></dt> <dd><p>Converts radians to degrees</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -385,7 +385,7 @@ <dl class="function"> <dt id="div"> -<code class="descname">div</code><span class="sig-paren">(</span><em>num1 int</em>, <em>num2 int</em><span class="sig-paren">)</span><a class="headerlink" href="#div" title="Permalink to this definition">¶</a></dt> +<tt class="descname">div</tt><big>(</big><em>num1 int</em>, <em>num2 int</em><big>)</big><a class="headerlink" href="#div" title="Permalink to this definition">¶</a></dt> <dd><p>Integer division truncates resut</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -412,7 +412,7 @@ <dl class="function"> <dt id="exp"> -<code class="descname">exp</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#exp" title="Permalink to this definition">¶</a></dt> +<tt class="descname">exp</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#exp" title="Permalink to this definition">¶</a></dt> <dd><p>Returns Euler’s number e raised to the power of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -434,7 +434,7 @@ <dl class="function"> <dt id="floor"> -<code class="descname">floor</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#floor" title="Permalink to this definition">¶</a></dt> +<tt class="descname">floor</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#floor" title="Permalink to this definition">¶</a></dt> <dd><p>Returns a largest integer not greater than argument</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -456,7 +456,7 @@ <dl class="function"> <dt id="mod"> -<code class="descname">mod</code><span class="sig-paren">(</span><em>num1 int</em>, <em>num2 int</em><span class="sig-paren">)</span><a class="headerlink" href="#mod" title="Permalink to this definition">¶</a></dt> +<tt class="descname">mod</tt><big>(</big><em>num1 int</em>, <em>num2 int</em><big>)</big><a class="headerlink" href="#mod" title="Permalink to this definition">¶</a></dt> <dd><p>Returns remainder of num1 / num2</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -483,7 +483,7 @@ <dl class="function"> <dt id="pi"> -<code class="descname">pi</code><span class="sig-paren">(</span><span class="sig-paren">)</span><a class="headerlink" href="#pi" title="Permalink to this definition">¶</a></dt> +<tt class="descname">pi</tt><big>(</big><big>)</big><a class="headerlink" href="#pi" title="Permalink to this definition">¶</a></dt> <dd><p>Returns constant value of pi</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -503,7 +503,7 @@ <dl class="function"> <dt id="pow"> -<code class="descname">pow</code><span class="sig-paren">(</span><em>x float</em>, <em>y float</em><span class="sig-paren">)</span><a class="headerlink" href="#pow" title="Permalink to this definition">¶</a></dt> +<tt class="descname">pow</tt><big>(</big><em>x float</em>, <em>y float</em><big>)</big><a class="headerlink" href="#pow" title="Permalink to this definition">¶</a></dt> <dd><p>Returns value of x raised to the power of y</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -530,7 +530,7 @@ <dl class="function"> <dt id="radians"> -<code class="descname">radians</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#radians" title="Permalink to this definition">¶</a></dt> +<tt class="descname">radians</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#radians" title="Permalink to this definition">¶</a></dt> <dd><p>Converts degrees to radians</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -552,7 +552,7 @@ <dl class="function"> <dt id="round"> -<code class="descname">round</code><span class="sig-paren">(</span><em>number int|float</em><span class="sig-paren">)</span><a class="headerlink" href="#round" title="Permalink to this definition">¶</a></dt> +<tt class="descname">round</tt><big>(</big><em>number int|float</em><big>)</big><a class="headerlink" href="#round" title="Permalink to this definition">¶</a></dt> <dd><p>Rounds to nearest integer</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -574,7 +574,7 @@ <dl class="function"> <dt id="sign"> -<code class="descname">sign</code><span class="sig-paren">(</span><em>number int|float</em><span class="sig-paren">)</span><a class="headerlink" href="#sign" title="Permalink to this definition">¶</a></dt> +<tt class="descname">sign</tt><big>(</big><em>number int|float</em><big>)</big><a class="headerlink" href="#sign" title="Permalink to this definition">¶</a></dt> <dd><p>Returns sign of argument as -1, 0, 1</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -596,7 +596,7 @@ <dl class="function"> <dt id="sin"> -<code class="descname">sin</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#sin" title="Permalink to this definition">¶</a></dt> +<tt class="descname">sin</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#sin" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the sine of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -618,7 +618,7 @@ <dl class="function"> <dt id="sqrt"> -<code class="descname">sqrt</code><span class="sig-paren">(</span><em>number float8</em><span class="sig-paren">)</span><a class="headerlink" href="#sqrt" title="Permalink to this definition">¶</a></dt> +<tt class="descname">sqrt</tt><big>(</big><em>number float8</em><big>)</big><a class="headerlink" href="#sqrt" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the square root of a number</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -640,7 +640,7 @@ <dl class="function"> <dt id="tan"> -<code class="descname">tan</code><span class="sig-paren">(</span><em>number float</em><span class="sig-paren">)</span><a class="headerlink" href="#tan" title="Permalink to this definition">¶</a></dt> +<tt class="descname">tan</tt><big>(</big><em>number float</em><big>)</big><a class="headerlink" href="#tan" title="Permalink to this definition">¶</a></dt> <dd><p>Returns the tangent of number value</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> Modified: tajo/site/docs/devel/functions/network_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/network_func_and_operators.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/functions/network_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/network_func_and_operators.html Thu Jan 8 17:49:23 2015 @@ -186,7 +186,7 @@ To use these functions and operations, the GeoIP database should be precedently installed in local disks of all the workers. (Please refer the install instruction in <a class="reference external" href="http://dev.maxmind.com/geoip/legacy/downloadable/";>http://dev.maxmind.com/geoip/legacy/downloadable/</a>)</p> -<p>Once the GeoIP database is installed, you should specify the install location in <code class="docutils literal"><span class="pre">conf/tajo-site.xml</span></code> +<p>Once the GeoIP database is installed, you should specify the install location in <tt class="docutils literal"><span class="pre">conf/tajo-site.xml</span></tt> as follows.</p> <div class="highlight-python"><div class="highlight"><pre><property> <name>tajo.function.geoip-database-location</name> @@ -199,7 +199,7 @@ as follows.</p> <h2>Supported Functions<a class="headerlink" href="#supported-functions" title="Permalink to this headline">¶</a></h2> <dl class="function"> <dt id="geoip_country_code"> -<code class="descname">geoip_country_code</code><span class="sig-paren">(</span><em>string addr</em><span class="sig-paren">)</span><a class="headerlink" href="#geoip_country_code" title="Permalink to this definition">¶</a></dt> +<tt class="descname">geoip_country_code</tt><big>(</big><em>string addr</em><big>)</big><a class="headerlink" href="#geoip_country_code" title="Permalink to this definition">¶</a></dt> <dd><p>Convert an ipv4 address string to a geoip country code.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -221,7 +221,7 @@ as follows.</p> <dl class="function"> <dt> -<code class="descname">geoip_country_code</code><span class="sig-paren">(</span><em>inet4 addr</em><span class="sig-paren">)</span></dt> +<tt class="descname">geoip_country_code</tt><big>(</big><em>inet4 addr</em><big>)</big></dt> <dd><p>Convert an ipv4 address to a geoip country code.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -243,7 +243,7 @@ as follows.</p> <dl class="function"> <dt id="geoip_in_country"> -<code class="descname">geoip_in_country</code><span class="sig-paren">(</span><em>string addr</em>, <em>string code</em><span class="sig-paren">)</span><a class="headerlink" href="#geoip_in_country" title="Permalink to this definition">¶</a></dt> +<tt class="descname">geoip_in_country</tt><big>(</big><em>string addr</em>, <em>string code</em><big>)</big><a class="headerlink" href="#geoip_in_country" title="Permalink to this definition">¶</a></dt> <dd><p>If the given country code is same with the country code of the given address, it returns true. Otherwise, returns false.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -270,7 +270,7 @@ as follows.</p> <dl class="function"> <dt> -<code class="descname">geoip_in_country</code><span class="sig-paren">(</span><em>inet4 addr</em>, <em>string code</em><span class="sig-paren">)</span></dt> +<tt class="descname">geoip_in_country</tt><big>(</big><em>inet4 addr</em>, <em>string code</em><big>)</big></dt> <dd><p>If the given country code is same with the country code of the given address, it returns true. Otherwise, returns false.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> Modified: tajo/site/docs/devel/functions/string_func_and_operators.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/functions/string_func_and_operators.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/functions/string_func_and_operators.html (original) +++ tajo/site/docs/devel/functions/string_func_and_operators.html Thu Jan 8 17:49:23 2015 @@ -182,8 +182,8 @@ <h1>String Functions and Operators<a class="headerlink" href="#string-functions-and-operators" title="Permalink to this headline">¶</a></h1> <dl class="function"> <dt> -<code class="descname">str1 || str2</code></dt> -<dd><p>Returns the concatnenated string of both side strings <code class="docutils literal"><span class="pre">str1</span></code> and <code class="docutils literal"><span class="pre">str2</span></code>.</p> +<tt class="descname">str1 || str2</tt></dt> +<dd><p>Returns the concatnenated string of both side strings <tt class="docutils literal"><span class="pre">str1</span></tt> and <tt class="docutils literal"><span class="pre">str2</span></tt>.</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> <col class="field-body" /> @@ -209,7 +209,7 @@ <dl class="function"> <dt id="char_length"> -<code class="descname">char_length</code><span class="sig-paren">(</span><em>string text</em><span class="sig-paren">)</span><a class="headerlink" href="#char_length" title="Permalink to this definition">¶</a></dt> +<tt class="descname">char_length</tt><big>(</big><em>string text</em><big>)</big><a class="headerlink" href="#char_length" title="Permalink to this definition">¶</a></dt> <dd><p>Returns Number of characters in string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -233,7 +233,7 @@ <dl class="function"> <dt id="trim"> -<code class="descname">trim</code><span class="sig-paren">(</span><em>[leading | trailing | both] [characters] from string</em><span class="sig-paren">)</span><a class="headerlink" href="#trim" title="Permalink to this definition">¶</a></dt> +<tt class="descname">trim</tt><big>(</big><em>[leading | trailing | both] [characters] from string</em><big>)</big><a class="headerlink" href="#trim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the start/end/both ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -260,7 +260,7 @@ <dl class="function"> <dt id="btrim"> -<code class="descname">btrim</code><span class="sig-paren">(</span><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><span class="sig-paren">)</span><a class="headerlink" href="#btrim" title="Permalink to this definition">¶</a></dt> +<tt class="descname">btrim</tt><big>(</big><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><big>)</big><a class="headerlink" href="#btrim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the both ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -290,7 +290,7 @@ <dl class="function"> <dt id="ltrim"> -<code class="descname">ltrim</code><span class="sig-paren">(</span><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><span class="sig-paren">)</span><a class="headerlink" href="#ltrim" title="Permalink to this definition">¶</a></dt> +<tt class="descname">ltrim</tt><big>(</big><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><big>)</big><a class="headerlink" href="#ltrim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the start ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -317,7 +317,7 @@ <dl class="function"> <dt id="rtrim"> -<code class="descname">rtrim</code><span class="sig-paren">(</span><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><span class="sig-paren">)</span><a class="headerlink" href="#rtrim" title="Permalink to this definition">¶</a></dt> +<tt class="descname">rtrim</tt><big>(</big><em>string text</em><span class="optional">[</span>, <em>characters text</em><span class="optional">]</span><big>)</big><a class="headerlink" href="#rtrim" title="Permalink to this definition">¶</a></dt> <dd><p>Removes the characters (a space by default) from the end ends of the string</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -344,7 +344,7 @@ <dl class="function"> <dt id="split_part"> -<code class="descname">split_part</code><span class="sig-paren">(</span><em>string text</em>, <em>delimiter text</em>, <em>field int</em><span class="sig-paren">)</span><a class="headerlink" href="#split_part" title="Permalink to this definition">¶</a></dt> +<tt class="descname">split_part</tt><big>(</big><em>string text</em>, <em>delimiter text</em>, <em>field int</em><big>)</big><a class="headerlink" href="#split_part" title="Permalink to this definition">¶</a></dt> <dd><p>Splits a string on delimiter and return the given field (counting from one)</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -372,7 +372,7 @@ <dl class="function"> <dt id="regexp_replace"> -<code class="descname">regexp_replace</code><span class="sig-paren">(</span><em>string text</em>, <em>pattern text</em>, <em>replacement text</em><span class="sig-paren">)</span><a class="headerlink" href="#regexp_replace" title="Permalink to this definition">¶</a></dt> +<tt class="descname">regexp_replace</tt><big>(</big><em>string text</em>, <em>pattern text</em>, <em>replacement text</em><big>)</big><a class="headerlink" href="#regexp_replace" title="Permalink to this definition">¶</a></dt> <dd><p>Replaces substrings matched to a given regular expression pattern</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -400,7 +400,7 @@ <dl class="function"> <dt id="upper"> -<code class="descname">upper</code><span class="sig-paren">(</span><em>string text</em><span class="sig-paren">)</span><a class="headerlink" href="#upper" title="Permalink to this definition">¶</a></dt> +<tt class="descname">upper</tt><big>(</big><em>string text</em><big>)</big><a class="headerlink" href="#upper" title="Permalink to this definition">¶</a></dt> <dd><p>makes an input text to be upper case</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> @@ -422,7 +422,7 @@ <dl class="function"> <dt id="lower"> -<code class="descname">lower</code><span class="sig-paren">(</span><em>string text</em><span class="sig-paren">)</span><a class="headerlink" href="#lower" title="Permalink to this definition">¶</a></dt> +<tt class="descname">lower</tt><big>(</big><em>string text</em><big>)</big><a class="headerlink" href="#lower" title="Permalink to this definition">¶</a></dt> <dd><p>makes an input text to be lower case</p> <table class="docutils field-list" frame="void" rules="none"> <col class="field-name" /> Modified: tajo/site/docs/devel/getting_started.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/getting_started.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/getting_started.html (original) +++ tajo/site/docs/devel/getting_started.html Thu Jan 8 17:49:23 2015 @@ -254,7 +254,7 @@ Download the file that ends in .tar.gz t </div> <div class="admonition warning"> <p class="first admonition-title">Warning</p> -<p class="last">By default, <em>Catalog server</em> which manages table meta data uses <a class="reference external" href="http://db.apache.org/derby/";>Apache Derby</a> as a persistent storage, and Derby stores data into <code class="docutils literal"><span class="pre">/tmp/tajo-catalog-${username}</span></code> directory. But, some operating systems may remove all contents in <code class="docutils literal"><span class="pre">/tmp</span></code> when booting up. In order to ensure persistent store of your catalog data, you need to set a proper location of derby directory. To learn Catalog configuration, please refer to <a class="reference internal" href="configuration/catalog_configuration.html"><em>Catalog Configuration</em></a>.</p> +<p class="last">By default, <em>Catalog server</em> which manages table meta data uses <a class="reference external" href="http://db.apache.org/derby/";>Apache Derby</a> as a persistent storage, and Derby stores data into <tt class="docutils literal"><span class="pre">/tmp/tajo-catalog-${username}</span></tt> directory. But, some operating systems may remove all contents in <tt class="docutils literal"><span class="pre">/tmp</span></tt> when booting up. In order to ensure persistent store of your catalog data, you need to set a proper location of derby directory. To learn Catalog configuration, please refer to <a class="reference internal" href="configuration/catalog_configuration.html"><em>Catalog Configuration</em></a>.</p> </div> </div> <div class="section" id="first-query-execution"> @@ -271,7 +271,7 @@ Download the file that ends in .tar.gz t <CTRL + D> </pre></div> </div> -<p>Apache Tajo⢠provides a SQL shell which allows users to interactively submit SQL queries. In order to use this shell, please execute <code class="docutils literal"><span class="pre">bin/tsql</span></code></p> +<p>Apache Tajo⢠provides a SQL shell which allows users to interactively submit SQL queries. In order to use this shell, please execute <tt class="docutils literal"><span class="pre">bin/tsql</span></tt></p> <div class="highlight-python"><div class="highlight"><pre>$ $TAJO_HOME/bin/tsql tajo> </pre></div> @@ -310,7 +310,7 @@ If the table resides in HDFS, you should type TEXT </pre></div> </div> -<p><code class="docutils literal"><span class="pre">\d</span> <span class="pre">[table</span> <span class="pre">name]</span></code> command shows the description of a given table.</p> +<p><tt class="docutils literal"><span class="pre">\d</span> <span class="pre">[table</span> <span class="pre">name]</span></tt> command shows the description of a given table.</p> <p>Also, you can execute SQL queries as follows:</p> <div class="highlight-python"><div class="highlight"><pre>tajo> select * from table1 where id > 2; final state: QUERY_SUCCEEDED, init time: 0.069 sec, response time: 0.397 sec Modified: tajo/site/docs/devel/hcatalog_integration.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/hcatalog_integration.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/hcatalog_integration.html (original) +++ tajo/site/docs/devel/hcatalog_integration.html Thu Jan 8 17:49:23 2015 @@ -182,20 +182,20 @@ This integration allows Tajo to access a Depending on your purpose, you can execute either SQL queries or HiveQL queries on the same tables managed in Apache Hive.</p> <p>In order to use this feature, you need to build Tajo with a specified maven profile -and then add some configs into <code class="docutils literal"><span class="pre">conf/tajo-env.sh</span></code> and <code class="docutils literal"><span class="pre">conf/catalog-site.xml</span></code>. +and then add some configs into <tt class="docutils literal"><span class="pre">conf/tajo-env.sh</span></tt> and <tt class="docutils literal"><span class="pre">conf/catalog-site.xml</span></tt>. This section describes how to setup HCatalog integration. This instruction would take no more than ten minutes.</p> <p>First, you need to compile the source code with hcatalog profile. Currently, Tajo supports hcatalog-0.11.0 and hcatalog-0.12.0 profile. -So, if you want to use Hive 0.11.0, you need to set <code class="docutils literal"><span class="pre">-Phcatalog-0.11.0</span></code> as the maven profile</p> +So, if you want to use Hive 0.11.0, you need to set <tt class="docutils literal"><span class="pre">-Phcatalog-0.11.0</span></tt> as the maven profile</p> <div class="highlight-python"><div class="highlight"><pre>$ mvn clean package -DskipTests -Pdist -Dtar -Phcatalog-0.11.0 </pre></div> </div> -<p>Or, if you want to use Hive 0.12.0, you need to set <code class="docutils literal"><span class="pre">-Phcatalog-0.12.0</span></code> as the maven profile</p> +<p>Or, if you want to use Hive 0.12.0, you need to set <tt class="docutils literal"><span class="pre">-Phcatalog-0.12.0</span></tt> as the maven profile</p> <div class="highlight-python"><div class="highlight"><pre>$ mvn clean package -DskipTests -Pdist -Dtar -Phcatalog-0.12.0 </pre></div> </div> -<p>Then, you need to set your Hive home directory to the environment variable <code class="docutils literal"><span class="pre">HIVE_HOME</span></code> in conf/tajo-env.sh as follows:</p> +<p>Then, you need to set your Hive home directory to the environment variable <tt class="docutils literal"><span class="pre">HIVE_HOME</span></tt> in conf/tajo-env.sh as follows:</p> <div class="highlight-python"><div class="highlight"><pre>export HIVE_HOME=/path/to/your/hive/directory </pre></div> </div> @@ -204,7 +204,7 @@ Next, you should set the path of MySQL J <div class="highlight-python"><div class="highlight"><pre>export HIVE_JDBC_DRIVER_DIR==/path/to/your/mysql_jdbc_driver/mysql-connector-java-x.x.x-bin.jar </pre></div> </div> -<p>Finally, you should specify HCatalogStore as Tajo catalog driver class in <code class="docutils literal"><span class="pre">conf/catalog-site.xml</span></code> as follows:</p> +<p>Finally, you should specify HCatalogStore as Tajo catalog driver class in <tt class="docutils literal"><span class="pre">conf/catalog-site.xml</span></tt> as follows:</p> <div class="highlight-python"><div class="highlight"><pre><property> <name>tajo.catalog.store.class</name> <value>org.apache.tajo.catalog.store.HCatalogStore</value> @@ -215,10 +215,10 @@ Next, you should set the path of MySQL J <p class="first admonition-title">Note</p> <p>Hive stores a list of partitions for each table in its metastore. If new partitions are directly added to HDFS, HiveMetastore will not able aware of these partitions unless the user -<code class="docutils literal"><span class="pre">ALTER</span> <span class="pre">TABLE</span> <span class="pre">table_name</span> <span class="pre">ADD</span> <span class="pre">PARTITION</span></code> commands on each of the newly added partitions or -<code class="docutils literal"><span class="pre">MSCK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span> <span class="pre">table_name</span></code> command.</p> -<p>But current tajo doesn’t provide <code class="docutils literal"><span class="pre">ADD</span> <span class="pre">PARTITION</span></code> command and hive doesn’t provide an api for -responding to <code class="docutils literal"><span class="pre">MSK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span></code> command. Thus, if you insert data to hive partitioned +<tt class="docutils literal"><span class="pre">ALTER</span> <span class="pre">TABLE</span> <span class="pre">table_name</span> <span class="pre">ADD</span> <span class="pre">PARTITION</span></tt> commands on each of the newly added partitions or +<tt class="docutils literal"><span class="pre">MSCK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span> <span class="pre">table_name</span></tt> command.</p> +<p>But current tajo doesn’t provide <tt class="docutils literal"><span class="pre">ADD</span> <span class="pre">PARTITION</span></tt> command and hive doesn’t provide an api for +responding to <tt class="docutils literal"><span class="pre">MSK</span> <span class="pre">REPAIR</span> <span class="pre">TABLE</span></tt> command. Thus, if you insert data to hive partitioned table and you want to scan the updated partitions through Tajo, you must run following command on hive</p> <div class="last highlight-python"><div class="highlight"><pre>$ MSCK REPAIR TABLE [table_name]; </pre></div> Modified: tajo/site/docs/devel/index.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/index.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/index.html (original) +++ tajo/site/docs/devel/index.html Thu Jan 8 17:49:23 2015 @@ -221,8 +221,7 @@ As a result, some contents can be mismat </li> <li class="toctree-l2"><a class="reference internal" href="configuration/catalog_configuration.html">Catalog Configuration</a><ul> <li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#derby-configuration">Derby Configuration</a></li> -<li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#mysqlstore-configuration">MySQLStore Configuration</a></li> -<li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#mariadbstore-configuration">MariaDBStore Configuration</a></li> +<li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#mysql-mariadb-postgresql-oracle-configuration">MySQL/MariaDB/PostgreSQL/Oracle Configuration</a></li> <li class="toctree-l3"><a class="reference internal" href="configuration/catalog_configuration.html#hcatalogstore-configuration">HCatalogStore Configuration</a></li> </ul> </li> Modified: tajo/site/docs/devel/jdbc_driver.html URL: http://svn.apache.org/viewvc/tajo/site/docs/devel/jdbc_driver.html?rev=1650343&r1=1650342&r2=1650343&view=diff ============================================================================== --- tajo/site/docs/devel/jdbc_driver.html (original) +++ tajo/site/docs/devel/jdbc_driver.html Thu Jan 8 17:49:23 2015 @@ -185,7 +185,7 @@ In this section, we explain how to get J <div class="section" id="from-binary-distribution"> <h3>From Binary Distribution<a class="headerlink" href="#from-binary-distribution" title="Permalink to this headline">¶</a></h3> <p>Tajo binary distribution provides JDBC jar file and its dependent JAR files. -Those files are located in <code class="docutils literal"><span class="pre">${TAJO_HOME}/share/jdbc-dist/</span></code>.</p> +Those files are located in <tt class="docutils literal"><span class="pre">${TAJO_HOME}/share/jdbc-dist/</span></tt>.</p> </div> <div class="section" id="from-building-source-code"> <h3>From Building Source Code<a class="headerlink" href="#from-building-source-code" title="Permalink to this headline">¶</a></h3> @@ -200,29 +200,29 @@ Those files are located in <code class=" <div class="section" id="setting-the-classpath"> <h2>Setting the CLASSPATH<a class="headerlink" href="#setting-the-classpath" title="Permalink to this headline">¶</a></h2> <p>In order to use the JDBC driver, you should set the jar files included in -<code class="docutils literal"><span class="pre">tajo-dist/target/tajo-x.y.z/share/jdbc-dist</span></code> to your <code class="docutils literal"><span class="pre">CLASSPATH</span></code>. -In addition, you should add hadoop clsspath into your <code class="docutils literal"><span class="pre">CLASSPATH</span></code>. -So, <code class="docutils literal"><span class="pre">CLASSPATH</span></code> will be set as follows:</p> +<tt class="docutils literal"><span class="pre">tajo-dist/target/tajo-x.y.z/share/jdbc-dist</span></tt> to your <tt class="docutils literal"><span class="pre">CLASSPATH</span></tt>. +In addition, you should add hadoop clsspath into your <tt class="docutils literal"><span class="pre">CLASSPATH</span></tt>. +So, <tt class="docutils literal"><span class="pre">CLASSPATH</span></tt> will be set as follows:</p> <div class="highlight-bash"><div class="highlight"><pre><span class="nv">CLASSPATH</span><span class="o">=</span>path/to/tajo-jdbc/*:path/to/tajo-site.xml:path/to/core-site.xml:path/to/hdfs-site.xml </pre></div> </div> <div class="admonition note"> <p class="first admonition-title">Note</p> -<p class="last">You must add the locations which include Tajo config files (i.e., <code class="docutils literal"><span class="pre">tajo-site.xml</span></code>) and -Hadoop config files (i.e., <code class="docutils literal"><span class="pre">core-site.xml</span></code> and <code class="docutils literal"><span class="pre">hdfs-site.xml</span></code>) to your <code class="docutils literal"><span class="pre">CLASSPATH</span></code>.</p> +<p class="last">You must add the locations which include Tajo config files (i.e., <tt class="docutils literal"><span class="pre">tajo-site.xml</span></tt>) and +Hadoop config files (i.e., <tt class="docutils literal"><span class="pre">core-site.xml</span></tt> and <tt class="docutils literal"><span class="pre">hdfs-site.xml</span></tt>) to your <tt class="docutils literal"><span class="pre">CLASSPATH</span></tt>.</p> </div> </div> <div class="section" id="an-example-jdbc-client"> <h2>An Example JDBC Client<a class="headerlink" href="#an-example-jdbc-client" title="Permalink to this headline">¶</a></h2> -<p>The JDBC driver class name is <code class="docutils literal"><span class="pre">org.apache.tajo.jdbc.TajoDriver</span></code>. -You can get the driver <code class="docutils literal"><span class="pre">Class.forName("org.apache.tajo.jdbc.TajoDriver")</span></code>. -The connection url should be <code class="docutils literal"><span class="pre">jdbc:tajo://<TajoMaster</span> <span class="pre">hostname>:<TajoMaster</span> <span class="pre">client</span> <span class="pre">rpc</span> <span class="pre">port>/<database</span> <span class="pre">name></span></code>. -The default TajoMaster client rpc port is <code class="docutils literal"><span class="pre">26002</span></code>. -If you want to change the listening port, please refer <code class="xref doc docutils literal"><span class="pre">/configuration/configuration_defaults</span></code>.</p> +<p>The JDBC driver class name is <tt class="docutils literal"><span class="pre">org.apache.tajo.jdbc.TajoDriver</span></tt>. +You can get the driver <tt class="docutils literal"><span class="pre">Class.forName("org.apache.tajo.jdbc.TajoDriver")</span></tt>. +The connection url should be <tt class="docutils literal"><span class="pre">jdbc:tajo://<TajoMaster</span> <span class="pre">hostname>:<TajoMaster</span> <span class="pre">client</span> <span class="pre">rpc</span> <span class="pre">port>/<database</span> <span class="pre">name></span></tt>. +The default TajoMaster client rpc port is <tt class="docutils literal"><span class="pre">26002</span></tt>. +If you want to change the listening port, please refer <a class="reference internal" href="configuration/cluster_setup.html"><em>Cluster Setup</em></a>.</p> <div class="admonition note"> <p class="first admonition-title">Note</p> <p class="last">Currently, Tajo does not support the concept of database and namespace. -All tables are contained in <code class="docutils literal"><span class="pre">default</span></code> database. So, you don’t need to specify any database name.</p> +All tables are contained in <tt class="docutils literal"><span class="pre">default</span></tt> database. So, you don’t need to specify any database name.</p> </div> <p>The following shows an example of JDBC Client.</p> <div class="highlight-java"><div class="highlight"><pre><span class="kn">import</span> <span class="nn">java.sql.Connection</span><span class="o">;</span>
