Author: gates
Date: Mon Apr 30 23:17:03 2012
New Revision: 1332466
URL: http://svn.apache.org/viewvc?rev=1332466&view=rev
Log:
HCATALOG-393 Several hcat 0.4 document fixes
Modified:
incubator/hcatalog/trunk/CHANGES.txt
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/cli.xml
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/index.xml
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/inputoutput.xml
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/loadstore.xml
Modified: incubator/hcatalog/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/CHANGES.txt?rev=1332466&r1=1332465&r2=1332466&view=diff
==============================================================================
--- incubator/hcatalog/trunk/CHANGES.txt (original)
+++ incubator/hcatalog/trunk/CHANGES.txt Mon Apr 30 23:17:03 2012
@@ -122,6 +122,8 @@ Release 0.4.0 - Unreleased
OPTIMIZATIONS
BUG FIXES
+ HCAT-393 Several hcat 0.4 document fixes (daijy via gates)
+
HCAT-395 Hcat 0.4 last minute doc fixes (gates)
HCAT-382 NPE in pig when a binary field is null (rohini vi avandana)
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/cli.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/cli.xml?rev=1332466&r1=1332465&r2=1332466&view=diff
==============================================================================
--- incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/cli.xml
(original)
+++ incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/cli.xml
Mon Apr 30 23:17:03 2012
@@ -27,7 +27,7 @@
<section>
<title>Set Up</title>
<p>The HCatalog command line interface (CLI) can be invoked as
-<code>HIVE_HOME=</code><em>hive_home hcat_home</em><code>bin/hcat</code>
+<code>HIVE_HOME=</code><em>hive_home hcat_home</em><code>/bin/hcat</code>
where <em>hive_home</em> is the directory where Hive has been installed and
<em>hcat_home</em> is the directory where HCatalog has been installed.</p>
@@ -82,6 +82,7 @@ Usage: hcat { -e "<query>" | -f "
<li>ALTER TABLE ... REBUILD</li>
<li>ALTER TABLE ... CONCATENATE</li>
<li>ANALYZE TABLE ... COMPUTE STATISTICS</li>
+ <li>ALTER TABLE ARCHIVE/UNARCHIVE PARTITION</li>
</ul>
<section>
@@ -161,6 +162,10 @@ Usage: hcat { -e "<query>" | -f "
<!--
==================================================================== -->
<section>
+ <title>"dfs" command and "set" command</title>
+ <p>Supported. Behavior same as Hive.</p>
+</section>
+<section>
<title>Other Commands</title>
<p>Any command not listed above is NOT supported and throws an
exception with the message "Operation Not Supported". </p>
</section>
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/index.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/index.xml?rev=1332466&r1=1332465&r2=1332466&view=diff
==============================================================================
--- incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/index.xml
(original)
+++ incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/index.xml
Mon Apr 30 23:17:03 2012
@@ -44,7 +44,7 @@
<title>Interfaces</title>
<p>The HCatalog interface for Pig consists of HCatLoader and HCatStorer, which
implement the Pig load and store interfaces respectively. HCatLoader accepts a
table to read data from; you can indicate which partitions to scan by
immediately following the load statement with a partition filter statement.
HCatStorer accepts a table to write to and optionally a specification of
partition keys to create a new partition. You can write to a single partition
by specifying the partition key(s) and value(s) in the STORE clause; and you
can write to multiple partitions if the partition key(s) are columns in the
data being stored. HCatLoader is implemented on top of HCatInputFormat and
HCatStorer is implemented on top of HCatOutputFormat (see <a
href="loadstore.html">HCatalog Load and Store</a>).</p>
-<p>HCatInputFormat and HCatOutputFormat are HCatalog's interface for
MapReduce; they implement Hadoop's InputFormat and OutputFormat, respectively.
HCatInputFormat accepts a table to read data from and optionally a selection
predicate to indicate which partitions to scan. HCatOutputFormat accepts a
table to write to and optionally a specification of partition keys to create a
new partition. You can write to a single partition by specifying the partition
key(s) and value(s) in the STORE clause; and you can write to multiple
partitions if the partition key(s) are columns in the data being stored. (See
<a href="inputoutput.html">HCatalog Input and Output</a>.)</p>
+<p>The HCatalog interface for MapReduce â HCatInputFormat and
HCatOutputFormat â is an implementation of Hadoop InputFormat and
OutputFormat. HCatInputFormat accepts a table to read data from and optionally
a selection predicate to indicate which partitions to scan. HCatOutputFormat
accepts a table to write to and optionally a specification of partition keys to
create a new partition. You can write to a single partition by specifying the
partition key(s) and value(s) in the setOutput method; and you can write to
multiple partitions if the partition key(s) are columns in the data being
stored. (See <a href="inputoutput.html">HCatalog Input and Output</a>.)</p>
<p>Note: There is no Hive-specific interface. Since HCatalog uses Hive's
metastore, Hive can read data in HCatalog directly.</p>
@@ -81,7 +81,7 @@ store Z into 'data/processedevents/20100
<p>With HCatalog, HCatalog will send a JMS message that data is available. The
Pig job can then be started.</p>
<source>
-A = load 'rawevents' using HCatLoader;
+A = load 'rawevents' using HCatLoader();
B = filter A by date = '20100819' and by bot_finder(zeta) = 0;
â¦
store Z into 'processedevents' using HCatStorer("date=20100819");
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/inputoutput.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/inputoutput.xml?rev=1332466&r1=1332465&r2=1332466&view=diff
==============================================================================
---
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/inputoutput.xml
(original)
+++
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/inputoutput.xml
Mon Apr 30 23:17:03 2012
@@ -149,28 +149,21 @@ pass the Hive and HCatalog jars MapReduc
export HADOOP_HOME=<path_to_hadoop_install>
export HCAT_HOME=<path_to_hcat_install>
export LIB_JARS=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar,
-$HCAT_HOME/share/hcatalog/lib/hive-metastore-0.8.1.jar,$HCAT_HOME/share/hcatalog/lib/libthrift-0.7.0.jar,
-$HCAT_HOME/share/hcatalog/lib/hive-exec-0.8.1.jar,$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar,
-$HCAT_HOME/share/hcatalog/lib/jdo2-api-2.3-ec.jar,$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar,
-$HCAT_HOME/share/hcatalog/lib/antlr-runtime-3.0.1.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-connectionpool-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-core-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-enhancer-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/datanucleus-rdbms-2.0.3.jar,
-$HCAT_HOME/share/hcatalog/lib/commons-dbcp-1.4.jar,
-$HCAT_HOME/share/hcatalog/lib/commons-pool-1.5.4.jar
+$HIVE_HOME/lib/hive-metastore-0.9.0.jar,
+$HIVE_HOME/lib/libthrift-0.7.0.jar,
+$HIVE_HOME/lib/hive-exec-0.9.0.jar,
+$HIVE_HOME/lib/libfb303-0.7.0.jar,
+$HIVE_HOME/lib/jdo2-api-2.3-ec.jar,
+$HIVE_HOME/lib/slf4j-api-1.6.1.jar
+
export HADOOP_CLASSPATH=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:
-$HCAT_HOME/share/hcatalog/lib/hive-metastore-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libthrift-0.7.0.jar:
-$HCAT_HOME/share/hcatalog/lib/hive-exec-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar:
-$HCAT_HOME/share/hcatalog/lib/jdo2-api-2.3-ec.jar:$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar:
-$HCAT_HOME/share/hcatalog/lib/antlr-runtime-3.0.1.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-connectionpool-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-core-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-enhancer-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/datanucleus-rdbms-2.0.3.jar:
-$HCAT_HOME/share/hcatalog/lib/commons-dbcp-1.4.jar:
-$HCAT_HOME/share/hcatalog/lib/commons-pool-1.5.4.jar:
-$HCAT_HOME/etc/hcatalog
+$HIVE_HOME/lib/hive-metastore-0.9.0.jar:
+$HIVE_HOME/lib/libthrift-0.7.0.jar:
+$HIVE_HOME/lib/hive-exec-0.9.0.jar:
+$HIVE_HOME/lib/libfb303-0.7.0.jar:
+$HIVE_HOME/lib/jdo2-api-2.3-ec.jar:
+$HIVE_HOME/conf:$HADOOP_HOME/conf:
+$HIVE_HOME/lib/slf4j-api-1.6.1.jar
$HADOOP_HOME/bin/hadoop --config $HADOOP_HOME/conf jar <path_to_jar>
<main_class> -libjars $LIB_JARS <program_arguments>
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml?rev=1332466&r1=1332465&r2=1332466&view=diff
==============================================================================
---
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
(original)
+++
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
Mon Apr 30 23:17:03 2012
@@ -113,7 +113,7 @@
where you have installed Hive. If you are using Hive rpms, then this will
be <code>/usr/lib/hive</code>.</p>
- <p><code>mysql -u hive -D hivemetastoredb
-h</code><em>hivedb.acme.com</em><code> -p <
</code><em>hive_home</em><code>scripts/metastore/upgrade/mysql/hive-schema-0.9.0.mysql.sql</code></p>
+ <p><code>mysql -u hive -D hivemetastoredb
-h</code><em>hivedb.acme.com</em><code> -p <
</code><em>hive_home</em><code>/scripts/metastore/upgrade/mysql/hive-schema-0.9.0.mysql.sql</code></p>
<p><strong>Thrift Server Setup</strong></p>
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/loadstore.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/loadstore.xml?rev=1332466&r1=1332465&r2=1332466&view=diff
==============================================================================
---
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/loadstore.xml
(original)
+++
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/loadstore.xml
Mon Apr 30 23:17:03 2012
@@ -115,19 +115,15 @@ variable. In the case where you have ins
<source>
export HADOOP_HOME=<path_to_hadoop_install>
export HCAT_HOME=<path_to_hcat_install>
-PIG_CLASSPATH=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:$HCAT_HOME/share/hcatalog/lib/
-hive-metastore-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libthrift-0.7.0.jar:$HCAT_HOME/
-share/hcatalog/lib/hive-exec-0.8.1.jar:$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar:
-$HCAT_HOME/share/hcatalog/lib/jdo2-api-2.3-ec.jar:$HCAT_HOME/etc/hcatalog:$HADOOP_HOME/
-conf:$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar
+export
PIG_CLASSPATH=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:$HIVE_HOME/lib/hive-metastore-0.9.0.jar:
+$HIVE_HOME/lib/libthrift-0.7.0.jar:$HIVE_HOME/lib/hive-exec-0.9.0.jar:$HIVE_HOME/lib/libfb303-0.7.0.jar:
+$HIVE_HOME/lib/jdo2-api-2.3-ec.jar:$HIVE_HOME/conf:$HADOOP_HOME/conf:$HIVE_HOME/lib/slf4j-api-1.6.1.jar
+
export PIG_OPTS=-Dhive.metastore.uris=thrift://<hostname>:<port>
-<path_to_pig_install>/bin/pig
-Dpig.additional.jars=$HCAT_HOME/share/hcatalog/
-hcatalog-0.4.0.jar:$HCAT_HOME/share/hcatalog/lib/hive-metastore-0.8.1.jar:$HCAT_HOME/
-share/hcatalog/lib/libthrift-0.7.0.jar:$HCAT_HOME/share/hcatalog/lib/hive-exec-0.8.1.jar:
-$HCAT_HOME/share/hcatalog/lib/libfb303-0.7.0.jar:$HCAT_HOME/share/hcatalog/lib/jdo2-
-api-2.3-ec.jar:$HCAT_HOME/etc/hcatalog:$HCAT_HOME/share/hcatalog/lib/slf4j-api-1.6.1.jar
- <script.pig>
+<path_to_pig_install>/bin/pig
-Dpig.additional.jars=$HCAT_HOME/share/hcatalog/hcatalog-0.4.0.jar:
+$HIVE_HOME/lib/hive-metastore-0.9.0.jar:$HIVE_HOME/lib/libthrift-0.7.0.jar:$HIVE_HOME/lib/hive-exec-0.9.0.jar:
+$HIVE_HOME/lib/libfb303-0.7.0.jar:$HIVE_HOME/lib/jdo2-api-2.3-ec.jar:$HIVE_HOME/lib/slf4j-api-1.6.1.jar
<script.pig>
</source>
<p><strong>Authentication</strong></p>
