Author: gates
Date: Mon Apr 30 22:13:56 2012
New Revision: 1332447
URL: http://svn.apache.org/viewvc?rev=1332447&view=rev
Log:
HCATALOG-395 Hcat 0.4 last minute doc fixes
Removed:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/rpminstall.xml
Modified:
incubator/hcatalog/trunk/CHANGES.txt
incubator/hcatalog/trunk/RELEASE_NOTES.txt
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml
Modified: incubator/hcatalog/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/CHANGES.txt?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/CHANGES.txt (original)
+++ incubator/hcatalog/trunk/CHANGES.txt Mon Apr 30 22:13:56 2012
@@ -122,6 +122,8 @@ Release 0.4.0 - Unreleased
OPTIMIZATIONS
BUG FIXES
+ HCAT-395 Hcat 0.4 last minute doc fixes (gates)
+
HCAT-382 NPE in pig when a binary field is null (rohini vi avandana)
HCAT-386 e2e tests should respect JAVA_HOME when it's set (gates)
Modified: incubator/hcatalog/trunk/RELEASE_NOTES.txt
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/RELEASE_NOTES.txt?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/RELEASE_NOTES.txt (original)
+++ incubator/hcatalog/trunk/RELEASE_NOTES.txt Mon Apr 30 22:13:56 2012
@@ -2,8 +2,13 @@ These notes are for HCatalog 0.4.0 relea
Highlights
==========
-
-This is the initial relase of Apache HCatalog. It provides read and write
capability for Pig and Hadoop, and read capability for Hive.
+
+HCatalog is a table management and storage management layer for Hadoop that
+enables users with different data processing tools â Pig, MapReduce, and
Hive,
+to easily share data on the grid. HCatalogâs table abstraction presents users
+with a relational view of data in the Hadoop distributed file system (HDFS)
+and ensures that users need not worry about where or in what format their data
+is stored â RCFile format, text files, sequence files.
System Requirements
===================
@@ -13,41 +18,57 @@ System Requirements
2. Ant build tool, version 1.8 or higher: http://ant.apache.org - to build
source only
3. This release is compatible with Hadoop 1.0.1.
-4. This release is compatible with Pig 0.8.1 and Pig 0.9.1 or 0.9.2.
+4. This release is compatible with Pig 0.8.1, Pig 0.9.1, and 0.9.2.
5. This release is compatible with Hive 0.8.1.
-6. This release is compatible with HBase 0.92.0. See Notes below for more
- information on HBase.
Trying the Release
==================
1. Download hcatalog-src-0.4.0-incubating.tar.gz
-2. Unpack the file: tar -xzvpf hcatalog-src-0.4.0-incubating.tar.gz
-3. Move into the installation directory: cd hcatalog-0.4.0-incubating
-4. Run "umask 0022 && ant jar test -Dhcatalog.version=0.4.0" to run unit tests.
-5. Run ant tar -Dforrest.home=/path/to/forrest/install -Dhcatalog.version=0.4.0
- to build installable tarball.
-6. cd build
-7. Move hcatalog-0.4.0.tar.gz to somewhere you have write permissions (e.g.
/home/me/hcat-insall)
-8. cd to your tar-ball location (e.g. cd /home/me/hcat-install)
-9. Untar hcatalog-0.4.0.tar.gz: tar -xvzpf hcatalog-0.4.0.tar.gz
-10. Move into hcatalog-0.4.0
-11. Install the hcatalog server by running
share/hcatalog/scripts/hcat_server_install.sh
- You may find instructions in share/doc/hcatalog/install.html useful
-12. If you are upgrading from HCatalog 0.2.0 you will need to upgrade your
- metastore. The upgrade script can be found in server installation at
-
share/hcatalog/hive/external/metastore/scripts/upgrade/mysql/upgrade-0.7.0-to-0.8.0.mysql.sql
-13. Export HADOOP_HOME and HADOOP_CONF_DIR to appropriate values.
-14. Run share/hcatalog/scripts/hcat_server_start.sh to start the hcatalog
server.
-15. To use the command line interface use bin/hcat
-16. To use with Hadoop MapReduce jobs, use the HCatInputFormat and
- HCatOutputFormat classes.
-17. To use with Pig, use the HCatLoader and HCatStorer classes.
+2. Follow the directions at
+ http://incubator.apache.org/hcatalog/docs/r0.4.0/install.html
+3. If you are upgrading from HCatalog 0.2.0 you will need to upgrade your
+ metastore. The upgrade script can be found in server installation at
+
share/hcatalog/hive/external/metastore/scripts/upgrade/mysql/upgrade-0.7.0-to-0.8.0.mysql.sql
+ This should be done after you install the server and before you start it.
+
+
Relevant Documentation
======================
See http://incubator.apache.org/hcatalog/docs/r0.4.0
These notes are for HCatalog 0.4.0 release.
+Changes Since Last Release
+==========================
+HCatalog 0.3 was not released. HCatalog 0.2 was the last release of HCatalog.
+Major changes since the last release include:
+ - Full support for reading from and writing to Hive.
+ - Support for deeply nested maps, arrays, and structs.
+ - Switch from StorageDrivers to SerDes. See "Backward Incompatibilities"
+ below.
+ - Addition of JSonSerDe to support reading and writing JSON data.
+ - Rather than releasing rpms from HCatalog, we rely on the rpms provided by
+ Apache Bigtop.
+ - The HCatalog binary distribution no longer includes Apache Hive. We now
+ require that Hive first be installed.
+ - The HCatalog source distribution no longer includes Apache Hive source.
+ It now pulls the required jars via maven.
+
+
+For a full list of changes see CHANGES.txt located in the same directory as
this file.
+
+Backward Incompatibilities
+==========================
+- HCatalog no longer supports its own StorageDriver classes for data
+ (de)serialization. Instead it uses Hive's SerDe classes.
+- Rather than releasing rpms from HCatalog, we rely on the rpms provided by
+ Apache Bigtop.
+- The HCatalog binary distribution no longer includes Apache Hive. We now
+ require that Hive first be installed.
+- The HCatalog source distribution no longer includes Apache Hive source.
+ It now pulls the required jars via maven.
+
+
Notes
=====
-HBase integration with HCatalog is experimental not yet ready for production
use.
+HBase integration with HCatalog is experimental and not yet ready for
production use.
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
---
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
(original)
+++
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/install.xml
Mon Apr 30 22:13:56 2012
@@ -126,6 +126,16 @@
purposes of these instructions we will refer to this machine as
<em>hcatsvr.acme.com</em>.</p>
+ <p>If you have not already done so, install Hive 0.9 on this machine. You
+ can use the
+ <a href="http://hive.apache.org/releases.html";>binary distributions</a>
+ provided by Hive or rpms available from
+ <a href="http://incubator.apache.org/bigtop/";>Apache Bigtop</a>. If you
use
+ the Apache Hive binary distribution, select a directory, henceforth
+ referred to as <code>hive_home</code>, and untar the distribution there.
+ If you use the rpms, <code>hive_home</code> will be
+ <code>/usr/lib/hive</code>.</p>
+
<p>Install the MySQL Java connector libraries on <em>hcatsvr.acme.com</em>.
You can obtain these from
<a href="http://www.mysql.com/downloads/connector/j/5.1.html";>MySQL's
@@ -234,15 +244,6 @@
</tr>
</table>
- <p>A more potent script exists in the form of
src/packages/hcat-configure.sh
- which can configure the hive-site.xml to conform to the changes mentioned
- above. It has predefined values for the most of the above mentioned
fields
- except for the ConnectionPassword and keytabs. It is capable of taking
- those fields too as parameters in the command line. Just run it once
- without parameters to see a full description of the usage of the script.
- Users looking to automate the hcat installation should look to leverage
- this script.
- </p>
<p>You can now procede to starting the server.</p>
</section>
@@ -271,7 +272,7 @@
<title>Stopping the Server</title>
<p>To stop the HCatalog server, change directories to the <em>root</em>
- directory and invoking <code>sbin/hcat_server.sh stop</code></p>
+ directory and invoking <code>HIVE_HOME=</code><em>hive_home</em><code>
sbin/hcat_server.sh stop</code></p>
</section>
Modified:
incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml
URL:
http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml?rev=1332447&r1=1332446&r2=1332447&view=diff
==============================================================================
--- incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml
(original)
+++ incubator/hcatalog/trunk/src/docs/src/documentation/content/xdocs/site.xml
Mon Apr 30 22:13:56 2012
@@ -41,7 +41,6 @@ See http://forrest.apache.org/docs/linki
<docs label="HCatalog">
<index label="Overview" href="index.html" />
<index label="Installation From Tarball" href="install.html" />
- <index label="RPM Installation" href="rpminstall.html" />
<index label="Load & Store Interfaces" href="loadstore.html" />
<index label="Input & Output Interfaces " href="inputoutput.html" />
<index label="Command Line Interface " href="cli.html" />
