Author: szita
Date: Fri Jun 2 08:29:36 2017
New Revision: 1797327
URL: http://svn.apache.org/viewvc?rev=1797327&view=rev
Log:
Updating release notes and version numbers for Pig 0.17 release
Modified:
pig/branches/branch-0.17/RELEASE_NOTES.txt
pig/branches/branch-0.17/build.xml
pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml
pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml
pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml
Modified: pig/branches/branch-0.17/RELEASE_NOTES.txt
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.17/RELEASE_NOTES.txt?rev=1797327&r1=1797326&r2=1797327&view=diff
==============================================================================
--- pig/branches/branch-0.17/RELEASE_NOTES.txt (original)
+++ pig/branches/branch-0.17/RELEASE_NOTES.txt Fri Jun 2 08:29:36 2017
@@ -1,26 +1,28 @@
-These notes are for Pig 0.3.0 release.
+These notes are for Pig 0.17.0 release.
Highlights
==========
-The main focus of this release is multiquery support that allows to optimize
-multiple queries within the same script that share a computation.
+The highlights of this release includes Pig on Spark
System Requirements
===================
-1. Java 1.6.x or newer, preferably from Sun. Set JAVA_HOME to the root of your
+1. Java 1.7.x or newer, preferably from Sun. Set JAVA_HOME to the root of your
Java installation
2. Ant build tool: http://ant.apache.org - to build source only
-3. Cygwin: http://www.cygwin.com/ - to run under Windows
-4. This release is compatible with Hadoop 0.18.x releases
+3. Run under Unix and Windows
+4. This release is compatible with Hadoop 2.5+ releases. Note Hadoop 1.X is not
+ supported anymore.
+5. For using Spark execution engine Spark 1.6.x is required. (Spark 2 support
is
+ likely to come in the next release)
Trying the Release
==================
-1. Download pig-0.3.0.tar.gz
-2. Unpack the file: tar -xzvf pig-0.3.0.tar.gz
-3. Move into the installation directory: cd pig-0.3.0
+1. Download pig-0.17.0.tar.gz
+2. Unpack the file: tar -xzvf pig-0.17.0.tar.gz
+3. Move into the installation directory: cd pig-0.17.0
4. To run pig without Hadoop cluster, execute the command below. This will
take you into an interactive shell called grunt that allows you to navigate
the local file system and execute Pig commands against the local files
@@ -36,7 +38,6 @@ export PIG_CLASSPATH=/hadoop/conf
7. To run unit tests run
ant test
8. To build jar file with available user defined functions run commands below.
-This currently only works with Java 1.6.x.
cd contrib/piggybank/java
ant
9. To build the tutorial:
@@ -47,9 +48,6 @@ This currently only works with Java 1.6.
Relevant Documentation
======================
-Pig Language Manual(including Grunt commands):
-http://wiki.apache.org/pig-data/attachments/FrontPage/attachments/plrm.htm
-UDF Manual: http://wiki.apache.org/pig/UDFManual
-Piggy Bank: http://wiki.apache.org/pig/PiggyBank
-Pig Tutorial: http://wiki.apache.org/pig/PigTutorial
-Pig Eclipse Plugin (PigPen): http://wiki.apache.org/pig/PigPen
+Pig Documentation: http://pig.apache.org/docs/r0.17.0/
+Pig Wiki: https://cwiki.apache.org/confluence/display/PIG/Index
+Pig Tutorial: https://cwiki.apache.org/confluence/display/PIG/PigTutorial
\ No newline at end of file
Modified: pig/branches/branch-0.17/build.xml
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.17/build.xml?rev=1797327&r1=1797326&r2=1797327&view=diff
==============================================================================
--- pig/branches/branch-0.17/build.xml (original)
+++ pig/branches/branch-0.17/build.xml Fri Jun 2 08:29:36 2017
@@ -42,7 +42,7 @@
<property name="pig.version.suffix" value="-SNAPSHOT" />
<property name="version" value="${pig.version}${pig.version.suffix}" />
<property name="final.name" value="${name}-${version}" />
- <property name="year" value="2007-2016" />
+ <property name="year" value="2007-2017" />
<!-- source properties -->
<property name="lib.dir" value="${basedir}/lib" />
Modified:
pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml?rev=1797327&r1=1797326&r2=1797327&view=diff
==============================================================================
--- pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml
(original)
+++ pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml
Fri Jun 2 08:29:36 2017
@@ -42,7 +42,7 @@
</section>
<section id="container-reuse">
<title>Tez session/container reuse</title>
- <p>One downside of MapReduce is the startup cost for a job is very high.
That hurts the performance especially for small job. Tez alleviate the problem
by using session and container reuse, so it is not necessary to start an
application master for every job, and start a JVM for every task. By default,
session/container reuse is on and we usually shall not turn it off. JVM reuse
might cause some side effect if static variable is used since static variable
might live across different jobs. So if static variable is used in
EvalFunc/LoadFunc/StoreFunc, be sure to implement a cleanup function and
register with <a
href="http://pig.apache.org/docs/r0.16.0/api/org/apache/pig/JVMReuseManager.html">JVMReuseManager</a>.</p>
+ <p>One downside of MapReduce is the startup cost for a job is very high.
That hurts the performance especially for small job. Tez alleviate the problem
by using session and container reuse, so it is not necessary to start an
application master for every job, and start a JVM for every task. By default,
session/container reuse is on and we usually shall not turn it off. JVM reuse
might cause some side effect if static variable is used since static variable
might live across different jobs. So if static variable is used in
EvalFunc/LoadFunc/StoreFunc, be sure to implement a cleanup function and
register with <a
href="http://pig.apache.org/docs/r0.17.0/api/org/apache/pig/JVMReuseManager.html">JVMReuseManager</a>.</p>
</section>
<section id="auto-parallelism">
<title>Automatic parallelism</title>
Modified:
pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml?rev=1797327&r1=1797326&r2=1797327&view=diff
==============================================================================
--- pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml
(original)
+++ pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml
Fri Jun 2 08:29:36 2017
@@ -567,16 +567,16 @@ However, in a production environment you
<li>Make sure the JAVA_HOME environment variable is set the root of your Java
installation.</li>
<li>Make sure your PATH includes bin/pig (this enables you to run the
tutorials using the "pig" command).
<source>
-$ export PATH=/<my-path-to-pig>/pig-0.16.0/bin:$PATH
+$ export PATH=/<my-path-to-pig>/pig-0.17.0/bin:$PATH
</source>
</li>
<li>Set the PIG_HOME environment variable:
<source>
-$ export PIG_HOME=/<my-path-to-pig>/pig-0.16.0
+$ export PIG_HOME=/<my-path-to-pig>/pig-0.17.0
</source></li>
<li>Create the pigtutorial.tar.gz file:
<ul>
- <li>Move to the Pig tutorial directory (.../pig-0.16.0/tutorial).</li>
+ <li>Move to the Pig tutorial directory (.../pig-0.17.0/tutorial).</li>
<li>Run the "ant" command from the tutorial directory. This will create
the pigtutorial.tar.gz file.
</li>
</ul>
Modified:
pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml
URL:
http://svn.apache.org/viewvc/pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml?rev=1797327&r1=1797326&r2=1797327&view=diff
==============================================================================
--- pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml
(original)
+++ pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml
Fri Jun 2 08:29:36 2017
@@ -548,7 +548,7 @@ job_201004271216_12714 1 1 3 3 3 12 12 1
<p>Several new public classes make it easier for external tools such as Oozie
to integrate with Pig statistics. </p>
-<p>The Pig statistics are available here: <a
href="http://pig.apache.org/docs/r0.16.0/api/">http://pig.apache.org/docs/r0.16.0/api/</a></p>
+<p>The Pig statistics are available here: <a
href="http://pig.apache.org/docs/r0.17.0/api/">http://pig.apache.org/docs/r0.17.0/api/</a></p>
<p id="stats-classes">The stats classes are in the package:
org.apache.pig.tools.pigstats</p>
<ul>