Author: szita Date: Fri Jun 2 08:29:36 2017 New Revision: 1797327 URL: http://svn.apache.org/viewvc?rev=1797327&view=rev Log: Updating release notes and version numbers for Pig 0.17 release
Modified: pig/branches/branch-0.17/RELEASE_NOTES.txt pig/branches/branch-0.17/build.xml pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml Modified: pig/branches/branch-0.17/RELEASE_NOTES.txt URL: http://svn.apache.org/viewvc/pig/branches/branch-0.17/RELEASE_NOTES.txt?rev=1797327&r1=1797326&r2=1797327&view=diff ============================================================================== --- pig/branches/branch-0.17/RELEASE_NOTES.txt (original) +++ pig/branches/branch-0.17/RELEASE_NOTES.txt Fri Jun 2 08:29:36 2017 @@ -1,26 +1,28 @@ -These notes are for Pig 0.3.0 release. +These notes are for Pig 0.17.0 release. Highlights ========== -The main focus of this release is multiquery support that allows to optimize -multiple queries within the same script that share a computation. +The highlights of this release includes Pig on Spark System Requirements =================== -1. Java 1.6.x or newer, preferably from Sun. Set JAVA_HOME to the root of your +1. Java 1.7.x or newer, preferably from Sun. Set JAVA_HOME to the root of your Java installation 2. Ant build tool: http://ant.apache.org - to build source only -3. Cygwin: http://www.cygwin.com/ - to run under Windows -4. This release is compatible with Hadoop 0.18.x releases +3. Run under Unix and Windows +4. This release is compatible with Hadoop 2.5+ releases. Note Hadoop 1.X is not + supported anymore. +5. For using Spark execution engine Spark 1.6.x is required. (Spark 2 support is + likely to come in the next release) Trying the Release ================== -1. Download pig-0.3.0.tar.gz -2. Unpack the file: tar -xzvf pig-0.3.0.tar.gz -3. Move into the installation directory: cd pig-0.3.0 +1. Download pig-0.17.0.tar.gz +2. Unpack the file: tar -xzvf pig-0.17.0.tar.gz +3. Move into the installation directory: cd pig-0.17.0 4. To run pig without Hadoop cluster, execute the command below. This will take you into an interactive shell called grunt that allows you to navigate the local file system and execute Pig commands against the local files @@ -36,7 +38,6 @@ export PIG_CLASSPATH=/hadoop/conf 7. To run unit tests run ant test 8. To build jar file with available user defined functions run commands below. -This currently only works with Java 1.6.x. cd contrib/piggybank/java ant 9. To build the tutorial: @@ -47,9 +48,6 @@ This currently only works with Java 1.6. Relevant Documentation ====================== -Pig Language Manual(including Grunt commands): -http://wiki.apache.org/pig-data/attachments/FrontPage/attachments/plrm.htm -UDF Manual: http://wiki.apache.org/pig/UDFManual -Piggy Bank: http://wiki.apache.org/pig/PiggyBank -Pig Tutorial: http://wiki.apache.org/pig/PigTutorial -Pig Eclipse Plugin (PigPen): http://wiki.apache.org/pig/PigPen +Pig Documentation: http://pig.apache.org/docs/r0.17.0/ +Pig Wiki: https://cwiki.apache.org/confluence/display/PIG/Index +Pig Tutorial: https://cwiki.apache.org/confluence/display/PIG/PigTutorial \ No newline at end of file Modified: pig/branches/branch-0.17/build.xml URL: http://svn.apache.org/viewvc/pig/branches/branch-0.17/build.xml?rev=1797327&r1=1797326&r2=1797327&view=diff ============================================================================== --- pig/branches/branch-0.17/build.xml (original) +++ pig/branches/branch-0.17/build.xml Fri Jun 2 08:29:36 2017 @@ -42,7 +42,7 @@ <property name="pig.version.suffix" value="-SNAPSHOT" /> <property name="version" value="${pig.version}${pig.version.suffix}" /> <property name="final.name" value="${name}-${version}" /> - <property name="year" value="2007-2016" /> + <property name="year" value="2007-2017" /> <!-- source properties --> <property name="lib.dir" value="${basedir}/lib" /> Modified: pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml URL: http://svn.apache.org/viewvc/pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml?rev=1797327&r1=1797326&r2=1797327&view=diff ============================================================================== --- pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml (original) +++ pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/perf.xml Fri Jun 2 08:29:36 2017 @@ -42,7 +42,7 @@ </section> <section id="container-reuse"> <title>Tez session/container reuse</title> - <p>One downside of MapReduce is the startup cost for a job is very high. That hurts the performance especially for small job. Tez alleviate the problem by using session and container reuse, so it is not necessary to start an application master for every job, and start a JVM for every task. By default, session/container reuse is on and we usually shall not turn it off. JVM reuse might cause some side effect if static variable is used since static variable might live across different jobs. So if static variable is used in EvalFunc/LoadFunc/StoreFunc, be sure to implement a cleanup function and register with <a href="http://pig.apache.org/docs/r0.16.0/api/org/apache/pig/JVMReuseManager.html">JVMReuseManager</a>.</p> + <p>One downside of MapReduce is the startup cost for a job is very high. That hurts the performance especially for small job. Tez alleviate the problem by using session and container reuse, so it is not necessary to start an application master for every job, and start a JVM for every task. By default, session/container reuse is on and we usually shall not turn it off. JVM reuse might cause some side effect if static variable is used since static variable might live across different jobs. So if static variable is used in EvalFunc/LoadFunc/StoreFunc, be sure to implement a cleanup function and register with <a href="http://pig.apache.org/docs/r0.17.0/api/org/apache/pig/JVMReuseManager.html">JVMReuseManager</a>.</p> </section> <section id="auto-parallelism"> <title>Automatic parallelism</title> Modified: pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml URL: http://svn.apache.org/viewvc/pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml?rev=1797327&r1=1797326&r2=1797327&view=diff ============================================================================== --- pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml (original) +++ pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/start.xml Fri Jun 2 08:29:36 2017 @@ -567,16 +567,16 @@ However, in a production environment you <li>Make sure the JAVA_HOME environment variable is set the root of your Java installation.</li> <li>Make sure your PATH includes bin/pig (this enables you to run the tutorials using the "pig" command). <source> -$ export PATH=/<my-path-to-pig>/pig-0.16.0/bin:$PATH +$ export PATH=/<my-path-to-pig>/pig-0.17.0/bin:$PATH </source> </li> <li>Set the PIG_HOME environment variable: <source> -$ export PIG_HOME=/<my-path-to-pig>/pig-0.16.0 +$ export PIG_HOME=/<my-path-to-pig>/pig-0.17.0 </source></li> <li>Create the pigtutorial.tar.gz file: <ul> - <li>Move to the Pig tutorial directory (.../pig-0.16.0/tutorial).</li> + <li>Move to the Pig tutorial directory (.../pig-0.17.0/tutorial).</li> <li>Run the "ant" command from the tutorial directory. This will create the pigtutorial.tar.gz file. </li> </ul> Modified: pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml URL: http://svn.apache.org/viewvc/pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml?rev=1797327&r1=1797326&r2=1797327&view=diff ============================================================================== --- pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml (original) +++ pig/branches/branch-0.17/src/docs/src/documentation/content/xdocs/test.xml Fri Jun 2 08:29:36 2017 @@ -548,7 +548,7 @@ job_201004271216_12714 1 1 3 3 3 12 12 1 <p>Several new public classes make it easier for external tools such as Oozie to integrate with Pig statistics. </p> -<p>The Pig statistics are available here: <a href="http://pig.apache.org/docs/r0.16.0/api/">http://pig.apache.org/docs/r0.16.0/api/</a></p> +<p>The Pig statistics are available here: <a href="http://pig.apache.org/docs/r0.17.0/api/">http://pig.apache.org/docs/r0.17.0/api/</a></p> <p id="stats-classes">The stats classes are in the package: org.apache.pig.tools.pigstats</p> <ul>