Author: virag
Date: Thu Feb 7 22:58:50 2013
New Revision: 1443765
URL: http://svn.apache.org/r1443765
Log:
Porting 1194, 1193, 1172 to hcat-intre from trunk
Modified:
oozie/branches/hcat-intre/bin/test-patch-20-tests
oozie/branches/hcat-intre/docs/src/site/twiki/WorkflowFunctionalSpec.twiki
oozie/branches/hcat-intre/pom.xml
oozie/branches/hcat-intre/release-log.txt
Modified: oozie/branches/hcat-intre/bin/test-patch-20-tests
URL:
http://svn.apache.org/viewvc/oozie/branches/hcat-intre/bin/test-patch-20-tests?rev=1443765&r1=1443764&r2=1443765&view=diff
==============================================================================
--- oozie/branches/hcat-intre/bin/test-patch-20-tests (original)
+++ oozie/branches/hcat-intre/bin/test-patch-20-tests Thu Feb 7 22:58:50 2013
@@ -91,15 +91,6 @@ case $OP in
-Dmaven.test.error.ignore=true -fae -Doozie.test.waitfor.ratio=3 \
-Dtest.timeout=7200 | tee ${TEMPDIR}/${TASKNAME}.out >> $STDOUT
exitCode=${PIPESTATUS[0]}
- if [[ ! "${MVNPASSTHRU}" =~ "-Dtest=" || ("${MVNPASSTHRU}" =~
"TestHiveActionExecutor" || "${MVNPASSTHRU}" =~ "TestHiveMain") ]] ; then
- # we need to do this 2nd run because Pig 0.9 and Hive 0.9 require
different
- # versions of antlr. Once we move to Pig 0.10 then we don't need this.
- mvn test -Dtest=TestHiveActionExecutor,TestHiveMain ${MVNPASSTHRU} \
- -PtestHive -Dmaven.test.failure.ignore=true
-Dmaven.test.error.ignore=true \
- -Doozie.test.waitfor.ratio=3 -Dtest.timeout=7200 \
- | tee -a ${TEMPDIR}/${TASKNAME}.out >> $STDOUT
- exitCode=`expr $exitCode + ${PIPESTATUS[0]}`
- fi
echo "$exitCode" > ${TEMPDIR}/${TASKNAME}.exitCode
;;
report)
Modified:
oozie/branches/hcat-intre/docs/src/site/twiki/WorkflowFunctionalSpec.twiki
URL:
http://svn.apache.org/viewvc/oozie/branches/hcat-intre/docs/src/site/twiki/WorkflowFunctionalSpec.twiki?rev=1443765&r1=1443764&r2=1443765&view=diff
==============================================================================
--- oozie/branches/hcat-intre/docs/src/site/twiki/WorkflowFunctionalSpec.twiki
(original)
+++ oozie/branches/hcat-intre/docs/src/site/twiki/WorkflowFunctionalSpec.twiki
Thu Feb 7 22:58:50 2013
@@ -1332,6 +1332,15 @@ The =capture-output= element can be used
EL-functions. This needs to be written out as a java properties format file.
The filename is obtained via a System
property specified by the constant
=JavaMainMapper.OOZIE_JAVA_MAIN_CAPTURE_OUTPUT_FILE=
+*IMPORTANT:* In order for a Java action to succeed on a secure cluster, it
must propagate the Hadoop delegation token like in the
+following code snippet (this is benign on non-secure clusters):
+<verbatim>
+// propagate delegation related props from launcher job to MR job
+if (System.getenv("HADOOP_TOKEN_FILE_LOCATION") != null) {
+ jobConf.set("mapreduce.job.credentials.binary",
System.getenv("HADOOP_TOKEN_FILE_LOCATION"));
+}
+</verbatim>
+
*IMPORTANT:* Because the Java application is run from within a Map-Reduce job,
from Hadoop 0.20. onwards a queue must
be assigned to it. The queue name must be specified as a configuration
property.
Modified: oozie/branches/hcat-intre/pom.xml
URL:
http://svn.apache.org/viewvc/oozie/branches/hcat-intre/pom.xml?rev=1443765&r1=1443764&r2=1443765&view=diff
==============================================================================
--- oozie/branches/hcat-intre/pom.xml (original)
+++ oozie/branches/hcat-intre/pom.xml Thu Feb 7 22:58:50 2013
@@ -621,7 +621,7 @@
<dependency>
<groupId>org.python</groupId>
<artifactId>jython</artifactId>
- <version>2.5.0</version>
+ <version>2.5.3</version>
</dependency>
<dependency>
Modified: oozie/branches/hcat-intre/release-log.txt
URL:
http://svn.apache.org/viewvc/oozie/branches/hcat-intre/release-log.txt?rev=1443765&r1=1443764&r2=1443765&view=diff
==============================================================================
--- oozie/branches/hcat-intre/release-log.txt (original)
+++ oozie/branches/hcat-intre/release-log.txt Thu Feb 7 22:58:50 2013
@@ -1,10 +1,19 @@
+
-- Oozie 3.4.0 release (trunk - unreleased)
+OOZIE-809 MySQL TEXT columns should be MEDIUMTEXT (rkanter via tucu)
+OOZIE-669 Deprecate oozie-start.sh, oozie-stop.sh & oozie-run.sh scripts
(rkanter via tucu)
+
+-- Oozie 3.2.0 release
+
OOZIE-1196 HCat EL functions for database and table should be modified (mona)
OOZIE-1210 Rework uri handling for Prepare actions and jms server mapping
(rohini via virag)
OOZIE-1179 coord action in WAITING when no definition of dataset in coord job
xml (mona)
OOZIE-1188 Typo in documentation for using login server example (rkanter)
OOZIE-1177 HostnameFilter should only catch UnknownHostException, not
Exception (rkanter)
+OOZIE-1194 test-patch shouldn't run the testHive profile because it not longer
exists (rkanter)
+OOZIE-1193 upgrade jython to 2.5.3 for Pig in Oozie due to jython 2.5.0 legal
issues (bowenzhangusa via rkanter)
+OOZIE-1172 Add documentation on how to get Java actions to authenticate
properly on Kerberos-enabled clusters (rkanter)
OOZIE-945 BundleSubmitXCommand.submit() doesn't properly remove comments
(jaoki via rkanter)
OOZIE-1171 HostnameFilter should handle hostname resolution failures and
continue processing (tucu via rkanter)
OOZIE-1166 Print a more helpful message when ProxyUserService is configured
wrong (rkanter)
@@ -93,18 +102,14 @@ OOZIE-1016 Tests that use junit assert o
OOZIE-1017 Add test to make sure old version of Xerces isn't being used
(rkanter via tucu)
OOZIE-949 Allow the user to set 'mapred.job.name' (jrkinley via tucu)
OOZIE-1009 Documentation pages should use default ports for Oozie/JT/NN (tucu)
-OOZIE-669 Deprecate oozie-start.sh, oozie-stop.sh & oozie-run.sh scripts
(rkanter via tucu)
-OOZIE-1005 Tests from OOZIE-994 use wrong condition in waitFor (rkanter via
virag)
OOZIE-992 Add overall status to test-patch messages and add some color-coding
for negative results (tucu)
OOZIE-1003 TestOozieCLI.testSubmitDoAs() should disable anonymous request
(tucu)
OOZIE-1004 Oozie client needs to bundle slf4j JARs (tucu)
OOZIE-1000 Remove Yahoo branding from docs, tests, etc (rkanter via virag)
OOZIE-999 XLogStreamer requires log4j.appender.oozie.layout.ConversionPattern
to contain a "-" (dash) or streaming logs to web UI and CLI don't work (rkanter
via virag)
-OOZIE-994 ActionCheckXCommand does not handle failures properly (rkanter via
virag)
OOZIE-998 test-patch doesn't allow lines that are exactly 132 characters
(rkanter via tucu)
OOZIE-739 a coord action fails because the uri points to a namenode that is
not in whitelist. the E0901 error shows in the oozie.log, but not written to
the database (mona,mbattisha via virag)
OOZIE-987 Fix minor bug in one of the uber jar tests (rkanter via tucu)
-OOZIE-809 MySQL TEXT columns should be MEDIUMTEXT (rkanter via tucu)
OOZIE-988 Improve verification of TestJavaActionExecutor.testLibFileArchives
(rkanter via tucu)
OOZIE-973 Allow Oozie to run against Hadoop trunk branch (rkanter via tucu)
OOZIE-984 Allow EL Functions in Coordinator timeout (rkanter via tucu)
@@ -140,6 +145,8 @@ OOZIE-1058 ACL modify-job should not be
OOZIE-1052 HadoopAccessorService.createFileSystem throws exception in
map-reduce action, failing workflow (egashira via mohammad)
OOZIE-976 add workflowgenerator into distro tarball (egashira via tucu)
OOZIE-993 Hadoop 23 doesn't accept user defined jobtracker (virag)
+OOZIE-1005 Tests from OOZIE-994 use wrong condition in waitFor (rkanter via
virag)
+OOZIE-994 ActionCheckXCommand does not handle failures properly (rkanter via
virag)
OOZIE-1013 Build failing as the license header comment is appearing before xml
declaration in some files (virag)
OOZIE-1007 Add license headers to all files don't have them (egashira via
tucu)
OOZIE-1006 Oozie fails to add required dependency for Hadoop 3.0.2 (venkatesh
via virag)
