Failed: OOZIE-2339 PreCommit Build #455

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-2339
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/455/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.84 MB...]
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
-1 COMPILE
+1 HEAD compiles
+1 patch compiles
-1 the patch seems to introduce 11 new javac warning(s)
-1 There are [120] new bugs found below threshold in total that must be fixed.
 +1 There are no new bugs found in [docs].
 -1 There are [114] new bugs found below threshold in [jobs/jobs-api] that must 
be fixed, listing only the first [5] ones.
 You can find the FindBugs diff here (look for the red and orange ones): 
jobs/jobs-api/findbugs-new.html
 The top [5] most important FindBugs errors are:
 At GraphVisualization.java:[line 102]: 
java/io/File.init(Ljava/lang/String;Ljava/lang/String;)V reads a file 
whose location might be specified by user input
 At GraphVisualization.java:[line 108]: 
java/io/File.init(Ljava/lang/String;Ljava/lang/String;)V reads a file 
whose location might be specified by user input
 At NodeBuilderBaseImpl.java:[line 247]: The use of java.lang.Math.random() is 
predictable
 At SimpleWorkflowFactory.java:[line 54]: Dead store to happyPath in 
org.apache.oozie.jobs.api.factory.SimpleWorkflowFactory.create()
 At SimpleWorkflowFactory.java:[line 60]: Dead store to sadPath in 
org.apache.oozie.jobs.api.factory.SimpleWorkflowFactory.create()
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [examples].
 -1 There are [5] new bugs found below threshold in [client] that must be fixed.
 You can find the FindBugs diff here (look for the red and orange ones): 
client/findbugs-new.html
 The most important FindBugs errors are:
 Dereferenced at ApiJarFactory.java:[line 86]: Possible null pointer 
dereference in org.apache.oozie.cli.ApiJarFactory.addWorkflowJarEntry(File, 
JarOutputStream) due to return value of called method
 java/io/FileOutputStream.init(Ljava/lang/String;)V writes to a file 
whose location might be specified by user input: Known null at 
ApiJarFactory.java:[line 86]
 At ApiJarFactory.java:[line 67]: At ApiJarFactory.java:[line 67]
 At ApiJarLoader.java:[line 52]: 
org.apache.oozie.cli.ApiJarLoader.loadAndGenerate() may fail to close stream
 At OozieCLI.java:[line 1396]: Found reliance on default encoding in 
org.apache.oozie.cli.OozieCLI.checkApiJar(XOozieClient, CommandLine, boolean): 
String.getBytes()
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [server].
 -1 There are [1] new bugs found below threshold in [core] that must be fixed.
 You can find the FindBugs diff here (look for the red and orange ones): 
core/findbugs-new.html
 The most important FindBugs errors are:
 At V1JobsServlet.java:[line 163]: Found reliance on default encoding in 
org.apache.oozie.servlet.V1JobsServlet.checkAndWriteApplicationXMLToHDFS(String,
 Configuration): new java.io.OutputStreamWriter(OutputStream)
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2824
Tests failed: 5
Tests errors: 9

The patch failed the following testcases:

testSubmit(org.apache.oozie.servlet.TestV1JobsServlet)
testSubmitMapReduce2(org.apache.oozie.client.TestOozieCLI)
testSubmitMapReduce(org.apache.oozie.client.TestOozieCLI)
testSubmitPig(org.apache.oozie.client.TestOozieCLI)
testJobDryrun(org.apache.oozie.client.TestOozieCLI)

Tests failing with errors:
testSubmitMR(org.apache.oozie.client.TestWorkflowXClient)
testSubmitSqoop(org.apache.oozie.client.TestWorkflowXClient)
testSubmitPig(org.apache.oozie.client.TestWorkflowXClient)
testSubmitHive(org.apache.oozie.client.TestWorkflowXClient)
testValidateJar(org.apache.oozie.client.TestOozieCLI)
testRunJarWithoutAppPath(org.apache.oozie.client.TestOozieCLI)
testSubmitJarWithoutAppPath(org.apache.oozie.client.TestOozieCLI)
testSubmitJar(org.apache.oozie.client.TestOozieCLI)
testRunJar(org.apache.oozie.client.TestOozieCLI)

Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
TestHiveActionExecutor#testHiveAction
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds 

[jira] [Commented] (OOZIE-2339) Provide an API for writing jobs based on the XSD schemas

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407429#comment-16407429
 ] 

Hadoop QA commented on OOZIE-2339:
--


Testing JIRA OOZIE-2339

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:red}-1{color} the patch contains 12 line(s) with tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:red}-1{color} the patch contains 37 line(s) longer than 132 
characters
.{color:green}+1{color} the patch adds/modifies 97 testcase(s)
{color:red}-1 RAT{color}
.{color:red}-1{color} the patch seems to introduce 1 new RAT warning(s)
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 11 new javac warning(s)
{color:red}-1{color} There are [120] new bugs found below threshold in total 
that must be fixed.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:red}-1{color} There are [114] new bugs found below threshold in 
[jobs/jobs-api] that must be fixed, listing only the first [5] ones.
. You can find the FindBugs diff here (look for the red and orange ones): 
jobs/jobs-api/findbugs-new.html
. The top [5] most important FindBugs errors are:
. At GraphVisualization.java:[line 102]: 
java/io/File.init(Ljava/lang/String;Ljava/lang/String;)V reads a file 
whose location might be specified by user input
. At GraphVisualization.java:[line 108]: 
java/io/File.init(Ljava/lang/String;Ljava/lang/String;)V reads a file 
whose location might be specified by user input
. At NodeBuilderBaseImpl.java:[line 247]: The use of java.lang.Math.random() is 
predictable
. At SimpleWorkflowFactory.java:[line 54]: Dead store to happyPath in 
org.apache.oozie.jobs.api.factory.SimpleWorkflowFactory.create()
. At SimpleWorkflowFactory.java:[line 60]: Dead store to sadPath in 
org.apache.oozie.jobs.api.factory.SimpleWorkflowFactory.create()
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:red}-1{color} There are [5] new bugs found below threshold in [client] 
that must be fixed.
. You can find the FindBugs diff here (look for the red and orange ones): 
client/findbugs-new.html
. The most important FindBugs errors are:
. Dereferenced at ApiJarFactory.java:[line 86]: Possible null pointer 
dereference in org.apache.oozie.cli.ApiJarFactory.addWorkflowJarEntry(File, 
JarOutputStream) due to return value of called method
. java/io/FileOutputStream.init(Ljava/lang/String;)V writes to a file 
whose location might be specified by user input: Known null at 
ApiJarFactory.java:[line 86]
. At ApiJarFactory.java:[line 67]: At ApiJarFactory.java:[line 67]
. At ApiJarLoader.java:[line 52]: 
org.apache.oozie.cli.ApiJarLoader.loadAndGenerate() may fail to close stream
. At OozieCLI.java:[line 1396]: Found reliance on default encoding in 
org.apache.oozie.cli.OozieCLI.checkApiJar(XOozieClient, CommandLine, boolean): 
String.getBytes()
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:red}-1{color} There are [1] new bugs found below threshold in [core] 
that must be fixed.
. You can find the FindBugs diff here (look for the red and orange ones): 
core/findbugs-new.html
. The most important FindBugs errors are:
. At V1JobsServlet.java:[line 163]: Found reliance on default encoding in 
org.apache.oozie.servlet.V1JobsServlet.checkAndWriteApplicationXMLToHDFS(String,
 Configuration): new java.io.OutputStreamWriter(OutputStream)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files

[jira] [Commented] (OOZIE-2339) Provide an API for writing jobs based on the XSD schemas

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407353#comment-16407353
 ] 

Hadoop QA commented on OOZIE-2339:
--

PreCommit-OOZIE-Build started


> Provide an API for writing jobs based on the XSD schemas
> 
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside an {{oozie-jobs-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython REPL to make it easy to experiment
> ** create documentation about usage
> ** can read {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** can convert between XSD versions
> ** support XSD change on the fly (within REPL)
> ** support HDFS reads / writes
> ** support dry run on an Oozie server to perform checks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3056) Implement new mechanism to specify ShareLibs for workflow actions

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407311#comment-16407311
 ] 

Hadoop QA commented on OOZIE-3056:
--


Testing JIRA OOZIE-3056

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:red}-1{color} the patch contains 2 line(s) longer than 132 
characters
.{color:green}+1{color} the patch adds/modifies 2 testcase(s)
{color:red}-1 RAT{color}
.{color:red}-1{color} the patch seems to introduce 2 new RAT warning(s)
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2098
.Tests failed: 2
.Tests errors: 1

.The patch failed the following testcases:

testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerService)

.Tests failing with errors:
testConnectionRetry(org.apache.oozie.service.TestJMSAccessorService)

.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionInputCheckXCommandNonUTC>TestCoordActionInputCheckXCommand#testNone
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/454/



> Implement new mechanism to specify ShareLibs for workflow actions
> -
>
> Key: OOZIE-3056
> URL: https://issues.apache.org/jira/browse/OOZIE-3056
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Critical
> Fix For: 5.0.0
>
> Attachments: OOZIE-3056.001.patch
>
>
> OOZIE-2687 introduces the {{launcher}} element for workflows:
> {code}
> 
> 1024
> 1
> -Dsome.property=true -XX:+RandomJVMSwitch
> key=value
> root.oozie
> spark,hive
> 
> {code}
> The purpose of this ticket is to discuss and implement new mechanism for 
> handling ShareLib. 
> {{addActionShareLib}} in {{JavaActionExecutor}} should adjusted. Regarding 
> "precedence order":
> if global and an action level {{launcher}} and {{configuration}} (e.g. 
> {{oozie.action.sharelib.for.#ACTIONTYPE#}}) tries to override the sharelib 
> the following should apply:
> {quote} 
> config properties defined in an 

Failed: OOZIE-3056 PreCommit Build #454

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-3056
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/454/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.69 MB...]
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [server].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2242 bytes
[TRACE] Full summary file size is 1314 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-3056

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
-1 the patch contains 2 line(s) longer than 132 characters
+1 the patch adds/modifies 2 testcase(s)
-1 RAT
-1 the patch seems to introduce 2 new RAT warning(s)
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2098
Tests failed: 2
Tests errors: 1

The patch failed the following testcases:

testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerService)

Tests failing with errors:
testConnectionRetry(org.apache.oozie.service.TestJMSAccessorService)

Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionInputCheckXCommandNonUTC>TestCoordActionInputCheckXCommand#testNone
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/454/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13102211/comment/16407311","id":"16407311","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot 
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
 QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA 
OOZIE-3056\n\nCleaning local git 
workspace\n\n\n\n{color:green}+1 
PATCH_APPLIES{color}\n{color:green}+1 CLEAN{color}\n{color:red}-1 
RAW_PATCH_ANALYSIS{color}\n.{color:green}+1{color} the patch does not 
introduce any @author tags\n.{color:green}+1{color} the patch does not 
introduce any tabs\n.

[jira] [Commented] (OOZIE-3056) Implement new mechanism to specify ShareLibs for workflow actions

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407259#comment-16407259
 ] 

Hadoop QA commented on OOZIE-3056:
--

PreCommit-OOZIE-Build started


> Implement new mechanism to specify ShareLibs for workflow actions
> -
>
> Key: OOZIE-3056
> URL: https://issues.apache.org/jira/browse/OOZIE-3056
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Critical
> Fix For: 5.0.0
>
> Attachments: OOZIE-3056.001.patch
>
>
> OOZIE-2687 introduces the {{launcher}} element for workflows:
> {code}
> 
> 1024
> 1
> -Dsome.property=true -XX:+RandomJVMSwitch
> key=value
> root.oozie
> spark,hive
> 
> {code}
> The purpose of this ticket is to discuss and implement new mechanism for 
> handling ShareLib. 
> {{addActionShareLib}} in {{JavaActionExecutor}} should adjusted. Regarding 
> "precedence order":
> if global and an action level {{launcher}} and {{configuration}} (e.g. 
> {{oozie.action.sharelib.for.#ACTIONTYPE#}}) tries to override the sharelib 
> the following should apply:
> {quote} 
> config properties defined in an action's  have priority over 
> an action's , which has priority over the global section's 
>  and , which has priority over the action defaults in 
> oozie-site, and so on.
> {quote}
> Here we have multiple choices how to handle sharelib:
> - Alternative 1: override sharelib in a way that is consistent with current 
> way of handling Oozie configuration settings.
> - Alternative 2: make sharelib additive
> -- For example, if there is a global {{launcher}} with {{sharelib}} element 
> in a workflow that includes multiple ShareLibs (e.g. A,B), and  
> {{oozie.action.sharelib.for.#ACTIONTYPE#}} is also specified for an action's 
> configuration (e.g. C,D), then we take the union of the specified entities 
> (A,B,C,D would be included). 
> -- It's inconsistent with everything else



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 64029: OOZIE-2339 Provide an API for writing jobs based on the XSD schemas

[András Piros via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64029/
---

(Updated March 20, 2018, 9:58 p.m.)


Review request for oozie, Attila Sasvari, Peter Cseh, and Robert Kanter.


Changes
---

Addressing first round review comments.


Repository: oozie-git


Description
---

OOZIE-2339 Provide an API for writing jobs based on the XSD schemas


Diffs (updated)
-

  .gitignore a4285a0d77ac2e4e8fc4afbfa21bf9fd287b3e4d 
  client/pom.xml 31cd43fa5311484f92cc8d33b4fc7b4cf13d66c4 
  client/src/main/java/org/apache/oozie/cli/ApiJarFactory.java PRE-CREATION 
  client/src/main/java/org/apache/oozie/cli/ApiJarLoader.java PRE-CREATION 
  client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
4abc7502c0c9d8b59ded2baaed30c407ad073008 
  client/src/main/java/org/apache/oozie/cli/WorkflowFactoryCompiler.java 
PRE-CREATION 
  client/src/main/java/org/apache/oozie/client/OozieClient.java 
4c8175628ba5ee346d97ad984532662032b88acc 
  core/src/main/java/org/apache/oozie/BaseLocalOozieClient.java 
38fb006980c0acb582b4f91175be1ced8a1afa79 
  core/src/main/java/org/apache/oozie/local/LocalOozie.java 
9ab646cd53223d903e387eb92aa103a7b6577d0f 
  core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
e1bd3cf61aabfa4311881b2944fc9f10ffe9145d 
  core/src/main/java/org/apache/oozie/servlet/BaseJobsServlet.java 
d4b08711223356c8d4f58a3391b6b87efa0a2b73 
  core/src/main/java/org/apache/oozie/servlet/ServletUtilities.java 
9cdd915c02a3e34ad211cf6cced2e64f3a1196a0 
  core/src/main/java/org/apache/oozie/servlet/V0JobsServlet.java 
ff50f3d121d8af7d607124424915e1bf30ffb109 
  core/src/main/java/org/apache/oozie/servlet/V1JobsServlet.java 
c1ca65fd2f8bf0f3e5c618dddcba3bf52eaf5420 
  core/src/main/java/org/apache/oozie/servlet/V2ValidateServlet.java 
b86fa6ace43aead115302aad3ae15368b15f1923 
  core/src/main/resources/oozie-default.xml 
966dd29b20ffb4a627418d62403c0cec166dd147 
  core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
3395cc25d27805444ba0b6463357c4ecff977ac1 
  core/src/test/java/org/apache/oozie/test/MiniOozieTestCase.java 
12ede028655f2a30613a9f802e48cd3a27af6ed9 
  docs/src/site/twiki/DG_CommandLineTool.twiki 
a94201ded8451cc725b40e9f73182ecaa52be88a 
  docs/src/site/twiki/DG_JobsAPI.twiki PRE-CREATION 
  jobs/jobs-api/pom.xml PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/Condition.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/GraphVisualization.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/ModifyOnce.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ActionAttributes.java
 PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ActionAttributesBuilder.java
 PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/Builder.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ChFSBase.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ChFSBaseBuilder.java
 PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/Chgrp.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ChgrpBuilder.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/Chmod.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ChmodBuilder.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/Delete.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/DistcpAction.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/DistcpActionBuilder.java
 PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/EmailAction.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/EmailActionBuilder.java
 PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ErrorHandler.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/FSAction.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/FSActionBuilder.java
 PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/HasAttributes.java 
PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/Hive2Action.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/Hive2ActionBuilder.java
 PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/HiveAction.java 
PRE-CREATION 
  
jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/HiveActionBuilder.java
 PRE-CREATION 
  jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/JavaAction.java 
PRE-CREATION 
  

Re: Review Request 64029: OOZIE-2339 Provide an API for writing jobs based on the XSD schemas

[András Piros via Review Board]

> On Jan. 11, 2018, 1:53 a.m., Robert Kanter wrote:
> > client/src/main/java/org/apache/oozie/cli/ApiJarFactory.java
> > Lines 68-73 (patched)
> > 
> >
> > Oozie's copyStream already has a method that does this.  If you 
> > don't want to pull in oozie-core, there should be some similar methods in 
> > Commons-IO

`IOUtils.copy(InputStream, OutputStream)` does the trick.


> On Jan. 11, 2018, 1:53 a.m., Robert Kanter wrote:
> > jobs/jobs-api/src/main/java/org/apache/oozie/jobs/api/action/ActionAttributes.java
> > Lines 28 (patched)
> > 
> >
> > Is this something we're going to have to manually maintain going 
> > forward if the XML schema changes?  If so, and/or if there are other cases 
> > of that, we should have some comments or developer docs or something 
> > explaining what to do and when.  Otherwise, I can easily see this not 
> > getting updated when someone updates the schema.
> > 
> > Even better would be to somehow have a unit test that fails if these 
> > get out of sync.

Actually, the binding between XSD attributes and Java attributes does not 
happen automatically, but is taken care of by Dozer framework. Please see 
`dozer_config.xml` and all the classes inside 
`org.apache.oozie.jobs.api.mapping` within `jobs-api`. So yes, we need to have 
a developer docs stating what else to update when there is a schema change / 
extension.

On the other hand, XSDs are versioned, and Dozer mapping files are bound to 
latest, v1.0 XSDs. That said, mapping etc. to the existing latest XSDs is 
tested within `org.apache.oozie.jobs.api.mapping` inside `jobs-api`, and 
`org.apache.oozie.jobs.client.jaxb.TestJAXBWorkflow` inside `jobs-client`.


> On Jan. 11, 2018, 1:53 a.m., Robert Kanter wrote:
> > pom.xml
> > Lines 131 (patched)
> > 
> >
> > I wonder if we should call this something else.  "jobs" isn't super 
> > clear, and we already have a number of things called jobs (e.g. Oozie Jobs 
> > (workflows, coords, etc), Hadoop Jobs (apps), etc).  Maybe "jobs-api"?  
> > Though that's not much different.  I'm not sure of a good name.

The problem is here we should have two artifacts - `jobs-api` for the API 
itself, can be referenced by `client`, while `jobs-client` is a sample client 
using `jobs-api` consisting of examples and integration tests. The two are both 
children of `jobs` right now, that is a `pom` parent of both.

We want in the future to have not only workflow, but coordinator, and bundle 
jobs also generated by `jobs-api`. I don't find a better name for the parent, 
but clients will reference and use `jobs-api`, hence, not so important IMO.


- András


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64029/#review195200
---


On Jan. 8, 2018, 10:31 p.m., András Piros wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/64029/
> ---
> 
> (Updated Jan. 8, 2018, 10:31 p.m.)
> 
> 
> Review request for oozie, Attila Sasvari, Peter Cseh, and Robert Kanter.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2339 Provide an API for writing jobs based on the XSD schemas
> 
> 
> Diffs
> -
> 
>   .gitignore a4285a0d77ac2e4e8fc4afbfa21bf9fd287b3e4d 
>   client/pom.xml 3b67d1286499337d61c269f9dbd1ff65ba23b903 
>   client/src/main/java/org/apache/oozie/cli/ApiJarFactory.java PRE-CREATION 
>   client/src/main/java/org/apache/oozie/cli/ApiJarLoader.java PRE-CREATION 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 4abc7502c0c9d8b59ded2baaed30c407ad073008 
>   client/src/main/java/org/apache/oozie/cli/WorkflowFactoryCompiler.java 
> PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> 7e41ef89c784882c26f4af0da0110101fa1a61a0 
>   core/src/main/java/org/apache/oozie/BaseLocalOozieClient.java 
> 38fb006980c0acb582b4f91175be1ced8a1afa79 
>   core/src/main/java/org/apache/oozie/local/LocalOozie.java 
> 9ab646cd53223d903e387eb92aa103a7b6577d0f 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> e1bd3cf61aabfa4311881b2944fc9f10ffe9145d 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobsServlet.java 
> d4b08711223356c8d4f58a3391b6b87efa0a2b73 
>   core/src/main/java/org/apache/oozie/servlet/ServletUtilities.java 
> 9cdd915c02a3e34ad211cf6cced2e64f3a1196a0 
>   core/src/main/java/org/apache/oozie/servlet/V0JobsServlet.java 
> ff50f3d121d8af7d607124424915e1bf30ffb109 
>   core/src/main/java/org/apache/oozie/servlet/V1JobsServlet.java 
> 

[jira] [Updated] (OOZIE-2339) Provide an API for writing jobs based on the XSD schemas

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-2339:

Attachment: OOZIE-2339.011.patch

> Provide an API for writing jobs based on the XSD schemas
> 
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside an {{oozie-jobs-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython REPL to make it easy to experiment
> ** create documentation about usage
> ** can read {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** can convert between XSD versions
> ** support XSD change on the fly (within REPL)
> ** support HDFS reads / writes
> ** support dry run on an Oozie server to perform checks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3056) Implement new mechanism to specify ShareLibs for workflow actions

[Peter Cseh (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-3056:
--
Priority: Critical  (was: Major)

> Implement new mechanism to specify ShareLibs for workflow actions
> -
>
> Key: OOZIE-3056
> URL: https://issues.apache.org/jira/browse/OOZIE-3056
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Critical
> Fix For: 5.0.0
>
> Attachments: OOZIE-3056.001.patch
>
>
> OOZIE-2687 introduces the {{launcher}} element for workflows:
> {code}
> 
> 1024
> 1
> -Dsome.property=true -XX:+RandomJVMSwitch
> key=value
> root.oozie
> spark,hive
> 
> {code}
> The purpose of this ticket is to discuss and implement new mechanism for 
> handling ShareLib. 
> {{addActionShareLib}} in {{JavaActionExecutor}} should adjusted. Regarding 
> "precedence order":
> if global and an action level {{launcher}} and {{configuration}} (e.g. 
> {{oozie.action.sharelib.for.#ACTIONTYPE#}}) tries to override the sharelib 
> the following should apply:
> {quote} 
> config properties defined in an action's  have priority over 
> an action's , which has priority over the global section's 
>  and , which has priority over the action defaults in 
> oozie-site, and so on.
> {quote}
> Here we have multiple choices how to handle sharelib:
> - Alternative 1: override sharelib in a way that is consistent with current 
> way of handling Oozie configuration settings.
> - Alternative 2: make sharelib additive
> -- For example, if there is a global {{launcher}} with {{sharelib}} element 
> in a workflow that includes multiple ShareLibs (e.g. A,B), and  
> {{oozie.action.sharelib.for.#ACTIONTYPE#}} is also specified for an action's 
> configuration (e.g. C,D), then we take the union of the specified entities 
> (A,B,C,D would be included). 
> -- It's inconsistent with everything else



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Comment Edited] (OOZIE-3056) Implement new mechanism to specify ShareLibs for workflow actions

[Peter Cseh (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16407023#comment-16407023
 ] 

Peter Cseh edited comment on OOZIE-3056 at 3/20/18 9:05 PM:


Attaching first version. I went with Alternative 1), we're overwriting sharelib 
values with the one that has bigger priority.


was (Author: gezapeti):
Attaching first version.

> Implement new mechanism to specify ShareLibs for workflow actions
> -
>
> Key: OOZIE-3056
> URL: https://issues.apache.org/jira/browse/OOZIE-3056
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-3056.001.patch
>
>
> OOZIE-2687 introduces the {{launcher}} element for workflows:
> {code}
> 
> 1024
> 1
> -Dsome.property=true -XX:+RandomJVMSwitch
> key=value
> root.oozie
> spark,hive
> 
> {code}
> The purpose of this ticket is to discuss and implement new mechanism for 
> handling ShareLib. 
> {{addActionShareLib}} in {{JavaActionExecutor}} should adjusted. Regarding 
> "precedence order":
> if global and an action level {{launcher}} and {{configuration}} (e.g. 
> {{oozie.action.sharelib.for.#ACTIONTYPE#}}) tries to override the sharelib 
> the following should apply:
> {quote} 
> config properties defined in an action's  have priority over 
> an action's , which has priority over the global section's 
>  and , which has priority over the action defaults in 
> oozie-site, and so on.
> {quote}
> Here we have multiple choices how to handle sharelib:
> - Alternative 1: override sharelib in a way that is consistent with current 
> way of handling Oozie configuration settings.
> - Alternative 2: make sharelib additive
> -- For example, if there is a global {{launcher}} with {{sharelib}} element 
> in a workflow that includes multiple ShareLibs (e.g. A,B), and  
> {{oozie.action.sharelib.for.#ACTIONTYPE#}} is also specified for an action's 
> configuration (e.g. C,D), then we take the union of the specified entities 
> (A,B,C,D would be included). 
> -- It's inconsistent with everything else



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 66181: OOZIE-3056 Implement new mechanism to specify ShareLibs for workflow actions

[Peter Cseh via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66181/
---

Review request for oozie, András Piros and Attila Sasvari.


Bugs: OOZIE-3056
https://issues.apache.org/jira/browse/OOZIE-3056


Repository: oozie-git


Description
---

Refactored out Sharelib name resolution from JavaAE as an additional step to 
pick that giant class to pieces.
Added logic to process the  properties added in  sections.


Diffs
-

  core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 
122dfd02e17456b9aab924504faee790813fb6a1 
  core/src/main/java/org/apache/oozie/action/hadoop/SharelibResolver.java 
PRE-CREATION 
  core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java 
b55a3cd7f8064cd898edc686891c9f6ebb118c42 
  core/src/test/java/org/apache/oozie/action/hadoop/TestSharelibResolver.java 
PRE-CREATION 


Diff: https://reviews.apache.org/r/66181/diff/1/


Testing
---

Added Junit tests to validate that 
1) the configs are propagating and overwriting each other correctly when an xml 
is formatted
2) the configs are resolved in the correct order for sharelib names


Thanks,

Peter Cseh

[jira] [Updated] (OOZIE-3056) Implement new mechanism to specify ShareLibs for workflow actions

[Peter Cseh (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-3056:
--
Attachment: OOZIE-3056.001.patch

> Implement new mechanism to specify ShareLibs for workflow actions
> -
>
> Key: OOZIE-3056
> URL: https://issues.apache.org/jira/browse/OOZIE-3056
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Peter Cseh
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-3056.001.patch
>
>
> OOZIE-2687 introduces the {{launcher}} element for workflows:
> {code}
> 
> 1024
> 1
> -Dsome.property=true -XX:+RandomJVMSwitch
> key=value
> root.oozie
> spark,hive
> 
> {code}
> The purpose of this ticket is to discuss and implement new mechanism for 
> handling ShareLib. 
> {{addActionShareLib}} in {{JavaActionExecutor}} should adjusted. Regarding 
> "precedence order":
> if global and an action level {{launcher}} and {{configuration}} (e.g. 
> {{oozie.action.sharelib.for.#ACTIONTYPE#}}) tries to override the sharelib 
> the following should apply:
> {quote} 
> config properties defined in an action's  have priority over 
> an action's , which has priority over the global section's 
>  and , which has priority over the action defaults in 
> oozie-site, and so on.
> {quote}
> Here we have multiple choices how to handle sharelib:
> - Alternative 1: override sharelib in a way that is consistent with current 
> way of handling Oozie configuration settings.
> - Alternative 2: make sharelib additive
> -- For example, if there is a global {{launcher}} with {{sharelib}} element 
> in a workflow that includes multiple ShareLibs (e.g. A,B), and  
> {{oozie.action.sharelib.for.#ACTIONTYPE#}} is also specified for an action's 
> configuration (e.g. C,D), then we take the union of the specified entities 
> (A,B,C,D would be included). 
> -- It's inconsistent with everything else



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406876#comment-16406876
 ] 

Hadoop QA commented on OOZIE-2600:
--


Testing JIRA OOZIE-2600

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2096
.Tests failed: 1
.Tests errors: 0

.The patch failed the following testcases:

testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)

.Tests failing with errors:


.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/453/



> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch, 
> OOZIE-2600.003.patch, OOZIE-2600.004.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-2600 PreCommit Build #453

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-2600
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/453/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.71 MB...]
[DEBUG] There are no new bugs found in [docs].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [server].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2253 bytes
[TRACE] Full summary file size is 1314 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-2600

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2096
Tests failed: 1
Tests errors: 0

The patch failed the following testcases:

testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)

Tests failing with errors:


Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/453/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/12985913/comment/16406876","id":"16406876","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot 
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
 QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA 
OOZIE-2600\n\nCleaning local git 
workspace\n\n\n\n{color:green}+1 
PATCH_APPLIES{color}\n{color:green}+1 CLEAN{color}\n{color:red}-1 
RAW_PATCH_ANALYSIS{color}\n.{color:green}+1{color} the patch does not 
introduce any @author tags\n.{color:green}+1{color} the patch does not 
introduce any tabs\n.{color:green}+1{color} the patch does not introduce 
any trailing spaces\n. 

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406730#comment-16406730
 ] 

Hadoop QA commented on OOZIE-2600:
--

PreCommit-OOZIE-Build started


> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch, 
> OOZIE-2600.003.patch, OOZIE-2600.004.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406711#comment-16406711
 ] 

Hadoop QA commented on OOZIE-2600:
--


Testing JIRA OOZIE-2600

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2096
.Tests failed: 1
.Tests errors: 0

.The patch failed the following testcases:

testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)

.Tests failing with errors:


.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/452/



> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch, 
> OOZIE-2600.003.patch, OOZIE-2600.004.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-2600 PreCommit Build #452

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-2600
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/452/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.71 MB...]
[DEBUG] There are no new bugs found in [docs].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [server].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2253 bytes
[TRACE] Full summary file size is 1314 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-2600

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2096
Tests failed: 1
Tests errors: 0

The patch failed the following testcases:

testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)

Tests failing with errors:


Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/452/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/12985913/comment/16406711","id":"16406711","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot 
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
 QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA 
OOZIE-2600\n\nCleaning local git 
workspace\n\n\n\n{color:green}+1 
PATCH_APPLIES{color}\n{color:green}+1 CLEAN{color}\n{color:red}-1 
RAW_PATCH_ANALYSIS{color}\n.{color:green}+1{color} the patch does not 
introduce any @author tags\n.{color:green}+1{color} the patch does not 
introduce any tabs\n.{color:green}+1{color} the patch does not introduce 
any trailing spaces\n. 

[jira] [Updated] (OOZIE-2600) OYA: Update Documentation

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-2600:

Attachment: OOZIE-2600.004.patch

> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch, 
> OOZIE-2600.003.patch, OOZIE-2600.004.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 66149: OOZIE-2600 OYA: Update Documentation

[András Piros via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66149/
---

(Updated March 20, 2018, 5:06 p.m.)


Review request for oozie, Peter Cseh and Robert Kanter.


Repository: oozie-git


Description
---

OOZIE-2600 OYA: Update Documentation


Diffs (updated)
-

  docs/src/site/twiki/AG_Install.twiki 15042151f11666517f328f700cca022375bad8ae 
  docs/src/site/twiki/DG_DistCpActionExtension.twiki 
260cd2578e7a4d78067512461fac72f47d32e7cb 
  docs/src/site/twiki/DG_Examples.twiki 
87cac48bcb7bfb2c6628ad33429a036d0d2b676e 
  docs/src/site/twiki/DG_Hive2ActionExtension.twiki 
094307fd81e57f51c25e6c6e30a2c7564a2bba76 
  docs/src/site/twiki/DG_HiveActionExtension.twiki 
a0d7b578ba0dd30fa8cd8c0b8a6c796c20e78c93 
  docs/src/site/twiki/DG_ShellActionExtension.twiki 
493254a6f5d77eaa3dfa56ba39047e0847fa15ee 
  docs/src/site/twiki/DG_SparkActionExtension.twiki 
294e7dd566b8849742e42962ce164c71b9caaed9 
  docs/src/site/twiki/DG_SqoopActionExtension.twiki 
906ba5476f7628b3bf70dc3d6d5ef4a48418ea94 
  docs/src/site/twiki/DG_SshActionExtension.twiki 
c2e33c90c154df1e978e09c1534474a107191cd5 
  docs/src/site/twiki/ENG_MiniOozie.twiki 
2c397264e1d758bae0c0590289d329a82fa3fd8c 
  docs/src/site/twiki/WorkflowFunctionalSpec.twiki 
038c430d37887617070f2cb13dd0eba0962600d2 


Diff: https://reviews.apache.org/r/66149/diff/4/

Changes: https://reviews.apache.org/r/66149/diff/3-4/


Testing
---

This is a documentation-only task, hence no testing except for generating the 
documentation, and checking, is done:
```
mvn clean install -DskipTests -Denforcer.skip=true -Dcheckstyle.skip=true 
-Dfindbugs.skip=true -PgenerateDocs
```


Thanks,

András Piros

[jira] [Comment Edited] (OOZIE-3196) Authorization: restrict world readability by user

[Artem Ervits (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406625#comment-16406625
 ] 

Artem Ervits edited comment on OOZIE-3196 at 3/20/18 4:32 PM:
--

this is a wonderful idea, at the minimum, implementation should be internal to 
Oozie not (Sentry, Ranger) specific. There should be a property file with Oozie 
authorizations and provide an interface for external projects to tap into.

Do we want this for per workflow, per coordinator, per bundle, per action?

feedback I got from customers is that they want jobs to be more private, 
prevent user from seeing a workflow, see job.properties (passwords), job logs, 
etc.


was (Author: dbist13):
this is a wonderful idea, at the minimum, implementation should be internal to 
Oozie not (Sentry, Ranger) specific. There should be a property file with Oozie 
authorizations and provide an interface for external projects to tap into.

Do we want this for per workflow, per coordinator, per bundle, per action?

feedback I got from customers is that they want jobs to be more private, 
prevent user from seeing a workflow, see job.properties (passwords).

> Authorization: restrict world readability by user
> -
>
> Key: OOZIE-3196
> URL: https://issues.apache.org/jira/browse/OOZIE-3196
> Project: Oozie
>  Issue Type: New Feature
>  Components: bundle, coordinator, workflow
>Affects Versions: 5.0.0b1
>Reporter: Andras Piros
>Priority: Major
>
> The [*current authorization 
> model*|https://issues.apache.org/jira/browse/OOZIE-228] does not fit the 
> enterprise requirements as everything is readable and writable by everyone by 
> default.
> Write access can be restricted using authorization but restricting read 
> rights is only possible via Yarn ACLs and HDFS rights which still does not 
> prevent accessing the workflow, coordinator or bundle job’s configurations 
> for everyone.
> Improve authorization so it’s possible to configure read/write access for 
> workflows, coordinators, and bundles in a more granular way. Could involve 
> Sentry during implementation or create and design a new system that fits the 
> needs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3196) Authorization: restrict world readability by user

[Artem Ervits (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406625#comment-16406625
 ] 

Artem Ervits commented on OOZIE-3196:
-

this is a wonderful idea, at the minimum, implementation should be internal to 
Oozie not (Sentry, Ranger) specific. There should be a property file with Oozie 
authorizations and provide an interface for external projects to tap into.

Do we want this for per workflow, per coordinator, per bundle, per action?

feedback I got from customers is that they want jobs to be more private, 
prevent user from seeing a workflow, see job.properties (passwords).

> Authorization: restrict world readability by user
> -
>
> Key: OOZIE-3196
> URL: https://issues.apache.org/jira/browse/OOZIE-3196
> Project: Oozie
>  Issue Type: New Feature
>  Components: bundle, coordinator, workflow
>Affects Versions: 5.0.0b1
>Reporter: Andras Piros
>Priority: Major
>
> The [*current authorization 
> model*|https://issues.apache.org/jira/browse/OOZIE-228] does not fit the 
> enterprise requirements as everything is readable and writable by everyone by 
> default.
> Write access can be restricted using authorization but restricting read 
> rights is only possible via Yarn ACLs and HDFS rights which still does not 
> prevent accessing the workflow, coordinator or bundle job’s configurations 
> for everyone.
> Improve authorization so it’s possible to configure read/write access for 
> workflows, coordinators, and bundles in a more granular way. Could involve 
> Sentry during implementation or create and design a new system that fits the 
> needs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406495#comment-16406495
 ] 

Hadoop QA commented on OOZIE-2600:
--

PreCommit-OOZIE-Build started


> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch, 
> OOZIE-2600.003.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-3199 PreCommit Build #451

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-3199
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/451/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.71 MB...]
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [server].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2253 bytes
[TRACE] Full summary file size is 1314 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-3199

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2096
Tests failed: 1
Tests errors: 1

The patch failed the following testcases:

testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)

Tests failing with errors:
testNewUsingACLs(org.apache.oozie.util.TestZKUtilsWithSecurity)

Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
TestCoordMaterializeTriggerService#testCoordMaterializeTriggerService3
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/451/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13146513/comment/16406494","id":"16406494","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot 
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
 QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA 
OOZIE-3199\n\nCleaning local git 
workspace\n\n\n\n{color:green}+1 
PATCH_APPLIES{color}\n{color:green}+1 CLEAN{color}\n{color:red}-1 
RAW_PATCH_ANALYSIS{color}\n.{color:green}+1{color} the patch does not 
introduce any @author tags\n.{color:green}+1{color} the patch does not 
introduce any 

[jira] [Commented] (OOZIE-3199) Let system property restriction configurable

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406494#comment-16406494
 ] 

Hadoop QA commented on OOZIE-3199:
--


Testing JIRA OOZIE-3199

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2096
.Tests failed: 1
.Tests errors: 1

.The patch failed the following testcases:

testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)

.Tests failing with errors:
testNewUsingACLs(org.apache.oozie.util.TestZKUtilsWithSecurity)

.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
TestCoordMaterializeTriggerService#testCoordMaterializeTriggerService3
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/451/



> Let system property restriction configurable
> 
>
> Key: OOZIE-3199
> URL: https://issues.apache.org/jira/browse/OOZIE-3199
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.0.0, 4.3.1
>Reporter: Denes Bodo
>Assignee: Denes Bodo
>Priority: Major
> Attachments: OOZIE-3199-001.patch
>
>
> Currently Oozie restricts resolution of system properties by default. In some 
> cases that would be nice if as an administrator I could set a whitelist of 
> enabled system property names.
> Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 66149: OOZIE-2600 OYA: Update Documentation

[Peter Cseh via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66149/#review199552
---




docs/src/site/twiki/WorkflowFunctionalSpec.twiki
Line 8 (original), 8 (patched)


Please update the version here as well to 5.0


- Peter Cseh


On March 20, 2018, 2:48 p.m., András Piros wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66149/
> ---
> 
> (Updated March 20, 2018, 2:48 p.m.)
> 
> 
> Review request for oozie, Peter Cseh and Robert Kanter.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2600 OYA: Update Documentation
> 
> 
> Diffs
> -
> 
>   docs/src/site/twiki/AG_Install.twiki 
> 15042151f11666517f328f700cca022375bad8ae 
>   docs/src/site/twiki/DG_DistCpActionExtension.twiki 
> 260cd2578e7a4d78067512461fac72f47d32e7cb 
>   docs/src/site/twiki/DG_Examples.twiki 
> 87cac48bcb7bfb2c6628ad33429a036d0d2b676e 
>   docs/src/site/twiki/DG_Hive2ActionExtension.twiki 
> 094307fd81e57f51c25e6c6e30a2c7564a2bba76 
>   docs/src/site/twiki/DG_HiveActionExtension.twiki 
> a0d7b578ba0dd30fa8cd8c0b8a6c796c20e78c93 
>   docs/src/site/twiki/DG_ShellActionExtension.twiki 
> 493254a6f5d77eaa3dfa56ba39047e0847fa15ee 
>   docs/src/site/twiki/DG_SparkActionExtension.twiki 
> 294e7dd566b8849742e42962ce164c71b9caaed9 
>   docs/src/site/twiki/DG_SqoopActionExtension.twiki 
> 906ba5476f7628b3bf70dc3d6d5ef4a48418ea94 
>   docs/src/site/twiki/DG_SshActionExtension.twiki 
> c2e33c90c154df1e978e09c1534474a107191cd5 
>   docs/src/site/twiki/ENG_MiniOozie.twiki 
> 2c397264e1d758bae0c0590289d329a82fa3fd8c 
>   docs/src/site/twiki/WorkflowFunctionalSpec.twiki 
> 038c430d37887617070f2cb13dd0eba0962600d2 
> 
> 
> Diff: https://reviews.apache.org/r/66149/diff/3/
> 
> 
> Testing
> ---
> 
> This is a documentation-only task, hence no testing except for generating the 
> documentation, and checking, is done:
> ```
> mvn clean install -DskipTests -Denforcer.skip=true -Dcheckstyle.skip=true 
> -Dfindbugs.skip=true -PgenerateDocs
> ```
> 
> 
> Thanks,
> 
> András Piros
> 
>

Re: Review Request 66149: OOZIE-2600 OYA: Update Documentation

[András Piros via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66149/
---

(Updated March 20, 2018, 2:48 p.m.)


Review request for oozie, Peter Cseh and Robert Kanter.


Repository: oozie-git


Description
---

OOZIE-2600 OYA: Update Documentation


Diffs (updated)
-

  docs/src/site/twiki/AG_Install.twiki 15042151f11666517f328f700cca022375bad8ae 
  docs/src/site/twiki/DG_DistCpActionExtension.twiki 
260cd2578e7a4d78067512461fac72f47d32e7cb 
  docs/src/site/twiki/DG_Examples.twiki 
87cac48bcb7bfb2c6628ad33429a036d0d2b676e 
  docs/src/site/twiki/DG_Hive2ActionExtension.twiki 
094307fd81e57f51c25e6c6e30a2c7564a2bba76 
  docs/src/site/twiki/DG_HiveActionExtension.twiki 
a0d7b578ba0dd30fa8cd8c0b8a6c796c20e78c93 
  docs/src/site/twiki/DG_ShellActionExtension.twiki 
493254a6f5d77eaa3dfa56ba39047e0847fa15ee 
  docs/src/site/twiki/DG_SparkActionExtension.twiki 
294e7dd566b8849742e42962ce164c71b9caaed9 
  docs/src/site/twiki/DG_SqoopActionExtension.twiki 
906ba5476f7628b3bf70dc3d6d5ef4a48418ea94 
  docs/src/site/twiki/DG_SshActionExtension.twiki 
c2e33c90c154df1e978e09c1534474a107191cd5 
  docs/src/site/twiki/ENG_MiniOozie.twiki 
2c397264e1d758bae0c0590289d329a82fa3fd8c 
  docs/src/site/twiki/WorkflowFunctionalSpec.twiki 
038c430d37887617070f2cb13dd0eba0962600d2 


Diff: https://reviews.apache.org/r/66149/diff/3/

Changes: https://reviews.apache.org/r/66149/diff/2-3/


Testing
---

This is a documentation-only task, hence no testing except for generating the 
documentation, and checking, is done:
```
mvn clean install -DskipTests -Denforcer.skip=true -Dcheckstyle.skip=true 
-Dfindbugs.skip=true -PgenerateDocs
```


Thanks,

András Piros

[jira] [Updated] (OOZIE-2600) OYA: Update Documentation

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-2600:

Attachment: OOZIE-2600.003.patch

> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch, 
> OOZIE-2600.003.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3199) Let system property restriction configurable

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406319#comment-16406319
 ] 

Hadoop QA commented on OOZIE-3199:
--

PreCommit-OOZIE-Build started


> Let system property restriction configurable
> 
>
> Key: OOZIE-3199
> URL: https://issues.apache.org/jira/browse/OOZIE-3199
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.0.0, 4.3.1
>Reporter: Denes Bodo
>Assignee: Denes Bodo
>Priority: Major
> Attachments: OOZIE-3199-001.patch
>
>
> Currently Oozie restricts resolution of system properties by default. In some 
> cases that would be nice if as an administrator I could set a whitelist of 
> enabled system property names.
> Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406311#comment-16406311
 ] 

Hadoop QA commented on OOZIE-2600:
--


Testing JIRA OOZIE-2600

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:red}-1{color} the patch contains 1 line(s) with tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:red}-1{color} the patch contains 7 line(s) longer than 132 
characters
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2096
.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
TestHiveActionExecutor#testHiveAction
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/450/



> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-2600 PreCommit Build #450

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-2600
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/450/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.71 MB...]
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/hive].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/spark].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [client].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [examples].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [docs].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [server].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2252 bytes
[TRACE] Full summary file size is 1314 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-2600

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
-1 the patch contains 1 line(s) with tabs
+1 the patch does not introduce any trailing spaces
-1 the patch contains 7 line(s) longer than 132 characters
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
+1 TESTS
Tests run: 2096
Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
TestCoordActionsKillXCommand#testActionKillCommandActionNumbers
TestHiveActionExecutor#testHiveAction
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/450/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/12985913/comment/16406311","id":"16406311","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot 
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
 

[jira] [Updated] (OOZIE-3199) Let system property restriction configurable

[Denes Bodo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Denes Bodo updated OOZIE-3199:
--
Attachment: OOZIE-3199-001.patch

> Let system property restriction configurable
> 
>
> Key: OOZIE-3199
> URL: https://issues.apache.org/jira/browse/OOZIE-3199
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.0.0, 4.3.1
>Reporter: Denes Bodo
>Assignee: Denes Bodo
>Priority: Major
> Attachments: OOZIE-3199-001.patch
>
>
> Currently Oozie restricts resolution of system properties by default. In some 
> cases that would be nice if as an administrator I could set a whitelist of 
> enabled system property names.
> Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3199) Let system property restriction configurable

[Denes Bodo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Denes Bodo updated OOZIE-3199:
--
Attachment: OOZIE-3199-001.patch

> Let system property restriction configurable
> 
>
> Key: OOZIE-3199
> URL: https://issues.apache.org/jira/browse/OOZIE-3199
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.0.0, 4.3.1
>Reporter: Denes Bodo
>Assignee: Denes Bodo
>Priority: Major
>
> Currently Oozie restricts resolution of system properties by default. In some 
> cases that would be nice if as an administrator I could set a whitelist of 
> enabled system property names.
> Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3199) Let system property restriction configurable

[Denes Bodo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Denes Bodo updated OOZIE-3199:
--
Attachment: (was: OOZIE-3199-001.patch)

> Let system property restriction configurable
> 
>
> Key: OOZIE-3199
> URL: https://issues.apache.org/jira/browse/OOZIE-3199
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.0.0, 4.3.1
>Reporter: Denes Bodo
>Assignee: Denes Bodo
>Priority: Major
>
> Currently Oozie restricts resolution of system properties by default. In some 
> cases that would be nice if as an administrator I could set a whitelist of 
> enabled system property names.
> Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (OOZIE-3199) Let system property restriction configurable

[Denes Bodo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Denes Bodo reassigned OOZIE-3199:
-

Assignee: Denes Bodo

> Let system property restriction configurable
> 
>
> Key: OOZIE-3199
> URL: https://issues.apache.org/jira/browse/OOZIE-3199
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 5.0.0, 4.3.1
>Reporter: Denes Bodo
>Assignee: Denes Bodo
>Priority: Major
>
> Currently Oozie restricts resolution of system properties by default. In some 
> cases that would be nice if as an administrator I could set a whitelist of 
> enabled system property names.
> Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406197#comment-16406197
 ] 

Hadoop QA commented on OOZIE-2600:
--

PreCommit-OOZIE-Build started


> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2600) OYA: Update Documentation

[Andras Piros (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406188#comment-16406188
 ] 

Andras Piros commented on OOZIE-2600:
-

Addressing review comments.

> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-2600) OYA: Update Documentation

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-2600:

Attachment: OOZIE-2600.002.patch

> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
>  Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2600.001.patch, OOZIE-2600.002.patch
>
>
> Based on the work done in OOZIE-2896, document also the way how 
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters 
> function.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 66149: OOZIE-2600 OYA: Update Documentation

[András Piros via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66149/
---

(Updated March 20, 2018, 11:35 a.m.)


Review request for oozie, Peter Cseh and Robert Kanter.


Changes
---

Addressing review comments.


Repository: oozie-git


Description
---

OOZIE-2600 OYA: Update Documentation


Diffs (updated)
-

  docs/src/site/twiki/AG_Install.twiki 15042151f11666517f328f700cca022375bad8ae 
  docs/src/site/twiki/DG_DistCpActionExtension.twiki 
260cd2578e7a4d78067512461fac72f47d32e7cb 
  docs/src/site/twiki/DG_Examples.twiki 
87cac48bcb7bfb2c6628ad33429a036d0d2b676e 
  docs/src/site/twiki/DG_Hive2ActionExtension.twiki 
094307fd81e57f51c25e6c6e30a2c7564a2bba76 
  docs/src/site/twiki/DG_HiveActionExtension.twiki 
a0d7b578ba0dd30fa8cd8c0b8a6c796c20e78c93 
  docs/src/site/twiki/DG_ShellActionExtension.twiki 
493254a6f5d77eaa3dfa56ba39047e0847fa15ee 
  docs/src/site/twiki/DG_SparkActionExtension.twiki 
294e7dd566b8849742e42962ce164c71b9caaed9 
  docs/src/site/twiki/DG_SqoopActionExtension.twiki 
906ba5476f7628b3bf70dc3d6d5ef4a48418ea94 
  docs/src/site/twiki/DG_SshActionExtension.twiki 
c2e33c90c154df1e978e09c1534474a107191cd5 
  docs/src/site/twiki/ENG_MiniOozie.twiki 
2c397264e1d758bae0c0590289d329a82fa3fd8c 
  docs/src/site/twiki/WorkflowFunctionalSpec.twiki 
038c430d37887617070f2cb13dd0eba0962600d2 


Diff: https://reviews.apache.org/r/66149/diff/2/

Changes: https://reviews.apache.org/r/66149/diff/1-2/


Testing
---

This is a documentation-only task, hence no testing except for generating the 
documentation, and checking, is done:
```
mvn clean install -DskipTests -Denforcer.skip=true -Dcheckstyle.skip=true 
-Dfindbugs.skip=true -PgenerateDocs
```


Thanks,

András Piros

[jira] [Created] (OOZIE-3199) Let system property restriction configurable

[Denes Bodo (JIRA)]

Denes Bodo created OOZIE-3199:
-

 Summary: Let system property restriction configurable
 Key: OOZIE-3199
 URL: https://issues.apache.org/jira/browse/OOZIE-3199
 Project: Oozie
  Issue Type: Bug
  Components: core
Affects Versions: 4.3.1, 5.0.0
Reporter: Denes Bodo


Currently Oozie restricts resolution of system properties by default. In some 
cases that would be nice if as an administrator I could set a whitelist of 
enabled system property names.

Suggestion will be provided asap.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 66149: OOZIE-2600 OYA: Update Documentation

[Peter Cseh via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66149/#review199531
---




docs/src/site/twiki/AG_Install.twiki
Lines 307 (patched)


We should mention that it's on by default



docs/src/site/twiki/AG_Install.twiki
Lines 325-326 (patched)


We should mention that the list can be extended in oozie-site.xml and there 
are examples for this in oozie-default.xml



docs/src/site/twiki/AG_Install.twiki
Lines 329 (patched)


oozie.launcher.prepend, isn't it?
Also, we should mention the default value


- Peter Cseh


On March 19, 2018, 8:17 p.m., András Piros wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66149/
> ---
> 
> (Updated March 19, 2018, 8:17 p.m.)
> 
> 
> Review request for oozie, Peter Cseh and Robert Kanter.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2600 OYA: Update Documentation
> 
> 
> Diffs
> -
> 
>   docs/src/site/twiki/AG_Install.twiki 
> 15042151f11666517f328f700cca022375bad8ae 
>   docs/src/site/twiki/DG_DistCpActionExtension.twiki 
> 260cd2578e7a4d78067512461fac72f47d32e7cb 
>   docs/src/site/twiki/DG_Examples.twiki 
> 87cac48bcb7bfb2c6628ad33429a036d0d2b676e 
>   docs/src/site/twiki/DG_Hive2ActionExtension.twiki 
> 094307fd81e57f51c25e6c6e30a2c7564a2bba76 
>   docs/src/site/twiki/DG_HiveActionExtension.twiki 
> a0d7b578ba0dd30fa8cd8c0b8a6c796c20e78c93 
>   docs/src/site/twiki/DG_ShellActionExtension.twiki 
> 493254a6f5d77eaa3dfa56ba39047e0847fa15ee 
>   docs/src/site/twiki/DG_SparkActionExtension.twiki 
> 294e7dd566b8849742e42962ce164c71b9caaed9 
>   docs/src/site/twiki/DG_SqoopActionExtension.twiki 
> 906ba5476f7628b3bf70dc3d6d5ef4a48418ea94 
>   docs/src/site/twiki/DG_SshActionExtension.twiki 
> c2e33c90c154df1e978e09c1534474a107191cd5 
>   docs/src/site/twiki/ENG_MiniOozie.twiki 
> 2c397264e1d758bae0c0590289d329a82fa3fd8c 
>   docs/src/site/twiki/WorkflowFunctionalSpec.twiki 
> 038c430d37887617070f2cb13dd0eba0962600d2 
> 
> 
> Diff: https://reviews.apache.org/r/66149/diff/1/
> 
> 
> Testing
> ---
> 
> This is a documentation-only task, hence no testing except for generating the 
> documentation, and checking, is done:
> ```
> mvn clean install -DskipTests -Denforcer.skip=true -Dcheckstyle.skip=true 
> -Dfindbugs.skip=true -PgenerateDocs
> ```
> 
> 
> Thanks,
> 
> András Piros
> 
>

[jira] Subscription: Oozie Patch Available

[jira]

Issue Subscription
Filter: Oozie Patch Available (107 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3194  Oozie should set proper permissions to sharelib after upload
https://issues.apache.org/jira/browse/OOZIE-3194
OOZIE-3189  Update the release script and wiki page to use sha512 instead of md5
https://issues.apache.org/jira/browse/OOZIE-3189
OOZIE-3186  Oozie is unable to use configuration linked using jceks://file/...
https://issues.apache.org/jira/browse/OOZIE-3186
OOZIE-3185  Conflicting JARs org.apache.derby exist in Oozie
https://issues.apache.org/jira/browse/OOZIE-3185
OOZIE-3179  Adding a configurable config-default.xml location to a workflow
https://issues.apache.org/jira/browse/OOZIE-3179
OOZIE-3176  Oozie-core fails with checkstyle errors.
https://issues.apache.org/jira/browse/OOZIE-3176
OOZIE-3170  Oozie Diagnostic Bundle tool fails with NPE due to missing service 
class
https://issues.apache.org/jira/browse/OOZIE-3170
OOZIE-3135  Configure log4j2 in SqoopMain
https://issues.apache.org/jira/browse/OOZIE-3135
OOZIE-3134  Potential inconsistency between the in-memory SLA map and the Oozie 
database
https://issues.apache.org/jira/browse/OOZIE-3134
OOZIE-3109  Escape log-streaming's HTML-specific characters
https://issues.apache.org/jira/browse/OOZIE-3109
OOZIE-3105  testJMXInstrumentation from the 
org.apache.oozie.util.TestMetricsInstrumentation class is flaky
https://issues.apache.org/jira/browse/OOZIE-3105
OOZIE-3094  fix for grammar mistake
https://issues.apache.org/jira/browse/OOZIE-3094
OOZIE-3091  Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: 
org/apache/avro/mapred/AvroWrapper"
https://issues.apache.org/jira/browse/OOZIE-3091
OOZIE-3071  Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 
than Spark 2.2.0
https://issues.apache.org/jira/browse/OOZIE-3071
OOZIE-3063  Sanitizing variables that are part of openjpa.ConnectionProperties
https://issues.apache.org/jira/browse/OOZIE-3063
OOZIE-3062  Set HADOOP_CONF_DIR for spark action
https://issues.apache.org/jira/browse/OOZIE-3062
OOZIE-3061  Kill only those child jobs which are not already killed
https://issues.apache.org/jira/browse/OOZIE-3061
OOZIE-3002  address findbugs errors in client lib
https://issues.apache.org/jira/browse/OOZIE-3002
OOZIE-2975  code clean up in pig sharelib, replace Exception with more 
explicit, add try with resources, StringBuilder instead of StringBuffer
https://issues.apache.org/jira/browse/OOZIE-2975
OOZIE-2956  Fix Findbugs warnings related to reliance on default encoding in 
oozie-core
https://issues.apache.org/jira/browse/OOZIE-2956
OOZIE-2955  Fix Findbugs warnings related to reliance on default encoding in 
oozie-client
https://issues.apache.org/jira/browse/OOZIE-2955
OOZIE-2954  Fix Checkstyle issues in oozie-client
https://issues.apache.org/jira/browse/OOZIE-2954
OOZIE-2953  Fix Checkstyle issues in oozie-tools
https://issues.apache.org/jira/browse/OOZIE-2953
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues.apache.org/jira/browse/OOZIE-2949
OOZIE-2942  Fix Findbugs warnings in oozie-examples
https://issues.apache.org/jira/browse/OOZIE-2942
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues.apache.org/jira/browse/OOZIE-2937
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues.apache.org/jira/browse/OOZIE-2934
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2914  Consolidate Trim 
https://issues.apache.org/jira/browse/OOZIE-2914
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues.apache.org/jira/browse/OOZIE-2867
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders