[jira] [Commented] (OOZIE-2911) Re-add test testWfActionKillChildJob and adapt it to OYA

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049762#comment-16049762
 ] 

Hadoop QA commented on OOZIE-2911:
--

Testing JIRA OOZIE-2911

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 2 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1967
.Tests failed: 0
.Tests errors: 1

.The patch failed the following testcases:

.  

.Tests failing with errors:
.  
testMapReduceActionKill(org.apache.oozie.action.hadoop.TestMapReduceActionExecutor)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3893/

> Re-add test testWfActionKillChildJob and adapt it to OYA
> 
>
> Key: OOZIE-2911
> URL: https://issues.apache.org/jira/browse/OOZIE-2911
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
> Attachments: OOZIE-2911-001.patch
>
>
> Original test case was:
> {code}
>  public void testWfActionKillChildJob() throws Exception {
> String externalJobID = launchSleepJob(1000);
> String childId = launchSleepJob(100);
> WorkflowJobBean job = 
> this.addRecordToWfJobTable(WorkflowJob.Status.KILLED, 
> WorkflowInstance.Status.KILLED);
> WorkflowActionBean action = 
> this.addRecordToWfActionTable(job.getId(), externalJobID, "1",
> WorkflowAction.Status.KILLED, childId);
> new ActionKillXCommand(action.getId()).call();
> JobClient jobClient = createJobClient();
> final RunningJob mrJob = jobClient.getJob(JobID.forName(childId));
> waitFor(60 * 1000, new Predicate() {
> public boolean evaluate() throws Exception {
> return mrJob.isComplete();
> }
> });
> assertEquals(mrJob.getJobState(), JobStatus.KILLED);
> }
> {code}
> It was removed by OOZIE-1770's 
> [commit|https://github.com/apache/oozie/commit/21761f5b5b2b4457302aef780239610d076047e5#diff-aebe75e7912a7ba12c52f4ea356b61feL120]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Build failed in Jenkins: oozie-trunk-precommit-build #3893

2017-06-14 Thread Apache Jenkins Server
See 


Changes:

[rkanter] OOZIE-2651 Set javax.xml.parsers.DocumentBuilderFactory sys prop to 
make

[rkanter] OOZIE-2933 Switch from Findbugs to Spotbugs (Jan Hentschel via 
rkanter)

--
[...truncated 361.99 KB...]
[INFO] Copying jets3t-0.9.0.jar to 

[INFO] Copying datanucleus-rdbms-3.2.9.jar to 

[INFO] Copying hive-common-1.2.0.jar to 

[INFO] Copying snappy-java-1.0.4.1.jar to 

[INFO] Copying javax.annotation-api-1.2.jar to 

[INFO] Copying commons-compiler-2.7.6.jar to 

[INFO] Copying ant-1.9.1.jar to 

[INFO] Copying hadoop-annotations-2.6.0.jar to 

[INFO] Copying janino-2.7.6.jar to 

[INFO] Copying activemq-client-5.13.3.jar to 

[INFO] Copying guice-3.0.jar to 

[INFO] Copying httpclient-4.3.6.jar to 

[INFO] Copying xz-1.0.jar to 

[INFO] Copying oozie-client-5.0.0-SNAPSHOT.jar to 

[INFO] Copying hadoop-mapreduce-client-common-2.6.0.jar to 

[INFO] Copying leveldbjni-all-1.8.jar to 

[INFO] Copying jetty-util-6.1.26.jar to 

[INFO] Copying velocity-1.5.jar to 

[INFO] Copying jackson-core-2.4.2.jar to 

[INFO] Copying apache-log4j-extras-1.2.17.jar to 

[INFO] Copying netty-3.7.0.Final.jar to 

[INFO] Copying xmlenc-0.52.jar to 

[INFO] Copying httpcore-4.3.3.jar to 

[INFO] Copying jetty-io-9.2.19.v20160908.jar to 

[INFO] Copying commons-beanutils-core-1.8.0.jar to 

[INFO] Copying antlr-2.7.7.jar to 

[INFO] Copying slf4j-log4j12-1.6.6.jar to 

[INFO] Copying datanucleus-api-jdo-3.2.6.jar to 

[INFO] Copying jung-api-2.0.1.jar to 

[INFO] Copying jta-1.1.jar to 

[INFO] Copying apacheds-kerberos-codec-2.0.0-M15.jar to 

[jira] [Updated] (OOZIE-2910) Re-add testChildKill and adapt it to OYA

2017-06-14 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2910:
--
Description: Removed by OOZIE-1770: [link to the original 
code|https://github.com/apache/oozie/blob/e0b7cde711b1b9e1a03660ec635041eeb9755049/core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java#L546]
  (was: Removed by OOZIE-1770: [link to the original 
code|https://github.com/apache/oozie/commit/21761f5b5b2b4457302aef780239610d076047e5#diff-819cf5736cc278d1c35b67bc55ce13eeL546])

> Re-add testChildKill and adapt it to OYA
> 
>
> Key: OOZIE-2910
> URL: https://issues.apache.org/jira/browse/OOZIE-2910
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>
> Removed by OOZIE-1770: [link to the original 
> code|https://github.com/apache/oozie/blob/e0b7cde711b1b9e1a03660ec635041eeb9755049/core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java#L546]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2910) Re-add testChildKill and adapt it to OYA

2017-06-14 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2910:
--
Description: Removed by OOZIE-1770: [link to the original 
code|https://github.com/apache/oozie/commit/21761f5b5b2b4457302aef780239610d076047e5#diff-819cf5736cc278d1c35b67bc55ce13eeL546]

> Re-add testChildKill and adapt it to OYA
> 
>
> Key: OOZIE-2910
> URL: https://issues.apache.org/jira/browse/OOZIE-2910
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>
> Removed by OOZIE-1770: [link to the original 
> code|https://github.com/apache/oozie/commit/21761f5b5b2b4457302aef780239610d076047e5#diff-819cf5736cc278d1c35b67bc55ce13eeL546]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2911) Re-add test testWfActionKillChildJob and adapt it to OYA

2017-06-14 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2911:
--
Description: 
Original test case was:
{code}
 public void testWfActionKillChildJob() throws Exception {
String externalJobID = launchSleepJob(1000);
String childId = launchSleepJob(100);

WorkflowJobBean job = 
this.addRecordToWfJobTable(WorkflowJob.Status.KILLED, 
WorkflowInstance.Status.KILLED);
WorkflowActionBean action = this.addRecordToWfActionTable(job.getId(), 
externalJobID, "1",
WorkflowAction.Status.KILLED, childId);

new ActionKillXCommand(action.getId()).call();
JobClient jobClient = createJobClient();

final RunningJob mrJob = jobClient.getJob(JobID.forName(childId));
waitFor(60 * 1000, new Predicate() {
public boolean evaluate() throws Exception {
return mrJob.isComplete();
}
});
assertEquals(mrJob.getJobState(), JobStatus.KILLED);
}
{code}

It was removed by OOZIE-1770's 
[commit|https://github.com/apache/oozie/commit/21761f5b5b2b4457302aef780239610d076047e5#diff-aebe75e7912a7ba12c52f4ea356b61feL120]

  was:
Original test case was:
{code}
 public void testWfActionKillChildJob() throws Exception {
String externalJobID = launchSleepJob(1000);
String childId = launchSleepJob(100);

WorkflowJobBean job = 
this.addRecordToWfJobTable(WorkflowJob.Status.KILLED, 
WorkflowInstance.Status.KILLED);
WorkflowActionBean action = this.addRecordToWfActionTable(job.getId(), 
externalJobID, "1",
WorkflowAction.Status.KILLED, childId);

new ActionKillXCommand(action.getId()).call();
JobClient jobClient = createJobClient();

final RunningJob mrJob = jobClient.getJob(JobID.forName(childId));
waitFor(60 * 1000, new Predicate() {
public boolean evaluate() throws Exception {
return mrJob.isComplete();
}
});
assertEquals(mrJob.getJobState(), JobStatus.KILLED);
}
{code}


> Re-add test testWfActionKillChildJob and adapt it to OYA
> 
>
> Key: OOZIE-2911
> URL: https://issues.apache.org/jira/browse/OOZIE-2911
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
> Attachments: OOZIE-2911-001.patch
>
>
> Original test case was:
> {code}
>  public void testWfActionKillChildJob() throws Exception {
> String externalJobID = launchSleepJob(1000);
> String childId = launchSleepJob(100);
> WorkflowJobBean job = 
> this.addRecordToWfJobTable(WorkflowJob.Status.KILLED, 
> WorkflowInstance.Status.KILLED);
> WorkflowActionBean action = 
> this.addRecordToWfActionTable(job.getId(), externalJobID, "1",
> WorkflowAction.Status.KILLED, childId);
> new ActionKillXCommand(action.getId()).call();
> JobClient jobClient = createJobClient();
> final RunningJob mrJob = jobClient.getJob(JobID.forName(childId));
> waitFor(60 * 1000, new Predicate() {
> public boolean evaluate() throws Exception {
> return mrJob.isComplete();
> }
> });
> assertEquals(mrJob.getJobState(), JobStatus.KILLED);
> }
> {code}
> It was removed by OOZIE-1770's 
> [commit|https://github.com/apache/oozie/commit/21761f5b5b2b4457302aef780239610d076047e5#diff-aebe75e7912a7ba12c52f4ea356b61feL120]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2911) Re-add test testWfActionKillChildJob and adapt it to OYA

2017-06-14 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2911:
--
Description: 
Original test case was:
{code}
 public void testWfActionKillChildJob() throws Exception {
String externalJobID = launchSleepJob(1000);
String childId = launchSleepJob(100);

WorkflowJobBean job = 
this.addRecordToWfJobTable(WorkflowJob.Status.KILLED, 
WorkflowInstance.Status.KILLED);
WorkflowActionBean action = this.addRecordToWfActionTable(job.getId(), 
externalJobID, "1",
WorkflowAction.Status.KILLED, childId);

new ActionKillXCommand(action.getId()).call();
JobClient jobClient = createJobClient();

final RunningJob mrJob = jobClient.getJob(JobID.forName(childId));
waitFor(60 * 1000, new Predicate() {
public boolean evaluate() throws Exception {
return mrJob.isComplete();
}
});
assertEquals(mrJob.getJobState(), JobStatus.KILLED);
}
{code}

> Re-add test testWfActionKillChildJob and adapt it to OYA
> 
>
> Key: OOZIE-2911
> URL: https://issues.apache.org/jira/browse/OOZIE-2911
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
> Attachments: OOZIE-2911-001.patch
>
>
> Original test case was:
> {code}
>  public void testWfActionKillChildJob() throws Exception {
> String externalJobID = launchSleepJob(1000);
> String childId = launchSleepJob(100);
> WorkflowJobBean job = 
> this.addRecordToWfJobTable(WorkflowJob.Status.KILLED, 
> WorkflowInstance.Status.KILLED);
> WorkflowActionBean action = 
> this.addRecordToWfActionTable(job.getId(), externalJobID, "1",
> WorkflowAction.Status.KILLED, childId);
> new ActionKillXCommand(action.getId()).call();
> JobClient jobClient = createJobClient();
> final RunningJob mrJob = jobClient.getJob(JobID.forName(childId));
> waitFor(60 * 1000, new Predicate() {
> public boolean evaluate() throws Exception {
> return mrJob.isComplete();
> }
> });
> assertEquals(mrJob.getJobState(), JobStatus.KILLED);
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2911) Re-add test testWfActionKillChildJob and adapt it to OYA

2017-06-14 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2911:
--
Attachment: OOZIE-2911-001.patch

Attaching first patch 
# added back the test case and changed it a bit to not depend on JobClient 
anymore
# fixed JAE.kill() to kill ChildIDs based on the data in the DB, not just tags

> Re-add test testWfActionKillChildJob and adapt it to OYA
> 
>
> Key: OOZIE-2911
> URL: https://issues.apache.org/jira/browse/OOZIE-2911
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
> Attachments: OOZIE-2911-001.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2946) Include find-sec-bugs plugin

2017-06-14 Thread Robert Kanter (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049518#comment-16049518
 ] 

Robert Kanter commented on OOZIE-2946:
--

[~Jan Hentschel], I just noticed that we define a {{}} for the 
findbugs-maven-plugin in the {{}} and {{}} 
sections.  They also don't have the same version.  We should define the version 
only in {{}}.  Can you also fix that while we're adding the 
find-sec-bugs plugin; it's kind of related.

Also, the version for {{com.h3xstream.findsecbugs}} should be defined in the 
{{}} as well.

> Include find-sec-bugs plugin
> 
>
> Key: OOZIE-2946
> URL: https://issues.apache.org/jira/browse/OOZIE-2946
> Project: Oozie
>  Issue Type: Task
>  Components: build, security
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2946-1.patch
>
>
> The [Find Security Bugs|http://find-sec-bugs.github.io/] plugin looks for 
> security bugs in Java web apps, such as Oozie. This plugin should be included 
> in the build process.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2933) Switch from Findbugs to Spotbugs

2017-06-14 Thread Robert Kanter (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049507#comment-16049507
 ] 

Robert Kanter commented on OOZIE-2933:
--

+1

> Switch from Findbugs to Spotbugs
> 
>
> Key: OOZIE-2933
> URL: https://issues.apache.org/jira/browse/OOZIE-2933
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2933-1.patch, OOZIE-2933-2.patch, 
> oozie-findbugs-pre-commit.txt
>
>
> Because Findbugs hadn't a new release in some time other projects such as 
> Hadoop and HBase already switched to Spotbugs. This ticket proposes to switch 
> the current Findbugs implementation to Spotbugs, similar to the changes made 
> to Hadoop and HBase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (OOZIE-2911) Re-add test testWfActionKillChildJob and adapt it to OYA

2017-06-14 Thread Peter Cseh (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh reassigned OOZIE-2911:
-

Assignee: Peter Cseh

> Re-add test testWfActionKillChildJob and adapt it to OYA
> 
>
> Key: OOZIE-2911
> URL: https://issues.apache.org/jira/browse/OOZIE-2911
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (OOZIE-2947) Support job-xml or global configs for credentials provider

2017-06-14 Thread Clay B. (JIRA)
Clay B. created OOZIE-2947:
--

 Summary: Support job-xml or global configs for credentials provider
 Key: OOZIE-2947
 URL: https://issues.apache.org/jira/browse/OOZIE-2947
 Project: Oozie
  Issue Type: New Feature
  Components: security
Affects Versions: 4.2.0
 Environment: Today, one needs to specify their HBase properties in 
their credentials section by 
[hand|https://github.com/apache/oozie/blob/99a3df568d182e75751126aac5fe8b63d876e64f/client/src/main/resources/oozie-workflow-0.5.xsd#L321-L341[
 (or EL Expression) if acquiring an HBase credential for example. This is 
despite having the same settings in `hbase-site.xml` e.g. for a Java action. It 
would be nice if the same configurations the actions used for HBase could be 
used by the credentials provider.
Reporter: Clay B.
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2928) Unit Tests using LocalOozie fail randomly

2017-06-14 Thread Andras Piros (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049208#comment-16049208
 ] 

Andras Piros commented on OOZIE-2928:
-

Thanks [~dionusos] for the contribution!

LGTM +1 (non-binding). [~gezapeti] [~pbacsko] can you please have a look?

> Unit Tests using LocalOozie fail randomly
> -
>
> Key: OOZIE-2928
> URL: https://issues.apache.org/jira/browse/OOZIE-2928
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.3.0
>Reporter: Denes Bodo
>  Labels: Servlet
> Attachments: 0001-Fix-random-LocalOozie-based-test-failure.patch, 
> 0001-Fix-random-LocalOozie-based-test-failure.patch
>
>
> Sometimes There is an erro message running unit tests: "LocalOozie is already 
> initialized" then fails all the tests using LocalOozie.
> There is already a BindException that 
> {noformat}
>  type="java.net.BindException">java.net.BindException: Address already in use
> at java.net.PlainSocketImpl.socketBind(Native Method)
> at 
> java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
> at java.net.ServerSocket.bind(ServerSocket.java:376)
> at java.net.ServerSocket.init(ServerSocket.java:237)
> at 
> org.mortbay.jetty.bio.SocketConnector.newServerSocket(SocketConnector.java:80)
> at org.mortbay.jetty.bio.SocketConnector.open(SocketConnector.java:73)
> at 
> org.mortbay.jetty.AbstractConnector.doStart(AbstractConnector.java:283)
> at 
> org.mortbay.jetty.bio.SocketConnector.doStart(SocketConnector.java:147)
> at 
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> at org.mortbay.jetty.Server.doStart(Server.java:233)
> at 
> org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
> at 
> org.apache.oozie.test.EmbeddedServletContainer.start(EmbeddedServletContainer.java:105)
> at org.apache.oozie.local.LocalOozie.start(LocalOozie.java:81)
> at 
> org.apache.oozie.command.coord.TestCoordRerunXCommand.setUp(TestCoordRerunXCommand.java:79)
> at junit.framework.TestCase.runBare(TestCase.java:132)
> at junit.framework.TestResult$1.protect(TestResult.java:110)
> at junit.framework.TestResult.runProtected(TestResult.java:128)
> at junit.framework.TestResult.run(TestResult.java:113)
> at junit.framework.TestCase.run(TestCase.java:124)
> at junit.framework.TestSuite.runTest(TestSuite.java:243)
> at junit.framework.TestSuite.run(TestSuite.java:238)
> at 
> org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
> at org.junit.runners.Suite.runChild(Suite.java:128)
> at org.junit.runners.Suite.runChild(Suite.java:24)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
> at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:722)
> 
> {noformat}
> The source of problem seems to be in EmbeddedServletContainer.java. First we 
> create a socket, get its port number, release the socket and use this port to 
> create server:
> {noformat}
> ServerSocket ss = new ServerSocket(0);
> port = ss.getLocalPort();
> ss.close();
> server.getConnectors()[0].setHost(host);
> server.getConnectors()[0].setPort(port);
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049188#comment-16049188
 ] 

Hadoop QA commented on OOZIE-2943:
--

Testing JIRA OOZIE-2943

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1963
.Tests failed: 6
.Tests errors: 2

.The patch failed the following testcases:

.  testLoadDump(org.apache.oozie.tools.TestDBLoadDump)
.  testMain(org.apache.oozie.action.hadoop.TestHiveMain)
.  testPig_withNullExternalID(org.apache.oozie.action.hadoop.TestPigMain)
.  testEmbeddedPigWithinPython(org.apache.oozie.action.hadoop.TestPigMain)
.  testPigScript(org.apache.oozie.action.hadoop.TestPigMain)
.  testPigScript(org.apache.oozie.action.hadoop.TestPigMainWithOldAPI)

.Tests failing with errors:
.  testAddXIncludeFromReader(org.apache.oozie.util.TestXConfiguration)
.  testAddXIncludeFromStream(org.apache.oozie.util.TestXConfiguration)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3892/

> Fix Findbugs warnings in oozie-sharelib-pig
> ---
>
> Key: OOZIE-2943
> URL: https://issues.apache.org/jira/browse/OOZIE-2943
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2943-1.patch, OOZIE-2943-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-pig* module:
> {code}
> [INFO] 
> org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map)
>  makes inefficient use of keySet iterator instead of entrySet iterator 
> [org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 
> 130]
> [INFO] Dead store to klass in 
> org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
> boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] Found reliance on default encoding 

Build failed in Jenkins: oozie-trunk-precommit-build #3892

2017-06-14 Thread Apache Jenkins Server
See 


--
[...truncated 909.46 KB...]
[INFO] Copying jasper-runtime-5.5.23.jar to 

[INFO] Copying curator-client-2.5.0.jar to 

[INFO] Copying jetty-annotations-9.2.19.v20160908.jar to 

[INFO] Copying jersey-server-1.9.jar to 

[INFO] Copying oozie-sharelib-oozie-5.0.0-SNAPSHOT.jar to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-distro ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-distro ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/distro.xml
[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] Building tar : 

[INFO] 
[INFO] 
[INFO] Building Apache Oozie ZooKeeper Security Tests 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
oozie-zookeeper-security-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-zookeeper-security-tests ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test 

[jira] [Commented] (OOZIE-2927) Append new line character for Hive2 query using query tag

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049154#comment-16049154
 ] 

Hadoop QA commented on OOZIE-2927:
--

Testing JIRA OOZIE-2927

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1963
.Tests failed: 0
.Tests errors: 1

.The patch failed the following testcases:

.  

.Tests failing with errors:
.  
testCredentialsSkip(org.apache.oozie.action.hadoop.TestJavaActionExecutor)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3891/

> Append new line character for Hive2 query using query tag
> -
>
> Key: OOZIE-2927
> URL: https://issues.apache.org/jira/browse/OOZIE-2927
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2927-00.patch, OOZIE-2927-01.patch
>
>
> Without the new line character in the query, beeline does not do anything. 
> Though hive2 action completes successfully but query is not executed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Build failed in Jenkins: oozie-trunk-precommit-build #3891

2017-06-14 Thread Apache Jenkins Server
See 


--
[...truncated 904.52 KB...]
[INFO] Copying hadoop-hdfs-2.6.0.jar to 

[INFO] Copying xbean-asm5-shaded-3.17.jar to 

[INFO] Copying serp-1.15.1.jar to 

[INFO] Copying asm-5.0.1.jar to 

[INFO] Copying openjpa-lib-2.4.1.jar to 

[INFO] Copying opencsv-2.3.jar to 

[INFO] Copying jasper-runtime-5.5.23.jar to 

[INFO] Copying curator-client-2.5.0.jar to 

[INFO] Copying jetty-annotations-9.2.19.v20160908.jar to 

[INFO] Copying jersey-server-1.9.jar to 

[INFO] Copying oozie-sharelib-oozie-5.0.0-SNAPSHOT.jar to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-distro ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-distro ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/distro.xml
[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] Building tar : 

[INFO] 
[INFO] 
[INFO] Building Apache Oozie ZooKeeper Security Tests 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[jira] [Commented] (OOZIE-2651) Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML handling faster

2017-06-14 Thread Peter Bacsko (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049083#comment-16049083
 ] 

Peter Bacsko commented on OOZIE-2651:
-

+1 LGTM

> Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML handling 
> faster
> -
>
> Key: OOZIE-2651
> URL: https://issues.apache.org/jira/browse/OOZIE-2651
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Robert Kanter
> Attachments: OOZIE-2651.001.patch, OOZIE-2651.002.patch, 
> OOZIE-2651.003.patch, OOZIE-2651.004.patch, OOZIE-2651.005.patch
>
>
> We noticed from some jstacks that Oozie was spending a lot of time looking 
> for XML related jars (we do a lot of XML parsing in Oozie and Hadoop code).  
> For instance, we'd see hundreds of threads blocked here
> {noformat}
> "pool-5-thread-57" prio=10 tid=0x7f9579923000 nid=0x6b7f waiting for 
> monitor entry [0x7f94225e3000]
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1559)
> - waiting to lock <0x000500026148> (a 
> org.apache.catalina.loader.WebappClassLoader)
> at 
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526)
> at 
> javax.xml.parsers.FactoryFinder.getProviderClass(FactoryFinder.java:117)
> at javax.xml.parsers.FactoryFinder.newInstance(FactoryFinder.java:178)
> at 
> javax.xml.parsers.FactoryFinder.findJarServiceProvider(FactoryFinder.java:333)
> at javax.xml.parsers.FactoryFinder.find(FactoryFinder.java:255)
> at 
> javax.xml.parsers.DocumentBuilderFactory.newInstance(DocumentBuilderFactory.java:121)
> at 
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2526)
> at 
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2503)
> at 
> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2409)
> - locked <0x0007eac5ea28> (a org.apache.hadoop.conf.Configuration)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1144)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1116)
> at org.apache.oozie.util.XConfiguration.copy(XConfiguration.java:206)
> ...
> {noformat}
> There's nothing we can do about the lock at the {{WebappClassLoader}}, but by 
> setting the {{javax.xml.parsers.DocumentBuilderFactory}} system property to 
> {{org.apache.xerces.jaxp.DocumentBuilderFactoryImpl}}, we can speed this up a 
> lot by getting rid of all of the searching that it's doing to find the 
> implementation.  
> See 
> https://docs.oracle.com/javase/7/docs/api/javax/xml/parsers/DocumentBuilderFactory.html#newInstance()
>  
> and 
> https://www.databasesandlife.com/java-always-explicitly-specify-which-xml-parser-to-use/
> In our testing, we had a metric around creating a new {{JobClient}}, which 
> also calls {{DocumentBuilderFactory.newInstance}}, and it dropped from ~3min 
> max to ~2sec max (not an exact test of the savings here).  And we also didn't 
> see so much blocking on this in the jstacks anymore.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2902) org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after hadoop 2.6 upgrade

2017-06-14 Thread Peter Bacsko (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049082#comment-16049082
 ] 

Peter Bacsko commented on OOZIE-2902:
-

Btw patch looks good. Remove the unused code path and we're OK.

> org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after hadoop 2.6 
> upgrade
> 
>
> Key: OOZIE-2902
> URL: https://issues.apache.org/jira/browse/OOZIE-2902
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2902-0.patch, OOZIE-2902-1.patch
>
>
> after https://issues.apache.org/jira/browse/OOZIE-2780 jira, 
> {code}TestJavaActionExecutor{code} fails with
> {noformat}
> ---
>  T E S T S
> ---
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
> support was removed in 8.0
> Concurrency config is parallel='classes', perCoreThreadCount=false, 
> threadCount=1, useUnlimitedThreads=false
> objc[81957]: Class JavaLaunchHelper is implemented in both 
> /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java 
> (0x107ee74c0) and 
> /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib
>  (0x1112e84e0). One of the two will be used. Which one is undefined.
> Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
> Tests run: 49, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 210.336 sec 
> <<< FAILURE!
> Results :
> Failed tests:   
> testUpdateConfForTimeLineServiceEnabled(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>  expected:<[tru]e> but was:<[fals]e>
> Tests run: 49, Failures: 1, Errors: 0, Skipped: 0
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Oozie Main .. SUCCESS [  0.487 
> s]
> [INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [  2.005 
> s]
> [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [  0.073 
> s]
> [INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [  0.271 
> s]
> [INFO] Apache Oozie Hadoop Libs ... SUCCESS [  0.015 
> s]
> [INFO] Apache Oozie Client  SUCCESS [  2.365 
> s]
> [INFO] Apache Oozie Share Lib Oozie ... SUCCESS [  2.465 
> s]
> [INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  1.812 
> s]
> [INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  0.535 
> s]
> [INFO] Apache Oozie Core .. FAILURE [03:52 
> min]
> [INFO] Apache Oozie Share Lib Streaming ... SKIPPED
> [INFO] Apache Oozie Share Lib Pig . SKIPPED
> [INFO] Apache Oozie Share Lib Hive  SKIPPED
> [INFO] Apache Oozie Share Lib Hive 2 .. SKIPPED
> [INFO] Apache Oozie Share Lib Sqoop ... SKIPPED
> [INFO] Apache Oozie Examples .. SKIPPED
> [INFO] Apache Oozie Share Lib Spark ... SKIPPED
> [INFO] Apache Oozie Share Lib . SKIPPED
> [INFO] Apache Oozie Docs .. SKIPPED
> [INFO] Apache Oozie WebApp  SKIPPED
> [INFO] Apache Oozie Tools . SKIPPED
> [INFO] Apache Oozie MiniOozie . SKIPPED
> [INFO] Apache Oozie Server  SKIPPED
> [INFO] Apache Oozie Distro  SKIPPED
> [INFO] Apache Oozie ZooKeeper Security Tests .. SKIPPED
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 04:03 min
> [INFO] Finished at: 2017-05-15T09:38:23-04:00
> [INFO] Final Memory: 150M/443M
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2902) org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after hadoop 2.6 upgrade

2017-06-14 Thread Peter Bacsko (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049079#comment-16049079
 ] 

Peter Bacsko commented on OOZIE-2902:
-

[~dbist13] yeah I think it does.

Since we merged OYA, we no longer support Hadoop 1. This means there's only 
YARN. Therefore it's pointless to keep {{HadoomShims.isYARN()}}. This is 
something that we should do everywhere (not sure where we have isYARN() checks, 
but I remember seeing it at different places).

> org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after hadoop 2.6 
> upgrade
> 
>
> Key: OOZIE-2902
> URL: https://issues.apache.org/jira/browse/OOZIE-2902
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2902-0.patch, OOZIE-2902-1.patch
>
>
> after https://issues.apache.org/jira/browse/OOZIE-2780 jira, 
> {code}TestJavaActionExecutor{code} fails with
> {noformat}
> ---
>  T E S T S
> ---
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
> support was removed in 8.0
> Concurrency config is parallel='classes', perCoreThreadCount=false, 
> threadCount=1, useUnlimitedThreads=false
> objc[81957]: Class JavaLaunchHelper is implemented in both 
> /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java 
> (0x107ee74c0) and 
> /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib
>  (0x1112e84e0). One of the two will be used. Which one is undefined.
> Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
> Tests run: 49, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 210.336 sec 
> <<< FAILURE!
> Results :
> Failed tests:   
> testUpdateConfForTimeLineServiceEnabled(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>  expected:<[tru]e> but was:<[fals]e>
> Tests run: 49, Failures: 1, Errors: 0, Skipped: 0
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Oozie Main .. SUCCESS [  0.487 
> s]
> [INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [  2.005 
> s]
> [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [  0.073 
> s]
> [INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [  0.271 
> s]
> [INFO] Apache Oozie Hadoop Libs ... SUCCESS [  0.015 
> s]
> [INFO] Apache Oozie Client  SUCCESS [  2.365 
> s]
> [INFO] Apache Oozie Share Lib Oozie ... SUCCESS [  2.465 
> s]
> [INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  1.812 
> s]
> [INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  0.535 
> s]
> [INFO] Apache Oozie Core .. FAILURE [03:52 
> min]
> [INFO] Apache Oozie Share Lib Streaming ... SKIPPED
> [INFO] Apache Oozie Share Lib Pig . SKIPPED
> [INFO] Apache Oozie Share Lib Hive  SKIPPED
> [INFO] Apache Oozie Share Lib Hive 2 .. SKIPPED
> [INFO] Apache Oozie Share Lib Sqoop ... SKIPPED
> [INFO] Apache Oozie Examples .. SKIPPED
> [INFO] Apache Oozie Share Lib Spark ... SKIPPED
> [INFO] Apache Oozie Share Lib . SKIPPED
> [INFO] Apache Oozie Docs .. SKIPPED
> [INFO] Apache Oozie WebApp  SKIPPED
> [INFO] Apache Oozie Tools . SKIPPED
> [INFO] Apache Oozie MiniOozie . SKIPPED
> [INFO] Apache Oozie Server  SKIPPED
> [INFO] Apache Oozie Distro  SKIPPED
> [INFO] Apache Oozie ZooKeeper Security Tests .. SKIPPED
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 04:03 min
> [INFO] Finished at: 2017-05-15T09:38:23-04:00
> [INFO] Final Memory: 150M/443M
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2937) Remove redundant groupId from the child pom's

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049078#comment-16049078
 ] 

Hadoop QA commented on OOZIE-2937:
--

Testing JIRA OOZIE-2937

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1963
.Tests rerun: 26
.Tests failed at first run: 
org.apache.oozie.action.hadoop.TestHdfsOperations,org.apache.oozie.jms.TestJMSJobEventListener,org.apache.oozie.event.TestEventGeneration,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3888/

> Remove redundant groupId from the child pom's
> -
>
> Key: OOZIE-2937
> URL: https://issues.apache.org/jira/browse/OOZIE-2937
> Project: Oozie
>  Issue Type: Task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Trivial
> Attachments: OOZIE-2937-1.patch
>
>
> Currently all child pom's define the *groupId* again. That's not necessary, 
> because it is already defined in the parent pom. Remove the redundant 
> declarations of the *groupId*.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Build failed in Jenkins: oozie-trunk-precommit-build #3888

2017-06-14 Thread Apache Jenkins Server
See 


Changes:

[gezapeti] OOZIE-2939 Fix Findbugs warnings related to reliance on default 
encoding

[gezapeti] OOZIE-2938 Fix Findbugs warnings in oozie-sharelib-hive module (Jan

--
[...truncated 906.30 KB...]
[INFO] Copying jetty-rewrite-9.2.19.v20160908.jar to 

[INFO] Copying hadoop-yarn-common-2.6.0.jar to 

[INFO] Copying commons-collections-3.2.1.jar to 

[INFO] Copying geronimo-jpa_2.0_spec-1.1.jar to 

[INFO] Copying hadoop-mapreduce-client-core-2.6.0.jar to 

[INFO] Copying json-20090211.jar to 

[INFO] Copying jersey-client-1.9.jar to 

[INFO] Copying jetty-schemas-3.1.M0.jar to 

[INFO] Copying hadoop-hdfs-2.6.0.jar to 

[INFO] Copying xbean-asm5-shaded-3.17.jar to 

[INFO] Copying serp-1.15.1.jar to 

[INFO] Copying asm-5.0.1.jar to 

[INFO] Copying openjpa-lib-2.4.1.jar to 

[INFO] Copying opencsv-2.3.jar to 

[INFO] Copying jasper-runtime-5.5.23.jar to 

[INFO] Copying curator-client-2.5.0.jar to 

[INFO] Copying jetty-annotations-9.2.19.v20160908.jar to 

[INFO] Copying jersey-server-1.9.jar to 

[INFO] Copying oozie-sharelib-oozie-5.0.0-SNAPSHOT.jar to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building 

Build failed in Jenkins: oozie-trunk-precommit-build #3889

2017-06-14 Thread Apache Jenkins Server
See 


--
[...truncated 912.09 KB...]
[INFO] Copying jasper-runtime-5.5.23.jar to 

[INFO] Copying curator-client-2.5.0.jar to 

[INFO] Copying jetty-annotations-9.2.19.v20160908.jar to 

[INFO] Copying jersey-server-1.9.jar to 

[INFO] Copying oozie-sharelib-oozie-5.0.0-SNAPSHOT.jar to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-distro ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-distro ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/distro.xml
[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] Building tar : 

[INFO] 
[INFO] 
[INFO] Building Apache Oozie ZooKeeper Security Tests 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
oozie-zookeeper-security-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-zookeeper-security-tests ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test 

[jira] [Commented] (OOZIE-2924) ./bin/mkdistro.sh reports a number instances of no @throws for Exception

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049077#comment-16049077
 ] 

Hadoop QA commented on OOZIE-2924:
--

Testing JIRA OOZIE-2924

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1963
.Tests failed: 6
.Tests errors: 2

.The patch failed the following testcases:

.  testLoadDump(org.apache.oozie.tools.TestDBLoadDump)
.  testMain(org.apache.oozie.action.hadoop.TestHiveMain)
.  testPig_withNullExternalID(org.apache.oozie.action.hadoop.TestPigMain)
.  testEmbeddedPigWithinPython(org.apache.oozie.action.hadoop.TestPigMain)
.  testPigScript(org.apache.oozie.action.hadoop.TestPigMain)
.  testPigScript(org.apache.oozie.action.hadoop.TestPigMainWithOldAPI)

.Tests failing with errors:
.  testAddXIncludeFromReader(org.apache.oozie.util.TestXConfiguration)
.  testAddXIncludeFromStream(org.apache.oozie.util.TestXConfiguration)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3889/

> ./bin/mkdistro.sh reports a number instances of no @throws for Exception
> 
>
> Key: OOZIE-2924
> URL: https://issues.apache.org/jira/browse/OOZIE-2924
> Project: Oozie
>  Issue Type: Improvement
>  Components: client, core
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Trivial
> Fix For: 5.0.0
>
> Attachments: OOZIE-2924-0.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

2017-06-14 Thread Jan Hentschel (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049072#comment-16049072
 ] 

Jan Hentschel commented on OOZIE-2943:
--

[~gezapeti] You're absolutely right. I updated the patch accordingly.

> Fix Findbugs warnings in oozie-sharelib-pig
> ---
>
> Key: OOZIE-2943
> URL: https://issues.apache.org/jira/browse/OOZIE-2943
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2943-1.patch, OOZIE-2943-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-pig* module:
> {code}
> [INFO] 
> org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map)
>  makes inefficient use of keySet iterator instead of entrySet iterator 
> [org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 
> 130]
> [INFO] Dead store to klass in 
> org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
> boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.writeExternalData(String, File): new 
> java.io.FileWriter(File) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 408]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to clean 
> up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMain, 
> org.apache.oozie.action.hadoop.PigMain] Obligation to clean up resource 
> created at PigMain.java:[line 130] is not dischargedPath continues at 
> PigMain.java:[line 131]
> [INFO] org.apache.oozie.action.hadoop.PigMain.handleError(String) may fail to 
> close stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to close 
> stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 130]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI] 
> At PigMainWithOldAPI.java:[line 265]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to clean up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] Obligation to clean up 
> resource created at PigMainWithOldAPI.java:[line 101] is not dischargedPath 
> continues at PigMainWithOldAPI.java:[line 102]
> [INFO] 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 265]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 101]Another occurrence at 
> PigMainWithOldAPI.java:[line 242]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

2017-06-14 Thread Jan Hentschel (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel updated OOZIE-2943:
-
Attachment: OOZIE-2943-2.patch

> Fix Findbugs warnings in oozie-sharelib-pig
> ---
>
> Key: OOZIE-2943
> URL: https://issues.apache.org/jira/browse/OOZIE-2943
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2943-1.patch, OOZIE-2943-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-pig* module:
> {code}
> [INFO] 
> org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map)
>  makes inefficient use of keySet iterator instead of entrySet iterator 
> [org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 
> 130]
> [INFO] Dead store to klass in 
> org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
> boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.writeExternalData(String, File): new 
> java.io.FileWriter(File) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 408]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to clean 
> up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMain, 
> org.apache.oozie.action.hadoop.PigMain] Obligation to clean up resource 
> created at PigMain.java:[line 130] is not dischargedPath continues at 
> PigMain.java:[line 131]
> [INFO] org.apache.oozie.action.hadoop.PigMain.handleError(String) may fail to 
> close stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to close 
> stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 130]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI] 
> At PigMainWithOldAPI.java:[line 265]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to clean up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] Obligation to clean up 
> resource created at PigMainWithOldAPI.java:[line 101] is not dischargedPath 
> continues at PigMainWithOldAPI.java:[line 102]
> [INFO] 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 265]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 101]Another occurrence at 
> PigMainWithOldAPI.java:[line 242]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049061#comment-16049061
 ] 

Peter Cseh commented on OOZIE-2943:
---

I think this change will change the generated JSONs:
{noformat}
-for (String cName : map.keySet()) {
-group.put(cName, map.get(cName));
+for (Map.Entry cName : map.entrySet()) {
+group.put(cName, cName.getValue());
{noformat}
shouldn't it be {{ group.put(cName.getKey(), cName.getValue());}} ?

> Fix Findbugs warnings in oozie-sharelib-pig
> ---
>
> Key: OOZIE-2943
> URL: https://issues.apache.org/jira/browse/OOZIE-2943
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2943-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-pig* module:
> {code}
> [INFO] 
> org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map)
>  makes inefficient use of keySet iterator instead of entrySet iterator 
> [org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 
> 130]
> [INFO] Dead store to klass in 
> org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
> boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.writeExternalData(String, File): new 
> java.io.FileWriter(File) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 408]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to clean 
> up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMain, 
> org.apache.oozie.action.hadoop.PigMain] Obligation to clean up resource 
> created at PigMain.java:[line 130] is not dischargedPath continues at 
> PigMain.java:[line 131]
> [INFO] org.apache.oozie.action.hadoop.PigMain.handleError(String) may fail to 
> close stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to close 
> stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 130]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI] 
> At PigMainWithOldAPI.java:[line 265]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to clean up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] Obligation to clean up 
> resource created at PigMainWithOldAPI.java:[line 101] is not dischargedPath 
> continues at PigMainWithOldAPI.java:[line 102]
> [INFO] 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 265]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 101]Another occurrence at 
> PigMainWithOldAPI.java:[line 242]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2927) Append new line character for Hive2 query using query tag

2017-06-14 Thread Abhishek Bafna (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049051#comment-16049051
 ] 

Abhishek Bafna commented on OOZIE-2927:
---

Thanks [~gezapeti]. I think, I will modify the existing test case to cover the 
scenario.

> Append new line character for Hive2 query using query tag
> -
>
> Key: OOZIE-2927
> URL: https://issues.apache.org/jira/browse/OOZIE-2927
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2927-00.patch, OOZIE-2927-01.patch
>
>
> Without the new line character in the query, beeline does not do anything. 
> Though hive2 action completes successfully but query is not executed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2927) Append new line character for Hive2 query using query tag

2017-06-14 Thread Abhishek Bafna (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Bafna updated OOZIE-2927:
--
Attachment: OOZIE-2927-01.patch

> Append new line character for Hive2 query using query tag
> -
>
> Key: OOZIE-2927
> URL: https://issues.apache.org/jira/browse/OOZIE-2927
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2927-00.patch, OOZIE-2927-01.patch
>
>
> Without the new line character in the query, beeline does not do anything. 
> Though hive2 action completes successfully but query is not executed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2946) Include find-sec-bugs plugin

2017-06-14 Thread Jan Hentschel (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049032#comment-16049032
 ] 

Jan Hentschel commented on OOZIE-2946:
--

The Findbugs problems are expected due to the nature of the patch. Solving the 
new warnings should be part of another ticket. The failed tests seem to be 
flaky.

> Include find-sec-bugs plugin
> 
>
> Key: OOZIE-2946
> URL: https://issues.apache.org/jira/browse/OOZIE-2946
> Project: Oozie
>  Issue Type: Task
>  Components: build, security
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2946-1.patch
>
>
> The [Find Security Bugs|http://find-sec-bugs.github.io/] plugin looks for 
> security bugs in Java web apps, such as Oozie. This plugin should be included 
> in the build process.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2946) Include find-sec-bugs plugin

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049030#comment-16049030
 ] 

Hadoop QA commented on OOZIE-2946:
--

Testing JIRA OOZIE-2946

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:red}-1{color} There are [106] new bugs found below threshold in total 
that must be fixed.
. {color:red}-1{color} There are [1] new bugs found below threshold in [server] 
that must be fixed.
. You can find the FindBugs diff here (look for the red and orange ones): 
server/findbugs-new.html
. The most important FindBugs errors are:
. At JspHandlerProvider.java:[line 43]: File(...) reads a file whose location 
might be specified by user input
. At JspHandlerProvider.java:[line 43]
. {color:red}-1{color} There are [8] new bugs found below threshold in [client] 
that must be fixed, listing only the first [5] ones.
. You can find the FindBugs diff here (look for the red and orange ones): 
client/findbugs-new.html
. The top [5] most important FindBugs errors are:
. At OozieCLI.java:[line 840]: File(...) reads a file whose location might be 
specified by user input
. FileInputStream(...) reads a file whose location might be specified by user 
input: At OozieCLI.java:[line 838]
. At OozieCLI.java:[line 838]: At OozieCLI.java:[line 848]
. At OozieCLI.java:[line 875]: File(...) reads a file whose location might be 
specified by user input
. File(...) reads a file whose location might be specified by user input: At 
OozieCLI.java:[line 870]
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:red}-1{color} There are [3] new bugs found below threshold in 
[sharelib/hive] that must be fixed.
. You can find the FindBugs diff here (look for the red and orange ones): 
sharelib/hive/findbugs-new.html
. The most important FindBugs errors are:
. At HiveMain.java:[line 336]: FileReader(...) reads a file whose location 
might be specified by user input
. At HiveMain.java:[line 245]: At HiveMain.java:[line 226]
. At HiveMain.java:[line 229]: File(...) reads a file whose location might be 
specified by user input
. FileOutputStream(...) writes to a file whose location might be specified by 
user input: At HiveMain.java:[line 226]
. At HiveMain.java:[line 172]: At HiveMain.java:[line 173]
. {color:red}-1{color} There are [5] new bugs found below threshold in 
[sharelib/spark] that must be fixed.
. You can find the FindBugs diff here (look for the red and orange ones): 
sharelib/spark/findbugs-new.html
. The most important FindBugs errors are:
. At SparkMain.java:[line 129]: File(...) reads a file whose location might be 
specified by user input
. File(...) reads a file whose location might be specified by user input: At 
SparkMain.java:[line 129]
. At SparkMain.java:[line 162]: At SparkMain.java:[line 169]
. FileOutputStream(...) writes to a file whose location might be specified by 
user input: At SparkMain.java:[line 168]
. At SparkMain.java:[line 210]: At SparkMain.java:[line 211]
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:red}-1{color} There are [3] new bugs found below threshold in 
[sharelib/hive2] that must be fixed.
. You can find the FindBugs diff here (look for the red and orange ones): 
sharelib/hive2/findbugs-new.html
. The most important FindBugs errors are:
. At Hive2Main.java:[line 278]: FileReader(...) reads a file whose location 
might be specified by user input
. At Hive2Main.java:[line 164]: At Hive2Main.java:[line 145]
. At Hive2Main.java:[line 148]: File(...) reads a file whose location might be 
specified by user input
. FileOutputStream(...) writes to a file whose location might be specified by 
user input: At Hive2Main.java:[line 145]
. At Hive2Main.java:[line 117]: At Hive2Main.java:[line 266]
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:red}-1{color} There are [8] new bugs found below threshold in 
[sharelib/pig] that must be 

Build failed in Jenkins: oozie-trunk-precommit-build #3887

2017-06-14 Thread Apache Jenkins Server
See 


--
[...truncated 1.22 MB...]
[INFO] Reading assembly descriptor: src/main/assemblies/empty.xml
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Oozie Main .. SUCCESS [  1.621 s]
[INFO] Apache Oozie Client  SUCCESS [ 21.661 s]
[INFO] Apache Oozie Share Lib Oozie ... SUCCESS [  3.124 s]
[INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  1.947 s]
[INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  0.351 s]
[INFO] Apache Oozie Core .. SUCCESS [ 42.491 s]
[INFO] Apache Oozie Share Lib Streaming ... SUCCESS [  3.215 s]
[INFO] Apache Oozie Share Lib Pig . SUCCESS [  2.410 s]
[INFO] Apache Oozie Share Lib Hive  SUCCESS [  3.483 s]
[INFO] Apache Oozie Share Lib Hive 2 .. SUCCESS [  3.589 s]
[INFO] Apache Oozie Share Lib Sqoop ... SUCCESS [  0.564 s]
[INFO] Apache Oozie Examples .. SUCCESS [  2.264 s]
[INFO] Apache Oozie Share Lib Spark ... SUCCESS [  5.915 s]
[INFO] Apache Oozie Share Lib . SUCCESS [ 20.732 s]
[INFO] Apache Oozie Docs .. SUCCESS [ 11.690 s]
[INFO] Apache Oozie WebApp  SUCCESS [ 43.660 s]
[INFO] Apache Oozie Tools . SUCCESS [  1.375 s]
[INFO] Apache Oozie MiniOozie . SUCCESS [  1.544 s]
[INFO] Apache Oozie Server  SUCCESS [  4.364 s]
[INFO] Apache Oozie Distro  SUCCESS [ 51.477 s]
[INFO] Apache Oozie ZooKeeper Security Tests .. SUCCESS [  2.726 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 03:52 min
[INFO] Finished at: 2017-06-14T10:32:05Z
[INFO] Final Memory: 96M/1268M
[INFO] 

Reports
  Running test-patch task CLEAN
  Running test-patch task RAW_PATCH_ANALYSIS
  Running test-patch task RAT
  Running test-patch task JAVADOC
  Running test-patch task COMPILE
  Running test-patch task FINDBUGS_DIFF
[TRACE] Downloading FindBugs diff JAR from 
https://repo1.maven.org/maven2/me/andrz/findbugs/findbugs-diff/0.1.0/findbugs-diff-0.1.0-all.jar
[TRACE] FindBugs diff JAR downloaded
grep: 
:
 No such file or directory
[TRACE] FindBugs diff JAR checked, is safe to use
[TRACE] Performing FindBugs diffs
[TRACE] FindBugs diffs performed
[TRACE] Checking FindBugs diffs and creating reports
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[ERROR] There are [1] new bugs found below threshold in [server].
[DEBUG] You can find the FindBugs diff here (look for the red and orange ones): 
server/findbugs-new.html
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[ERROR] There are [8] new bugs found below threshold in [client].
[DEBUG] You can find the FindBugs diff here (look for the red and orange ones): 
client/findbugs-new.html
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [docs].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[ERROR] There are [3] new bugs found below threshold in [sharelib/hive].
[DEBUG] You can find the FindBugs diff here (look for the red and orange ones): 
sharelib/hive/findbugs-new.html
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[ERROR] There are [5] new bugs found below threshold in [sharelib/spark].
[DEBUG] You can find the FindBugs diff here (look for the red and orange ones): 
sharelib/spark/findbugs-new.html
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/hcatalog].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[ERROR] There are [3] new bugs found below threshold in [sharelib/hive2].
[DEBUG] You can find the FindBugs diff here (look for the red and orange ones): 
sharelib/hive2/findbugs-new.html
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/streaming].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[ERROR] There are [8] new bugs found below threshold in [sharelib/pig].
[DEBUG] You can find the FindBugs 

Build failed in Jenkins: oozie-trunk-precommit-build #3890

2017-06-14 Thread Apache Jenkins Server
See 


--
[...truncated 326.41 KB...]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-mini ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-mini ---
[INFO] Compiling 1 source file to 

[INFO] 
[INFO] >>> findbugs-maven-plugin:3.0.1:check (default-cli) > :findbugs @ 
oozie-mini >>>
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ oozie-mini ---
[INFO] 
[INFO] <<< findbugs-maven-plugin:3.0.1:check (default-cli) < :findbugs @ 
oozie-mini <<<
[INFO] 
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:check (default-cli) @ oozie-mini ---
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Server 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ oozie-server ---
[INFO] Deleting 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-server 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-server 
---
[INFO] Compiling 13 source files to 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-server 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-server 
---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-server ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-server ---
[INFO] Compiling 4 source files to 

[INFO] 
[INFO] >>> findbugs-maven-plugin:3.0.1:check (default-cli) > :findbugs @ 
oozie-server >>>
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ oozie-server ---
[INFO] Fork Value is true
[INFO] Done FindBugs Analysis
[INFO] 
[INFO] <<< findbugs-maven-plugin:3.0.1:check (default-cli) < :findbugs @ 
oozie-server <<<
[INFO] 
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:check (default-cli) @ oozie-server ---
[INFO] BugInstance size is 0
[INFO] Error size is 0
[INFO] No errors/warnings found
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ oozie-distro ---
[INFO] Deleting 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 

[jira] [Commented] (OOZIE-2902) org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after hadoop 2.6 upgrade

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048941#comment-16048941
 ] 

Hadoop QA commented on OOZIE-2902:
--

Testing JIRA OOZIE-2902

Cleaning local git workspace



{color:red}-1{color} Patch failed to apply to head of branch



> org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after hadoop 2.6 
> upgrade
> 
>
> Key: OOZIE-2902
> URL: https://issues.apache.org/jira/browse/OOZIE-2902
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Blocker
> Fix For: 5.0.0
>
> Attachments: OOZIE-2902-0.patch, OOZIE-2902-1.patch
>
>
> after https://issues.apache.org/jira/browse/OOZIE-2780 jira, 
> {code}TestJavaActionExecutor{code} fails with
> {noformat}
> ---
>  T E S T S
> ---
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; 
> support was removed in 8.0
> Concurrency config is parallel='classes', perCoreThreadCount=false, 
> threadCount=1, useUnlimitedThreads=false
> objc[81957]: Class JavaLaunchHelper is implemented in both 
> /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java 
> (0x107ee74c0) and 
> /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib
>  (0x1112e84e0). One of the two will be used. Which one is undefined.
> Running org.apache.oozie.action.hadoop.TestJavaActionExecutor
> Tests run: 49, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 210.336 sec 
> <<< FAILURE!
> Results :
> Failed tests:   
> testUpdateConfForTimeLineServiceEnabled(org.apache.oozie.action.hadoop.TestJavaActionExecutor):
>  expected:<[tru]e> but was:<[fals]e>
> Tests run: 49, Failures: 1, Errors: 0, Skipped: 0
> [INFO] 
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Oozie Main .. SUCCESS [  0.487 
> s]
> [INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [  2.005 
> s]
> [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [  0.073 
> s]
> [INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [  0.271 
> s]
> [INFO] Apache Oozie Hadoop Libs ... SUCCESS [  0.015 
> s]
> [INFO] Apache Oozie Client  SUCCESS [  2.365 
> s]
> [INFO] Apache Oozie Share Lib Oozie ... SUCCESS [  2.465 
> s]
> [INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  1.812 
> s]
> [INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  0.535 
> s]
> [INFO] Apache Oozie Core .. FAILURE [03:52 
> min]
> [INFO] Apache Oozie Share Lib Streaming ... SKIPPED
> [INFO] Apache Oozie Share Lib Pig . SKIPPED
> [INFO] Apache Oozie Share Lib Hive  SKIPPED
> [INFO] Apache Oozie Share Lib Hive 2 .. SKIPPED
> [INFO] Apache Oozie Share Lib Sqoop ... SKIPPED
> [INFO] Apache Oozie Examples .. SKIPPED
> [INFO] Apache Oozie Share Lib Spark ... SKIPPED
> [INFO] Apache Oozie Share Lib . SKIPPED
> [INFO] Apache Oozie Docs .. SKIPPED
> [INFO] Apache Oozie WebApp  SKIPPED
> [INFO] Apache Oozie Tools . SKIPPED
> [INFO] Apache Oozie MiniOozie . SKIPPED
> [INFO] Apache Oozie Server  SKIPPED
> [INFO] Apache Oozie Distro  SKIPPED
> [INFO] Apache Oozie ZooKeeper Security Tests .. SKIPPED
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 04:03 min
> [INFO] Finished at: 2017-05-15T09:38:23-04:00
> [INFO] Final Memory: 150M/443M
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2933) Switch from Findbugs to Spotbugs

2017-06-14 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048936#comment-16048936
 ] 

Hadoop QA commented on OOZIE-2933:
--

Testing JIRA OOZIE-2933

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1963
.Tests rerun: 79
.Tests failed at first run: 
org.apache.oozie.action.hadoop.TestJavaActionExecutor,org.apache.oozie.jms.TestJMSJobEventListener,org.apache.oozie.action.hadoop.TestLauncherAM,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3886/

> Switch from Findbugs to Spotbugs
> 
>
> Key: OOZIE-2933
> URL: https://issues.apache.org/jira/browse/OOZIE-2933
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2933-1.patch, OOZIE-2933-2.patch, 
> oozie-findbugs-pre-commit.txt
>
>
> Because Findbugs hadn't a new release in some time other projects such as 
> Hadoop and HBase already switched to Spotbugs. This ticket proposes to switch 
> the current Findbugs implementation to Spotbugs, similar to the changes made 
> to Hadoop and HBase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Build failed in Jenkins: oozie-trunk-precommit-build #3886

2017-06-14 Thread Apache Jenkins Server
See 


--
[...truncated 700.99 KB...]
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:53)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:157)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:169)
at 
me.andrz.findbugs.diff.FindBugsDiffCli.main(FindBugsDiffCli.groovy:51)
bin/test-patch-11-findbugs-diff: line 253: : No such file or directory
bin/test-patch-11-findbugs-diff: line 255: [: -le: unary operator expected
Exception in thread "main" groovy.lang.GroovyRuntimeException: Ambiguous method 
overloading for method java.io.File#.
Cannot resolve which method to invoke for [null] due to overlapping prototypes 
between:
[class java.lang.String]
[class java.net.URI]
at 
groovy.lang.MetaClassImpl.chooseMostSpecificParams(MetaClassImpl.java:3202)
at 
groovy.lang.MetaClassImpl.chooseMethodInternal(MetaClassImpl.java:3154)
at groovy.lang.MetaClassImpl.chooseMethod(MetaClassImpl.java:3097)
at 
groovy.lang.MetaClassImpl.createConstructorSite(MetaClassImpl.java:3384)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.createCallConstructorSite(CallSiteArray.java:88)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:57)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:182)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190)
at 
me.andrz.findbugs.diff.FindBugsDiff.diffFromFilePaths(FindBugsDiff.groovy:33)
at me.andrz.findbugs.diff.FindBugsDiff$diffFromFilePaths.call(Unknown 
Source)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:120)
at me.andrz.findbugs.diff.FindBugsDiffIo.run(FindBugsDiffIo.groovy:21)
at me.andrz.findbugs.diff.FindBugsDiffIo$run.call(Unknown Source)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
at 
me.andrz.findbugs.diff.FindBugsDiffCli.handleFileOpts(FindBugsDiffCli.groovy:75)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
at 
org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite$StaticMetaMethodSiteNoUnwrapNoCoerce.invoke(StaticMetaMethodSite.java:148)
at 
org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite.callStatic(StaticMetaMethodSite.java:99)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:53)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:157)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:169)
at 
me.andrz.findbugs.diff.FindBugsDiffCli.main(FindBugsDiffCli.groovy:51)
bin/test-patch-11-findbugs-diff: line 253: : No such file or directory
bin/test-patch-11-findbugs-diff: line 255: [: -le: unary operator expected
Exception in thread "main" groovy.lang.GroovyRuntimeException: Ambiguous method 
overloading for method java.io.File#.
Cannot resolve which method to invoke for [null] due to overlapping prototypes 
between:
[class java.lang.String]
[class java.net.URI]
at 
groovy.lang.MetaClassImpl.chooseMostSpecificParams(MetaClassImpl.java:3202)
at 
groovy.lang.MetaClassImpl.chooseMethodInternal(MetaClassImpl.java:3154)
at groovy.lang.MetaClassImpl.chooseMethod(MetaClassImpl.java:3097)
at 
groovy.lang.MetaClassImpl.createConstructorSite(MetaClassImpl.java:3384)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.createCallConstructorSite(CallSiteArray.java:88)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:57)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:182)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:190)
 

[jira] [Commented] (OOZIE-2924) ./bin/mkdistro.sh reports a number instances of no @throws for Exception

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048928#comment-16048928
 ] 

Peter Cseh commented on OOZIE-2924:
---

I've retriggered the job, let's see what happens.

> ./bin/mkdistro.sh reports a number instances of no @throws for Exception
> 
>
> Key: OOZIE-2924
> URL: https://issues.apache.org/jira/browse/OOZIE-2924
> Project: Oozie
>  Issue Type: Improvement
>  Components: client, core
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Trivial
> Fix For: 5.0.0
>
> Attachments: OOZIE-2924-0.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2927) Append new line character for Hive2 query using query tag

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048924#comment-16048924
 ] 

Peter Cseh commented on OOZIE-2927:
---

[~abhishekbafna], can you add a test case for this?

> Append new line character for Hive2 query using query tag
> -
>
> Key: OOZIE-2927
> URL: https://issues.apache.org/jira/browse/OOZIE-2927
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2927-00.patch
>
>
> Without the new line character in the query, beeline does not do anything. 
> Though hive2 action completes successfully but query is not executed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2931) multiple warnings during build for "no @param for"

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048920#comment-16048920
 ] 

Peter Cseh commented on OOZIE-2931:
---

Thanks for looking into these warnings.
The raw analysis says this patch is introducing new warnings instead of fixing 
them. :)
Which Java version are you compiling with? there may be differences between 1.7 
and 1.8 that can cause this.


> multiple warnings during build for "no @param for"
> --
>
> Key: OOZIE-2931
> URL: https://issues.apache.org/jira/browse/OOZIE-2931
> Project: Oozie
>  Issue Type: Task
>  Components: action, client, core
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Trivial
> Fix For: 5.0.0
>
> Attachments: OOZIE-2931-0.patch
>
>
> {noformat}
> ./bin/mkdistro.sh -DskipTests=true
> {noformat}
> generates many warnings for "no @param for" message. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2937) Remove redundant groupId from the child pom's

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048910#comment-16048910
 ] 

Peter Cseh commented on OOZIE-2937:
---

I've triggered an other jenkins job for this one.

> Remove redundant groupId from the child pom's
> -
>
> Key: OOZIE-2937
> URL: https://issues.apache.org/jira/browse/OOZIE-2937
> Project: Oozie
>  Issue Type: Task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Trivial
> Attachments: OOZIE-2937-1.patch
>
>
> Currently all child pom's define the *groupId* again. That's not necessary, 
> because it is already defined in the parent pom. Remove the redundant 
> declarations of the *groupId*.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2938) Fix Findbugs warnings in oozie-sharelib-hive module

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048907#comment-16048907
 ] 

Peter Cseh commented on OOZIE-2938:
---

+1 
Committed to master!

> Fix Findbugs warnings in oozie-sharelib-hive module
> ---
>
> Key: OOZIE-2938
> URL: https://issues.apache.org/jira/browse/OOZIE-2938
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Fix For: 5.0.0
>
> Attachments: OOZIE-2938-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-hive* module:
> {code}
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.HiveMain.readStringFromFile(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.HiveMain] At 
> HiveMain.java:[line 336]
> [INFO] org.apache.oozie.action.hadoop.HiveMain.setUpHiveSite() may fail to 
> clean up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.HiveMain, 
> org.apache.oozie.action.hadoop.HiveMain] Obligation to clean up resource 
> created at HiveMain.java:[line 184] is not dischargedPath continues at 
> HiveMain.java:[line 185]
> [INFO] org.apache.oozie.action.hadoop.HiveMain.setUpHiveSite() may fail to 
> close stream on exception [org.apache.oozie.action.hadoop.HiveMain] At 
> HiveMain.java:[line 184]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2939) Fix Findbugs warnings related to reliance on default encoding in oozie-sharelib-hive2 module

2017-06-14 Thread Peter Cseh (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048903#comment-16048903
 ] 

Peter Cseh commented on OOZIE-2939:
---

+1


> Fix Findbugs warnings related to reliance on default encoding in 
> oozie-sharelib-hive2 module
> 
>
> Key: OOZIE-2939
> URL: https://issues.apache.org/jira/browse/OOZIE-2939
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2939-1.patch
>
>
> Currently Findbugs complains about the following warnings related to the 
> reliance on the default encoding in the *oozie-sharelib-hive2* module:
> {code}
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.Hive2Main.readStringFromFile(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.Hive2Main] At 
> Hive2Main.java:[line 278]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.Hive2Main.runBeeline(String[], String): new 
> java.io.PrintStream(OutputStream) [org.apache.oozie.action.hadoop.Hive2Main] 
> At Hive2Main.java:[line 266]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (OOZIE-1967) Fix checkstyle issues

2017-06-14 Thread Jan Hentschel (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel reassigned OOZIE-1967:


Assignee: Jan Hentschel

> Fix checkstyle issues
> -
>
> Key: OOZIE-1967
> URL: https://issues.apache.org/jira/browse/OOZIE-1967
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Shwetha G S
>Assignee: Jan Hentschel
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2946) Include find-sec-bugs plugin

2017-06-14 Thread Jan Hentschel (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel updated OOZIE-2946:
-
Attachment: OOZIE-2946-1.patch

> Include find-sec-bugs plugin
> 
>
> Key: OOZIE-2946
> URL: https://issues.apache.org/jira/browse/OOZIE-2946
> Project: Oozie
>  Issue Type: Task
>  Components: build, security
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2946-1.patch
>
>
> The [Find Security Bugs|http://find-sec-bugs.github.io/] plugin looks for 
> security bugs in Java web apps, such as Oozie. This plugin should be included 
> in the build process.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (OOZIE-2946) Include find-sec-bugs plugin

2017-06-14 Thread Jan Hentschel (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel reassigned OOZIE-2946:


Assignee: Jan Hentschel

> Include find-sec-bugs plugin
> 
>
> Key: OOZIE-2946
> URL: https://issues.apache.org/jira/browse/OOZIE-2946
> Project: Oozie
>  Issue Type: Task
>  Components: build, security
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
>
> The [Find Security Bugs|http://find-sec-bugs.github.io/] plugin looks for 
> security bugs in Java web apps, such as Oozie. This plugin should be included 
> in the build process.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (OOZIE-2933) Switch from Findbugs to Spotbugs

2017-06-14 Thread Jan Hentschel (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048801#comment-16048801
 ] 

Jan Hentschel commented on OOZIE-2933:
--

[~rkanter] Thanks for your comments. I updated the patch to the latest RC 
version and filed OOZIE-2945 for moving to the GA version as soon as it is 
available. For the "find-sec-bugs" I opened OOZIE-2946. I didn't include it in 
this patch to have a better separation.

Regarding ReviewBoard: Thanks for the hint. I will keep it in mind.

> Switch from Findbugs to Spotbugs
> 
>
> Key: OOZIE-2933
> URL: https://issues.apache.org/jira/browse/OOZIE-2933
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2933-1.patch, OOZIE-2933-2.patch, 
> oozie-findbugs-pre-commit.txt
>
>
> Because Findbugs hadn't a new release in some time other projects such as 
> Hadoop and HBase already switched to Spotbugs. This ticket proposes to switch 
> the current Findbugs implementation to Spotbugs, similar to the changes made 
> to Hadoop and HBase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (OOZIE-2946) Include find-sec-bugs plugin

2017-06-14 Thread Jan Hentschel (JIRA)
Jan Hentschel created OOZIE-2946:


 Summary: Include find-sec-bugs plugin
 Key: OOZIE-2946
 URL: https://issues.apache.org/jira/browse/OOZIE-2946
 Project: Oozie
  Issue Type: Task
  Components: build, security
Reporter: Jan Hentschel
Priority: Minor


The [Find Security Bugs|http://find-sec-bugs.github.io/] plugin looks for 
security bugs in Java web apps, such as Oozie. This plugin should be included 
in the build process.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (OOZIE-2945) Update SpotBugs to stable version after GA

2017-06-14 Thread Jan Hentschel (JIRA)
Jan Hentschel created OOZIE-2945:


 Summary: Update SpotBugs to stable version after GA
 Key: OOZIE-2945
 URL: https://issues.apache.org/jira/browse/OOZIE-2945
 Project: Oozie
  Issue Type: Task
  Components: build
Reporter: Jan Hentschel
Priority: Minor


Currently Oozie uses an RC version of SpotBugs. As soon as SpotBugs has a GA 
version the current version should be raised to the GA version.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (OOZIE-2933) Switch from Findbugs to Spotbugs

2017-06-14 Thread Jan Hentschel (JIRA)

 [ 
https://issues.apache.org/jira/browse/OOZIE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel updated OOZIE-2933:
-
Attachment: OOZIE-2933-2.patch

> Switch from Findbugs to Spotbugs
> 
>
> Key: OOZIE-2933
> URL: https://issues.apache.org/jira/browse/OOZIE-2933
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2933-1.patch, OOZIE-2933-2.patch, 
> oozie-findbugs-pre-commit.txt
>
>
> Because Findbugs hadn't a new release in some time other projects such as 
> Hadoop and HBase already switched to Spotbugs. This ticket proposes to switch 
> the current Findbugs implementation to Spotbugs, similar to the changes made 
> to Hadoop and HBase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


Jenkins build is back to normal : oozie-trunk-find-patches-available #161008

2017-06-14 Thread Apache Jenkins Server
See 




Build failed in Jenkins: oozie-trunk-find-patches-available #161007

2017-06-14 Thread Apache Jenkins Server
See 


--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 06119562194fdac8e6c7a81ca9139b8feb851af0 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 06119562194fdac8e6c7a81ca9139b8feb851af0
 > git rev-list 06119562194fdac8e6c7a81ca9139b8feb851af0 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson3419398148246501704.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0100 
 255k0  255k0 0   192k  0 --:--:--  0:00:01 --:--:--  192k100  
255k0  255k0 0   192k  0 --:--:--  0:00:01 --:--:--  192k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure


[jira] Subscription: Oozie Patch Available

2017-06-14 Thread jira
Issue Subscription
Filter: Oozie Patch Available (106 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2943  Fix Findbugs warnings in oozie-sharelib-pig
https://issues.apache.org/jira/browse/OOZIE-2943
OOZIE-2942  Fix Findbugs warnings in oozie-examples
https://issues.apache.org/jira/browse/OOZIE-2942
OOZIE-2939  Fix Findbugs warnings related to reliance on default encoding in 
oozie-sharelib-hive2 module
https://issues.apache.org/jira/browse/OOZIE-2939
OOZIE-2938  Fix Findbugs warnings in oozie-sharelib-hive module
https://issues.apache.org/jira/browse/OOZIE-2938
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues.apache.org/jira/browse/OOZIE-2937
OOZIE-2936  Fix Javadoc warnings from build
https://issues.apache.org/jira/browse/OOZIE-2936
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues.apache.org/jira/browse/OOZIE-2934
OOZIE-2933  Switch from Findbugs to Spotbugs
https://issues.apache.org/jira/browse/OOZIE-2933
OOZIE-2931  multiple warnings during build for "no @param for"
https://issues.apache.org/jira/browse/OOZIE-2931
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2924  ./bin/mkdistro.sh reports a number instances of no @throws for 
Exception
https://issues.apache.org/jira/browse/OOZIE-2924
OOZIE-2920  Document Distcp can copy files within a cluster
https://issues.apache.org/jira/browse/OOZIE-2920
OOZIE-2902  org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after 
hadoop 2.6 upgrade
https://issues.apache.org/jira/browse/OOZIE-2902
OOZIE-2884  consolidate hadoop versions in pomfiles
https://issues.apache.org/jira/browse/OOZIE-2884
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues.apache.org/jira/browse/OOZIE-2867
OOZIE-2854  Oozie should handle transient DB problems
https://issues.apache.org/jira/browse/OOZIE-2854
OOZIE-2849  Fix build warnings when assembling directories
https://issues.apache.org/jira/browse/OOZIE-2849
OOZIE-2848  Override sharelib.tgz in distro when rebuilding Oozie
https://issues.apache.org/jira/browse/OOZIE-2848
OOZIE-2846  TestSSLServerConnectorFactory fails with Jetty 9.3 and 9.4
https://issues.apache.org/jira/browse/OOZIE-2846
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders
https://issues.apache.org/jira/browse/OOZIE-2829
OOZIE-2826  Falcon feed fails to aws s3; Oozie joda time version does not meet 
required jar version 2.2 or later
https://issues.apache.org/jira/browse/OOZIE-2826
OOZIE-2815  Oozie not always display job log
https://issues.apache.org/jira/browse/OOZIE-2815
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2796  oozie.action.keep.action.dir not getting noticed
https://issues.apache.org/jira/browse/OOZIE-2796
OOZIE-2795  Create lib directory or symlink for Oozie CLI during packaging
https://issues.apache.org/jira/browse/OOZIE-2795
OOZIE-2791  ShareLib installation may fail on busy Hadoop clusters
https://issues.apache.org/jira/browse/OOZIE-2791
OOZIE-2784  Include WEEK as a parameter in the Coordinator Expression Language 
Evaulator
https://issues.apache.org/jira/browse/OOZIE-2784
OOZIE-2779  Mask Hive2 action Beeline JDBC password
https://issues.apache.org/jira/browse/OOZIE-2779
OOZIE-2769  Extend FS action to allow setrep on a file
https://issues.apache.org/jira/browse/OOZIE-2769
OOZIE-2746  Several tests failure in TestV2ValidateServlet.java
https://issues.apache.org/jira/browse/OOZIE-2746
OOZIE-2736  Reduce the number of threads during test execution
https://issues.apache.org/jira/browse/OOZIE-2736
OOZIE-2733  change org.apache.hadoop.fs.permission.AccessControlException to 
org.apache.hadoop.security.AccessControlException
https://issues.apache.org/jira/browse/OOZIE-2733