[jira] [Commented] (OOZIE-2651) Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML handling faster

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048685#comment-16048685
 ] 

Hadoop QA commented on OOZIE-2651:
--

Testing JIRA OOZIE-2651

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 4 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1966
.Tests rerun: 79
.Tests failed at first run: 
org.apache.oozie.action.hadoop.TestJavaActionExecutor,org.apache.oozie.jms.TestJMSJobEventListener,org.apache.oozie.action.hadoop.TestLauncherAM,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:green}*+1 Overall result, good!, no -1s*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3885/

> Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML handling 
> faster
> -
>
> Key: OOZIE-2651
> URL: https://issues.apache.org/jira/browse/OOZIE-2651
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Robert Kanter
> Attachments: OOZIE-2651.001.patch, OOZIE-2651.002.patch, 
> OOZIE-2651.003.patch, OOZIE-2651.004.patch, OOZIE-2651.005.patch
>
>
> We noticed from some jstacks that Oozie was spending a lot of time looking 
> for XML related jars (we do a lot of XML parsing in Oozie and Hadoop code).  
> For instance, we'd see hundreds of threads blocked here
> {noformat}
> "pool-5-thread-57" prio=10 tid=0x7f9579923000 nid=0x6b7f waiting for 
> monitor entry [0x7f94225e3000]
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1559)
> - waiting to lock <0x000500026148> (a 
> org.apache.catalina.loader.WebappClassLoader)
> at 
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526)
> at 
> javax.xml.parsers.FactoryFinder.getProviderClass(FactoryFinder.java:117)
> at javax.xml.parsers.FactoryFinder.newInstance(FactoryFinder.java:178)
> at 
> javax.xml.parsers.FactoryFinder.findJarServiceProvider(FactoryFinder.java:333)
> at javax.xml.parsers.FactoryFinder.find(FactoryFinder.java:255)
> at 
> 

Jenkins build is back to normal : oozie-trunk-precommit-build #3885

[Apache Jenkins Server]

See 

Re: [jira] [Commented] (OOZIE-2941) Old map-reduce workflow example can't work with OYA

[Dongying Jiao]

Hi Attilia:
I have Oozie share lib, it is setup during oozie installation, but oozie
share lib doesn't have map-reduce folder. Did you modify anything to make
the example map-reduce workflow run successfully?

Peter:
About the commit link you mentioned, I see MR jars are added from
map-reduce property:“mapreduce.application.classpath”, the classpath in my
cluster is:
/etc/hadoop/conf/:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/etc/hadoop/conf/secure:/usr/lib/hadoop-lzo/lib/*:/usr/iop/current/ext/hadoop/*

Not sure if my map-reduce classpath is not corrcet.
I used the 08/Jun build in oozie master branch.

Thanks for help.

Best Regards,
Dong Ying



2017-06-13 23:27 GMT+08:00 Attila Sasvari (JIRA) :

>
> [ https://issues.apache.org/jira/browse/OOZIE-2941?page=
> com.atlassian.jira.plugin.system.issuetabpanels:comment-
> tabpanel=16048022#comment-16048022 ]
>
> Attila Sasvari commented on OOZIE-2941:
> ---
>
> [~Dongying Jiao] I re-tested the mapreduce example in my local
> environment, and the workflow successfully finished. Before running the MR
> workflow, you should first install Oozie sharelib and make sure jhs is
> running. As per your previous commend, I suspect sharelib was not installed
> in your case. So I believe this issue is not the same as my experience with
> the shell action example.
>
> > Old map-reduce workflow example can't work with OYA
> > ---
> >
> > Key: OOZIE-2941
> > URL: https://issues.apache.org/jira/browse/OOZIE-2941
> > Project: Oozie
> >  Issue Type: Sub-task
> >  Components: workflow
> >Affects Versions: trunk
> >Reporter: Dongying Jiao
> > Attachments: RM_UI.jpg
> >
> >
> > map-reduce workflow in Oozie examples run failed after OYA merged. The
> exception in yarn log is:
> > Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapred/Mapper
> >   at java.lang.ClassLoader.defineClass1(Native Method)
> >   at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> >   at java.security.SecureClassLoader.defineClass(
> SecureClassLoader.java:142)
> >   at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
> >   at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
> >   at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
> >   at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
> >   at java.security.AccessController.doPrivileged(Native Method)
> >   at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
> >   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> >   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> >   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >   at org.apache.oozie.action.hadoop.LauncherAM.
> getMainArguments(LauncherAM.java:540)
> >   at org.apache.oozie.action.hadoop.LauncherAM.run(
> LauncherAM.java:170)
> >   at org.apache.oozie.action.hadoop.LauncherAM.main(
> LauncherAM.java:148)
> > Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.
> Mapper
> >   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> >   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> >   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> >   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> >   ... 15 more
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.4.14#64029)
>

[jira] [Updated] (OOZIE-2651) Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML handling faster

[Robert Kanter (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Kanter updated OOZIE-2651:
-
Attachment: OOZIE-2651.005.patch

The 005 patch:
- Adds unit tests

> Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML handling 
> faster
> -
>
> Key: OOZIE-2651
> URL: https://issues.apache.org/jira/browse/OOZIE-2651
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Affects Versions: trunk
>Reporter: Robert Kanter
>Assignee: Robert Kanter
> Attachments: OOZIE-2651.001.patch, OOZIE-2651.002.patch, 
> OOZIE-2651.003.patch, OOZIE-2651.004.patch, OOZIE-2651.005.patch
>
>
> We noticed from some jstacks that Oozie was spending a lot of time looking 
> for XML related jars (we do a lot of XML parsing in Oozie and Hadoop code).  
> For instance, we'd see hundreds of threads blocked here
> {noformat}
> "pool-5-thread-57" prio=10 tid=0x7f9579923000 nid=0x6b7f waiting for 
> monitor entry [0x7f94225e3000]
>java.lang.Thread.State: BLOCKED (on object monitor)
> at 
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1559)
> - waiting to lock <0x000500026148> (a 
> org.apache.catalina.loader.WebappClassLoader)
> at 
> org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526)
> at 
> javax.xml.parsers.FactoryFinder.getProviderClass(FactoryFinder.java:117)
> at javax.xml.parsers.FactoryFinder.newInstance(FactoryFinder.java:178)
> at 
> javax.xml.parsers.FactoryFinder.findJarServiceProvider(FactoryFinder.java:333)
> at javax.xml.parsers.FactoryFinder.find(FactoryFinder.java:255)
> at 
> javax.xml.parsers.DocumentBuilderFactory.newInstance(DocumentBuilderFactory.java:121)
> at 
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2526)
> at 
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2503)
> at 
> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2409)
> - locked <0x0007eac5ea28> (a org.apache.hadoop.conf.Configuration)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1144)
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1116)
> at org.apache.oozie.util.XConfiguration.copy(XConfiguration.java:206)
> ...
> {noformat}
> There's nothing we can do about the lock at the {{WebappClassLoader}}, but by 
> setting the {{javax.xml.parsers.DocumentBuilderFactory}} system property to 
> {{org.apache.xerces.jaxp.DocumentBuilderFactoryImpl}}, we can speed this up a 
> lot by getting rid of all of the searching that it's doing to find the 
> implementation.  
> See 
> https://docs.oracle.com/javase/7/docs/api/javax/xml/parsers/DocumentBuilderFactory.html#newInstance()
>  
> and 
> https://www.databasesandlife.com/java-always-explicitly-specify-which-xml-parser-to-use/
> In our testing, we had a metric around creating a new {{JobClient}}, which 
> also calls {{DocumentBuilderFactory.newInstance}}, and it dropped from ~3min 
> max to ~2sec max (not an exact test of the savings here).  And we also didn't 
> see so much blocking on this in the jstacks anymore.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2935) Fix "concatenates strings using + in a loop" Findbugs error in oozie-sharelib-streaming

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048557#comment-16048557
 ] 

Robert Kanter commented on OOZIE-2935:
--

+1

> Fix "concatenates strings using + in a loop" Findbugs error in 
> oozie-sharelib-streaming
> ---
>
> Key: OOZIE-2935
> URL: https://issues.apache.org/jira/browse/OOZIE-2935
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2935-1.patch
>
>
> Currently Findbugs complaints about "concatenates strings using + in a loop" 
> in the *sharelib-streaming* module. This should be fixed to get the code more 
> reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2825) Custom Authentication doc page is not well formatted

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048554#comment-16048554
 ] 

Robert Kanter commented on OOZIE-2825:
--

+1

> Custom Authentication doc page is not well formatted
> 
>
> Key: OOZIE-2825
> URL: https://issues.apache.org/jira/browse/OOZIE-2825
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Laszlo Zeke
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2825-1.patch, OOZIE-2825-2.patch, 
> OOZIE-2825-3.patch, OOZIE-2825-4.patch
>
>
> At line 30 there's a verbatim tag staring but don't end.
> Also at line 45 a paragraph is staring but it does not make a lot of sense 
> with a code sample seems to be cut in half.
> All in ENG_Custom_Authentication.twiki



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Review Request 57799: OOZIE-2825 Fixed custom Authentication doc page

[Robert Kanter]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/57799/#review177848
---


Ship it!




Ship It!

- Robert Kanter


On April 4, 2017, 12:39 p.m., Jan Hentschel wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/57799/
> ---
> 
> (Updated April 4, 2017, 12:39 p.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-2825
> https://issues.apache.org/jira/browse/OOZIE-2825
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> Fixed the code sample in the custom authentication page in the documentation.
> 
> 
> Diffs
> -
> 
>   docs/src/site/twiki/ENG_Custom_Authentication.twiki 64334b6e 
> 
> 
> Diff: https://reviews.apache.org/r/57799/diff/4/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Jan Hentschel
> 
>

[jira] [Commented] (OOZIE-2747) README.txt is out of date

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048543#comment-16048543
 ] 

Robert Kanter commented on OOZIE-2747:
--

+1

> README.txt is out of date
> -
>
> Key: OOZIE-2747
> URL: https://issues.apache.org/jira/browse/OOZIE-2747
> Project: Oozie
>  Issue Type: Sub-task
>  Components: docs
>Affects Versions: 4.0.0
>Reporter: Robert Kanter
>Assignee: Jan Hentschel
> Fix For: 5.0.0
>
> Attachments: OOZIE-2747-1.patch
>
>
> The README.txt file is out of date.  The main text may require some updating 
> as it hasn't been touched in a while, but the really obvious problems here 
> are that it refers to 
> "http://oozie.apache.org/docs/3.2.0-incubating/DG_QuickStart.html; 
> (3.2.0-incubating version) and says "This version of Oozie was primarily 
> tested against Hadoop 0.20.205.x. This will not work on earlier versions of 
> Hadoop such as 0.20.x. and 0.21." which way off.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2933) Switch from Findbugs to Spotbugs

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048542#comment-16048542
 ] 

Robert Kanter commented on OOZIE-2933:
--

Thanks for doing this [~Jan Hentschel], I hadn't realized that findbugs is so 
old.  A few minor things:
# Looks like there's an 3.1.0 RC3 now, released not long ago; we may as well 
use that one.  https://github.com/spotbugs/spotbugs/releases
# Please file a followup JIRA to update to 3.1.0 GA release once it's out.  
It's best to not use RCs, but in this case I think it's okay.  In any case, we 
should try to update again once it's GA.
# The spotbugs website mentioned this "find-sec-bugs" plugin, which looks for 
security bugs in Java web apps, which is essentially what Oozie is.  It would 
be great if we could add this plugin while we're here.  
http://find-sec-bugs.github.io/  Feel free to file this as a followup JIRA if 
you don't feel like working on it now though.

By the way, we typically only use ReviewBoard for large/complicated changes or 
if someone asks.  For simpler fixes, we don't usually bother.  

> Switch from Findbugs to Spotbugs
> 
>
> Key: OOZIE-2933
> URL: https://issues.apache.org/jira/browse/OOZIE-2933
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Minor
> Attachments: OOZIE-2933-1.patch, oozie-findbugs-pre-commit.txt
>
>
> Because Findbugs hadn't a new release in some time other projects such as 
> Hadoop and HBase already switched to Spotbugs. This ticket proposes to switch 
> the current Findbugs implementation to Spotbugs, similar to the changes made 
> to Hadoop and HBase.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2867) Timezone handling for Coordinators: emphasize "Continent/City" format

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048532#comment-16048532
 ] 

Robert Kanter commented on OOZIE-2867:
--

# On the unit test, I wasn't thinking - you're right.  I think this can be done 
but it's really messy.  Instead, you could make {{THREE_LETTER_ID_PATTERN}} 
package private and label it {{\@VisibleForTesting}} and just have the unit 
test use it directly.  It would be nice to simply call the method, but I think 
this is the best compromise.
# I don't think we need the {{seleniumhq}} or {{com.opera}} artifacts, right?
# The nested if statement can be merged into one if statement:
{code:java}
if (m.matches() && !tzId.equalsIgnoreCase("UTC") && 
!tzId.equalsIgnoreCase("GMT")) {
   ...
{code}

> Timezone handling for Coordinators: emphasize "Continent/City" format
> -
>
> Key: OOZIE-2867
> URL: https://issues.apache.org/jira/browse/OOZIE-2867
> Project: Oozie
>  Issue Type: Sub-task
>  Components: coordinator
>Affects Versions: 4.3.0
>Reporter: Andras Piros
>Assignee: Artem Ervits
> Fix For: 5.0.0
>
> Attachments: OOZIE-2867-0.patch, OOZIE-2867-1.patch, 
> OOZIE-2867-2.patch, OOZIE-2867-3.patch, OOZIE-2867-4.patch
>
>
> It seems that some time zone abbreviations like {{BST}} for British Summer 
> Time silently just do not get accepted correctly by Oozie and the underlying 
> JVM.
> It would be great to:
> * emphasize in the Coordinator Functional Specification that it's best to 
> only use time zone format {{Continent/City}}, like {{Europe/London}}, or 
> {{America/Los_Angeles}}, instead of other formats like {{PDT}}, {{PST}}, or 
> {{BST}}
> * if the timezone is not recognized by Oozie, it's best to emit a {{WARN}} 
> log and suppose {{UTC}} instead of silently ignoring the unknown specified 
> timezone



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2920) Document Distcp can copy files within a cluster

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048527#comment-16048527
 ] 

Robert Kanter commented on OOZIE-2920:
--

#1 Ok, then I guess you can leave that
#2 Yes, please update both
#3 You can build the docs by adding {{-DgenerateDocs}} to the {{mvn}} command 
when building Oozie.  That should create the html files, and you can go and 
check in your browser that the link works correctly.

> Document Distcp can copy files within a cluster
> ---
>
> Key: OOZIE-2920
> URL: https://issues.apache.org/jira/browse/OOZIE-2920
> Project: Oozie
>  Issue Type: Improvement
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Trivial
> Fix For: 4.3.0
>
> Attachments: OOZIE-2920-0.patch, OOZIE-2920-1.patch, 
> OOZIE-2920-2.patch
>
>
> The FS action doesn't support a "copy" action.  We should update the 
> documentation to point to the DistCp action to help users looking for that 
> functionality.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2944) Shell action example does not work with Oozie on Yarn on hadoop 2.6

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048258#comment-16048258
 ] 

Robert Kanter commented on OOZIE-2944:
--

{{LauncherAM}} should use {{Configuration}} instead of {{JobConf}}.

> Shell action example does not work with Oozie on Yarn on hadoop 2.6
> ---
>
> Key: OOZIE-2944
> URL: https://issues.apache.org/jira/browse/OOZIE-2944
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
>
> I tried to execute example shell action with a pseudo hadoop 2.6.0. The 
> workflow failed with the exception below :
> {code}
> $ ~/workspace/pseudo/hadoop-2.6.0/bin/yarn logs --applicationId 
> application_1497357254962_0005
> 17/06/13 15:59:09 INFO client.RMProxy: Connecting to ResourceManager at 
> /0.0.0.0:8032
> 17/06/13 15:59:09 WARN util.NativeCodeLoader: Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> Container: container_1497357254962_0005_01_01 on 172.30.64.221_55437
> ==
> LogType:stderr
> Log Upload Time:13-Jun-2017 15:58:45
> LogLength:1397
> Log Contents:
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/mapred/Mapper
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at 
> org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
> at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
> at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 15 more
> LogType:stdout
> Log Upload Time:13-Jun-2017 15:58:45
> LogLength:2152
> Log Contents:
> Submitter user is: asasvari
> log4j: Trying to find [container-log4j.properties] using context classloader 
> sun.misc.Launcher$AppClassLoader@6bc7c054.
> log4j: Using URL 
> [jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties]
>  for automatic log4j configuration.
> log4j: Reading configuration from URL 
> jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties
> log4j: Hierarchy threshold set to [ALL].
> log4j: Parsing for [root] with value=[INFO,CLA, EventCounter].
> log4j: Level token is [INFO].
> log4j: Category root set to INFO
> log4j: Parsing appender named "CLA".
> log4j: Parsing layout options for "CLA".
> log4j: Setting property [conversionPattern] to [%d{ISO8601} %p [%t] %c: %m%n].
> log4j: End of parsing for "CLA".
> log4j: Setting property [containerLogDir] to 
> [/Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1497357254962_0005/container_1497357254962_0005_01_01].
> log4j: Setting property [totalLogFileSize] to [0].
> log4j: setFile called: 
> /Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1497357254962_0005/container_1497357254962_0005_01_01/syslog,
>  true
> log4j: setFile ended
> log4j: Parsed "CLA" options.
> log4j: Parsing appender named "EventCounter".
> log4j: Parsed "EventCounter" options.
> log4j: Finished configuring.
> Using login user for UGI
> Launcher AM configuration loaded
> Starting the execution of prepare actions
> Completed the execution of prepare actions successfully
> Failing Oozie Launcher, null
> Oozie Launcher, uploading action data to HDFS sequence file: 
> hdfs://localhost:9000/user/asasvari/oozie-asas/002-170613150915408-oozie-asas-W/shell-node--shell/action-data.seq
> Stopping AM
> Callback notification attempts left 0
> Callback notification trying 
> http://0.0.0.0:11000/oozie/callback?id=002-170613150915408-oozie-asas-W@shell-node=FAILED
> Callback notification to 
> 

[jira] [Commented] (OOZIE-2944) Shell action example does not work with Oozie on Yarn on hadoop 2.6

[Attila Sasvari (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048160#comment-16048160
 ] 

Attila Sasvari commented on OOZIE-2944:
---

I changed a LauncherMapper so that it does not extend the Mapper class and 
rebuilt Oozie. I submitted the shell example that now failed with another, but 
similar, reason:

{code}
Exception in thread "main" java.lang.NoClassDefFoundError: 
org/apache/hadoop/mapred/JobConf
at 
org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 3 more
{code}
If I override {{needToAddMapReduceToClassPath()}} in {{ShellActionExecutor}}, 
so that it returns true, shell example workflow passes (verified).  

>From this, I suppose each ActionExecutor that extends JavaActionExecutor will 
>fail if they do not override {{needToAddMapReduceToClassPath()}} and MR is not 
>in the class path. 

> Shell action example does not work with Oozie on Yarn on hadoop 2.6
> ---
>
> Key: OOZIE-2944
> URL: https://issues.apache.org/jira/browse/OOZIE-2944
> Project: Oozie
>  Issue Type: Bug
>Reporter: Attila Sasvari
>
> I tried to execute example shell action with a pseudo hadoop 2.6.0. The 
> workflow failed with the exception below :
> {code}
> $ ~/workspace/pseudo/hadoop-2.6.0/bin/yarn logs --applicationId 
> application_1497357254962_0005
> 17/06/13 15:59:09 INFO client.RMProxy: Connecting to ResourceManager at 
> /0.0.0.0:8032
> 17/06/13 15:59:09 WARN util.NativeCodeLoader: Unable to load native-hadoop 
> library for your platform... using builtin-java classes where applicable
> Container: container_1497357254962_0005_01_01 on 172.30.64.221_55437
> ==
> LogType:stderr
> Log Upload Time:13-Jun-2017 15:58:45
> LogLength:1397
> Log Contents:
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/mapred/Mapper
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at 
> org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
> at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
> at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 15 more
> LogType:stdout
> Log Upload Time:13-Jun-2017 15:58:45
> LogLength:2152
> Log Contents:
> Submitter user is: asasvari
> log4j: Trying to find [container-log4j.properties] using context classloader 
> sun.misc.Launcher$AppClassLoader@6bc7c054.
> log4j: Using URL 
> [jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties]
>  for automatic log4j configuration.
> log4j: Reading configuration from URL 
> jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties
> log4j: Hierarchy threshold set to [ALL].
> log4j: Parsing for [root] with value=[INFO,CLA, EventCounter].
> log4j: Level token is [INFO].
> log4j: Category root set to INFO
> log4j: Parsing appender named "CLA".
> log4j: Parsing layout options for "CLA".
> log4j: Setting property [conversionPattern] to [%d{ISO8601} %p [%t] %c: %m%n].
> log4j: End of parsing for "CLA".
> log4j: Setting property 

[jira] [Created] (OOZIE-2944) Shell action example does not work with Oozie on Yarn on hadoop 2.6

[Attila Sasvari (JIRA)]

Attila Sasvari created OOZIE-2944:
-

 Summary: Shell action example does not work with Oozie on Yarn on 
hadoop 2.6
 Key: OOZIE-2944
 URL: https://issues.apache.org/jira/browse/OOZIE-2944
 Project: Oozie
  Issue Type: Bug
Reporter: Attila Sasvari


I tried to execute example shell action with a pseudo hadoop 2.6.0. The 
workflow failed with the exception below :

{code}
$ ~/workspace/pseudo/hadoop-2.6.0/bin/yarn logs --applicationId 
application_1497357254962_0005

17/06/13 15:59:09 INFO client.RMProxy: Connecting to ResourceManager at 
/0.0.0.0:8032
17/06/13 15:59:09 WARN util.NativeCodeLoader: Unable to load native-hadoop 
library for your platform... using builtin-java classes where applicable

Container: container_1497357254962_0005_01_01 on 172.30.64.221_55437
==

LogType:stderr
Log Upload Time:13-Jun-2017 15:58:45
LogLength:1397
Log Contents:

Exception in thread "main" java.lang.NoClassDefFoundError: 
org/apache/hadoop/mapred/Mapper

at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 15 more

LogType:stdout
Log Upload Time:13-Jun-2017 15:58:45
LogLength:2152
Log Contents:

Submitter user is: asasvari

log4j: Trying to find [container-log4j.properties] using context classloader 
sun.misc.Launcher$AppClassLoader@6bc7c054.
log4j: Using URL 
[jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties]
 for automatic log4j configuration.
log4j: Reading configuration from URL 
jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties
log4j: Hierarchy threshold set to [ALL].
log4j: Parsing for [root] with value=[INFO,CLA, EventCounter].
log4j: Level token is [INFO].
log4j: Category root set to INFO
log4j: Parsing appender named "CLA".
log4j: Parsing layout options for "CLA".
log4j: Setting property [conversionPattern] to [%d{ISO8601} %p [%t] %c: %m%n].
log4j: End of parsing for "CLA".
log4j: Setting property [containerLogDir] to 
[/Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1497357254962_0005/container_1497357254962_0005_01_01].
log4j: Setting property [totalLogFileSize] to [0].
log4j: setFile called: 
/Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1497357254962_0005/container_1497357254962_0005_01_01/syslog,
 true
log4j: setFile ended
log4j: Parsed "CLA" options.
log4j: Parsing appender named "EventCounter".
log4j: Parsed "EventCounter" options.
log4j: Finished configuring.
Using login user for UGI
Launcher AM configuration loaded

Starting the execution of prepare actions
Completed the execution of prepare actions successfully

Failing Oozie Launcher, null

Oozie Launcher, uploading action data to HDFS sequence file: 
hdfs://localhost:9000/user/asasvari/oozie-asas/002-170613150915408-oozie-asas-W/shell-node--shell/action-data.seq

Stopping AM
Callback notification attempts left 0
Callback notification trying 
http://0.0.0.0:11000/oozie/callback?id=002-170613150915408-oozie-asas-W@shell-node=FAILED
Callback notification to 
http://0.0.0.0:11000/oozie/callback?id=002-170613150915408-oozie-asas-W@shell-node=FAILED
 succeeded

Callback notification succeeded

LogType:syslog
Log Upload Time:13-Jun-2017 15:58:45
LogLength:1215
Log Contents:

2017-06-13 15:58:43,105 WARN [main] org.apache.hadoop.util.NativeCodeLoader: 
Unable to load native-hadoop library for your platform... using builtin-java 
classes where applicable
2017-06-13 15:58:43,271 INFO [main] 

[jira] [Commented] (OOZIE-2941) Old map-reduce workflow example can't work with OYA

[Attila Sasvari (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048022#comment-16048022
 ] 

Attila Sasvari commented on OOZIE-2941:
---

[~Dongying Jiao] I re-tested the mapreduce example in my local environment, and 
the workflow successfully finished. Before running the MR workflow, you should 
first install Oozie sharelib and make sure jhs is running. As per your previous 
commend, I suspect sharelib was not installed in your case. So I believe this 
issue is not the same as my experience with the shell action example.

> Old map-reduce workflow example can't work with OYA
> ---
>
> Key: OOZIE-2941
> URL: https://issues.apache.org/jira/browse/OOZIE-2941
> Project: Oozie
>  Issue Type: Sub-task
>  Components: workflow
>Affects Versions: trunk
>Reporter: Dongying Jiao
> Attachments: RM_UI.jpg
>
>
> map-reduce workflow in Oozie examples run failed after OYA merged. The 
> exception in yarn log is:
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/mapred/Mapper
>   at java.lang.ClassLoader.defineClass1(Native Method)
>   at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
>   at 
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>   at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
>   at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 15 more



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2941) Old map-reduce workflow example can't work with OYA

[Attila Sasvari (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047989#comment-16047989
 ] 

Attila Sasvari commented on OOZIE-2941:
---

[~Dongying Jiao], [~gezapeti] Today I experienced the same issue with the shell 
action example (I was using a pseudo hadoop 2.6.0 for my test).

{code}
$ ~/workspace/pseudo/hadoop-2.6.0/bin/yarn logs --applicationId 
application_1497357254962_0005

17/06/13 15:59:09 INFO client.RMProxy: Connecting to ResourceManager at 
/0.0.0.0:8032
17/06/13 15:59:09 WARN util.NativeCodeLoader: Unable to load native-hadoop 
library for your platform... using builtin-java classes where applicable

Container: container_1497357254962_0005_01_01 on 172.30.64.221_55437
==

LogType:stderr
Log Upload Time:13-Jun-2017 15:58:45
LogLength:1397
Log Contents:

Exception in thread "main" java.lang.NoClassDefFoundError: 
org/apache/hadoop/mapred/Mapper

at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at 
org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 15 more

LogType:stdout
Log Upload Time:13-Jun-2017 15:58:45
LogLength:2152
Log Contents:

Submitter user is: asasvari

log4j: Trying to find [container-log4j.properties] using context classloader 
sun.misc.Launcher$AppClassLoader@6bc7c054.
log4j: Using URL 
[jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties]
 for automatic log4j configuration.
log4j: Reading configuration from URL 
jar:file:/Users/asasvari/workspace/pseudo/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.6.0.jar!/container-log4j.properties
log4j: Hierarchy threshold set to [ALL].
log4j: Parsing for [root] with value=[INFO,CLA, EventCounter].
log4j: Level token is [INFO].
log4j: Category root set to INFO
log4j: Parsing appender named "CLA".
log4j: Parsing layout options for "CLA".
log4j: Setting property [conversionPattern] to [%d{ISO8601} %p [%t] %c: %m%n].
log4j: End of parsing for "CLA".
log4j: Setting property [containerLogDir] to 
[/Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1497357254962_0005/container_1497357254962_0005_01_01].
log4j: Setting property [totalLogFileSize] to [0].
log4j: setFile called: 
/Users/asasvari/workspace/pseudo/hadoop-2.6.0/logs/userlogs/application_1497357254962_0005/container_1497357254962_0005_01_01/syslog,
 true
log4j: setFile ended
log4j: Parsed "CLA" options.
log4j: Parsing appender named "EventCounter".
log4j: Parsed "EventCounter" options.
log4j: Finished configuring.
Using login user for UGI
Launcher AM configuration loaded

Starting the execution of prepare actions
Completed the execution of prepare actions successfully

Failing Oozie Launcher, null

Oozie Launcher, uploading action data to HDFS sequence file: 
hdfs://localhost:9000/user/asasvari/oozie-asas/002-170613150915408-oozie-asas-W/shell-node--shell/action-data.seq

Stopping AM
Callback notification attempts left 0
Callback notification trying 
http://0.0.0.0:11000/oozie/callback?id=002-170613150915408-oozie-asas-W@shell-node=FAILED
Callback notification to 
http://0.0.0.0:11000/oozie/callback?id=002-170613150915408-oozie-asas-W@shell-node=FAILED
 succeeded

Callback notification succeeded

LogType:syslog
Log Upload Time:13-Jun-2017 15:58:45
LogLength:1215
Log Contents:

2017-06-13 15:58:43,105 WARN [main] org.apache.hadoop.util.NativeCodeLoader: 
Unable to load native-hadoop library for your platform... using builtin-java 
classes where applicable
2017-06-13 15:58:43,271 INFO [main] org.apache.hadoop.yarn.client.RMProxy: 
Connecting to ResourceManager at /0.0.0.0:8030
2017-06-13 15:58:43,844 INFO [main] 

[jira] [Comment Edited] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Jan Hentschel (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047970#comment-16047970
 ] 

Jan Hentschel edited comment on OOZIE-2942 at 6/13/17 2:35 PM:
---

The test failures seem to be unrelated to the actual changes.


was (Author: jan hentschel):
The test failures seem to be unrelated to the actual change.

> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
> stream on exception [org.apache.oozie.example.DateList] At 
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in 
> org.apache.oozie.example.DateList.main(String[]) 
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method 
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called 
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource 
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues 
> at LocalOozieExample.java:[line 76]Path continues at 
> LocalOozieExample.java:[line 77]Path continues at 
> LocalOozieExample.java:[line 78]Path continues at 
> LocalOozieExample.java:[line 81]Path continues at 
> LocalOozieExample.java:[line 88]Path continues at 
> LocalOozieExample.java:[line 89]Path continues at 
> LocalOozieExample.java:[line 91]Path continues at 
> LocalOozieExample.java:[line 100]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to close stream [org.apache.oozie.example.LocalOozieExample] At 
> LocalOozieExample.java:[line 72]
> [INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal 
> representation by returning Repeatable.baseline 
> [org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
> [INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose 
> internal representation by storing an externally mutable object into 
> Repeatable.baseline [org.apache.oozie.example.Repeatable] At 
> Repeatable.java:[line 172]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Jan Hentschel (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047970#comment-16047970
 ] 

Jan Hentschel commented on OOZIE-2942:
--

The test failures seem to be unrelated to the actual change.

> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
> stream on exception [org.apache.oozie.example.DateList] At 
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in 
> org.apache.oozie.example.DateList.main(String[]) 
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method 
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called 
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource 
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues 
> at LocalOozieExample.java:[line 76]Path continues at 
> LocalOozieExample.java:[line 77]Path continues at 
> LocalOozieExample.java:[line 78]Path continues at 
> LocalOozieExample.java:[line 81]Path continues at 
> LocalOozieExample.java:[line 88]Path continues at 
> LocalOozieExample.java:[line 89]Path continues at 
> LocalOozieExample.java:[line 91]Path continues at 
> LocalOozieExample.java:[line 100]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to close stream [org.apache.oozie.example.LocalOozieExample] At 
> LocalOozieExample.java:[line 72]
> [INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal 
> representation by returning Repeatable.baseline 
> [org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
> [INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose 
> internal representation by storing an externally mutable object into 
> Repeatable.baseline [org.apache.oozie.example.Repeatable] At 
> Repeatable.java:[line 172]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2941) Old map-reduce workflow example can't work with OYA

[Peter Cseh (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047951#comment-16047951
 ] 

Peter Cseh commented on OOZIE-2941:
---

Thanks for looking into this!

This failure is strange. The MR action should have the MR jars on it's 
classpath just like it had before.
https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java#L1090
https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java#L346


> Old map-reduce workflow example can't work with OYA
> ---
>
> Key: OOZIE-2941
> URL: https://issues.apache.org/jira/browse/OOZIE-2941
> Project: Oozie
>  Issue Type: Sub-task
>  Components: workflow
>Affects Versions: trunk
>Reporter: Dongying Jiao
> Attachments: RM_UI.jpg
>
>
> map-reduce workflow in Oozie examples run failed after OYA merged. The 
> exception in yarn log is:
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/mapred/Mapper
>   at java.lang.ClassLoader.defineClass1(Native Method)
>   at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
>   at 
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
>   at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
>   at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   at 
> org.apache.oozie.action.hadoop.LauncherAM.getMainArguments(LauncherAM.java:540)
>   at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:170)
>   at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:148)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.Mapper
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>   ... 15 more



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047937#comment-16047937
 ] 

Hadoop QA commented on OOZIE-2942:
--

Testing JIRA OOZIE-2942

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [examples].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1963
.Tests failed: 1
.Tests errors: 2

.The patch failed the following testcases:

.  testNofindLogs(org.apache.oozie.util.TestTimestampedMessageParser)

.Tests failing with errors:
.  
testProcessRemainingLog(org.apache.oozie.util.TestTimestampedMessageParser)
.  
testProcessRemainingCoordinatorLogForActions(org.apache.oozie.util.TestTimestampedMessageParser)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3884/

> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
> stream on exception [org.apache.oozie.example.DateList] At 
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in 
> org.apache.oozie.example.DateList.main(String[]) 
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method 
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called 
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> 

Build failed in Jenkins: oozie-trunk-precommit-build #3884

[Apache Jenkins Server]

See 


--
[...truncated 906.86 KB...]
[INFO] Copying xbean-asm5-shaded-3.17.jar to 

[INFO] Copying serp-1.15.1.jar to 

[INFO] Copying asm-5.0.1.jar to 

[INFO] Copying openjpa-lib-2.4.1.jar to 

[INFO] Copying opencsv-2.3.jar to 

[INFO] Copying jasper-runtime-5.5.23.jar to 

[INFO] Copying curator-client-2.5.0.jar to 

[INFO] Copying jetty-annotations-9.2.19.v20160908.jar to 

[INFO] Copying jersey-server-1.9.jar to 

[INFO] Copying oozie-sharelib-oozie-5.0.0-SNAPSHOT.jar to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-distro ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-distro ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/distro.xml
[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] Building tar : 

[INFO] 
[INFO] 
[INFO] Building Apache Oozie ZooKeeper Security Tests 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- 

Build failed in Jenkins: oozie-trunk-precommit-build #3883

[Apache Jenkins Server]

See 


--
[...truncated 904.46 KB...]
[INFO] Copying jetty-rewrite-9.2.19.v20160908.jar to 

[INFO] Copying hadoop-yarn-common-2.6.0.jar to 

[INFO] Copying commons-collections-3.2.1.jar to 

[INFO] Copying geronimo-jpa_2.0_spec-1.1.jar to 

[INFO] Copying hadoop-mapreduce-client-core-2.6.0.jar to 

[INFO] Copying json-20090211.jar to 

[INFO] Copying jersey-client-1.9.jar to 

[INFO] Copying jetty-schemas-3.1.M0.jar to 

[INFO] Copying hadoop-hdfs-2.6.0.jar to 

[INFO] Copying xbean-asm5-shaded-3.17.jar to 

[INFO] Copying serp-1.15.1.jar to 

[INFO] Copying asm-5.0.1.jar to 

[INFO] Copying openjpa-lib-2.4.1.jar to 

[INFO] Copying opencsv-2.3.jar to 

[INFO] Copying jasper-runtime-5.5.23.jar to 

[INFO] Copying curator-client-2.5.0.jar to 

[INFO] Copying jetty-annotations-9.2.19.v20160908.jar to 

[INFO] Copying jersey-server-1.9.jar to 

[INFO] Copying oozie-sharelib-oozie-5.0.0-SNAPSHOT.jar to 

[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 5.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor 

[jira] [Commented] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047863#comment-16047863
 ] 

Hadoop QA commented on OOZIE-2943:
--

Testing JIRA OOZIE-2943

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1963
.Tests rerun: 72
.Tests failed at first run: 
org.apache.oozie.command.coord.TestCoordKillXCommand,org.apache.oozie.action.hadoop.TestJavaActionExecutor,org.apache.oozie.action.hadoop.TestLauncherAM,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3883/

> Fix Findbugs warnings in oozie-sharelib-pig
> ---
>
> Key: OOZIE-2943
> URL: https://issues.apache.org/jira/browse/OOZIE-2943
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2943-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-pig* module:
> {code}
> [INFO] 
> org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map)
>  makes inefficient use of keySet iterator instead of entrySet iterator 
> [org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 
> 130]
> [INFO] Dead store to klass in 
> org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
> boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.writeExternalData(String, File): new 
> java.io.FileWriter(File) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 408]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to clean 
> up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMain, 
> org.apache.oozie.action.hadoop.PigMain] Obligation to clean up resource 
> created at PigMain.java:[line 130] is not dischargedPath continues at 

[jira] [Updated] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Jan Hentschel (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel updated OOZIE-2942:
-
Attachment: OOZIE-2942-2.patch

Trying to fix build warnings.

> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
> stream on exception [org.apache.oozie.example.DateList] At 
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in 
> org.apache.oozie.example.DateList.main(String[]) 
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method 
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called 
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource 
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues 
> at LocalOozieExample.java:[line 76]Path continues at 
> LocalOozieExample.java:[line 77]Path continues at 
> LocalOozieExample.java:[line 78]Path continues at 
> LocalOozieExample.java:[line 81]Path continues at 
> LocalOozieExample.java:[line 88]Path continues at 
> LocalOozieExample.java:[line 89]Path continues at 
> LocalOozieExample.java:[line 91]Path continues at 
> LocalOozieExample.java:[line 100]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to close stream [org.apache.oozie.example.LocalOozieExample] At 
> LocalOozieExample.java:[line 72]
> [INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal 
> representation by returning Repeatable.baseline 
> [org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
> [INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose 
> internal representation by storing an externally mutable object into 
> Repeatable.baseline [org.apache.oozie.example.Repeatable] At 
> Repeatable.java:[line 172]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047740#comment-16047740
 ] 

Hadoop QA commented on OOZIE-2942:
--

Testing JIRA OOZIE-2942

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:red}-1{color} the patch contains 10 line(s) with tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 6 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1963
.Tests rerun: 18
.Tests failed at first run: 
org.apache.oozie.action.hadoop.TestHdfsOperations,org.apache.oozie.jms.TestJMSJobEventListener,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/oozie-trunk-precommit-build/3882/

> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2942-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
> stream on exception [org.apache.oozie.example.DateList] At 
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in 
> org.apache.oozie.example.DateList.main(String[]) 
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method 
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called 
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource 
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues 
> at 

[jira] [Updated] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

[Jan Hentschel (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel updated OOZIE-2943:
-
Attachment: OOZIE-2943-1.patch

> Fix Findbugs warnings in oozie-sharelib-pig
> ---
>
> Key: OOZIE-2943
> URL: https://issues.apache.org/jira/browse/OOZIE-2943
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2943-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-pig* module:
> {code}
> [INFO] 
> org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map)
>  makes inefficient use of keySet iterator instead of entrySet iterator 
> [org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 
> 130]
> [INFO] Dead store to klass in 
> org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
> boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMain.writeExternalData(String, File): new 
> java.io.FileWriter(File) [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 408]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to clean 
> up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMain, 
> org.apache.oozie.action.hadoop.PigMain] Obligation to clean up resource 
> created at PigMain.java:[line 130] is not dischargedPath continues at 
> PigMain.java:[line 131]
> [INFO] org.apache.oozie.action.hadoop.PigMain.handleError(String) may fail to 
> close stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 307]
> [INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to close 
> stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
> PigMain.java:[line 130]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI] 
> At PigMainWithOldAPI.java:[line 265]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]): new 
> java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to clean up java.io.OutputStream on checked exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] Obligation to clean up 
> resource created at PigMainWithOldAPI.java:[line 101] is not dischargedPath 
> continues at PigMainWithOldAPI.java:[line 102]
> [INFO] 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 265]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 101]Another occurrence at 
> PigMainWithOldAPI.java:[line 242]
> [INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may 
> fail to close stream on exception 
> [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
> org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
> PigMainWithOldAPI.java:[line 126]Another occurrence at 
> PigMainWithOldAPI.java:[line 219]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Review Request 60044: OOZIE-2943 Fix Findbugs warnings in oozie-sharelib-pig

[Jan Hentschel]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60044/
---

Review request for oozie.


Bugs: OOZIE-2943
https://issues.apache.org/jira/browse/OOZIE-2943


Repository: oozie-git


Description
---

Fixed the Findbugs warnings in the **oozie-sharelib-pig** module.


Diffs
-

  sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java 
c3a31b59 
  sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java 
5a9123a7 
  
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMainWithOldAPI.java
 0ee4b0b6 


Diff: https://reviews.apache.org/r/60044/diff/1/


Testing
---


Thanks,

Jan Hentschel

[jira] [Created] (OOZIE-2943) Fix Findbugs warnings in oozie-sharelib-pig

[Jan Hentschel (JIRA)]

Jan Hentschel created OOZIE-2943:


 Summary: Fix Findbugs warnings in oozie-sharelib-pig
 Key: OOZIE-2943
 URL: https://issues.apache.org/jira/browse/OOZIE-2943
 Project: Oozie
  Issue Type: Sub-task
  Components: build
Reporter: Jan Hentschel
Assignee: Jan Hentschel


Currently Findbugs complains about the following warnings in the 
*oozie-sharelib-pig* module:

{code}
[INFO] 
org.apache.oozie.action.hadoop.OoziePigStats.toJSONFromMultiStoreCounters(Map) 
makes inefficient use of keySet iterator instead of entrySet iterator 
[org.apache.oozie.action.hadoop.OoziePigStats] At OoziePigStats.java:[line 130]
[INFO] Dead store to klass in 
org.apache.oozie.action.hadoop.PigMain.runPigJob(String[], String, boolean, 
boolean) [org.apache.oozie.action.hadoop.PigMain] At PigMain.java:[line 335]
[INFO] Found reliance on default encoding in 
org.apache.oozie.action.hadoop.PigMain.handleError(String): new 
java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMain] At 
PigMain.java:[line 307]
[INFO] Found reliance on default encoding in 
org.apache.oozie.action.hadoop.PigMain.writeExternalData(String, File): new 
java.io.FileWriter(File) [org.apache.oozie.action.hadoop.PigMain] At 
PigMain.java:[line 408]
[INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to clean 
up java.io.OutputStream on checked exception 
[org.apache.oozie.action.hadoop.PigMain, 
org.apache.oozie.action.hadoop.PigMain] Obligation to clean up resource created 
at PigMain.java:[line 130] is not dischargedPath continues at 
PigMain.java:[line 131]
[INFO] org.apache.oozie.action.hadoop.PigMain.handleError(String) may fail to 
close stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
PigMain.java:[line 307]
[INFO] org.apache.oozie.action.hadoop.PigMain.run(String[]) may fail to close 
stream on exception [org.apache.oozie.action.hadoop.PigMain] At 
PigMain.java:[line 130]
[INFO] Found reliance on default encoding in 
org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String): new 
java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI] 
At PigMainWithOldAPI.java:[line 265]
[INFO] Found reliance on default encoding in 
org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]): new 
java.io.FileReader(String) [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
PigMainWithOldAPI.java:[line 126]Another occurrence at 
PigMainWithOldAPI.java:[line 219]
[INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may fail 
to clean up java.io.OutputStream on checked exception 
[org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
org.apache.oozie.action.hadoop.PigMainWithOldAPI] Obligation to clean up 
resource created at PigMainWithOldAPI.java:[line 101] is not dischargedPath 
continues at PigMainWithOldAPI.java:[line 102]
[INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.getHadoopJobIds(String) 
may fail to close stream on exception 
[org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
PigMainWithOldAPI.java:[line 265]
[INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may fail 
to close stream on exception [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
PigMainWithOldAPI.java:[line 101]Another occurrence at 
PigMainWithOldAPI.java:[line 242]
[INFO] org.apache.oozie.action.hadoop.PigMainWithOldAPI.run(String[]) may fail 
to close stream on exception [org.apache.oozie.action.hadoop.PigMainWithOldAPI, 
org.apache.oozie.action.hadoop.PigMainWithOldAPI] At 
PigMainWithOldAPI.java:[line 126]Another occurrence at 
PigMainWithOldAPI.java:[line 219]
{code}

They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Jan Hentschel (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jan Hentschel updated OOZIE-2942:
-
Attachment: OOZIE-2942-1.patch

> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
> Attachments: OOZIE-2942-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
> stream on exception [org.apache.oozie.example.DateList] At 
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in 
> org.apache.oozie.example.DateList.main(String[]) 
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method 
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called 
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample, 
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource 
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues 
> at LocalOozieExample.java:[line 76]Path continues at 
> LocalOozieExample.java:[line 77]Path continues at 
> LocalOozieExample.java:[line 78]Path continues at 
> LocalOozieExample.java:[line 81]Path continues at 
> LocalOozieExample.java:[line 88]Path continues at 
> LocalOozieExample.java:[line 89]Path continues at 
> LocalOozieExample.java:[line 91]Path continues at 
> LocalOozieExample.java:[line 100]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail 
> to close stream [org.apache.oozie.example.LocalOozieExample] At 
> LocalOozieExample.java:[line 72]
> [INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal 
> representation by returning Repeatable.baseline 
> [org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
> [INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose 
> internal representation by storing an externally mutable object into 
> Repeatable.baseline [org.apache.oozie.example.Repeatable] At 
> Repeatable.java:[line 172]
> {code}
> They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Review Request 60039: OOZIE-2942 Fix Findbugs warnings in oozie-examples

[Jan Hentschel]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60039/
---

Review request for oozie.


Bugs: OOZIE-2942
https://issues.apache.org/jira/browse/OOZIE-2942


Repository: oozie-git


Description
---

Fixed the Findbugs warning in the **oozie-examples** module.


Diffs
-

  examples/src/main/java/org/apache/oozie/example/DateList.java 7e574cbe 
  examples/src/main/java/org/apache/oozie/example/LocalOozieExample.java 
c9f5697c 
  examples/src/main/java/org/apache/oozie/example/Repeatable.java ee863251 


Diff: https://reviews.apache.org/r/60039/diff/1/


Testing
---


Thanks,

Jan Hentschel

[jira] [Created] (OOZIE-2942) Fix Findbugs warnings in oozie-examples

[Jan Hentschel (JIRA)]

Jan Hentschel created OOZIE-2942:


 Summary: Fix Findbugs warnings in oozie-examples
 Key: OOZIE-2942
 URL: https://issues.apache.org/jira/browse/OOZIE-2942
 Project: Oozie
  Issue Type: Sub-task
  Components: build
Reporter: Jan Hentschel
Assignee: Jan Hentschel


Currently Findbugs complains about the following warnings in the 
*oozie-examples* module:

{code}
[INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close 
stream on exception [org.apache.oozie.example.DateList] At DateList.java:[line 
69]
[INFO] Nullcheck of date at line 55 of value previously dereferenced in 
org.apache.oozie.example.DateList.main(String[]) 
[org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At 
DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
[INFO] Private method org.apache.oozie.example.DateList.formatDateUTC(Calendar) 
is never called [org.apache.oozie.example.DateList] At DateList.java:[line 97]
[INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail to 
clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample, 
org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource 
created at LocalOozieExample.java:[line 72] is not dischargedPath continues at 
LocalOozieExample.java:[line 76]Path continues at LocalOozieExample.java:[line 
77]Path continues at LocalOozieExample.java:[line 78]Path continues at 
LocalOozieExample.java:[line 81]Path continues at LocalOozieExample.java:[line 
88]Path continues at LocalOozieExample.java:[line 89]Path continues at 
LocalOozieExample.java:[line 91]Path continues at LocalOozieExample.java:[line 
100]
[INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail to 
close stream [org.apache.oozie.example.LocalOozieExample] At 
LocalOozieExample.java:[line 72]
[INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal 
representation by returning Repeatable.baseline 
[org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
[INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose 
internal representation by storing an externally mutable object into 
Repeatable.baseline [org.apache.oozie.example.Repeatable] At 
Repeatable.java:[line 172]
{code}

They should be fixed to get the code more reliable.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Jenkins build is back to normal : oozie-trunk-find-patches-available #160877

[Apache Jenkins Server]

See 

Build failed in Jenkins: oozie-trunk-find-patches-available #160876

[Apache Jenkins Server]

See 


--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 378f294c2cd92ac0d505201857f03746ce2e58ac 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 378f294c2cd92ac0d505201857f03746ce2e58ac
 > git rev-list 378f294c2cd92ac0d505201857f03746ce2e58ac # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson922290132582541110.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0100 
 423k0  423k0 0   296k  0 --:--:--  0:00:01 --:--:--  296k100  
879k0  879k0 0   351k  0 --:--:--  0:00:02 --:--:--  351k100  
879k0  879k0 0   351k  0 --:--:--  0:00:02 --:--:--  351k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] Subscription: Oozie Patch Available

[jira]

Issue Subscription
Filter: Oozie Patch Available (107 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2939  Fix Findbugs warnings related to reliance on default encoding in 
oozie-sharelib-hive2 module
https://issues.apache.org/jira/browse/OOZIE-2939
OOZIE-2938  Fix Findbugs warnings in oozie-sharelib-hive module
https://issues.apache.org/jira/browse/OOZIE-2938
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues.apache.org/jira/browse/OOZIE-2937
OOZIE-2936  Fix Javadoc warnings from build
https://issues.apache.org/jira/browse/OOZIE-2936
OOZIE-2935  Fix "concatenates strings using + in a loop" Findbugs error in 
oozie-sharelib-streaming
https://issues.apache.org/jira/browse/OOZIE-2935
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues.apache.org/jira/browse/OOZIE-2934
OOZIE-2933  Switch from Findbugs to Spotbugs
https://issues.apache.org/jira/browse/OOZIE-2933
OOZIE-2931  multiple warnings during build for "no @param for"
https://issues.apache.org/jira/browse/OOZIE-2931
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2924  ./bin/mkdistro.sh reports a number instances of no @throws for 
Exception
https://issues.apache.org/jira/browse/OOZIE-2924
OOZIE-2920  Document Distcp can copy files within a cluster
https://issues.apache.org/jira/browse/OOZIE-2920
OOZIE-2902  org.apache.oozie.action.hadoop.TestJavaActionExecutor fails after 
hadoop 2.6 upgrade
https://issues.apache.org/jira/browse/OOZIE-2902
OOZIE-2884  consolidate hadoop versions in pomfiles
https://issues.apache.org/jira/browse/OOZIE-2884
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues.apache.org/jira/browse/OOZIE-2867
OOZIE-2854  Oozie should handle transient DB problems
https://issues.apache.org/jira/browse/OOZIE-2854
OOZIE-2849  Fix build warnings when assembling directories
https://issues.apache.org/jira/browse/OOZIE-2849
OOZIE-2848  Override sharelib.tgz in distro when rebuilding Oozie
https://issues.apache.org/jira/browse/OOZIE-2848
OOZIE-2846  TestSSLServerConnectorFactory fails with Jetty 9.3 and 9.4
https://issues.apache.org/jira/browse/OOZIE-2846
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders
https://issues.apache.org/jira/browse/OOZIE-2829
OOZIE-2826  Falcon feed fails to aws s3; Oozie joda time version does not meet 
required jar version 2.2 or later
https://issues.apache.org/jira/browse/OOZIE-2826
OOZIE-2825  Custom Authentication doc page is not well formatted
https://issues.apache.org/jira/browse/OOZIE-2825
OOZIE-2815  Oozie not always display job log
https://issues.apache.org/jira/browse/OOZIE-2815
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2796  oozie.action.keep.action.dir not getting noticed
https://issues.apache.org/jira/browse/OOZIE-2796
OOZIE-2795  Create lib directory or symlink for Oozie CLI during packaging
https://issues.apache.org/jira/browse/OOZIE-2795
OOZIE-2791  ShareLib installation may fail on busy Hadoop clusters
https://issues.apache.org/jira/browse/OOZIE-2791
OOZIE-2784  Include WEEK as a parameter in the Coordinator Expression Language 
Evaulator
https://issues.apache.org/jira/browse/OOZIE-2784
OOZIE-2779  Mask Hive2 action Beeline JDBC password
https://issues.apache.org/jira/browse/OOZIE-2779
OOZIE-2769  Extend FS action to allow setrep on a file
https://issues.apache.org/jira/browse/OOZIE-2769
OOZIE-2747  README.txt is out of date
https://issues.apache.org/jira/browse/OOZIE-2747
OOZIE-2746  Several tests failure in TestV2ValidateServlet.java
https://issues.apache.org/jira/browse/OOZIE-2746
OOZIE-2736  Reduce the number of threads during test execution
https://issues.apache.org/jira/browse/OOZIE-2736
OOZIE-2733  change