[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (103 issues) Subscriber: ooziedaily Key Summary OOZIE-3168 Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh https://issues.apache.org/jira/browse/OOZIE-3168 OOZIE-3163 improve documentation rendering: use fluido skin and better config https://issues.apache.org/jira/browse/OOZIE-3163 OOZIE-3157 Setup truststore so that it also works in HTTP only mode https://issues.apache.org/jira/browse/OOZIE-3157 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3121 bump all maven plugins to latest versions https://issues.apache.org/jira/browse/OOZIE-3121 OOZIE-3105 testJMXInstrumentation from the org.apache.oozie.util.TestMetricsInstrumentation class is flaky https://issues.apache.org/jira/browse/OOZIE-3105 OOZIE-3094 fix for grammar mistake https://issues.apache.org/jira/browse/OOZIE-3094 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-3002 address findbugs errors in client lib https://issues.apache.org/jira/browse/OOZIE-3002 OOZIE-2975 code clean up in pig sharelib, replace Exception with more explicit, add try with resources, StringBuilder instead of StringBuffer https://issues.apache.org/jira/browse/OOZIE-2975 OOZIE-2957 Documentation states that starting a coordinator is possible https://issues.apache.org/jira/browse/OOZIE-2957 OOZIE-2956 Fix Findbugs warnings related to reliance on default encoding in oozie-core https://issues.apache.org/jira/browse/OOZIE-2956 OOZIE-2955 Fix Findbugs warnings related to reliance on default encoding in oozie-client https://issues.apache.org/jira/browse/OOZIE-2955 OOZIE-2954 Fix Checkstyle issues in oozie-client https://issues.apache.org/jira/browse/OOZIE-2954 OOZIE-2953 Fix Checkstyle issues in oozie-tools https://issues.apache.org/jira/browse/OOZIE-2953 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues.apache.org/jira/browse/OOZIE-2949 OOZIE-2942 Fix Findbugs warnings in oozie-examples https://issues.apache.org/jira/browse/OOZIE-2942 OOZIE-2937 Remove redundant groupId from the child pom's https://issues.apache.org/jira/browse/OOZIE-2937 OOZIE-2934 Fix "Exceptional return value of java.io.File.mkdirs() ignored" Findbugs error in oozie-sharelib-spark https://issues.apache.org/jira/browse/OOZIE-2934 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2914 Consolidate Trim https://issues.apache.org/jira/browse/OOZIE-2914 OOZIE-2883 OOZIE throw the error "Missing [oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups] property" https://issues.apache.org/jira/browse/OOZIE-2883 OOZIE-2877 Oozie Git Action https://issues.apache.org/jira/browse/OOZIE-2877 OOZIE-2867 Timezone handling for Coordinators: emphasize "Continent/City" format https://issues.apache.org/jira/browse/OOZIE-2867 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2829 Improve sharelib upload to accept multiple source folders https://issues.apache.org/jira/browse/OOZIE-2829 OOZIE-2826 Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later https://issues.apache.org/jira/browse/OOZIE-2826 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2791 ShareLib installation may fail on busy Hadoop clusters https://issues.apache.org/jira/browse/OOZIE-2791 OOZIE-2784 Include WEEK as a parameter in the
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (111 issues) Subscriber: ooziedaily Key Summary OOZIE-3129 Fix test TestConfigurationService.testOozieConfig https://issues-test.apache.org/jira/browse/OOZIE-3129 OOZIE-3127 Remove redundant check for user https://issues-test.apache.org/jira/browse/OOZIE-3127 OOZIE-3126 Add option to allow list of users to access system config https://issues-test.apache.org/jira/browse/OOZIE-3126 OOZIE-3121 bump all maven plugins to latest versions https://issues-test.apache.org/jira/browse/OOZIE-3121 OOZIE-3118 fix for error: self-closing element not allowed https://issues-test.apache.org/jira/browse/OOZIE-3118 OOZIE-3117 fix for warning: no @throws for https://issues-test.apache.org/jira/browse/OOZIE-3117 OOZIE-3116 fix for warning: no description for @throws https://issues-test.apache.org/jira/browse/OOZIE-3116 OOZIE-3115 fix for javadoc warning: empty tag https://issues-test.apache.org/jira/browse/OOZIE-3115 OOZIE-3113 Retry for ZK lock release https://issues-test.apache.org/jira/browse/OOZIE-3113 OOZIE-3112 SparkConfigrationService overwrites properties provided via --properties-file option in SparkAction https://issues-test.apache.org/jira/browse/OOZIE-3112 OOZIE-3105 testJMXInstrumentation from the org.apache.oozie.util.TestMetricsInstrumentation class is flaky https://issues-test.apache.org/jira/browse/OOZIE-3105 OOZIE-3094 fix for grammar mistake https://issues-test.apache.org/jira/browse/OOZIE-3094 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues-test.apache.org/jira/browse/OOZIE-3091 OOZIE-3083 Make improved version Info backward compatible https://issues-test.apache.org/jira/browse/OOZIE-3083 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues-test.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues-test.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues-test.apache.org/jira/browse/OOZIE-3062 OOZIE-3002 address findbugs errors in client lib https://issues-test.apache.org/jira/browse/OOZIE-3002 OOZIE-2975 code clean up in pig sharelib, replace Exception with more explicit, add try with resources, StringBuilder instead of StringBuffer https://issues-test.apache.org/jira/browse/OOZIE-2975 OOZIE-2973 Make sure Oozie works with Hadoop 3 https://issues-test.apache.org/jira/browse/OOZIE-2973 OOZIE-2969 Drop support for Java 1.7 https://issues-test.apache.org/jira/browse/OOZIE-2969 OOZIE-2957 Documentation states that starting a coordinator is possible https://issues-test.apache.org/jira/browse/OOZIE-2957 OOZIE-2956 Fix Findbugs warnings related to reliance on default encoding in oozie-core https://issues-test.apache.org/jira/browse/OOZIE-2956 OOZIE-2955 Fix Findbugs warnings related to reliance on default encoding in oozie-client https://issues-test.apache.org/jira/browse/OOZIE-2955 OOZIE-2954 Fix Checkstyle issues in oozie-client https://issues-test.apache.org/jira/browse/OOZIE-2954 OOZIE-2953 Fix Checkstyle issues in oozie-tools https://issues-test.apache.org/jira/browse/OOZIE-2953 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues-test.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues-test.apache.org/jira/browse/OOZIE-2949 OOZIE-2942 Fix Findbugs warnings in oozie-examples https://issues-test.apache.org/jira/browse/OOZIE-2942 OOZIE-2937 Remove redundant groupId from the child pom's https://issues-test.apache.org/jira/browse/OOZIE-2937 OOZIE-2934 Fix "Exceptional return value of java.io.File.mkdirs() ignored" Findbugs error in oozie-sharelib-spark https://issues-test.apache.org/jira/browse/OOZIE-2934 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues-test.apache.org/jira/browse/OOZIE-2927 OOZIE-2914 Consolidate Trim https://issues-test.apache.org/jira/browse/OOZIE-2914 OOZIE-2883 OOZIE throw the error "Missing [oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups] property" https://issues-test.apache.org/jira/browse/OOZIE-2883 OOZIE-2877 Oozie Git Action https://issues-test.apache.org/jira/browse/OOZIE-2877 OOZIE-2867 Timezone handling for Coordinators: emphasize "Continent/City" format https://issues-test.apache.org/jira/browse/OOZIE-2867 OOZIE-2834 ParameterVerifier logging
[jira] [Commented] (OOZIE-1717) Index user_name column
[
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340407#comment-16340407
]
Hadoop QA commented on OOZIE-1717:
--
Testing JIRA OOZIE-1717
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2087
.Tests failed: 2
.Tests errors: 0
.The patch failed the following testcases:
testRerun(org.apache.oozie.action.hadoop.TestRerun)
testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
.Tests failing with errors:
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/350/
> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
> Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch, OOZIE-1717-01.patch
>
>
> User_name is one of the frequently used filter. Adding index should avoid
> full db scan.
> Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Failed: OOZIE-1717 PreCommit Build #350
Jira: https://issues.apache.org/jira/browse/OOZIE-1717
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/350/
###
## LAST 100 LINES OF THE CONSOLE
###
[...truncated 1.63 MB...]
[DEBUG] There are no new bugs found in [server].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [core].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [examples].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [tools].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2187 bytes
[TRACE] Full summary file size is 1248 bytes
[TRACE] File
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
removed
[TRACE] File
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
removed
Running test-patch task BACKWARDS_COMPATIBILITY
Running test-patch task TESTS
Running test-patch task DISTRO
Testing JIRA OOZIE-1717
Cleaning local git workspace
+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
+1 There are no new bugs found in [client].
+1 There are no new bugs found in [sharelib/hive].
+1 There are no new bugs found in [sharelib/sqoop].
+1 There are no new bugs found in [sharelib/spark].
+1 There are no new bugs found in [sharelib/streaming].
+1 There are no new bugs found in [sharelib/hive2].
+1 There are no new bugs found in [sharelib/oozie].
+1 There are no new bugs found in [sharelib/hcatalog].
+1 There are no new bugs found in [sharelib/pig].
+1 There are no new bugs found in [sharelib/distcp].
+1 There are no new bugs found in [docs].
+1 There are no new bugs found in [server].
+1 There are no new bugs found in [core].
+1 There are no new bugs found in [examples].
+1 There are no new bugs found in [tools].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2087
Tests failed: 2
Tests errors: 0
The patch failed the following testcases:
testRerun(org.apache.oozie.action.hadoop.TestRerun)
testActionCheck(org.apache.oozie.command.wf.TestActionCheckXCommand)
Tests failing with errors:
+1 DISTRO
+1 distro tarball builds with the patch
-1 Overall result, please check the reported -1(s)
There is at least one warning, please check
The full output of the test-patch run is available at
https://builds.apache.org/job/PreCommit-OOZIE-Build/350/
Adding comment to JIRA
% Total% Received % Xferd Average Speed TimeTime Time Current
Dload Upload Total SpentLeft Speed
0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0
0 00 00 0 0 0 --:--:-- --:--:-- --:--:--
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/12697804/comment/16340407","id":"16340407","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
at hadoop dot apache dot
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA
OOZIE-1717\n\nCleaning local git
workspace\n\n\n\n{color:green}+1
PATCH_APPLIES{color}\n{color:green}+1 CLEAN{color}\n{color:red}-1
RAW_PATCH_ANALYSIS{color}\n.{color:green}+1{color} the patch does not
introduce any @author tags\n.{color:green}+1{color} the patch does not
introduce any tabs\n.
[jira] [Commented] (OOZIE-1717) Index user_name column
[ https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340302#comment-16340302 ] Hadoop QA commented on OOZIE-1717: -- PreCommit-OOZIE-Build started > Index user_name column > -- > > Key: OOZIE-1717 > URL: https://issues.apache.org/jira/browse/OOZIE-1717 > Project: Oozie > Issue Type: Bug >Reporter: Purshotam Shah >Assignee: Attila Sasvari >Priority: Minor > Attachments: OOZIE-1717-00.patch, OOZIE-1717-01.patch > > > User_name is one of the frequently used filter. Adding index should avoid > full db scan. > Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-1717) Index user_name column
[ https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Sasvari updated OOZIE-1717: -- Attachment: OOZIE-1717-01.patch > Index user_name column > -- > > Key: OOZIE-1717 > URL: https://issues.apache.org/jira/browse/OOZIE-1717 > Project: Oozie > Issue Type: Bug >Reporter: Purshotam Shah >Assignee: Attila Sasvari >Priority: Minor > Attachments: OOZIE-1717-00.patch, OOZIE-1717-01.patch > > > User_name is one of the frequently used filter. Adding index should avoid > full db scan. > Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-1717) Index user_name column
[
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340291#comment-16340291
]
Attila Sasvari commented on OOZIE-1717:
---
[~todd.farmer] thanks for the recommendation.
Oozie uses OpenJPA 2.4.2 to talk with databases (Oracle, PostgreSQL, etc. are
also supported). OpenJPA 2.4.2 supports only [JPA
2.0|http://openjpa.apache.org/]. Do you know how we can define a covering
composite index with OpenJPA, I could not find it in the documentation.
I tried the following things in org.apache.oozie.CoordinatorJobBean
{code:java}
@Index(name = "index1", columnNames = {"status, created_time"})
@Index(name = "index2", columnNames = {"status", "created_time"}){code}
but none of them resulted in a composite index. The [Table
annotation|[https://github.com/apache/oozie/blob/acdf291aef48fd0f9a5b0e3270afacb7ee4a1543/core/src/main/java/org/apache/oozie/CoordinatorJobBean.java#L158|https://github.com/apache/oozie/blob/acdf291aef48fd0f9a5b0e3270afacb7ee4a1543/core/src/main/java/org/apache/oozie/CoordinatorJobBean.java#L158]]]
in CoordinatorJobBean did not accept indices either.
I can see in
[OozieDBCLI|https://github.com/apache/oozie/blob/acdf291aef48fd0f9a5b0e3270afacb7ee4a1543/tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java#L977]
that a clustered index is created "manually". We can follow this pattern if
really needed.
It would be good to have a list for more interesting (composite) indexes.
> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
> Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch
>
>
> User_name is one of the frequently used filter. Adding index should avoid
> full db scan.
> Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (OOZIE-2942) Fix Findbugs warnings in oozie-examples
[
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340217#comment-16340217
]
Hadoop QA commented on OOZIE-2942:
--
Testing JIRA OOZIE-2942
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2087
.Tests failed: 1
.Tests errors: 1
.The patch failed the following testcases:
testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
.Tests failing with errors:
testNewUsingACLs(org.apache.oozie.util.TestZKUtilsWithSecurity)
.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/349/
> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
> Issue Type: Sub-task
> Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close
> stream on exception [org.apache.oozie.example.DateList] At
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in
> org.apache.oozie.example.DateList.main(String[])
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
>
Failed: OOZIE-2942 PreCommit Build #349
Jira: https://issues.apache.org/jira/browse/OOZIE-2942
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/349/
###
## LAST 100 LINES OF THE CONSOLE
###
[...truncated 1.58 MB...]
[DEBUG] There are no new bugs found in [examples].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [docs].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [server].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2187 bytes
[TRACE] Full summary file size is 1248 bytes
[TRACE] File
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build@2/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
removed
[TRACE] File
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build@2/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
removed
Running test-patch task BACKWARDS_COMPATIBILITY
Running test-patch task TESTS
Running test-patch task DISTRO
Testing JIRA OOZIE-2942
Cleaning local git workspace
+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
+1 There are no new bugs found in [core].
+1 There are no new bugs found in [tools].
+1 There are no new bugs found in [sharelib/hive2].
+1 There are no new bugs found in [sharelib/distcp].
+1 There are no new bugs found in [sharelib/hcatalog].
+1 There are no new bugs found in [sharelib/streaming].
+1 There are no new bugs found in [sharelib/sqoop].
+1 There are no new bugs found in [sharelib/oozie].
+1 There are no new bugs found in [sharelib/pig].
+1 There are no new bugs found in [sharelib/hive].
+1 There are no new bugs found in [sharelib/spark].
+1 There are no new bugs found in [client].
+1 There are no new bugs found in [examples].
+1 There are no new bugs found in [docs].
+1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2087
Tests failed: 1
Tests errors: 1
The patch failed the following testcases:
testHiveAction(org.apache.oozie.action.hadoop.TestHiveActionExecutor)
Tests failing with errors:
testNewUsingACLs(org.apache.oozie.util.TestZKUtilsWithSecurity)
Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch
-1 Overall result, please check the reported -1(s)
There is at least one warning, please check
The full output of the test-patch run is available at
https://builds.apache.org/job/PreCommit-OOZIE-Build/349/
Adding comment to JIRA
% Total% Received % Xferd Average Speed TimeTime Time Current
Dload Upload Total SpentLeft Speed
0 00 00 0 0 0 --:--:-- --:--:-- --:--:--
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13079413/comment/16340217","id":"16340217","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
at hadoop dot apache dot
org","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA
OOZIE-2942\n\nCleaning local git
workspace\n\n\n\n{color:green}+1
PATCH_APPLIES{color}\n{color:green}+1 CLEAN{color}\n{color:red}-1
RAW_PATCH_ANALYSIS{color}\n.{color:green}+1{color} the patch does not
introduce any @author tags\n.{color:green}+1{color} the patch does not
introduce any tabs\n.{color:green}+1{color} the patch does not introduce
any
[jira] [Resolved] (OOZIE-1266) Oozie MapReduce failing to run
[ https://issues.apache.org/jira/browse/OOZIE-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved OOZIE-1266. -- Resolution: Cannot Reproduce Fix Version/s: (was: 3.3.1) > Oozie MapReduce failing to run > --- > > Key: OOZIE-1266 > URL: https://issues.apache.org/jira/browse/OOZIE-1266 > Project: Oozie > Issue Type: Bug > Components: examples >Affects Versions: 3.3.1 >Reporter: srikanth ayalasomayajulu >Priority: Major > Labels: hadoop023, mapreduce, oozie > Original Estimate: 24h > Remaining Estimate: 24h > > Installed oozie 3.3.1 on apache hadoop 0.23.3, when trying to run an > mapreduce example on the oozie, the following error is occurring. > 2013-03-11 15:29:27,760 INFO ActionStartXCommand:539 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@:start:] Start action > [000-130311152909237-oozie-srik-W@:start:] with user-retry state : > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > 2013-03-11 15:29:27,761 WARN ActionStartXCommand:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@:start:] > [***000-130311152909237-oozie-srik-W@:start:***]Action status=DONE > 2013-03-11 15:29:27,762 WARN ActionStartXCommand:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@:start:] > [***000-130311152909237-oozie-srik-W@:start:***]Action updated in DB! > 2013-03-11 15:29:28,106 INFO ActionStartXCommand:539 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] Start action > [000-130311152909237-oozie-srik-W@mr-node] with user-retry state : > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > 2013-03-11 15:29:28,447 WARN MapReduceActionExecutor:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] credentials is null for > the action > 2013-03-11 15:29:31,521 INFO MapReduceActionExecutor:539 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] checking action, > external ID [job_1362986780726_0001] status [RUNNING] > 2013-03-11 15:29:31,524 WARN ActionStartXCommand:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] > [***000-130311152909237-oozie-srik-W@mr-node***]Action status=RUNNING > 2013-03-11 15:29:31,524 WARN ActionStartXCommand:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] > [***000-130311152909237-oozie-srik-W@mr-node***]Action updated in DB! > 2013-03-11 15:40:26,462 INFO MapReduceActionExecutor:539 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] action completed, > external ID [job_1362986780726_0001] > 2013-03-11 15:40:26,483 WARN MapReduceActionExecutor:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] LauncherMapper died, > check Hadoop log for job [localhost:8040:job_1362986780726_0001] > 2013-03-11 15:40:26,615 INFO ActionEndXCommand:539 - USER[srikanth] GROUP[-] > TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@mr-node] ERROR is considered as > FAILED for SLA > 2013-03-11 15:40:26,669 INFO ActionStartXCommand:539 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@fail] Start action > [000-130311152909237-oozie-srik-W@fail] with user-retry state : > userRetryCount [0], userRetryMax [0], userRetryInterval [10] > 2013-03-11 15:40:26,670 WARN ActionStartXCommand:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@fail] > [***000-130311152909237-oozie-srik-W@fail***]Action status=DONE > 2013-03-11 15:40:26,671 WARN ActionStartXCommand:542 - USER[srikanth] > GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[000-130311152909237-oozie-srik-W] > ACTION[000-130311152909237-oozie-srik-W@fail] >
Failed: OOZIE-2975 PreCommit Build #348
Jira: https://issues.apache.org/jira/browse/OOZIE-2975
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/348/
###
## LAST 100 LINES OF THE CONSOLE
###
[...truncated 696.87 KB...]
[INFO]
[INFO] Total time: 04:05 min
[INFO] Finished at: 2018-01-25T20:57:46Z
[INFO] Final Memory: 650M/1906M
[INFO]
[TRACE] FindBugs output in HEAD verified and saved
Running test-patch task BACKWARDS_COMPATIBILITY
Running test-patch task TESTS
Running test-patch task DISTRO
Applying patch
Checking patch
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java...
Checking patch
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java...
Hunk #1 succeeded at 275 (offset -9 lines).
error: while searching for:
// write external data(stats, hadoopIds) to the file which will be read by
the LauncherMapper
private static void writeExternalData(String data, File f) throws
IOException {
BufferedWriter out = null;
try {
out = new BufferedWriter(new OutputStreamWriter(new
FileOutputStream(f), "UTF-8"));
out.write(data);
}
finally {
if (out != null) {
out.close();
}
}
}
/**
error: patch failed:
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:402
error: sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java:
patch does not apply
Checking patch
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMainWithOldAPI.java...
error:
sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/PigMainWithOldAPI.java:
No such file or directory
Checking patch
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigActionExecutor.java...
Checking patch
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java...
Hunk #1 succeeded at 68 (offset 7 lines).
Hunk #2 succeeded at 101 (offset 7 lines).
error: while searching for:
new LauncherSecurityManager();
String user = System.getProperty("user.name");
try {
Writer wr = new FileWriter(pigProps);
props.store(wr, "");
wr.close();
PigMain.main(null);
}
catch (SecurityException ex) {
error: patch failed:
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java:118
error:
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java:
patch does not apply
Checking patch
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMainWithOldAPI.java...
error:
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMainWithOldAPI.java:
No such file or directory
Checking patch
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/UDFTester.java...
error: while searching for:
String query = (String) input.get(0);
return query.toLowerCase().trim();
}
catch (Exception e) {
System.err.println("ToLower: failed to process input; error - " +
e.getMessage());
return null;
}
error: patch failed:
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/UDFTester.java:38
error:
sharelib/pig/src/test/java/org/apache/oozie/action/hadoop/UDFTester.java: patch
does not apply
Checking patch
pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java...
error: pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java: No
such file or directory
Checking patch pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java...
error: pig/src/main/java/org/apache/oozie/action/hadoop/PigMain.java: No such
file or directory
Checking patch
pig/src/main/java/org/apache/oozie/action/hadoop/PigMainWithOldAPI.java...
error: pig/src/main/java/org/apache/oozie/action/hadoop/PigMainWithOldAPI.java:
No such file or directory
Checking patch
pig/src/test/java/org/apache/oozie/action/hadoop/TestPigActionExecutor.java...
error:
pig/src/test/java/org/apache/oozie/action/hadoop/TestPigActionExecutor.java: No
such file or directory
Checking patch
pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java...
error: pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMain.java: No
such file or directory
Checking patch
pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMainWithOldAPI.java...
error:
pig/src/test/java/org/apache/oozie/action/hadoop/TestPigMainWithOldAPI.java: No
such file or directory
Checking patch
pig/src/test/java/org/apache/oozie/action/hadoop/UDFTester.java...
error: pig/src/test/java/org/apache/oozie/action/hadoop/UDFTester.java: No such
file or directory
Patch failed to apply to head of branch
Adding comment to JIRA
% Total% Received % Xferd
[jira] [Commented] (OOZIE-2942) Fix Findbugs warnings in oozie-examples
[
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339861#comment-16339861
]
Hadoop QA commented on OOZIE-2942:
--
PreCommit-OOZIE-Build started
> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
> Issue Type: Sub-task
> Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close
> stream on exception [org.apache.oozie.example.DateList] At
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in
> org.apache.oozie.example.DateList.main(String[])
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues
> at LocalOozieExample.java:[line 76]Path continues at
> LocalOozieExample.java:[line 77]Path continues at
> LocalOozieExample.java:[line 78]Path continues at
> LocalOozieExample.java:[line 81]Path continues at
> LocalOozieExample.java:[line 88]Path continues at
> LocalOozieExample.java:[line 89]Path continues at
> LocalOozieExample.java:[line 91]Path continues at
> LocalOozieExample.java:[line 100]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail
> to close stream [org.apache.oozie.example.LocalOozieExample] At
> LocalOozieExample.java:[line 72]
> [INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal
> representation by returning Repeatable.baseline
> [org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
> [INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose
> internal representation by storing an externally mutable object into
> Repeatable.baseline [org.apache.oozie.example.Repeatable] At
> Repeatable.java:[line 172]
> {code}
> They should be fixed to get the code more reliable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (OOZIE-2975) code clean up in pig sharelib, replace Exception with more explicit, add try with resources, StringBuilder instead of StringBuffer
[ https://issues.apache.org/jira/browse/OOZIE-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339858#comment-16339858 ] Hadoop QA commented on OOZIE-2975: -- PreCommit-OOZIE-Build started > code clean up in pig sharelib, replace Exception with more explicit, add try > with resources, StringBuilder instead of StringBuffer > -- > > Key: OOZIE-2975 > URL: https://issues.apache.org/jira/browse/OOZIE-2975 > Project: Oozie > Issue Type: Improvement >Reporter: Artem Ervits >Assignee: Artem Ervits >Priority: Trivial > Labels: newbie > Fix For: 5.0.0 > > Attachments: OOZIE-2975-0.patch > > > 1. Replaced StringBuffer with StringBuilder > 2. Replaced Exception with IOException and ExecException > 3. Replaced old Hashmap notation with diamond notation > 4. Added try-with-resources notation -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-3093) Test Scenarios for Oozie 5.0
[ https://issues.apache.org/jira/browse/OOZIE-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Sasvari updated OOZIE-3093: -- Fix Version/s: (was: 5.0.0b1) 5.0.0 > Test Scenarios for Oozie 5.0 > > > Key: OOZIE-3093 > URL: https://issues.apache.org/jira/browse/OOZIE-3093 > Project: Oozie > Issue Type: Test >Affects Versions: 5.0.0b1 >Reporter: Artem Ervits >Priority: Blocker > Fix For: 5.0.0 > > > This is umbrella jira to track test scenarios on Oozie 5.0. In my discussion > with [~gezapeti] we can have a joint effort to test different test cases. > [~clayb] please provide your input as well. > 1. Oozie HA > 2. Oozie secure cluster > 3. Run all examples > 4. Execute against every Hadoop profile > etc. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-1987) Fix existing findbugs warnings
[ https://issues.apache.org/jira/browse/OOZIE-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Sasvari updated OOZIE-1987: -- Fix Version/s: (was: 5.0.0b1) 5.0.0 > Fix existing findbugs warnings > -- > > Key: OOZIE-1987 > URL: https://issues.apache.org/jira/browse/OOZIE-1987 > Project: Oozie > Issue Type: Bug >Reporter: Robert Kanter >Assignee: Jan Hentschel >Priority: Major > Fix For: 5.0.0 > > > Now that we have OOZIE-1793, we should actually fix the warnings that > findbugs finds in the existing codebase. It may be a good idea to split this > into subtasks or multiple patches as there are a lot of warnings: over 500 in > oozie-core alone! > If we think something is ok, but findbugs complains, we should exclude it. > There's a way to create a file that lists exclusions (Hadoop does this). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-2600) OYA: Update Documentation
[
https://issues.apache.org/jira/browse/OOZIE-2600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Sasvari updated OOZIE-2600:
--
Fix Version/s: (was: 5.0.0b1)
5.0.0
> OYA: Update Documentation
> -
>
> Key: OOZIE-2600
> URL: https://issues.apache.org/jira/browse/OOZIE-2600
> Project: Oozie
> Issue Type: Sub-task
>Affects Versions: oya, 5.0.0
>Reporter: Robert Kanter
>Priority: Blocker
> Fix For: 5.0.0
>
>
> Based on the work done in OOZIE-2896, document also the way how
> {{oozie.launcher.override.\*}} and {{oozie.launcher.prepend.\*}} parameters
> function.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (OOZIE-2942) Fix Findbugs warnings in oozie-examples
[
https://issues.apache.org/jira/browse/OOZIE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Sasvari updated OOZIE-2942:
--
Fix Version/s: (was: 5.0.0b1)
5.0.0
> Fix Findbugs warnings in oozie-examples
> ---
>
> Key: OOZIE-2942
> URL: https://issues.apache.org/jira/browse/OOZIE-2942
> Project: Oozie
> Issue Type: Sub-task
> Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-2942-1.patch, OOZIE-2942-2.patch
>
>
> Currently Findbugs complains about the following warnings in the
> *oozie-examples* module:
> {code}
> [INFO] org.apache.oozie.example.DateList.main(String[]) may fail to close
> stream on exception [org.apache.oozie.example.DateList] At
> DateList.java:[line 69]
> [INFO] Nullcheck of date at line 55 of value previously dereferenced in
> org.apache.oozie.example.DateList.main(String[])
> [org.apache.oozie.example.DateList, org.apache.oozie.example.DateList] At
> DateList.java:[line 55]Redundant null check at DateList.java:[line 62]
> [INFO] Private method
> org.apache.oozie.example.DateList.formatDateUTC(Calendar) is never called
> [org.apache.oozie.example.DateList] At DateList.java:[line 97]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail
> to clean up java.io.InputStream [org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample,
> org.apache.oozie.example.LocalOozieExample] Obligation to clean up resource
> created at LocalOozieExample.java:[line 72] is not dischargedPath continues
> at LocalOozieExample.java:[line 76]Path continues at
> LocalOozieExample.java:[line 77]Path continues at
> LocalOozieExample.java:[line 78]Path continues at
> LocalOozieExample.java:[line 81]Path continues at
> LocalOozieExample.java:[line 88]Path continues at
> LocalOozieExample.java:[line 89]Path continues at
> LocalOozieExample.java:[line 91]Path continues at
> LocalOozieExample.java:[line 100]
> [INFO] org.apache.oozie.example.LocalOozieExample.execute(String[]) may fail
> to close stream [org.apache.oozie.example.LocalOozieExample] At
> LocalOozieExample.java:[line 72]
> [INFO] org.apache.oozie.example.Repeatable.getBaseline() may expose internal
> representation by returning Repeatable.baseline
> [org.apache.oozie.example.Repeatable] At Repeatable.java:[line 168]
> [INFO] org.apache.oozie.example.Repeatable.setBaseline(Date) may expose
> internal representation by storing an externally mutable object into
> Repeatable.baseline [org.apache.oozie.example.Repeatable] At
> Repeatable.java:[line 172]
> {code}
> They should be fixed to get the code more reliable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (OOZIE-2975) code clean up in pig sharelib, replace Exception with more explicit, add try with resources, StringBuilder instead of StringBuffer
[ https://issues.apache.org/jira/browse/OOZIE-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Sasvari updated OOZIE-2975: -- Fix Version/s: (was: 5.0.0b1) 5.0.0 > code clean up in pig sharelib, replace Exception with more explicit, add try > with resources, StringBuilder instead of StringBuffer > -- > > Key: OOZIE-2975 > URL: https://issues.apache.org/jira/browse/OOZIE-2975 > Project: Oozie > Issue Type: Improvement >Reporter: Artem Ervits >Assignee: Artem Ervits >Priority: Trivial > Labels: newbie > Fix For: 5.0.0 > > Attachments: OOZIE-2975-0.patch > > > 1. Replaced StringBuffer with StringBuilder > 2. Replaced Exception with IOException and ExecException > 3. Replaced old Hashmap notation with diamond notation > 4. Added try-with-resources notation -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[ANNOUNCE] Apache Oozie 5.0.0-beta1 released
Hello Oozie Community, The Apache Oozie team is pleased to announce the release of Oozie 5.0.0-beta1. Oozie 5.0.0-beta1 includes new features, bug fixes and minor improvements. The details of the release and download location can be found at http://oozie.apache.org/ The full release notes can be found at the download location, but some of the highlights of the release include: - Migrated Oozie Launcher from MapReduce to YARN AM for significant performance improvements and simplicity - Dropped support for Hadoop 1.x - Added new 1.0 workflow schemas - Switched from Tomcat to embedded Jetty for easier management and better security - Completely rewritten Job DAG renderer to support SVG and DOT formats as well as better performance - Better resiliency to transient database outages - Requires Java 8 Many thanks to all the developers, QA's, users and committers for making this release happen. Regards, - Attila
[jira] [Updated] (OOZIE-3169) Create a download page for releases
[ https://issues.apache.org/jira/browse/OOZIE-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated OOZIE-3169: - Description: Today to download a release, you need to click on the Releases tab and select a release. It will take a user to an external page where you can download the release from an Apache mirrors (e.g. [http://www.apache.org/dyn/closer.lua/oozie/5.0.0-beta1).] It would be better to create a page on the Oozie site to download releases and related hash and PGP signature files (these are often not replicated to mirrors, and they should be hosted on Apache anyway). This way a visitor could stay on the Oozie site. Examples: [http://hadoop.apache.org/releases.html] [https://flume.apache.org/releases/] was: Today to download a release, you need to click on the Releases tab and select a release. It will take a user to an external page where you can download the release from an Apache mirrors (e.g. [http://www.apache.org/dyn/closer.lua/oozie/5.0.0-beta1).] It would be better to create a page on the Oozie site to download releases and related hash and PGP signature files. This way a visitor could stay on the Oozie site. Examples: [http://hadoop.apache.org/releases.html] [https://flume.apache.org/releases/] > Create a download page for releases > --- > > Key: OOZIE-3169 > URL: https://issues.apache.org/jira/browse/OOZIE-3169 > Project: Oozie > Issue Type: New Feature > Components: site >Reporter: Attila Sasvari >Priority: Minor > > Today to download a release, you need to click on the Releases tab and select > a release. It will take a user to an external page where you can download the > release from an Apache mirrors (e.g. > [http://www.apache.org/dyn/closer.lua/oozie/5.0.0-beta1).] > It would be better to create a page on the Oozie site to download releases > and related hash and PGP signature files (these are often not replicated to > mirrors, and they should be hosted on Apache anyway). This way a visitor > could stay on the Oozie site. > Examples: > [http://hadoop.apache.org/releases.html] > [https://flume.apache.org/releases/] > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (OOZIE-3169) Create a download page for releases
Attila Sasvari created OOZIE-3169: - Summary: Create a download page for releases Key: OOZIE-3169 URL: https://issues.apache.org/jira/browse/OOZIE-3169 Project: Oozie Issue Type: New Feature Components: site Reporter: Attila Sasvari Today to download a release, you need to click on the Releases tab and select a release. It will take a user to an external page where you can download the release from an Apache mirrors (e.g. [http://www.apache.org/dyn/closer.lua/oozie/5.0.0-beta1).] It would be better to create a page on the Oozie site to download releases and related hash and PGP signature files. This way a visitor could stay on the Oozie site. Examples: [http://hadoop.apache.org/releases.html] [https://flume.apache.org/releases/] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-1717) Index user_name column
[ https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339375#comment-16339375 ] Todd Farmer commented on OOZIE-1717: I suspect a composite index on (status, created_time) will prove more effective for the query cited. This "covering" index will allow equality matches on the leading column (important for MySQL and derivatives) for filtering, and then use the created_time in the same index to order and filter without needing to access table data. > Index user_name column > -- > > Key: OOZIE-1717 > URL: https://issues.apache.org/jira/browse/OOZIE-1717 > Project: Oozie > Issue Type: Bug >Reporter: Purshotam Shah >Assignee: Attila Sasvari >Priority: Minor > Attachments: OOZIE-1717-00.patch > > > User_name is one of the frequently used filter. Adding index should avoid > full db scan. > Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-1717) Index user_name column
[ https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339145#comment-16339145 ] Peter Cseh commented on OOZIE-1717: --- I think you should go ahead and add that index as well. There should be indexes on commonly queried columns. > Index user_name column > -- > > Key: OOZIE-1717 > URL: https://issues.apache.org/jira/browse/OOZIE-1717 > Project: Oozie > Issue Type: Bug >Reporter: Purshotam Shah >Assignee: Attila Sasvari >Priority: Minor > Attachments: OOZIE-1717-00.patch > > > User_name is one of the frequently used filter. Adding index should avoid > full db scan. > Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
