Failed: OOZIE-3160 PreCommit Build #867
Jira: https://issues.apache.org/jira/browse/OOZIE-3160 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/867/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.88 MB...] [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [tools]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [server]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [fluent-job/fluent-job-api]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2486 bytes [TRACE] Full summary file size is 1471 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3160 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN +1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags +1 the patch does not introduce any tabs +1 the patch does not introduce any trailing spaces +1 the patch does not introduce any line longer than 132 +1 the patch adds/modifies 2 testcase(s) +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 Javadoc generation succeeded with the patch +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/git]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [core]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [server]. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files -1 TESTS Tests run: 2927 Tests failed : 0 Tests in error : 0 Tests timed out : 1 Check console output for the full list of errors/failures Tests failed at first run: TestWorkflowRetries>TestWorkflow#testWorkflowWithStartAndEndCompletesSuccessfully For the complete list of flaky tests, see TEST-SUMMARY-FULL files. +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/867/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13130774/comment/16629142","id":"16629142","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA OOZIE-3160\n\nCleaning local git workspace\n\n\n\n{color:green}+1 PATCH_APPLIES{color}\n{color:green}+1
[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629142#comment-16629142 ] Hadoop QA commented on OOZIE-3160: -- Testing JIRA OOZIE-3160 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:green}+1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:green}+1{color} the patch adds/modifies 2 testcase(s) {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/git]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} .Tests run: 2927 .Tests failed : 0 .Tests in error : 0 .Tests timed out : 1 Check console output for the full list of errors/failures .{color:orange}Tests failed at first run:{color} TestWorkflowRetries>TestWorkflow#testWorkflowWithStartAndEndCompletesSuccessfully .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/867/ > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, OOZIE-3160.amend.003.patch, PriorityDelayQueue > improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws
Failed: OOZIE-3348 PreCommit Build #868
Jira: https://issues.apache.org/jira/browse/OOZIE-3348 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/868/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.88 MB...] [DEBUG] There are no new bugs found in [sharelib/hive]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/spark]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [client]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [examples]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [docs]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [server]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2487 bytes [TRACE] Full summary file size is 1471 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3348 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags +1 the patch does not introduce any tabs +1 the patch does not introduce any trailing spaces +1 the patch does not introduce any line longer than 132 -1 the patch does not add/modify any testcase +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 Javadoc generation succeeded with the patch +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [core]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/git]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [server]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files +1 TESTS Tests run: 3056 Tests failed at first run: TestCoordActionsKillXCommand#testActionKillCommandDate For the complete list of flaky tests, see TEST-SUMMARY-FULL files. +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/868/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0100 33890 0 100 3389 0 4046 --:--:-- --:--:-- --:--:-- 4044{"self":"https://issues.apache.org/jira/rest/api/2/issue/13185783/comment/16629138","id":"16629138","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629138#comment-16629138 ] Hadoop QA commented on OOZIE-3348: -- Testing JIRA OOZIE-3348 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/git]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [server]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3056 .{color:orange}Tests failed at first run:{color} TestCoordActionsKillXCommand#testActionKillCommandDate .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/868/ > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3343) [build] [tests] Add the first five test errors per module to the report
[ https://issues.apache.org/jira/browse/OOZIE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629003#comment-16629003 ] Hadoop QA commented on OOZIE-3343: -- Testing JIRA OOZIE-3343 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:red}-1{color} the patch contains 1 line(s) longer than 132 characters .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/git]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [client]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3056 .{color:orange}Tests failed at first run:{color} TestCoordActionsKillXCommand#testActionKillCommandDate .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/866/ > [build] [tests] Add the first five test errors per module to the report > --- > > Key: OOZIE-3343 > URL: https://issues.apache.org/jira/browse/OOZIE-3343 > Project: Oozie > Issue Type: Bug > Components: build, tests >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3343-001.patch, OOZIE-3343-002.patch, > OOZIE-3343-003.patch, OOZIE-3343-004.patch, OOZIE-3343-005.patch, > OOZIE-3343-006.patch, OOZIE-3343-DEBUG_PURPOSE_DO_NOT_MERGE2.patch, > OOZIE-3343-amend001.patch > > > After fixing the false positive precommit reports in OOZIE-3317, if there are > some kind of errors during junit execution, the following information is > printed out: > {color:#FF}-1 TESTS{color} > There were errors during execution. Check console output for details. > It should be useful to have the concrete errors printed out as well. In order > to avoid the very long reports in case of lots of failures, we should limit > the printed out errors to a specific number (5)/module. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Failed: OOZIE-3343 PreCommit Build #866
Jira: https://issues.apache.org/jira/browse/OOZIE-3343 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/866/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.88 MB...] [DEBUG] There are no new bugs found in [sharelib/sqoop]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/oozie]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/git]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/distcp]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/spark]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [client]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2487 bytes [TRACE] Full summary file size is 1471 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3343 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags +1 the patch does not introduce any tabs +1 the patch does not introduce any trailing spaces -1 the patch contains 1 line(s) longer than 132 characters -1 the patch does not add/modify any testcase +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 Javadoc generation succeeded with the patch +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [core]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 There are no new bugs found in [server]. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [sharelib/git]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [client]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files +1 TESTS Tests run: 3056 Tests failed at first run: TestCoordActionsKillXCommand#testActionKillCommandDate For the complete list of flaky tests, see TEST-SUMMARY-FULL files. +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/866/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0100 33890 0 100 3389 0 3871 --:--:-- --:--:-- --:--:-- 3868{"self":"https://issues.apache.org/jira/rest/api/2/issue/13184593/comment/16629003","id":"16629003","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628898#comment-16628898 ] Hadoop QA commented on OOZIE-3348: -- PreCommit-OOZIE-Build started > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628896#comment-16628896 ] Andras Piros commented on OOZIE-3348: - Because {{TestJavaActionExecutor}} failures have been resolved in the meanwhile by an amendment patch to OOZIE-3160, retriggering Jenkins build. > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628874#comment-16628874 ] Hadoop QA commented on OOZIE-3160: -- PreCommit-OOZIE-Build started > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, OOZIE-3160.amend.003.patch, PriorityDelayQueue > improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws InterruptedException { > QueueElement e = poll(); > while (e == null) { > Thread.sleep(10); > e = poll(); > } > return e; > } > {code} > i think it's the reason of this problem. it's keep while, not await. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628867#comment-16628867 ] Andras Piros commented on OOZIE-3160: - Amendment patch 003 fixes failing {{ZKXTestCase}} instances, as well as renames the feature switch {{oozie.service.CallableQueueService.queue.oldImpl}} to {{newImpl}}. It also introduces a check in {{CallableQueueService#queue()}} to check queue shut down or terminated state in case of {{newImpl}}. > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, OOZIE-3160.amend.003.patch, PriorityDelayQueue > improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws InterruptedException { > QueueElement e = poll(); > while (e == null) { > Thread.sleep(10); > e = poll(); > } > return e; > } > {code} > i think it's the reason of this problem. it's keep while, not await. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Piros updated OOZIE-3160: Attachment: OOZIE-3160.amend.003.patch > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, OOZIE-3160.amend.003.patch, PriorityDelayQueue > improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws InterruptedException { > QueueElement e = poll(); > while (e == null) { > Thread.sleep(10); > e = poll(); > } > return e; > } > {code} > i think it's the reason of this problem. it's keep while, not await. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3343) [build] [tests] Add the first five test errors per module to the report
[ https://issues.apache.org/jira/browse/OOZIE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628845#comment-16628845 ] Hadoop QA commented on OOZIE-3343: -- PreCommit-OOZIE-Build started > [build] [tests] Add the first five test errors per module to the report > --- > > Key: OOZIE-3343 > URL: https://issues.apache.org/jira/browse/OOZIE-3343 > Project: Oozie > Issue Type: Bug > Components: build, tests >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3343-001.patch, OOZIE-3343-002.patch, > OOZIE-3343-003.patch, OOZIE-3343-004.patch, OOZIE-3343-005.patch, > OOZIE-3343-006.patch, OOZIE-3343-DEBUG_PURPOSE_DO_NOT_MERGE2.patch, > OOZIE-3343-amend001.patch > > > After fixing the false positive precommit reports in OOZIE-3317, if there are > some kind of errors during junit execution, the following information is > printed out: > {color:#FF}-1 TESTS{color} > There were errors during execution. Check console output for details. > It should be useful to have the concrete errors printed out as well. In order > to avoid the very long reports in case of lots of failures, we should limit > the printed out errors to a specific number (5)/module. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-3343) [build] [tests] Add the first five test errors per module to the report
[ https://issues.apache.org/jira/browse/OOZIE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julia Kinga Marton updated OOZIE-3343: -- Attachment: OOZIE-3343-amend001.patch > [build] [tests] Add the first five test errors per module to the report > --- > > Key: OOZIE-3343 > URL: https://issues.apache.org/jira/browse/OOZIE-3343 > Project: Oozie > Issue Type: Bug > Components: build, tests >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3343-001.patch, OOZIE-3343-002.patch, > OOZIE-3343-003.patch, OOZIE-3343-004.patch, OOZIE-3343-005.patch, > OOZIE-3343-006.patch, OOZIE-3343-DEBUG_PURPOSE_DO_NOT_MERGE2.patch, > OOZIE-3343-amend001.patch > > > After fixing the false positive precommit reports in OOZIE-3317, if there are > some kind of errors during junit execution, the following information is > printed out: > {color:#FF}-1 TESTS{color} > There were errors during execution. Check console output for details. > It should be useful to have the concrete errors printed out as well. In order > to avoid the very long reports in case of lots of failures, we should limit > the printed out errors to a specific number (5)/module. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628734#comment-16628734 ] Hadoop QA commented on OOZIE-3160: -- Testing JIRA OOZIE-3160 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:green}+1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:green}+1{color} the patch adds/modifies 2 testcase(s) {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/git]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [core]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} .Tests run: 2786 .Tests failed : 0 .Tests in error : 0 .Tests timed out : 1 Check console output for the full list of errors/failures {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/865/ > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, PriorityDelayQueue improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws InterruptedException { > QueueElement e = poll(); > while (e == null) { > Thread.sleep(10); > e = poll(); > } > return e; > } > {code} > i think it's the reason of this problem. it's keep while, not await.
Failed: OOZIE-3160 PreCommit Build #865
Jira: https://issues.apache.org/jira/browse/OOZIE-3160 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/865/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.87 MB...] [DEBUG] There are no new bugs found in [fluent-job/fluent-job-api]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [client]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [tools]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [server]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [core]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2486 bytes [TRACE] Full summary file size is 1471 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3160 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN +1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags +1 the patch does not introduce any tabs +1 the patch does not introduce any trailing spaces +1 the patch does not introduce any line longer than 132 +1 the patch adds/modifies 2 testcase(s) +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 Javadoc generation succeeded with the patch +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/git]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [server]. +1 There are no new bugs found in [core]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files -1 TESTS Tests run: 2786 Tests failed : 0 Tests in error : 0 Tests timed out : 1 Check console output for the full list of errors/failures +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/865/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0100 33530 0 100 3353 0 4263 --:--:-- --:--:-- --:--:-- 4260{"self":"https://issues.apache.org/jira/rest/api/2/issue/13130774/comment/16628734","id":"16628734","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA OOZIE-3160\n\nCleaning local git workspace\n\n\n\n{color:green}+1 PATCH_APPLIES{color}\n{color:green}+1
Failed: OOZIE-3340 PreCommit Build #864
Jira: https://issues.apache.org/jira/browse/OOZIE-3340 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/864/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.88 MB...] [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/hive]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/streaming]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/git]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/sqoop]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/spark]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [examples]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2486 bytes [TRACE] Full summary file size is 1471 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3340 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN +1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags +1 the patch does not introduce any tabs +1 the patch does not introduce any trailing spaces +1 the patch does not introduce any line longer than 132 +1 the patch adds/modifies 1 testcase(s) +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 Javadoc generation succeeded with the patch +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [core]. +1 There are no new bugs found in [server]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/git]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [examples]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files +1 TESTS Tests run: 3056 Tests failed at first run: TestCoordActionsKillXCommand#testActionKillCommandDate For the complete list of flaky tests, see TEST-SUMMARY-FULL files. +1 DISTRO +1 distro tarball builds with the patch +1 Overall result, good!, no -1s There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/864/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0100 33720 0 100 3372 0 4014 --:--:-- --:--:-- --:--:--
[jira] [Commented] (OOZIE-3340) [fluent-job] Create error handler ACTION only if needed
[ https://issues.apache.org/jira/browse/OOZIE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628678#comment-16628678 ] Hadoop QA commented on OOZIE-3340: -- Testing JIRA OOZIE-3340 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:green}+1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:green}+1{color} the patch adds/modifies 1 testcase(s) {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/git]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [examples]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3056 .{color:orange}Tests failed at first run:{color} TestCoordActionsKillXCommand#testActionKillCommandDate .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:green}*+1 Overall result, good!, no -1s*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/864/ > [fluent-job] Create error handler ACTION only if needed > --- > > Key: OOZIE-3340 > URL: https://issues.apache.org/jira/browse/OOZIE-3340 > Project: Oozie > Issue Type: Improvement > Components: fluent-job >Reporter: Andras Salamon >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3340-001.patch, OOZIE-3340.002.patch > > > The Shell and MultipleShellActions example of the Fluent Job API generates > multiple actions with the same name ({{email-on-error}}) which gives > {{E0705}} error code. > For MultipleShellActions the generated XML: > {noformat} > Workflow job definition generated from API jar: > > xmlns:workflow="uri:oozie:workflow:1.0" > xmlns:shell="uri:oozie:shell-action:1.0" name="shell-example"> > > > Action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > someb...@apache.org > Workflow error > Shell action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > > > ... > > >... > > > ... > > > ... > > > ... > > ... > {noformat} > The error message: > {noformat} > bin/oozie job -oozie
[jira] [Comment Edited] (OOZIE-3343) [build] [tests] Add the first five test errors per module to the report
[ https://issues.apache.org/jira/browse/OOZIE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628652#comment-16628652 ] Julia Kinga Marton edited comment on OOZIE-3343 at 9/26/18 12:23 PM: - Still not working properly. The following precommit showed +1, but there were test failures: [https://builds.apache.org/job/PreCommit-OOZIE-Build/863] The console log contains the following error: {noformat} rsync: link_stat "/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/core/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestJavaActionExecutor.xml#012./core/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestJavaMain.xml" failed: No such file or directory (2) rsync error: some files/attrs were not transferred{noformat} was (Author: kmarton): Still not working properly. The following precommit showed +1, but there were test failures: [https://builds.apache.org/job/PreCommit-OOZIE-Build/863] The console log contains the following error: rsync: link_stat "/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/core/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestJavaActionExecutor.xml\#012./core/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestJavaMain.xml" failed: No such file or directory (2) rsync error: some files/attrs were not transferred > [build] [tests] Add the first five test errors per module to the report > --- > > Key: OOZIE-3343 > URL: https://issues.apache.org/jira/browse/OOZIE-3343 > Project: Oozie > Issue Type: Bug > Components: build, tests >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3343-001.patch, OOZIE-3343-002.patch, > OOZIE-3343-003.patch, OOZIE-3343-004.patch, OOZIE-3343-005.patch, > OOZIE-3343-006.patch, OOZIE-3343-DEBUG_PURPOSE_DO_NOT_MERGE2.patch > > > After fixing the false positive precommit reports in OOZIE-3317, if there are > some kind of errors during junit execution, the following information is > printed out: > {color:#FF}-1 TESTS{color} > There were errors during execution. Check console output for details. > It should be useful to have the concrete errors printed out as well. In order > to avoid the very long reports in case of lots of failures, we should limit > the printed out errors to a specific number (5)/module. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628658#comment-16628658 ] Julia Kinga Marton commented on OOZIE-3348: --- The precommit report is showing false +1 for the tests. Reopened OOZIE-3343 for fixing it. There are some test failures in TestJavaActionExecutor > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Reopened] (OOZIE-3343) [build] [tests] Add the first five test errors per module to the report
[ https://issues.apache.org/jira/browse/OOZIE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julia Kinga Marton reopened OOZIE-3343: --- Still not working properly. The following precommit showed +1, but there were test failures: [https://builds.apache.org/job/PreCommit-OOZIE-Build/863] The console log contains the following error: rsync: link_stat "/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/core/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestJavaActionExecutor.xml\#012./core/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestJavaMain.xml" failed: No such file or directory (2) rsync error: some files/attrs were not transferred > [build] [tests] Add the first five test errors per module to the report > --- > > Key: OOZIE-3343 > URL: https://issues.apache.org/jira/browse/OOZIE-3343 > Project: Oozie > Issue Type: Bug > Components: build, tests >Affects Versions: 5.0.0 >Reporter: Julia Kinga Marton >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3343-001.patch, OOZIE-3343-002.patch, > OOZIE-3343-003.patch, OOZIE-3343-004.patch, OOZIE-3343-005.patch, > OOZIE-3343-006.patch, OOZIE-3343-DEBUG_PURPOSE_DO_NOT_MERGE2.patch > > > After fixing the false positive precommit reports in OOZIE-3317, if there are > some kind of errors during junit execution, the following information is > printed out: > {color:#FF}-1 TESTS{color} > There were errors during execution. Check console output for details. > It should be useful to have the concrete errors printed out as well. In order > to avoid the very long reports in case of lots of failures, we should limit > the printed out errors to a specific number (5)/module. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3353) Add support for WebHDFS token provider
[ https://issues.apache.org/jira/browse/OOZIE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628566#comment-16628566 ] Peter Bacsko commented on OOZIE-3353: - I'll add an example later. But for example, using DistCp with webhdfs will not work in a secure environment. > Add support for WebHDFS token provider > -- > > Key: OOZIE-3353 > URL: https://issues.apache.org/jira/browse/OOZIE-3353 > Project: Oozie > Issue Type: New Feature > Components: core >Reporter: Peter Bacsko >Priority: Major > > Oozie currently doesn't support fetching delegation tokens for WebHDFS. > Ordinary HDFS tokens are not adequate because the token kind is different: > WEBHDFS_TOKEN_KIND vs HDFS_DELEGATION_TOKEN. > We need to use REST calls to retrieve the tokens. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628553#comment-16628553 ] Hadoop QA commented on OOZIE-3160: -- PreCommit-OOZIE-Build started > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, PriorityDelayQueue improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws InterruptedException { > QueueElement e = poll(); > while (e == null) { > Thread.sleep(10); > e = poll(); > } > return e; > } > {code} > i think it's the reason of this problem. it's keep while, not await. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3340) [fluent-job] Create error handler ACTION only if needed
[ https://issues.apache.org/jira/browse/OOZIE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628549#comment-16628549 ] Hadoop QA commented on OOZIE-3340: -- PreCommit-OOZIE-Build started > [fluent-job] Create error handler ACTION only if needed > --- > > Key: OOZIE-3340 > URL: https://issues.apache.org/jira/browse/OOZIE-3340 > Project: Oozie > Issue Type: Improvement > Components: fluent-job >Reporter: Andras Salamon >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3340-001.patch, OOZIE-3340.002.patch > > > The Shell and MultipleShellActions example of the Fluent Job API generates > multiple actions with the same name ({{email-on-error}}) which gives > {{E0705}} error code. > For MultipleShellActions the generated XML: > {noformat} > Workflow job definition generated from API jar: > > xmlns:workflow="uri:oozie:workflow:1.0" > xmlns:shell="uri:oozie:shell-action:1.0" name="shell-example"> > > > Action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > someb...@apache.org > Workflow error > Shell action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > > > ... > > >... > > > ... > > > ... > > > ... > > ... > {noformat} > The error message: > {noformat} > bin/oozie job -oozie http://localhost:11000/oozie -runjar fluenttest.jar > -config job.properties -verbose > ... > Error: E0705 : E0705: Nnode already defined, node [email-on-error] > {noformat} > The Shell example also creates an XML with multiple {{email-on-error}} > actions. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3160) PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting
[ https://issues.apache.org/jira/browse/OOZIE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628541#comment-16628541 ] Andras Piros commented on OOZIE-3160: - Retriggering pre-commit build. > PriorityDelayQueue put()/take() can cause significant CPU load due to busy > waiting > -- > > Key: OOZIE-3160 > URL: https://issues.apache.org/jira/browse/OOZIE-3160 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: trunk > Environment: all platforms >Reporter: jj >Assignee: Peter Bacsko >Priority: Major > Fix For: 5.1.0 > > Attachments: 11.png, 22.png, > OOZIE-3160-001.patch, OOZIE-3160-002.patch, OOZIE-3160-003.patch, > OOZIE-3160-004.patch, OOZIE-3160-005.patch, OOZIE-3160-006.patch, > OOZIE-3160-007.patch, OOZIE-3160-POC01.patch, OOZIE-3160-POC02.patch, > OOZIE-3160-POC02.patch, OOZIE-3160-POC03.patch, OOZIE-3160-POC04.patch, > OOZIE-3160-POC05.patch, OOZIE-3160.amend.001.patch, > OOZIE-3160.amend.002.patch, PriorityDelayQueue improvement - OOZIE-3160.pdf > > > oozie process always consume high cpu. in my mechine,around 10%. > I check the source code,find take() method in PriorityDelayQueue class。 > code: > {code:java} > public QueueElement take() throws InterruptedException { > QueueElement e = poll(); > while (e == null) { > Thread.sleep(10); > e = poll(); > } > return e; > } > {code} > i think it's the reason of this problem. it's keep while, not await. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (OOZIE-3340) [fluent-job] Create error handler ACTION only if needed
[ https://issues.apache.org/jira/browse/OOZIE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628540#comment-16628540 ] Andras Piros edited comment on OOZIE-3340 at 9/26/18 10:28 AM: --- Retriggering pre-commit build. was (Author: andras.piros): Retriggering pre-commit build.a > [fluent-job] Create error handler ACTION only if needed > --- > > Key: OOZIE-3340 > URL: https://issues.apache.org/jira/browse/OOZIE-3340 > Project: Oozie > Issue Type: Improvement > Components: fluent-job >Reporter: Andras Salamon >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3340-001.patch, OOZIE-3340.002.patch > > > The Shell and MultipleShellActions example of the Fluent Job API generates > multiple actions with the same name ({{email-on-error}}) which gives > {{E0705}} error code. > For MultipleShellActions the generated XML: > {noformat} > Workflow job definition generated from API jar: > > xmlns:workflow="uri:oozie:workflow:1.0" > xmlns:shell="uri:oozie:shell-action:1.0" name="shell-example"> > > > Action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > someb...@apache.org > Workflow error > Shell action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > > > ... > > >... > > > ... > > > ... > > > ... > > ... > {noformat} > The error message: > {noformat} > bin/oozie job -oozie http://localhost:11000/oozie -runjar fluenttest.jar > -config job.properties -verbose > ... > Error: E0705 : E0705: Nnode already defined, node [email-on-error] > {noformat} > The Shell example also creates an XML with multiple {{email-on-error}} > actions. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3340) [fluent-job] Create error handler ACTION only if needed
[ https://issues.apache.org/jira/browse/OOZIE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628540#comment-16628540 ] Andras Piros commented on OOZIE-3340: - Retriggering pre-commit build.a > [fluent-job] Create error handler ACTION only if needed > --- > > Key: OOZIE-3340 > URL: https://issues.apache.org/jira/browse/OOZIE-3340 > Project: Oozie > Issue Type: Improvement > Components: fluent-job >Reporter: Andras Salamon >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.1.0 > > Attachments: OOZIE-3340-001.patch, OOZIE-3340.002.patch > > > The Shell and MultipleShellActions example of the Fluent Job API generates > multiple actions with the same name ({{email-on-error}}) which gives > {{E0705}} error code. > For MultipleShellActions the generated XML: > {noformat} > Workflow job definition generated from API jar: > > xmlns:workflow="uri:oozie:workflow:1.0" > xmlns:shell="uri:oozie:shell-action:1.0" name="shell-example"> > > > Action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > someb...@apache.org > Workflow error > Shell action failed, error > message[${wf:errorMessage(wf:lastErrorNode())}] > > > > > > ... > > >... > > > ... > > > ... > > > ... > > ... > {noformat} > The error message: > {noformat} > bin/oozie job -oozie http://localhost:11000/oozie -runjar fluenttest.jar > -config job.properties -verbose > ... > Error: E0705 : E0705: Nnode already defined, node [email-on-error] > {noformat} > The Shell example also creates an XML with multiple {{email-on-error}} > actions. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3353) Add support for WebHDFS token provider
[ https://issues.apache.org/jira/browse/OOZIE-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628503#comment-16628503 ] Andras Piros commented on OOZIE-3353: - Thanks for the idea [~pbacsko]! Looks like a long-standing tech debt, would really like to have Oozie also talk to secure WebHDFS. Do you have a workflow example? > Add support for WebHDFS token provider > -- > > Key: OOZIE-3353 > URL: https://issues.apache.org/jira/browse/OOZIE-3353 > Project: Oozie > Issue Type: New Feature > Components: core >Reporter: Peter Bacsko >Priority: Major > > Oozie currently doesn't support fetching delegation tokens for WebHDFS. > Ordinary HDFS tokens are not adequate because the token kind is different: > WEBHDFS_TOKEN_KIND vs HDFS_DELEGATION_TOKEN. > We need to use REST calls to retrieve the tokens. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (OOZIE-3353) Add support for WebHDFS token provider
Peter Bacsko created OOZIE-3353: --- Summary: Add support for WebHDFS token provider Key: OOZIE-3353 URL: https://issues.apache.org/jira/browse/OOZIE-3353 Project: Oozie Issue Type: New Feature Components: core Reporter: Peter Bacsko Oozie currently doesn't support fetching delegation tokens for WebHDFS. Ordinary HDFS tokens are not adequate because the token kind is different: WEBHDFS_TOKEN_KIND vs HDFS_DELEGATION_TOKEN. We need to use REST calls to retrieve the tokens. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Failed: OOZIE-3348 PreCommit Build #863
Jira: https://issues.apache.org/jira/browse/OOZIE-3348 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/863/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.95 MB...] [DEBUG] There are no new bugs found in [sharelib/hive]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/spark]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [client]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [examples]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [docs]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [server]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2487 bytes [TRACE] Full summary file size is 1471 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3348 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags +1 the patch does not introduce any tabs +1 the patch does not introduce any trailing spaces +1 the patch does not introduce any line longer than 132 -1 the patch does not add/modify any testcase +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 Javadoc generation succeeded with the patch +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [core]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/git]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [server]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files +1 TESTS Tests run: 3056 Tests failed at first run: TestCoordActionsKillXCommand#testActionKillCommandDate For the complete list of flaky tests, see TEST-SUMMARY-FULL files. +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/863/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 33890 00 0 0 0 --:--:-- --:--:-- --:--:-- 0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13185783/comment/16628488","id":"16628488","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628488#comment-16628488 ] Hadoop QA commented on OOZIE-3348: -- Testing JIRA OOZIE-3348 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:green}+1{color} the patch does not introduce any tabs .{color:green}+1{color} the patch does not introduce any trailing spaces .{color:green}+1{color} the patch does not introduce any line longer than 132 .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} .{color:green}+1{color} Javadoc generation succeeded with the patch .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:orange}WARNING{color}: the current HEAD has 100 Javadoc warning(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/git]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [server]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 3056 .{color:orange}Tests failed at first run:{color} TestCoordActionsKillXCommand#testActionKillCommandDate .For the complete list of flaky tests, see TEST-SUMMARY-FULL files. {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/863/ > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628353#comment-16628353 ] Hadoop QA commented on OOZIE-3348: -- PreCommit-OOZIE-Build started > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16628346#comment-16628346 ] Julia Kinga Marton commented on OOZIE-3348: --- hive-contrib pulls hive-exec as well, which is needed to be able to run a Hive action. IN patch 002 I have removed hive-contrib, and included hive-exec. > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-3348) [Hive action] Remove dependency hive-contrib
[ https://issues.apache.org/jira/browse/OOZIE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julia Kinga Marton updated OOZIE-3348: -- Attachment: OOZIE-3348-002.patch > [Hive action] Remove dependency hive-contrib > > > Key: OOZIE-3348 > URL: https://issues.apache.org/jira/browse/OOZIE-3348 > Project: Oozie > Issue Type: Improvement > Components: action >Affects Versions: 5.0.0 >Reporter: Andras Piros >Assignee: Julia Kinga Marton >Priority: Major > Fix For: 5.2.0 > > Attachments: OOZIE-3348-001.patch, OOZIE-3348-002.patch > > > As per HIVE-20020 the dependency {{org.apache.hive:hive-contrib}} is packaged > differently - moved out of under Hive's lib. > {{oozie-sharelib-hive}} exports some of the Hive dependencies, and that > includes {{hive-contrib.jar}}. In order to be synced with Hive we should > remove it too. > Oozie doesn't depend on this jar runtime so there's no use of it being in > {{oozie-sharelib-hive}} anyway. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (94 issues) Subscriber: ooziedaily Key Summary OOZIE-3348 [Hive action] Remove dependency hive-contrib https://issues.apache.org/jira/browse/OOZIE-3348 OOZIE-3340 [fluent-job] Create error handler ACTION only if needed https://issues.apache.org/jira/browse/OOZIE-3340 OOZIE-3338 Remove SVN references https://issues.apache.org/jira/browse/OOZIE-3338 OOZIE-3326 Sqoop Action should support tez delegation tokens for hive-import https://issues.apache.org/jira/browse/OOZIE-3326 OOZIE-3320 Oozie ShellAction should support absolute bash file path https://issues.apache.org/jira/browse/OOZIE-3320 OOZIE-3319 Log SSH action callback error output https://issues.apache.org/jira/browse/OOZIE-3319 OOZIE-3307 [core] Limit heap usage of LauncherAM https://issues.apache.org/jira/browse/OOZIE-3307 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3277 [build] Check for star imports in patches in pre-commit https://issues.apache.org/jira/browse/OOZIE-3277 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3266 Coord action rerun support RERUN_SKIP_NODES option https://issues.apache.org/jira/browse/OOZIE-3266 OOZIE-3265 properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together https://issues.apache.org/jira/browse/OOZIE-3265 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3249 [tools] Instrumentation log parser https://issues.apache.org/jira/browse/OOZIE-3249 OOZIE-3218 Oozie Sqoop action with command splits the select clause into multiple parts due to delimiter being space https://issues.apache.org/jira/browse/OOZIE-3218 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3194 Oozie should set proper permissions to sharelib after upload https://issues.apache.org/jira/browse/OOZIE-3194 OOZIE-3186 Oozie is unable to use configuration linked using jceks://file/... https://issues.apache.org/jira/browse/OOZIE-3186 OOZIE-3179 Adding a configurable config-default.xml location to a workflow https://issues.apache.org/jira/browse/OOZIE-3179 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting https://issues.apache.org/jira/browse/OOZIE-3160 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3120 maven-assembly-plugin fails when bumped from 2.2.1 https://issues.apache.org/jira/browse/OOZIE-3120 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues.apache.org/jira/browse/OOZIE-2949 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2784 Include WEEK as a parameter in the Coordinator Expression Language Evaulator https://issues.apache.org/jira/browse/OOZIE-2784 OOZIE-2779 Mask Hive2 action Beeline JDBC password https://issues.apache.org/jira/browse/OOZIE-2779 OOZIE-2736 Reduce the number of threads during