[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913187#comment-17913187 ] ASF subversion and git services commented on OOZIE-3728: Commit 33c90dd3483921af108dacdd073dcbe3b780348b in oozie's branch refs/heads/master from Denes Bodo [ https://gitbox.apache.org/repos/asf?p=oozie.git;h=33c90dd34 ] OOZIE-3728 Upgrade Hadoop to 2.8.5 > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913109#comment-17913109 ] Attila Sasvári commented on OOZIE-3728: --- +1 to merge OOZIE-3728-003.patch Many thanks Dénes. > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912799#comment-17912799 ] Dénes Bodó commented on OOZIE-3728: --- I think [^OOZIE-3728-003.patch] would be my candidate to merge. [^OOZIE-3728-004.patch] contains Curator version upgrade to match with the one in Hadoop but that new Curator 2.7.1 requires Guava 11 -> 16 upgrade too. In my opinion the version upgrades should be handled in a later ticket. > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912654#comment-17912654
]
Hadoop QA commented on OOZIE-3728:
--
Testing JIRA OOZIE-3728
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [29] new bugs found in total that would be
nice to have fixed.
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:orange}0{color} There are [15] new bugs found in [tools] that would
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:orange}0{color} There are [13] new bugs found in [core] that would
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie]
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2796
.Tests failed : 2
.Tests in error : 16
.Tests timed out : 1
{color:red}-1{color} [ERROR] There are [2] test failures in [sharelib]. Listing
only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark
{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing
only the first [5] ones
{color:red}-1{color} [ERROR] There are [2] test errors in
[zookeeper-security-tests]. Listing only the first [5] ones
testCheckAndSetACLs:org.apache.oozie.util.TestZKUtilsWithSecurity
testNewUsingACLs:org.apache.oozie.util.TestZKUtilsWithSecurity
Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}+1 MODERNIZER{color}
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/239/
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch,
> OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912614#comment-17912614 ] Hadoop QA commented on OOZIE-3728: -- PreCommit-OOZIE-Build started > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912531#comment-17912531
]
Hadoop QA commented on OOZIE-3728:
--
Testing JIRA OOZIE-3728
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be
nice to have fixed.
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:orange}0{color} There are [15] new bugs found in [tools] that would
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:orange}0{color} There are [9] new bugs found in [core] that would
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie]
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 3262
.Tests failed : 4
.Tests in error : 18
.Tests timed out : 1
{color:red}-1{color} [ERROR] There are [2] test failures in [core]. Listing
only the first [5] ones
testDistCpFile:org.apache.oozie.action.hadoop.TestDistCpActionExecutor
{color:red}-1{color} [ERROR] There are [2] test failures in [sharelib]. Listing
only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark
{color:red}-1{color} [ERROR] There are [4] test errors in [core]. Listing only
the first [5] ones
{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing
only the first [5] ones
Check console output for the full list of errors/failures
.{color:orange}Tests failed at first run:{color}
TestSignalXCommand#testDeadlockForForkParallelSubmit
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}+1 MODERNIZER{color}
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/238/
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments:
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912441#comment-17912441 ] Hadoop QA commented on OOZIE-3728: -- PreCommit-OOZIE-Build started > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > OOZIE-3728-003.patch, oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912217#comment-17912217
]
Hadoop QA commented on OOZIE-3728:
--
Testing JIRA OOZIE-3728
Cleaning local git workspace
{color:red}-1{color} Patch failed to apply to head of branch
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch,
> oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout
> because the underlying MR jobs didn't finish in time.
>
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to
> adjust test parameters to make them pass.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912216#comment-17912216 ] Hadoop QA commented on OOZIE-3728: -- PreCommit-OOZIE-Build started > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912215#comment-17912215 ] Attila Sasvári commented on OOZIE-3728: --- Many thanks for the new patch [~dionusos]! I tested the rest of the examples, and most of the jobs succeeded: !oozie_examples-job_states.png! I think using Hadoop version 2.8.5 already improves the current state of things, so +1 from me to merge this. (Note: the documentation will need to be updated about the default Hadoop version. ) > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, > oozie_examples-job_states.png > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912015#comment-17912015 ] Dénes Bodó commented on OOZIE-3728: --- On Monday I will check the Oozie dependencies' version against Hadoop 2.8.5 dependencies' version maybe we can upgrade something to solve the remaining test failures. In an Ubuntu docker image with Java8 and Maven 3.6.3 Sqoop, Hive and Hive2 tests pass with the current change. PySpark does not, neither 1.6 nor 2.x. Anyway, Spark3 is almost deprecated now. When should we fix the test issues? Should we merge the Hadoop upgrade as-is to unblock other other testing or make it 100% now? I vote for merge-now-fix-later. > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911584#comment-17911584
]
Hadoop QA commented on OOZIE-3728:
--
Testing JIRA OOZIE-3728
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be
nice to have fixed.
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:orange}0{color} There are [15] new bugs found in [tools] that would
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:orange}0{color} There are [9] new bugs found in [core] that would
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie]
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 3262
.Tests failed : 4
.Tests in error : 18
.Tests timed out : 1
{color:red}-1{color} [ERROR] There are [2] test failures in [core]. Listing
only the first [5] ones
testDistCpFile:org.apache.oozie.action.hadoop.TestDistCpActionExecutor
{color:red}-1{color} [ERROR] There are [2] test failures in [sharelib]. Listing
only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark
{color:red}-1{color} [ERROR] There are [4] test errors in [core]. Listing only
the first [5] ones
{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing
only the first [5] ones
Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}+1 MODERNIZER{color}
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/236/
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to 2.8.5. There will be test failures, as I experienced due
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911492#comment-17911492 ] Hadoop QA commented on OOZIE-3728: -- PreCommit-OOZIE-Build started > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911361#comment-17911361
]
Dénes Bodó commented on OOZIE-3728:
---
Thank you [~asasvari] . I only have MacOS and I can run the Hive share lib
tests from IntelliJ IDEA successfully, but it always stuck when using only
maven:
{code:bash}
mvn test -Puber -pl sharelib/hive{code}
Looks like the Hive job started by the Oozie launcher does not proceed.
I'll try to run it from a Docker container maybe that helps.
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout
> because the underlying MR jobs didn't finish in time.
>
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to
> adjust test parameters to make them pass.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911277#comment-17911277
]
Attila Sasvári commented on OOZIE-3728:
---
[~dionusos] many thanks for the patch! Build results are reported now, but the
unit tests are failing.
If I try to create a release with {{bin/mkdistro.sh -Puber -DskipTests}}, the
mvn build will fail due to non-existing pentaho dependencies.
If you add
{code}
org.pentaho
pentaho-aggdesigner-algorithm
{code}
to the *hive-webhcat-java-client* and *hive-hcatalog-server-extensions*
dependencies of the uber profile in pom.xml, mkdistro.sh will succeed.
Using a 1-node pseudo hadoop 2.8.5 cluster I installed in Docker, I submitted
some of the Oozie examples:
- MapReduce, Hive, Pig & Spark examples succeeded
- Hive2, pySpark failed due to dependencies (I had no Hive2 server and python
installed)
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout
> because the underlying MR jobs didn't finish in time.
>
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to
> adjust test parameters to make them pass.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911267#comment-17911267
]
Hadoop QA commented on OOZIE-3728:
--
Testing JIRA OOZIE-3728
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be
nice to have fixed.
.{color:orange}0{color} There are [15] new bugs found in [tools] that would
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie]
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:orange}0{color} There are [9] new bugs found in [core] that would
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [examples].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2813
.Tests failed : 12
.Tests in error : 14
.Tests timed out : 1
{color:red}-1{color} [ERROR] There are [12] test failures in [sharelib].
Listing only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark
{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing
only the first [5] ones
Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}+1 MODERNIZER{color}
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/235/
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout
> because the underlying MR jobs didn't finish in time.
>
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to
> adjust test parameters to make them pass.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911238#comment-17911238 ] Hadoop QA commented on OOZIE-3728: -- PreCommit-OOZIE-Build started > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch > > > In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade > Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout > because the underlying MR jobs didn't finish in time. > > Let's see how the build behaves with newer Hadoop 2, and if possible, try to > adjust test parameters to make them pass. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911189#comment-17911189
]
Hadoop QA commented on OOZIE-3728:
--
Testing JIRA OOZIE-3728
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be
nice to have fixed.
.{color:orange}0{color} There are [15] new bugs found in [tools] that would
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie]
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:orange}0{color} There are [9] new bugs found in [core] that would
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [examples].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2811
.Tests failed : 12
.Tests in error : 14
.Tests timed out : 1
{color:red}-1{color} [ERROR] There are [12] test failures in [sharelib].
Listing only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark
{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing
only the first [5] ones
Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}+1 MODERNIZER{color}
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/234/
> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
> Issue Type: Improvement
> Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout
> because the underlying MR jobs didn't finish in time.
>
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to
> adjust test parameters to make them pass.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5
[ https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911127#comment-17911127 ] Hadoop QA commented on OOZIE-3728: -- PreCommit-OOZIE-Build started > Upgrade Hadoop to 2.8.5 > --- > > Key: OOZIE-3728 > URL: https://issues.apache.org/jira/browse/OOZIE-3728 > Project: Oozie > Issue Type: Improvement > Components: core >Reporter: Dénes Bodó >Assignee: Dénes Bodó >Priority: Major > Attachments: OOZIE-3728-001.patch > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
