[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-14 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913187#comment-17913187
 ] 

ASF subversion and git services commented on OOZIE-3728:


Commit 33c90dd3483921af108dacdd073dcbe3b780348b in oozie's branch 
refs/heads/master from Denes Bodo
[ https://gitbox.apache.org/repos/asf?p=oozie.git;h=33c90dd34 ]

OOZIE-3728 Upgrade Hadoop to 2.8.5


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-14 Thread Jira


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913109#comment-17913109
 ] 

Attila Sasvári commented on OOZIE-3728:
---

+1 to merge OOZIE-3728-003.patch

Many thanks Dénes.

> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-14 Thread Jira


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912799#comment-17912799
 ] 

Dénes Bodó commented on OOZIE-3728:
---

I think [^OOZIE-3728-003.patch] would be my candidate to merge.

[^OOZIE-3728-004.patch] contains Curator version upgrade to match with the one 
in Hadoop but that new Curator 2.7.1 requires Guava 11 -> 16 upgrade too. In my 
opinion the version upgrades should be handled in a later ticket.

> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-13 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912654#comment-17912654
 ] 

Hadoop QA commented on OOZIE-3728:
--


Testing JIRA OOZIE-3728

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [29] new bugs found in total that would be 
nice to have fixed.
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:orange}0{color} There are [15] new bugs found in [tools] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:orange}0{color} There are [13] new bugs found in [core] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie] 
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in 
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2796
.Tests failed : 2
.Tests in error   : 16
.Tests timed out  : 1

{color:red}-1{color} [ERROR] There are [2] test failures in [sharelib]. Listing 
only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark

{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing 
only the first [5] ones

{color:red}-1{color} [ERROR] There are [2] test errors in 
[zookeeper-security-tests]. Listing only the first [5] ones
testCheckAndSetACLs:org.apache.oozie.util.TestZKUtilsWithSecurity
testNewUsingACLs:org.apache.oozie.util.TestZKUtilsWithSecurity

Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 
{color:green}+1 MODERNIZER{color}


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/239/



> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 

[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-13 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912614#comment-17912614
 ] 

Hadoop QA commented on OOZIE-3728:
--

PreCommit-OOZIE-Build started


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> OOZIE-3728-003.patch, OOZIE-3728-004.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-13 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912531#comment-17912531
 ] 

Hadoop QA commented on OOZIE-3728:
--


Testing JIRA OOZIE-3728

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be 
nice to have fixed.
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:orange}0{color} There are [15] new bugs found in [tools] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:orange}0{color} There are [9] new bugs found in [core] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie] 
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in 
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 3262
.Tests failed : 4
.Tests in error   : 18
.Tests timed out  : 1

{color:red}-1{color} [ERROR] There are [2] test failures in [core]. Listing 
only the first [5] ones
testDistCpFile:org.apache.oozie.action.hadoop.TestDistCpActionExecutor
{color:red}-1{color} [ERROR] There are [2] test failures in [sharelib]. Listing 
only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark

{color:red}-1{color} [ERROR] There are [4] test errors in [core]. Listing only 
the first [5] ones

{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing 
only the first [5] ones


Check console output for the full list of errors/failures
.{color:orange}Tests failed at first run:{color}
TestSignalXCommand#testDeadlockForForkParallelSubmit
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 
{color:green}+1 MODERNIZER{color}


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/238/



> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: 

[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-13 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912441#comment-17912441
 ] 

Hadoop QA commented on OOZIE-3728:
--

PreCommit-OOZIE-Build started


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> OOZIE-3728-003.patch, oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-11 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912217#comment-17912217
 ] 

Hadoop QA commented on OOZIE-3728:
--


Testing JIRA OOZIE-3728

Cleaning local git workspace



{color:red}-1{color} Patch failed to apply to head of branch




> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-11 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912216#comment-17912216
 ] 

Hadoop QA commented on OOZIE-3728:
--

PreCommit-OOZIE-Build started


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-11 Thread Jira


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912215#comment-17912215
 ] 

Attila Sasvári commented on OOZIE-3728:
---

Many thanks for the new patch [~dionusos]!

I tested the rest of the examples, and most of the jobs succeeded:
!oozie_examples-job_states.png!

I think using Hadoop version 2.8.5 already improves the current state of 
things, so +1 from me to merge this.

(Note: the documentation will need to be updated about the default Hadoop 
version. )

> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch, 
> oozie_examples-job_states.png
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-10 Thread Jira


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912015#comment-17912015
 ] 

Dénes Bodó commented on OOZIE-3728:
---

On Monday I will check the Oozie dependencies' version against Hadoop 2.8.5 
dependencies' version maybe we can upgrade something to solve the remaining 
test failures.

 

In an Ubuntu docker image with Java8 and Maven 3.6.3 Sqoop, Hive and Hive2 
tests pass with the current change. PySpark does not, neither 1.6 nor 2.x. 
Anyway, Spark3 is almost deprecated now.

 

When should we fix the test issues? Should we merge the Hadoop upgrade as-is to 
unblock other other testing or make it 100% now? I vote for merge-now-fix-later.

> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-09 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911584#comment-17911584
 ] 

Hadoop QA commented on OOZIE-3728:
--


Testing JIRA OOZIE-3728

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be 
nice to have fixed.
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:orange}0{color} There are [15] new bugs found in [tools] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:orange}0{color} There are [9] new bugs found in [core] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie] 
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in 
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 3262
.Tests failed : 4
.Tests in error   : 18
.Tests timed out  : 1

{color:red}-1{color} [ERROR] There are [2] test failures in [core]. Listing 
only the first [5] ones
testDistCpFile:org.apache.oozie.action.hadoop.TestDistCpActionExecutor
{color:red}-1{color} [ERROR] There are [2] test failures in [sharelib]. Listing 
only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark

{color:red}-1{color} [ERROR] There are [4] test errors in [core]. Listing only 
the first [5] ones

{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing 
only the first [5] ones


Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 
{color:green}+1 MODERNIZER{color}


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/236/



> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due 

[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-09 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911492#comment-17911492
 ] 

Hadoop QA commented on OOZIE-3728:
--

PreCommit-OOZIE-Build started


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-09 Thread Jira


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911361#comment-17911361
 ] 

Dénes Bodó commented on OOZIE-3728:
---

Thank you [~asasvari] . I only have MacOS and I can run the Hive share lib 
tests from IntelliJ IDEA successfully, but it always stuck when using only 
maven:
{code:bash}
mvn test -Puber -pl sharelib/hive{code}
Looks like the Hive job started by the Oozie launcher does not proceed.

 

I'll try to run it from a Docker container maybe that helps.

> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-08 Thread Jira


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911277#comment-17911277
 ] 

Attila Sasvári commented on OOZIE-3728:
---

[~dionusos] many thanks for the patch! Build results are reported now, but the 
unit tests are failing. 

If I try to create a release with {{bin/mkdistro.sh -Puber -DskipTests}}, the 
mvn build will fail due to non-existing pentaho dependencies. 

If you add
{code}

  
org.pentaho
  pentaho-aggdesigner-algorithm
  

{code}
to the *hive-webhcat-java-client* and *hive-hcatalog-server-extensions* 
dependencies of the uber profile in pom.xml, mkdistro.sh will succeed.

Using a 1-node pseudo hadoop 2.8.5 cluster I installed in Docker, I submitted 
some of the Oozie examples:
- MapReduce, Hive, Pig & Spark examples succeeded
- Hive2, pySpark failed due to dependencies (I had no Hive2 server and python 
installed)


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-08 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911267#comment-17911267
 ] 

Hadoop QA commented on OOZIE-3728:
--


Testing JIRA OOZIE-3728

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be 
nice to have fixed.
.{color:orange}0{color} There are [15] new bugs found in [tools] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie] 
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:orange}0{color} There are [9] new bugs found in [core] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in 
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [examples].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2813
.Tests failed : 12
.Tests in error   : 14
.Tests timed out  : 1

{color:red}-1{color} [ERROR] There are [12] test failures in [sharelib]. 
Listing only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark

{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing 
only the first [5] ones


Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 
{color:green}+1 MODERNIZER{color}


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/235/



> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-08 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911238#comment-17911238
 ] 

Hadoop QA commented on OOZIE-3728:
--

PreCommit-OOZIE-Build started


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-08 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911189#comment-17911189
 ] 

Hadoop QA commented on OOZIE-3728:
--


Testing JIRA OOZIE-3728

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 21 new javac warning(s)
{color:orange}0{color} There are [25] new bugs found in total that would be 
nice to have fixed.
.{color:orange}0{color} There are [15] new bugs found in [tools] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: tools/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:orange}0{color} There are [1] new bugs found in [sharelib/oozie] 
that would be nice to have fixed.
.You can find the SpotBugs diff here: sharelib/oozie/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in [webapp].
.{color:orange}0{color} There are [9] new bugs found in [core] that would 
be nice to have fixed.
.You can find the SpotBugs diff here: core/findbugs-new.html
.{color:green}+1{color} There are no new bugs found in 
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [examples].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2811
.Tests failed : 12
.Tests in error   : 14
.Tests timed out  : 1

{color:red}-1{color} [ERROR] There are [12] test failures in [sharelib]. 
Listing only the first [5] ones
testPyspark:org.apache.oozie.action.hadoop.TestPyspark

{color:red}-1{color} [ERROR] There are [14] test errors in [sharelib]. Listing 
only the first [5] ones


Check console output for the full list of errors/failures
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 
{color:green}+1 MODERNIZER{color}


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://ci-hadoop.apache.org/job/PreCommit-OOZIE-Build/234/



> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (OOZIE-3728) Upgrade Hadoop to 2.8.5

2025-01-08 Thread Hadoop QA (Jira)


[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911127#comment-17911127
 ] 

Hadoop QA commented on OOZIE-3728:
--

PreCommit-OOZIE-Build started


> Upgrade Hadoop to 2.8.5
> ---
>
> Key: OOZIE-3728
> URL: https://issues.apache.org/jira/browse/OOZIE-3728
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Dénes Bodó
>Assignee: Dénes Bodó
>Priority: Major
> Attachments: OOZIE-3728-001.patch
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)