[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[ https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036232#comment-17036232 ] László Bodor commented on TEZ-4100: --- ...and, it passed, is this ready to be committed to master [~jeagles]? > Upgrade to Hadoop 3.1.3 and Guava 27 > > > Key: TEZ-4100 > URL: https://issues.apache.org/jira/browse/TEZ-4100 > Project: Apache Tez > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch, > TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch, > TEZ-4100.08.patch, TEZ-4100.08.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[
https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036122#comment-17036122
]
TezQA commented on TEZ-4100:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
30s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
20s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
31s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
37s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 58m
32s{color} | {color:green} root in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
23s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 73m 42s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.4 Server=19.03.4 base:
https://builds.apache.org/job/PreCommit-TEZ-Build/296/artifact/out/Dockerfile |
| JIRA Issue | TEZ-4100 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12993344/TEZ-4100.08.patch |
| Optional Tests | dupname asflicense javac javadoc unit xml compile |
| uname | Linux 4ca603bda7c3 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / fd19ce6 |
| Default Java | 1.8.0_242 |
| Test Results |
https://builds.apache.org/job/PreCommit-TEZ-Build/296/testReport/ |
| Max. process+thread count | 1546 (vs. ulimit of 5500) |
| modules | C: . U: . |
| Console output |
https://builds.apache.org/job/PreCommit-TEZ-Build/296/console |
| versions | git=2.7.4 maven=3.3.9 |
| Powered by | Apache Yetus 0.11.1 https://yetus.apache.org |
This message was automatically generated.
> Upgrade to Hadoop 3.1.3 and Guava 27
>
>
> Key: TEZ-4100
> URL: https://issues.apache.org/jira/browse/TEZ-4100
> Project: Apache Tez
> Issue Type: Improvement
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Major
> Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch,
> TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch,
> TEZ-4100.08.patch, TEZ-4100.08.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[ https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17036063#comment-17036063 ] László Bodor commented on TEZ-4100: --- [~jeagles]: as far as I remember, TestRecovery has been fine so far, I tend to think that it could not be related to the hadoop upgrade, so retriggering precommit tests > Upgrade to Hadoop 3.1.3 and Guava 27 > > > Key: TEZ-4100 > URL: https://issues.apache.org/jira/browse/TEZ-4100 > Project: Apache Tez > Issue Type: Improvement >Reporter: László Bodor >Assignee: László Bodor >Priority: Major > Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch, > TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch, > TEZ-4100.08.patch, TEZ-4100.08.patch > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[
https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035536#comment-17035536
]
Jonathan Turner Eagles commented on TEZ-4100:
-
I believe the TestRecovery test must be hanging as it reports no results.
{noformat}
[INFO] Running org.apache.tez.test.TestAMRecovery
[INFO] Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 239.782
s - in org.apache.tez.test.TestAMRecovery
[INFO] Running org.apache.tez.test.TestFaultTolerance
[WARNING] Tests run: 26, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
191.445 s - in org.apache.tez.test.TestFaultTolerance
[INFO] Running org.apache.tez.test.TestTezJobs
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 249.451
s - in org.apache.tez.test.TestTezJobs
[INFO] Running org.apache.tez.test.TestPipelinedShuffle
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 55.006 s
- in org.apache.tez.test.TestPipelinedShuffle
[INFO] Running org.apache.tez.test.TestSecureShuffle
[INFO] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 275.648
s - in org.apache.tez.test.TestSecureShuffle
[INFO] Running org.apache.tez.test.TestDAGRecovery2
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.306 s
- in org.apache.tez.test.TestDAGRecovery2
[INFO] Running org.apache.tez.test.TestExceptionPropagation
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.375 s
- in org.apache.tez.test.TestExceptionPropagation
[INFO] Running org.apache.tez.test.TestLocalMode
[INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 45.654
s - in org.apache.tez.test.TestLocalMode
[INFO] Running org.apache.tez.test.TestRecovery
[INFO] Running org.apache.tez.test.TestDAGRecovery
[INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 97.659 s
- in org.apache.tez.test.TestDAGRecovery
[INFO] Running org.apache.tez.test.TestTaskErrorsUsingLocalMode
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.775 s
- in org.apache.tez.test.TestTaskErrorsUsingLocalMode
[INFO] Running org.apache.tez.mapreduce.TestMRRJobs
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 159.316
s - in org.apache.tez.mapreduce.TestMRRJobs
[INFO] Running org.apache.tez.mapreduce.TestMRRJobsDAGApi
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 221.159
s - in org.apache.tez.mapreduce.TestMRRJobsDAGApi
[INFO]
[INFO] Results:
[INFO]
[WARNING] Tests run: 97, Failures: 0, Errors: 0, Skipped: 1
{noformat}
> Upgrade to Hadoop 3.1.3 and Guava 27
>
>
> Key: TEZ-4100
> URL: https://issues.apache.org/jira/browse/TEZ-4100
> Project: Apache Tez
> Issue Type: Improvement
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Major
> Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch,
> TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch,
> TEZ-4100.08.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[
https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035530#comment-17035530
]
László Bodor commented on TEZ-4100:
---
from:
https://builds.apache.org/job/PreCommit-TEZ-Build/294/artifact/out/patch-unit-root.txt
I would not tell that I can see where is the timeout...
{code}
[INFO] Running org.apache.tez.mapreduce.TestMRRJobsDAGApi
[INFO] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 221.159
s - in org.apache.tez.mapreduce.TestMRRJobsDAGApi
{code}
but tez-tests is reported as FAILURE...this should be investigated further
(but not related to hadoop upgrade I think)
> Upgrade to Hadoop 3.1.3 and Guava 27
>
>
> Key: TEZ-4100
> URL: https://issues.apache.org/jira/browse/TEZ-4100
> Project: Apache Tez
> Issue Type: Improvement
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Major
> Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch,
> TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch,
> TEZ-4100.08.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[
https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035516#comment-17035516
]
TezQA commented on TEZ-4100:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
30s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
12s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
21s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
31s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
31s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 56m 39s{color}
| {color:red} root in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
40s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 72m 19s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.4 Server=19.03.4 base:
https://builds.apache.org/job/PreCommit-TEZ-Build/294/artifact/out/Dockerfile |
| JIRA Issue | TEZ-4100 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12993245/TEZ-4100.08.patch |
| Optional Tests | dupname asflicense javac javadoc unit xml compile |
| uname | Linux a9541fec56d2 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 544290e |
| Default Java | 1.8.0_242 |
| unit |
https://builds.apache.org/job/PreCommit-TEZ-Build/294/artifact/out/patch-unit-root.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-TEZ-Build/294/testReport/ |
| Max. process+thread count | 1158 (vs. ulimit of 5500) |
| modules | C: . U: . |
| Console output |
https://builds.apache.org/job/PreCommit-TEZ-Build/294/console |
| versions | git=2.7.4 maven=3.3.9 |
| Powered by | Apache Yetus 0.11.1 https://yetus.apache.org |
This message was automatically generated.
> Upgrade to Hadoop 3.1.3 and Guava 27
>
>
> Key: TEZ-4100
> URL: https://issues.apache.org/jira/browse/TEZ-4100
> Project: Apache Tez
> Issue Type: Improvement
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Major
> Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch,
> TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch,
> TEZ-4100.08.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (TEZ-4100) Upgrade to Hadoop 3.1.3 and Guava 27
[
https://issues.apache.org/jira/browse/TEZ-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035238#comment-17035238
]
TezQA commented on TEZ-4100:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
32s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
26s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
19s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
34s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 2m
1s{color} | {color:red} root in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
26s{color} | {color:red} root in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 26s{color}
| {color:red} root in the patch failed. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
30s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 3m 49s{color}
| {color:red} root in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
22s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 16m 51s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.4 Server=19.03.4 base:
https://builds.apache.org/job/PreCommit-TEZ-Build/293/artifact/out/Dockerfile |
| JIRA Issue | TEZ-4100 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12993245/TEZ-4100.08.patch |
| Optional Tests | dupname asflicense javac javadoc unit xml compile |
| uname | Linux a8d179655a4a 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19
08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 86182d0 |
| Default Java | 1.8.0_242 |
| mvninstall |
https://builds.apache.org/job/PreCommit-TEZ-Build/293/artifact/out/patch-mvninstall-root.txt
|
| compile |
https://builds.apache.org/job/PreCommit-TEZ-Build/293/artifact/out/patch-compile-root.txt
|
| javac |
https://builds.apache.org/job/PreCommit-TEZ-Build/293/artifact/out/patch-compile-root.txt
|
| unit |
https://builds.apache.org/job/PreCommit-TEZ-Build/293/artifact/out/patch-unit-root.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-TEZ-Build/293/testReport/ |
| Max. process+thread count | 241 (vs. ulimit of 5500) |
| modules | C: . U: . |
| Console output |
https://builds.apache.org/job/PreCommit-TEZ-Build/293/console |
| versions | git=2.7.4 maven=3.3.9 |
| Powered by | Apache Yetus 0.11.1 https://yetus.apache.org |
This message was automatically generated.
> Upgrade to Hadoop 3.1.3 and Guava 27
>
>
> Key: TEZ-4100
> URL: https://issues.apache.org/jira/browse/TEZ-4100
> Project: Apache Tez
> Issue Type: Improvement
>Reporter: László Bodor
>Assignee: László Bodor
>Priority: Major
> Attachments: TEZ-4100.01.patch, TEZ-4100.02.patch, TEZ-4100.03.patch,
> TEZ-4100.04.patch, TEZ-4100.05.patch, TEZ-4100.06.patch, TEZ-4100.07.patch,
> TEZ-4100.08.patch
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
