[jira] [Updated] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3990: - Attachment: TEZ-3990.005.patch > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645254#comment-16645254 ] Kuhu Shukla commented on TEZ-3990: -- Missed a variable name change. d'oh. > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch, > TEZ-3990.006..patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[
https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645369#comment-16645369
]
TezQA commented on TEZ-3990:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in master failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_172. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
26s{color} | {color:green} master passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in master failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_172. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 5s{color}
| {color:red} tez-runtime-library in the patch failed with JDK v1.8.0_181.
{color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_172. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 5s{color}
| {color:red} tez-runtime-library in the patch failed with JDK v1.8.0_172.
{color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 26s{color} | {color:orange} tez-runtime-library: The patch generated 9 new +
707 unchanged - 2 fixed = 716 total (was 709) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_172. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 4s{color}
| {color:red} tez-runtime-library in the patch failed with JDK v1.8.0_172.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
4s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 2m 16s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-3990 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943280/TEZ-3990.006.patch |
| Optional Tests | dupname asflicense javac javadoc unit findbugs
checkstyle compile |
| uname | Linux asf912.gq1.ygridcore.net 4.4.0-133-generic #159-Ubuntu SMP Fri
Aug 10 07:31:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_172 |
| Multi-JDK versions | /usr/lib/jvm/java-8-openjdk-amd64:1.8.0_181
/usr/local/asfpackages/java/jdk1.8.0_172:1.8.0_172 |
| mvninstall |
[jira] [Updated] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3990: - Attachment: (was: TEZ-3990.006..patch) > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645213#comment-16645213 ] Kuhu Shukla edited comment on TEZ-3961 at 10/10/18 4:25 PM: Thank you for the ping [~jeagles]. This patch is simple but needs review on whether it is ok to remove the DOCTYPE declaration. was (Author: kshukla): Thank you for the ping [~jeagles]. This patch is simple but needs review on whether it is ok to emovethe DOCTYPE declaration. > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3961.001.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3961: - Attachment: TEZ-3961.001.patch > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3961.001.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3990: - Attachment: TEZ-3990.006..patch > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch, > TEZ-3990.006..patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645328#comment-16645328 ] Jonathan Eagles commented on TEZ-3961: -- [~kshukla], can you address the ASF license warnings? > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3961.001.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[
https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645218#comment-16645218
]
TezQA commented on TEZ-3990:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
28s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
12s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
29s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
13s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
13s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 28s{color} | {color:orange} tez-runtime-library: The patch generated 9 new +
706 unchanged - 2 fixed = 715 total (was 708) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
45s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
16s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 3m
53s{color} | {color:green} tez-runtime-library in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
5s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 8m 22s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-3990 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943266/TEZ-3990.005.patch |
| Optional Tests | dupname asflicense javac javadoc unit findbugs
checkstyle compile |
| uname | Linux asf900.gq1.ygridcore.net 3.13.0-139-generic #188-Ubuntu SMP Tue
Jan 9 14:43:09 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_172 |
| findbugs | v3.0.1 |
| checkstyle |
https://builds.apache.org/job/PreCommit-TEZ-Build/19/artifact/out/diff-checkstyle-tez-runtime-library.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-TEZ-Build/19/testReport/ |
| modules | C: tez-runtime-library U: tez-runtime-library |
| Console output | https://builds.apache.org/job/PreCommit-TEZ-Build/19/console
|
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> The number of shuffle penalties for a host/inputAttemptIdentifier should be
> capped
> --
>
> Key: TEZ-3990
> URL: https://issues.apache.org/jira/browse/TEZ-3990
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.9.1, 0.10.0
>Reporter: Kuhu Shukla
>Assignee: Kuhu Shukla
>Priority: Major
> Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch,
> TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch
>
>
> In a scenario where the same mapId fetches fail, the penalty code allows
> adding the same Host/InputAttemptIdentifier over and over with revised
> penalty time that grows exponentially. It should at some point drop the
>
[jira] [Commented] (TEZ-3075) Revamp bad node handling
[ https://issues.apache.org/jira/browse/TEZ-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645319#comment-16645319 ] JIN SUN commented on TEZ-3075: -- +1 need more heuristics for handle machine failure > Revamp bad node handling > > > Key: TEZ-3075 > URL: https://issues.apache.org/jira/browse/TEZ-3075 > Project: Apache Tez > Issue Type: Improvement >Reporter: Bikas Saha >Priority: Major > > The current logic around that is derived from MR and does not work in all > cases. > Things to consider > 1) Have a notion of probation where machines are put out of service for a > period of time (say 5m, 15m and 30m) before being given up for good. This > allows more graceful handling of temporary glitches. > 2) Different handling for YARN marking a node as bad vs internal heuritics > 3) Bad nodes should not immediately trigger re-execution of completed work. > That should be based on presence of downstream consumers (ie existing demand > for that output) and a reasonable indication by other consumers from that > node that it cannot serve results (eg. multiple reports of read errors with > that node as a source). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3990: - Attachment: TEZ-3990.006.patch > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch, TEZ-3990.006.patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[
https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645350#comment-16645350
]
TezQA commented on TEZ-3990:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 1m
52s{color} | {color:red} tez-runtime-library in master failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
7s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_172. {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
1s{color} | {color:green} master passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
6s{color} | {color:red} tez-runtime-library in master failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
5s{color} | {color:red} tez-runtime-library in master failed with JDK
v1.8.0_172. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 4s{color}
| {color:red} tez-runtime-library in the patch failed with JDK v1.8.0_181.
{color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_172. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 4s{color}
| {color:red} tez-runtime-library in the patch failed with JDK v1.8.0_172.
{color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 27s{color} | {color:orange} tez-runtime-library: The patch generated 9 new +
707 unchanged - 2 fixed = 716 total (was 709) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
4s{color} | {color:red} tez-runtime-library in the patch failed with JDK
v1.8.0_172. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 0m 5s{color}
| {color:red} tez-runtime-library in the patch failed with JDK v1.8.0_172.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
13s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 4m 51s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-3990 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943280/TEZ-3990.006.patch |
| Optional Tests | dupname asflicense javac javadoc unit findbugs
checkstyle compile |
| uname | Linux asf912.gq1.ygridcore.net 4.4.0-133-generic #159-Ubuntu SMP Fri
Aug 10 07:31:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_172 |
| Multi-JDK versions | /usr/lib/jvm/java-8-openjdk-amd64:1.8.0_181
/usr/local/asfpackages/java/jdk1.8.0_172:1.8.0_172 |
| mvninstall |
[jira] [Updated] (TEZ-4004) Update jetty9 to align with Hadoop and Hive
[ https://issues.apache.org/jira/browse/TEZ-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-4004: - Description: https://abi-laboratory.pro/index.php?view=timeline=java=jetty https://issues.apache.org/jira/browse/HADOOP-15815 > Update jetty9 to align with Hadoop and Hive > --- > > Key: TEZ-4004 > URL: https://issues.apache.org/jira/browse/TEZ-4004 > Project: Apache Tez > Issue Type: Bug >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles >Priority: Major > > https://abi-laboratory.pro/index.php?view=timeline=java=jetty > https://issues.apache.org/jira/browse/HADOOP-15815 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[
https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645225#comment-16645225
]
TezQA commented on TEZ-3961:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:blue}0{color} | {color:blue} shelldocs {color} | {color:blue} 0m
0s{color} | {color:blue} Shelldocs was not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
36s{color} | {color:blue} Maven dependency ordering for branch {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
8s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} shellcheck {color} | {color:green} 0m
0s{color} | {color:green} There were no new shellcheck issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 0m
13s{color} | {color:red} The patch generated 1 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 1m 8s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-3961 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943267/TEZ-3961.001.patch |
| Optional Tests | dupname asflicense xml shellcheck shelldocs |
| uname | Linux asf900.gq1.ygridcore.net 3.13.0-139-generic #188-Ubuntu SMP Tue
Jan 9 14:43:09 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| shellcheck | v0.3.3 (This is an old version that has serious bugs. Consider
upgrading.) |
| asflicense |
https://builds.apache.org/job/PreCommit-TEZ-Build/20/artifact/out/patch-asflicense-problems.txt
|
| modules | C: tez-ui . U: . |
| Console output | https://builds.apache.org/job/PreCommit-TEZ-Build/20/console
|
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Tez UI web.xml tries to reach out to java.sun.com for validation after moving
> to jetty-9
>
>
> Key: TEZ-3961
> URL: https://issues.apache.org/jira/browse/TEZ-3961
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.9.1
>Reporter: Kuhu Shukla
>Assignee: Kuhu Shukla
>Priority: Major
> Attachments: TEZ-3961.001.patch
>
>
> Tez UI can throw a 503 error when hosted on a server that cannot reach public
> IPs like java.sun.com which are listed as servers for DTDs in web.xml. This
> behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which
> removed provided schemas that were being shipped with earlier versions. It is
> suboptimal even in cases where public IPs are accessible to fetch the DTD for
> a very very simple web.xml file. We can choose to either remove the DTD
> validation or add dependency explicitly to org.eclipse.jetty.toolchain »
> jetty-osgi-servlet-api to allow for this jetty change to not affect the
> behavior of tez-ui.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (TEZ-4004) Update jetty9 to align with Hadoop and Hive
Jonathan Eagles created TEZ-4004: Summary: Update jetty9 to align with Hadoop and Hive Key: TEZ-4004 URL: https://issues.apache.org/jira/browse/TEZ-4004 Project: Apache Tez Issue Type: Bug Reporter: Jonathan Eagles Assignee: Jonathan Eagles -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (TEZ-4005) Add Host-Source input penalties to Unordered Shuffle
Kuhu Shukla created TEZ-4005: Summary: Add Host-Source input penalties to Unordered Shuffle Key: TEZ-4005 URL: https://issues.apache.org/jira/browse/TEZ-4005 Project: Apache Tez Issue Type: Task Affects Versions: 0.9.1 Reporter: Kuhu Shukla Ordered shuffle has a mechanism to penalize hosts and try exponential waits for retrying. Unordered case is missing this feature. Would be really useful to add this and make shuffle policies consistent. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-4004) Update jetty9 to align with Hadoop and Hive
[ https://issues.apache.org/jira/browse/TEZ-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645415#comment-16645415 ] Kuhu Shukla commented on TEZ-4004: -- HADOOP-15815 seems to try and go to 9.3.25 jetty (9.3.25.v20180904) although anything 24 (and up?) should be good based on [~kihwal]. I see some new methods in 9.3.25 compared to 9.3.24. > Update jetty9 to align with Hadoop and Hive > --- > > Key: TEZ-4004 > URL: https://issues.apache.org/jira/browse/TEZ-4004 > Project: Apache Tez > Issue Type: Bug >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles >Priority: Major > Attachments: TEZ-4004.001.patch > > > https://abi-laboratory.pro/index.php?view=timeline=java=jetty > https://issues.apache.org/jira/browse/HADOOP-15815 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated TEZ-3961: - Attachment: TEZ-3961.002.patch > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3961.001.patch, TEZ-3961.002.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645452#comment-16645452 ] Kuhu Shukla commented on TEZ-3990: -- Opened https://issues.apache.org/jira/browse/TEZ-4005 for unordered feature addition for penalties. > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch, TEZ-3990.006.patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[
https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645478#comment-16645478
]
TezQA commented on TEZ-3961:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
5s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 0m 16s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-3961 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943291/TEZ-3961.002.patch |
| Optional Tests | dupname asflicense xml |
| uname | Linux asf915.gq1.ygridcore.net 4.4.0-133-generic #159-Ubuntu SMP Fri
Aug 10 07:31:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| modules | C: tez-ui U: tez-ui |
| Console output | https://builds.apache.org/job/PreCommit-TEZ-Build/25/console
|
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Tez UI web.xml tries to reach out to java.sun.com for validation after moving
> to jetty-9
>
>
> Key: TEZ-3961
> URL: https://issues.apache.org/jira/browse/TEZ-3961
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.9.1
>Reporter: Kuhu Shukla
>Assignee: Kuhu Shukla
>Priority: Major
> Attachments: TEZ-3961.001.patch, TEZ-3961.002.patch
>
>
> Tez UI can throw a 503 error when hosted on a server that cannot reach public
> IPs like java.sun.com which are listed as servers for DTDs in web.xml. This
> behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which
> removed provided schemas that were being shipped with earlier versions. It is
> suboptimal even in cases where public IPs are accessible to fetch the DTD for
> a very very simple web.xml file. We can choose to either remove the DTD
> validation or add dependency explicitly to org.eclipse.jetty.toolchain »
> jetty-osgi-servlet-api to allow for this jetty change to not affect the
> behavior of tez-ui.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645502#comment-16645502 ] Kuhu Shukla commented on TEZ-3961: -- [~jeagles], request for review. Thanks a lot! > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3961.001.patch, TEZ-3961.002.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (TEZ-4004) Update jetty9 to align with Hadoop and Hive
[ https://issues.apache.org/jira/browse/TEZ-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-4004: - Attachment: TEZ-4004.001.patch > Update jetty9 to align with Hadoop and Hive > --- > > Key: TEZ-4004 > URL: https://issues.apache.org/jira/browse/TEZ-4004 > Project: Apache Tez > Issue Type: Bug >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles >Priority: Major > Attachments: TEZ-4004.001.patch > > > https://abi-laboratory.pro/index.php?view=timeline=java=jetty > https://issues.apache.org/jira/browse/HADOOP-15815 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[ https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645421#comment-16645421 ] Kuhu Shukla commented on TEZ-3990: -- The build seems to be having a protoc version issue. > The number of shuffle penalties for a host/inputAttemptIdentifier should be > capped > -- > > Key: TEZ-3990 > URL: https://issues.apache.org/jira/browse/TEZ-3990 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1, 0.10.0 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch, > TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch, TEZ-3990.006.patch > > > In a scenario where the same mapId fetches fail, the penalty code allows > adding the same Host/InputAttemptIdentifier over and over with revised > penalty time that grows exponentially. It should at some point drop the > retrying and report failure to the AM asap to allow the job to rectify the > upstream output. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3990) The number of shuffle penalties for a host/inputAttemptIdentifier should be capped
[
https://issues.apache.org/jira/browse/TEZ-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645440#comment-16645440
]
TezQA commented on TEZ-3990:
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m
22s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
13s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
57s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
50s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
20s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 0m
14s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
12s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 26s{color} | {color:orange} tez-runtime-library: The patch generated 9 new +
706 unchanged - 2 fixed = 715 total (was 708) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
14s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 4m
2s{color} | {color:green} tez-runtime-library in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
10s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 10m 59s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-3990 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943280/TEZ-3990.006.patch |
| Optional Tests | dupname asflicense javac javadoc unit findbugs
checkstyle compile |
| uname | Linux asf910.gq1.ygridcore.net 3.13.0-153-generic #203-Ubuntu SMP Thu
Jun 14 08:52:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_172 |
| findbugs | v3.0.1 |
| checkstyle |
https://builds.apache.org/job/PreCommit-TEZ-Build/23/artifact/out/diff-checkstyle-tez-runtime-library.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-TEZ-Build/23/testReport/ |
| modules | C: tez-runtime-library U: tez-runtime-library |
| Console output | https://builds.apache.org/job/PreCommit-TEZ-Build/23/console
|
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> The number of shuffle penalties for a host/inputAttemptIdentifier should be
> capped
> --
>
> Key: TEZ-3990
> URL: https://issues.apache.org/jira/browse/TEZ-3990
> Project: Apache Tez
> Issue Type: Bug
>Affects Versions: 0.9.1, 0.10.0
>Reporter: Kuhu Shukla
>Assignee: Kuhu Shukla
>Priority: Major
> Attachments: TEZ-3990.001.patch, TEZ-3990.002.patch,
> TEZ-3990.003.patch, TEZ-3990.004.patch, TEZ-3990.005.patch, TEZ-3990.006.patch
>
>
> In a scenario where the same mapId fetches fail, the penalty code allows
> adding the same Host/InputAttemptIdentifier over and over with revised
> penalty time that grows exponentially. It should at some
[jira] [Issue Comment Deleted] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated TEZ-3961: - Comment: was deleted (was: +1. To addendum for branch-0.9. Committed to branch-0.9. Thanks for the patch, [~jmarhuen].) > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Fix For: 0.9.2, 0.10.0 > > Attachments: TEZ-3961.001.patch, TEZ-3961.002.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-4004) Update jetty9 to align with Hadoop and Hive
[
https://issues.apache.org/jira/browse/TEZ-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645477#comment-16645477
]
TezQA commented on TEZ-4004:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 4m
48s{color} | {color:red} root in master failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
16s{color} | {color:red} root in master failed with JDK v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
10s{color} | {color:red} root in master failed with JDK v1.8.0_172. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
33s{color} | {color:red} root in master failed with JDK v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
12s{color} | {color:red} root in master failed with JDK v1.8.0_172. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:red}-1{color} | {color:red} mvninstall {color} | {color:red} 0m
47s{color} | {color:red} root in the patch failed. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
12s{color} | {color:red} root in the patch failed with JDK v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 12s{color}
| {color:red} root in the patch failed with JDK v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} compile {color} | {color:red} 0m
14s{color} | {color:red} root in the patch failed with JDK v1.8.0_172. {color} |
| {color:red}-1{color} | {color:red} javac {color} | {color:red} 0m 14s{color}
| {color:red} root in the patch failed with JDK v1.8.0_172. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
14s{color} | {color:red} root in the patch failed with JDK v1.8.0_181. {color} |
| {color:red}-1{color} | {color:red} javadoc {color} | {color:red} 0m
15s{color} | {color:red} root in the patch failed with JDK v1.8.0_172. {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 1m 46s{color}
| {color:red} root in the patch failed with JDK v1.8.0_172. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
23s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 12m 22s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | TEZ-4004 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12943285/TEZ-4004.001.patch |
| Optional Tests | dupname asflicense javac javadoc unit xml compile |
| uname | Linux asf915.gq1.ygridcore.net 4.4.0-133-generic #159-Ubuntu SMP Fri
Aug 10 07:31:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-TEZ-Build/yetus/precommit/personality/tez.sh
|
| git revision | master / 2f17388 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_172 |
| Multi-JDK versions | /usr/lib/jvm/java-8-openjdk-amd64:1.8.0_181
/usr/local/asfpackages/java/jdk1.8.0_172:1.8.0_172 |
| mvninstall |
https://builds.apache.org/job/PreCommit-TEZ-Build/24/artifact/out/branch-mvninstall-root.txt
|
| compile |
https://builds.apache.org/job/PreCommit-TEZ-Build/24/artifact/out/branch-compile-root-jdk1.8.0_181.txt
|
| compile |
https://builds.apache.org/job/PreCommit-TEZ-Build/24/artifact/out/branch-compile-root-jdk1.8.0_172.txt
|
| javadoc |
https://builds.apache.org/job/PreCommit-TEZ-Build/24/artifact/out/branch-javadoc-root-jdk1.8.0_181.txt
|
| javadoc |
https://builds.apache.org/job/PreCommit-TEZ-Build/24/artifact/out/branch-javadoc-root-jdk1.8.0_172.txt
|
| mvninstall |
https://builds.apache.org/job/PreCommit-TEZ-Build/24/artifact/out/patch-mvninstall-root.txt
[jira] [Commented] (TEZ-4004) Update jetty9 to align with Hadoop and Hive
[ https://issues.apache.org/jira/browse/TEZ-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645603#comment-16645603 ] Jonathan Eagles commented on TEZ-4004: -- [~kshukla], let's wait on the Hadoop jira. It seems like Hadoop will likely switch to 9.3.24 instead of 9.3.25. But we'll see. > Update jetty9 to align with Hadoop and Hive > --- > > Key: TEZ-4004 > URL: https://issues.apache.org/jira/browse/TEZ-4004 > Project: Apache Tez > Issue Type: Bug >Reporter: Jonathan Eagles >Assignee: Jonathan Eagles >Priority: Major > Attachments: TEZ-4004.001.patch > > > https://abi-laboratory.pro/index.php?view=timeline=java=jetty > https://issues.apache.org/jira/browse/HADOOP-15815 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TEZ-3961) Tez UI web.xml tries to reach out to java.sun.com for validation after moving to jetty-9
[ https://issues.apache.org/jira/browse/TEZ-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645599#comment-16645599 ] Jonathan Eagles commented on TEZ-3961: -- +1. Thanks, [~kshukla]. Committed this patch to branch-0.9 and master. > Tez UI web.xml tries to reach out to java.sun.com for validation after moving > to jetty-9 > > > Key: TEZ-3961 > URL: https://issues.apache.org/jira/browse/TEZ-3961 > Project: Apache Tez > Issue Type: Bug >Affects Versions: 0.9.1 >Reporter: Kuhu Shukla >Assignee: Kuhu Shukla >Priority: Major > Fix For: 0.9.2, 0.10.0 > > Attachments: TEZ-3961.001.patch, TEZ-3961.002.patch > > > Tez UI can throw a 503 error when hosted on a server that cannot reach public > IPs like java.sun.com which are listed as servers for DTDs in web.xml. This > behavior change comes from moving to jetty 9 (Tez and Hadoop 3.0) which > removed provided schemas that were being shipped with earlier versions. It is > suboptimal even in cases where public IPs are accessible to fetch the DTD for > a very very simple web.xml file. We can choose to either remove the DTD > validation or add dependency explicitly to org.eclipse.jetty.toolchain » > jetty-osgi-servlet-api to allow for this jetty change to not affect the > behavior of tez-ui. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
