[ https://issues.apache.org/jira/browse/TEZ-4318 ]
László Bodor deleted comment on TEZ-4318:
-----------------------------------
was (Author: tez-ci):
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
30s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} dupname {color} | {color:green} 0m
0s{color} | {color:green} No case conflicting files found. {color} |
| {color:blue}0{color} | {color:blue} shelldocs {color} | {color:blue} 0m
1s{color} | {color:blue} Shelldocs was not available. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 5m
10s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m
35s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
0s{color} | {color:green} master passed with JDK
Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 3m
46s{color} | {color:green} master passed with JDK Private
Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m
17s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
44s{color} | {color:green} master passed with JDK
Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m
55s{color} | {color:green} master passed with JDK Private
Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:blue}0{color} | {color:blue} spotbugs {color} | {color:blue} 0m
41s{color} | {color:blue} Used deprecated FindBugs config; considering
switching to SpotBugs. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
47s{color} | {color:blue} tez-tools in master has 2 extant findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 5m
48s{color} | {color:blue} root in master has 2 extant findbugs warnings.
{color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m
39s{color} | {color:blue} tez-tools/analyzers/job-analyzer in master has 4
extant findbugs warnings. {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 1m
54s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
27s{color} | {color:green} the patch passed with JDK
Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 4m
27s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 4m
8s{color} | {color:green} the patch passed with JDK Private
Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 4m
8s{color} | {color:green} the patch passed {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 25s{color} | {color:orange} tez-tools: The patch generated 9 new + 47
unchanged - 0 fixed = 56 total (was 47) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 24s{color} | {color:orange} tez-tools/analyzers/job-analyzer: The patch
generated 1 new + 47 unchanged - 0 fixed = 48 total (was 47) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 22s{color} | {color:orange} tez-tools/tez-tools-webapp: The patch generated
8 new + 0 unchanged - 0 fixed = 8 total (was 0) {color} |
| {color:orange}-0{color} | {color:orange} checkstyle {color} | {color:orange}
0m 49s{color} | {color:orange} root: The patch generated 9 new + 55 unchanged -
0 fixed = 64 total (was 55) {color} |
| {color:green}+1{color} | {color:green} hadolint {color} | {color:green} 0m
1s{color} | {color:green} There were no new hadolint issues. {color} |
| {color:green}+1{color} | {color:green} markdownlint {color} | {color:green}
0m 1s{color} | {color:green} There were no new markdownlint issues. {color} |
| {color:green}+1{color} | {color:green} shellcheck {color} | {color:green} 0m
0s{color} | {color:green} There were no new shellcheck issues. {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
7s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
55s{color} | {color:green} the patch passed with JDK
Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04 {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 3m
24s{color} | {color:green} the patch passed with JDK Private
Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
8s{color} | {color:red} tez-tools generated 4 new + 2 unchanged - 0 fixed = 6
total (was 2) {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 5m
53s{color} | {color:red} root generated 4 new + 2 unchanged - 0 fixed = 6 total
(was 2) {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
38s{color} | {color:green} tez-history-parser in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
49s{color} | {color:green} tez-tools in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
48s{color} | {color:green} job-analyzer in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
30s{color} | {color:green} tez-tools-webapp in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 75m
0s{color} | {color:green} root in the patch passed. {color} |
| {color:red}-1{color} | {color:red} asflicense {color} | {color:red} 2m
15s{color} | {color:red} The patch generated 5 ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}163m 30s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:tez-tools |
| | Found reliance on default encoding in
org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String):in
org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String):
new java.io.FileReader(String) At AnalyzerService.java:[line 158] |
| | Inconsistent synchronization of
org.apache.tez.tools.webapp.service.AnalyzerService.analyzers; locked 80% of
time Unsynchronized access at AnalyzerService.java:80% of time Unsynchronized
access at AnalyzerService.java:[line 81] |
| | Possible null pointer dereference in
org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String)
due to return value of called method Dereferenced at
AnalyzerService.java:org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String)
due to return value of called method Dereferenced at
AnalyzerService.java:[line 155] |
| | org.apache.tez.tools.webapp.service.AnalyzerService.addFileToZip(File,
ZipOutputStream) may fail to clean up java.io.InputStream on checked exception
Obligation to clean up resource created at AnalyzerService.java:clean up
java.io.InputStream on checked exception Obligation to clean up resource
created at AnalyzerService.java:[line 199] is not discharged |
| FindBugs | module:root |
| | Found reliance on default encoding in
org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String):in
org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String):
new java.io.FileReader(String) At AnalyzerService.java:[line 158] |
| | Inconsistent synchronization of
org.apache.tez.tools.webapp.service.AnalyzerService.analyzers; locked 80% of
time Unsynchronized access at AnalyzerService.java:80% of time Unsynchronized
access at AnalyzerService.java:[line 81] |
| | Possible null pointer dereference in
org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String)
due to return value of called method Dereferenced at
AnalyzerService.java:org.apache.tez.tools.webapp.service.AnalyzerService.convertCSVFileToExcel(String)
due to return value of called method Dereferenced at
AnalyzerService.java:[line 155] |
| | org.apache.tez.tools.webapp.service.AnalyzerService.addFileToZip(File,
ZipOutputStream) may fail to clean up java.io.InputStream on checked exception
Obligation to clean up resource created at AnalyzerService.java:clean up
java.io.InputStream on checked exception Obligation to clean up resource
created at AnalyzerService.java:[line 199] is not discharged |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | ClientAPI=1.41 ServerAPI=1.41 base:
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/Dockerfile
|
| GITHUB PR | https://github.com/apache/tez/pull/139 |
| JIRA Issue | TEZ-4318 |
| Optional Tests | dupname asflicense javac javadoc unit xml compile spotbugs
findbugs checkstyle hadolint shellcheck shelldocs markdownlint |
| uname | Linux 7d6bca12fc98 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6
11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | personality/tez.sh |
| git revision | master / 3f541d06f |
| Default Java | Private Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 |
| Multi-JDK versions |
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.11+9-Ubuntu-0ubuntu2.20.04
/usr/lib/jvm/java-8-openjdk-amd64:Private
Build-1.8.0_292-8u292-b10-0ubuntu1~20.04-b10 |
| checkstyle |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/diff-checkstyle-tez-tools.txt
|
| checkstyle |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/diff-checkstyle-tez-tools_analyzers_job-analyzer.txt
|
| checkstyle |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/diff-checkstyle-tez-tools_tez-tools-webapp.txt
|
| checkstyle |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/diff-checkstyle-root.txt
|
| findbugs |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/new-findbugs-tez-tools.html
|
| findbugs |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/new-findbugs-root.html
|
| Test Results |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/testReport/ |
| asflicense |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/artifact/out/patch-asflicense-problems.txt
|
| Max. process+thread count | 2099 (vs. ulimit of 5500) |
| modules | C: tez-plugins/tez-history-parser tez-tools
tez-tools/analyzers/job-analyzer tez-tools/tez-tools-webapp . U: . |
| Console output |
https://ci-hadoop.apache.org/job/tez-multibranch/job/PR-139/4/console |
| versions | git=2.25.1 maven=3.6.3 shellcheck=0.7.1 findbugs=3.0.1
hadolint=1.18.0-0-g76eee5c markdownlint=0.23.2 |
| Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
> Tez debugging tools webapp
> --------------------------
>
> Key: TEZ-4318
> URL: https://issues.apache.org/jira/browse/TEZ-4318
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Attachments: Screenshot 2021-08-01 at 14.11.26.png,
> dag_1627089048261_0000_1_1, dag_1627089048261_0000_1_1_1,
> dag_1627810632098_0001_1.zip, history.txt
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> This is about creating a very simple UI for postprocessing info about tez
> dags.
> The primary focus is on
> [analyzers|https://github.com/apache/tez/tree/master/tez-tools/analyzers/job-analyzer].
> I use analyzers quite often, thinking about a browser-based solution, which
> can be started easily locally, and lets the user do something like:
> 1. upload history logging file (simple, proto)
> 2. run a set of analyzers (change config opts from UI)
> 3. return 1 or more xls / cvs files with the result(s) (format can be picked
> on UI)
> [tez-tools|https://github.com/apache/tez/tree/master/tez-tools] has lot more
> tools there, but for me, the real benefit would be having analyzers in the
> first round
> also interested in the dockerized approach
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
