[ 
https://issues.apache.org/jira/browse/YETUS-500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15981929#comment-15981929
 ] 

Allen Wittenauer edited comment on YETUS-500 at 4/24/17 9:21 PM:
-----------------------------------------------------------------

(NOTE:  numbers, etc, here are not in agreement. Examples have been pieced 
together from actual results just to give something to play with.)

One key problem is that we're heavily limited in what we can do in JIRA tables. 
 For example, it doesn't appear to be possible to set the background color for 
a single row.  With that in mind, a simple delineation may be all we can do: 

|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  
0s{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
| | | | {color:brown} branch test {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 
58s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m 
29s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client in trunk has 2 
extant Findbugs warnings. {color} |
| | | | {color:brown} patch test {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
40s{color} | {color:green} hadoop-hdfs-project/hadoop-hdfs-client generated 0 
new + 0 unchanged - 2 fixed = 0 total (was 2) {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 68m 33s{color} 
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}106m 13s{color} | 
{color:black} {color} |
\\

Making them headers also helps make them stick out:

|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  
0s{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} branch test {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 
58s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m 
29s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client in trunk has 2 
extant Findbugs warnings. {color} |
|| || || || {color:brown} patch test {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
40s{color} | {color:green} hadoop-hdfs-project/hadoop-hdfs-client generated 0 
new + 0 unchanged - 2 fixed = 0 total (was 2) {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 68m 33s{color} 
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}106m 13s{color} | 
{color:black} {color} |
\\


The text here is also important:

* branch/patch test?
* branch/patch build test?

We've avoided differentiation because it leads to lies:  e.g., the test4tests 
is technically a patch test but runs before the code gets compiled.  I suppose 
we could add other headers to actually mark the phases:

 || Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  
0s{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} branch compile tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 
58s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m 
29s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client in trunk has 2 
extant Findbugs warnings. {color} |
|| || || || {color:brown} patch compile tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
40s{color} | {color:green} hadoop-hdfs-project/hadoop-hdfs-client generated 0 
new + 0 unchanged - 2 fixed = 0 total (was 2) {color} |
|| || || || {color:brown} other tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 68m 33s{color} 
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:black}{color} | {color:black} {color} | {color:black}106m 13s{color} | 
{color:black} {color} |
\\

or whatever.  But now we've expanded the output by quite a bit too.  People who 
complain about the length of the report vs. our inability to communicate what 
is happening to new users.

Something else to keep in mind:

We will *definitely* be required to change the contents and handling of the 
vote table arrays in order to make this work.  Otherwise, expect mass carnage!

Thoughts?


was (Author: aw):
One key problem is that we're heavily limited in what we can do in JIRA tables. 
 For example, it doesn't appear to be possible to set the background color for 
a single row.  With that in mind, a simple delineation may be all we can do: 

|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  
0s{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
| | | | {color:brown} branch test {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 
58s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m 
29s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client in trunk has 2 
extant Findbugs warnings. {color} |
| | | | {color:brown} patch test {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
40s{color} | {color:green} hadoop-hdfs-project/hadoop-hdfs-client generated 0 
new + 0 unchanged - 2 fixed = 0 total (was 2) {color} |
| {color:black}{color} | {color:black} {color} | {color:black}106m 13s{color} | 
{color:black} {color} |
\\

Making them headers also helps make them stick out:

|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  
0s{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} branch test {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 
58s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m 
29s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client in trunk has 2 
extant Findbugs warnings. {color} |
|| || || || {color:brown} patch test {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
40s{color} | {color:green} hadoop-hdfs-project/hadoop-hdfs-client generated 0 
new + 0 unchanged - 2 fixed = 0 total (was 2) {color} |
| {color:black}{color} | {color:black} {color} | {color:black}106m 13s{color} | 
{color:black} {color} |
\\


The text here is also important:

* branch/patch test?
* branch/patch build test?

We've avoided differentiation because it leads to lies:  e.g., the test4tests 
is technically a patch test but runs before the code gets compiled.  I suppose 
we could add other headers to actually mark the phases:

 || Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue}  0m 
17s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green}  0m  
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red}  0m  
0s{color} | {color:red} The patch doesn't appear to include any new or modified 
tests. Please justify why no new tests are needed for this patch. Also please 
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} branch compile tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
6s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m 
58s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red}  1m 
29s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs-client in trunk has 2 
extant Findbugs warnings. {color} |
|| || || || {color:brown} patch compile tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue}  0m  
7s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green}  1m 
29s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green}  1m 
40s{color} | {color:green} hadoop-hdfs-project/hadoop-hdfs-client generated 0 
new + 0 unchanged - 2 fixed = 0 total (was 2) {color} |
|| || || || {color:brown} other tests {color} ||
| {color:black}{color} | {color:black} {color} | {color:black}106m 13s{color} | 
{color:black} {color} |
\\

or whatever.  But now we've expanded the output by quite a bit too.  People who 
complain about the length of the report vs. our inability to communicate what 
is happening to new users.

Something else to keep in mind:

We will *definitely* be required to change the contents and handling of the 
vote table arrays in order to make this work.  Otherwise, expect mass carnage!

Thoughts?

> Users are confused by precheck/compile cycle in precommit output
> ----------------------------------------------------------------
>
>                 Key: YETUS-500
>                 URL: https://issues.apache.org/jira/browse/YETUS-500
>             Project: Yetus
>          Issue Type: Improvement
>    Affects Versions: 0.5.0
>            Reporter: Allen Wittenauer
>            Assignee: Allen Wittenauer
>
> Every few weeks there is a question in JIRA issues asking why the result is 
> still failed despite them working on fixing said result.  e.g.  master branch 
> has spotbug issues, this patch fixes them, why is it still saying -1?
> I think we could curb a lot of these questions by figuring out how to put 
> "subheaders" into the precommit output in patch testing mode.  
> See below for some ideas.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to