[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-21 Thread esch...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Eugene Schava edited a comment on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 Thanks, I see now.So nowexecution time chart is shown if the result is successcompile time chart is shown if the result is successperformance chart is shown is the result is successmetrics chart is shown if the result is unstable or success It looks logical to change  this  these  conditions to:execution time chart is shown if the result is *unstable or success*compile time chart is shown if the result is *failure, unstable or success* (better than not built)performance chart is shown is the result is *unstable or success*metrics chart is shown if the result is unstable or success (do not change) Agree?     
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-21 Thread tobias.lingem...@vector.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Tobias Lingemann commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 For now I simply create the graph via the custom metric. I will wait until a new release is published.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-21 Thread esch...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Eugene Schava commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 I've committed and pushed this change to repository But I think it's too minor change to create new release Are you OK to build and update your Jenkins installation manually with the version from github repository?  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-21 Thread scm_issue_l...@java.net (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 SCM/JIRA link daemon commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 Code changed in jenkins User: Eugene Schava Path: src/main/java/hudson/plugins/PerfPublisher/TestDetails.java http://jenkins-ci.org/commit/perfpublisher-plugin/f49132726ea71fef2d0b8df91a33ba42c929ad16 Log: JENKINS-49528 Peformance graphs for individual tests are not created when a single test has failed  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-21 Thread tobias.lingem...@vector.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Tobias Lingemann commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 Agreed   
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-21 Thread esch...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Eugene Schava commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 Thanks, I see now. So now execution time chart is shown if the result is success compile time chart is shown if the result is success performance chart is shown is the result is success metrics chart is shown if the result is unstable or success   It looks logical to change this conditions to: execution time chart is shown if the result is unstable or success compile time chart is shown if the result is failure, unstable or success (better than not built) performance chart is shown is the result is unstable or success metrics chart is shown if the result is unstable or success (do not change)   Agree?        
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-13 Thread tobias.lingem...@vector.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Tobias Lingemann commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 As I suspected. The custom metric graph was created successfully.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-13 Thread tobias.lingem...@vector.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Tobias Lingemann commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 I don't believe it is related to the number of XML files. I took a look at the source code and while I'm not sure, I believe the problem is in TestDetails.java. The graph for execution time, compile time and performance is only created when the result of the abstract build is success.   

 

if (!abstractBuild.isBuilding() && abstractBuild.getResult().isBetterOrEqualTo(Result.SUCCESS))
 

 Curiously the graph for custom metrics is created if the build is unstable or better. I have updated my tests to use a custom metric in the meantime. I will check tomorrow if it worked.    
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-13 Thread esch...@gmail.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Eugene Schava commented on  JENKINS-49528  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
  Re: Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
 Sorry, I need more details Is your issue related to multiple XML files only? I usually use only one XML report file and cannot confirm that some chart differs if there is no or only one failed test  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 

   





-- 
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-13 Thread tobias.lingem...@vector.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Tobias Lingemann updated an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 Jenkins /  JENKINS-49528  
 
 
  Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
Change By: 
 Tobias Lingemann  
 

  
 
 
 
 

 
 I have tried a lot of things, but whenever a single test fails, the performance publisher plugin does not create graphs for individual tests. Only the overview (sum) of all tests is created. If no test has failed, the graphs are created as expected.Since I cannot think of any reason why someone would want this, I must assume that this is a bug. My Jenkins job runs the tests with MSTest. Each test measures the execution time for various scenarios and each test creates a new xml file that is parsed by the performance publisher plugin. If a test reports an error (e.g. the execution time exceeds a certain limit), the job is marked as unstable. This is done automatically by the MSTest plugin.The plugin works fine with multiple xml files, as long as all tests have passed.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment  
 

  
 

  
 
 
 
  
 

  
 
 
 
 

 
 This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)  
 
 

 
   
 

  
 

  
 


[JIRA] (JENKINS-49528) Peformance graphs for individual tests are not created when a single test has failed

2018-02-13 Thread tobias.lingem...@vector.com (JIRA)
Title: Message Title


 
 
 
 

 
 
 

 
   
 Tobias Lingemann created an issue  
 

  
 
 
 
 

 
 
  
 
 
 
 

 
 Jenkins /  JENKINS-49528  
 
 
  Peformance graphs for individual tests are not created when a single test has failed   
 

  
 
 
 
 

 
Issue Type: 
  Bug  
 
 
Assignee: 
 Eugene Schava  
 
 
Components: 
 perfpublisher-plugin  
 
 
Created: 
 2018-02-13 13:48  
 
 
Environment: 
 Jenkins 2.89.3  Performance Publisher plugin 8.05  JRE 1.8.0_144-b01  Windows 7  
 
 
Priority: 
  Minor  
 
 
Reporter: 
 Tobias Lingemann  
 

  
 
 
 
 

 
 I have tried a lot of things, but whenever a single test fails, the performance publisher plugin does not create graphs for individual tests. Only the overview (sum) of all tests is created. If no test has failed, the graphs are created as expected. Since I cannot think of any reason why someone would want this, I must assume that this is a bug.  
 

  
 
 
 
 

 
 
 

 
 
 Add Comment