Hi Caleb, Nice start. Some questions/feedback:
* Is this replacing the standard hudson emails or does it come as an additional report? When is it sent? * I'd like to see an email whenever someone commits something that makes one of the modules fail to build and in that mail the title should be short and explicit about whom has made the build fail + the mail should contain the log of the failure (in order to understand why it fails directly from the email). IMO in general we need: * less emails from hudson (only mails when builds are failing IMO, not needed when they're not) * separate flickering from non flickering * shorter email titles * know how broke the build in the email and very visible * console logs in the mail (not the full log, just the module that fails to build and only the part around the failure: let's say the last 100 lines) Thanks -Vincent On Nov 9, 2010, at 4:02 AM, Caleb James DeLisle wrote: > Trying out a new test reporter, tell me what you think. > > Statistics Report: > 22 tests failed out of a total of 3026 > The total time taken to run the tests was 1853.3518 seconds, > and the average time taken by a test was 0.6124758 seconds. > The fastest test ran in 0.0 seconds,a record held by > http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-content-provider/5/testReport/org.xwoot.contentprovider/XWootContentProviderConfigurationTest/testAddRemove/ > The slowest test ran in 120.414 seconds,and that one was > http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/testReport/org.xwoot.jxta.test.singlePeer/NetworkTest/testFailConnectToNetwork/ > and the average speed of a webstandards test (a good indication of page load > speed) was 0.0 seconds. > ------------------------------------------------------------------------------- > Detailed Failure Report: > 0 Regressions, > 0 Tests are Probably Flickering, > 22 Failures > ------------------------------------------------------------------------------- > > Failures: > These tests have failed multiple times in a row. > > Failing for the past 164 builds. > Name: Blog/Archive.xml [month, year, comment, space, language] > testParametersInColibri > Details: Escaping test failed. * Parameter: "year" Tested file: > Blog/Archive.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 305 column 133 WARNING: Macro > execution exception in the > response. line 531 column 0 WARNING: Possible SQL error trace. > line 563 column 0 > WARNING: Possible SQL error trace. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_Archive_xml__month__year__comment__space__language_______testParametersInColibri/ > > Failing for the past 164 builds. > Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, > language, entryTitle] > testParametersInColibri > Details: Escaping test failed. * Parameter: "entrySpace" Tested file: > Blog/CreatePost.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entrySpace=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 308 column 62 ERROR: Unescaped < > character line 308 > column 58 ERROR: Unescaped > character * Parameter: "entryTitle" Tested > file: > Blog/CreatePost.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entryTitle=aaa%22b > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_CreatePost_xml__category__comment__entrySpace__form_token__language__entryTitle___testParametersInColibri/ > > Failing for the past 164 builds. > Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, place, > forceRightPanels, > comment, space, language] testParametersInColibri > Details: Escaping test failed. * Parameter: "place" Tested file: > Panels/PanelWizard.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&place=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 341 column 95 ERROR: Unescaped < > character line 341 > column 91 ERROR: Unescaped > character > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Panels_PanelWizard_xml__forceLeftPanels__section__queryString__place__forceRightPanels__comment__space__language___testParametersInColibri/ > > Failing for the past 164 builds. > Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, actionresolve, > confirm, > extensionversion, comment, actionuninstall, language, editor] > testParametersInColibri > Details: Escaping test failed. * Parameter: "actioninstall" Tested file: > XWiki/ExtensionManager.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actioninstall=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 321 column 140 WARNING: Macro > execution exception in the > response. * Parameter: "actionresolve" Tested file: > XWiki/ExtensionManager.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actionresolve= > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_ExtensionManager_xml__extensionid__actioninstall__actionresolve__confirm__extensionversion__comment__actionuninstall__language__editor___testParametersInColibri/ > > Failing for the past 164 builds. > Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, > space, language] > testParametersInColibri > Details: Escaping test failed. * Parameter: "classname" Tested file: > XWiki/LiveTableResults.xml > URL: > http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=colibri&language=en > List of validation errors: line 304 column 133 WARNING: Macro > execution exception in the > response. line 408 column 0 WARNING: Possible SQL error trace. > line 423 column 0 > WARNING: Possible SQL error trace. * Parameter: "space" Tested file: > XWiki/LiveTab > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_LiveTableResults_xml__classname__orphaned__collist__comment__space__language___testParametersInColibri/ > > Failing for the past 164 builds. > Name: testClassEditor > Details: Escaping test for XWIKI-5404 failed. Tested file: > templates/editclass.vm URL: > http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%27ccc%3Eddd%3Ceee?editor=class&language=en > List of validation errors: line 332 column 71 WARNING: Unescaped ' > character line 336 > column 77 WARNING: Unescaped ' character line 338 column 78 > WARNING: Unescaped ' character > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ObjectAndClassEditorTest/testClassEditor/ > > Failing for the past 164 builds. > Name: templates/editattachments.vm [] > testPageEscaping > Details: Escaping test for page name failed. Tested file: > templates/editattachments.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editattachments.vm&xpage=xpart&language=en > List of validation errors: line 1 column 42 ERROR: Unescaped < > character line 1 > column 38 ERROR: Unescaped > character > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editattachments_vm__________________________________testPageEscaping/ > > Failing for the past 164 builds. > Name: templates/editgroup.vm [classname] > testPageEscaping > Details: Escaping test for page name failed. Tested file: > templates/editgroup.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editgroup.vm&xpage=xpart&language=en > List of validation errors: line 0 column 0 WARNING: Unexpected > empty response > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testPageEscaping/ > > Failing for the past 164 builds. > Name: templates/editgroup.vm [classname] > testParameterEscaping > Details: Escaping test failed. * Parameter: "classname" Tested file: > templates/editgroup.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=default&vm=editgroup.vm&xpage=xpart&language=en > List of validation errors: line 0 column 0 WARNING: Unexpected > empty response > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testParameterEscaping/ > > Failing for the past 164 builds. > Name: templates/editgroup.vm [classname] > testSpaceEscaping > Details: Escaping test for space name failed. Tested file: > templates/editgroup.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?skin=default&vm=editgroup.vm&xpage=xpart&language=en > List of validation errors: line 0 column 0 WARNING: Unexpected > empty response > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testSpaceEscaping/ > > Failing for the past 177 builds. > Name: testDocumentCacheSync > Details: null expected:<[modified ]content> but was:<[]content> > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSync/ > > Failing for the past 177 builds. > Name: testDocumentCacheSyncForAttachments > Details: Name: PUT URI: > http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementCacheSync/attachments/file.ext > Status code: 404 Status text: Not Found Response: <html> <head> > <title>Status page</title> > </head> <body> <h3>The server has not found anything matching the request > URI</h3><p>You can get > technical details <a > href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5";>here</a>.<br> > Please > continue your visit at our <a href="/">home page</a>. </p> </body> </html> > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSyncForAttachments/ > > Failing for the past 177 builds. > Name: org.xwiki.test.ui.AllTests > Details: Failed to connect to binary > FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; > process output follows: Error: cannot open display: :1.0 System info: > os.name: 'Linux', os.arch: > 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: > '1.5.0_15' Driver info: > driver.version: firefox > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ > > Failing for the past 177 builds. > Name: org.xwiki.test.ui.AllTests > Details: Failed to connect to binary > FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; > process output follows: Error: cannot open display: :1.0 System info: > os.name: 'Linux', os.arch: > 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: > '1.5.0_15' Driver info: > driver.version: firefox > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ > > Failing for the past 177 builds. > Name: WYSIWYG Selenium Tests > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-wysiwyg/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/WYSIWYG_Selenium_Tests/ > > Failing for the past 180 builds. > Name: junit.framework.testsu...@6b3fc7 > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ldap/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_6b3fc7/ > > Failing for the past 180 builds. > Name: junit.framework.testsu...@1d85f79 > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-selenium/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_1d85f79/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome > executed with > credentials Admin:admin > Details: Validation errors in space=Main, page=WebHome ERROR: At least one > style attribute has been > found on the page. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=WikiManager, > page=CreateNewWiki executed > with credentials Admin:admin > Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: An > input field has been > found with no label association. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_WikiManager__page_CreateNewWiki_executed_with_credentials_Admin_admin/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome > executed with > credentials Admin:admin > Details: Validation errors in space=Main, page=WebHome ERROR: At least one > style attribute has been > found on the page. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome > executed with > credentials Admin:admin > Details: Validation errors in space=Main, page=WebHome ERROR: At least one > style attribute has been > found on the page. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ > > Failing for the past 839 builds. > Name: junit.framework.testsu...@2a4983 > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-selenium/838/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_2a4983/ > ------------------------------------------------------------------------------- _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
