On 11/09/2010 02:17 AM, Vincent Massol wrote: > Hi Caleb, > > Nice start. Some questions/feedback: > > * Is this replacing the standard hudson emails or does it come as an > additional report? When is it sent? I imagined it being sent periodically (maybe once a day). Since it uses commons-configuration, a different configuration profile could be set up to send a different type of mail for broken builds.
> * I'd like to see an email whenever someone commits something that makes one > of the modules fail to build and in that mail the title should be short and > explicit about whom has made the build fail + the mail should contain the log > of the failure (in order to understand why it fails directly from the email). > > IMO in general we need: > * less emails from hudson (only mails when builds are failing IMO, not needed > when they're not) > * separate flickering from non flickering I tried to do that, no flickers were detected though. Caleb > * shorter email titles > * know how broke the build in the email and very visible > * console logs in the mail (not the full log, just the module that fails to > build and only the part around the failure: let's say the last 100 lines) > > Thanks > -Vincent > > On Nov 9, 2010, at 4:02 AM, Caleb James DeLisle wrote: > >> Trying out a new test reporter, tell me what you think. >> >> Statistics Report: >> 22 tests failed out of a total of 3026 >> The total time taken to run the tests was 1853.3518 seconds, >> and the average time taken by a test was 0.6124758 seconds. >> The fastest test ran in 0.0 seconds,a record held by >> http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-content-provider/5/testReport/org.xwoot.contentprovider/XWootContentProviderConfigurationTest/testAddRemove/ >> The slowest test ran in 120.414 seconds,and that one was >> http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/testReport/org.xwoot.jxta.test.singlePeer/NetworkTest/testFailConnectToNetwork/ >> and the average speed of a webstandards test (a good indication of page load >> speed) was 0.0 seconds. >> ------------------------------------------------------------------------------- >> Detailed Failure Report: >> 0 Regressions, >> 0 Tests are Probably Flickering, >> 22 Failures >> ------------------------------------------------------------------------------- >> >> Failures: >> These tests have failed multiple times in a row. >> >> Failing for the past 164 builds. >> Name: Blog/Archive.xml [month, year, comment, space, language] >> testParametersInColibri >> Details: Escaping test failed. * Parameter: "year" Tested file: >> Blog/Archive.xml URL: >> http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >> List of validation errors: line 305 column 133 WARNING: Macro >> execution exception in the >> response. line 531 column 0 WARNING: Possible SQL error trace. >> line 563 column 0 >> WARNING: Possible SQL error trace. >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_Archive_xml__month__year__comment__space__language_______testParametersInColibri/ >> >> Failing for the past 164 builds. >> Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, >> language, entryTitle] >> testParametersInColibri >> Details: Escaping test failed. * Parameter: "entrySpace" Tested file: >> Blog/CreatePost.xml URL: >> http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entrySpace=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >> List of validation errors: line 308 column 62 ERROR: Unescaped < >> character line 308 >> column 58 ERROR: Unescaped > character * Parameter: "entryTitle" Tested >> file: >> Blog/CreatePost.xml URL: >> http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entryTitle=aaa%22b >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_CreatePost_xml__category__comment__entrySpace__form_token__language__entryTitle___testParametersInColibri/ >> >> Failing for the past 164 builds. >> Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, place, >> forceRightPanels, >> comment, space, language] testParametersInColibri >> Details: Escaping test failed. * Parameter: "place" Tested file: >> Panels/PanelWizard.xml URL: >> http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&place=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >> List of validation errors: line 341 column 95 ERROR: Unescaped < >> character line 341 >> column 91 ERROR: Unescaped > character >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Panels_PanelWizard_xml__forceLeftPanels__section__queryString__place__forceRightPanels__comment__space__language___testParametersInColibri/ >> >> Failing for the past 164 builds. >> Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, actionresolve, >> confirm, >> extensionversion, comment, actionuninstall, language, editor] >> testParametersInColibri >> Details: Escaping test failed. * Parameter: "actioninstall" Tested file: >> XWiki/ExtensionManager.xml URL: >> http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actioninstall=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >> List of validation errors: line 321 column 140 WARNING: Macro >> execution exception in the >> response. * Parameter: "actionresolve" Tested file: >> XWiki/ExtensionManager.xml URL: >> http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actionresolve= >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_ExtensionManager_xml__extensionid__actioninstall__actionresolve__confirm__extensionversion__comment__actionuninstall__language__editor___testParametersInColibri/ >> >> Failing for the past 164 builds. >> Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, >> space, language] >> testParametersInColibri >> Details: Escaping test failed. * Parameter: "classname" Tested file: >> XWiki/LiveTableResults.xml >> URL: >> http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=colibri&language=en >> List of validation errors: line 304 column 133 WARNING: Macro >> execution exception in the >> response. line 408 column 0 WARNING: Possible SQL error trace. >> line 423 column 0 >> WARNING: Possible SQL error trace. * Parameter: "space" Tested file: >> XWiki/LiveTab >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_LiveTableResults_xml__classname__orphaned__collist__comment__space__language___testParametersInColibri/ >> >> Failing for the past 164 builds. >> Name: testClassEditor >> Details: Escaping test for XWIKI-5404 failed. Tested file: >> templates/editclass.vm URL: >> http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%27ccc%3Eddd%3Ceee?editor=class&language=en >> List of validation errors: line 332 column 71 WARNING: Unescaped ' >> character line 336 >> column 77 WARNING: Unescaped ' character line 338 column 78 >> WARNING: Unescaped ' character >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ObjectAndClassEditorTest/testClassEditor/ >> >> Failing for the past 164 builds. >> Name: templates/editattachments.vm [] >> testPageEscaping >> Details: Escaping test for page name failed. Tested file: >> templates/editattachments.vm URL: >> http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editattachments.vm&xpage=xpart&language=en >> List of validation errors: line 1 column 42 ERROR: Unescaped < >> character line 1 >> column 38 ERROR: Unescaped > character >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editattachments_vm__________________________________testPageEscaping/ >> >> Failing for the past 164 builds. >> Name: templates/editgroup.vm [classname] >> testPageEscaping >> Details: Escaping test for page name failed. Tested file: >> templates/editgroup.vm URL: >> http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editgroup.vm&xpage=xpart&language=en >> List of validation errors: line 0 column 0 WARNING: Unexpected >> empty response >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testPageEscaping/ >> >> Failing for the past 164 builds. >> Name: templates/editgroup.vm [classname] >> testParameterEscaping >> Details: Escaping test failed. * Parameter: "classname" Tested file: >> templates/editgroup.vm URL: >> http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=default&vm=editgroup.vm&xpage=xpart&language=en >> List of validation errors: line 0 column 0 WARNING: Unexpected >> empty response >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testParameterEscaping/ >> >> Failing for the past 164 builds. >> Name: templates/editgroup.vm [classname] >> testSpaceEscaping >> Details: Escaping test for space name failed. Tested file: >> templates/editgroup.vm URL: >> http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?skin=default&vm=editgroup.vm&xpage=xpart&language=en >> List of validation errors: line 0 column 0 WARNING: Unexpected >> empty response >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testSpaceEscaping/ >> >> Failing for the past 177 builds. >> Name: testDocumentCacheSync >> Details: null expected:<[modified ]content> but was:<[]content> >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSync/ >> >> Failing for the past 177 builds. >> Name: testDocumentCacheSyncForAttachments >> Details: Name: PUT URI: >> http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementCacheSync/attachments/file.ext >> Status code: 404 Status text: Not Found Response: <html> <head> >> <title>Status page</title> >> </head> <body> <h3>The server has not found anything matching the request >> URI</h3><p>You can get >> technical details <a >> href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5";>here</a>.<br> >> Please >> continue your visit at our <a href="/">home page</a>. </p> </body> </html> >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSyncForAttachments/ >> >> Failing for the past 177 builds. >> Name: org.xwiki.test.ui.AllTests >> Details: Failed to connect to binary >> FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; >> process output follows: Error: cannot open display: :1.0 System info: >> os.name: 'Linux', os.arch: >> 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: >> '1.5.0_15' Driver info: >> driver.version: firefox >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ >> >> Failing for the past 177 builds. >> Name: org.xwiki.test.ui.AllTests >> Details: Failed to connect to binary >> FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; >> process output follows: Error: cannot open display: :1.0 System info: >> os.name: 'Linux', os.arch: >> 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: >> '1.5.0_15' Driver info: >> driver.version: firefox >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ >> >> Failing for the past 177 builds. >> Name: WYSIWYG Selenium Tests >> Details: Could not start Selenium session: Failed to start new browser >> session: Error while >> launching browser >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-wysiwyg/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/WYSIWYG_Selenium_Tests/ >> >> Failing for the past 180 builds. >> Name: junit.framework.testsu...@6b3fc7 >> Details: Could not start Selenium session: Failed to start new browser >> session: Error while >> launching browser >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ldap/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_6b3fc7/ >> >> Failing for the past 180 builds. >> Name: junit.framework.testsu...@1d85f79 >> Details: Could not start Selenium session: Failed to start new browser >> session: Error while >> launching browser >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-selenium/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_1d85f79/ >> >> Failing for the past 828 builds. >> Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome >> executed with >> credentials Admin:admin >> Details: Validation errors in space=Main, page=WebHome ERROR: At least one >> style attribute has been >> found on the page. >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ >> >> Failing for the past 828 builds. >> Name: Validating Dutch Web Guidelines validity for: space=WikiManager, >> page=CreateNewWiki executed >> with credentials Admin:admin >> Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: >> An input field has been >> found with no label association. >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_WikiManager__page_CreateNewWiki_executed_with_credentials_Admin_admin/ >> >> Failing for the past 828 builds. >> Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome >> executed with >> credentials Admin:admin >> Details: Validation errors in space=Main, page=WebHome ERROR: At least one >> style attribute has been >> found on the page. >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ >> >> Failing for the past 828 builds. >> Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome >> executed with >> credentials Admin:admin >> Details: Validation errors in space=Main, page=WebHome ERROR: At least one >> style attribute has been >> found on the page. >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ >> >> Failing for the past 839 builds. >> Name: junit.framework.testsu...@2a4983 >> Details: Could not start Selenium session: Failed to start new browser >> session: Error while >> launching browser >> Link: >> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-selenium/838/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_2a4983/ >> ------------------------------------------------------------------------------- > > _______________________________________________ > devs mailing list > [email protected] > http://lists.xwiki.org/mailman/listinfo/devs > _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
