On 11/09/2010 01:58 PM, Vincent Massol wrote: > > On Nov 9, 2010, at 7:44 PM, Caleb James DeLisle wrote: > >> >> >> On 11/09/2010 02:17 AM, Vincent Massol wrote: >>> Hi Caleb, >>> >>> Nice start. Some questions/feedback: >>> >>> * Is this replacing the standard hudson emails or does it come as an >>> additional report? When is it sent? >> I imagined it being sent periodically (maybe once a day). Since it uses >> commons-configuration, a >> different configuration profile could be set up to send a different type of >> mail for broken builds. >> >>> * I'd like to see an email whenever someone commits something that makes >>> one of the modules fail to build and in that mail the title should be short >>> and explicit about whom has made the build fail + the mail should contain >>> the log of the failure (in order to understand why it fails directly from >>> the email). >>> >>> IMO in general we need: >>> * less emails from hudson (only mails when builds are failing IMO, not >>> needed when they're not) >>> * separate flickering from non flickering >> I tried to do that, no flickers were detected though. > > Yes but what I meant is to send less emails than currently. With yours that > means more emails since we now have all the standard ones + yours. This should be able to replace the vast majority of mail, excluding maybe the "build failed" messages. I still think there should be a period of overlap because we want to be sure we understand and trust the new mail system before removing the old (as bad as it may be.)
I think we should look for solutions to have less emails in total to make it more manageable. I don't know about you but very often I don't even look at hudson emails and throw them away. hehe I can honestly say I don't throw them away. After matching regex filters, they go in an array of directories to bit rot and occasionally be "mark folder as read" ;) We need to change that so that we care when we receive an hudson email. And if we can now who broke it then that person could feel responsible for it and fix it ASAP (and not wait till the Release starts, thus delaying the release by several days every time). Good point. I had thought of pointing fingers as counterproductive but he who broke it will definitely know best how to fix it. Caleb > > Thanks > -Vincent > >> Caleb >> >>> * shorter email titles >>> * know how broke the build in the email and very visible >>> * console logs in the mail (not the full log, just the module that fails to >>> build and only the part around the failure: let's say the last 100 lines) >>> >>> Thanks >>> -Vincent >>> >>> On Nov 9, 2010, at 4:02 AM, Caleb James DeLisle wrote: >>> >>>> Trying out a new test reporter, tell me what you think. >>>> >>>> Statistics Report: >>>> 22 tests failed out of a total of 3026 >>>> The total time taken to run the tests was 1853.3518 seconds, >>>> and the average time taken by a test was 0.6124758 seconds. >>>> The fastest test ran in 0.0 seconds,a record held by >>>> http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-content-provider/5/testReport/org.xwoot.contentprovider/XWootContentProviderConfigurationTest/testAddRemove/ >>>> The slowest test ran in 120.414 seconds,and that one was >>>> http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/testReport/org.xwoot.jxta.test.singlePeer/NetworkTest/testFailConnectToNetwork/ >>>> and the average speed of a webstandards test (a good indication of page >>>> load speed) was 0.0 seconds. >>>> ------------------------------------------------------------------------------- >>>> Detailed Failure Report: >>>> 0 Regressions, >>>> 0 Tests are Probably Flickering, >>>> 22 Failures >>>> ------------------------------------------------------------------------------- >>>> >>>> Failures: >>>> These tests have failed multiple times in a row. >>>> >>>> Failing for the past 164 builds. >>>> Name: Blog/Archive.xml [month, year, comment, space, language] >>>> testParametersInColibri >>>> Details: Escaping test failed. * Parameter: "year" Tested file: >>>> Blog/Archive.xml URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >>>> List of validation errors: line 305 column 133 WARNING: Macro >>>> execution exception in the >>>> response. line 531 column 0 WARNING: Possible SQL error trace. >>>> line 563 column 0 >>>> WARNING: Possible SQL error trace. >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_Archive_xml__month__year__comment__space__language_______testParametersInColibri/ >>>> >>>> Failing for the past 164 builds. >>>> Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, >>>> language, entryTitle] >>>> testParametersInColibri >>>> Details: Escaping test failed. * Parameter: "entrySpace" Tested file: >>>> Blog/CreatePost.xml URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entrySpace=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >>>> List of validation errors: line 308 column 62 ERROR: Unescaped < >>>> character line 308 >>>> column 58 ERROR: Unescaped > character * Parameter: "entryTitle" >>>> Tested file: >>>> Blog/CreatePost.xml URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entryTitle=aaa%22b >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_CreatePost_xml__category__comment__entrySpace__form_token__language__entryTitle___testParametersInColibri/ >>>> >>>> Failing for the past 164 builds. >>>> Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, >>>> place, forceRightPanels, >>>> comment, space, language] testParametersInColibri >>>> Details: Escaping test failed. * Parameter: "place" Tested file: >>>> Panels/PanelWizard.xml URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&place=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >>>> List of validation errors: line 341 column 95 ERROR: Unescaped < >>>> character line 341 >>>> column 91 ERROR: Unescaped > character >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Panels_PanelWizard_xml__forceLeftPanels__section__queryString__place__forceRightPanels__comment__space__language___testParametersInColibri/ >>>> >>>> Failing for the past 164 builds. >>>> Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, >>>> actionresolve, confirm, >>>> extensionversion, comment, actionuninstall, language, editor] >>>> testParametersInColibri >>>> Details: Escaping test failed. * Parameter: "actioninstall" Tested file: >>>> XWiki/ExtensionManager.xml URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actioninstall=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en >>>> List of validation errors: line 321 column 140 WARNING: Macro >>>> execution exception in the >>>> response. * Parameter: "actionresolve" Tested file: >>>> XWiki/ExtensionManager.xml URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actionresolve= >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_ExtensionManager_xml__extensionid__actioninstall__actionresolve__confirm__extensionversion__comment__actionuninstall__language__editor___testParametersInColibri/ >>>> >>>> Failing for the past 164 builds. >>>> Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, >>>> space, language] >>>> testParametersInColibri >>>> Details: Escaping test failed. * Parameter: "classname" Tested file: >>>> XWiki/LiveTableResults.xml >>>> URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=colibri&language=en >>>> List of validation errors: line 304 column 133 WARNING: Macro >>>> execution exception in the >>>> response. line 408 column 0 WARNING: Possible SQL error trace. >>>> line 423 column 0 >>>> WARNING: Possible SQL error trace. * Parameter: "space" Tested file: >>>> XWiki/LiveTab >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_LiveTableResults_xml__classname__orphaned__collist__comment__space__language___testParametersInColibri/ >>>> >>>> Failing for the past 164 builds. >>>> Name: testClassEditor >>>> Details: Escaping test for XWIKI-5404 failed. Tested file: >>>> templates/editclass.vm URL: >>>> http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%27ccc%3Eddd%3Ceee?editor=class&language=en >>>> List of validation errors: line 332 column 71 WARNING: Unescaped ' >>>> character line 336 >>>> column 77 WARNING: Unescaped ' character line 338 column 78 >>>> WARNING: Unescaped ' character >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ObjectAndClassEditorTest/testClassEditor/ >>>> >>>> Failing for the past 164 builds. >>>> Name: templates/editattachments.vm [] >>>> testPageEscaping >>>> Details: Escaping test for page name failed. Tested file: >>>> templates/editattachments.vm URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editattachments.vm&xpage=xpart&language=en >>>> List of validation errors: line 1 column 42 ERROR: Unescaped < >>>> character line 1 >>>> column 38 ERROR: Unescaped > character >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editattachments_vm__________________________________testPageEscaping/ >>>> >>>> Failing for the past 164 builds. >>>> Name: templates/editgroup.vm [classname] >>>> testPageEscaping >>>> Details: Escaping test for page name failed. Tested file: >>>> templates/editgroup.vm URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editgroup.vm&xpage=xpart&language=en >>>> List of validation errors: line 0 column 0 WARNING: Unexpected >>>> empty response >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testPageEscaping/ >>>> >>>> Failing for the past 164 builds. >>>> Name: templates/editgroup.vm [classname] >>>> testParameterEscaping >>>> Details: Escaping test failed. * Parameter: "classname" Tested file: >>>> templates/editgroup.vm URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=default&vm=editgroup.vm&xpage=xpart&language=en >>>> List of validation errors: line 0 column 0 WARNING: Unexpected >>>> empty response >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testParameterEscaping/ >>>> >>>> Failing for the past 164 builds. >>>> Name: templates/editgroup.vm [classname] >>>> testSpaceEscaping >>>> Details: Escaping test for space name failed. Tested file: >>>> templates/editgroup.vm URL: >>>> http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?skin=default&vm=editgroup.vm&xpage=xpart&language=en >>>> List of validation errors: line 0 column 0 WARNING: Unexpected >>>> empty response >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testSpaceEscaping/ >>>> >>>> Failing for the past 177 builds. >>>> Name: testDocumentCacheSync >>>> Details: null expected:<[modified ]content> but was:<[]content> >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSync/ >>>> >>>> Failing for the past 177 builds. >>>> Name: testDocumentCacheSyncForAttachments >>>> Details: Name: PUT URI: >>>> http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementCacheSync/attachments/file.ext >>>> Status code: 404 Status text: Not Found Response: <html> <head> >>>> <title>Status page</title> >>>> </head> <body> <h3>The server has not found anything matching the request >>>> URI</h3><p>You can get >>>> technical details <a >>>> href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5";>here</a>.<br> >>>> Please >>>> continue your visit at our <a href="/">home page</a>. </p> </body> </html> >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSyncForAttachments/ >>>> >>>> Failing for the past 177 builds. >>>> Name: org.xwiki.test.ui.AllTests >>>> Details: Failed to connect to binary >>>> FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; >>>> process output follows: Error: cannot open display: :1.0 System info: >>>> os.name: 'Linux', os.arch: >>>> 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: >>>> '1.5.0_15' Driver info: >>>> driver.version: firefox >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ >>>> >>>> Failing for the past 177 builds. >>>> Name: org.xwiki.test.ui.AllTests >>>> Details: Failed to connect to binary >>>> FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; >>>> process output follows: Error: cannot open display: :1.0 System info: >>>> os.name: 'Linux', os.arch: >>>> 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: >>>> '1.5.0_15' Driver info: >>>> driver.version: firefox >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ >>>> >>>> Failing for the past 177 builds. >>>> Name: WYSIWYG Selenium Tests >>>> Details: Could not start Selenium session: Failed to start new browser >>>> session: Error while >>>> launching browser >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-wysiwyg/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/WYSIWYG_Selenium_Tests/ >>>> >>>> Failing for the past 180 builds. >>>> Name: junit.framework.testsu...@6b3fc7 >>>> Details: Could not start Selenium session: Failed to start new browser >>>> session: Error while >>>> launching browser >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ldap/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_6b3fc7/ >>>> >>>> Failing for the past 180 builds. >>>> Name: junit.framework.testsu...@1d85f79 >>>> Details: Could not start Selenium session: Failed to start new browser >>>> session: Error while >>>> launching browser >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-selenium/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_1d85f79/ >>>> >>>> Failing for the past 828 builds. >>>> Name: Validating Dutch Web Guidelines validity for: space=Main, >>>> page=WebHome executed with >>>> credentials Admin:admin >>>> Details: Validation errors in space=Main, page=WebHome ERROR: At least one >>>> style attribute has been >>>> found on the page. >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ >>>> >>>> Failing for the past 828 builds. >>>> Name: Validating Dutch Web Guidelines validity for: space=WikiManager, >>>> page=CreateNewWiki executed >>>> with credentials Admin:admin >>>> Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: >>>> An input field has been >>>> found with no label association. >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_WikiManager__page_CreateNewWiki_executed_with_credentials_Admin_admin/ >>>> >>>> Failing for the past 828 builds. >>>> Name: Validating Dutch Web Guidelines validity for: space=Main, >>>> page=WebHome executed with >>>> credentials Admin:admin >>>> Details: Validation errors in space=Main, page=WebHome ERROR: At least one >>>> style attribute has been >>>> found on the page. >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ >>>> >>>> Failing for the past 828 builds. >>>> Name: Validating Dutch Web Guidelines validity for: space=Main, >>>> page=WebHome executed with >>>> credentials Admin:admin >>>> Details: Validation errors in space=Main, page=WebHome ERROR: At least one >>>> style attribute has been >>>> found on the page. >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ >>>> >>>> Failing for the past 839 builds. >>>> Name: junit.framework.testsu...@2a4983 >>>> Details: Could not start Selenium session: Failed to start new browser >>>> session: Error while >>>> launching browser >>>> Link: >>>> http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-selenium/838/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_2a4983/ > _______________________________________________ > devs mailing list > [email protected] > http://lists.xwiki.org/mailman/listinfo/devs > _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
