Hi Caleb, On 11/09/2010 05:02 AM, Caleb James DeLisle wrote: > Trying out a new test reporter, tell me what you think.
The statistics report provides useful information, but the list of failed tests is hard to read. In order to find the tests you're interested in (e.g. the WYSIWYG selenium tests) you have to do a plain text search. Maybe a summary of failed tests would help. Thanks, Marius > > Statistics Report: > 22 tests failed out of a total of 3026 > The total time taken to run the tests was 1853.3518 seconds, > and the average time taken by a test was 0.6124758 seconds. > The fastest test ran in 0.0 seconds,a record held by > http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$xwoot-content-provider/5/testReport/org.xwoot.contentprovider/XWootContentProviderConfigurationTest/testAddRemove/ > The slowest test ran in 120.414 seconds,and that one was > http://hudson.xwiki.org/job/concerto/org.xwiki.contrib.concerto$jxta/5/testReport/org.xwoot.jxta.test.singlePeer/NetworkTest/testFailConnectToNetwork/ > and the average speed of a webstandards test (a good indication of page load > speed) was 0.0 seconds. > ------------------------------------------------------------------------------- > Detailed Failure Report: > 0 Regressions, > 0 Tests are Probably Flickering, > 22 Failures > ------------------------------------------------------------------------------- > > Failures: > These tests have failed multiple times in a row. > > Failing for the past 164 builds. > Name: Blog/Archive.xml [month, year, comment, space, language] > testParametersInColibri > Details: Escaping test failed. * Parameter: "year" Tested file: > Blog/Archive.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Blog/Archive?skin=colibri&year=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 305 column 133 WARNING: Macro > execution exception in the > response. line 531 column 0 WARNING: Possible SQL error trace. > line 563 column 0 > WARNING: Possible SQL error trace. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_Archive_xml__month__year__comment__space__language_______testParametersInColibri/ > > Failing for the past 164 builds. > Name: Blog/CreatePost.xml [category, comment, entrySpace, form_token, > language, entryTitle] > testParametersInColibri > Details: Escaping test failed. * Parameter: "entrySpace" Tested file: > Blog/CreatePost.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entrySpace=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 308 column 62 ERROR: Unescaped< > character line 308 > column 58 ERROR: Unescaped> character * Parameter: "entryTitle" Tested > file: > Blog/CreatePost.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Blog/CreatePost?skin=colibri&entryTitle=aaa%22b > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Blog_CreatePost_xml__category__comment__entrySpace__form_token__language__entryTitle___testParametersInColibri/ > > Failing for the past 164 builds. > Name: Panels/PanelWizard.xml [forceLeftPanels, section, queryString, place, > forceRightPanels, > comment, space, language] testParametersInColibri > Details: Escaping test failed. * Parameter: "place" Tested file: > Panels/PanelWizard.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/Panels/PanelWizard?skin=colibri&place=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 341 column 95 ERROR: Unescaped< > character line 341 > column 91 ERROR: Unescaped> character > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/Panels_PanelWizard_xml__forceLeftPanels__section__queryString__place__forceRightPanels__comment__space__language___testParametersInColibri/ > > Failing for the past 164 builds. > Name: XWiki/ExtensionManager.xml [extensionid, actioninstall, actionresolve, > confirm, > extensionversion, comment, actionuninstall, language, editor] > testParametersInColibri > Details: Escaping test failed. * Parameter: "actioninstall" Tested file: > XWiki/ExtensionManager.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actioninstall=aaa%22bbb%27ccc%3Eddd%3Ceee&language=en > List of validation errors: line 321 column 140 WARNING: Macro > execution exception in the > response. * Parameter: "actionresolve" Tested file: > XWiki/ExtensionManager.xml URL: > http://127.0.0.1:8080/xwiki/bin/view/XWiki/ExtensionManager?skin=colibri&actionresolve= > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_ExtensionManager_xml__extensionid__actioninstall__actionresolve__confirm__extensionversion__comment__actionuninstall__language__editor___testParametersInColibri/ > > Failing for the past 164 builds. > Name: XWiki/LiveTableResults.xml [classname, orphaned, collist, comment, > space, language] > testParametersInColibri > Details: Escaping test failed. * Parameter: "classname" Tested file: > XWiki/LiveTableResults.xml > URL: > http://127.0.0.1:8080/xwiki/bin/view/XWiki/LiveTableResults?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=colibri&language=en > List of validation errors: line 304 column 133 WARNING: Macro > execution exception in the > response. line 408 column 0 WARNING: Possible SQL error trace. > line 423 column 0 > WARNING: Possible SQL error trace. * Parameter: "space" Tested file: > XWiki/LiveTab > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ApplicationTest/XWiki_LiveTableResults_xml__classname__orphaned__collist__comment__space__language___testParametersInColibri/ > > Failing for the past 164 builds. > Name: testClassEditor > Details: Escaping test for XWIKI-5404 failed. Tested file: > templates/editclass.vm URL: > http://127.0.0.1:8080/xwiki/bin/edit/aaa%22bbb%27ccc%3Eddd%3Ceee/aaa%22bbb%27ccc%3Eddd%3Ceee?editor=class&language=en > List of validation errors: line 332 column 71 WARNING: Unescaped ' > character line 336 > column 77 WARNING: Unescaped ' character line 338 column 78 > WARNING: Unescaped ' character > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/ObjectAndClassEditorTest/testClassEditor/ > > Failing for the past 164 builds. > Name: templates/editattachments.vm [] > testPageEscaping > Details: Escaping test for page name failed. Tested file: > templates/editattachments.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editattachments.vm&xpage=xpart&language=en > List of validation errors: line 1 column 42 ERROR: Unescaped< > character line 1 > column 38 ERROR: Unescaped> character > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editattachments_vm__________________________________testPageEscaping/ > > Failing for the past 164 builds. > Name: templates/editgroup.vm [classname] > testPageEscaping > Details: Escaping test for page name failed. Tested file: > templates/editgroup.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/Main/aaa%22bbb%27ccc%3Eddd%3Ceee?skin=default&vm=editgroup.vm&xpage=xpart&language=en > List of validation errors: line 0 column 0 WARNING: Unexpected > empty response > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testPageEscaping/ > > Failing for the past 164 builds. > Name: templates/editgroup.vm [classname] > testParameterEscaping > Details: Escaping test failed. * Parameter: "classname" Tested file: > templates/editgroup.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/Main/WebHome?classname=aaa%22bbb%27ccc%3Eddd%3Ceee&skin=default&vm=editgroup.vm&xpage=xpart&language=en > List of validation errors: line 0 column 0 WARNING: Unexpected > empty response > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testParameterEscaping/ > > Failing for the past 164 builds. > Name: templates/editgroup.vm [classname] > testSpaceEscaping > Details: Escaping test for space name failed. Tested file: > templates/editgroup.vm URL: > http://127.0.0.1:8080/xwiki/bin/view/aaa%22bbb%27ccc%3Eddd%3Ceee/WebHome?skin=default&vm=editgroup.vm&xpage=xpart&language=en > List of validation errors: line 0 column 0 WARNING: Unexpected > empty response > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-escaping/179/testReport/org.xwiki.test.escaping/TemplateTest/templates_editgroup_vm__classname_____________________________testSpaceEscaping/ > > Failing for the past 177 builds. > Name: testDocumentCacheSync > Details: null expected:<[modified ]content> but was:<[]content> > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSync/ > > Failing for the past 177 builds. > Name: testDocumentCacheSyncForAttachments > Details: Name: PUT URI: > http://localhost:8081/xwiki/rest/wikis/xwiki/spaces/Test/pages/AttachementCacheSync/attachments/file.ext > Status code: 404 Status text: Not Found Response:<html> <head> > <title>Status page</title> > </head> <body> <h3>The server has not found anything matching the request > URI</h3><p>You can get > technical details<a > href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.5";>here</a>.<br> > Please > continue your visit at our<a href="/">home page</a>.</p> </body> </html> > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-cluster/179/testReport/org.xwiki.test.cluster/DocumentCacheTest/testDocumentCacheSyncForAttachments/ > > Failing for the past 177 builds. > Name: org.xwiki.test.ui.AllTests > Details: Failed to connect to binary > FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; > process output follows: Error: cannot open display: :1.0 System info: > os.name: 'Linux', os.arch: > 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: > '1.5.0_15' Driver info: > driver.version: firefox > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ > > Failing for the past 177 builds. > Name: org.xwiki.test.ui.AllTests > Details: Failed to connect to binary > FirefoxBinary(/home/hudsonagent/firefox/firefox) on port 7055; > process output follows: Error: cannot open display: :1.0 System info: > os.name: 'Linux', os.arch: > 'i386', os.version: '2.6.27.10-grsec-xxxx-grs-ipv4-64', java.version: > '1.5.0_15' Driver info: > driver.version: firefox > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ui/179/testReport/org.xwiki.test.ui/AllTests/org_xwiki_test_ui_AllTests/ > > Failing for the past 177 builds. > Name: WYSIWYG Selenium Tests > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-wysiwyg/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/WYSIWYG_Selenium_Tests/ > > Failing for the past 180 builds. > Name: junit.framework.testsu...@6b3fc7 > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-ldap/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_6b3fc7/ > > Failing for the past 180 builds. > Name: junit.framework.testsu...@1d85f79 > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/org.xwiki.enterprise$xwiki-enterprise-test-selenium/179/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_1d85f79/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome > executed with > credentials Admin:admin > Details: Validation errors in space=Main, page=WebHome ERROR: At least one > style attribute has been > found on the page. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=WikiManager, > page=CreateNewWiki executed > with credentials Admin:admin > Details: Validation errors in space=WikiManager, page=CreateNewWiki ERROR: An > input field has been > found with no label association. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_WikiManager__page_CreateNewWiki_executed_with_credentials_Admin_admin/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome > executed with > credentials Admin:admin > Details: Validation errors in space=Main, page=WebHome ERROR: At least one > style attribute has been > found on the page. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ > > Failing for the past 828 builds. > Name: Validating Dutch Web Guidelines validity for: space=Main, page=WebHome > executed with > credentials Admin:admin > Details: Validation errors in space=Main, page=WebHome ERROR: At least one > style attribute has been > found on the page. > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-webstandards/838/testReport/org.xwiki.test.webstandards/CustomDutchWebGuidelinesValidationTest/Validating_Dutch_Web_Guidelines_validity_for__space_Main__page_WebHome_executed_with_credentials_Admin_admin/ > > Failing for the past 839 builds. > Name: junit.framework.testsu...@2a4983 > Details: Could not start Selenium session: Failed to start new browser > session: Error while > launching browser > Link: > http://hudson.xwiki.org/job/xwiki-product-enterprise-manager-tests/org.xwiki.manager$xwiki-enterprise-manager-test-selenium/838/testReport/org.xwiki.test.selenium.framework/XWikiSeleniumTestSetup/junit_framework_TestSuite_2a4983/ > ------------------------------------------------------------------------------- > > _______________________________________________ > notifications mailing list > [email protected] > http://lists.xwiki.org/mailman/listinfo/notifications _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
