Post to Crosswalk mailing list because one major regression: widget signature issue(XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396>) found in nightly auto testing system.
Thanks, Tina From: Wang, ChaoX Sent: Wednesday, August 27, 2014 1:01 PM To: 'crosswalk-autot...@lists.crosswalk-project.org' Cc: Yu, Ling L; Fan, Yugang; Zhang, Belem; Zhao, Tina; Tao, Daniel; Liu, DeyiX; Dai, FengX Subject: Crosswalk Nightly Automation Test Report on 9.37.195.0 Test Objective: Capture the key regression of daily build by automated nightly testing. Summary: Tizen Device API and Tizen WRT got downgrade due to widget signature issue(XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396>). QA think this issue is caused by following patch: " commit 84598a026a4a1ac449384957b0954a6a9db8e587 Author: Xu Zhang <xu.u.zh...@intel.com<mailto:xu.u.zh...@intel.com>> Date: Fri Aug 8 11:40:13 2014 +0800 [Tizen] Checking widget signature Process signature file in widget according to http://www.w3.org/TR/widgets-digsig/#signature-verification. Because there is no Tizen CA root in image, reference validation and signature validation on signature will be added when CA is ready. " Downgraded Components: Platform Test component TC Num Pass% Diff w/ 9.37.194.0 Comments Tizen IVI/ Tizen Common TizenAPI/Application/Application 74 0% -71% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/Social/Bookmark 36 0% -100% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/Content/Content 135 0% -36% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/IO/Filesystem 272 0% -98% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/IO/Messageport 38 0% -47% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/User Interface/Notification 81 0% -100% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/System/Power 48 0% -93% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/System/SystemInfo 208 0% -49% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/System/SystemSetting 30 0% -60% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> TizenAPI/Tizen/Tizen 79 0% -37% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> Web/Runtime/ConfigExtension 7 0% -100% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> Web/Runtime/PackageManagement 20 0% -100% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> Web/Runtime/WebApplicationRuntime 11 0% -73% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> Web/Runtime/SecurityPrivacy 2 0% -100% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> Web/Runtime/WebApplicationRuntimeUI 10 0% -100% XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396> Overall Test Results: Platform Hardware Total TCs Pass% Trend Diff w/ 9.37.194.0 Tizen IVI NDiS 8108 75% -9% Got downgrade due to widget signature issue(XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396>) Tizen common Acer Aspire 5349 ZRL 8108 75% -10% Got downgrade due to widget signature issue(XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396>) Intel NUC i5 8108 75% -10% Got downgrade due to widget signature issue(XWALK-2396<https://crosswalk-project.org/jira/browse/XWALK-2396>) Android arm Google Nexus 4 CyanogenMod (4.4.2) 7435 92% +2% Google Nexus 5 (4.4.2) 7435 92% +2% Kindle Fire HD (Fire OS 3.2) 7435 79% +1% The pass rate different with other device due to Kindle does not support Webgl ZTE Grand Memo U5 (4.1.2) 7435 92% +2% Android x86 ASUS T00E Padfone Mini (4.3) 7435 92% +2% ASUS T00G Zenfone 6 (4.3) 7435 92% +2% Dell Venue 8 (4.3) 7435 92% +2% Ramos i10 (4.2.2) 7435 92% +2% Samsung Galaxy Tab 3 (4.2.2) 7435 92% +2% ZTE Geek V975 (4.2.2) 7435 92% +2% Test Coverage: Full Auto TCs of Web APIs and Tizen WRT core spec. Crosswalk WRT and Cordova is WIP. Test Environment: Tizen IVI image: http://download.tizen.org/releases/daily/tizen/ivi/tizen-ivi_20140814.5/ Tizen common image: http://download.tizen.org/snapshots/tizen/common/tizen-common_20140815.1/ Crosswalk build: https://download.01.org/crosswalk/releases/crosswalk/ Tizen Extensions Crosswalk: https://download.01.org/crosswalk/releases/tizen-extensions-crosswalk/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list Crosswalk-dev@lists.crosswalk-project.org https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
