Test Objective: Capture the key regression of daily build by automated nightly testing.
Summary: : One major issue found in crosswalk beta test, but total passrate are stable compared with 15.43.357.0 in Canary test. Aging downgrade issue(since 13.42.319.0): XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794> Aging downgrade issue(since 14.43.336.0): XWALK-4017<https://crosswalk-project.org/jira/browse/XWALK-4017> XWALK-4019<https://crosswalk-project.org/jira/browse/XWALK-4019> XWALK-4031<https://crosswalk-project.org/jira/browse/XWALK-4031> XWALK-4036<https://crosswalk-project.org/jira/browse/XWALK-4036> XWALK-4040<https://crosswalk-project.org/jira/browse/XWALK-4040> XWALK-4044<https://crosswalk-project.org/jira/browse/XWALK-4044> Aging downgrade issue(since 15.43.348.0): XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251> Downgraded Components: Platform Test Suites TC Num Pass% Diff w/ 14.43.349.0 Comments Android x86/arm WebAPIs/Use Cases/Cordova Feature 12052 0% -100% XWALK-4313<https://crosswalk-project.org/jira/browse/XWALK-4313> [Cordova] Fail to pack Cordova 4.0 package on Crosswalk 14.43.343.10/15.43.355.0 Overall Test Results: Canary - Crosswalk Project for Android Segment Test Set Hardware WebAPIs Embedding APIs (Java) Runtime Features Use Cases Sample Apps Diff w/ 15.43.357.0 Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Embedded Crosswalk Full Functional Test ASUS MeMO Pad 8(4.4.2) 11798 90% -- 202 78% -- 597 11% -- 55 95% -- 46 100% -- Google Nexus 4(4.2.2) 12008 91% -- 202 78% -- 597 11% -- 55 95% -- 46 100% -- Beta - Crosswalk Project for Android (14.43.343.10) Segment Test Set Hardware WebAPIs Embedding APIs (Java) Runtime Features Use Cases Sample Apps Cordova Feature Diff w/ 14.43.343.9 Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Embedded Crosswalk Full(Weekly) Functional Test ASUS MeMO Pad 8(4.4.2) 11768 90% -- 202 78% -- 597 99% -- 55 95% -- 47 100% -- N/A N/A N/A Google Nexus 4(4.2.2) 11978 90% -- 202 78% -- 597 99% -- 55 95% -- 47 100% -- N/A N/A N/A Crosswalk WebView Plugin for Cordova(Weekly) Functional Test ASUS MeMO Pad 8(4.4.2) N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A Crosswalk WebView Plugin for Cordova is block because of bug XWALK-4313<https://crosswalk-project.org/jira/browse/XWALK-4313>([Cordova] Fail to pack Cordova 4.0 package on Crosswalk 14.43.343.10/15.43.355.0) Google Nexus 4(4.2.2) N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A Test Coverage: Full Auto TCs of Web APIs, Crosswalk WRT, Embedding APIs, Use Cases, Sample Apps Test Environment: Crosswalk build: https://download.01.org/crosswalk/releases/crosswalk/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
