Test Objective: Capture the key regression of daily build by automated nightly testing.
Summary: : One major issue found after comparing recent result, Embedding APIs passrate are decreasing compared with 15.43.347.0. Aging downgrade issue(since 13.42.319.0): XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794> Aging downgrade issue(since 14.43.336.0): XWALK-4017<https://crosswalk-project.org/jira/browse/XWALK-4017> XWALK-4019<https://crosswalk-project.org/jira/browse/XWALK-4019> XWALK-4031<https://crosswalk-project.org/jira/browse/XWALK-4031> XWALK-4036<https://crosswalk-project.org/jira/browse/XWALK-4036> XWALK-4040<https://crosswalk-project.org/jira/browse/XWALK-4040> XWALK-4044<https://crosswalk-project.org/jira/browse/XWALK-4044> Downgraded Components: Platform Test component TC Num Pass% Diff w/ 14.43.347.0 Comments Android x86/arm Crosswalk APIs/Embedding API 202 79% -17% XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251> [REG] Embedding api method waitForCallback got "time out" error when invoked in some testcases in embedding-api-android-tests. Overall Test Results: Canary - Crosswalk Project for Android Segment Test Set Hardware WebAPIs Embedding APIs (Java) Runtime Features Use Cases Sample Apps Diff w/ 15.43.347.0 Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Embedded Crosswalk Full Functional Test ASUS MeMO Pad 8(4.4.2) 11772 90% -- 202 78% -18% 597 11% -- 55 95% -- 47 100% -- For Embedding APIs (Java):Due to bug XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251>[REG] Embedding api method waitForCallback got "time out" error when invoked in some testcases in embedding-api-android-tests.), its passrate decreased Google Nexus 4(4.2.2) 11982 91% +1% 202 78% -18% 597 11% -- 55 95% -- 47 100% -- For Embedding APIs (Java):Due to bug XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251>[REG] Embedding api method waitForCallback got "time out" error when invoked in some testcases in embedding-api-android-tests.), its passrate decreased Test Coverage: Full Auto TCs of Web APIs, Crosswalk WRT, Embedding APIs, Use Cases, Sample Apps Test Environment: Crosswalk build: https://download.01.org/crosswalk/releases/crosswalk/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
