Test Objective: Capture the key regression of daily build by automated nightly testing.
Summary: :One major issue found after comparing recent result, Embedding APIs passrate is decreasing compared with 16.44.397.0. Aging downgrade issue(since 13.42.319.0): XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794> Aging downgrade issue(since 14.43.336.0): XWALK-4017<https://crosswalk-project.org/jira/browse/XWALK-4017> XWALK-4019<https://crosswalk-project.org/jira/browse/XWALK-4019> XWALK-4031<https://crosswalk-project.org/jira/browse/XWALK-4031> XWALK-4036<https://crosswalk-project.org/jira/browse/XWALK-4036> XWALK-4040<https://crosswalk-project.org/jira/browse/XWALK-4040> XWALK-4044<https://crosswalk-project.org/jira/browse/XWALK-4044> Aging downgrade issue(since 15.43.348.0): XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251> Aging downgrade issue(since 15.44.361.0): XWALK-4382<https://crosswalk-project.org/jira/browse/XWALK-4251> Downgraded Components: Platform Test component TC Num Pass% Diff w/ 16.44.397.0 Comments Android x86/arm Crosswalk APIs/Embedding API 220 0% -96% XWALK-4934 [REG]Get exception test result when running "embedding-api-android-tests". Overall Test Results: Canary - Crosswalk Project for Android Segment Test Set Hardware WebAPIs Embedding APIs (Java) Runtime Features Use Cases Sample Apps Diff w/ 16.44.397.0 Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Embedded Crosswalk Full Functional Test ASUS MeMO Pad 8(4.4.2) 17406 88% -- 220 0% -96% 537 100% -- 54 93% -- 79 96% -- Embedding APIs passrate fall reason: Bug XWALK-4934([REG]Get exception test result when running "embedding-api-android-tests".) Google Nexus 4(4.2.2) 17406 88% -- 220 0% -96% 537 100% -- 54 85% -- 79 96% -- Embedding APIs passrate fall reason: Bug XWALK-4934([REG]Get exception test result when running "embedding-api-android-tests".) Test Coverage: Full Auto TCs of Web APIs, Crosswalk WRT, Embedding APIs, Use Cases, Sample Apps Test Environment: Crosswalk build: https://download.01.org/crosswalk/releases/crosswalk/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
