Test Objective: Capture the key regression of daily build by automated nightly testing.
Summary: :One major issue found after comparing recent result, Embedding APIs passrate are decreasing compared with 15.44.367.0. Aging downgrade issue(since 13.42.319.0): XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794> Aging downgrade issue(since 14.43.336.0): XWALK-4017<https://crosswalk-project.org/jira/browse/XWALK-4017> XWALK-4019<https://crosswalk-project.org/jira/browse/XWALK-4019> XWALK-4031<https://crosswalk-project.org/jira/browse/XWALK-4031> XWALK-4036<https://crosswalk-project.org/jira/browse/XWALK-4036> XWALK-4040<https://crosswalk-project.org/jira/browse/XWALK-4040> XWALK-4044<https://crosswalk-project.org/jira/browse/XWALK-4044> Aging downgrade issue(since 15.43.348.0): XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251> Aging downgrade issue(since 15.44.361.0): XWALK-4382<https://crosswalk-project.org/jira/browse/XWALK-4251> Downgraded Components: Platform Test Suites TC Num Pass% Diff w/ 15.44.367.0 Comments Android x86/arm Crosswalk APIs/Embedding API 207 0% -79% XWALK-4503<https://crosswalk-project.org/jira/browse/XWALK-4503> [REG]Get exception test result when running "embedding-api-android-tests". Overall Test Results: Canary - Crosswalk Project for Android Segment Test Set Hardware WebAPIs Embedding APIs (Java) Runtime Features Use Cases Sample Apps Diff w/ 15.44.367.0 Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Total TCs Pass% Trend Embedded Crosswalk Full Functional Test ASUS MeMO Pad 8(4.4.2) 11987 90% -- 207 0% -79% 525 13% -- 54 96% -- 46 100% -- Embedding APIs(Java) decreasing reason: XWALK-4503<https://crosswalk-project.org/jira/browse/XWALK-4503>([REG]Get exception test result when running "embedding-api-android-tests".) Google Nexus 4(4.2.2) 11987 91% +1% 207 0% -79% 525 13% -- 54 96% -- 46 98% -- Embedding APIs(Java) decreasing reason: XWALK-4503<https://crosswalk-project.org/jira/browse/XWALK-4503>([REG]Get exception test result when running "embedding-api-android-tests".) Test Coverage: Full Auto TCs of Web APIs, Crosswalk WRT, Embedding APIs, Use Cases, Sample Apps Test Environment: Crosswalk build: https://download.01.org/crosswalk/releases/crosswalk/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
