Test Objective: Capture the key regression of daily build by automated nightly 
testing.

Summary: : One major issue found after comparing recent result, WebAPIs and 
Sample Apps passrate are decreasing compared with 15.43.360.0.
Aging downgrade issue(since 13.42.319.0): 
XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794>
Aging downgrade issue(since 14.43.336.0): 
XWALK-4017<https://crosswalk-project.org/jira/browse/XWALK-4017> 
XWALK-4019<https://crosswalk-project.org/jira/browse/XWALK-4019> 
XWALK-4031<https://crosswalk-project.org/jira/browse/XWALK-4031> 
XWALK-4036<https://crosswalk-project.org/jira/browse/XWALK-4036> 
XWALK-4040<https://crosswalk-project.org/jira/browse/XWALK-4040> 
XWALK-4044<https://crosswalk-project.org/jira/browse/XWALK-4044>
Aging downgrade issue(since 15.43.348.0): 
XWALK-4251<https://crosswalk-project.org/jira/browse/XWALK-4251>
Aging downgrade issue(since 15.44.361.0): 
XWALK-4382<https://crosswalk-project.org/jira/browse/XWALK-4251>


Downgraded Components:
N/A


Overall Test Results:
Canary - Crosswalk Project for Android

Segment

Test Set

Hardware

WebAPIs

Embedding APIs (Java)

Runtime Features

Use Cases

Sample Apps

Diff w/ 15.44.361.0

Total TCs

Pass%

Trend

Total TCs

Pass%

Trend

Total TCs

Pass%

Trend

Total TCs

Pass%

Trend

Total TCs

Pass%

Trend

Embedded Crosswalk Full

Functional Test

ASUS MeMO Pad 8(4.4.2)

12008

76%

--

207

79%

+1%

597

11%

--

55

96%

--

46

98%

--



Google Nexus 4(4.2.2)

12008

77%

--

207

79%

+1%

597

11%

--

55

96%

--

46

98%

--




Test Coverage:
Full Auto TCs of Web APIs, Crosswalk WRT, Embedding APIs, Use Cases, Sample Apps

Test Environment:
Crosswalk build: https://download.01.org/crosswalk/releases/crosswalk/
Github Test Suite Links: 
https://github.com/crosswalk-project/crosswalk-test-suite/


Thanks,
Crosswalk QA team
_______________________________________________
Crosswalk-dev mailing list
[email protected]
https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev

Reply via email to