Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID f75ea3301c63b063e7fe02f60d51f3f1b52e8525 . Glad to see that Android 64-bit testing is added, and got same result as 32-bit testing. About 37 tests of 64-bit dropped by feature XWALK-4499<https://crosswalk-project.org/jira/browse/XWALK-4499> not implemented yet. However, filed one regression issue: [REG]Fail to build project with crosswalk directory for Android platforms (REG XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823>).
The overall test results: Test Scope Windows 8 OS X Deepin Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android Tests(Embedded) 230 94% -- 230 94% -- N/A N/A N/A Bugs on Windows/iOS: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> App Tools Android Tests(Shared) 230 94% -- 230 94% -- N/A N/A N/A Bugs on Windows/iOS: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> App Tools Android Tests 64-bit(Embedded) 221 93% -- 221 93% -- N/A N/A N/A Bugs on Windows/iOS: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> App Tools Android Tests 64-bit(Shared) 221 93% -- 221 93% -- N/A N/A N/A Bugs on Windows/iOS: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> App Tools SampleApp Tests 6 100% -- 6 100% -- 2 100% -- Got good quality App Tools UseCase Tests 5 100% -- 6 100% -- 1 100% -- Got good quality App Tools Windows Tests 110 95% -- N/A N/A N/A N/A N/A N/A Bugs on Windows: XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>,XWALK-4916<https://crosswalk-project.org/jira/browse/XWALK-4916>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-4835<https://crosswalk-project.org/jira/browse/XWALK-4835> Total 1023 94% -- 914 93% -1% 3 100% -- (*) instead of the previous test commit id: aa10bfc4042c256f3b3e3c8e483e3ca62cda7012 New Issues: ----------------------- XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> [App-Tools][REG] Fail to build project with crosswalk directory for Android platforms Verified Issues: ----------------------- N/A Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: f75ea3301c63b063e7fe02f60d51f3f1b52e8525 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/16.45.421.14/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/17.45.426.0/ [no beta builds for Windows] Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8 Android device: ASUS Memo Pad 8, ECS2-8A ,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2014.2 (http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
