Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID 4d9d28afa5e34e6bc11c5e9da4dffbbfac5def1e. Glad to see that user is able to build project with crosswalk directory for Android platforms (XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> fixed), able to build project when display or orientation set to invalid value (XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> fixed), able to create and build project when whitespace in path to apache ant (XWALK-5894<https://crosswalk-project.org/jira/browse/XWALK-5894> fixed), the -platforms parameter has been changed to -platform, and it works on windows/android/ios/deepin (XWALK-5909<https://crosswalk-project.org/jira/browse/XWALK-5909> fixed). However, about 37 tests of 64-bit still dropped by feature XWALK-4499<https://crosswalk-project.org/jira/browse/XWALK-4499> not implemented yet.
The overall test results: Test Scope Windows 8 OS X Deepin Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android Tests(Embedded) 236 98% +4% 236 98% +4% N/A N/A N/A Bugs on Windows/iOS: XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> Got improvement due to XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> and XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> are fixed. App Tools Android Tests(Shared) 236 98% +4% 236 98% +4% N/A N/A N/A Bugs on Windows/iOS:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> Got improvement due to XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> and XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> are fixed. App Tools Android Tests 64-bit(Embedded) 227 97% +4% 227 97% +4% N/A N/A N/A Bugs on Windows/iOS: XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> Got improvement due to XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> and XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> are fixed. App Tools Android Tests 64-bit(Shared) 227 97% +4% 227 97% +4% N/A N/A N/A Bugs on Windows/iOS:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> Got improvement due to XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> and XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> are fixed. App Tools SampleApp Tests 6 100% -- 6 100% -- 2 100% -- Got good quality App Tools UseCase Tests 5 100% -- 6 100% -- 1 100% -- Got good quality App Tools Windows Tests 119 95% -- N/A N/A N/A N/A N/A N/A Bugs on Windows: XWALK-4916<https://crosswalk-project.org/jira/browse/XWALK-4916>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-4835<https://crosswalk-project.org/jira/browse/XWALK-4835> Got improvement due to XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> is fixed. Total 1056 97% +3% 938 97% +4% 3 100% -- Got improvement due to XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> and XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> are fixed. (*) instead of the previous test commit id: f75ea3301c63b063e7fe02f60d51f3f1b52e8525 New Issues: ----------------------- N/A Verified Issues: ----------------------- XWALK-5823<https://crosswalk-project.org/jira/browse/XWALK-5823> P1 [App-Tools][REG] Fail to build project with crosswalk directory for Android platforms XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262> P2 Build project success when the display or orientation set the invalid value XWALK-5894<https://crosswalk-project.org/jira/browse/XWALK-5894> P2 Build project success when the display or orientation set the invalid value XWALK-5909<https://crosswalk-project.org/jira/browse/XWALK-5909> P2 crosswalk-app "manifest" and "create" only support single platform Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: 4d9d28afa5e34e6bc11c5e9da4dffbbfac5def1e Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/17.46.448.1/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/17.46.443.0/ [no beta builds for Windows] Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1 Android device: ASUS Memo Pad 8, ECS2-8A ,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2014.2 (http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
