Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID fdcc8a1b5d9efb45f12b617d70c52e4b44a3f9e9 . Glad to see that app could be built successfully on iOS platform (Fixed XWALK-5233<https://crosswalk-project.org/jira/browse/XWALK-5233>); project path could be build successfully on Mac OS(Fixed XWALK-5263<https://crosswalk-project.org/jira/browse/XWALK-5263>); able to remove project when xwalk_app_version is set to invalid value(Fixed XWALK-5255<https://crosswalk-project.org/jira/browse/XWALK-5255>); able to build project with crosswalk version for windows platforms(Fixed XWALK-5563<https://crosswalk-project.org/jira/browse/XWALK-5563>). And XCode version on iOS host has been updated to 7.1. However, file one update command issue on windows platform(XWALK-5596<https://crosswalk-project.org/jira/browse/XWALK-5596>). The overall test results:
Test Scope Windows 8 OS X Deepin Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android Tests(Embedded) 209 93% +10% 209 93% +10% N/A N/A N/A Bugs on Windows/iOS: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779>, XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>, iOS and Windows pass rate got improvement due to XWALK-5255<https://crosswalk-project.org/jira/browse/XWALK-5255> has been fixed. App Tools Android Tests(Shared) 209 93% +10% 209 93% +10% N/A N/A N/A Bugs on Windows/iOS: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779>, XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>, iOS and Windows pass rate got improvement due to XWALK-5255<https://crosswalk-project.org/jira/browse/XWALK-5255> has been fixed. App Tools SampleApp Tests 6 100% -- 6 100% +100% 2 100% -- Got good quality on Deepin ,Windows. iOS pass rate got improvement due to XWALK-5233<https://crosswalk-project.org/jira/browse/XWALK-5233>, XWALK-5263<https://crosswalk-project.org/jira/browse/XWALK-5263> has been fixed App Tools UseCase Tests 5 100% -- 6 100% +100% 1 100% -- Got good quality on Deepin ,Windows. iOS pass rate got improvement due to XWALK-5233<https://crosswalk-project.org/jira/browse/XWALK-5233>, XWALK-5263<https://crosswalk-project.org/jira/browse/XWALK-5263> has been fixed App Tools Windows Tests 102 96% -- N/A N/A N/A N/A N/A N/A Bugs on Windows: XWALK-5564<https://crosswalk-project.org/jira/browse/XWALK-5564>, XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>,XWALK-4916<https://crosswalk-project.org/jira/browse/XWALK-4916>,XWALK-5596<https://crosswalk-project.org/jira/browse/XWALK-5596>, Total 531 90% -- 430 93% +5% 3 100% -- (*) instead of the previous test commit id:625835539744dd61dffc95f40586998abec674e3 New Issues: ----------------------- XWALK-5596<https://crosswalk-project.org/jira/browse/XWALK-5596> P2 [app-tools]update command does not work on windows platforms Verified Issues: ----------------------- XWALK-5233<https://crosswalk-project.org/jira/browse/XWALK-5233> P1 [app-tools] Invalid app has been built on iOS platform XWALK-5263<https://crosswalk-project.org/jira/browse/XWALK-5263> P2 Fail to build the success with the project path on Mac OS XWALK-5255<https://crosswalk-project.org/jira/browse/XWALK-5255> P2 [REG][app-tools]Fail to remove project when xwalk_app_version is set to invalid value XWALK-5563<https://crosswalk-project.org/jira/browse/XWALK-5563> P2 [app-tools] Fail to build project with crosswalk version for windows platforms Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: fdcc8a1b5d9efb45f12b617d70c52e4b44a3f9e9 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/16.45.421.3/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/17.45.421.0/ Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8 Android device: Memopad 8, Nexus 4 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2014.2 (http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
