Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID 5b589337d1d68c40c675f6880a63fd12f18446f6. Glad to see that major regression of building project on Deepin backend got fixed (Fixed XWALK-4723<https://crosswalk-project.org/jira/browse/XWALK-4723>). Besides, basic functional tests got 97% pass on Windows 8 as Android host. Additionally, new implementation of manifest, fullscreen, keeping screen on, remote debugging support on Android, simplify project layout support on all platforms got verified by QA
Test Scope Ubuntu Windows Deepin iOS Comments Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Crosswalk App Tools/CLI 60 93% +2% 60 93% -- 27 93% -- 32 84% +7% Bugs on Ubuntu/Windows: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> Should not build an arm app successfully when the libxwalkcore.so for ARM is missing XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> Fail to install the app which is built with release option XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056> Duplicate to place download files when setup CROSSWALK_APP_TOOLS_CACHE_DIR Bugs on Linux: XWALK-4013<https://crosswalk-project.org/jira/browse/XWALK-4013> Project folder should not be created if "create" command fails XWALK-4129<https://crosswalk-project.org/jira/browse/XWALK-4129> Incorrect help info is displayed on linux platform Bugs on iOS: XWALK-4152<https://crosswalk-project.org/jira/browse/XWALK-4152> Support specific help output for backends XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> [app-tools] [REG] Fail to build the project on iOS platform All of the platforms got improvement due to add the test cases got pass result. Crosswalk App Tools/Common Module 93 100% -- 93 100% -- 49 100% -- 49 100% -- Got good quality Crosswalk App Tools/Sample Apps 2 100% -- 2 100% -- 2 100% -- 2 0% -- Android and Linux got good quality, Bugs on iOS: XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> [app-tools] [REG] Fail to build the project on iOS platform Crosswalk App Tools/Usecase 2 100% -- 2 100% -- 1 100% -- 1 0% -- Android and Linux got good quality, Bugs on iOS: XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> [app-tools] [REG] Fail to build the project on iOS platform Total 157 97% +1% 157 97% +1% 79 97% -- 84 90% +2% (*) instead of the previous test commit id: 878d5444eb19f68596b7125734b984e34bd49f40 Verified Issues: ----------------------- XWALK-4723<https://crosswalk-project.org/jira/browse/XWALK-4723> [app-tools][REG] Fail to build project on Deepin backend XWALK-4199<https://crosswalk-project.org/jira/browse/XWALK-4199> [app-tools] Log files are missing information for Deepin backend XWALK-4272<https://crosswalk-project.org/jira/browse/XWALK-4272> [app-tools] No log recorded in android.log when execute update command Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: 5b589337d1d68c40c675f6880a63fd12f18446f6 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: f820d8fb3a75e07051227fae3abde2967dfb9f79 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/canary/15.44.384.0/crosswalk-15.44.384.0.zip<https://download.01.org/crosswalk/releases/crosswalk/android/canary/15.44.377.0/crosswalk-15.44.377.0.zip> Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8 Android device: Android IA 4.2.2 ZTE Geek, Memopad 8, Nexus 4 iOS host: MacBook Pro 10.10 with XCode 6.3 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2014.2 (http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese Linux/Deepin backend:https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
