Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID ab60126297d2c3d8a5846e9a6a7e245db44117b3. Glad to see that major regression of building project on iOS backend got fixed(Fixed XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707>), user could build app on windows backend successfully(Fixed XWALK-4799<https://crosswalk-project.org/jira/browse/XWALK-4799>), no crash after build ios platform project (Fixed XWALK-4833<https://crosswalk-project.org/jira/browse/XWALK-4833>). However, one regression found: build should fail when package_id is changed on iOS backend(REG XWALK-4889<https://crosswalk-project.org/jira/browse/XWALK-4889>). Additionally, three issues filed: The description of error message need to be improved(XWALK-4891<https://crosswalk-project.org/jira/browse/XWALK-4891>), Block to build Deepin app when update the package id in manifest.json(XWALK-4785<https://crosswalk-project.org/jira/browse/XWALK-4785>), Fail to create project with windows platforms(XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886>)
The overall test results: Test Scope Ubuntu Windows Deepin iOS Comments Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Crosswalk App Tools/CLI 76 92% -1% 76 92% -1% 30 87% -6% 35 91% +7% Bugs on Android: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779>, XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886> Bugs on Linux: XWALK-4013<https://crosswalk-project.org/jira/browse/XWALK-4013>,XWALK-4129<https://crosswalk-project.org/jira/browse/XWALK-4129>, XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886>, XWALK-4785<https://crosswalk-project.org/jira/browse/XWALK-4785> Bugs on iOS: XWALK-4152<https://crosswalk-project.org/jira/browse/XWALK-4152>, XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886>, XWALK-4891<https://crosswalk-project.org/jira/browse/XWALK-4891> Ubuntu/Windows/Deepin got downgrade due to new issue XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886> iOS got improvement due to XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> has been fixed Crosswalk App Tools/Common Module 92 100% -- 92 100% -- 47 100% -- 47 100% -- Got good quality Crosswalk App Tools/Sample Apps 2 100% -- 2 100% -- 2 100% -- 2 100% +100% iOS got improvement due to XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> has been fixed. Crosswalk App Tools/Usecase 2 100% -- 2 100% -- 1 100% -- 2 100% +100% iOS got improvement due to XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> has been fixed. Total 172 97% -1% 172 97% -1% 80 95% -2% 86 97% +6% Android and windows got downgrade due to XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886> Deepin got downgrade due to XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886>, iOS got improvement due to XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> has been fixed. (*) instead of the previous test commit id: 5b589337d1d68c40c675f6880a63fd12f18446f6 New Issues: ----------------------- XWALK-4889<https://crosswalk-project.org/jira/browse/XWALK-4889> P2 [app-tools][REG]Build should fail when package_id is changed on iOS backend XWALK-4891<https://crosswalk-project.org/jira/browse/XWALK-4891> P2 [app-tools]The description of error message need to be improved XWALK-4785<https://crosswalk-project.org/jira/browse/XWALK-4785> P2 [app-tools] Block to build Deepin app when update the package id in manifest.json XWALK-4886<https://crosswalk-project.org/jira/browse/XWALK-4886> P2 [app-tools]Fail to create project with windows platforms Verified Issues: ----------------------- XWALK-4707<https://crosswalk-project.org/jira/browse/XWALK-4707> [app-tools] [REG] Fail to build the project on iOS platform XWALK-4799<https://crosswalk-project.org/jira/browse/XWALK-4799> [app-tools] Fail to build app on Windows backend XWALK-4833<https://crosswalk-project.org/jira/browse/XWALK-4833> [app-tools]The package crash after build the project on iOS platform Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: ab60126297d2c3d8a5846e9a6a7e245db44117b3 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: 5edf1f2a3e17e779c37068a4e796887dec4a5d8e iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: 7054a66fa7c0c48d9be12a7ced4645a6d62a7f3d Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/canary/16.44.392.0/crosswalk-16.44.392.0.zip Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8 Android device: Android IA 4.2.2 ZTE Geek, Memopad 8, Nexus 4 iOS host: MacBook Pro 10.10 with XCode 6.3 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2014.2 (http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese Linux/Deepin backend:https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
