Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID 41077b6c47fcb154055ef3aaa13eb77b173891eb. Glad to see that Android project built out without -p android/--platforms=android (fixed XWALK-6698<https://crosswalk-project.org/jira/browse/XWALK-6698>), multiple backends project can be built out when set -crosswalk=version (fixed XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527>), crosswalk-lite in download.01.org can be downloaded (fixed XWALK-6552<https://crosswalk-project.org/jira/browse/XWALK-6552>), crosswalk zip template/libs directory exists now (fixed XWALK-6744<https://crosswalk-project.org/jira/browse/XWALK-6744>). However, 2 new issues found: No project can be built with release crosswalk for multiple backends (XWALK-6808<https://crosswalk-project.org/jira/browse/XWALK-6808>), crosswalk-pkg/crosswalk-app ignored invalid paremeter if paremeter's name is invalid (XWALK-6807<https://crosswalk-project.org/jira/browse/XWALK-6807>). The overall test results:
New Issues: ----------------------- XWALK-6808<https://crosswalk-project.org/jira/browse/XWALK-6808> P2 [Apptools] No project can be built with release crosswalk for multiple backends XWALK-6807<https://crosswalk-project.org/jira/browse/XWALK-6807> P3 [Apptools] crosswalk-pkg/crosswalk-app ignored invalid paremeter if paremeter's name is invalid. Verified Issues: ----------------------- XWALK-6698<https://crosswalk-project.org/jira/browse/XWALK-6698> P2 [Apptools] Fail to build project without -p android/--platforms=android for Android platform. XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527> P2 [Apptools] Fail to build project with multiple backends when set --crosswalk=version. XWALK-6552<https://crosswalk-project.org/jira/browse/XWALK-6552> P2 App-tool cannot download crosswalk-lite in download.01.org XWALK-6744<https://crosswalk-project.org/jira/browse/XWALK-6744> P2 crosswalk zip template/libs directory gone (placed in toplevel) Test Scope Windows 8.1 Windows 10 OS X Deepin Android Usecase Test Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android 32-bit Tests(Embedded) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254> XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> XWALK-6698<https://crosswalk-project.org/jira/browse/XWALK-6698> is fixed. App Tools Android 32-bit Tests(Shared) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254> XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> XWALK-6698<https://crosswalk-project.org/jira/browse/XWALK-6698> is fixed. App Tools Android 64-bit Tests(Embedded) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254> XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> XWALK-6698<https://crosswalk-project.org/jira/browse/XWALK-6698> is fixed. App Tools Android 64-bit Tests (Shared) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254> XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> XWALK-6698<https://crosswalk-project.org/jira/browse/XWALK-6698> is fixed. App Tools SampleApp Tests N/A N/A N/A 10 100% -- 10 100% -- 2 100% -- N/A N/A N/A App Tools UseCase Tests (windows/ios/deepin) N/A N/A N/A 23 96% -- 8 63% -- 7 71% -- N/A N/A N/A Bugs exist: XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529>, XWALK-6715<https://crosswalk-project.org/jira/browse/XWALK-6715>, XWALK-6716<https://crosswalk-project.org/jira/browse/XWALK-6716> App Tools Tests 145 83% -- 145 83% -- N/A N/A N/A N/A N/A N/A N/A N/A N/A Bugs exist: XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6808<https://crosswalk-project.org/jira/browse/XWALK-6808> XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527> is fixed. . Total 145 83% -- 1270 94% -- 1110 95% -- 9 78% -- 156 92% -- (*) instead of the previous test commit id: ef96046c23eeac8c1f01171a1ccbd19c1696bdf1 Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: 41077b6c47fcb154055ef3aaa13eb77b173891eb Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/19.49.514.1/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/beta/19.49.514.1/ Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, Xiaomi Pad 2,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.11 with XCode 7.3 iOS device: iPad mini 9.3 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
