Quality Summary ------------------------------------------- QA complete the Crosswalk App Tools Testing based on Crosswalk-14.42.335.0. Good to see the initially support for iOS could basically work. One regression issue found: The return code is incorrect after creating project failed(REG XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968>). The overall test results: Test Scope
Android iOS Comments Total TCs Pass Rate Total TCs Pass Rate Crosswalk App Tools/CLI 28 64.3% 20 70.0% Android: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> Should not build an arm app successfully when the libxwalkcore.so for ARM is missing Android: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> Fail to install the app which is built with release option Android: XWALK-3798<https://crosswalk-project.org/jira/browse/XWALK-3798> Better handling of truncated or corrupted ZIP file XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Crosswalk App Tools/Common Module 57 89.5% 27 100.0% Android: XWALK-3798<https://crosswalk-project.org/jira/browse/XWALK-3798> Better handling of truncated or corrupted ZIP file Total 85 81.2% 47 87.2% New Issues: - XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> P2 [REG] The return code is incorrect after creating project failed Command-line Interface Details: Component Case Id Android iOS Comments Build Project test_build_missing_so_file FAIL N/A Android: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> Should not build an arm app successfully when the libxwalkcore.so for ARM is missing Build Project test_build_normal PASS PASS Build Project test_build_release FAIL PASS Android: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> Fail to install the app which is built with release option Create Project test_no_sdk PASS N/A Create Project AppTools_Download PASS N/A Create Project test_create_channel_beta PASS N/A Create Project test_create_channel_canary PASS N/A Create Project test_create_channel_stable FAIL N/A Android: XWALK-3798<https://crosswalk-project.org/jira/browse/XWALK-3798> Better handling of truncated or corrupted ZIP file Create Project test_dir_exist PASS PASS Create Project test_main_activity PASS N/A Create Project test_normal PASS PASS Create Project test_normal_with_downloadCrosswalk FAIL N/A Android: XWALK-3798<https://crosswalk-project.org/jira/browse/XWALK-3798> Better handling of truncated or corrupted ZIP file Create Project test_pkgName_negative11 FAIL FAIL XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Create Project test_pkgName_negative12 FAIL FAIL XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Create Project test_pkgName_negative13 FAIL FAIL XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Create Project test_pkgName_negative14 FAIL FAIL XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Create Project test_pkgName_negative15 FAIL FAIL XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Create Project test_pkgName_negative16 FAIL FAIL XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> The return code is incorrect after creating project failed Create Project test_pkgName_positive1 PASS PASS Create Project test_pkgName_positive10 PASS PASS Create Project test_pkgName_positive2 PASS PASS Create Project test_pkgName_positive3 PASS PASS Create Project test_pkgName_positive4 PASS PASS Create Project test_pkgName_positive5 PASS PASS Create Project test_pkgName_positive6 PASS PASS Create Project test_pkgName_positive7 PASS PASS Create Project test_pkgName_positive8 PASS PASS Create Project test_pkgName_positive9 PASS PASS Common Module Details: Component Total TCs Android iOS Comments Android Platform 3 100% N/A Android Project Deps 5 100% N/A Android SDK 3 100% N/A Android Targets 3 100% N/A Application 7 100% 100% Command Parser 6 100% N/A Downloader 4 100% N/A Finite Progress 1 100% 100% Infinite Progress 1 100% 100% Log File Output 5 100% 100% Main 6 0% N/A Android: XWALK-3798<https://crosswalk-project.org/jira/browse/XWALK-3798> Better handling of truncated or corrupted ZIP file Output Tee 6 100% 100% Platform Base 2 100% 100% Template File 2 100% 100% Test Util 3 100% 100% Verified Issues: ----------------------- None Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: 02b5988cc6e3a5979f827e5e2f7968663d47c5ef iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: 4f3497c7aa8808870dc559c55a11b21eb3182eff Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/canary/14.42.335.0/crosswalk-14.42.335.0.zip Detailed Test Report: http://wrt-qa-report.sh.intel.com/v2/Android/IA%20Canary/Crosswalk%20App%20Tools/8946 http://wrt-qa-report.sh.intel.com/v2/Linux/iOs/Crosswalk%20App%20Tools/8950 Test Environment: ----------------------- Test host: Ivy Bridge Desktop installed with Ubuntu 14.04/ MacBook Pro 10.10 with XCode 6.2 Test device: ASUS MeMo Pad 8(Android 4.4.2)/ Google nexus 5(Android 4.4.2)/ iPad Mini 8.2 Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
