Quality Summary
-------------------------------------------
QA complete the initial testing for Crosswalk App Tools on Android based on 
Crosswalk 13.42.320.0. Three issues found: shouldn't build arm app when missing 
arm 
libxwalkcore.so(XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779>),
 fail to install app with release 
option(XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>), 
download failed with http 
proxy(XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785>). 3 
component scores of Common Module are badly impact by http proxy bug 
(XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785>). The overall 
test results:

Test Scope      Total TCs       Passed  Failed  Blocked Run rate        Pass 
Rate of Total      Pass Rate of Executed   Comments
Crosswalk App Tools/CLI 23      21      2       0       100%    91.3%   91.3%   
XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> 
[app-tools]Should not build an arm app successfully when the libxwalkcore.so 
for ARM is missing
XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> 
[app-tools]Fail to install the app which is built with release option
Crosswalk App Tools/Common Module       52      42      3       7       86.5%   
80.8%   93.3%   
XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785> [app-tools] 
Download crosswalk failed with http proxy
Total   75      63      5       7       90.6%   84%     92.6%

New Issues:
>       XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785> P1 
> [app-tools] Download crosswalk failed with http proxy
>       XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> P2 
> [app-tools]Fail to install the app which is built with release option
>       XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> P4 
> [app-tools]Should not build an arm app successfully when the libxwalkcore.so 
> for ARM is missing

CLI Details:
Command Line Interface  Case Id Passed  Failed  Blocked Comments
Create Project  test_no_sdk     1
Create Project  test_dir_exist  1
Create Project  test_main_activity      1
Create Project  test_normal     1
Create Project  test_pkgName_negative11 1
Create Project  test_pkgName_negative12 1
Create Project  test_pkgName_negative13 1
Create Project  test_pkgName_negative14 1
Create Project  test_pkgName_negative15 1
Create Project  test_pkgName_negative16 1
Create Project  test_pkgName_positive1  1
Create Project  test_pkgName_positive10 1
Create Project  test_pkgName_positive2  1
Create Project  test_pkgName_positive3  1
Create Project  test_pkgName_positive4  1
Create Project  test_pkgName_positive5  1
Create Project  test_pkgName_positive6  1
Create Project  test_pkgName_positive7  1
Create Project  test_pkgName_positive8  1
Create Project  test_pkgName_positive9  1
Build Project   test_build_missing_so_file              1               
XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> 
[app-tools]Should not build an arm app successfully when the libxwalkcore.so 
for ARM is missing
<https://crosswalk-project.org/jira/browse/XWALK-3779>
Build Project   test_build_normal       1
Build Project   test_build_release              1               
XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> 
[app-tools]Fail to install the app which is built with release option

Common Module Details:
Module  Total TCs       Passed  Failed  Blocked Pass%   Comments
Android SDK     3       3       0       0       100%
Android Targets 3       3       0       0       100%
Application     6       6       0       0       100%
Command Parser  6       6       0       0       100%
Finite Progress 1       1       0       0       100%
Infinite Progress       1       1       0       0       100%
Log File Output 5       5       0       0       100%
Output Tee      6       6       0       0       100%
Platform Base   2       2       0       0       100%
Template File   2       2       0       0       100%
Test Util       3       3       0       0       100%
Android Project Dependencies    5       3       1       1       60%     
XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785> [app-tools] 
Download crosswalk failed with http proxy
Downloader      4       0       1       3       0%      
XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785> [app-tools] 
Download crosswalk failed with http proxy
Main    5       1       1       3       20%     
XWALK-3785<https://crosswalk-project.org/jira/browse/XWALK-3785> [app-tools] 
Download crosswalk failed with http proxy


Verified Issues:
-----------------------
N/A

Crosswalk-app-tools Repositories:
-----------------------
*           https://github.com/crosswalk-project/crosswalk-app-tools
*          Release Tag or Commit ID: 339b1f370bc4e7f7975027fde312f99f9a5da814

Test Suite Repositories:
-----------------------
*          CLI:  
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests
*          Common module: 
https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test

Crosswalk Binary: 
https://download.01.org/crosswalk/releases/crosswalk/android/canary/13.42.320.0/crosswalk-13.42.320.0.zip
Detailed Test Report: 
http://wrt-qa-report.sh.intel.com/v2/Android/IA%20Canary/Crosswalk%20App%20Tools/8554

Test Environment:
-----------------------
   *         Test host:  Ivy Bridge Desktop installed with Ubuntu 12.04
   *         Test device: ASUS MeMo Pad 8(Android 4.4.2)

Thanks
Crosswalk QA

_______________________________________________
Crosswalk-dev mailing list
[email protected]
https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev

Reply via email to