Quality Summary
-------------------------------------------
QA complete Crosswalk App Tools Testing based on Commit ID 
aa10bfc4042c256f3b3e3c8e483e3ca62cda7012 . Glad to see that user is able to 
build project with directory (Fixed 
XWALK-5564<https://crosswalk-project.org/jira/browse/XWALK-5564>), able to 
update command(Fixed 
XWALK-5596<https://crosswalk-project.org/jira/browse/XWALK-5596>). However, 
file two issues: Fail to build project with crosswalk version for windows 
platforms(XWALK-5720<https://crosswalk-project.org/jira/browse/XWALK-5720>);display
 incomplete path in 
log(XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>). The 
overall test results:

Test Scope

Windows 8

OS X

Deepin

Comment

Total TCs

Pass Rate

Diff W/last commit ID(*)

Total TCs

Pass Rate

Diff W/last commit ID(*)

Total TCs

Pass Rate

Diff W/last commit ID(*)


apptools-android-tests(Embedded)

197

94%

+1%

197

94%

+1%

N/A

N/A

N/A

Bugs on Windows/iOS: 
XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, 
XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, 
XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, 
XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>,
iOS and Windows pass rate got improvement due to 
XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> has been fixed.

apptools-android-tests(Shared)

197

94%

+1%

197

94%

+1%







Bugs on Windows/iOS: 
XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, 
XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, 
XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,, 
XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>,
iOS and Windows pass rate got improvement due to 
XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> has been fixed.

apptools-sampleapp-tests

6

100%

--

6

100%

--

2

100%

--

Got good quality

apptools-usecase-tests

5

100%

--

6

100%

--

1

100%

--

Got good quality

apptools-windows-tests

105

95%

-1%

N/A

N/A

N/A

N/A

N/A

N/A

Bugs on Windows: 
XWALK-5262<https://crosswalk-project.org/jira/browse/XWALK-5262>,XWALK-4916<https://crosswalk-project.org/jira/browse/XWALK-4916>,
Windows pass rate got improvement due to 
XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, 
XWALK-5720<https://crosswalk-project.org/jira/browse/XWALK-5720>

Total

510

94%

+4%

406

94%

+1%

3

100%

--


(*) instead of the previous test commit id: 
fdcc8a1b5d9efb45f12b617d70c52e4b44a3f9e9

New Issues:
-----------------------
XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> P2 [app-tools] 
Better to display full path in the log for using -k/--keep
XWALK-5720<https://crosswalk-project.org/jira/browse/XWALK-5720> P2 
[app-tools]Fail to build project with crosswalk version for windows platforms

Verified Issues:
-----------------------
XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> Should not 
build an arm app successfully when the libxwalkcore.so for ARM is missing
XWALK-5564<https://crosswalk-project.org/jira/browse/XWALK-5564> [app-tools] 
Fail to build project with crosswalk directory for windows platforms
XWALK-5596<https://crosswalk-project.org/jira/browse/XWALK-5596> 
[app-tools]update command does not work on windows platforms

Crosswalk-app-tools Repositories:
-----------------------
https://github.com/crosswalk-project/crosswalk-app-tools
Release Tag or Commit ID: fdcc8a1b5d9efb45f12b617d70c52e4b44a3f9e9
Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb
Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767
iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios
Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215

Test Suite Repositories:
-----------------------
Command-line Interface: 
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests
https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/
Common module: 
https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test
Crosswalk Binary on Android: 
https://download.01.org/crosswalk/releases/crosswalk/android/beta/16.45.421.3/
Crosswalk Binary on Windows: 
https://download.01.org/crosswalk/releases/crosswalk/windows/canary/17.45.421.0/

Test Environment:
-----------------------
Android host:  Ivy Bridge Desktop, Ubuntu 14, Windows 8
Android device: Memopad 8, Nexus 4
iOS host: MacBook Pro 10.10 with XCode 7.1
iOS device: iPad mini 8.2
iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios
Linux/Deepin desktop: Deepin 2014.2 
(http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese
Linux/Deepin backend: 
https://github.com/crosswalk-project/crosswalk-app-tools-deb


Thanks,
Crosswalk QA team
_______________________________________________
Crosswalk-dev mailing list
[email protected]
https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev

Reply via email to