Quality Summary
-------------------------------------------
QA complete Crosswalk App Tools Testing based on Commit ID 
9481b56274b0dbde8741802c00982d9dbbcacf95. Glad to see that crosswalk-lite apk 
can be built and installed on android devices (fixed 
APPTOOLS-341<https://crosswalk-project.org/jira/browse/APPTOOLS-341>), the .pak 
files now only exist in locals folder in msi package (fixed 
APPTOOLS-342<https://crosswalk-project.org/jira/browse/APPTOOLS-342>),  project 
can be built when there is a "VERSION" file in the crosswalk application 
project directory (fixed 
APPTOOLS-43<https://crosswalk-project.org/jira/browse/APPTOOLS-43>), host check 
has skipped after adding -s /--skip-check parameter (fixed 
APPTOOLS-303<https://crosswalk-project.org/jira/browse/APPTOOLS-303>) .No new 
issue found this time. The overall test results:

New Issues:
-----------------------
None

Verified Issues:
-----------------------
APPTOOLS-342<https://crosswalk-project.org/jira/browse/APPTOOLS-342> P1 
[Apptools][REG] Duplicate .pak files exist in msi package.
APPTOOLS-341<https://crosswalk-project.org/jira/browse/APPTOOLS-341> P2 All 
ABIs are packaged for crosswalk-lite
APPTOOLS-43<https://crosswalk-project.org/jira/browse/APPTOOLS-43>   P2 Failed 
to build msi when there is a "VERSION" file in the crosswalk application 
project directory
APPTOOLS-303<https://crosswalk-project.org/jira/browse/APPTOOLS-303> P2 Option 
to skip host check

Test Scope

Windows 8.1

Windows 10

OS X

Deepin

Android Usecase Test

Comment

Total TCs

Pass Rate

Diff W/last commit ID(*)

Total TCs

Pass Rate

Diff W/last commit ID(*)

Total TCs

Pass Rate

Diff W/last commit ID(*)

Total TCs

Pass Rate

Diff W/last commit ID(*)

Total TCs

Pass Rate

Diff W/last commit ID(*)

App Tools & Manifest Android 32-bit Tests (Embedded)

N/A

N/A

N/A

283

99%

--

283

99%

--

N/A

N/A

N/A

39

97%

--

Bugs Exist: 
APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, 
APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>,   
APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>


App Tools & Manifest Android 32-bit Tests (Shared)

N/A

N/A

N/A

283

99%

--

283

99%

--

N/A

N/A

N/A

39

97%

--

Bugs Exist: 
APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, 
APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>,   
APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>


App Tools & Manifest Android 64-bit Tests (Embedded)

N/A

N/A

N/A

283

99%

--

283

99%

--

N/A

N/A

N/A

39

97%

--

Bugs Exist: 
APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, 
APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>,   
APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>


App Tools & Manifest Android 64-bit Tests (Shared)

N/A

N/A

N/A

283

99%



283

99%

--

N/A

N/A

N/A

39

97%

--

Bugs Exist: 
APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, 
APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>,   
APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296>


App Tools SampleApp Tests

N/A

N/A

N/A

10

100%

--

10

100%

--

2

100%

--

N/A

N/A

N/A

App Tools UseCase Tests
(windows/ios/deepin)

N/A

N/A

N/A

23

96%

--

8

63%

--

7

71%

--

N/A

N/A

N/A

Bugs exist: APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, 
APPTOOLS-178<https://crosswalk-project.org/jira/browse/APPTOOLS-178>, 
APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, 
APPTOOLS-4<https://crosswalk-project.org/jira/browse/APPTOOLS-4>, 
APPTOOLS-170<https://crosswalk-project.org/jira/browse/APPTOOLS-170>, 
XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529>



App Tools & Manifest Windows Tests

152

93%

--

152

93%

--

N/A

N/A

N/A

N/A

N/A

N/A

N/A

N/A

N/A

Bugs exist: APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, 
APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, 
APPTOOLS-53<https://crosswalk-project.org/jira/browse/APPTOOLS-53>, 
APPTOOLS-338<https://crosswalk-project.org/jira/browse/APPTOOLS-338>


Total

152

93%

--

1317

98%

--

1150

99%

--

9

78%

--

156

97%

--

(*) instead of the previous test commit id: 
f0081c36abb9c86301b5174edeedc797b4bc8414

Crosswalk-app-tools Repositories:
-----------------------
https://github.com/crosswalk-project/crosswalk-app-tools
Release Tag or Commit ID: 9481b56274b0dbde8741802c00982d9dbbcacf95
Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb
Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767
iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios
Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215

Test Suite Repositories:
-----------------------
Command-line Interface: 
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests
https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests
https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/
Common module: 
https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test
Crosswalk Binary on Android: 
https://download.01.org/crosswalk/releases/crosswalk/android/beta/20.50.533.1/
Crosswalk Binary on Windows: 
https://download.01.org/crosswalk/releases/crosswalk/windows/beta/20.50.533.1/
Test Environment:
-----------------------
Android host:  Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10
Android device: ASUS Memo Pad 8, Xiaomi Pad 2,Nexus 5, Nexus 9
iOS host: MacBook Pro 10.11 with XCode 7.3
iOS device: iPad mini 9.3
iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios
Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese
Linux/Deepin backend: 
https://github.com/crosswalk-project/crosswalk-app-tools-deb


Thanks,
Crosswalk QA team
_______________________________________________
Crosswalk-dev mailing list
[email protected]
https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev

Reply via email to