Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID f0081c36abb9c86301b5174edeedc797b4bc8414. Glad to see that it has a parameter check before building project (fixed APPTOOLS-162<https://crosswalk-project.org/jira/browse/APPTOOLS-162>), project can be built when -c <crosswalk_path> point to unzipped folder (fixed APPTOOLS-339<https://crosswalk-project.org/jira/browse/APPTOOLS-339>). However, one REGRESSION issue found: Duplicate .pak files exist in msi package (APPTOOLS-342<https://crosswalk-project.org/jira/browse/APPTOOLS-342>). The overall test results:
New Issues: ----------------------- APPTOOLS-342<https://crosswalk-project.org/jira/browse/APPTOOLS-342> P1 [Apptools][REG] Duplicate .pak files exist in msi package. Verified Issues: ----------------------- APPTOOLS-339<https://crosswalk-project.org/jira/browse/APPTOOLS-339> P2 Fail to package locales dir when -c <crosswalk_path> point to unzipped folder APPTOOLS-162<https://crosswalk-project.org/jira/browse/APPTOOLS-162> P3 [Apptools] crosswalk-pkg/crosswalk-app ignored invalid paremeter if paremeter's name is invalid. Test Scope Windows 8.1 Windows 10 OS X Deepin Android Usecase Test Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools & Manifest Android 32-bit Tests (Embedded) N/A N/A N/A 283 99% -- 283 99% -- N/A N/A N/A 39 97% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296> App Tools & Manifest Android 32-bit Tests (Shared) N/A N/A N/A 283 99% -- 283 99% -- N/A N/A N/A 39 97% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296> App Tools & Manifest Android 64-bit Tests (Embedded) N/A N/A N/A 283 99% -- 283 99% -- N/A N/A N/A 39 97% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296> App Tools & Manifest Android 64-bit Tests (Shared) N/A N/A N/A 283 99% 283 99% -- N/A N/A N/A 39 97% -- Bugs Exist: APPTOOLS-113<https://crosswalk-project.org/jira/browse/APPTOOLS-113>, APPTOOLS-146<https://crosswalk-project.org/jira/browse/APPTOOLS-146>, APPTOOLS-296<https://crosswalk-project.org/jira/browse/APPTOOLS-296> App Tools SampleApp Tests N/A N/A N/A 10 100% -- 10 100% -- 2 100% -- N/A N/A N/A App Tools UseCase Tests (windows/ios/deepin) N/A N/A N/A 23 96% -- 8 63% -- 7 71% -- N/A N/A N/A Bugs exist: APPTOOLS-2<https://crosswalk-project.org/jira/browse/APPTOOLS-2>, APPTOOLS-178<https://crosswalk-project.org/jira/browse/APPTOOLS-178>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-4<https://crosswalk-project.org/jira/browse/APPTOOLS-4>, APPTOOLS-170<https://crosswalk-project.org/jira/browse/APPTOOLS-170>, XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529> App Tools & Manifest Windows Tests 151 93% -- 151 93% -- N/A N/A N/A N/A N/A N/A N/A N/A N/A Bugs exist: APPTOOLS-59<https://crosswalk-project.org/jira/browse/APPTOOLS-59>, APPTOOLS-62<https://crosswalk-project.org/jira/browse/APPTOOLS-62>, APPTOOLS-53<https://crosswalk-project.org/jira/browse/APPTOOLS-53>, APPTOOLS-338<https://crosswalk-project.org/jira/browse/APPTOOLS-338> Total 151 93% -- 1316 96% -- 1150 98% -- 9 78% -- 156 97% -- (*) instead of the previous test commit id: 7a4be8641ee33911a700601c11452dca4dc6fefb Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: f0081c36abb9c86301b5174edeedc797b4bc8414 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/19.49.514.2/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/beta/19.49.514.2/ Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, Xiaomi Pad 2,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.11 with XCode 7.3 iOS device: iPad mini 9.3 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
