Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID cf1a2d70385d50f1abf387a6e7ad1ade15748239. Glad to see that the third app permission in AndroidManifest.xml has added to crosswalk-app-tools (Fixed XWALK-6214<https://crosswalk-project.org/jira/browse/XWALK-6214>), windows crosswalk now can be downloaded when building apps (Fixed XWALK-6567<https://crosswalk-project.org/jira/browse/XWALK-6567>). The overall test results:
New Issues: ----------------------- None. Verified Issues: ----------------------- XWALK-6214<https://crosswalk-project.org/jira/browse/XWALK-6214> P1 crosswalk-app-tools does not support the third app permission in AndroidManifest.xml XWALK-6567<https://crosswalk-project.org/jira/browse/XWALK-6567> P1 [app tools] Building WIndows apps fails because of changes in the Crosswalk archive name Test Scope Windows 8.1 Windows 10 OS X Deepin Android Usecase Test Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android 32-bit Tests(Embedded) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> App Tools Android 32-bit Tests(Shared) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> App Tools Android 64-bit Tests(Embedded) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> App Tools Android 64-bit Tests (Shared) N/A N/A N/A 273 95% -- 273 95% -- N/A N/A N/A 39 92% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> App Tools SampleApp Tests N/A N/A N/A 10 100% -- 8 100% -- 2 100% -- N/A N/A N/A App Tools UseCase Tests (windows/ios/deepin) N/A N/A N/A 23 96% +11% N/A N/A -- 7 71% -- N/A N/A N/A Bugs exist: XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529> Got improvement on Windows due to case number increased. App Tools Tests 143 83% +3% 143 83% +3% N/A N/A N/A N/A N/A N/A N/A N/A N/A Bugs exist: XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527>. Got improvement due to case number increased. Total 143 83% +3% 1268 94% +1% 1100 95% +1% 9 78% -- 156 92% -- Got improvement due to case number increased. (*) instead of the previous test commit id: 1ecfe808a3f7124d5998633336a47cd01fff7565 Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: cf1a2d70385d50f1abf387a6e7ad1ade15748239 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/18.48.477.8/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/19.48.502.0/ [no beta builds for Windows] Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, ECS2-8A ,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
