Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID 050249b7ead1cd69595b99e26de7f12dbab4c61e. Glad to see that only x86 apk built using crosswalk-pkg with "--targets=x86"(Fixed XWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016>), .deb project can be built successfully(Fixed XWALK-6064<https://crosswalk-project.org/jira/browse/XWALK-6064>). However, two new issues found: Embedded apk is generated while building 64bit shared apk with "--targets=x86_64"(XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>), IPA app built by apptools is unable to be installed on IOS devices(XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224>).The overall test results:
Test Scope Windows 8.1 Windows 10 OS X Deepin Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android 32-bit Tests(Embedded) N/A N/A N/A 251 98% +5% 251 98% +5% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> Got improved due to XWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016> is fixed. App Tools Android 32-bit Tests(Shared) N/A N/A N/A 251 88% -5% 251 88% -5% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213> Bug XWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016> is fixed. Passrate downgrade due to new issue XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>. App Tools Android 64-bit Tests(Embedded) N/A N/A N/A 251 98% +5% 251 98 +5% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661> Got improved due to XWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016> is fixed. App Tools Android 64-bit Tests (Shared) N/A N/A N/A 251 88% -5% 251 88% -5% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213> Bug XWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016> is fixed. Passrate downgrade due to new issue XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>. App Tools SampleApp Tests N/A N/A N/A 10 100% -- 10 80% -20% 2 100% +100% Bugs on IOS: XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> Passrate downgrade on IOS due to new issue XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> Got improved on deepin due to XWALK-6064<https://crosswalk-project.org/jira/browse/XWALK-6064> is fixed. App Tools UseCase Tests N/A N/A N/A 11 91% -- 10 80% -20% 1 100% +100% Bugs exist: XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> Passrate downgrade on IOS due to XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> Got improved on deepin due to XWALK-6064<https://crosswalk-project.org/jira/browse/XWALK-6064> is fixed. App Tools Tests 127 81% -- 127 81% -- N/A N/A N/A N/A N/A N/A Bugs on Windows:XWALK-4916<https://crosswalk-project.org/jira/browse/XWALK-4916>, XWALK-4835<https://crosswalk-project.org/jira/browse/XWALK-4835>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> Total 127 81% -- 1152 92% +2% 1024 93% +2% 3 100% +100% Got improved due toXWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016>, XWALK-6064<https://crosswalk-project.org/jira/browse/XWALK-6064> fixed. (*) instead of the previous test commit id: f356ec0538ca2452bfb7207907604c662e0cc261 New Issues: ----------------------- XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213> P1 [Apptools] Embedded apk is generated while building 64bit shared apk with "--targets=x86_64". XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> P2 IPA app built by apptools is unable to be installed on IOS devices. Verified Issues: ----------------------- XWALK-6016<https://crosswalk-project.org/jira/browse/XWALK-6016> P1 [App-tools][REG] Build both x86 and arm apk using crosswalk-pkg with "--targets=x86" XWALK-6064<https://crosswalk-project.org/jira/browse/XWALK-6064> P1 [Apptools][REG] Fail to build .deb project on Deepin 64bit OS. Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools/commits/0.9 Release Tag or Commit ID: 050249b7ead1cd69595b99e26de7f12dbab4c61e Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/17.46.448.6 Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/18.46.468.0 [no beta builds for Windows] Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, ECS2-8A ,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
