Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID 1ecfe808a3f7124d5998633336a47cd01fff7565. Glad to see that project could be built with "--targets=invalid" for Android platform (Fixed XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375>), crosswalk-app-tools now can support the third app permission in AndroidManifest.xml (Fixed XWALK-6214<https://crosswalk-project.org/jira/browse/XWALK-6214>), crosswalk-pkg help wording now clearly (Fixed XWALK-6469<https://crosswalk-project.org/jira/browse/XWALK-6469>), Shared apk is generated while building 64bit shared apk with "--targets=x86_64" (Fixed XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>), Setting "xwalk_target_platforms" to "windows" in manifest.json now can built project on Windows platform (Fixed XWALK-6398<https://crosswalk-project.org/jira/browse/XWALK-6398>), "Elements" subpage display content when debugging app on Windows platform (Fixed XWALK-6332 <https://crosswalk-project.org/jira/browse/XWALK-6332> ), Application is able to launch after building with crosswalk-pkg for windows platform (Fixed XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346>). However, four new issues found: Fail to build project after putting 2 same files under echo_extension and echo_extension_bridge when building Crosswalk Extensions for Windows platform (XWALK-6455<https://crosswalk-project.org/jira/browse/XWALK-6455>), "Building packages armeabi-v7a,x86" displays in cmd logs when building project for windows platform (XWALK-6524<https://crosswalk-project.org/jira/browse/XWALK-6524>), Fail to build project with multiple backends when set --crosswalk=version (XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527>), Fullscreen is not working after built by Apptools on 2015 deepin 64bit OS (XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529>). The overall test results:
New Issues: ----------------------- XWALK-6455<https://crosswalk-project.org/jira/browse/XWALK-6455> P2 [Apptools] Fail to build project after putting 2 same files under echo_extension and echo_extension_bridge when building Crosswalk Extensions for Windows platform. XWALK-6524<https://crosswalk-project.org/jira/browse/XWALK-6524> P2 [Apptools]"Building packages armeabi-v7a,x86" displays in cmd logs when building project for windows platform. XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527> P2 [Apptools] Fail to build project with multiple backends when set --crosswalk=version. XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529> P2 [Deepin] Fullscreen is not working after built by Apptools on 2015 deepin 64bit OS. Verified Issues: ----------------------- XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> P1 [Apptools][REG] Fail to build project with "--targets=invalid" for Android platform. XWALK-6214<https://crosswalk-project.org/jira/browse/XWALK-6214> P1 crosswalk-app-tools does not support the third app permission in AndroidManifest.xml XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213> P1 [Apptools] Embedded apk is generated while building 64bit shared apk with "--targets=x86_64". XWALK-6398<https://crosswalk-project.org/jira/browse/XWALK-6398> P1 [app-tools] Setting "xwalk_target_platforms" to "windows" in manifest.json has no effect XWALK-6332 <https://crosswalk-project.org/jira/browse/XWALK-6332> P1 [REG] "Elements" subpage is blank when debugging app on Windows platform. XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346> P2 [Apptools] Application is unable to launch after building with crosswalk-pkg for windows platform. XWALK-6469<https://crosswalk-project.org/jira/browse/XWALK-6469> P2 crosswalk-pkg help wording a bit ambiguous Test Scope Windows 8.1 Windows 10 OS X Deepin Android Usecase Test Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android 32-bit Tests(Embedded) N/A N/A N/A 272 95% -2% 272 95% -2% N/A N/A N/A 38 97% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5598<https://crosswalk-project.org/jira/browse/XWALK-5598>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> Passrate downgrade due to case number increased. XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> is fixed. App Tools Android 32-bit Tests(Shared) N/A N/A N/A 272 95% +8% 272 95% +8% N/A N/A N/A 38 97% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5598<https://crosswalk-project.org/jira/browse/XWALK-5598>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> Got improvement due to XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> fixed. App Tools Android 64-bit Tests(Embedded) N/A N/A N/A 272 95% -2% 272 95% -2% N/A N/A N/A 38 97% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5598<https://crosswalk-project.org/jira/browse/XWALK-5598>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> Passrate downgrade due to case number increased. XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> is fixed. App Tools Android 64-bit Tests (Shared) N/A N/A N/A 272 95% +8% 272 95% +8% N/A N/A N/A 38 97% -- Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-5598<https://crosswalk-project.org/jira/browse/XWALK-5598>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> Got improvement due to XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> fixed. App Tools SampleApp Tests N/A N/A N/A 10 100% -- 10 80% -- 2 100% -- N/A N/A N/A Bugs exist: XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> App Tools UseCase Tests (windows/ios/deepin) N/A N/A N/A 13 85% +17% 7 0% -- 7 71% -29% N/A N/A N/A Bugs exist: XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224>, XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529> Got improvement on Windows due to XWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>,XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346> fixed. Passrate downgrade on Deepin due to XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529>. App Tools Tests 139 80% -3% 139 80% -3% N/A N/A N/A N/A N/A N/A N/A N/A N/A Bugs exist: XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527>. Passrate downgrade due to case number increased. Total 139 80% -3% 1250 93% +11% 1105 94% +2% 9 78% -22% 152 97% -- Got improvement on Windows/IOS due toXWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>,XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> fixed. Passrate downgrade on Deepin due to XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529>. (*) instead of the previous test commit id: b9238db542988e1a52ae63781c6426abc9dddcaa New Issues: ----------------------- XWALK-6455<https://crosswalk-project.org/jira/browse/XWALK-6455> P2 [Apptools] Fail to build project after putting 2 same files under echo_extension and echo_extension_bridge when building Crosswalk Extensions for Windows platform. XWALK-6524<https://crosswalk-project.org/jira/browse/XWALK-6524> P2 [Apptools]"Building packages armeabi-v7a,x86" displays in cmd logs when building project for windows platform. XWALK-6527<https://crosswalk-project.org/jira/browse/XWALK-6527> P2 [Apptools] Fail to build project with multiple backends when set --crosswalk=version. XWALK-6529<https://crosswalk-project.org/jira/browse/XWALK-6529> P2 [Deepin] Fullscreen is not working after built by Apptools on 2015 deepin 64bit OS. Verified Issues: ----------------------- XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> P1 [Apptools][REG] Fail to build project with "--targets=invalid" for Android platform. XWALK-6214<https://crosswalk-project.org/jira/browse/XWALK-6214> P1 crosswalk-app-tools does not support the third app permission in AndroidManifest.xml XWALK-6469<https://crosswalk-project.org/jira/browse/XWALK-6469> P2 crosswalk-pkg help wording a bit ambiguous XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213> P1 [Apptools] Embedded apk is generated while building 64bit shared apk with "--targets=x86_64". XWALK-6398<https://crosswalk-project.org/jira/browse/XWALK-6398> P1 [app-tools] Setting "xwalk_target_platforms" to "windows" in manifest.json has no effect XWALK-6332 <https://crosswalk-project.org/jira/browse/XWALK-6332> P1 [REG] "Elements" subpage is blank when debugging app on Windows platform. XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346> P2 [Apptools] Application is unable to launch after building with crosswalk-pkg for windows platform. Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: 1ecfe808a3f7124d5998633336a47cd01fff7565 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/18.48.477.7/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/19.48.495.0/ [no beta builds for Windows] Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, ECS2-8A ,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
