Quality Summary ------------------------------------------- QA complete Crosswalk App Tools Testing based on Commit ID b9238db542988e1a52ae63781c6426abc9dddcaa. Two new regression issues found: "Elements" subpage is blank when debugging app on Windows platform (REG XWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332>), Fail to build project with "--targets=invalid" for Android platform (REG XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375>). Besides, two new issues found: Window.location is unable to return URI starts with "app://" but "file://" when building package with app-tools (XWALK-6367<https://crosswalk-project.org/jira/browse/XWALK-6367>). Application is unable to launch after building with crosswalk-pkg for windows platform (XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346>). The overall test results:
Test Scope Windows 8.1 Windows 10 OS X Deepin Comment Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) Total TCs Pass Rate Diff W/last commit ID(*) App Tools Android 32-bit Tests(Embedded) N/A N/A N/A 252 97% -1% 252 97% -1% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> Passrate downgrade due to XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> App Tools Android 32-bit Tests(Shared) N/A N/A N/A 252 87% -1% 252 87% -1% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> Passrate downgrade due to XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> App Tools Android 64-bit Tests(Embedded) N/A N/A N/A 252 97% -1% 252 97% -1% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> Passrate downgrade due to XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> App Tools Android 64-bit Tests (Shared) N/A N/A N/A 252 87% -1% 252 87% -1% N/A N/A N/A Bugs Exist:XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056>, XWALK-5254<https://crosswalk-project.org/jira/browse/XWALK-5254>,XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> Passrate downgrade due to XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> App Tools SampleApp Tests N/A N/A N/A 10 100% -- 10 80% -- 2 100% -- Bugs exist: XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224> App Tools UseCase Tests N/A N/A N/A 19 68% -23% 18 72% -8% 1 100% -- Bugs exist: XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012>, XWALK-6224<https://crosswalk-project.org/jira/browse/XWALK-6224>, XWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332>, XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346>, XWALK-6018<https://crosswalk-project.org/jira/browse/XWALK-6018>, XWALK-6020<https://crosswalk-project.org/jira/browse/XWALK-6020>, XWALK-6213<https://crosswalk-project.org/jira/browse/XWALK-6213> Passrate downgrade on Windows due to XWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332>, XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346> Passrate downgrade on IOS due to case number increased. App Tools Tests 127 83% -- 127 83% -- N/A N/A N/A N/A N/A N/A Bugs exist: XWALK-5661<https://crosswalk-project.org/jira/browse/XWALK-5661>, XWALK-6012<https://crosswalk-project.org/jira/browse/XWALK-6012> Total 127 83% -- 1164 82% -10% 1036 92% -1% 3 100% -- Passrate downgrade due to XWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332>, XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346>, XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> (*) instead of the previous test commit id: 050249b7ead1cd69595b99e26de7f12dbab4c61e New Issues: ----------------------- XWALK-6332<https://crosswalk-project.org/jira/browse/XWALK-6332> P1 [Apptools][REG] "Elements" subpage is blank when debugging app on Windows platform. XWALK-6375<https://crosswalk-project.org/jira/browse/XWALK-6375> P1 [Apptools][REG] Fail to build project with "--targets=invalid" for Android platform. XWALK-6367<https://crosswalk-project.org/jira/browse/XWALK-6367> P2 [app-tools] window.location is unable to return URI starts with "app://" but "file://" when building package with app-tools XWALK-6346<https://crosswalk-project.org/jira/browse/XWALK-6346> P2 [Apptools] Application is unable to launch after building with crosswalk-pkg for windows platform. Verified Issues: ----------------------- None Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: b9238db542988e1a52ae63781c6426abc9dddcaa Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: c5212e631dc37807be394dd2c86fa0dad9c42767 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: abd046da6a127142b01a87e2343f52f0c79bd215 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-linux-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-sampleapp-tests https://github.com/crosswalk-project/crosswalk-test-suite/blob/master/usecase/usecase-apptools-tests/ Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/beta/18.48.477.5/ Crosswalk Binary on Windows: https://download.01.org/crosswalk/releases/crosswalk/windows/canary/18.48.475.0/ [no beta builds for Windows] Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14, Windows 8.1,Windows10 Android device: ASUS Memo Pad 8, ECS2-8A ,Nexus 5, Nexus 9 iOS host: MacBook Pro 10.10 with XCode 7.1 iOS device: iPad mini 8.2 iOS backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Linux/Deepin desktop: Deepin 2015 x86_64 with Chinese Linux/Deepin backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
