Thanks, looks like we are good to branch Crosswalk 18 From: Crosswalk-dev <crosswalk-dev-boun...@lists.crosswalk-project.org<mailto:crosswalk-dev-boun...@lists.crosswalk-project.org>> on behalf of "Jiang, WenhaoX" <wenhaox.ji...@intel.com<mailto:wenhaox.ji...@intel.com>> Date: Thursday 4 February 2016 08:31 To: "<crosswalk-dev@lists. org>" <crosswalk-dev@lists.crosswalk-project.org<mailto:crosswalk-dev@lists.crosswalk-project.org>> Subject: [Crosswalk-dev] [Canary] Regression test report for Crosswalk Project (Cordova) for Android ARM 32bit 18.46.474.0
Quality Summary 18.46.474.0 ----------------------- QA complete the Regression Testing on both Embedded and Shared Cordova 4.x using Crosswalk Canary ARM 32bit 18.46.474.0. Crosswalk has been rebased on Chrome 48 although build version display .46. Glad to see that Cordova screenshot could be captured successfully (Fixed XWALK-2233<https://crosswalk-project.org/jira/browse/XWALK-2233>). The overall test results: Type Test Scope Total TCs Run Rate Pass Rate Pass Rate of Executed Diff W/ 18.46.471.0 Comment Embedded 4.x Cordova Features 125 100% 95% 95% -- Failed cases also fail on upstream Cordova APIs 605 97% 88% 91% -1% Pass rate downgrade due to case update and Failed cases also fail on upstream Cordova Use Cases 28 96% 89% 93% +7% Got improvement due to Cordova screenshot could be captured successfully (Fixed XWALK-2233<https://crosswalk-project.org/jira/browse/XWALK-2233>) Fail to disable the WebRTC API with command line '--disable-webrtc'(XWALK-4415<https://crosswalk-project.org/jira/browse/XWALK-4415>) Cordova In app browser plugin cannot share cookie with my main page(XWALK-2648<https://crosswalk-project.org/jira/browse/XWALK-2648>) Total 758 98% 89% 92% -1% Shared 4.x Cordova Features 125 100% 95% 95% -- Failed cases also fail on upstream Cordova APIs 605 97% 88% 91% -1% Pass rate downgrade due to case update and Failed cases also fail on upstream Cordova Use Cases 29 97% 90% 93% +7% Got improvement due to Cordova screenshot could be captured successfully (Fixed XWALK-2233<https://crosswalk-project.org/jira/browse/XWALK-2233>) Fail to disable the WebRTC API with command line '--disable-webrtc'(XWALK-4415<https://crosswalk-project.org/jira/browse/XWALK-4415>) Cordova In app browser plugin cannot share cookie with my main page(XWALK-2648<https://crosswalk-project.org/jira/browse/XWALK-2648>) Total 759 98% 89% 92% -1% Cordova Use Cases Testing Details Component Total TCs 18.46.474.0 Diff W/ 18.46.471.0 Comments Cordova Use Cases(embeded4.x) 28 □□□□□□□□89% +7% Got improvement due to Cordova screenshot could be captured successfully (Fixed XWALK-2233<https://crosswalk-project.org/jira/browse/XWALK-2233>) Fail to disable the WebRTC API with command line '--disable-webrtc'(XWALK-4415<https://crosswalk-project.org/jira/browse/XWALK-4415>) Cordova In app browser plugin cannot share cookie with my main page(XWALK-2648<https://crosswalk-project.org/jira/browse/XWALK-2648>) Cordova Use Cases(shared 4.x) 29 □□□□□□□□□90% +7% Got improvement due to Cordova screenshot could be captured successfully (Fixed XWALK-2233<https://crosswalk-project.org/jira/browse/XWALK-2233>) Fail to disable the WebRTC API with command line '--disable-webrtc'(XWALK-4415<https://crosswalk-project.org/jira/browse/XWALK-4415>) Cordova In app browser plugin cannot share cookie with my main page(XWALK-2648<https://crosswalk-project.org/jira/browse/XWALK-2648>) Cordova Features Testing Details Component Total TCs 18.46.474.0 Diff W/ 18.46.471.0 Comments Embedded 4.x Cordova Features/CIRC 7 □□□□□□□□□□100% -- Got good quality Cordova Features/Eh 6 □□□□□□□□□□100% -- Got good quality Cordova Features/privateNotes 10 □□□□□□□□□□100% -- Got good quality Cordova Features/spacedodge 10 □□□□□□□□□□100% -- Got good quality Cordova Features/AppSecurityApi 78 □□□□□□□□□92% -- Test result is the same as Upstream result Cordova Features/Mobile Spec 7 □□□□□□□□□□100% -- Got good quality Cordova Features/WebApp 7 □□□□□□□□□□100% -- Got good quality Shared 4.x Cordova Features/CIRC 7 □□□□□□□□□□100% -- Got good quality Cordova Features/Eh 6 □□□□□□□□□□100% -- Got good quality Cordova Features/privateNotes 10 □□□□□□□□□□100% -- Got good quality Cordova Features/spacedodge 10 □□□□□□□□□□100% -- Got good quality Cordova Features/AppSecurityApi 78 □□□□□□□□□92% -- Test result is the same as Upstream result Cordova Features/Mobile Spec 7 □□□□□□□□□□100% -- Got good quality Cordova Features/WebApp 7 □□□□□□□□□□100% -- Got good quality Cordova APIs Testing Details Component Cordova ARM 18.46.474.0 Comments Total TCs Embedded 4.x Diff W/Upstream Cordova 4.x on Android Diff W/ 18.46.471.0 Total TCs Shared 4.x Diff W/Upstream Cordova 4.x on Android Diff W/ 18.46.471.0 Plugin Tests (Automatic) Battery-status 11 □□□□□□□□□□100% -- -- 11 □□□□□□□□□□100% -- -- Camera 7 □□□□□□□□□□100% -- -- 7 □□□□□□□□□□100% -- -- console 2 □□□□□□□□□□100% -- -- 2 □□□□□□□□□□100% -- -- contacts 30 □□□□□□□□□□100% -- -- 30 □□□□□□□□□□100% -- -- device 11 □□□□□□□□□□100% -- -- 11 □□□□□□□□□□100% -- -- device-motion 12 □□□□□□□□□□100% -- -- 12 □□□□□□□□□□100% -- -- device-orientation 9 □□□□□□□□□□100% -- -- 9 □□□□□□□□□□100% -- -- dialogs 5 □□□□□□□□□□100% -- -- 5 □□□□□□□□□□100% -- -- file 150 □□□□□□□□□99% -- -- 150 □□□□□□□□□99% -- -- file-transfer 47 □□□□□□□□□94% -- -6% 47 □□□□□□□□□94% -- -6% Test result is the same as Upstream result geolocation 10 □□□□□□□□□□100% -- +50% 10 □□□□□□□□□□100% -- +50% Test result is the same as Upstream result globalization 46 □□□□□□□□□□100% -- -- 46 □□□□□□□□□□100% -- -- media-capture 12 □□□□□□□□□□100% -- -- 12 □□□□□□□□□□100% -- -- network-information 4 □□□□□□□□□□100% -- -- 4 □□□□□□□□□□100% -- -- statusbar 4 □□□□□□□□□□100% -- -- 4 □□□□□□□□□□100% -- -- vibration 2 □□□□□□□□□□100% -- -- 2 □□□□□□□□□□100% -- -- Plugin Tests (Manual) battery-status 6 □□□33% -- -- 6 □□□33% -- -- camera 14 □□□36% -- -- 14 □□□36% -- -- contacts 8 □□□□□□□□□□100% -- +33% 8 □□□□□□□□□□100% -- +33% Test result is the same as Upstream result device 1 □□□□□□□□□□100% -- -- 1 □□□□□□□□□□100% -- -- device-motion 3 □□□□□□□□□□100% -- -- 3 □□□□□□□□□□100% -- -- device-orientation 3 □□□□□□□□□□100% -- -- 3 □□□□□□□□□□100% -- -- dialogs 8 □□□□□□□□□□100% -- -- 8 □□□□□□□□□□100% -- -- file 7 □□□□□□□□□□100% -- -- 7 □□□□□□□□□□100% -- -- file-transfer 5 □□□□□□□□80% -- +20% 5 □□□□□□□□80% -- +20% Test result is the same as Upstream result geolocation 4 □□□□□□□75% -- -- 4 □□□□□□□75% -- -- inappbrowser 48 □□□□□□□□81% -- -- 48 □□□□□□□□81% -- -- media 11 0% -- -100% 11 0% -- -100% Test result is the same as Upstream result media-capture 4 □□□□□□□75% -- -- 4 □□□□□□□75% -- -- network-information 1 □□□□□□□□□□100% -- -- 1 □□□□□□□□□□100% -- -- splashscreen 2 □□□□□□□□□□100% -- -- 2 □□□□□□□□□□100% -- -- statusbar 6 □□□33% -- -- 6 □□□33% -- -- third-party 1 □□□□□□□□□□100% -- -- 1 □□□□□□□□□□100% -- -- vibration 12 □□□□□□□□□□100% -- -- 12 □□□□□□□□□□100% -- -- input 7 □14% -- -- 7 □14% -- -- Non-plugin Automatic Tests Bridge Tests 1 □□□□□□□□□□100% -- -- 1 □□□□□□□□□□100% -- -- Data URL Tests 2 □□□□□□□□□□100% -- -- 2 □□□□□□□□□□100% -- -- Local XHR Tests 9 □□□□□□□□□□100% -- -- 9 □□□□□□□□□□100% -- -- Platform Tests 2 □□□□□□□□□□100% -- -- 2 □□□□□□□□□□100% -- -- Storage Tests 19 □□□□□□□□□□100% -- -- 19 □□□□□□□□□□100% -- -- Battery 6 □□□33% -- -- 6 □□□33% -- -- Benchmarks 3 □□□□□□67% -- -- 3 □□□□□□67% -- -- Events 18 □□□□□□□78% -- -- 18 □□□□□□□78% -- -- Keyboard 9 0% -- -- 9 0% -- -- Lazy Loading of cordova-incl.js 1 □□□□□□□□□□100% -- -- 1 □□□□□□□□□□100% -- -- Misc Content 14 □□□□□□□79% -- -- 14 □□□□□□□79% -- -- Web SQL 7 □□□□□□□□□□100% -- -- 7 □□□□□□□□□□100% -- -- Local Storage 1 □□□□□□□□□□100% -- -- 1 □□□□□□□□□□100% -- -- New Issue: N/A Highlight Open Issue: N/A Verified Issue: XWALK-2233<https://crosswalk-project.org/jira/browse/XWALK-2233> P2 Cordova Screenshot plugin always capture BLACK screenshot of xwalkView Crosswalk Cordova ARM Image: https://download.01.org/crosswalk/releases/crosswalk/android/canary/18.46.474.0/arm/crosswalk-cordova-18.46.474.0-arm.zip <https://download.01.org/crosswalk/releases/crosswalk/android/canary/18.46.474.0/arm/crosswalk-cordova-18.46.474.0-arm.zip%20> Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Referenced Upstream Cordova: http://cordova.apache.org/ Test Environment ----------------------- l Crosswalk Android 4.4: o ARM32bit phone: Google Nexus 5 Thanks Crosswalk QA --------------------------------------------------------------------- Intel Finland Oy Registered Address: PL 281, 00181 Helsinki Business Identity Code: 0357606 - 4 Domiciled in Helsinki This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. _______________________________________________ Crosswalk-dev mailing list Crosswalk-dev@lists.crosswalk-project.org https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
