Quality Summary 15.44.370.0-1 --------------------------------------- QA conclusion: QA suggest fixing Ubuntu specific bug: fail to launch test apps unless installing ‘realpath’ manually (XWALK-4537<https://crosswalk-project.org/jira/browse/XWALK-4537>) before promoting to release.
QA complete the full testing on Crosswalk_15.44.370.0-1_amd64.deb for Ubuntu and Deepin. Found one Ubuntu specific bug (XWALK-4537<https://crosswalk-project.org/jira/browse/XWALK-4537>), good to see that the most tests got PASS on both Ubuntu and Deepin. Filed 3 new issues: deepin specific notification issue: (XWALK-4541<https://crosswalk-project.org/jira/browse/XWALK-4541>), no response after clicking button(XWALK-4532<https://crosswalk-project.org/jira/browse/XWALK-4532>, XWALK-4533<https://crosswalk-project.org/jira/browse/XWALK-4533>) The overall test results: Test Scope Total TCs Run rate Pass Rate Pass Rate of Executed Diff W/ 15.43.360.0-1 Deepin Diff W/ Ubuntu Comments Use Cases 28 100% 71% 71% -8% -4% Some issues exist: fail to get the indexdb/localstorage after upgrading app version (XWALK-3820<https://crosswalk-project.org/jira/browse/XWALK-3820>/XWALK-3946<https://crosswalk-project.org/jira/browse/XWALK-3946>). Pass rate downgrade due to two new bugs found: fait to get ExternalURL/ Webnotification after downgrading Deepin app version(XWALK-4533<https://crosswalk-project.org/jira/browse/XWALK-4533>/XWALK-4541<https://crosswalk-project.org/jira/browse/XWALK-4541>). XWALK-4541<https://crosswalk-project.org/jira/browse/XWALK-4541> only happened on Deepin. Web Apps 107 96% 65% 68% -- -21% One new bug found: No response when clicking “Exit” button on Youdao note app (XWALK-4532<https://crosswalk-project.org/jira/browse/XWALK-4532>). Some tests are still buggy: Lack of UI entrance (XWALK-3658<https://crosswalk-project.org/jira/browse/XWALK-3658>). Deepin Specific issue： XWALK-3658<https://crosswalk-project.org/jira/browse/XWALK-3658> WRT 12 100% 100% 100% -- -- Good quality. Web APIs 747 95% 81% 86% +1% -- Some issues exist (XWALK-1831<https://crosswalk-project.org/jira/browse/XWALK-1831>), (XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906>) Total 894 95% 79% 83% -- -3% New Issues: - XWALK-4537<https://crosswalk-project.org/jira/browse/XWALK-4537> P1 Fail to launch test apps unless installs ‘realpath’ manually. - XWALK-4532<https://crosswalk-project.org/jira/browse/XWALK-4532> P2 No response when clicking “Exit” button on Youdao note app. - XWALK-4533<https://crosswalk-project.org/jira/browse/XWALK-4533> P2 No response when clicking “Back” button on ExternalURL app. - XWALK-4541<https://crosswalk-project.org/jira/browse/XWALK-4541> P2 Display “Notification has been closed “when clicking anywhere of the prompt box on Webnotification app. Crosswalk Use Cases Testing Details Component Linux 15.44.370.0-1 Deepin 15.44.370.0-1 Comments Total TCs 15.44.370.0-1 (Deepin) Diff W/ Ubuntu Diff W/ 15.43.360.0-1 Package Management 12 □□□□□50% -- -- XWALK-3820<https://crosswalk-project.org/jira/browse/XWALK-3820> [usecase]indexDB Upgrade - Cannot read property 'value' of undefined. XWALK-3946<https://crosswalk-project.org/jira/browse/XWALK-3946> Fail to get localstorage after upgrading test app version. Runtime 16 □□□□□□□□88% -6% -12% Pass rate downgrade due to two new bugs found: XWALK-4533<https://crosswalk-project.org/jira/browse/XWALK-4533> No response when clicking “Back” button on ExternalURL app. XWALK-4541<https://crosswalk-project.org/jira/browse/XWALK-4541> Display “Notification has been closed “when clicking anywhere of the prompt box on Webnotification app. Crosswalk Web Apps Testing Details Component Linux 15.44.370.0-1 Deepin 15.44.370.0-1 Comments Total TCs 15.44.370.0-1 (Deepin) Deepin Diff W/ Ubuntu Diff W/ 15.43.360.0-1 Hosted Website Apps 92 □□□□□□63% -24% -- XWALK-3658<https://crosswalk-project.org/jira/browse/XWALK-3658> Lack of UI entrance when installed Crosswalk .deb app. XWALK-3670<https://crosswalk-project.org/jira/browse/XWALK-3670> Display nothing after launching deepin-webapps-cargo-bridge. XWALK-3695<https://crosswalk-project.org/jira/browse/XWALK-3695> [Runtime] Download manager (file selector). XWALK-3791<https://crosswalk-project.org/jira/browse/XWALK-3791> Display messy code when inputting characters in kingsoft fast docs app. XWALK-4166<https://crosswalk-project.org/jira/browse/XWALK-4166> Fail to open "Space Friends" tag when running baidu-hi web app on Deepin. XWALK-4179<https://crosswalk-project.org/jira/browse/XWALK-4179> Fail to play music when running fm-baidu webapp on Deepin. XWALK-4210<https://crosswalk-project.org/jira/browse/XWALK-4210> Fail to access Microsoft Skydrive url (https://skydrive.live.com) on Deepin .. XWALK-4532<https://crosswalk-project.org/jira/browse/XWALK-4532> No response when clicking “Exit” button on Youdao note app. Sample Apps 15 □□□□□□□□80% -- -- XWALK-3658<https://crosswalk-project.org/jira/browse/XWALK-3658> Lack of UI entrance when installed Crosswalk .deb app Crosswalk WRT Testing Details Component Linux 15.44.370.0-1 Deepin 15.44.370.0-1 Comments Total TCs 15.44.370.0-1 (Deepin) Diff W/ 15.43.360.0-1 Diff W/ Ubuntu Crosswalk WRT/CSP 12 □□□□□□□□□□100% -- -- Good quality. Crosswalk Web APIs Testing Details Component Linux 15.44.370.0-1 Deepin 15.44.370.0-1 Comments Total TCs 15.44.370.0-1 (Deepin) Diff W/ Ubuntu Diff W/ Upstream Diff W/ Crosswalk Android IA Diff W/ 15.43.360.0-1 tct-audio-html5-tests 348 □□□□□□□□80% -- +11% +4% +1% Same issues exist on Linux/Deepin: XWALK-1831<https://crosswalk-project.org/jira/i#browse/XWALK-1831> [REG]The audio.controller attribute does not exist when running "WebAPI/Audio" on Android OS XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906> Fail to set media.muted value when testing Audio/Video element tct-video-html5-tests 389 □□□□□□□□81% -- +7% +3% -- Same issues exist on Linux/Deepin: XWALK-1832<https://crosswalk-project.org/jira/i#browse/XWALK-1832> [REG]The video.controller attribute does not exist when running “WebAPI/Video” on Android OS XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906> Fail to set media.muted value when testing Audio/Video element tct-notification-w3c-tests 10 □□□□□□□□□□100% -- -- -- -- Good quality Verified Issue: ----------------------- N/A Crosswalk Image Location Crosswalk_15.44.370.0-1_amd64.deb (http://pan.baidu.com/) Github Test Suite Links https://github.com/crosswalk-project/crosswalk-test-suite/ Test Environment ----------------------- Linux Desktop: Deepin 2014.2<http://www.linuxdeepin.com/download.cn.html> x86_64 with Chinese. Thanks Crosswalk QA
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
