Hi, If there are no objections, I propose that 13.42.319.0 is the branch point for Crosswalk 13. Blocker XWALK-3796 has a fix in master, but will need to be back ported.
Francesco From: <Wang>, LeiX Wang <[email protected]<mailto:[email protected]>> Date: Wednesday 25 March 2015 09:18 To: "<crosswalk-dev@lists. org>" <[email protected]<mailto:[email protected]>> Subject: [Crosswalk-dev] [Canary] Crosswalk Full Testing Report on 13.42.319.0(Android) Quality Summary 13.42.319.0 ----------------------- QA complete Fullpass and Stability Testing on crosswalk 13.42.319.0 for Android. One crash issue found: Crosswalk crashed when exit the fullscreen video(XWALK-3796<https://crosswalk-project.org/jira/i#browse/XWALK-3796>). Three API regression issues reported: fail to get align-content initial value(XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794>), fail to get SQLError.code(XWALK-3795<https://crosswalk-project.org/jira/browse/XWALK-3795>) and can’t remove all space characters(XWALK-3797<https://crosswalk-project.org/jira/browse/XWALK-3797>). The overall test results: Test Scope Total TCs Run rate Pass Rate Pass Rate of Executed Diff W/ 13.41.318.0 Comments Sample Apps 87 100% 98% 98% -- HangOnMan issue: XWALK-2223<https://crosswalk-project.org/jira/i#browse/XWALK-2223> WRT(Embedded) 773 100% 100% 100% -- Got good quality WRT(Shared) 22 100% 86% 86% -5% Got downgrade due toXWALK-3332<https://crosswalk-project.org/jira/i#browse/XWALK-3332> randomly occur Web API(Embedded) 12168 97% 90% 93% -- Some regression issues: fail to get align-content initial value(XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794>), fail to get SQLError.code(XWALK-3795<https://crosswalk-project.org/jira/browse/XWALK-3795>) and can’t remove all space characters(XWALK-3797<https://crosswalk-project.org/jira/browse/XWALK-3797>). Web API(Shared) 11819 97% 90% 93% -1% Some regression issues: fail to get align-content initial value(XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794>), fail to get SQLError.code(XWALK-3795<https://crosswalk-project.org/jira/browse/XWALK-3795>) and can’t remove all space characters(XWALK-3797<https://crosswalk-project.org/jira/browse/XWALK-3797>). Embedding API(Embedded) 194 100% 92% 92% -- Some issues: XWALK-2333<https://crosswalk-project.org/jira/browse/XWALK-2333>, XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754>, XWALK-3564<https://crosswalk-project.org/jira/i#browse/XWALK-3564>, … Embedding API(shared) 194 100% 92% 92% N/A Some issues: XWALK-2333<https://crosswalk-project.org/jira/browse/XWALK-2333>, XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754>, XWALK-3564<https://crosswalk-project.org/jira/i#browse/XWALK-3564>, … Behavior 17 100% 71% 71% -5% Got downgrade due to XWALK-3796<https://crosswalk-project.org/jira/browse/XWALK-3796> ([REG] Crosswalk crashed when exit the fullscreen video) Use Case 120 100% 85% 85% -3% Got downgrade due to XWALK-3796<https://crosswalk-project.org/jira/browse/XWALK-3796> ([REG] Crosswalk crashed when exit the fullscreen video) Stability 14 100% 86% 86% -- Stability issues:XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>, XWALK-1289<https://crosswalk-project.org/jira/browse/XWALK-1289> Total 25321 97% 91% 93% -- New Issues: - XWALK-3796<https://crosswalk-project.org/jira/i#browse/XWALK-3796> P1 [REG] Crosswalk crashed when exit the fullscreen video - XWALK-3794<https://crosswalk-project.org/jira/browse/XWALK-3794> P2 [REG]Fail to get correct the initial value of align-content when running tct-flexiblebox-css3-tests - XWALK-3795<https://crosswalk-project.org/jira/browse/XWALK-3795> P2 [REG]Fail to get correct SQLError.code when invoking executeSql() method to insert existing value in tct-webdatabase-w3c-tests package. - XWALK-3797<https://crosswalk-project.org/jira/browse/XWALK-3797> P2 [REG]Fails to remove all space characters when using a leading and trailing whitespace string to check input type="url" which contains in the "webapi-input-html5-tests" - Key Issues: Ø XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754> onCreateWindowRequested is not fired when window is opened Ø XWALK-3473<https://crosswalk-project.org/jira/browse/XWALK-3473> [REG]Fail to pack a testing app when using xwalk_version parameter which contains in manifest file Ø XWALK-3741<https://crosswalk-project.org/jira/browse/XWALK-3741> xwalkdriver is not stable during one hour long testing Ø XWALK-3796<https://crosswalk-project.org/jira/i#browse/XWALK-3796> [REG] Crosswalk crashed when exit the fullscreen video Crosswalk Sample Apps Testing Details Component Android Comments Total TCs 13.42.319.0 Diff W/ 13.41.318.0 Sample Apps 87 □□□□□□□□□98% -- Android: XWALK-2223<https://crosswalk-project.org/jira/i#browse/XWALK-2223> [REG] HangOnMan sample app doesn't display cloud background and "New Game"/"quit" button Android: createDataChannel and onDataChannel issues(upstream issues, XWALK-1473<https://crosswalk-project.org/jira/browse/XWALK-1473> comment) Crosswalk WRT(Embedded) Testing Details Component Android Comments Total TCs 13.42.319.0 Diff W/ 13.41.318.0 Crosswalk WRT/Core Shell 5 □□□□□□□□□□100% -- Crosswalk WRT/Extension System 5 □□□□□□□□□□100% -- Crosswalk WRT/Internet Standard/Cookie 9 □□□□□□□□□□100% -- Crosswalk WRT/Internet Standard/Scheme 24 □□□□□□□□□□100% -- Crosswalk WRT/Manifest 289 □□□□□□□□□□100% -- Crosswalk WRT/Package Management 14 □□□□□□□□□□100% -- Crosswalk WRT/Packer Tool 350 □□□□□□□□□□100% -- Android: XWALK-2667<https://crosswalk-project.org/jira/browse/XWALK-2667> Fail to get correct status of DeviceCapabilities.onstorageattach/onstoragedetach event when attach and detach SD card on 'Asus Memo Pad8' device Crosswalk WRT/Runtime Core 11 □□□□□□□□□□100% -- Crosswalk WRT/Security 29 □□□□□□□□□□100% -- Crosswalk WRT/User Experience 37 □□□□□□□□□□100% -- Crosswalk WRT(Shared) Testing Details Component Android Comments Total TCs 13.42.319.0 Diff W/ 13.41.318.0 Crosswalk WRT/Packer Tool 3 □□□□□□□□□□100% -- Crosswalk WRT/Shared Mode 11 □□□□□□□□□□100% -- Crosswalk WRT/Upgrade 8 □□□□□□63% -12% Android:XWALK-3332<https://crosswalk-project.org/jira/i#browse/XWALK-3332> Can't get correct cookie value when upgrading apps Got downgrade due toXWALK-3332<https://crosswalk-project.org/jira/i#browse/XWALK-3332> randomly occur Crosswalk Web API Testing Details Web Spec Android Comments Total TCs 13.42.319.0 (Embedded) 13.42.319.0 (Shared) Diff W/ Base Webview Diff W/ Base Chrome Diff W/ 13.41.318.0 Crosswalk APIs/Native File System 52 □□□□□□□□□□100% □□□□□□□□□□100% N/A N/A -- Crosswalk APIs/Screen Presentation APIs 15 □□□□□□□□□□100% □□□□□□□□□□100% +100% +100% -- Supplementary APIs/Fullscreen API - Mozilla (Partial) 9 □□□□□□□□□□100% □□□□□□□□□□100% +92% -- -- Supplementary APIs/Promises 4 □□□□□□□□□□100% □□□□□□□□□□100% +100% -- -- Supplementary APIs/SIMD 1637 □□□□□□□□□91% □□□□□□□□□91% N/A +91% -- Android: XWALK-2440<https://crosswalk-project.org/jira/browse/XWALK-2440> No exception was thrown when the index of the Float32x4Array is bigger than the length of array or smaller than 0 on Android/Webapi/SIMD test Android: XWALK-3155<https://crosswalk-project.org/jira/browse/XWALK-3155> SIMD load and store operations with overaligned run failed on android device. Android: XWALK-3517<https://crosswalk-project.org/jira/browse/XWALK-3517> SIMD float64x2_swizzle and float64x2_shuffle methods are not supported on android device Supplementary APIs/Typed Arrays - Khronos (Partial) 447 □□□□□□□□□99% □□□□□□□□□99% -- +9% -- Android: XWALK-998<https://crosswalk-project.org/jira/browse/XWALK-998> Fail to get correct value of Uint8ClampedArray.length on Android OS Supplementary APIs/WebGL - Khronos (Partial) 1597 □□□□□□□□□99% □□□□□□□□□99% -- +99% -- Android:XWALK-3062<https://crosswalk-project.org/jira/browse/XWALK-3062> Fail to get correct value when invoking deleteBuffer() Android: XWALK-3063<https://crosswalk-project.org/jira/browse/XWALK-3063> Fail to get correct value if no source has been defined when invoking getTranslatedShaderSource() method W3C_HTML5 APIs/Communication/HTML5 The session history of browsing contexts (Partial) 154 □□□□□□□□□□100% □□□□□□□□□□100% +81% +8% -- W3C_HTML5 APIs/Communication/HTML5 Web Messaging 176 □□□□□□□□□99% □□□□□□□□□99% +81% +4% -- Android: Failure reason is same as Chrome W3C_HTML5 APIs/Communication/Server-Sent Events 67 □□□□□□□□84% □□□□□□□□84% +84% -- -- Android: Failure reason is same as Chrome W3C_HTML5 APIs/Communication/The WebSocket API 270 □□□□□□□□□96% □□□□□□□□□96% +96% +16% -- Android: XWALK-1791<https://crosswalk-project.org/jira/browse/XWALK-1791> White screen occurs when running “WebAPI/WebSocket” on Android OS W3C_HTML5 APIs/Communication/WebRTC 134 □□□□□□□□84% □□□□□□□□84% N/A +3% -- Android: XWALK-942<https://crosswalk-project.org/jira/browse/XWALK-942> The setting of binaryType/maxRetransmits/ordered attributes of RTCDataChannel are abnormal on Android OS Android: XWALK-1447<https://crosswalk-project.org/jira/browse/XWALK-1447> Crosswalk crashed when running “WebAPI/webrtc” on Android OS (upstream bug) Android: XWALK-3232<https://crosswalk-project.org/jira/browse/XWALK-3232> [REG] The expected test purpose what is incorrect in webapi-webrtc-w3c-tests on Android Android:XWALK-3241<https://crosswalk-project.org/jira/browse/XWALK-3241> [REG] Fail to get readonly attribute when testing webapi-webrtc-w3c-tests package on Android W3C_HTML5 APIs/Communication/XMLHttpRequest Level 2 291 □□□□□□□□□90% □□□□□□□□□90% +16% +1% -- Android: XWALK-3074<https://crosswalk-project.org/jira/browse/XWALK-3074> Fail to trigger the onerror event when invoking XMLHttpRequest.getAllResponseHeaders() method W3C_HTML5 APIs/Device/DeviceOrientation Event Specification (Partial) 40 □□□□□□□□85% □□□□□□□□85% +85% -15% -- Android: XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on 'Asus Memo Pad8' device(Device limitation) W3C_HTML5 APIs/Device/HTML5 Browser state 3 □□□□□□□□□□100% □□□□□□□□□□100% -- -- -- W3C_HTML5 APIs/Device/The Network Information API 4 □□□□□50% □□□□□50% +20% -- -- Android: Failure reason is same as Chrome W3C_HTML5 APIs/Device/The Screen Orientation API 14 □□□□□□□□86% □□□□□□□□86% +78% -- -- Android: XWALK-2511<https://crosswalk-project.org/jira/browse/XWALK-2511> screen.orientation.lock() fails to return Promise when running“WebAPI/Screenorientation” on Android OS Android: XWALK-2512<https://crosswalk-project.org/jira/browse/XWALK-2512> Screen Orientation fails to fire onchange event when running “WebAPI/Screenorientation” on Android OS W3C_HTML5 APIs/Device/Touch Events version 1 (Partial) 47 □□□□□□□□□□100% □□□□□□□□□□100% +2% -- -- W3C_HTML5 APIs/Device/Vibration API 20 □□□□□□□□□□100% □□□□□□□□□□100% +100% -- -- Android: Vibration doesn’t support on Asus Memo Pad8, tested on ZTE Geek phone W3C_HTML5 APIs/DOM, Forms and Styles/CSS Animations Module Level 3 54 □□□□□□□□□□100% □□□□□□□□□□100% +9% +26% -- W3C_HTML5 APIs/DOM, Forms and Styles/CSS Backgrounds and Borders Module Level 3 612 □□□□□□□□□93% □□□□□□□□□93% +34% -6% -- Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android Android:XWALK-2659<https://crosswalk-project.org/jira/browse/XWALK-2659> Css line doesn't work on Crosswalk using the <![CDATA[ in <style> Android:XWALK-3506<https://crosswalk-project.org/jira/i#browse/XWALK-3506> [REG]Cann't correctly display background-clip with content-box in visual when running tct-backgrounds-css3-tests by webdriver Android: XWALK-3507<https://crosswalk-project.org/jira/i#browse/XWALK-3507> [REG] Cann't correctly display background-clip with inherit in visual when running tct-backgrounds-css3-tests by webdriver W3C_HTML5 APIs/DOM, Forms and Styles/CSS Basic User Interface Module Level 3 (CSS3 UI) (Partial) 44 □□□□□□□□□□100% □□□□□□□□□□100% +5% -- -- W3C_HTML5 APIs/DOM, Forms and Styles/CSS Color Module Level 3 105 □□□□□□□□84% □□□□□□□□81% -15% -16% -- Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Flexible Box Layout Module 67 □□□□40% □□□□40% +13% -50% -2% Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android Android:XWALK-2663<https://crosswalk-project.org/jira/browse/XWALK-2663> The red background of flexbox div cannot be covered completely when running the "flexibleBox" component Android: XWALK-3622<https://crosswalk-project.org/jira/i#browse/XWALK-3622> Fail to get the expect initial value of align-items/align-self property when running tct-flexiblebox-css3-tests. Got downgrade due to XWALK-3794<https://crosswalk-project.org/jira/i#browse/XWALK-3794> [REG]Fail to get correct the initial value of align-content when running tct-flexiblebox-css3-tests W3C_HTML5 APIs/DOM, Forms and Styles/CSS Fonts Module Level 3 (Partial) 141 □□□□□□□□□92% □□□□□□□□86% -2% -7% -- Android:XWALK-2659<https://crosswalk-project.org/jira/browse/XWALK-2659> Css line doesn't work on Crosswalk using the <![CDATA[ in <style> Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Multi-column Layout Module (Partial) 159 □□□□□□□□□97% □□□□□□□□□97% +15% -2% -- Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Text Module Level 3 (Partial) 47 □□□□□□□□□98% □□□□□□□□□97% +6% +1% -- Android: XWALK-2623<https://crosswalk-project.org/jira/browse/XWALK-2623> Failed to get correct value of "hyphens" when invoking the "GetCurrentStyle()" method which contains in the "W3C/Text" component on Android OS W3C_HTML5 APIs/DOM, Forms and Styles/CSS Transforms 78 □□□□□□□□85% □□□□□□□□85% N/A -15% -- Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Transitions Module Level 3 (Partial) 45 □□□□□□□□82% □□□□□□□□80% -18% +9% -- Android: XWALK-3006<https://crosswalk-project.org/jira/browse/XWALK-3006> Fail to get the correct calculated value of ‘transition-timing-function: ease’ when using window.getComputedStyle() method W3C_HTML5 APIs/DOM, Forms and Styles/HTML5 Forms (Partial) 49 □□□□□□□□□□100% □□□□□□□□□□100% -- -- -- Android: XWALK-1134<https://crosswalk-project.org/jira/browse/XWALK-1134> [REG] The order of form.elements is not as expected when table syntax error happens when running “WebAPI/forms” on Android OS W3C_HTML5 APIs/DOM, Forms and Styles/HTML5 telephone, email and URL state of input element 147 □□□□□□□□□97% □□□□□□□□□97% +19% +11% -3% Got downgrade due to XWALK-3797<https://crosswalk-project.org/jira/i#browse/XWALK-3797> [REG]Fails to remove all space characters when using a leading and trailing whitespace string to check input type="url" which contains in the "webapi-input-html5-tests" W3C_HTML5 APIs/DOM, Forms and Styles/DOM/JavaScript related HTML5 Enhancements 32 □□□□□□□□□□100% □□□□□□□□□□100% +97% +24% -- W3C_HTML5 APIs/DOM, Forms and Styles/Media Queries (Partial) 52 □□□□□□□□□□100% □□□□□□□□□□100% -- -- -- W3C_HTML5 APIs/DOM, Forms and Styles/Selectors API Level 1 72 □□□□□□□□□□100% □□□□□□□□□□100% -- +3% -- W3C_HTML5 APIs/DOM, Forms and Styles/Selectors API Level 2 (Partial) 85 □□□□41% □□□□41% +17% -26% -- Android: Failure reason is same as Chrome W3C_HTML5 APIs/Graphics/HTML Canvas 2D Context (Partial) 863 □□□□□□□□□98% □□□□□□□□□98% +6% +1% -- Android: XWALK-2121<https://crosswalk-project.org/jira/browse/XWALK-2121> Fail to throw DOMException "INDEX_SIZE_ERR" after invoking g.addColorStop(Infinity,'#000') when running “WebAPI/Canvas” on Android OS Android:XWALK-3630<https://crosswalk-project.org/jira/i#browse/XWALK-3630> [REG] Crosswalk does not throw a typeError when call "New" as window.ImageData's constructor W3C_HTML5 APIs/Graphics/HTML5 SVG 12 □□□□□50% □□□33% -50% -42% -- Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/HTML5 Application caches 36 □□□□□□□□□□100% □□□□□□□□□□100% +4% -- -- W3C_HTML5 APIs/Location/Geolocation API Specification 217 □□□□□50% □□□□49% N/A -- -- Android: XWALK-1783<https://crosswalk-project.org/jira/browse/XWALK-1783> The readonly attribute "altitude" should not be set to unexpected empty string when running “WebAPI/Geolocation” on Android OS W3C_HTML5 APIs/Media/getUserMedia (Partial) 26 □□□□□□62% □□□□□□□75% +55% +40% -- Android: XWALK-2210<https://crosswalk-project.org/jira/browse/XWALK-2210> unable to get an unique value when invoking e.inputBuffer.getChannelData(0) several times on Android/WebAPI/getUsrMedia test W3C_HTML5 APIs/Media/HTML Media Capture 5 □□□□□□□□80% □□□□□□□□□□100% +20% -20% -- Android: XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(Device limitation, won’t fix) W3C_HTML5 APIs/Media/HTML5 The audio element (Partial) 349 □□□□□□□76% □□□□□□□76% -3% +21% -- Android: XWALK-2201<https://crosswalk-project.org/jira/browse/XWALK-2201> Fail to get same test result between local mode and web service mode for Android/WebAPI/Audio/Video test Android: XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906>Fail to set media.muted value when testing Audio/Video element Android: XWALK-2953<https://crosswalk-project.org/jira/browse/XWALK-2953> Fail to set media.currentTime value when testing Audio/Video element Android: XWALK-3106<https://crosswalk-project.org/jira/browse/XWALK-3106> The expected test purpose what is incorrect in tct-audio-html5-tests Android: XWALK-1831<https://crosswalk-project.org/jira/i#browse/XWALK-1831> [REG]The audio.controller attribute does not exist when running "WebAPI/Audio" on Android OS W3C_HTML5 APIs/Media/HTML5 The video element (Partial) 387 □□□□□□□78% □□□□□□□78% +1% +7% -- Android: XWALK-2201<https://crosswalk-project.org/jira/browse/XWALK-2201> Fail to get same test result between local mode and web service mode for Android/WebAPI/Audio/Video test Android: XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906> Fail to set media.muted value when testing Audio/Video element Android: XWALK-2953<https://crosswalk-project.org/jira/browse/XWALK-2953> Fail to set media.currentTime value when testing Audio/Video element Android:XWALK-2960<https://crosswalk-project.org/jira/browse/XWALK-2960> Fail to get 'videoheight'and 'videowidth' value when loading a video media resource Android: XWALK-3107<https://crosswalk-project.org/jira/browse/XWALK-3107> The expected test purpose what is incorrect in tct-video-html5-tests Android: XWALK-1832<https://crosswalk-project.org/jira/i#browse/XWALK-1832> [REG]The video.controller attribute does not exist when running “WebAPI/Video” on Android OS W3C_HTML5 APIs/Media/Web Audio API (Partial) 389 □□□□□□□□87% □□□□□□□□87% +87% -- -- Android: XWALK-3242<https://crosswalk-project.org/jira/browse/XWALK-3242> [REG] Fail to get correct panningModel default value when testing tct-webaudio-w3c-tests on Android W3C_HTML5 APIs/Media/Web Speech API 212 □□□□□□□75% □□□□□□□75% N/A N/A -7% Android: XWALK-3732<https://crosswalk-project.org/jira/browse/XWALK-3732> The serviceURI attribute does not exist in SpeechRecognition interface Android: XWALK-3745<https://crosswalk-project.org/jira/i#browse/XWALK-3745> The addFromURI method does not exist in SpeechGrammarList interface Speech Synthesis partly implement(XWALK-1105<https://crosswalk-project.org/jira/browse/XWALK-1105>) Tests update and failure reason isXWALK-3745<https://crosswalk-project.org/jira/i#browse/XWALK-3745> W3C_HTML5 APIs/Performance and Optimization/High Resolution Time 7 □□□□□□□□86% □□□□□□□□86% +86% -- -- Android: XWALK-1000<https://crosswalk-project.org/jira/browse/XWALK-1000> The property now() of Performance interface is not configurable when running “WebAPI/hrtime” component on Android OS W3C_HTML5 APIs/Performance and Optimization/Navigation Timing 45 □□□□□□□□□□100% □□□□□□□□□□100% +60% -- -- W3C_HTML5 APIs/Performance and Optimization/Page Visibility 20 □□□□□□□□□□100% □□□□□□□□□□100% +75% +3% -- W3C_HTML5 APIs/Performance and Optimization/Performance Timeline 20 □□□□□□□□□□100% □□□□□□□□□□100% N/A +5% -- W3C_HTML5 APIs/Performance and Optimization/Resource Timing 70 □□□□□□66% □□□□□□66% +66% -20% -- Android: XWALK-3546<https://crosswalk-project.org/jira/i#browse/XWALK-3546> CLONE - Fail to get correct PerformanceEntry.initiatorType value after loading the test resource on Android W3C_HTML5 APIs/Performance and Optimization/Timing control for script-based animations 18 □□□□□□□□□□100% □□□□□□□□□□100% N/A -- -- W3C_HTML5 APIs/Performance and Optimization/User Timing 22 □□□□□□□□□95% □□□□□□□□□95% N/A -4% -- Android: XWALK-999<https://crosswalk-project.org/jira/browse/XWALK-999> The properties mark/clearMarks/measure/clearMeasures of Performance interface are not configurable when running “WebAPI/usertiming” component on Android OS W3C_HTML5 APIs/Performance and Optimization/Web Workers (Partial) 86 □□□□□□63% □□□□□□64% +63% +1% -- Android: Failure reason is same as Chrome W3C_HTML5 APIs/Security/Content Security Policy 1.0 (Partial) 267 □□□□□□□□88% □□□□□□□□88% +43% +12% -- Android: XWALK-501<https://crosswalk-project.org/jira/browse/XWALK-501> The two lines of strings "1234 ABCD" are different in font when running tct-csp-w3c-tests on Android OS Android: XWALK-2767<https://crosswalk-project.org/jira/browse/XWALK-2767> Fails to obtain/apply CanvasTest.ttf font-face from server client when running the "tct-csp-w3c-tests" on Android Android: XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/Security/Cross-Origin Resource Sharing 10 □□□□□□□□□□100% □□□□□□□□□□100% +40% +10% -- W3C_HTML5 APIs/Security/HTML5 The iframe element 59 □□□□□□□□□□100% □□□□□□□□□□100% +24% +6% -- W3C_HTML5 APIs/Storage/File API 122 □□□□□□□□89% □□□□□□□□□□100% +23% +3% -- Android: XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(Device limitation, won’t fix) W3C_HTML5 APIs/Storage/File API: Directories and System 203 □□□□□□□□□99% □□□□□□□□□99% +99% -- -- Android: Failure reason is same as Chrome W3C_HTML5 APIs/Storage/File API: Writer (Partial) 48 □□□□44% □□□□44% +34% -4% -- Android: XWALK-837<https://crosswalk-project.org/jira/browse/XWALK-837> Security Error occurs when calling requestFilesystem method on Android OS Android : XWALK-3279<https://crosswalk-project.org/jira/browse/XWALK-3279> App crash occurred (Fatal signal 4) when running the 'tct-filewriterapi-w3c-tests' on Android W3C_HTML5 APIs/Storage/Indexed Database API (Partial) 392 □□□□□□□□□□100% □□□□□□□□□□100% +100% -- -- Android: XWALK-3067<https://crosswalk-project.org/jira/browse/XWALK-3067> Fail to throws an NotSupportedError exception when invoking IDBObjectStore.createIndex() method W3C_HTML5 APIs/Storage/Web SQL Database 148 □□□□□□□□86% □□□□□□□□86% +80% +29% -1% Android: XWALK-2768<https://crosswalk-project.org/jira/browse/XWALK-2768> [REG] openDatabaseSync() got undefined when invoking WorkerUtilsDatabase Got downgrade due to XWALK-3795<https://crosswalk-project.org/jira/i#browse/XWALK-3795> [REG]Fail to get correct SQLError.code when invoking executeSql() method to insert existing value in tct-webdatabase-w3c-tests package. W3C_HTML5 APIs/Storage/Web Storage 196 □□□□□□□□□96% □□□□□□□□□96% +31% -- -- Android:XWALK-3527<https://crosswalk-project.org/jira/i#browse/XWALK-3527> [REG] Fail to get correct the initial value of StorageEvent.key when creating StorageEvent object. Android:XWALK-3529<https://crosswalk-project.org/jira/i#browse/XWALK-3529> [REG] Fail to get correct the value of StorageEvent.key when StorageEvent's constructor no key. Android:XWALK-3532<https://crosswalk-project.org/jira/i#browse/XWALK-3532> [REG] Fail to get correct the type of StorageEvent.key when creating StorageEvent object W3C_HTML5 APIs/System Apps/App URI 7 □□□□□□□□86% □□□□□□□□86% +86% N/A -- Android: XWALK-1941<https://crosswalk-project.org/jira/browse/XWALK-1941> Fail to get correct value of window.location.pathname when running “WebAPI/appuri” on Android W3C_HTML5 APIs/System Apps/Contacts Manager 144 □□□□□□□□□93% □□□□□□□□□93% +93% +93% -- Android: XWALK-1716<https://crosswalk-project.org/jira/browse/XWALK-1716> Contact.phoneNumbers is undefined when running “WebAPI/contactsmanager” on Android OS Android: XWALK-2451<https://crosswalk-project.org/jira/browse/XWALK-2451> fails to execute exactly search in ContactsManager.find method with "is" filter operator Android: XWALK-2452<https://crosswalk-project.org/jira/browse/XWALK-2452> The object of the readonly attribute Navigator.contacts should not be modified when running "WebAPI/contactsmanager" on Android OS Android: XWALK-2947<https://crosswalk-project.org/jira/browse/XWALK-2947> Fails to get correct type of Contact.id when invoking find method of Contact Interface on Android OS Android: XWALK-2946<https://crosswalk-project.org/jira/browse/XWALK-2946> Fails to trigger the callbacks when invoking "ContactsManager.remove" method on Android OS Android: XWALK-2453<https://crosswalk-project.org/jira/browse/XWALK-2453> fails to get the correct time value which is setted in Contact birthday data unit when running "WebAPI/contactsmanager" on Android OS W3C_HTML5 APIs/System Apps/Device Capabilities 84 □□□□□□□□□94% □□□□□□□□□□100% +94% +94% -- Android: XWALK-2667<https://crosswalk-project.org/jira/browse/XWALK-2667> Fail to get correct status of DeviceCapabilities.onstorageattach/onstoragedetach event when attach and detach SD card on 'Asus Memo Pad8' device W3C_HTML5 APIs/System Apps/Gamepad 3 □□□□□□□□□□100% □□□□□□□□□□100% N/A -- -- W3C_HTML5 APIs/System Apps/Messaging 172 □□20% □□20% +20% +12% -- Android: XWALK-2140<https://crosswalk-project.org/jira/browse/XWALK-2140> [REG]Target origin is ' ' when executing 'postMessage' on 'Window' for Android/WebAPI/messaging Message/Telephone don’t support on Asus Memo Pad8, tested on ZTE Geek phone Android: XWALK-2938<https://crosswalk-project.org/jira/browse/XWALK-2938> [REG] Fail to retrieve the messages when invoking findMessages method Android: XWALK-2940<https://crosswalk-project.org/jira/browse/XWALK-2940> [REG] Fail to retrieve the messages when invoking getMessage method Android: XWALK-862<https://crosswalk-project.org/jira/browse/XWALK-862> [WebAPI/Messaging]All properties and methods are not implemented on MmsManager W3C_HTML5 APIs/System Apps/Raw Sockets 90 □□□□□□□□88% □□□□□□□□88% +88% +88% -- Android: XWALK-1728<https://crosswalk-project.org/jira/browse/XWALK-1728> TCPSocket.noDelay attribute cannot be set to false when running “WebAPI/rawsockets” on Android OS Android: XWALK-2408<https://crosswalk-project.org/jira/browse/XWALK-2408> Fail to throw InvalidAccessError DOM exception when running "WebAPI/rawsockets" on Android OS Android: XWALK-2414<https://crosswalk-project.org/jira/browse/XWALK-2414> Fail to set addressReuse value by the options argument in TCPServerSocket constructor when running "WebAPI/rawsockets" on Android OS Android: XWALK-2420<https://crosswalk-project.org/jira/browse/XWALK-2420> TCPSocket fail to throw a InvalidStateError DOM Exception by send data after calling close/halfclose method when running "WebAPI/rawsockets" on Android OS Android: XWALK-3484<https://crosswalk-project.org/jira/i#browse/XWALK-3484> TCPSocket.send() method send content with Blob or ArrayBuffer or ArrayBufferView type failed. Android: XWALK-3485<https://crosswalk-project.org/jira/i#browse/XWALK-3485> The TCPSocket.onerror event can not be fired. W3C_HTML5 APIs/UI/HTML5 Drag and drop (Partial) 6 □□□□□□□□□□100% □□□□□□□□□□100% +17% -- -- W3C_HTML5 APIs/UI/Web Notifications (Partial) 17 □□□□□□□□□□100% □□□□□□□□□□100% +100% +71% -- W3C_HTML5 APIs/W3C_EXTRAHTML5 646 □□□□□□□□□98% □□□□□□□□□98% +98% +8% -- Android:XWALK-1724<https://crosswalk-project.org/jira/browse/XWALK-1724> The window.external attribute does not exist when running “WebAPI/extra” on Android OS Android:XWALK-1891<https://crosswalk-project.org/jira/browse/XWALK-1891> Datetime type does not support on input element when using string value to check input type="datetime" on Android Crosswalk Embedding Testing Details Component Total TCs 13.42.319.0 (Embedded) 13.42.319.0 (Shared) Diff W/ 13.41.318.0 Comments Embedding API 194 □□□□□□□□□92% □□□□□□□□□92% -- Android: XWALK-2333<https://crosswalk-project.org/jira/browse/XWALK-2333> [Android] Navigation back won't trigger onReceivedTitle Callback Android:XWALK-2352<https://crosswalk-project.org/jira/browse/XWALK-2352>Some methods in XWalkView and XWalkUIClient interface do not support when running “WebAPI/Embeddingapi” on Android OS Android: XWALK-2684<https://crosswalk-project.org/jira/browse/XWALK-2684> xhtml local files in android embedded application trying to open with external file handler Android:XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754> onCreateWindowRequested is not fired when window is opened Android: XWALK-3508<https://crosswalk-project.org/jira/i#browse/XWALK-3508> The onLoadStarted method can't be called when load a local html file Android: XWALK-3014<https://crosswalk-project.org/jira/i#browse/XWALK-3014> XWalkView loading local external JS not properly Android: XWALK-3564<https://crosswalk-project.org/jira/i#browse/XWALK-3564> onPageLoadStopped can't be triggered when load a page using iframe.contentDocument.write. Crosswalk Behavior Testing Details Component Total TCs 13.42.319.0 Diff W/ 13.41.318.0 Comment Media and Animation 7 □□□□□□□71% -15% Android:XWALK-2988<https://crosswalk-project.org/jira/i#browse/XWALK-2988> [REG] Transparency does not take effect if its value changes from 0%(or 100%) to other value when multicolumn is enabled Got downgrade due to XWALK-3796<https://crosswalk-project.org/jira/i#browse/XWALK-3796> [REG] Crosswalk crashed when exit the fullscreen video Hardware and Sensor 6 □□□□□□67% -- Android: Vibration doesn’t support on Asus Memo Pad8, tested on ZTE Geek phone Android:XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on 'Asus Memo Pad8' device(Device limitation ,won’t fix) Android: XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(particular device issue ,won’t fix) Gesture 2 □□□□□□□□□□100% -- Content 1 0% -- Android: XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(particular device issue ,won’t fix) System 1 □□□□□□□□□□100% -- Crosswalk Use Case Testing Details Component Total TCs 13.42.319.0 Diff W/ 13.41.318.0 Comments WRT/Android 36 □□□□□□□□86% -8% Android:XWALK-3330<https://crosswalk-project.org/jira/browse/XWALK-3330>Crosswalk sets input type date in US format even if the locale is FR Android: XWALK-3108<https://crosswalk-project.org/jira/browse/XWALK-3108> E/chromium﹕[ERROR:runtime_javascript_dialog_manager.cc(64)] Not implemented reached in virtual void xwalk::RuntimeJavaScriptDialogManager::CancelActiveAndPendingDialogs(content::WebContents*) Android: XWALk-3651<https://crosswalk-project.org/jira/browse/XWALK-3651> Immersive Fullscreen mode doesn´t recover after changing the volume on the device Android: XWALK-3594<https://crosswalk-project.org/jira/browse/XWALK-3594> WIN DEATH when press "back" key from chrome://gpu link Got downgrade due to XWALK-3796<https://crosswalk-project.org/jira/browse/XWALK-3796> [REG] Crosswalk crashed when exit the fullscreen video WebAPI 69 □□□□□□□□84% -2% Android: XWALK-1457<https://crosswalk-project.org/jira/browse/XWALK-1457> No selection list displayed in the input when running “Usecase/Input” on Android OS Android: XWALK-1693<https://crosswalk-project.org/jira/browse/XWALK-1693> Fail to get correct value of “connection status” when running “Usecase/BrowserState” on Android OS Android: XWALK-2663<https://crosswalk-project.org/jira/browse/XWALK-2663> The red background of flexbox div cannot be covered completely when running the "flexibleBox" component Android: XWALK-2511<https://crosswalk-project.org/jira/browse/XWALK-2511> screen.orientation.lock() fails to return Promise when running “WebAPI/Screenorientation” on Android OS Android:XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on 'Asus Memo Pad8' device(device limitation,won’t fix) Android: XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(particular device issue ,won't fix) Android: Vibration doesn’t support on Asus Memo Pad8, tested on ZTE Geek phone Android:XWALK-2988<https://crosswalk-project.org/jira/i#browse/XWALK-2988> [REG] Transparency does not take effect if its value changes from 0%(or 100%) to other value when multicolumn is enabled Speech Synthesis partly implement(XWALK-1105<https://crosswalk-project.org/jira/browse/XWALK-1105>) Got downgrade due to XWALK-3796<https://crosswalk-project.org/jira/browse/XWALK-3796> [REG] Crosswalk crashed when exit the fullscreen video Embedding API 15 □□□□□□□□87% -- Android: XWALK-2012<https://crosswalk-project.org/jira/browse/XWALK-2012> Incorrect z-order when using multiple Android XWalk webviews (won’t fix) Android:XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754> onCreateWindowRequested is not fired when window is opened Crosswalk Stability Testing Details Usage Check Points Target Result Comments Iterative Testing Suspend/Resume system while playing HTML5 video 50 times Pass Install/uninstall Web app 50 times Pass Launch/terminate one Web app 50 times Pass Switch between activated native and Web app 50 times Pass Switch between multiple Web apps 50 times Pass Tap control buttons (FF/FB, Play/Pause, volume etc) during playing audio 50 times Pass Tap control buttons (FF/FB, Play/Pause, fullscreen, etc) during playing video 50 times Pass Long-lasting Testing Play html5 audio 4hrs Pass Average CPU: 14% Average Memory: 66.9MB Play html5 video 4hrs Pass Average CPU: 43.6% Average Memory: 75.4MB Capture Video in Web app 1hr Fail XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902> Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(won’t fix) Run Games of 2D graphics 24hrs Pass Average CPU: 12% Average Memory: 83.4MB Run Games of 3D graphics 24hrs Fail XWALK-1289<https://crosswalk-project.org/jira/browse/XWALK-1289>Crosswalk consume more resources compare with Chrome when running 3D games for a long time Average CPU: 139% Average Memory: 255.5MB Overload Testing Launch a mass of Web apps till system force to terminate System memory not enough Pass Recovery Testing Pause/resume sample app after a long time 2hrs Pass Verified Issue: ----------------------- N/A Crosswalk Image Location Crosswalk for Android: 13.42.319.0 (https://download.01.org/crosswalk/releases/crosswalk/android/canary/13.42.319.0/crosswalk-13.42.319.0.zip) Crosswalk WebView: 13.42.319.0 (https://download.01.org/crosswalk/releases/crosswalk/android/canary/13.42.319.0/x86/crosswalk-webview-13.42.319.0-x86.zip) Github Test Suite Links https://github.com/crosswalk-project/crosswalk-test-suite/ Operating System Android Image version:4.2.2/4.4.4 Test Environment ----------------------- l Crosswalk Android: o IA Tablet (Baytrail T): Asus Memo Pad8 o IA Phone: ZTE Geek o ARM Device: Nexus 5 Thanks Crosswalk QA --------------------------------------------------------------------- Intel Finland Oy Registered Address: PL 281, 00181 Helsinki Business Identity Code: 0357606 - 4 Domiciled in Helsinki This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. _______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
