QA complete the testing for Crosswalk Project Extensions for RealSense in 
v19.6.0 release at 
https://github.com/crosswalk-project/realsense-extensions-crosswalk/releases/tag/v19.6.0.
 Glad to see that twelve RS issues got fixed(Fixed 
XWALK-6363<https://crosswalk-project.org/jira/browse/XWALK-6363>, 
XWALK-6447<https://crosswalk-project.org/jira/browse/XWALK-6447>, 
XWALK-6551<https://crosswalk-project.org/jira/browse/XWALK-6551>, 
XWALK-6506<https://crosswalk-project.org/jira/browse/XWALK-6506>, 
XWALK-6534<https://crosswalk-project.org/jira/browse/XWALK-6534>, 
XWALK-6448<https://crosswalk-project.org/jira/browse/XWALK-6448>, 
XWALK-6607<https://crosswalk-project.org/jira/browse/XWALK-6607>, 
XWALK-6462<https://crosswalk-project.org/jira/browse/XWALK-6462>, 
XWALK-6400<https://crosswalk-project.org/jira/browse/XWALK-6400>, 
XWALK-6401<https://crosswalk-project.org/jira/browse/XWALK-6401>, 
XWALK-6402<https://crosswalk-project.org/jira/browse/XWALK-6402>, 
XWALK-6403<https://crosswalk-project.org/jira/browse/XWALK-6403>). However, two 
P1 regression issues found: Crop photo cannot save when the selected cropped 
field is very 
small(XWALK-6632<https://crosswalk-project.org/jira/browse/XWALK-6632>), Set 
function is unable to work in Face 
Module(XWALK-6635<https://crosswalk-project.org/jira/browse/XWALK-6635>), and 
four new issues 
filed(XWALK-6642<https://crosswalk-project.org/jira/browse/XWALK-6642>, 
XWALK-6643<https://crosswalk-project.org/jira/browse/XWALK-6643>, 
XWALK-6644<https://crosswalk-project.org/jira/browse/XWALK-6644>, XWALK-6650 
<https://crosswalk-project.org/jira/browse/XWALK-6650> ). The overall test 
result:


Test Scope

Release  v19.6.0

Comments

Total TCs

Pass Rate

RealSense Samples

75

80%

Exist bug: XWALK-6632<https://crosswalk-project.org/jira/browse/XWALK-6632>, 
XWALK-6635<https://crosswalk-project.org/jira/browse/XWALK-6635>, XWALK-6650 
<https://crosswalk-project.org/jira/browse/XWALK-6650>

Crosswalk Web API RealSense

154

95%

Exist bug:  XWALK-6642<https://crosswalk-project.org/jira/browse/XWALK-6642>, 
XWALK-6643<https://crosswalk-project.org/jira/browse/XWALK-6643>, 
XWALK-6644<https://crosswalk-project.org/jira/browse/XWALK-6644>





New Issues:
-----------------------
XWALK-6632<https://crosswalk-project.org/jira/browse/XWALK-6632> P1 [REG] Crop 
photo cannot save when the selected cropped field is very small.
XWALK-6635<https://crosswalk-project.org/jira/browse/XWALK-6635> P1 [REG] Set 
function is unable to work in Face Module
XWALK-6642<https://crosswalk-project.org/jira/browse/XWALK-6642> P2 [RealSense] 
Unable to get right EventTarget in enhanced_photography and scene_perception of 
realsense
XWALK-6643<https://crosswalk-project.org/jira/browse/XWALK-6643> P2 [RealSense] 
Unable to get configuration and recognition objects in face of 
webapi-realsense-xwalk-tests.
XWALK-6644<https://crosswalk-project.org/jira/browse/XWALK-6644> P2 [RealSense] 
GetSurfaceVoxels/QueryVolumePreview/SaveMesh should reject with a SPError when 
region/cameraPose/info is null.
XWALK-6650 <https://crosswalk-project.org/jira/browse/XWALK-6650> P2 
[RealSense] Unable to detect face when resolution set to "QVGA@60FPS".

Verified Issues:
-----------------------

XWALK-6363<https://crosswalk-project.org/jira/browse/XWALK-6363> P2 Warnings 
popup during installing RealSense sample app

XWALK-6447<https://crosswalk-project.org/jira/browse/XWALK-6447> P2 RealSense 
WebAPI is not right name

XWALK-6551<https://crosswalk-project.org/jira/browse/XWALK-6551> P2 [RS] 
PhotoCapture and Face samples won't work with Crosswalk-19.48.498.0

XWALK-6506<https://crosswalk-project.org/jira/browse/XWALK-6506> P2 [Face] 
Entry Face sample, should not into preview status before clicking start button

XWALK-6534<https://crosswalk-project.org/jira/browse/XWALK-6534> P2 [RS][Spec] 
Remove the unofficial draft text and watermark

XWALK-6448<https://crosswalk-project.org/jira/browse/XWALK-6448> [RS] 
crosswalk-app-tool should package app using RealSense extensions into msi

XWALK-6607<https://crosswalk-project.org/jira/browse/XWALK-6607> [RS] Fix typo 
in package_sample.py

XWALK-6462<https://crosswalk-project.org/jira/browse/XWALK-6462> [RS][Spec] 
License file link is pointing to otcshare repo

XWALK-6400<https://crosswalk-project.org/jira/browse/XWALK-6400> [RS] Add 
RealSense API examples into spec

XWALK-6401<https://crosswalk-project.org/jira/browse/XWALK-6401> [RS] Add DEP 
API examples into spec

XWALK-6402<https://crosswalk-project.org/jira/browse/XWALK-6402> [RS] Add SP 
API examples into spec

XWALK-6403<https://crosswalk-project.org/jira/browse/XWALK-6403> [RS] Add Face 
API examples into spec



RealSense Samples Testing Details:
Samples

Checkpoint

RealSense Extensions Crosswalk samples (v19.6.0 release)

Comments

Application

 

PASS

 

Scene Perception

Init

PASS

 

Destroy

PASS

 

Reset

PASS

 

StartSP

PASS

 

StopSP

PASS

 

Toggle Reconstruction

PASS

 

Save Mesh

PASS

 

Volume Preview

PASS

 

Meshing Reconstrution

PASS

 

Face Tracking and Recognition

Resolution (QVGA@60FPS)

FAIL

XWALK-6650 [RealSense] Unable to detect face when resolution set to 
"QVGA@60FPS".<https://crosswalk-project.org/jira/browse/XWALK-6650>

Resolution (VGA@60FPS)

PASS

Resolution (VGA@30FPS)

PASS

 

Resolution (HD@30FPS)

PASS

 

Resolution (Full HD@30FPS)

PASS

 

Start

PASS

 

Stop

PASS

 

Show Depth

PASS

 

Set

FAIL

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Get

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Default

PASS

 

Tracking Mode (color_depth)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Tracking Mode (color)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Tracking Strategy (appearance_time)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Tracking Strategy (closest_farthest)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Tracking Strategy (farthest_closest)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Tracking Strategy (left_right)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Tracking Strategy (right_left)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Detection (Enable)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Detection (Max number of faces)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Landmarks (Enable)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Landmarks (Max number of faces)

BLOCK

XWALK-6635 [REG] Set function is unable to work in Face 
Module<https://crosswalk-project.org/jira/browse/XWALK-6635>

Recognition (Enable)

PASS

 

Register

PASS

 

Unregister

PASS

 

Depth Enabled Photography -> PhotoCapture

Take Photo

PASS

 

Resolution (Full HD@30FPS)

PASS

 

Resolution (HD@30FPS)

PASS

 

Resolution (VGA@60FPS)

PASS

 

Resolution (QVGA@60FPS)

PASS

 

Show Depth

PASS

 

Depth Enabled Photography -> EnhancedPhoto

Load

PASS

 

Save

PASS

 

Set Sticker

PASS

 

Measure

PASS

 

Refocus

PASS

 

Paste OnPlane

PASS

 

Color Pop

PASS

 

Depth Enabled Photography -> Photo

Load Photo

PASS

 

QueryImage

PASS

 

QueryContainerrImage

PASS

 

QuertDepthImage

PASS

 

ResetContainerImage

PASS

 

Depth Enabled Photography -> PhotoUtils

Load

PASS

 

Save

PASS

 

Color Resize

PASS

 

Common FOV

PASS

 

Depth Resize

PASS

 

Depth Enhance

PASS

 

Depth Quality

PASS

 

Photo Crop

FAIL

XWALK-6632 [REG] Crop photo cannot save when the selected cropped field is very 
small.<https://crosswalk-project.org/jira/browse/XWALK-6632>

Photo Rotate

PASS

 

Depth Enabled Photography -> Segmentation

Load

PASS

 

Save

PASS

 

Restart

PASS

 

Undo

PASS

 

Redo

PASS

 

Depth Enabled Photography -> MotionEffect

Load Photo

PASS

 

Left/Right

PASS

 

Up/Down

PASS

 

Forward/Back

PASS

 

Zoom

PASS

 

Yaw

PASS

 

Pitch

PASS

 

Roll

PASS

 




Crosswalk Web API Realsense Testing Details
Case ID

Release  v19.6.0

Comments

Total TCs

Pass Rate

RealSense/Enhanced_photography

68

99%

Exist bug: XWALK-6642<https://crosswalk-project.org/jira/browse/XWALK-6642>

RealSense/Face

32

94%

Exist bug: <https://crosswalk-project.org/jira/browse/XWALK-6642> 
XWALK-6643<https://crosswalk-project.org/jira/browse/XWALK-6643>

RealSense/Realsense

2

100%

RealSense/scene_perception

52

92%

Exist bug: XWALK-6642<https://crosswalk-project.org/jira/browse/XWALK-6642>, 
XWALK-6644<https://crosswalk-project.org/jira/browse/XWALK-6644>


Test Binaries:
https://github.com/crosswalk-project/realsense-extensions-crosswalk/releases/download/v19.6.0/realsense_extensions_v19.6.0.zip
https://github.com/crosswalk-project/realsense-extensions-crosswalk/releases/download/v19.6.0/rs_sample_v19.6.0.zip
https://download.01.org/crosswalk/releases/crosswalk/windows/canary/19.48.498.0/crosswalk64-19.48.498.0.zip
Github Test Suite Links: 
https://github.com/crosswalk-project/crosswalk-test-suite/
Test Environment
-----------------------
HP Spectre x2




Thanks,
Crosswalk QA team
_______________________________________________
Crosswalk-dev mailing list
Crosswalk-dev@lists.crosswalk-project.org
https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev

Reply via email to