Hi,
Using 11.1 on OSX I getting failures mostly bitmaps (87 failures), Alex when
you redid the baselines did you check if the tests passed on OSX?
What do we do when in this case when it fairly obvious that is the tests that
have issues and "fixing" them on one platform breaks them for another?
With the MP_* test failures I'm seeing a broken image - should this be the case?
Here's list of failures:
[java] =====================================================
[java] Failed:
[java] =====================================================
[java] MarshallPlan/RSLs/allowDomain_Tests allowDomain_rsl Failed
SetProperty(setup:step 12) Timeout waiting for complete from sl2
[java] MarshallPlan/RSLs/allowDomainFalse_Tests allowDomainFalse_rsl
Failed SetProperty(setup:step 12) Timeout waiting for complete from sl2
[java] MarshallPlan/Controls/MP_Controls_Tests MP_EditableList_remote
Failed SetProperty(body:step 1) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_EditableDataGrid_untrusted Failed SetProperty(setup:step 7) Timeout waiting
for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_ButtonWithEmbeddedIcon_untrusted Failed SetProperty(setup:step 8) Timeout
waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_OpeningTreeNodes_untrusted Failed SetProperty(setup:step 8) Timeout waiting
for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_ColorPicker_swatchPanel_untrusted Failed SetProperty(setup:step 8) Timeout
waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_ColorPicker_closeOnMouseDown_untrusted Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_ColorPicker_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step
8) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_DateField_calendar_untrusted Failed SetProperty(setup:step 8) Timeout
waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_DateField_closeOnMouseDown_untrusted Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests
MP_DateField_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_ComboBox_dropdown_untrusted Failed SetProperty(setup:step 8) Timeout
waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_ComboBox_closeOnMouseDown_untrusted Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_ComboBox_closeOnMouseDownOutside_untrusted Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_PopUpMenuButton_dropdown_untrusted Failed SetProperty(setup:step 7) Timeout
waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_PopUpMenuButton_closeOnMouseDown_untrusted Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_PopUpMenuButton_closeOnMouseDownOutside_untrusted Failed
SetProperty(setup:step 7) Timeout waiting for complete from swf1
[java] MarshallPlan/Controls/MP_Controls_Tests2
MP_EditableDataGrid_errorString_untrusted Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_CursorManager_Tests
MP_CursorManager_DividedBox_remote Failed SetProperty(setup:step 9) Timeout
waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests
DragManager_DragWithinSubApp_remote Failed SetProperty(setup:step 6) Timeout
waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests
DragManager_DragMainToSubApp_remote Failed SetProperty(setup:step 6) Timeout
waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests
DragManager_DragSubAppToMain_remote Failed SetProperty(setup:step 7) Timeout
waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_DragManager_Tests
DragManager_CustomDrag_UnTrusted Failed SetProperty(setup:step 8) Timeout
waiting for complete from swfLoader1
[java] MarshallPlan/ManagerTests/MP_NestedSWF_FocusManager_Tests
NestedSWF_FocusManager_Tab_fromLocalhost Failed SetProperty(setup:step 9)
Timeout waiting for complete from topSWF
[java] MarshallPlan/ManagerTests/MP_NestedSWF_FocusManager_Tests
NestedSWF_FocusManager_ShiftTab_fromLocalhost Failed SetProperty(setup:step 9)
Timeout waiting for complete from topSWF
[java] MarshallPlan/ManagerTests/MP_NestedSWF_FocusManager_Tests
NestedSWF_FocusManager_ShiftTab_fromLocalhost_compatibilityMode Failed Timed out
[java] MarshallPlan/ManagerTests/MP_FocusManager_Tests
MarshallPlan_FocusManager_Tab_fromLocalhost Failed SetProperty(setup:step 9)
Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_FocusManager_Tests
MarshallPlan_FocusManager_ShiftTab_fromLocalhost Failed SetProperty(setup:step
9) Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests
MP_PopUpManager_addPopUp_modal_remote Failed SetProperty(setup:step 8) Timeout
waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests
MP_PopUpManager_createPopUP_nonmodal_remote Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests
MP_PopUpManager_addPopUp_nonmodal_remote Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests
MP_PopUpManager_centerPopUp_nonmodal_remote Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests
MP_PopUpManager_centerPopUp_modal_remote Failed SetProperty(setup:step 8)
Timeout waiting for complete from swf1
[java] MarshallPlan/ManagerTests/MP_PopUpManager_Tests
MP_PopUpManager_dragUnTrustedPopUp_remote Failed Timed out
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests
MP_Spark_Component_toolTip_untrusted Failed SetProperty(setup:step 8) Timeout
waiting for complete from swf1
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests
MP_Spark_Component_TextAreaScrolling_untrusted Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests2
MP_Spark_Component_DropDownList_untrusted Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Spark/MP_Spark_Controls_Tests2
MP_Spark_Component_Effects_untrusted Failed SetProperty(setup:step 7) Timeout
waiting for complete from swf2
[java] MarshallPlan/Events/MP_Events_Tests MP_SandboxRootMouseEvent_click
Failed SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseDown Failed SetProperty(setup:step 6) Timeout
waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseUp Failed SetProperty(setup:step 7) Timeout
waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseMove Failed SetProperty(setup:step 7) Timeout
waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_click_shiftKey Failed SetProperty(setup:step 6)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseDown_shiftKey Failed SetProperty(setup:step 6)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseUp_shiftKey Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseMove_shiftKey Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseUp_buttonDown Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseMove_buttonDown Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_click_ctrlKey Failed SetProperty(setup:step 6)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseDown_ctrlKey Failed SetProperty(setup:step 6)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseUp_ctrlKey Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests
MP_SandboxRootMouseEvent_mouseMove_ctrlKey Failed SetProperty(setup:step 7)
Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_AddChildBridgeEvent Failed
SetProperty(setup:step 6) Timeout waiting for complete from swf1
[java] MarshallPlan/Events/MP_Events_Tests MP_RemoveChildBridgeEvent
Failed SetProperty(setup:step 4) Timeout waiting for complete from swf1
[java] PerModuleStyles/api/loadCSS_SubApp loadCSS_SubApp Failed
CompareBitmap(body:step 3) compare returned-3
[java] components/Charts/Area/Properties/AreaProperties
AreaSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties
AreaSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties
AreaSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties
AreaSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Area/Properties/AreaProperties
AreaSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Bar/Properties/BarProperties
BarSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Bar/Properties/BarProperties
BarSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Bar/Properties/BarProperties
BarSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Bubble/Properties/BubbleProperties
BubbleSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Bubble/Properties/BubbleProperties
BubbleSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Bubble/Properties/BubbleProperties
BubbleSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties
CandlestickSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties
CandlestickSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties
CandlestickSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties
CandlestickSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Candle/Properties/CandlestickProperties
CandlestickSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties
ColumnSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties
ColumnSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties
ColumnSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties
ColumnSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Column/Properties/ColumnProperties
ColumnSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties
HLOCSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties
HLOCSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties
HLOCSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties
HLOCSeries_axisRenderer_withPlacement Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/HLOC/Properties/HLOCProperties
HLOCSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties
PlotSeries_ChangeMinAndMax_LinearAxis Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties
PlotSeries_filterData_filterDataValues Failed CompareBitmap(body:step 1)
compare returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties
PlotSeries_multipleAxes_disabledDays Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] components/Charts/Plot/Properties/PlotProperties
PlotSeries_axisAtSeriesLevel Failed CompareBitmap(body:step 1) compare
returned[object BitmapData]
[java] spark/core/fxg/properties/fxgtemplate_tester filters_filters_blend
Failed CompareBitmap(body:step 1) compare returned[object BitmapData]
[java]
[java]
[java] =====================================================
[java] Passes: 0
[java] Fails: 87
[java] =====================================================
[java]
[java]
[java] Wrote summary to results.txt
[java] Wrote failures to failures.txt
Thanks,
Justin
