Anna Qin created BEAM-10784:
-------------------------------
Summary: Spark portable streaming: failing window-related tests
Key: BEAM-10784
URL: https://issues.apache.org/jira/browse/BEAM-10784
Project: Beam
Issue Type: Bug
Components: runner-spark
Reporter: Anna Qin
When running validatesPortableRunnerStreaming on Spark, the following tests
fail. They all seem to be related to windowing. The underlying issue may have
to do with incorrect handling of watermarks (they may not be getting held back
properly?).
Fails from timeout:
PAssertTest. testWindowedContainsInAnyOrder
PAssertTest. testWindowedSerializablePredicate
WindowTest. testNoWindowFnDoesNotReassignWindows
Fails from incorrect assertion:
CombineTest$BasicTests. testHotKeyCombining
Fails from empty assertion ("Expected: iterable with items [*] in any order
but: no item matches: * in []"):
CombineTest$WindowingTests. testFixedWindowsCombine
CombineTest$WindowingTests. testSessionsCombine
ReshuffleTest. testReshuffleAfterFixedWindowsAndGroupByKey
ReshuffleTest. testReshuffleAfterSessionsAndGroupByKey
ReshuffleTest. testReshuffleAfterSlidingWindowsAndGroupByKey
CoGroupByKeyTest. testCoGroupByKeyWithWindowing
WindowingTest. testMergingWindowing
WindowingTest. testNonPartitioningWindowing
WindowingTest. testPartitioningWindowing
WindowingTest. testWindowPreservation
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
