[
https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117469#comment-16117469
]
Eugene Kirpichov commented on BEAM-2671:
----------------------------------------
Aviem - my apologies for misunderstanding previous comments on the JIRA. Could
you elaborate on "If we want streaming to be working in Spark runner in 2.1.0
we should fix this for 2.1.0" - I'd like to understand to what extent is Spark
runner streaming currently broken in 2.1.0, given that it passes the other SDK
ValidatesRunner tests. Are those tests insufficient / should we have more
coverage there?
Has anybody run any serious Spark streaming pipelines on a cluster against
2.1.0 RC2? JB - I believe you said you did; can you detail what kind of
pipeline you ran, and does it potentially address Aviem's concerns?
> CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark
> runner
> --------------------------------------------------------------------------------
>
> Key: BEAM-2671
> URL: https://issues.apache.org/jira/browse/BEAM-2671
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Etienne Chauchot
> Assignee: Jean-Baptiste Onofré
> Fix For: 2.1.0
>
>
> Error message:
> Flatten.Iterables/FlattenIterables/FlatMap/ParMultiDo(Anonymous).out0:
> Expected: iterable over [] in any order
> but: Not matched: "late"
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
