[
https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110962#comment-16110962
]
Jean-Baptiste Onofré commented on BEAM-2671:
--------------------------------------------
Just to be clear. I checked out on commit
935c077341de580dddd4b29ffee3926795acf403 and ran a build with validate runner.
Result is:
{code}
[INFO] Running
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest
[ERROR] Tests run: 10, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 30.695
s <<< FAILURE! - in
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest
[ERROR]
testFirstElementLate(org.apache.beam.runners.spark.translation.streaming.CreateStreamTest)
Time elapsed: 3.198 s <<< FAILURE!
java.lang.AssertionError:
Flatten.Iterables/FlattenIterables/FlatMap/ParMultiDo(Anonymous).out0:
Expected: iterable over [] in any order
but: Not matched: "late"
at
org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:170)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:366)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:358)
at
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testFirstElementLate(CreateStreamTest.java:233)
...
{code}
corresponding to the same failure we have on master.
Now, if I checkout on the commit just before
935c077341de580dddd4b29ffee3926795acf403
(bd631b89a8434f0756e1596875e89013fb623ab5) and I do the same build, I have:
{code}
[INFO] Running
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest
[ERROR] Tests run: 10, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 55.192
s <<< FAILURE! - in
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest
[ERROR]
testMultipleStreams(org.apache.beam.runners.spark.translation.streaming.CreateStreamTest)
Time elapsed: 3.689 s <<< FAILURE!
java.lang.AssertionError:
WindowStrings/Flatten.PCollections.out:
Expected: iterable over ["foo", "bar"] in any order
but: No item matches: "foo", "bar" in []
at
org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:170)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:366)
at org.apache.beam.sdk.testing.PAssert.that(PAssert.java:358)
at
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testMultipleStreams(CreateStreamTest.java:284)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
...
{code}
So, {{CreateStreamTest}} also fails but with a different cause and on
{{testMultipleStream}} (whereas on master and on commit mentioned above, it
fails on {{testFirstElementLate}}).
> CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark
> runner
> --------------------------------------------------------------------------------
>
> Key: BEAM-2671
> URL: https://issues.apache.org/jira/browse/BEAM-2671
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Etienne Chauchot
> Assignee: Jean-Baptiste Onofré
> Fix For: 2.1.0, 2.2.0
>
>
> Error message:
> Flatten.Iterables/FlattenIterables/FlatMap/ParMultiDo(Anonymous).out0:
> Expected: iterable over [] in any order
> but: Not matched: "late"
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
