Lukasz Gajowy created BEAM-5163:
-----------------------------------
Summary: TFRecordIOIT fails on Spark and Flink
Key: BEAM-5163
URL: https://issues.apache.org/jira/browse/BEAM-5163
Project: Beam
Issue Type: Bug
Components: testing
Reporter: Lukasz Gajowy
When run on Spark or Flink remote cluster, TFRecordIOIT fails with the
following stacktrace:
{code:java}
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll FAILED
org.apache.beam.sdk.Pipeline$PipelineExecutionException:
java.io.FileNotFoundException: No files found for spec: PREFIX_1534520885787*.
at
org.apache.beam.runners.spark.SparkPipelineResult.beamExceptionFrom(SparkPipelineResult.java:66)
at
org.apache.beam.runners.spark.SparkPipelineResult.waitUntilFinish(SparkPipelineResult.java:99)
at
org.apache.beam.runners.spark.SparkPipelineResult.waitUntilFinish(SparkPipelineResult.java:87)
at org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:116)
at org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:61)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT.writeThenReadAll(TFRecordIOIT.java:128)
Caused by:
java.io.FileNotFoundException: No files found for spec:
PREFIX_1534520885787*.{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
