Lukasz Gajowy created BEAM-6697:
-----------------------------------
Summary: ParquetIO Performance test is failing
Key: BEAM-6697
URL: https://issues.apache.org/jira/browse/BEAM-6697
Project: Beam
Issue Type: New Feature
Components: io-java-parquet, test-failures
Reporter: Lukasz Gajowy
Relevant failure logs:
{code:java}
Caused by: java.lang.RuntimeException:
org.apache.beam.sdk.io.parquet.ParquetIO$ReadFiles$BeamParquetInputFile@2de8303e
is not a Parquet file (too small length: -1)
at
org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:514)
at
org.apache.parquet.hadoop.ParquetFileReader.<init>(ParquetFileReader.java:689)
at
org.apache.parquet.hadoop.ParquetFileReader.open(ParquetFileReader.java:595)
at
org.apache.parquet.hadoop.ParquetReader.initReader(ParquetReader.java:152)
at org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:135)
at
org.apache.beam.sdk.io.parquet.ParquetIO$ReadFiles$ReadFn.processElement(ParquetIO.java:221){code}
Full logs can be found here:
[https://builds.apache.org/view/A-D/view/Beam/view/PerformanceTests/job/beam_PerformanceTests_ParquetIOIT/|https://builds.apache.org/view/A-D/view/Beam/view/PerformanceTests/job/beam_PerformanceTests_ParquetIOIT/1096/console]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
