Tristan Davolt created PARQUET-1773:
---------------------------------------
Summary: Parquet file in invalid state while writing to S3 when
calling ParquetWriter.write
Key: PARQUET-1773
URL: https://issues.apache.org/jira/browse/PARQUET-1773
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.10.0
Reporter: Tristan Davolt
This may be related to
[PARQUET-632|https://issues.apache.org/jira/browse/PARQUET-632]. I am also
writing parquet to S3, but I am calling ParquetWriter.write directly.
Exception:
java.io.IOException
Message:
The file being written is in an invalid state. Probably caused by an error
thrown previously. Current state: BLOCK
Stacktrace:
{code:java}
org.apache.parquet.hadoop.ParquetFileWriter$STATE.error(ParquetFileWriter.java:168)org.apache.parquet.hadoop.ParquetFileWriter$STATE.startBlock(ParquetFileWriter.java:160)org.apache.parquet.hadoop.ParquetFileWriter.startBlock(ParquetFileWriter.java:291)org.apache.parquet.hadoop.InternalParquetRecordWriter.flushRowGroupToStore(InternalParquetRecordWriter.java:171)org.apache.parquet.hadoop.InternalParquetRecordWriter.close(InternalParquetRecordWriter.java:114)org.apache.parquet.hadoop.ParquetWriter.close(ParquetWriter.java:308)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)