Tristan Davolt created PARQUET-1773:
---------------------------------------

             Summary: Parquet file in invalid state while writing to S3 when 
calling ParquetWriter.write
                 Key: PARQUET-1773
                 URL: https://issues.apache.org/jira/browse/PARQUET-1773
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
    Affects Versions: 1.10.0
            Reporter: Tristan Davolt


This may be related to 
[PARQUET-632|https://issues.apache.org/jira/browse/PARQUET-632]. I am also 
writing parquet to S3, but I am calling ParquetWriter.write directly.

Exception:
java.io.IOException
Message:
The file being written is in an invalid state. Probably caused by an error 
thrown previously. Current state: BLOCK
Stacktrace:
{code:java}
org.apache.parquet.hadoop.ParquetFileWriter$STATE.error(ParquetFileWriter.java:168)org.apache.parquet.hadoop.ParquetFileWriter$STATE.startBlock(ParquetFileWriter.java:160)org.apache.parquet.hadoop.ParquetFileWriter.startBlock(ParquetFileWriter.java:291)org.apache.parquet.hadoop.InternalParquetRecordWriter.flushRowGroupToStore(InternalParquetRecordWriter.java:171)org.apache.parquet.hadoop.InternalParquetRecordWriter.close(InternalParquetRecordWriter.java:114)org.apache.parquet.hadoop.ParquetWriter.close(ParquetWriter.java:308)
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to