velctor edited a comment on pull request #3276:
URL: https://github.com/apache/iceberg/pull/3276#issuecomment-947383886
> @velctor, can you post the problem that you're seeing? If you have a
stream that was closed by the finalizer, how is anything still using it to hit
the `Stream closed` error?
The error `Stream closed` occurs when the created `stream` is used to read
the deletefile. The specific error is as follows:
```
Caused by: org.apache.iceberg.exceptions.RuntimeIOException:
java.io.IOException: Stream is closed!
at
org.apache.iceberg.parquet.ParquetReader$FileIterator.advance(ParquetReader.java:135)
at
org.apache.iceberg.parquet.ParquetReader$FileIterator.next(ParquetReader.java:112)
at
org.apache.iceberg.io.CloseableIterable$ConcatCloseableIterable$ConcatCloseableIterator.next(CloseableIterable.java:206)
at
org.apache.iceberg.io.CloseableIterable$4$1.next(CloseableIterable.java:113)
at
org.apache.iceberg.relocated.com.google.common.collect.Iterators.addAll(Iterators.java:356)
at
org.apache.iceberg.relocated.com.google.common.collect.Iterables.addAll(Iterables.java:320)
at org.apache.iceberg.deletes.Deletes.toEqualitySet(Deletes.java:83)
at
org.apache.iceberg.data.DeleteFilter.applyEqDeletes(DeleteFilter.java:137)
at
org.apache.iceberg.data.DeleteFilter.applyEqDeletes(DeleteFilter.java:166)
at org.apache.iceberg.data.DeleteFilter.filter(DeleteFilter.java:112)
at
io.trino.plugin.iceberg.IcebergPageSource.getNextPage(IcebergPageSource.java:125)
... 12 more
Caused by: java.io.IOException: Stream is closed!
at
org.apache.hadoop.hdfs.DFSInputStream.seek(DFSInputStream.java:1453)
at
org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:65)
at
org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:65)
at
org.apache.parquet.hadoop.util.H2SeekableInputStream.seek(H2SeekableInputStream.java:60)
at
org.apache.parquet.hadoop.ParquetFileReader$ConsecutivePartList.readAll(ParquetFileReader.java:1687)
at
org.apache.parquet.hadoop.ParquetFileReader.readNextRowGroup(ParquetFileReader.java:925)
at
org.apache.iceberg.parquet.ParquetReader$FileIterator.advance(ParquetReader.java:133)
... 22 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
