rdblue commented on pull request #3276: URL: https://github.com/apache/iceberg/pull/3276#issuecomment-973224336
Thanks for the logs! It's always helpful to have the full picture. I think what's happening is that Trino is extracting the underlying `FsDataInputStream` and using it directly. The fix should be for whatever in Trino is doing that to keep a reference to the `HadoopSeekableInputStream` that Iceberg creates. I wasn't expecting to see `io.trino.plugin` in the stack trace. That tells me that Trino is injecting something that is non-Iceberg. Since Iceberg only accesses the `FsDataInputStream` from the objects that reference it, that's why I thought it wasn't possible for this to be the Iceberg finalizer. But if something gets the underlying stream and discards the Iceberg wrapper, that could cause this problem. @electrum, can you help us take a look at this problem? Looks like something is getting the underlying stream from Iceberg and keeping a reference past when the reference to the Iceberg stream is garbage collected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
