alexjo2144 opened a new issue, #438:
URL: https://github.com/apache/iceberg-go/issues/438
### Apache Iceberg version
None
### Please describe the bug 🐞
Hey iceberg-go team, @alexandre-normand and I have been trying out writes to
an Iceberg table from Go and have hit a snag.
When Trino is reading the table's manifest files produced by iceberg-go I
get the following error:
```
java.io.IOException: Incorrect file size (32417) for file (end of stream not
reached): s3://<path>
```
Checking the contents of the manifest list, each of the manifests
suspiciously has the exact same length:
```
trino> select length from iceberg.default."test_table$manifests";
length
--------
32417
32417
32417
```
Especially because the files are not all the same size:
```
> aws s3 ls s3://<path>/metadata/ | grep "m1.avro"
2025-05-23 15:54:19 35557
01f978e5-4086-452f-90f9-c9db46cda10d-m1.avro
2025-05-23 15:39:21 35649.
11931ea9-5fc5-4463-a8f3-9151c1305d89-m1.avro
2025-05-23 16:04:24 35762.
2460f4cd-aa95-4d98-b04d-4716799ca04a-m1.avro
2025-05-23 15:44:22 35679.
41254a5b-79d6-4a1d-a7ad-84a5c7302e01-m1.avro
2025-05-23 16:09:23 35604.
648ed2ee-adc4-4ee0-a88b-90bfb4c4967f-m1.avro
2025-05-23 15:49:22 35709.
8099f4d0-76f0-47d0-ab89-2037c7cd9aa4-m1.avro
2025-05-23 15:59:22 35671
b2032af6-6cdf-42f5-8c65-48b723b49e13-m1.avro
2025-05-23 15:34:22 34984.
ed847256-3e89-4a8e-aaa6-99389bc984c0-m1.avro
```
I haven't had a chance to dive too deep into the Go implementation yet but
my hunch is the manifest list is not fetching the actual size of the produced
Avro file after the write is flushed to object storage, and is instead using an
estimated count.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
