batyrchary commented on issue #644: URL: https://github.com/apache/iceberg-go/issues/644#issuecomment-3765687147
I am still seeing this issue even after applying fixes from #666 and #667. Below is my simplified transaction function. I have a single pod writing to an Iceberg table using Nessie as a REST catalog. Despite this setup, I am still getting the following warning: 2026/01/18 19:42:13 A blob.Writer writing to "u011720265/numberdpattrs_f030e24e-3c91-4a94-a323-35b3e176eac9/metadata/3ce12426-33ad-4b1f-ba33-5785663bd484-m2.avro" was never closed (github.com/apache/[email protected]/io/blob.go:178) it is followed by error: time="2026-01-18T19:42:12Z" level=error msg="Error in appending recordReader to transaction (transaction) - blob (key \"u011720265/numberdpattrs_f030e24e-3c91-4a94-a323-35b3e176eac9/metadata/b1f32157-1731-420b-90c9-7a206b029370-m2.avro\") (code=NotFound): operation error S3: GetObject, https response error StatusCode: 404, RequestID: phx-1:ge7kLmOBIvlIQQCiYKKkzHJiQMQlc9QFybP4Tpzt9ug9K2zEMqSBANXyoPwBIxiG, HostID: , NoSuchKey: " I am using following function to make transaction. ``` func transaction(ctx context.Context, dataTable *icebergtbl.Table, arrowSchema *arrow.Schema, arrowRecords []arrow.RecordBatch, icebergProperties iceberg.Properties) (*icebergtbl.Table, error) { txn := dataTable.NewTransaction() recordReader, err := array.NewRecordReader(arrowSchema, arrowRecords) if err != nil { log.Errorf("Error in creating new record reader (transaction) - %s", err) return nil, err } defer recordReader.Release() err = txn.Append(ctx, recordReader, icebergProperties) if err != nil { log.Errorf("Error in appending recordReader to transaction (transaction) - %s", err) return nil, err } dataTable, err = txn.Commit(ctx) if err != nil { log.Errorf("Error in committing to table (transaction)- %s", err) return nil, err } return dataTable, nil } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
