Hi Team,

This question is specifically on the iceberg-go library.  
I have a use case where I want to write the data files (avro & parquet files) 
using my own libraries.

Once the data files are written to the destination, I want to update the 
iceberg table just with the metadata, using a transaction. 
My particular interest is in the partition metadata.

I have tried the Transaction.AddFiles method, it works for parquet, where the 
iceberg-go library extracts the partition values from parquet files and it 
automatically updates the metadata.
However I can not use this approach for avro files, which does not these 
partition specific details.

So what should be the approach for
1. Without using iceberg-go libary, first create avro file. During this 
process, gather necessary meta data including the partition meta data. 
2. Now using the iceberg-go library, update the iceberg table metadata using a 
transaction

Thanks,
Ramesh.



Reply via email to