I’m looking to migrate a partitioned parquet table to use iceberg. The issue I’ve run into is that the column order for the data varies wildly, which isn’t a problem for us normally (we just set mergeSchemas=true when reading), but presents a problem with iceberg because the iceberg.schema field isn’t set in the parquet footer. Is there any way to migrate this data over without rewriting the entire dataset?
- Migrating plain parquet tables to iceberg Kruger, Scott
- Re: Migrating plain parquet tables to iceberg Ryan Blue
- Re: Migrating plain parquet tables to iceberg Kruger, Scott
- Re: Migrating plain parquet tables to iceberg Ryan Blue
- Re: Migrating plain parquet tables to icebe... Kruger, Scott
