Hi dev, I'm Weston, I've been working on the Arrow project lately. As the Arrow project implements more transformations of data I've been wondering how we should treat the field_id property. For some concrete examples:
* Filtering a table by column (it seems the field_id should remain unchanged) * Filtering a table by rows (it seems the field_id should remain unchanged) * Filling in null values with a placeholder value (the data is changed so ???) * Casting a field to a different data type (the meaning of the data has changed so ???) * Combining two fields into a third field (it seems the third field should have no field_id) I'm reaching out to the Parquet community to solicit input as you have expertise/experience around the motivation behind the field_id property and its uses. Thanks, -Weston Pace
