mapleFU commented on PR #35798: URL: https://github.com/apache/arrow/pull/35798#issuecomment-1569685796
Yeah, I know what you mean, however, Parquet files in a dataset might has different schema, the most typical case is at: https://iceberg.apache.org/docs/latest/evolution/ Assume user insert a column, name might be better than FieldIndex, because it can maintain some consistency. If we're sure we don't need to support that case, or user can make sure that file has same schema, then I'm +1 on this patch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
