thisisnic commented on issue #37428: URL: https://github.com/apache/arrow/issues/37428#issuecomment-7038790211
This still happens on 26.0.0: `pq.read_table()` on a file with duplicate column names fails with `Multiple matches for FieldRef.Name(colA)`, while `pq.ParquetFile(path).read()` works. It is the same dataset limitation tracked in #24407 (see also #33552 for the scanner design question), so I'm closing this as a duplicate of that one. The all-null result when passing `schema=` isn't specific to duplicate names: the dataset reader matches the schema to the file's columns by name, so columns named `col1` and `col2` that aren't in the file come back as nulls. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
