lst-codes commented on issue #83: URL: https://github.com/apache/arrow-datafusion/issues/83#issuecomment-979356704
Is it expected that datafusion cannot currently read parquets with nested objects at all, even if we never utilize the column? While attempting to read a parquet that has a nested object, I get an error because `arrow_reader::get_schema` returns num_fields counting nested objects as a single field, but `row_groups.columns` flattens and has more columns than `num_fields` returns. Should the ability to read parquets with nested objects be implemented (only panicking if transformations utilizing that field), or would it be better to just work on this issue as a whole? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
