mbutrovich opened a new issue, #15763:
URL: https://github.com/apache/datafusion/issues/15763

   ### Describe the bug
   
   The logic that coerces timestamps to a different resolution iterates through 
fields and uses their key in the Parquet schema as a key to match against the 
Arrow schema.
   
   
https://github.com/apache/datafusion/blob/66a7423a4e9116d30d7defc56216f4e7a7bcf7ac/datafusion/datasource-parquet/src/file_format.rs#L586
   
   However, this is insufficient (consider a schema with structs each with an 
`id` field) to disambiguate nested fields. I think we might need a combination 
of Parquet ColumnDesc's path and a normalized Arrow schema to fix the mapping.
   
   ### To Reproduce
   
   _No response_
   
   ### Expected behavior
   
   _No response_
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to