tustvold opened a new issue #1736:
URL: https://github.com/apache/arrow-datafusion/issues/1736


   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   
   I wrote a test approximating
   
   ```
   let file = tempfile::tempfile();
   
   // ... write parquet data ...
   
   let mut context = ExecutionContext::new();
   context.register_parquet("t", file.path().as_str())
   context.sql("select column from t");
   ```
   
   This would result in "Invalid identifier" errors, effectively claiming the 
column didn't exist. I verified the file existed, had the correct columns, 
etc... I was very confused :laughing: 
   
   Eventually I tracked this down to the schema being inferred as empty if the 
extension is not ".parquet", this feels unexpected
   
   **Describe the solution you'd like**
   
   Either "register_parquet" should return an error if the extension is 
missing, or `FileFormat::infer_schema` should be more agnostic to file 
extensions.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to