vegarsti commented on issue #13567: URL: https://github.com/apache/datafusion/issues/13567#issuecomment-2501727351
Oh this is already supported, I didn't read the code well enough. `read_parquet` takes a `ParquetReadOptions` which has a `pub file_extension`, which defaults to `.parquet`. https://github.com/apache/datafusion/blob/18fc103a403ab0efe5245dd4352f3f3b93c2a4fe/datafusion/core/src/datasource/file_format/options.rs#L217-L227 So I just need to swap that out: ``` let df = ctx .read_parquet( uri, ParquetReadOptions { file_extension: "", table_partition_cols: vec![], parquet_pruning: None, skip_metadata: None, schema: None, file_sort_order: vec![], }, ) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
