timvw commented on issue #14016:
URL: https://github.com/apache/datafusion/issues/14016#issuecomment-2572638847
Manually tinkering with the config will make the inference work again...
```rust
let table_path = ListingTableUrl::parse(&data_path)?;
let config = ListingTableConfig::new(table_path);
let config_with_opts = config.infer_options(&ctx.state()).await?;
let mut opts = config_with_opts.clone().options.unwrap();
opts.file_extension = ".json.gz".to_string();
let fmt = JsonFormat::default().with_options(JsonOptions {
compression: CompressionTypeVariant::GZIP,
schema_infer_max_rec: Some(100),
});
opts.format = Arc::new(fmt);
let mut config_with_tweaked_opts = config_with_opts;
config_with_tweaked_opts.options = Some(opts);
let config_with_schema =
config_with_tweaked_opts.infer_schema(&ctx.state()).await?;
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
