Revanth14 opened a new issue, #1148: URL: https://github.com/apache/iceberg-go/issues/1148
### Apache Iceberg version main (development) ### Please describe the bug 🐞 ## Issue When `s3.connect-timeout` or `s3.proxy-uri` is set, `ParseAWSConfig` populates `awscfg.HTTPClient`. The nil guard in `createS3Bucket` then skips applying the tuned transport options: - `MaxIdleConnsPerHost: 256` - `MaxIdleConns: 256` - `MaxConnsPerHost: 256` - `IdleConnTimeout: 90s` As a result, these code paths fall back to the AWS SDK defaults, including `MaxIdleConnsPerHost: 10`. This can hurt highly parallel scans on tables with many files. ## Possible Fixes - Factor a shared `newTunedBuildableClient()` helper and use it in both `ParseAWSConfig` and `createS3Bucket`. - Or apply the tuning inside `ParseAWSConfig` directly. Flagged during review of #1141. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
