mneedham opened a new pull request, #11196: URL: https://github.com/apache/pinot/pull/11196
This is a bugfix for an issue that was introduced when upgrading the AWS S3 library from version 2.14.28: ``` - <aws.sdk.version>2.14.28</aws.sdk.version> + <aws.sdk.version>2.20.83</aws.sdk.version> ``` This commit: ``` commit 0420414fc2a5408dc7aa32fdb9d359763fc3cb34 Author: Xiaobing <[email protected]> Date: Tue Jun 13 10:08:00 2023 -0700 bump awssdk version for a bugfix on http conn leakage (#10898) * bump awssdk version for a bugfix on http conn leakage * use latest s3mock and fix S3PinotFSTest ``` This causes a problem when trying to use MinIO, which is S3 API compatible. The default of how URIs are resolved seems to have got messed up for MInIO, resulting in the following exception: ``` Caused by: java.net.UnknownHostException: pinot-controller.minio at java.net.InetAddress$CachedAddresses.get(InetAddress.java:797) ~[?:?] at java.net.InetAddress.getAllByName0(InetAddress.java:1533) ~[?:?] at java.net.InetAddress.getAllByName(InetAddress.java:1386) ~[?:?] at java.net.InetAddress.getAllByName(InetAddress.java:1307) ~[?:?] at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[pinot-s3-0.13.0-SNAPSHOT-shaded.jar:0.13.0-SNAPSHOT-fe2b013a657e1ad6ac508a9a37933961bc4c408b] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[pinot-s3-0.13.0-SNAPSHOT-shaded.jar:0.13.0-SNAPSHOT-fe2b013a657e1ad6ac508a9a37933961bc4c408b] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[pinot-s3-0.13.0-SNAPSHOT-shaded.jar:0.13.0-SNAPSHOT-fe2b013a657e1ad6ac508a9a37933961bc4c408b] at software.amazon.awssdk.http.apache.internal.conn.ClientConnectionManagerFactory$DelegatingHttpClientConnectionManager.connect(ClientConnectionManagerFactory.java:86) ~[pinot-s3-0.13.0-SNAPSHOT-shaded.jar:0.13.0-SNAPSHOT-fe2b013a657e1ad6ac508a9a37933961bc4c408b] ``` This [StackOverflow thread ](https://stackoverflow.com/questions/72205086/amazonss3client-throws-unknownhostexception-if-attempting-to-connect-to-a-local) describes the issue and a way to work around it. I'm not sure whether setting this flag would cause an issue for other S3 API implementations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
