luoyuxia commented on issue #2412: URL: https://github.com/apache/fluss/issues/2412#issuecomment-3771377517
> > > Comparing the dependencies of the two versions of `hadoop-aws`, I found that version 3.4.0 has an additional `bundle-2.23.19.jar`, which is 500MB in size. see: https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html#Other_S3_Connectors > > > > > > I think we can exclude them. > > [@luoyuxia](https://github.com/luoyuxia) I tested it and found that excluding this jar causes `NoAwsCredentialsException` to fail because its parent class `SdkClientException` comes from this jar, and I haven't found a replacement for `NoAwsCredentialsException`. > > see: https://github.com/apache/fluss/blob/main/fluss-filesystems/fluss-fs-s3/src/main/java/org/apache/fluss/fs/s3/token/S3DelegationTokenReceiver.java#L66 and https://github.com/apache/fluss/blob/main/fluss-filesystems/fluss-fs-s3/src/main/java/org/apache/fluss/fs/s3/token/DynamicTemporaryAWSCredentialsProvider.java#L49 > > I also checked the `Flink` and `Paimon` projects and found that they depends on Hadoop version 3.3.4, which doesn't have this issue. Thanks for diving into it. I think we can replace `NoAwsCredentialsException` with other exception. We don't required the exception to be `NoAwsCredentialsException`. It can be any suitable exception. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
