jackye1995 commented on issue #2168: URL: https://github.com/apache/iceberg/issues/2168#issuecomment-768870857
In general, each compute engine has its own page to explain loading custom catalog, that's why only spark example is given in AWS page. Probably good to add this note in the AWS page. I am gathering the small fixes for the 0.11 website right now, I will update them all at once, thanks for the suggestion. To answer your question around Flink, use the guide here: https://iceberg.apache.org/flink/#custom-catalog, the minimum you need is: ``` CREATE CATALOG my_catalog WITH ( 'type'='iceberg', 'catalog-impl'='org.apache.iceberg.aws.glue.GlueCatalog', 'warehouse'='s3://my-bucket/my/key/prefix' ); ``` AWS credentials are accessed through the default credential chain that tries to retrieve credentials in a series of approaches: https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/credentials.html If you need more customization such as endpoint, you can load your own AwsClientFactory through the guide https://iceberg.apache.org/aws/#aws-client-customization ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
