johnclara edited a comment on pull request #1844: URL: https://github.com/apache/iceberg/pull/1844#issuecomment-742636797
Thanks this makes a lot of sense! > > ``` > > * CatalogProperties: I'm not sure what these are? > > ``` > > In the context of Spark, it is the `Map<String, String> argument` of spark source. It is just generalized also for Flink (and any other use case that can accept a map). So CatalogProperties are the arguments that are passed in. What about the HMS Metastore properties (or any other information that is kept alongside the pointer to the iceberg table)? In our Dynamo implementation, we only have two columns: TableName Location but I could also see having other columns (eg "this is a gcp table. this is an aws table"). These are entirely ignored? I was confusing these Metastore properties with Catalog properties. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
