saathwik-tk commented on issue #33497: URL: https://github.com/apache/beam/issues/33497#issuecomment-2576838322
Hi @ahmedabu98 , I am using hive catalog, for which hive metastore running at port 9083, Yes, I have created the iceberg table beforehand with the query, CREATE TABLE catalog_name.schema_name.table_name( field1 varchar, field2 varchar... ) WITH (format = 'PARQUET', format_version = 2, location = 's3a://bucket_name/storage_path', partitioning = ARRAY['asdt']) I have created this as using Trino Iceberg Connector, referring to https://trino.io/docs/current/connector/iceberg.html and my configuration map looks as below, Map<String,Object> configProperties = ImmutableMap.<String,Object>builder() .put("io-impl","org.apache.iceberg.aws.s3.S3FileIO") .put("catalog-impl","org.apache.iceberg.hive.HiveCatalog") // few s3 configurations as required .build(); Map<String, Object> catalogConfig = ImmutableMap.<String, Object>builder() .put("uri","<my-thrift-uri>:<my-port-no>") .put("warehouse","<my-s3-warehouse-path>") .put("type", "hive") .build(); ImmutableMap<String, Object> config = ImmutableMap.<String, Object>builder() .put("table", "iceberg.iceberg_table") .put("catalog_name", "iceberg_catalog") .put("catalog_properties", catalogConfig) .put("config_properties",configProperties) .build(); -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
