diqiu50 commented on issue #11342: URL: https://github.com/apache/gravitino/issues/11342#issuecomment-4608813430
## Glue Catalog UI Reference ### Provider ``` glue ``` --- ### Catalog Properties | Property | Required | Default | Immutable | Description | |---|---|---|---|---| | `aws-region` | ✅ | — | ✅ | AWS region, e.g. `us-east-1` | | `warehouse` | ✅ | — | ❌ | S3 base path, e.g. `s3://my-bucket/warehouse` | | `aws-glue-catalog-id` | ❌ | (caller account) | ✅ | 12-digit AWS account ID; defaults to caller's account | | `aws-access-key-id` | ❌ | — | ❌ | Static credential; omit to use default credential chain | | `aws-secret-access-key` | ❌ | — | ❌ | Static credential paired with `aws-access-key-id` | | `aws-glue-endpoint` | ❌ | — | ❌ | Custom endpoint URL, e.g. `http://localhost:4566` for LocalStack | | `default-table-format` | ❌ | `hive` | ❌ | Default format for `createTable()`: `hive` or `iceberg` | | `table-format-filter` | ❌ | `all` | ❌ | Comma-separated formats exposed by `listTables()` | --- ### Schema Properties **None.** Glue databases only have name, description, and location — no extra properties. --- ### Table Properties | Property | Required | Default | Immutable | Description | |---|---|---|---|---| | `table-format` | ❌ | — | ❌ | Table format: `ICEBERG` or `HIVE` | | `metadata_location` | ❌ | — | ❌ | Iceberg metadata file path | | `format` | ❌ | — | ✅ | File format: `parquet`, `orc`, `textfile`, etc. Auto-derives the three fields below | | `input-format` | ❌ | TextInputFormat | ✅ | Hive InputFormat class name | | `output-format` | ❌ | IgnoreKeyOutputFormat | ✅ | Hive OutputFormat class name | | `serde-lib` | ❌ | LazySimpleSerDe | ✅ | SerDe library class name | --- ### Supported Column Types **Primitive types:** | Type | Glue string | |---|---| | Boolean | `boolean` | | Byte | `tinyint` | | Short | `smallint` | | Integer | `int` / `integer` | | Long | `bigint` | | Float | `float` | | Double | `double` | | String | `string` | | Date | `date` | | Timestamp | `timestamp` (no time zone; `WITH TIME ZONE` is **not** supported) | | Binary | `binary` | | Interval Year | `interval_year_month` | | Interval Day | `interval_day_time` | **Parameterized types:** | Type | Glue string | |---|---| | Char(N) | `char(N)` | | VarChar(N) | `varchar(N)` | | Decimal(P,S) | `decimal(P,S)` | **Complex types:** | Type | Glue string | |---|---| | List | `array<T>` | | Map | `map<K,V>` | | Struct | `struct<field:type,...>` | | Union | `uniontype<T1,T2,...>` | --- ### Capabilities / Limitations | Feature | Supported | Reason | |---|---|---| | NOT NULL constraint | ❌ | Glue `Column` struct has no nullable field | | DEFAULT value | ❌ | Glue `Column` struct has no defaultValue field | | Case-sensitive names | ❌ | Schema and table names are folded to lowercase by Glue | | Table rename | ❌ | Glue API does not support rename | ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
