mchades commented on code in PR #8777:
URL: https://github.com/apache/gravitino/pull/8777#discussion_r2575633507
##########
docs/fileset-catalog.md:
##########
@@ -38,31 +39,50 @@ Besides the [common catalog
properties](./gravitino-server-config.md#apache-grav
| `disable-filesystem-ops` | The configuration to disable file
system operations in the server side. If set to true, the Fileset catalog in
the server side will not create, drop files or folder when the schema, fileset
is created, dropped.
| false | No |
0.9.0-incubating |
| `fileset-cache-eviction-interval-ms` | The interval in milliseconds to evict
the fileset cache, -1 means never evict.
| 3600000 | No | 0.9.0-incubating |
| `fileset-cache-max-size` | The maximum number of the filesets
the cache may contain, -1 means no limit.
| 200000 | No |
0.9.0-incubating |
+| `config.resources` | The configuration resources,
separated by comma. For example, `hdfs-site.xml,core-site.xml`.
| (none) | No | 1.1.0
|
Please refer to [Credential vending](./security/credential-vending.md) for
more details about credential vending.
-### HDFS fileset
+### HDFS fileset
-Apart from the above properties, to access fileset like HDFS fileset, you need
to configure the following extra properties.
+Apart from the above properties, to access fileset like HDFS fileset, you need
to configure the following extra
+properties.
-| Property Name | Description
|
Default Value | Required |
Since Version |
-|----------------------------------------------------|------------------------------------------------------------------------------------------------|---------------|-------------------------------------------------------------|---------------|
+| Property Name | Description
|
Default Value | Required |
Since Version |
+|----------------------------------------------------|-------------------------------------------------------------------------------------------------|---------------|-------------------------------------------------------------|---------------|
| `authentication.impersonation-enable` | Whether to enable
impersonation for the Fileset catalog. |
`false` | No |
0.5.1 |
| `authentication.type` | The type of
authentication for Fileset catalog, currently we only support `kerberos`,
`simple`. | `simple` | No
| 0.5.1 |
-| `authentication.kerberos.principal` | The principal of the
Kerberos authentication |
(none) | required if the value of `authentication.type` is Kerberos. |
0.5.1 |
-| `authentication.kerberos.keytab-uri` | The URI of The keytab
for the Kerberos authentication. |
(none) | required if the value of `authentication.type` is Kerberos. |
0.5.1 |
+| `authentication.kerberos.principal` | The principal of the
Kerberos authentication |
(none) | required if the value of `authentication.type` is Kerberos. |
0.5.1 |
+| `authentication.kerberos.keytab-uri` | The URI of The keytab
for the Kerberos authentication. |
(none) | required if the value of `authentication.type` is Kerberos. |
0.5.1 |
| `authentication.kerberos.check-interval-sec` | The check interval of
Kerberos credential for Fileset catalog. | 60
| No | 0.5.1
|
-| `authentication.kerberos.keytab-fetch-timeout-sec` | The fetch timeout of
retrieving Kerberos keytab from `authentication.kerberos.keytab-uri`. | 60
| No | 0.5.1
|
+| `authentication.kerberos.keytab-fetch-timeout-sec` | The fetch timeout of
retrieving Kerberos keytab from `authentication.kerberos.keytab-uri`. | 60
| No |
0.5.1 |
+
+The `config.resources` property allows users to specify custom configuration
files.
+
+The Gravitino Fileset extends the following properties in the `xxx-site.xml`:
+
+| Property Name | Description
| Default Value | Required
| Since Version |
+|---------------------------------------------------|-------------------------------------------------------------------------|---------------|-------------------------------------------------------------|---------------|
+| hadoop.security.authentication.kerberos.principal | The principal of the
Kerberos authentication for HDFS client. | (none) | required
if the value of `authentication.type` is Kerberos. | 1.1.0 |
+| hadoop.security.authentication.kerberos.keytab | The keytab file path of
the Kerberos authentication for HDFS client. | (none) | required if
the value of `authentication.type` is Kerberos. | 1.1.0 |
+| hadoop.security.authentication.kerberos.krb5.conf | The krb5.conf file path
of the Kerberos authentication for HDFS client. | (none) | No
| 1.1.0 |
### Fileset catalog with Cloud Storage
+
+In the current implementation, the fileset uses the HDFS protocol to access
its location. If users use S3, GCS, OSS,
+or Azure Blob Storage, they can also configure the `config.resources property`
to specify custom configuration
Review Comment:
```
`config.resources` property
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
