This is an automated email from the ASF dual-hosted git repository.
danny0405 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new fcc92bc192f4 docs(flink): list glue as a valid hive_sync.mode (#19435)
fcc92bc192f4 is described below
commit fcc92bc192f44d8af3046af5ee77be6ec8397907
Author: Ranga Reddy <[email protected]>
AuthorDate: Fri Jul 31 13:26:23 2026 +0530
docs(flink): list glue as a valid hive_sync.mode (#19435)
HiveSyncMode has four values (HMS, GLUE, HIVEQL, JDBC) and
HiveSyncContext#hiveSyncTool loads AwsGlueCatalogSyncTool when the mode is
GLUE, but both Flink descriptions of the option advertise only
"hms, jdbc and hiveql". Glue sync from Flink is therefore supported but
undiscoverable from the config itself, which is what sent the reporter of
#15279 looking for a hive_sync.catalog.sync.tool.class key that does not
exist in the codebase.
Only the two Flink descriptions are updated. Glue is not a valid value for
the shared hoodie.datasource.hive_sync.mode: HoodieHiveSyncClient handles
HMS, HIVEQL and JDBC and throws "Invalid sync mode given" for anything else,
and Spark selects the Glue tool through the sync tool class instead
(HoodieSparkSqlWriter adds org.apache.hudi.aws.sync.AwsGlueCatalogSyncTool).
Closes #15279
---
.../src/main/java/org/apache/hudi/configuration/FlinkOptions.java | 2 +-
.../src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git
a/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java
b/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java
index 2a4c5f8815fd..9b02e2a202df 100644
---
a/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java
+++
b/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java
@@ -1325,7 +1325,7 @@ public class FlinkOptions extends HoodieConfig {
.key("hive_sync.mode")
.stringType()
.defaultValue(HiveSyncMode.HMS.name())
- .withDescription("Mode to choose for Hive ops. Valid values are hms,
jdbc and hiveql, default 'hms'");
+ .withDescription("Mode to choose for Hive ops. Valid values are hms,
glue, jdbc and hiveql, default 'hms'");
@AdvancedConfig
public static final ConfigOption<String> HIVE_SYNC_USERNAME = ConfigOptions
diff --git
a/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java
b/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java
index e19312ee548a..5a6bc70f8032 100644
---
a/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java
+++
b/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/streamer/FlinkStreamerConfig.java
@@ -368,7 +368,7 @@ public class FlinkStreamerConfig extends Configuration {
@Parameter(names = {"--hive-sync-file-format"}, description = "File format
for hive sync, default 'PARQUET'")
public String hiveSyncFileFormat = "PARQUET";
- @Parameter(names = {"--hive-sync-mode"}, description = "Mode to choose for
Hive ops. Valid values are hms, jdbc and hiveql, default 'jdbc'")
+ @Parameter(names = {"--hive-sync-mode"}, description = "Mode to choose for
Hive ops. Valid values are hms, glue, jdbc and hiveql, default 'jdbc'")
public String hiveSyncMode = "jdbc";
@Parameter(names = {"--hive-sync-username"}, description = "Username for
hive sync, default 'hive'")