MattSlone opened a new issue, #9170: URL: https://github.com/apache/hudi/issues/9170
.**Describe the problem you faced** When using the following boilerplate code (using actual data for the fields) from https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-format-hudi.html: ```python # Example: Create a Hudi table from a DataFrame # and register the table to Glue Data Catalog additional_options={ "hoodie.table.name": "<your_table_name>", "hoodie.datasource.write.storage.type": "COPY_ON_WRITE", "hoodie.datasource.write.operation": "upsert", "hoodie.datasource.write.recordkey.field": "<your_recordkey_field>", "hoodie.datasource.write.precombine.field": "<your_precombine_field>", "hoodie.datasource.write.partitionpath.field": "<your_partitionkey_field>", "hoodie.datasource.write.hive_style_partitioning": "true", "hoodie.datasource.hive_sync.enable": "true", "hoodie.datasource.hive_sync.database": "<your_database_name>", "hoodie.datasource.hive_sync.table": "<your_table_name>", "hoodie.datasource.hive_sync.partition_fields": "<your_partitionkey_field>", "hoodie.datasource.hive_sync.partition_extractor_class": "org.apache.hudi.hive.MultiPartKeysValueExtractor", "hoodie.datasource.hive_sync.use_jdbc": "false", "hoodie.datasource.hive_sync.mode": "hms", "path": "s3://<s3Path/>" } dataFrame.write.format("hudi") \ .options(**additional_options) \ .mode("overwrite") \ .save() ``` I receive the following error: nPossibly unquoted identifier <database_name> detected. Please consider quoting it with back-quotes as `<your_database_name>`(line 1, pos 5)\n\n== SQL ==\n<database_name>.<your_table_name>\n-----^^^\n" **To Reproduce** Steps to reproduce the behavior: 1. Create a Glue V4 streaming job 2. Use the boilerplate code above to try to write to S3 **Expected behavior** It writes to S3 without any problems (which it does in Glue V3 streaming jobs) **Environment Description** * Glue version : 4.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
