asankadarshana007 opened a new issue, #7271: URL: https://github.com/apache/hudi/issues/7271
I am using Apache Hudi (Apache Hudi Connector 0.10.1 for AWS Glue 3.0) with AWS Glue. I initially did a bulk insert and created a table. But now when I try to upsert latest/new data, I get the error `An error occurred while calling o1073.pyWriteDynamicFrame.\n: org.apache.hudi.exception.HoodieException: Unknown versionCode:` I see few similar issues raised, * https://github.com/apache/hudi/issues/4177 * https://github.com/apache/hudi/issues/7154 ^ on both of the above tickets, answer is to downgrade or upgrade table version through cli. But how can I do that on the glue ? Is there a specific pyspark command that I can use to downgrade or upgrade a specific hudi table ? This is a hudi table properties file - ``` hoodie.table.precombine.field=key_column hoodie.table.partition.fields=execution_date hoodie.table.type=COPY_ON_WRITE hoodie.archivelog.folder=archived hoodie.populate.meta.fields=true hoodie.timeline.layout.version=1 hoodie.table.version=3 hoodie.table.recordkey.fields=key_column hoodie.table.base.file.format=PARQUET hoodie.datasource.write.partitionpath.urlencode=false hoodie.table.keygenerator.class=org.apache.hudi.keygen.SimpleKeyGenerator hoodie.table.name=etl_metrics hoodie.datasource.write.hive_style_partitioning=false ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
