bytesid19 commented on issue #11955:
URL: https://github.com/apache/hudi/issues/11955#issuecomment-2362843710

   Hudi properties during writing when we migrated from 10.0.1 to 0.15.0
   ```
   'hoodie.table.name': 'table_name',
   'hoodie.datasource.write.table.name':'table_name',
   'hoodie.datasource.write.operation': 'upsert',
   'hoodie.datasource.write.keygenerator.class': 
'org.apache.hudi.keygen.ComplexKeyGenerator',
   'hoodie.datasource.write.recordkey.field': hudi_record_key,
   'hoodie.datasource.write.partitionpath.field': "txn_date",
   'hoodie.datasource.write.precombine.field': 'ingestion_timestamp',
   'hoodie.upsert.shuffle.parallelism': 100,
   'hoodie.insert.shuffle.parallelism': 100
   ```
   hoodie.properties after that migration
   ```
   #Updated at 2024-09-03T12:04:40.615Z
   #Tue Sep 03 12:04:40 UTC 2024
   hoodie.table.precombine.field=ingestion_timestamp
   hoodie.table.partition.fields=txn_date
   hoodie.table.type=COPY_ON_WRITE
   hoodie.archivelog.folder=archived
   hoodie.populate.meta.fields=true
   hoodie.timeline.layout.version=1
   hoodie.table.version=6
   hoodie.table.metadata.partitions=files
   hoodie.table.recordkey.fields=record_id
   hoodie.table.base.file.format=PARQUET
   hoodie.datasource.write.partitionpath.urlencode=false
   hoodie.table.keygenerator.class=org.apache.hudi.keygen.ComplexKeyGenerator
   hoodie.table.name=table_name
   hoodie.table.metadata.partitions.inflight=
   hoodie.datasource.write.hive_style_partitioning=false
   hoodie.table.checksum=849148821
   ```
   
   extra hudi properties added for hive sync
   ```
   'hoodie.datasource.meta.sync.enable': 'true',
   'hoodie.datasource.hive_sync.mode': 'hms',
   'hoodie.database.name': '##db_name##',
   'hoodie.datasource.hive_sync.metastore.uris': '##hive_uri##'
   ```
   after adding above properties hoodie.properties never changed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to