lamber-ken commented on issue #1512: [HUDI-763] Add hoodie.table.base.file.format option to hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1512#issuecomment-615908872 Hi @vinothchandar, apologies for the delay. > different partitions use different formats I know hive support that feature, it's easy for hive. If we want to support different partitions use different format, we alos need to store these partition file format infomation to `hoodie.properties` file as shown bellow, these are required when read / write. At present, I can't think of a better way, correct me if I'm wrong or do you have any good ideas? ``` // hoodie.properties hoodie.table.name=hudi_mor_table hoodie.archivelog.folder=archived hoodie.table.type=COPY_ON_WRITE hoodie.timeline.layout.version=0 hoodie.table.base.file.format.partition.2020.01.08=ORC hoodie.table.base.file.format.partition.2020.01.09=PARQUET hoodie.table.base.file.format.partition.2020.01.10=PARQUET hoodie.table.base.file.format.partition.2020.01.11=ORC hoodie.table.base.file.format.partition.2020.01.12=ORC // sync to hive, need to set fileformat ALTER TABLE day_table PARTITION (dt='20200805') SET FILEFORMAT rcfile; ``` <br> > store things like index.type .. I found a jira about it, "Persist the HoodieIndex type in the hoodie.properties file" [1], It seems to be another topic : ) [1] https://issues.apache.org/jira/browse/HUDI-37
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
