manojpec commented on pull request #3871: URL: https://github.com/apache/hudi/pull/3871#issuecomment-958713288
> But partition path for the metadata table are hardcoded. Can that be helpful? Removing the fields will save a lot of storage space from record level index. @prashantwason So far we only have `files` partition under metadata table. But, we are planning to bring in more partitions for storing other indices. So, the assumption of single partition for the metadata table will not hold good for long. Otherwise, removing 5 meta fields from each record by enabling virtual keys would definitely save a lot of space. We either have to improve the current metadata schema or infer the partition path from other cues for now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
