KKcorps commented on PR #9804: URL: https://github.com/apache/pinot/pull/9804#issuecomment-1324957363
> Is this specific to the upsert metadata for now? It is confusing because initially I expect the segment metadata will be stored in this new dir. > Do you see a scenario where we don't want the `metadataDir` under the `dateDir`? Yes, so basically metadataDir specifically can be loaded onto a faster disk system while dataDir can be mounted to a slow disk. This will allow us to minimize cost while also providing necessary performance for upsert lookups Kishore also doesn't want that users should be able to configure metadata directory from tableConfig and instead it should be a cluster level config. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
