dario-liberman opened a new issue, #13242: URL: https://github.com/apache/pinot/issues/13242
In order design the tables so to optimise MMAP loaded segments to fit in memory we would like to understand if unused (or rarely used columns) would be impacting memory usage. Basically we want to serve two use cases: 1. Aggregated metrics broken down by dimensional columns (mostly enumerations like countries, event name, etc) 2. Log access by user uuid including not just dimensional columns but also identifiers (eg. order uuid, session uuid, etc) Data is partitioned by user uuid. The second use-case is rarely used, 99.99% load is for first use case. We would like to understand if Pinot would map to memory columns that are not used in the aggregation queries when loading a segment. An alternative could be to have two tables, one with just dimensional columns, one with all columns, use each table respectively for each use case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
