Jackie-Jiang opened a new pull request #5722:
URL: https://github.com/apache/incubator-pinot/pull/5722


   ## Description
   Motivation:
   Currently within `MutableSegmentImpl` we maintain 10 maps from column to 
different type of index or column stats, which is very inefficient and requires 
a lot of redundant map lookups to access or update indexes. Also, it is quite 
hard to manage 10 maps, and the number of maps will keep growing as we add more 
types of indexes.
   
   Changes:
   - Introduce `IndexContainer` class inside MutableSegmentImpl to wrap all the 
index and stats for a column
   - Add helper method in `IndexContainer` to directly get `DataSource` and 
close all indexes for a column
   - Store `dictId` for the latest ingested records in `IndexContainer` to 
avoid the per-record map from column to dictId
   
   Bug fixes:
   - Do not store min/max value for aggregated metrics
   - Add document into text index properly
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to