wirybeaver opened a new issue, #12645: URL: https://github.com/apache/pinot/issues/12645
I notice that the postingListMap is changed from hashMap to TreeMap in this PR: https://github.com/apache/pinot/pull/12568 jsonMatch performs a point search on the _postingListMap wheras jsonExtractIndex perform a prefix search on the _postingListMap. The treeMap can speed the prefix search but slow down the point search. Ideally, we can use TrieTree to speed up both function. Moreover, we don’t have to store the literal “$index” inside the key of postingListMap. last but not least, we can use latch crabbing to increase the concurrency. the existing read and write lock the whole map. A rough idea of the Data structure below: ``` TrieNode { boolean arrayIndex; String subPath; Map<String, TrieNode> kids; } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
