itschrispeck opened a new pull request, #13164: URL: https://github.com/apache/pinot/pull/13164
This PR contains two changes: 1. Add instrumentation for OOM protection to json index's getMatchingFlattenedDocsMap() 2. Use lazy initialization when generating the map in `json_extract_index` transform function For the first change, we've seen the map can be very large and sampling/interruption check previously could not occur during map generation. For the second, lazy initialization skips map generation entirely when filters exclude all results which can save significant resources depending on the query. tags: `enhancement` `performance` (?) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
