gianm commented on issue #17820: URL: https://github.com/apache/druid/issues/17820#issuecomment-2776555468
Are these `map` type lookups? For those lookups, the definition contains the data. I wonder if what's going on here is that we are storing a copy of the definition per server, which would add up quickly for a larger `map` lookup. If that's what's happening, it would be better to deduplicate those in the `LookupCoordinatorManager`, or perhaps we don't even need to store the current lookup definitions at all. I think the logic would possibly work if we only stored the `version` of the current lookup definitions on each node. Also, if that's what's happening, you could work around it by using a uri-based lookup instead of `map`. Then the definitions will be small enough that this won't be a problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
