zachjsh opened a new issue, #13324:
URL: https://github.com/apache/druid/issues/13324

   ### Description
   
   At the moment, all druid tasks types attempt to load lookups, even when not 
needed:
   
   1. Some task types, have absolutely no  need to do this, such as compaction, 
or kill tasks
   2. native batch ingest: only load lookups that are actually needed by 
transformSpec or metricsSpec
   3. MSQ: only load lookups that are actually needed by the query
   
   ### Motivation
   
   Lookups can be large. and should not consume resources on tasks that have no 
use for them. It's a waste of resources.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to