Akshat-Jain commented on PR #16481: URL: https://github.com/apache/druid/pull/16481#issuecomment-2134401814
> > idea of the degree to which concurrency helps in output heavy queries > > What is meant by output heavy query? > > > but it's possible to have more workers than the processing threadpool size. > > In which scenario is this possible? @LakshSingla 1. By output heavy query, I meant queries where we have a lot of data to upload to durable storage, and the processing time isn't a lot. Example: `select * from huge_datasource` 2. I think our processing threadpool size is fixed based on number of cores of the system. For example, for my system it's 10 processing threads. But I can provide maxNumTasks higher than that? Or do we have a pre-flight check to not allow that? (I should try it out once) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
