lokesh-lingarajan opened a new pull request #12321:
URL: https://github.com/apache/druid/pull/12321


   Added a toggle button that steers queries to overlord or sql. We will 
default it to overlord to reduce metadata stress.
   
   Fixes #12318
   
   This PR fixes the first part of the solution recommended using UI 
(https://github.com/apache/druid/issues/12318)
   
   ### Description
   As tasks increases, UI start putting a lot of stress on metadata store as 
its required to fetch the whole table to parse the status of the task for 
filtering and displaying in the UI.
   
   We have seen an upward of 3x network throughput on our metadata store and 
resulting in degraded performance.
   
   This PR fixes this issue in the UI by introducing a toggle switch that 
defaults to overlord for fetching task listing and thus avoiding such stress on 
metadata store.
   
   This PR has:
   - [x] been self-reviewed.
   - [x] added comments explaining the "why" and the intent of the code 
wherever would not be obvious for an unfamiliar - [ ] - - [x] been tested in a 
test Druid cluster.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to