Jackie-Jiang commented on issue #8469: URL: https://github.com/apache/pinot/issues/8469#issuecomment-1090601570
In order to know if a new segment is ready for query, the information should come from the broker. Here is the steps of new segment becoming queryable: 1. Segment uploaded to the deep store via controller (or metadata push) 2. Server gets notified to download and load the segment 3. Controller collects server status and updates table's external view 4. Broker listens to the external view change and includes the query into the routing. The segment is queryable only when it is loaded on an enabled server that is not disabled for routing. Do you think it can solve the problem if we add an API to the broker to return if the given segment is ready for query (and all queryable segments for a given table)? We may also add the API to the controller to be redirected to the broker -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
