rbankar7 commented on issue #19937: URL: https://github.com/apache/druid/issues/19937#issuecomment-5230081118
>what is the use case that you create segment every minute? and what is the size of each segment? The segment size is 50-100MB. - We support the metrics scraping use case from this cluster. (near realtime queries with small intervals) - The QPS is predictable and very high. - Caching isn't helpful as the time intervals in the queries are non overlapping for the scraping queries - Historically we have seen reliability issues when these queries were being answered from the indexers with (10mins of segments). So now we have minimal query load on indexers. - The segments are 1minute granularity and we handoff every minute. the handoff time is ~2-3s so the queries land on the historicals -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
