noob-se7en commented on PR #16265: URL: https://github.com/apache/pinot/pull/16265#issuecomment-3047947301
> This is changing behavior, which might not always be desired. User usually throttles ingestion rate to cap CPU usage, and we cannot assume user always uses `REALTIME_ROWS_FETCHED` to set the threshold. Do you see this mainly an issue to set up the threshold? Valid concern. So how can we decide the throttling limit, then? If we see 100K messages per second fetched on server and high resource utilisation, I will put 100K as throttle limit. But there might be lot of tombstones out of 100K and I will have to reduce the throttling limit. It's not a big problem, I am okay with closing the PR as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
