kfaraz commented on PR #20708: URL: https://github.com/apache/druid/pull/20708#issuecomment-6416986967
The IT failure is genuine. It has exposed an existing issue in the test. The test always reported a moving average processing rate of zero causing the auto-scaler to fall back to the default of 1000 as the `MIN_PROCESSING_RATE`. But now that we are using the running average, the task reports a non-zero value (~10k/sec which seems accurate given the number of records each task in this test works through). Since the processing rate is so high, the auto-scaler assumes that a single task can work through the lag and doesn't consider a scale up at any point, thus failing the test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
