HyukjinKwon opened a new pull request, #37432:
URL: https://github.com/apache/spark/pull/37432
### What changes were proposed in this pull request?
This PR proposes to:
- Suppress error logs when the number of timers is set to 0.
- Add documentation for describing its behaviour clearly:
- 0: disable the feature
- -1: no limit
- Otherwise, explicit limit.
- Throw an exception if the configuration is set to the number lower than -1.
This is an internal configuration, numbers lower than -1 don't make much
sense, and this configuration sort of less known. So I think it's pretty safe
to do this.
### Why are the changes needed?
To avoid noisy error logs, and document the feature properly.
### Does this PR introduce _any_ user-facing change?
Yes. When `spark.scheduler.listenerbus.metrics.maxListenerClassesTimed` is
set to `0`, it does not show a warning such as:
```
LiveListenerBusMetrics: Not measuring processing time for listener class
org.apache.spark.sql.util.ExecutionListenerBus because a maximum of 0 listener
classes are already timed.
```
### How was this patch tested?
Unittest is added.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
