Sungpeo Kook created SPARK-37515:
------------------------------------
Summary: minRatePerPartition works as "max messages per partition
per a batch" (it should be per seconds)
Key: SPARK-37515
URL: https://issues.apache.org/jira/browse/SPARK-37515
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.2.0, 2.4.8
Reporter: Sungpeo Kook
{{maxRatePerPartition}} means "max messages per partition per second".
But minRatePerPartition does not. ("max messages per partition per a batch").
This is a bug.
minRatePerPartition should be works as "min messages per partition per second".
*
[https://github.com/apache/spark/blob/f97de309792f382ae823894e978f7e54f34f1a29/docs/configuration.md?plain=1#L2878-L2886]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
