[
https://issues.apache.org/jira/browse/SPARK-45332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45332.
----------------------------------
Resolution: Duplicate
Duplicate: identical summary filed the same day by the same reporter;
SPARK-45333 was Fixed (4.0.0).
> Fix one unit mistake related to spark.eventLog.buffer.kb
> --------------------------------------------------------
>
> Key: SPARK-45332
> URL: https://issues.apache.org/jira/browse/SPARK-45332
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.5.0
> Reporter: Mengran Lan
> Priority: Minor
>
> The configuration "spark.eventLog.buffer.kb" has a definition with KiB unit.
> {code:java}
> private[spark] val EVENT_LOG_OUTPUT_BUFFER_SIZE =
> ConfigBuilder("spark.eventLog.buffer.kb")
> .doc("Buffer size to use when writing to output streams, in KiB unless
> otherwise specified.")
> .version("1.0.0")
> .bytesConf(ByteUnit.KiB)
> .createWithDefaultString("100k"){code}
> It is used in a context acting as the size of bytes.
> {code:java}
> protected val outputBufferSize =
> sparkConf.get(EVENT_LOG_OUTPUT_BUFFER_SIZE).toInt {code}
> This may be a mistake and needs to be fixed.
> The default buffer size for the event-log output buffer will be 100k as
> configured.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
