Claude Warren created CASSANDRA-18637:
-----------------------------------------
Summary: As DataOutputBuffer approaches the MAX_BUFFER_SIZE limit
there should be a warning.
Key: CASSANDRA-18637
URL: https://issues.apache.org/jira/browse/CASSANDRA-18637
Project: Cassandra
Issue Type: Improvement
Components: Local/SSTable
Reporter: Claude Warren
As DataOuptutBuffer fills the available buffer space it allocates more by
doubling the buffer size until it reaches 64Mb (assuming
DOB_DOUBLING_THRESHOLD_MB has not been set). After which it will increase the
size by 1.5 until it reaches 0x7FFF_FFF8 bytes (MAX_BUFFER_SIZE) and then the
reallocation will fail.
0x5555_5550 x 1.5 = 0x7FFF_FFF8
Once the buffer is 0x5555_5550 bytes or larger in size the next allocation will
return 0x7FFF_FFF8 bytes and the one after that will fail.
I propose adding a configurable warning that applies when the allocated buffer
first approaches 0x5555_5550, by defining a WARNING_THRESHOLD so that the
first time the buffer allocation crosses 0x5555_5550 - WARNING_THRESHOLD an
alert is sent.
The alert should be instrumented such that automated monitoring systems can
report the issue before it becomes emergent.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
