ConfX created HADOOP-18896:
------------------------------
Summary: NegativeArraySizeException thrown in FSOutputSummer.java
given large file.bytes-per-checksum
Key: HADOOP-18896
URL: https://issues.apache.org/jira/browse/HADOOP-18896
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 3.3.6
Reporter: ConfX
Buffer size of FSOutputSummer equals to `file.bytes-per-checksum` times
`BUFFER_NUM_CHUNKS`. A large `file.bytes-per-checksum` causes buffer size to
overflow and crash with NegativeArraySizeException.
To reproduce:
1. set `file.bytes-per-checksum` to 238609295
2. `mvn surefire:test
-Dtest=org.apache.hadoop.hdfs.TestDecommissionWithStriped#testFileSmallerThanOneStripe`
We linked this issue to a PR that provides a fix which checks the buffer size
is positive after multiplying `file.bytes-per-checksum` with `BUFFER_NUM_CHUNKS`
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
