XiaoHongbo-Hope commented on code in PR #8722:
URL: https://github.com/apache/paimon/pull/8722#discussion_r3612351714
##########
paimon-api/src/main/java/org/apache/paimon/CoreOptions.java:
##########
@@ -830,6 +830,17 @@ public InlineElement getDescription() {
"Whether to consider blob file
size as a factor when performing scan splitting.")
.build());
+ // Safety ceiling for blob.copy-buffer-size (allocated as new byte[size]
per writer).
+ public static final int MAX_BLOB_COPY_BUFFER_SIZE = 256 * 1024 * 1024;
Review Comment:
Removed the arbitrary 256 MiB ceiling in b61dc8bc7. CoreOptions now only
enforces the technical 1..Integer.MAX_VALUE range before narrowing MemorySize
bytes from long to the writer int argument; BlobFormatWriter itself only
requires a positive int. Python configuration uses the same Java int boundary.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
