iemejia commented on code in PR #12400: URL: https://github.com/apache/gluten/pull/12400#discussion_r3546748207
##########
docs/velox-configuration.md:
##########
@@ -55,6 +56,7 @@ nav_order: 16
| spark.gluten.sql.columnar.backend.velox.memInitCapacity
| 🔄 Dynamic | 8MB | The initial memory capacity to reserve
for a newly created Velox query memory pool.
|
|
spark.gluten.sql.columnar.backend.velox.memoryPoolCapacityTransferAcrossTasks
| 🔄 Dynamic | true | Whether to allow memory capacity transfer
between memory pools from different tasks.
|
| spark.gluten.sql.columnar.backend.velox.memoryUseHugePages
| 🔄 Dynamic | false | Use explicit huge pages for Velox
memory allocation.
|
+| spark.gluten.sql.columnar.backend.velox.numCacheFileHandles
| âš“ Static | 10000 | Maximum number of entries in the file
handle cache. Each entry holds an open file descriptor (local FS) or connection
state (remote FS). Note that on local filesystems, high values may approach the
OS file descriptor limit (ulimit -n). On remote object stores (S3, ABFS, GCS)
entries are HTTP connections, not OS file descriptors.
|
Review Comment:
Same fix as above — will align the docs wording to clarify that entries
represent network connections/sockets rather than per-file OS file descriptors,
but they can still count toward OS resource limits (ulimit -n).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
