[
https://issues.apache.org/jira/browse/HADOOP-18876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17760883#comment-17760883
]
ASF GitHub Bot commented on HADOOP-18876:
-----------------------------------------
anmolanmol1234 opened a new pull request, #6009:
URL: https://github.com/apache/hadoop/pull/6009
Change default from disk to bytebuffer for fs.azure.data.blocks.buffer.
Derived from numerous workload runs, the data presented accentuates a
noteworthy performance enhancement. The utilization of ByteBuffer for **reading
operations** showcased a remarkable improvement of approximately **64.83%** in
contrast to conventional disk-based reading. Furthermore, the integration of
ByteBuffer for **write operations** resulted in a significant efficiency gain
of about **60.75%**. These findings underscore the consistent and substantial
advantages of embracing ByteBuffer as the default choice, particularly in light
of the performance issues associated with disk operations.
> ABFS: Change default from disk to bytebuffer for fs.azure.data.blocks.buffer
> ----------------------------------------------------------------------------
>
> Key: HADOOP-18876
> URL: https://issues.apache.org/jira/browse/HADOOP-18876
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build
> Affects Versions: 3.3.6
> Reporter: Anmol Asrani
> Priority: Major
> Fix For: 3.3.6
>
>
> Change default from disk to bytebuffer for fs.azure.data.blocks.buffer.
> Gathered from multiple workload runs, the presented data underscores a
> noteworthy enhancement in performance. The adoption of ByteBuffer for
> *reading operations* exhibited a remarkable improvement of approximately
> *64.83%* when compared to traditional disk-based reading. Similarly, the
> implementation of ByteBuffer for *write operations* yielded a substantial
> efficiency gain of about {*}60.75%{*}. These findings underscore the
> consistent and substantial advantages of integrating ByteBuffer across a
> range of workload scenarios.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
