[
https://issues.apache.org/jira/browse/TEZ-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210763#comment-17210763
]
László Bodor commented on TEZ-4239:
-----------------------------------
what can be optimized:
1. Reuse InputStreams and OutputStreams (similarly to Compressor/Decompressor)?
2. Rounding the allocation of streams
3. Having multiple codec pools for different workloads ( < 1k, <128k, <256k,
>256k)
> Optimize compression/decompression buffer allocation
> ----------------------------------------------------
>
> Key: TEZ-4239
> URL: https://issues.apache.org/jira/browse/TEZ-4239
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
>
> This is a follow-up task for TEZ-4234 (TEZ-4135). Let me quote [~jeagles]
> here:
> "I think we may find more add-ons to this feature that will continue to gain
> performance. Perhaps rounding the allocation to (say 8bytes -> 64bits) or
> setting a minimum on buffer size or finding a more reasonable growth pattern
> to encourage reuse."
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
