[
https://issues.apache.org/jira/browse/TEZ-3455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15563117#comment-15563117
]
Siddharth Seth commented on TEZ-3455:
-------------------------------------
io.file.buffer.size is something that is normally defined in core-site.xml.
Normally we'll never end up running into the default value of -1 that is
defined (maybe it's used in tests).
CommonConfigurationKeysPublis.IO_FILE_BUFFER_SIZE_KEY. I'm not sure why it's
redefined in Tez - I suspect there was no variable defining this at the time it
was introduced. The default value in Hadoop is 4096 - which is what it should
be for Tez as well.
Should we remove the parameter altogether?, and at least change the default to
match the value in Hadoop.
[~darion] - did you run into an issue with this somewhere? I'm curious as to
what led to looking at this specific parameter.
> Using TEZ_RUNTIME_IO_FILE_BUFFER_SIZE to replace "io.file.buffer.size"
> ----------------------------------------------------------------------
>
> Key: TEZ-3455
> URL: https://issues.apache.org/jira/browse/TEZ-3455
> Project: Apache Tez
> Issue Type: Improvement
> Affects Versions: 0.8.4
> Reporter: darion yaphet
> Assignee: darion yaphet
> Attachments: TEZ-3455.1.patch
>
>
> use TezRuntimeConfiguration.TEZ_RUNTIME_IO_FILE_BUFFER_SIZE to replace
> "io.file.buffer.size" and add
> TezRuntimeConfiguration.TEZ_RUNTIME_IO_FILE_BUFFER_SIZE_DEFAULT
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
