[
https://issues.apache.org/jira/browse/HADOOP-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsuyoshi Ozawa updated HADOOP-10694:
------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 2.9.0
3.0.0
Status: Resolved (was: Patch Available)
Committed this to trunk and branch-2. Thanks [~gopalv] and [~rajesh.balamohan]
for your contribution!
> Remove synchronized input streams from Writable deserialization
> ---------------------------------------------------------------
>
> Key: HADOOP-10694
> URL: https://issues.apache.org/jira/browse/HADOOP-10694
> Project: Hadoop Common
> Issue Type: Bug
> Components: io
> Reporter: Gopal V
> Assignee: Gopal V
> Labels: BB2015-05-TBR
> Fix For: 3.0.0, 2.9.0
>
> Attachments: HADOOP-10694.1.patch, HADOOP-10694.2.patch,
> writable-read-sync.png
>
>
> Writable deserialization is slowing down due to a synchronized block within
> DataInputBuffer$Buffer.
> ByteArrayInputStream::read() is synchronized and this shows up as a slow
> uncontested lock.
> Hive ships with its own faster thread-unsafe version with
> hive.common.io.NonSyncByteArrayInputStream.
> !writable-read-sync.png!
> The DataInputBuffer and Writable deserialization should not require a lock
> per readInt()/read().
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
