Gopal V created TEZ-3284:
----------------------------
Summary: Synchronization for every byte in UnorderdKVWriter
Key: TEZ-3284
URL: https://issues.apache.org/jira/browse/TEZ-3284
Project: Apache Tez
Issue Type: Bug
Affects Versions: 0.9.0
Reporter: Gopal V
Priority: Critical
{code}
baos = new ByteArrayOutputStream();
dos = new DataOutputStream(baos);
keySerializer.open(dos);
valSerializer.open(dos);
{code}
This is a known performance issue as documented in HADOOP-10694
Both ByteArrayOutputStream::write() and DataOutputStream::write() have lock
prefix calls in them, because they are object synchronized methods.
Recommended solution is to replicate the Hive NonSync impls similar to
HADOOP-10694
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
