Gopal V created HIVE-16425:
------------------------------
Summary: Vectorization: unload old hashtables before
reloadHashTable
Key: HIVE-16425
URL: https://issues.apache.org/jira/browse/HIVE-16425
Project: Hive
Issue Type: Bug
Components: Vectorization
Reporter: Gopal V
{code}
@Override
protected void reloadHashTable(byte pos, int partitionId)
throws IOException, HiveException, SerDeException,
ClassNotFoundException {
// The super method will reload a hash table partition of one of the small
tables.
// Currently, for native vector map join it will only be one small table.
super.reloadHashTable(pos, partitionId);
MapJoinTableContainer smallTable = spilledMapJoinTables[pos];
vectorMapJoinHashTable =
VectorMapJoinOptimizedCreateHashTable.createHashTable(conf,
smallTable);
needHashTableSetup = true;
LOG.info("Created " + vectorMapJoinHashTable.getClass().getSimpleName() + "
from " + this.getClass().getSimpleName());
if (isLogDebugEnabled) {
LOG.debug(CLASS_NAME + " reloadHashTable!");
}
}
{code}
The super call causes an OOM because of existing memory usage by
vectorMapJoinHashTable.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
