Hi, I am trying to run one of the TPC-DS  queries, query25 against a 25GB 
dataset (my instance memory size is 64GB) and I get this error,

Caused by: org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionError: 
VectorMapJoin Hash table loading exceeded memory limits. estimatedMemoryUsage: 
1644167752 noconditionalTaskSize: 463667612 inflationFactor: 2.0 threshold: 
927335232 effectiveThreshold: 927335232


I have tried tweaking these parameters, but cannot seem to get past this 
problem.
hive.auto.convert.join.noconditionaltask = false
hive.auto.convert.join.noconditionaltask.size = 289792256

Reply via email to