LiuJi created FLINK-11425: ----------------------------- Summary: Support of “Hash Teams” in Hybrid Hash Join Key: FLINK-11425 URL: https://issues.apache.org/jira/browse/FLINK-11425 Project: Flink Issue Type: New Feature Components: Core, Optimizer Reporter: LiuJi
Hybrid Hash Join is already supported in current version. The join starts operating in memory and gradually starts spilling contents to disk, when the memory is not sufficient. Current hash join only support two inputs, so when a job contains multiple hash joins which have the same join keys, it will consume some unnecessary resources (I/O, memory, etc) because some upstream output data may useless for downstream hash join. According to the above observations, we want to provide a HashTeamManager to implement multiway inputs hash join by combining several two way hash join which have same join keys. HashTeamManager manage the relations of multiple HashTables and improve efficiency in memory use and lower I/O operations by joining multiple relations at one time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)