Chao Sun created HIVE-16483: ------------------------------- Summary: HoS should populate split related configurations to HiveConf Key: HIVE-16483 URL: https://issues.apache.org/jira/browse/HIVE-16483 Project: Hive Issue Type: Bug Components: Spark Reporter: Chao Sun Assignee: Chao Sun
There are several split related configurations, such as {{MAPREDMINSPLITSIZE}}, {{MAPREDMINSPLITSIZEPERNODE}}, {{MAPREDMINSPLITSIZEPERRACK}}, etc., that should be populated to HiveConf. Currently we only do this for {{MAPREDMINSPLITSIZE}}. Without these, Spark sometimes will not merge small files for file formats such as text. -- This message was sent by Atlassian JIRA (v6.3.15#6346)