Shaofeng SHI created KYLIN-1580:
-----------------------------------
Summary: Use 1 byte instead of 8 bytes as column indicator in fact
distinct MR job
Key: KYLIN-1580
URL: https://issues.apache.org/jira/browse/KYLIN-1580
Project: Kylin
Issue Type: Improvement
Reporter: Shaofeng SHI
Assignee: Shaofeng SHI
Fix For: v1.5.2
One small enhancement in fact distinct job; today it uses 8 bytes in the head
of the key to indicates the column index as well as cuboid id; actually it can
be optimized to 1 byte for column index, and next 8 for cuboid id if the first
is a special value; this will reduce the network IO between mappers and
reducers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
