[
https://issues.apache.org/jira/browse/KYLIN-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16494935#comment-16494935
]
ASF subversion and git services commented on KYLIN-3369:
--------------------------------------------------------
Commit 6d623664ad513bd5a2ad7e9694cdd70f5ef7e6f6 in kylin's branch
refs/heads/KYLIN-3369 from [~Na Zhai]
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6d62366 ]
KYLIN-3369 Kafka join with hive
Signed-off-by: shaofengshi <[email protected]>
> Reduce the data size sink from Kafka topic to HDFS
> --------------------------------------------------
>
> Key: KYLIN-3369
> URL: https://issues.apache.org/jira/browse/KYLIN-3369
> Project: Kylin
> Issue Type: Improvement
> Components: Streaming
> Reporter: Shaofeng SHI
> Assignee: Shaofeng SHI
> Priority: Major
> Fix For: v2.4.0
>
>
> When building a cube from Kafka topic, the first step is to sink the Kafka
> data to HDFS. In today's implementation, it will persist all the fields of a
> message to disk. While in many cases, only a couple of fields will be needed
> for cubing; Today's behavior wastes network bandwidth and disk space.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
