qianqiaoneng created KYLIN-1500:
-----------------------------------
Summary: streaming_fillgap cause out of memory
Key: KYLIN-1500
URL: https://issues.apache.org/jira/browse/KYLIN-1500
Project: Kylin
Issue Type: Improvement
Components: streaming
Affects Versions: v1.2, v1.3.0
Reporter: qianqiaoneng
streaming_fillgap.sh will try to fill gap when there is some error of the
streaming job. But no matter how long the gap it is, how big the missing data
it is, kylin tried to fill gap in one thread, which sometimes cause out of
memory error. Need streaming_fillgap.sh to be more intelligent based on gap
time range and data volume.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
