[
https://issues.apache.org/jira/browse/KYLIN-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17631590#comment-17631590
]
ASF subversion and git services commented on KYLIN-5246:
--------------------------------------------------------
Commit 18c52f3b42fcc8e1f92ae32c6e12f4ddf45fdf64 in kylin's branch
refs/heads/main from zhaoliu4
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=18c52f3b42 ]
KYLIN-5246 long running job's log staying in mem, may cause job server oom.
keep only the last 10k logs by ring buffer
add a UT for the [RingBuffer.java]
> long running job's log staying in mem, may cause job server oom
> ---------------------------------------------------------------
>
> Key: KYLIN-5246
> URL: https://issues.apache.org/jira/browse/KYLIN-5246
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Affects Versions: v4.0.1
> Reporter: Liu Zhao
> Priority: Minor
>
> {code:java}
> CliCommandExecutor
> --------
> BufferedReader reader = new BufferedReader(
> new InputStreamReader(proc.getInputStream(),
> StandardCharsets.UTF_8));
> String line;
> StringBuilder result = new StringBuilder();
> while ((line = reader.readLine()) != null &&
> !Thread.currentThread().isInterrupted()) {
> result.append(line).append('\n');
> if (logAppender != null) {
> logAppender.log(line);
> }
> }
> {code}
> job运行时间久，result 会非常大，可能会引起内存问题
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
