[
https://issues.apache.org/jira/browse/KYLIN-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ZhouKang updated KYLIN-4143:
----------------------------
Summary: truncate spark executable job output (was: Get job status fail
when too much content in job output)
> truncate spark executable job output
> -------------------------------------
>
> Key: KYLIN-4143
> URL: https://issues.apache.org/jira/browse/KYLIN-4143
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v2.5.2
> Reporter: ZhouKang
> Priority: Major
>
> Kylin: 2.5.2
> job engine: spark
>
> After long time running, job executor will record plenty of content in job
> output file, which make ExecutableManager get output fail. And the job will
> be marked as "error".
> {code:java}
> // code placeholder
> 2019-08-15 11:58:34,442 ERROR [Scheduler 1278051386 Job
> db9b01d0-fd8c-d168-8cfa-2e11d807972c-128] spark.SparkExecutable:359 : error
> run spark job:
> java.lang.RuntimeException:
> org.apache.kylin.job.exception.PersistentException:
> com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input
> in VALUE_STRING
> at [Source: (DataInputStream); line: 5, column: 10728969]
> at [Source: (DataInputStream); line: 5, column: 15] (through reference
> chain: org.apache.kylin.job.dao.ExecutableOutputPO["content"])
> at
> org.apache.kylin.job.execution.ExecutableManager.getOutput(ExecutableManager.java:164)
> at
> org.apache.kylin.job.execution.AbstractExecutable.getOutput(AbstractExecutable.java:414)
> at
> org.apache.kylin.job.execution.AbstractExecutable.isDiscarded(AbstractExecutable.java:525)
> at
> org.apache.kylin.engine.spark.SparkExecutable.doWork(SparkExecutable.java:304)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:178)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kylin.job.exception.PersistentException:
> com.fasterxml.jackson.databind.JsonMappingException: Unexpected end-of-input
> in VALUE_STRING
> at [Source: (DataInputStream); line: 5, column: 10728969]
> at [Source: (DataInputStream); line: 5, column: 15] (through reference
> chain: org.apache.kylin.job.dao.ExecutableOutputPO["content"])
> at
> org.apache.kylin.job.dao.ExecutableDao.getJobOutput(ExecutableDao.java:356)
> at
> org.apache.kylin.job.execution.ExecutableManager.getOutput(ExecutableManager.java:159)
>
> ... 10 more
> Caused by: com.fasterxml.jackson.databind.JsonMappingException: Unexpected
> end-of-input in VALUE_STRING
> at [Source: (DataInputStream); line: 5, column: 10728969]
> at [Source: (DataInputStream); line: 5, column: 15] (through reference
> chain: org.apache.kylin.job.dao.ExecutableOutputPO["content"])
> at
> com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:391)
> at
> com.fasterxml.jackson.databind.JsonMappingException.wrapWithPath(JsonMappingException.java:351)
> at
> com.fasterxml.jackson.databind.deser.BeanDeserializerBase.wrapAndThrow(BeanDeserializerBase.java:1704)
> at
> com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:290)
> at
> com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:151)
> at
> com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4001)
> at
> com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3058)
> at org.apache.kylin.common.util.JsonUtil.readValue(JsonUtil.java:69)
> at
> org.apache.kylin.common.persistence.JsonSerializer.deserialize(JsonSerializer.java:46)
> at
> org.apache.kylin.common.persistence.ResourceStore.getResource(ResourceStore.java:182)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
