[
https://issues.apache.org/jira/browse/KYLIN-4431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kangjunxiang resolved KYLIN-4431.
---------------------------------
Resolution: Fixed
Check "jinfo <PID of kylin> ", The results of
information："kylin.kafka.dependency = ",The value is an empty string.
The corresponding problem has been solved by replacing
kafka-clients-0.8.2.1.jar in mapreduce.tar.gz with kafka-clients-1.0.0.jar.
*Thank you very much!*
> Use the official sample action "Quick Start with Streaming Sample Cube" build
> Error
> -----------------------------------------------------------------------------------
>
> Key: KYLIN-4431
> URL: https://issues.apache.org/jira/browse/KYLIN-4431
> Project: Kylin
> Issue Type: Bug
> Components: NRT Streaming
> Affects Versions: v3.0.1
> Environment: HDP-3.1.0.0
> Apache kylin 3.0.1
> Kafka 2.0.0
> Reporter: kangjunxiang
> Priority: Major
>
> h2. Use the official sample action "Quick Start with Streaming Sample Cube"
> {color:#333333}build {color}{color:#333333}Error，The error message is as
> follows:{color}
>
> ---------------------------error logs---------------------------
> 2020-03-17 15:37:13,389 ERROR [Scheduler 775260112 Job
> 94b82185-70b0-2a4d-e83e-e5bbdecefa3f-430] execution.AbstractExecutable:181 :
> error running Executable: CubingJob\{id=94b82185-70b0-2a4d-e83e-e5bbdecefa3f,
> name=BUILD CUBE - kylin_streaming_cube - 0_2128 - CST 2020-03-17 15:35:57,
> state=RUNNING}
> 2020-03-17 15:37:13,395 DEBUG [pool-7-thread-1] cachesync.Broadcaster:119 :
> Servers in the cluster: [localhost:7070]
> 2020-03-17 15:37:13,396 DEBUG [pool-7-thread-1] cachesync.Broadcaster:129 :
> Announcing new broadcast to all: BroadcastEvent\{entity=execute_output,
> event=update, cacheKey=94b82185-70b0-2a4d-e83e-e5bbdecefa3f}
> 2020-03-17 15:37:13,401 DEBUG [http-nio-7070-exec-4]
> cachesync.Broadcaster:267 : Broadcasting UPDATE, execute_output,
> 94b82185-70b0-2a4d-e83e-e5bbdecefa3f
> 2020-03-17 15:37:13,402 INFO [Scheduler 775260112 Job
> 94b82185-70b0-2a4d-e83e-e5bbdecefa3f-430] execution.ExecutableManager:478 :
> job id:94b82185-70b0-2a4d-e83e-e5bbdecefa3f from RUNNING to ERROR
> 2020-03-17 15:37:13,402 DEBUG [Scheduler 775260112 Job
> 94b82185-70b0-2a4d-e83e-e5bbdecefa3f-430] execution.AbstractExecutable:332 :
> no need to send email, user list is empty
> 2020-03-17 15:37:13,403 DEBUG [pool-7-thread-1] cachesync.Broadcaster:119 :
> Servers in the cluster: [localhost:7070]
> 2020-03-17 15:37:13,403 DEBUG [pool-7-thread-1] cachesync.Broadcaster:129 :
> Announcing new broadcast to all: BroadcastEvent\{entity=execute_output,
> event=update, cacheKey=94b82185-70b0-2a4d-e83e-e5bbdecefa3f}
> 2020-03-17 15:37:13,403 DEBUG [http-nio-7070-exec-4]
> cachesync.Broadcaster:301 : Done broadcasting UPDATE, execute_output,
> 94b82185-70b0-2a4d-e83e-e5bbdecefa3f
> 2020-03-17 15:37:13,404 ERROR [pool-11-thread-10]
> threadpool.DefaultScheduler:116 : ExecuteException
> job:94b82185-70b0-2a4d-e83e-e5bbdecefa3f
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 12
> Job Counters
> Failed map tasks=4
> Launched map tasks=4
> Other local map tasks=3
> Rack-local map tasks=1
> Total time spent by all maps in occupied slots (ms)=109572
> Total time spent by all reduces in occupied slots (ms)=0
> Total time spent by all map tasks (ms)=27393
> Total vcore-milliseconds taken by all map tasks=27393
> Total megabyte-milliseconds taken by all map tasks=37364052
> Map-Reduce Framework
> CPU time spent (ms)=0
> Physical memory (bytes) snapshot=0
> Virtual memory (bytes) snapshot=0
> Job Diagnostics:Task failed task_1584424619465_0006_m_000000
> Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0
> killedReduces: 0
>
> Failure task Diagnostics:
> Error:
> org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
>
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:194)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.engine.mr.exception.MapReduceException: Counters: 12
> Job Counters
> Failed map tasks=4
> Launched map tasks=4
> Other local map tasks=3
> Rack-local map tasks=1
> Total time spent by all maps in occupied slots (ms)=109572
> Total time spent by all reduces in occupied slots (ms)=0
> Total time spent by all map tasks (ms)=27393
> Total vcore-milliseconds taken by all map tasks=27393
> Total megabyte-milliseconds taken by all map tasks=37364052
> Map-Reduce Framework
> CPU time spent (ms)=0
> Physical memory (bytes) snapshot=0
> Virtual memory (bytes) snapshot=0
> Job Diagnostics:Task failed task_1584424619465_0006_m_000000
> Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0
> killedReduces: 0
>
> ---------------------------error logs---------------------------
>
> *Help, thanks!*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
