发件人: Rupeng Wang <[email protected]>
日期: 2020年4月22日 星期三 15:45
收件人: 梅秋莹 <[email protected]>
主题: Re: 回复： When build streaming cube in kylin, I got an error tip.
Well, I test it in Hadoop cluster with Kylin2.6.3 and Kafka2.0.0. But it run
normally. My Hadoop version is cdh5.7. What’s your Hadoop version?
-------------------
Best wishes,
Rupeng Wang
发件人: 梅秋莹 <[email protected]>
日期: 2020年4月21日 星期二 16:46
收件人: user <[email protected]>
抄送: wangrupeng <[email protected]>, Yaqian_Zhang <[email protected]>
主题: 回复： When build streaming cube in kylin, I got an error tip.
Thank you for your suggestions!
When I tried with those plans you provided, I can find the
kafka-client-{version}.jar and it also can be loaded by kylin. But when we
restart the kylin, and recreate the model and cube，it also goes wrong with the
same
error message.
------------------ 原始邮件 ------------------
发件人: "Rupeng Wang"<[email protected]>;
发送时间: 2020年4月21日(星期二) 下午3:14
收件人: "user"<[email protected]>;
主题: Re: When build streaming cube in kylin, I got an error tip.
Yes, you can try this command to determine whether kafka-client-{version}.jar
can be found.
find -L $KAFKA_HOME -name 'kafka-clients-[a-z0-9A-Z\.-]*.jar' ! -name '*doc*' !
-name '*test*' ! -name '*sources*' ''-printf '%p:' | sed 's/:$//'
And also check check if kafka-client-{version}.jar is loaded by kylin.
cat ${KYLIN_HOME}/pid #get kylin proess id
ps -ef | grep ${pid}
Then take a look if the kafka-client.jar is included in the jars which are
loaded by kylin when kylin start.
-------------------
Best wishes,
Rupeng Wang
发件人: Yaqian Zhang <[email protected]>
答复: <[email protected]>
日期: 2020年4月21日 星期二 14:51
收件人: <[email protected]>
主题: Re: When build streaming cube in kylin, I got an error tip.
Hi：
Is Kafka home set before kylin is started？If not, you can set KAFKA_HOME and
restart kylin.
If you still encounter this problem after setting KAFKA_HOME, and your hadoop
environment is hdp3.0, you can take a look at this issue
https://issues.apache.org/jira/browse/KYLIN-3970. I'm not sure if it will help
you.
在 2020年4月21日，11:22，梅秋莹 <[email protected]> 写道：
Hello，dear kyliners:
Lately, We tried to create a streaming model in kylin ,which refer to
doc "Cubing from Kafka(Near RT Streaming)" in kylin official website,
and we created the model and cube successfully, but when build the cube, it
appeared an error,like this:
"
ERROR [http-nio-7070-exec-9] controller.CubeController:398 :
org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;"
<[email protected]>
our environment: kylin 2.6.3; kafka 2.0.0.
If you know where is the problem or you know how to solve it, please contact
me, thank you very much!
