Hello,
My Hadoop version is HDP 3.1.1.
Yesterday, I have solved the problem with the method as follows:
In the follow path?? we have repalced the "kafka-client-{version}.jar "
from a lower version to a higher. Then we can build the streaming cube
successfully.
------------------ ???????? ------------------
??????: "wangrupeng"<[email protected]>;
????????: 2020??4??22??(??????) ????3:52
??????: "[email protected]"<[email protected]>;
????: Re: ?????? When build streaming cube in kylin, I got an error tip.
??????: Rupeng Wang <[email protected]>
????: 2020??4??22?? ?????? 15:45
??????: ?????? <[email protected]>
????: Re: ?????? When build streaming cube in kylin, I got an error tip.
Well, I test it in Hadoop cluster with Kylin2.6.3 and Kafka2.0.0. But it run
normally. My Hadoop version is cdh5.7. What??s your Hadoop version?
-------------------
Best wishes,
Rupeng Wang
??????: ?????? <[email protected]>
????: 2020??4??21?? ?????? 16:46
??????: user <[email protected]>
????: wangrupeng <[email protected]>, Yaqian_Zhang <[email protected]>
????: ?????? When build streaming cube in kylin, I got an error tip.
Thank you for your suggestions!
When I tried with those plans you provided, I can find the
kafka-client-{version}.jar and it also can be loaded by kylin. But when we
restart the kylin, and recreate the model and cube??it also goes wrong with the
same
error message.
------------------ ???????? ------------------
??????: "Rupeng Wang"<[email protected]>;
????????: 2020??4??21??(??????) ????3:14
??????: "user"<[email protected]>;
????: Re: When build streaming cube in kylin, I got an error tip.
Yes, you can try this command to determine whether kafka-client-{version}.jar
can be found.
find -L $KAFKA_HOME -name 'kafka-clients-[a-z0-9A-Z\.-]*.jar' ! -name '*doc*' !
-name '*test*' ! -name '*sources*' ''-printf '%p:' | sed 's/:$//'
And also check check if kafka-client-{version}.jar is loaded by kylin.
cat ${KYLIN_HOME}/pid #get kylin proess id
ps -ef | grep ${pid}
Then take a look if the kafka-client.jar is included in the jars which are
loaded by kylin when kylin start.
-------------------
Best wishes,
Rupeng Wang
??????: Yaqian Zhang <[email protected]>
????: <[email protected]>
????: 2020??4??21?? ?????? 14:51
??????: <[email protected]>
????: Re: When build streaming cube in kylin, I got an error tip.
Hi??
Is Kafka home set before kylin is started??If not, you can set KAFKA_HOME and
restart kylin.
If you still encounter this problem after setting KAFKA_HOME, and your hadoop
environment is hdp3.0, you can take a look at this issue
https://issues.apache.org/jira/browse/KYLIN-3970. I'm not sure if it will
help you.
?? 2020??4??21????11:22???????? <[email protected]> ??????
Hello??dear kyliners:
Lately, We tried to create a streaming model
in kylin ,which refer to doc "Cubing from Kafka(Near RT Streaming)" in kylin
official website,
and we created the model and cube successfully, but when build the cube,
it appeared an error,like this:
"
ERROR [http-nio-7070-exec-9] controller.CubeController:398 :
org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;
java.lang.NoSuchMethodError:
org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;"
<[email protected]>
our environment: kylin 2.6.3; kafka 2.0.0.
If you know where is the problem or you know how to solve it, please contact
me, thank you very much!