Hello, 
   
       My  Hadoop version is HDP 3.1.1.  
Yesterday, I have solved the problem with the method as follows: 


In the follow path?? we have repalced the "kafka-client-{version}.jar " 
from a lower version to a higher. Then we can build the streaming cube 
successfully.














------------------ ???????? ------------------
??????:&nbsp;"wangrupeng"<[email protected]&gt;;
????????:&nbsp;2020??4??22??(??????) ????3:52
??????:&nbsp;"[email protected]"<[email protected]&gt;;

????:&nbsp;Re: ?????? When build streaming cube  in kylin, I got an error tip.



 
&nbsp;

&nbsp;

??????: Rupeng Wang <[email protected]&gt;
????: 2020??4??22?? ?????? 15:45
??????: ?????? <[email protected]&gt;
????: Re: ?????? When build streaming cube in kylin, I got an error tip.


&nbsp;


Well, I test it in Hadoop cluster with Kylin2.6.3 and Kafka2.0.0. But it run 
normally. My Hadoop version is cdh5.7. What??s your Hadoop version?

&nbsp;

-------------------

Best wishes,

Rupeng Wang

&nbsp;

&nbsp;

&nbsp;

??????: ?????? <[email protected]&gt;
????: 2020??4??21?? ?????? 16:46
??????: user <[email protected]&gt;
????: wangrupeng <[email protected]&gt;, Yaqian_Zhang <[email protected]&gt;
????: ?????? When build streaming cube in kylin, I got an error tip.


&nbsp;


Thank you for your suggestions!


&nbsp;


When I tried with those plans you provided, I can find the 
kafka-client-{version}.jar and it also can be loaded by kylin. But when we 
restart the kylin, and recreate the model and cube??it also goes wrong with the 
same


&nbsp;


error message.&nbsp; 


&nbsp;


&nbsp;


------------------ ????????&nbsp;------------------


??????:&nbsp;"Rupeng Wang"<[email protected]&gt;;


????????:&nbsp;2020??4??21??(??????) ????3:14


??????:&nbsp;"user"<[email protected]&gt;;


????:&nbsp;Re: When build streaming cube in kylin, I got an error tip.



&nbsp;


Yes, you can try this command to determine whether kafka-client-{version}.jar 
can be found. 

find -L $KAFKA_HOME -name 'kafka-clients-[a-z0-9A-Z\.-]*.jar' ! -name '*doc*' ! 
-name '*test*' ! -name '*sources*' ''-printf '%p:' | sed 's/:$//'

&nbsp;

And also check check if kafka-client-{version}.jar is loaded by kylin.

cat ${KYLIN_HOME}/pid #get kylin proess id

ps -ef | grep ${pid}

&nbsp;

Then take a look if the kafka-client.jar is included in the jars which are 
loaded by kylin when kylin start.

&nbsp;

-------------------

Best wishes,

Rupeng Wang

&nbsp;

&nbsp;

&nbsp;

&nbsp;

??????: Yaqian Zhang <[email protected]&gt;
????: <[email protected]&gt;
????: 2020??4??21?? ?????? 14:51
??????: <[email protected]&gt;
????: Re: When build streaming cube in kylin, I got an error tip.


&nbsp;


Hi??

&nbsp;


Is Kafka home set before kylin is started??If not, you can set KAFKA_HOME and 
restart kylin.


&nbsp;


If you still encounter this problem after setting KAFKA_HOME, and your hadoop 
environment is hdp3.0, you can take a look at this issue 
https://issues.apache.org/jira/browse/KYLIN-3970.&nbsp; I'm not sure if it will 
help you.








?? 2020??4??21????11:22???????? <[email protected]&gt; ??????


&nbsp;

Hello??dear kyliners:


&nbsp;


&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;Lately, We tried to create a streaming model 
in kylin ,which refer to doc "Cubing from Kafka(Near RT Streaming)" in kylin 
official website,


and&nbsp; we created the model and cube successfully, but when build the cube, 
it appeared an error,like this:


&nbsp;


"


ERROR [http-nio-7070-exec-9] controller.CubeController:398 : 
org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;


java.lang.NoSuchMethodError: 
org.apache.kafka.clients.consumer.ConsumerConfig.configNames()Ljava/util/Set;"



&nbsp;


<[email protected]&gt;


&nbsp;


our environment:&nbsp; kylin 2.6.3; kafka 2.0.0.


&nbsp;


If you know where is the problem or you know how to solve it, please contact 
me, thank you very much!




&nbsp;

Reply via email to