Hello, I installed kylin1.6.0 and kafka0.10.1, and I followed the blog
"Scalable Cubing from Kafka (beta)" step by step, but the build job failed at
the first step "Save data from Kafka". The hadoop yarn log show the below
content:
"WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child :
java.io.IOException: Unexpected ending of stream, expected ending offset 5689,
but end at 0
at
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader.nextKeyValue(KafkaInputRecordReader.java:121)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:533)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
"
It's there something wrong with my kafka settings or kylin env? (The kafka
producer can send messages, and consumer can receive messages.)
