Hi ,
我按照官方文档build streaming cube 时， 总是报如下错误，通过kybot也得不出有效的信息， 请指导，谢谢！
*命令：*
curl -X PUT --user ADMIN:KYLIN -H "Content-Type:
application/json;charset=utf-8" -d '{ "sourceOffsetStart": 0,
"sourceOffsetEnd": 9223372036854775807, "buildType": "BUILD"}'
http://172.31.10.171:7070/kylin/api/cubes/StreamingCube22/build2
*部分报错信息：*
2016-12-13 00:22:09,002 INFO [pool-9-thread-5] persistence.ResourceStore:80
: Using metadata url
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta for
resource store
2016-12-13 00:22:09,016 DEBUG [pool-9-thread-5]
persistence.ResourceStore:207 : Directly saving resource
/cube/StreamingCube22.json (Store
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta)
2016-12-13 00:22:09,021 DEBUG [pool-9-thread-5]
persistence.ResourceStore:207 : Directly saving resource
/model_desc/StreamingModel22.json (Store
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta)
2016-12-13 00:22:09,024 DEBUG [pool-9-thread-5]
persistence.ResourceStore:207 : Directly saving resource
/cube_desc/StreamingCube22.json (Store
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta)
2016-12-13 00:22:09,029 DEBUG [pool-9-thread-5]
persistence.ResourceStore:207 : Directly saving resource
/table/DEFAULT.STREAMINGTABLE22.json (Store
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta)
2016-12-13 00:22:09,031 DEBUG [pool-9-thread-5]
persistence.ResourceStore:207 : Directly saving resource
/kafka/DEFAULT.STREAMINGTABLE22.json (Store
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta)
2016-12-13 00:22:09,037 DEBUG [pool-9-thread-5]
persistence.ResourceStore:207 : Directly saving resource
/streaming/DEFAULT.STREAMINGTABLE22.json (Store
/opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta)
2016-12-13 00:22:09,037 INFO [pool-9-thread-5] common.AbstractHadoopJob:499
: HDFS meta dir is:
file:///opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta
2016-12-13 00:22:09,037 INFO [pool-9-thread-5] common.AbstractHadoopJob:372
: Job 'tmpfiles' updated --
file:///opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta
2016-12-13 00:22:09,097 INFO [pool-9-thread-5] client.RMProxy:98 :
Connecting to ResourceManager at quickstart.cloudera/127.0.0.1:8032
2016-12-13 00:22:09,603 WARN [DataStreamer for file
/user/root/.staging/job_1481606707079_0005/files/meta/cube/StreamingCube22.json]
hdfs.DFSClient:864 : Caught exception
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1281)
at java.lang.Thread.join(Thread.java:1355)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789)
2016-12-13 00:22:11,555 WARN [DataStreamer for file
/user/root/.staging/job_1481606707079_0005/job.jar] hdfs.DFSClient:864 :
Caught exception
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1281)
at java.lang.Thread.join(Thread.java:1355)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeResponder(DFSOutputStream.java:862)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.endBlock(DFSOutputStream.java:600)
at
org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:789)
2016-12-13 00:22:11,587 INFO [pool-9-thread-5] consumer.ConsumerConfig:180
: ConsumerConfig values:
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [172.31.10.171:9092]
check.crcs = true
client.id =
connections.max.idle.ms = 540000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = StreamingCube22
heartbeat.interval.ms = 3000
interceptor.classes = null
key.deserializer = class
org.apache.kafka.common.serialization.StringDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class
org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 65536
reconnect.backoff.ms = 50
request.timeout.ms = 305000
retry.backoff.ms = 100
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 30000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class
org.apache.kafka.common.serialization.StringDeserializer
2016-12-13 00:22:11,588 INFO [pool-9-thread-5] consumer.ConsumerConfig:180
: ConsumerConfig values:
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [172.31.10.171:9092]
check.crcs = true
client.id = consumer-11
connections.max.idle.ms = 540000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = StreamingCube22
heartbeat.interval.ms = 3000
interceptor.classes = null
key.deserializer = class
org.apache.kafka.common.serialization.StringDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class
org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 65536
reconnect.backoff.ms = 50
request.timeout.ms = 305000
retry.backoff.ms = 100
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 30000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class
org.apache.kafka.common.serialization.StringDeserializer
2016-12-13 00:22:11,591 INFO [pool-9-thread-5] utils.AppInfoParser:83 :
Kafka version : 0.10.1.0
2016-12-13 00:22:11,591 INFO [pool-9-thread-5] utils.AppInfoParser:84 :
Kafka commitId : 3402a74efb23d1d4
2016-12-13 00:22:11,742 INFO [pool-9-thread-5] mapreduce.JobSubmitter:202 :
number of splits:1
2016-12-13 00:22:11,773 INFO [pool-9-thread-5] mapreduce.JobSubmitter:291 :
Submitting tokens for job: job_1481606707079_0005
2016-12-13 00:22:12,016 INFO [pool-9-thread-5] impl.YarnClientImpl:260 :
Submitted application application_1481606707079_0005
2016-12-13 00:22:12,021 INFO [pool-9-thread-5] mapreduce.Job:1311 : The url
to track the job:
http://quickstart.cloudera:8088/proxy/application_1481606707079_0005/
2016-12-13 00:22:12,021 INFO [pool-9-thread-5] common.AbstractHadoopJob:506
: tempMetaFileString is :
file:///opt/kylin/bin/../tomcat/temp/kylin_job_meta2815264195653031175/meta
2016-12-13 00:22:12,028 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:12,031 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617328793, to newTs: 1481617332028, operation result: true
2016-12-13 00:22:22,052 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:22,056 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617332028, to newTs: 1481617342053, operation result: true
2016-12-13 00:22:32,068 INFO [pool-9-thread-5]
mapred.ClientServiceDelegate:277 : Application state is completed.
FinalApplicationStatus=FAILED. Redirecting to job history server
2016-12-13 00:22:32,159 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:32,164 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617342053, to newTs: 1481617352160, operation result: true
2016-12-13 00:22:32,166 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:32,171 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617352160, to newTs: 1481617352167, operation result: true
2016-12-13 00:22:32,175 WARN [pool-9-thread-5] common.HadoopCmdOutput:89 :
no counters for job job_1481606707079_0005
2016-12-13 00:22:32,178 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:32,183 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617352167, to newTs: 1481617352179, operation result: true
2016-12-13 00:22:32,186 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:32,191 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617352179, to newTs: 1481617352186, operation result: true
2016-12-13 00:22:32,196 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7-00
2016-12-13 00:22:32,206 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7-00 from
oldTs: 1481617352186, to newTs: 1481617352197, operation result: true
2016-12-13 00:22:32,206 INFO [pool-9-thread-5]
manager.ExecutableManager:292 : job
id:ab6260bc-ed49-486e-911f-b11b676339f7-00 from RUNNING to ERROR
2016-12-13 00:22:32,211 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7
2016-12-13 00:22:32,216 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7 from
oldTs: 1481617328556, to newTs: 1481617352211, operation result: true
2016-12-13 00:22:32,222 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7
2016-12-13 00:22:32,233 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7 from
oldTs: 1481617352211, to newTs: 1481617352222, operation result: true
2016-12-13 00:22:32,236 DEBUG [pool-9-thread-5] dao.ExecutableDao:210 :
updating job output, id: ab6260bc-ed49-486e-911f-b11b676339f7
2016-12-13 00:22:32,242 DEBUG [pool-9-thread-5] hbase.HBaseResourceStore:262
: Update row /execute_output/ab6260bc-ed49-486e-911f-b11b676339f7 from
oldTs: 1481617352222, to newTs: 1481617352236, operation result: true
2016-12-13 00:22:32,242 INFO [pool-9-thread-5]
manager.ExecutableManager:292 : job id:ab6260bc-ed49-486e-911f-b11b676339f7
from RUNNING to ERROR
2016-12-13 00:22:32,242 WARN [pool-9-thread-5]
execution.AbstractExecutable:247 : no need to send email, user list is empty
2016-12-13 00:22:32,259 INFO [pool-8-thread-1]
threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual
running, 0 ready, 0 already succeed, 2 error, 0 discarded, 0 others
2016-12-13 00:23:08,537 INFO [pool-8-thread-1]
threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual
running, 0 ready, 0 already succeed, 2 error, 0 discarded, 0 others
2016-12-13 00:24:08,539 INFO [pool-8-thread-1]
threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual
running, 0 ready, 0 already succeed, 2 error, 0 discarded, 0 others
[root@quickstart logs]#
--
View this message in context:
http://apache-kylin.74782.x6.nabble.com/Streaming-cube-build-error-in-the-1st-step-by-Kylin1-6-Kafka1-0-tp6615.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
