> 2017-09-20 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551] mapreduce.Job:1289 : The url to track the job: http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/
For MR job failure, please analyze the MR logs. The job tracking URL is printed in log. On Wed, Sep 20, 2017 at 6:12 PM, gqlxj1987 <gqlxj1...@gmail.com> wrote: > Hi, I got an error in build base cube in step 7. The error log is below: > > 2017-09-20 11:43:40,690 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > client.RMProxy:92 : Connecting to ResourceManager at > kika-ad-data-spark0/172.31.2.221:8032 > 2017-09-20 11:43:41,340 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > mapred.FileInputFormat:247 : Total input paths to process : 5 > 2017-09-20 11:43:41,371 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > mapreduce.JobSubmitter:396 : number of splits:5 > 2017-09-20 11:43:41,403 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > mapreduce.JobSubmitter:479 : Submitting tokens for job: > job_1504680828019_0205 > 2017-09-20 11:43:41,414 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > impl.YarnClientImpl:236 : Submitted application > application_1504680828019_0205 > 2017-09-20 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > mapreduce.Job:1289 : The url to track the job: > http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/ > 2017-09-20 > <http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/%0A2017-09-20> > 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551] > common.AbstractHadoopJob:520 : tempMetaFileString is : > file:///home/spark/apache-kylin-2.0.0-bin/bin/../tomcat/temp/kylin_job_ > meta8310507310295140464/meta > 2017-09-20 11:43:41,462 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:43:51,622 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:43:51,624 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:44:01,629 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:44:11,634 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:44:11,658 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > common.HadoopCmdOutput:96 : Counters: 13 > Job Counters > Failed map tasks=16 > Killed map tasks=4 > Launched map tasks=20 > Other local map tasks=15 > Data-local map tasks=5 > Total time spent by all maps in occupied slots (ms)=81568 > Total time spent by all reduces in occupied slots (ms)=0 > Total time spent by all map tasks (ms)=81568 > Total vcore-seconds taken by all map tasks=81568 > Total megabyte-seconds taken by all map tasks=83525632 > Map-Reduce Framework > CPU time spent (ms)=0 > Physical memory (bytes) snapshot=0 > Virtual memory (bytes) snapshot=0 > 2017-09-20 11:44:11,659 WARN [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > mapreduce.Counters:234 : Group FileSystemCounters is deprecated. Use > org.apache.hadoop.mapreduce.FileSystemCounter instead > 2017-09-20 11:44:11,659 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:44:11,660 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:44:11,662 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 > 2017-09-20 11:44:11,662 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > execution.ExecutableManager:389 : job > id:84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 from RUNNING to ERROR > 2017-09-20 11:44:11,664 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf > 2017-09-20 11:44:11,665 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf > 2017-09-20 11:44:11,666 DEBUG [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > dao.ExecutableDao:217 : updating job output, id: > 84527fe6-14cd-46fb-94a8-1167ce5f25cf > 2017-09-20 11:44:11,667 INFO [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > execution.ExecutableManager:389 : job > id:84527fe6-14cd-46fb-94a8-1167ce5f25cf from RUNNING to ERROR > 2017-09-20 11:44:11,667 WARN [Job 84527fe6-14cd-46fb-94a8- > 1167ce5f25cf-551] > execution.AbstractExecutable:258 : no need to send email, user list is > empty > 2017-09-20 11:44:11,670 INFO [pool-8-thread-1] > threadpool.DefaultScheduler:124 : Job Fetcher: 0 should running, 0 actual > running, 0 stopped, 0 ready, 3 already succeed, 1 error, 8 discarded, 0 > others > 2017-09-20 11:44:39,920 INFO [pool-8-thread-1] > threadpool.DefaultScheduler:124 : Job Fetcher: 0 should running, 0 actual > running, 0 stopped, 0 ready, 3 already succeed, 1 error, 8 discarded, 0 > others > > > I don't know what reason to cause the error. Please give some suggestions. > Thanks. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ >
