Kylin was trying to fetch MR job status via resource manager API. Seems yarn-site.xml is not on classpath, so the default URL "yarn.resourcemanager.webapp.address:http://0.0.0.0:8088"; is used and cannot connect.
1. Kylin is a client of Hadoop, so make sure all -site.xml are available on the Kylin host. 2. Kylin uses `hbase classpath` to detect hadoop config/jar dependency. Analyze why the hadoop conf dir is not reported by `hbase classpath` 3. A final work around is to manual edit `kylin.sh` to include the hadoop conf dir. On Thu, Jul 9, 2015 at 3:49 PM, streemwu <[email protected]> wrote: > hi > when i buiding the cube,the job can't run successfully. > > > the error log is : > [pool-5-thread-2]:[2015-07-09 > 15:25:24,747][INFO][org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:67)] > - Using metadata url > /home/eway/kylin-0.7.1/bin/../tomcat/temp/kylin_job_meta4970594159203808320/meta > for resource store > [pool-5-thread-2]:[2015-07-09 > 15:25:24,784][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:160)] > - Saving resource /cube/cube111.json (Store > /home/eway/kylin-0.7.1/bin/../tomcat/temp/kylin_job_meta4970594159203808320/meta) > [pool-5-thread-2]:[2015-07-09 > 15:25:24,789][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:160)] > - Saving resource /model_desc/cube111.json (Store > /home/eway/kylin-0.7.1/bin/../tomcat/temp/kylin_job_meta4970594159203808320/meta) > [pool-5-thread-2]:[2015-07-09 > 15:25:24,795][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:160)] > - Saving resource /cube_desc/cube111.json (Store > /home/eway/kylin-0.7.1/bin/../tomcat/temp/kylin_job_meta4970594159203808320/meta) > [pool-5-thread-2]:[2015-07-09 > 15:25:24,799][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:160)] > - Saving resource /table/DEFAULT.KYLIN_CATEGORY_GROUPINGS.json (Store > /home/eway/kylin-0.7.1/bin/../tomcat/temp/kylin_job_meta4970594159203808320/meta) > [pool-5-thread-2]:[2015-07-09 > 15:25:24,804][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:160)] > - Saving resource /table/DEFAULT.KYLIN_SALES.json (Store > /home/eway/kylin-0.7.1/bin/../tomcat/temp/kylin_job_meta4970594159203808320/meta) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,465][INFO][org.apache.kylin.job.common.MapReduceExecutable.getRestStatusCheckUrl(MapReduceExecutable.java:177)] > - kylin.job.yarn.app.rest.check.status.url is not set, read from job > configuration > [pool-5-thread-2]:[2015-07-09 > 15:25:25,466][INFO][org.apache.kylin.job.common.MapReduceExecutable.getRestStatusCheckUrl(MapReduceExecutable.java:188)] > - yarn.resourcemanager.webapp.address:http://0.0.0.0:8088 > [pool-5-thread-2]:[2015-07-09 > 15:25:25,520][INFO][org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439)] > - I/O exception (java.net.ConnectException) caught when processing request: > Connection refused > [pool-5-thread-2]:[2015-07-09 > 15:25:25,520][INFO][org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445)] > - Retrying request > [pool-5-thread-2]:[2015-07-09 > 15:25:25,521][INFO][org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439)] > - I/O exception (java.net.ConnectException) caught when processing request: > Connection refused > [pool-5-thread-2]:[2015-07-09 > 15:25:25,521][INFO][org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445)] > - Retrying request > [pool-5-thread-2]:[2015-07-09 > 15:25:25,521][INFO][org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:439)] > - I/O exception (java.net.ConnectException) caught when processing request: > Connection refused > [pool-5-thread-2]:[2015-07-09 > 15:25:25,521][INFO][org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:445)] > - Retrying request > [pool-5-thread-2]:[2015-07-09 > 15:25:25,522][ERROR][org.apache.kylin.job.tools.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:91)] > - error check status > java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345) > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:204) > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:589) > at java.net.Socket.connect(Socket.java:538) > at java.net.Socket.<init>(Socket.java:434) > at java.net.Socket.<init>(Socket.java:286) > at > org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80) > at > org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122) > at > org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at > org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at > org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at > org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at > org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at > org.apache.kylin.job.tools.HadoopStatusGetter.getHttpResponse(HadoopStatusGetter.java:76) > at > org.apache.kylin.job.tools.HadoopStatusGetter.get(HadoopStatusGetter.java:55) > at > org.apache.kylin.job.tools.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:56) > at > org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:136) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) > at > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50) > at > org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) > at > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,528][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557-01 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,538][DEBUG][org.apache.kylin.job.common.HadoopCmdOutput.updateJobCounter(HadoopCmdOutput.java:94)] > - Counters: 0 > [pool-5-thread-2]:[2015-07-09 > 15:25:25,558][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557-01 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,568][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557-01 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,580][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557-01 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,584][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] > - job id:1bce3bb9-669d-4095-9b74-54c2d00b3557-01 from RUNNING to ERROR > [pool-5-thread-2]:[2015-07-09 > 15:25:25,613][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,627][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,635][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] > - Saving resource /execute_output/1bce3bb9-669d-4095-9b74-54c2d00b3557 > (Store kylin_metadata@hbase) > [pool-5-thread-2]:[2015-07-09 > 15:25:25,638][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] > - job id:1bce3bb9-669d-4095-9b74-54c2d00b3557 from RUNNING to ERROR > [LocalJobRunner Map Task Executor #0]:[2015-07-09 > 15:25:25,711][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.loadKylinPropsAndMetadata(AbstractHadoopJob.java:343)] > - The absolute path for meta dir is /home/eway/meta > > > > > I don't know where to configure socket info,do you have any indications on > how to build the cube? > Thanks in advance.
