[
https://issues.apache.org/jira/browse/KYLIN-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI reopened KYLIN-3559:
---------------------------------
The integration test was failed in last night:
2018-11-26 20:01:08,950 INFO [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] execution.ExecutableManager:435 : job
id:ac05a6b3-b6de-6a60-bd2b-778e76b58998-00 from READY to RUNNING 2018-11-26
20:01:08,951 INFO [FetcherRunner 1980278840-288] threadpool.FetcherRunner:62 :
CubingJob\{id=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb, name=OPTIMIZE CUBE -
ci_inner_join_cube - 20120601000000_20130701000000 - GMT+08:00 2018-11-27
04:01:08, state=READY} prepare to schedule and its priority is 5 2018-11-26
20:01:08,951 INFO [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.AbstractExecutable:148 :
Executing AbstractExecutable (OPTIMIZE CUBE - ci_inner_join_cube -
20120601000000_20130701000000 - GMT+08:00 2018-11-27 04:01:08) 2018-11-26
20:01:08,951 INFO [FetcherRunner 1980278840-288] threadpool.FetcherRunner:66 :
CubingJob\{id=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb, name=OPTIMIZE CUBE -
ci_inner_join_cube - 20120601000000_20130701000000 - GMT+08:00 2018-11-27
04:01:08, state=READY} scheduled 2018-11-26 20:01:08,952 INFO [FetcherRunner
1980278840-288] threadpool.DefaultFetcherRunner:96 : Job Fetcher: 0 should
running, 2 actual running, 0 stopped, 2 ready, 2 already succeed, 0 error, 0
discarded, 1 others 2018-11-26 20:01:08,953 INFO [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] execution.ExecutableManager:435 : job
id:fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb from READY to RUNNING 2018-11-26
20:01:08,953 DEBUG [pool-4-thread-1] cachesync.Broadcaster:113 : Servers in the
cluster: [localhost:7070] 2018-11-26 20:01:08,953 DEBUG [pool-4-thread-1]
cachesync.Broadcaster:123 : Announcing new broadcast to all:
BroadcastEvent\{entity=execute_output, event=update,
cacheKey=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb} 2018-11-26 20:01:08,953 ERROR
[pool-5-thread-1] cachesync.Broadcaster:137 : Announce broadcast event failed,
targetNode localhost:7070 broadcastEvent BroadcastEvent\{entity=execute_output,
event=update, cacheKey=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb}, error msg:
org.apache.http.conn.HttpHostConnectException: Connection to
[http://localhost:7070|http://localhost:7070/]
refused 2018-11-26 20:01:08,953 ERROR [pool-5-thread-1]
cachesync.Broadcaster:330 : Announce broadcast event exceeds retry limit,
abandon targetNode localhost:7070 broadcastEvent
BroadcastEvent\{entity=execute_output, event=update,
cacheKey=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb} 2018-11-26 20:01:08,954 INFO
[Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645]
execution.AbstractExecutable:148 : Executing AbstractExecutable (Filter
Recommend Cuboid Data for Optimization) 2018-11-26 20:01:08,955 INFO [Scheduler
1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645]
execution.ExecutableManager:435 : job
id:fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-00 from READY to RUNNING 2018-11-26
20:01:09,009 INFO [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.MapReduceExecutable:128 :
parameters of the MapReduceExecutable: -conf
/var/jenkins/workspace/kylin-master-full-regression/kylin-it/../examples/test_case_data/sandbox/kylin_job_conf.xml
-cubename ci_inner_join_cube -segmentid bd8b568c-16af-6813-aabe-aba8345ae4b1
-input
hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-5d654bc7-7a92-6c86-2102-6ade864a77a5/ci_inner_join_cube/cuboid/*
-output
hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-ac05a6b3-b6de-6a60-bd2b-778e76b58998/ci_inner_join_cube/optimize/cuboid/
-jobname Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26
20:01:09,010 INFO [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] steps.FilterRecommendCuboidDataJob:66
: Starting: Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26
20:01:09,010 DEBUG [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:245 : No
hive dependency jars set in the environment, will find them from classpath:
2018-11-26 20:01:09,043 INFO [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.MapReduceExecutable:128 :
parameters of the MapReduceExecutable: -conf
/var/jenkins/workspace/kylin-master-full-regression/kylin-it/../examples/test_case_data/sandbox/kylin_job_conf.xml
-cubename ci_inner_join_cube -segmentid 443b2a1d-213a-7f99-c399-2ebe28539d86
-input
hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-8f043b00-6cde-f794-ab02-8b57f58da1c4/ci_inner_join_cube/cuboid/*
-output
hdfs://sandbox.hortonworks.com:8020/kylin/dl_dev_kylinmaster_ci_instance/kylin-fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb/ci_inner_join_cube/optimize/cuboid/
-jobname Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26
20:01:09,045 INFO [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] steps.FilterRecommendCuboidDataJob:66
: Starting: Kylin_Filter_Recommend_Cuboid_Data_ci_inner_join_cube 2018-11-26
20:01:09,045 DEBUG [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:245 : No
hive dependency jars set in the environment, will find them from classpath:
2018-11-26 20:01:09,143 DEBUG [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:251 :
hive-exec jar file:
/root/.m2/repository/org/apache/hive/hive-exec/1.2.1/hive-exec-1.2.1.jar
2018-11-26 20:01:09,143 DEBUG [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:251 :
hive-exec jar file:
/root/.m2/repository/org/apache/hive/hive-exec/1.2.1/hive-exec-1.2.1.jar
2018-11-26 20:01:09,150 DEBUG [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:256 :
hive-catalog jar file:
/root/.m2/repository/org/apache/hive/hcatalog/hive-hcatalog-core/1.2.1/hive-hcatalog-core-1.2.1.jar
2018-11-26 20:01:09,150 DEBUG [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:256 :
hive-catalog jar file:
/root/.m2/repository/org/apache/hive/hcatalog/hive-hcatalog-core/1.2.1/hive-hcatalog-core-1.2.1.jar
2018-11-26 20:01:09,167 DEBUG [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:261 :
hive-metastore jar file:
/root/.m2/repository/org/apache/hive/hive-metastore/1.2.1/hive-metastore-1.2.1.jar
2018-11-26 20:01:09,167 DEBUG [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:273 : No
Kafka dependency jar set in the environment, will find them from classpath:
2018-11-26 20:01:09,167 DEBUG [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:261 :
hive-metastore jar file:
/root/.m2/repository/org/apache/hive/hive-metastore/1.2.1/hive-metastore-1.2.1.jar
2018-11-26 20:01:09,168 DEBUG [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:273 : No
Kafka dependency jar set in the environment, will find them from classpath:
2018-11-26 20:01:09,288 DEBUG [Scheduler 1211715398 Job
ac05a6b3-b6de-6a60-bd2b-778e76b58998-663] common.AbstractHadoopJob:278 : kafka
jar file:
/root/.m2/repository/org/apache/kafka/kafka-clients/1.0.0/kafka-clients-1.0.0.jar
2018-11-26 20:01:09,289 DEBUG [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] common.AbstractHadoopJob:278 : kafka
jar file:
/root/.m2/repository/org/apache/kafka/kafka-clients/1.0.0/kafka-clients-1.0.0.jar
2018-11-26 20:01:09,310 ERROR [Scheduler 1211715398 Job
fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645] steps.FilterRecommendCuboidDataJob:97
: error in CuboidJob java.lang.IllegalArgumentException: Can not create a Path
from an empty string at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126)
at org.apache.hadoop.fs.Path.<init>(Path.java:134) at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328)
at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290)
at
org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 2018-11-26 20:01:09,310 ERROR
[Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663]
steps.FilterRecommendCuboidDataJob:97 : error in CuboidJob
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at
org.apache.hadoop.fs.Path.<init>(Path.java:134) at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328)
at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290)
at
org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) usage: FilterRecommendCuboidDataJob
-cubename <cubename> Cube name. For exmaple, flat_item_cube -input <input>
Input path -jobname <jobname> Job name. For example,
Kylin_Cuboid_Builder-clsfd_v2_Step_22-D) -output <output> Output path
-segmentid <segmentid> Cube segment id usage: FilterRecommendCuboidDataJob
-cubename <cubename> Cube name. For exmaple, flat_item_cube -input <input>
Input path -jobname <jobname> Job name. For example,
Kylin_Cuboid_Builder-clsfd_v2_Step_22-D) -output <output> Output path
-segmentid <segmentid> Cube segment id 2018-11-26 20:01:09,380 ERROR [Scheduler
1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645]
common.MapReduceExecutable:138 : error execute
MapReduceExecutable\{id=fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-00, name=Filter
Recommend Cuboid Data for Optimization, state=RUNNING}
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at
org.apache.hadoop.fs.Path.<init>(Path.java:134) at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328)
at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290)
at
org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 2018-11-26 20:01:09,380 ERROR
[Scheduler 1211715398 Job ac05a6b3-b6de-6a60-bd2b-778e76b58998-663]
common.MapReduceExecutable:138 : error execute
MapReduceExecutable\{id=ac05a6b3-b6de-6a60-bd2b-778e76b58998-00, name=Filter
Recommend Cuboid Data for Optimization, state=RUNNING}
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:126) at
org.apache.hadoop.fs.Path.<init>(Path.java:134) at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobTmpJarsAndFiles(AbstractHadoopJob.java:328)
at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:290)
at
org.apache.kylin.engine.mr.steps.FilterRecommendCuboidDataJob.run(FilterRecommendCuboidDataJob.java:68)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:131)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:70)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:164)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) 2018-11-26 20:01:09,385 INFO
[Scheduler 1211715398 Job fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-645]
execution.ExecutableManager:435 : job
id:fd124f4f-00c5-949e-b2f0-17c8cf5cd3bb-00 from RUNNING to ERROR
> Use Splitter for splitting String
> ---------------------------------
>
> Key: KYLIN-3559
> URL: https://issues.apache.org/jira/browse/KYLIN-3559
> Project: Kylin
> Issue Type: Task
> Reporter: Ted Yu
> Assignee: Wu Bin
> Priority: Major
> Fix For: v2.6.0
>
>
> See http://errorprone.info/bugpattern/StringSplitter for why Splitter is
> preferred .
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
