I think an unbounded measure will be problematic from the maintenance perspective as well as optimization perspective. The situation is even worse in 2.0 above versions in which we introduced GTTable concept, where each column in the GTTable is treated like a fixed length cell. This means that for each dimension and measure, we’ll always need to allocate DataTypeSerializer.maxLength() memory space. Unbounded measure will also increase the size of cube’s rows. As we all know Hbase may have difficulty in deal with every large rows. Have you ever checked what’s the largest row size of such cubes in your case?
So it would be risky to release such a immature feature to our customers, I suggest to hide the function from Web UI (or even IT) before we come up a mature solution for this. Is it possible to refer to hll implementation to set a “max” for the measure? For example we may have “bitmap(100)”, “bitmap(1000)” ? I’m also forwarding this to the dev mail list for public discussion. Regards, Bin Mahone | 马洪宾 Apache Kylin: http://kylin.io Github: https://github.com/binmahone From: Yerui Sun <sunye...@gmail.com<mailto:sunye...@gmail.com>> Date: Wednesday, January 27, 2016 at 12:25 PM To: ShaoFeng Shi <shaofeng...@apache.org<mailto:shaofeng...@apache.org>> Cc: "Ma, Hongbin" <ho...@ebay.com<mailto:ho...@ebay.com>> Subject: Re: Build failed in Jenkins: 2.x-staging-full-stagedcubing #124 Hi, shaofeng Sorry for my slow response, I missed this mail due to the wrong mail filter. Bitmap is difficult to determine the max length, because that it’s size totally depends on the data. I discussed this with liyang before, and his suggestion is just set a big number and let we see. Unfortunately, it seems not a properly number. And I also has one question, why 1.x-staging is good but 2.x-staging failed, what’s different between them? 在 2016年1月25日，14:14，ShaoFeng Shi <shaofeng...@apache.org<mailto:shaofeng...@apache.org>> 写道： Hi Yerui, The Jenkins failed to build the test cube "test_kylin_cube_without_slr_left_join_desc", I checked the log, the mapper throws OOM exception when requesting memory; it should be caused by the bitmap measure, which estimated 8Mb as the max length, which might be too high. Could you please check and enhance the estimation? One idea is to add a precision for the bitmap measure, just like the HLL or TopN; then use the selected precision to do some estimation. Please let us know your thought. Thanks! Here is the error trace in mapper; Besides, we suggest you do a fully regression test before pushing the code to git. Just let me know if you want to know the detail steps of a full CI. 2016-01-24 22:11:40,202 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.io.IOException: Failed to build cube in mapper 0 at org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:124) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:148) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.kylin.engine.mr.steps.InMemCuboidMapper.cleanup(InMemCuboidMapper.java:122) ... 8 more Caused by: java.lang.OutOfMemoryError: Java heap space at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57) at java.nio.ByteBuffer.allocate(ByteBuffer.java:331) at org.apache.kylin.cube.inmemcubing.ConcurrentDiskStore$Reader$2.<init>(ConcurrentDiskStore.java:219) at org.apache.kylin.cube.inmemcubing.ConcurrentDiskStore$Reader.iterator(ConcurrentDiskStore.java:216) at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$MergeSlot.fetchNext(DoggedCubeBuilder.java:403) at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$Merger.mergeAndOutput(DoggedCubeBuilder.java:325) at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder$BuildOnce.build(DoggedCubeBuilder.java:116) at org.apache.kylin.cube.inmemcubing.DoggedCubeBuilder.build(DoggedCubeBuilder.java:72) at org.apache.kylin.cube.inmemcubing.AbstractInMemCubeBuilder$1.run(AbstractInMemCubeBuilder.java:74) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ---------- Forwarded message ---------- From: Kylin-CI <kylin...@ebay.com<mailto:kylin...@ebay.com>> Date: 2016-01-25 13:40 GMT+08:00 Subject: Build failed in Jenkins: 2.x-staging-full-stagedcubing #124 To: dl-ebay-ky...@corp.ebay.com<mailto:dl-ebay-ky...@corp.ebay.com>, sunye...@gmail.com<mailto:sunye...@gmail.com>, lid...@apache.org<mailto:lid...@apache.org>, liy...@apache.org<mailto:liy...@apache.org>, zhongj...@apache.org<mailto:zhongj...@apache.org>, ho...@ebay.com<mailto:ho...@ebay.com>, yang...@ebay.com<mailto:yang...@ebay.com>, shaofeng...@apache.org<mailto:shaofeng...@apache.org> See <http://10.9.153.156:8888/job/2.x-staging-full-stagedcubing/124/changes> Changes: [shaofengshi] Feature changed: automatically append hive dependent jars to 'tmpjars' [shaofengshi] fix the error in BitmapSerializerTest ------------------------------------------ [...truncated 12274 lines...] 2016-01-24 22:38:17,127 INFO [pool-9-thread-10] mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1451288410220_3556/ 2016-01-24<http://sandbox.hortonworks.com:8088/proxy/application_1451288410220_3556/2016-01-24> 22:38:17,127 INFO [pool-9-thread-10] common.AbstractHadoopJob (AbstractHadoopJob.java:cleanupTempConfFile(455)) - tempMetaFileString is : file:///tmp/kylin_job_meta1882729953611388447/meta 2016-01-24 22:38:17,130 INFO [pool-9-thread-10] execution.AbstractExecutable (MapReduceExecutable.java:getRestStatusCheckUrl(218)) - kylin.job.yarn.app.rest.check.status.url is not set, read from job configuration 2016-01-24 22:38:17,130 INFO [pool-9-thread-10] execution.AbstractExecutable (MapReduceExecutable.java:getRestStatusCheckUrl(234)) - yarn.resourcemanager.webapp.address:http://sandbox.hortonworks.com:8088<http://sandbox.hortonworks.com:8088/> 2016-01-24 22:38:17,134 WARN [pool-9-thread-10] httpclient.HttpMethodBase (HttpMethodBase.java:getResponseBody(682)) - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-01-24 22:38:27,144 WARN [pool-9-thread-10] httpclient.HttpMethodBase (HttpMethodBase.java:getResponseBody(682)) - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-01-24 22:38:37,155 WARN [pool-9-thread-10] httpclient.HttpMethodBase (HttpMethodBase.java:getResponseBody(682)) - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-01-24 22:38:38,629 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 1 running, 1 actual running, 0 ready, 11 others 2016-01-24 22:38:47,165 WARN [pool-9-thread-10] httpclient.HttpMethodBase (HttpMethodBase.java:getResponseBody(682)) - Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended. 2016-01-24 22:38:47,174 INFO [pool-9-thread-10] mapred.ClientServiceDelegate (ClientServiceDelegate.java:getProxy(276)) - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server 2016-01-24 22:38:47,259 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-04 from RUNNING to SUCCEED 2016-01-24 22:38:47,278 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from RUNNING to READY 2016-01-24 22:38:47,289 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(96)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} prepare to schedule 2016-01-24 22:38:47,290 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(100)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} scheduled 2016-01-24 22:38:47,290 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49 <<<<<<<<<<<<< 2016-01-24 22:38:47,291 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 0 running, 1 actual running, 1 ready, 11 others 2016-01-24 22:38:47,294 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from READY to RUNNING 2016-01-24 22:38:47,298 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> Load HFile to HBase Table <<<<<<<<<<<<< 2016-01-24 22:38:47,301 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-05 from READY to RUNNING 2016-01-24 22:38:47,302 INFO [pool-9-thread-10] execution.AbstractExecutable (HadoopShellExecutable.java:doWork(55)) - parameters of the HadoopShellExecutable: 2016-01-24 22:38:47,302 INFO [pool-9-thread-10] execution.AbstractExecutable (HadoopShellExecutable.java:doWork(56)) - -input hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1/test_kylin_cube_with_slr_left_join_empty/hfile<http://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1/test_kylin_cube_with_slr_left_join_empty/hfile> -htablename KYLIN_YEP3XI2E4R -cubename test_kylin_cube_with_slr_left_join_empty 2016-01-24 22:38:47,371 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7ac0574e, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:38:47,372 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7ac0574e connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:38:47,373 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:38:47,374 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:38:47,422 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d56, negotiated timeout = 30000 2016-01-24 22:38:47,553 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d56 closed 2016-01-24 22:38:47,553 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:38:47,561 WARN [pool-9-thread-10] mapreduce.LoadIncrementalHFiles (LoadIncrementalHFiles.java:discoverLoadQueue(183)) - Skipping non-directory hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1/test_kylin_cube_with_slr_left_join_empty/hfile/_SUCCESS 2016-01-24<http://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1/test_kylin_cube_with_slr_left_join_empty/hfile/_SUCCESS2016-01-24> 22:38:47,575 INFO [LoadIncrementalHFiles-0] compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz] 2016-01-24 22:38:47,576 INFO [LoadIncrementalHFiles-0] compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz] 2016-01-24 22:38:47,576 INFO [LoadIncrementalHFiles-0] compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz] 2016-01-24 22:38:47,577 INFO [LoadIncrementalHFiles-0] compress.CodecPool (CodecPool.java:getDecompressor(179)) - Got brand-new decompressor [.gz] 2016-01-24 22:38:47,577 INFO [LoadIncrementalHFiles-0] mapreduce.LoadIncrementalHFiles (LoadIncrementalHFiles.java:groupOrSplit(520)) - Trying to load hfile=hdfs://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1/test_kylin_cube_with_slr_left_join_empty/hfile/F1/2e92979676474c7dacc817acf5ea4d9e<http://sandbox.hortonworks.com:8020/kylin/kylin_metadata/kylin-d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1/test_kylin_cube_with_slr_left_join_empty/hfile/F1/2e92979676474c7dacc817acf5ea4d9e> first=\x00\x00\x00\x00\x00\x00\x01\x0710000000\x09\x09\x09\x09\x09\x09\x09\x09\x09\x09ABIN\x09\x09\x09\x09\x09\x09\x09\x09\x02\x00 last=\x00\x00\x00\x00\x00\x00\x01\xFF10000999\x09\x09\x09\x09\x09\x09\x09\x09\x09\x09\x0B8\xAAG\xFF\xFF\xFFFP-non GTC\x09\x09\x03\x03 2016-01-24 22:38:47,642 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-05 from RUNNING to SUCCEED 2016-01-24 22:38:47,663 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from RUNNING to READY 2016-01-24 22:38:47,674 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(96)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} prepare to schedule 2016-01-24 22:38:47,676 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(100)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} scheduled 2016-01-24 22:38:47,676 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49 <<<<<<<<<<<<< 2016-01-24 22:38:47,678 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 0 running, 1 actual running, 1 ready, 11 others 2016-01-24 22:38:47,680 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from READY to RUNNING 2016-01-24 22:38:47,685 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> Update Cube Info <<<<<<<<<<<<< 2016-01-24 22:38:47,688 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-06 from READY to RUNNING 2016-01-24 22:38:47,693 INFO [pool-9-thread-10] cube.CubeManager (CubeManager.java:promoteNewlyBuiltSegments(706)) - Promoting cube CUBE[name=test_kylin_cube_with_slr_left_join_empty], new segments [test_kylin_cube_with_slr_left_join_empty[19700101000000_20130701000000]], to remove segments [test_kylin_cube_with_slr_left_join_empty[19700101000000_20130101000000], test_kylin_cube_with_slr_left_join_empty[20130101000000_20130701000000]] 2016-01-24 22:38:47,693 INFO [pool-9-thread-10] cube.CubeManager (CubeManager.java:updateCubeWithRetry(312)) - Updating cube instance 'test_kylin_cube_with_slr_left_join_empty' 2016-01-24 22:38:47,699 INFO [pool-4-thread-1] restclient.Broadcaster (Broadcaster.java:run(101)) - new broadcast event:BroadcastEvent{type=cube, name=test_kylin_cube_with_slr_left_join_empty, action=update} 2016-01-24 22:38:47,700 INFO [pool-5-thread-1] httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(439)) - I/O exception (java.net.ConnectException) caught when processing request: Connection refused 2016-01-24 22:38:47,700 INFO [pool-5-thread-1] httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(445)) - Retrying request 2016-01-24 22:38:47,700 INFO [pool-5-thread-1] httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(439)) - I/O exception (java.net.ConnectException) caught when processing request: Connection refused 2016-01-24 22:38:47,700 INFO [pool-5-thread-1] httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(445)) - Retrying request 2016-01-24 22:38:47,701 INFO [pool-5-thread-1] httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(439)) - I/O exception (java.net.ConnectException) caught when processing request: Connection refused 2016-01-24 22:38:47,701 INFO [pool-5-thread-1] httpclient.HttpMethodDirector (HttpMethodDirector.java:executeWithRetry(445)) - Retrying request 2016-01-24 22:38:47,701 WARN [pool-5-thread-1] restclient.Broadcaster (Broadcaster.java:run(109)) - Thread failed during wipe cache at BroadcastEvent{type=cube, name=test_kylin_cube_with_slr_left_join_empty, action=update} 2016-01-24 22:38:47,704 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-06 from RUNNING to SUCCEED 2016-01-24 22:38:47,723 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from RUNNING to READY 2016-01-24 22:38:47,735 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(96)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} prepare to schedule 2016-01-24 22:38:47,735 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(100)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} scheduled 2016-01-24 22:38:47,735 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49 <<<<<<<<<<<<< 2016-01-24 22:38:47,737 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 0 running, 1 actual running, 1 ready, 11 others 2016-01-24 22:38:47,739 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from READY to RUNNING 2016-01-24 22:38:47,745 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> Garbage Collection <<<<<<<<<<<<< 2016-01-24 22:38:47,747 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-07 from READY to RUNNING 2016-01-24 22:38:47,748 INFO [pool-9-thread-10] steps.MergeGCStep (MergeGCStep.java:doWork(60)) - Sleep one minute before deleting the Htables 2016-01-24 22:39:38,629 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 1 running, 1 actual running, 0 ready, 11 others 2016-01-24 22:39:47,748 INFO [pool-9-thread-10] steps.MergeGCStep (MergeGCStep.java:doWork(66)) - Start doing merge gc work 2016-01-24 22:39:47,778 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:47,779 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:47,779 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:47,781 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:47,837 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d57, negotiated timeout = 30000 2016-01-24 22:39:47,849 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d57 closed 2016-01-24 22:39:47,849 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:47,854 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:47,855 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:47,855 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:47,856 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:47,861 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d58, negotiated timeout = 30000 2016-01-24 22:39:47,873 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d58 closed 2016-01-24 22:39:47,873 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:47,874 INFO [pool-9-thread-10] client.HBaseAdmin (HBaseAdmin.java:call(917)) - Started disable of KYLIN_81XD3XZMLG 2016-01-24 22:39:47,897 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:47,898 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:47,899 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:47,899 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:47,909 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d59, negotiated timeout = 30000 2016-01-24 22:39:47,960 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d59 closed 2016-01-24 22:39:47,960 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:48,062 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:48,063 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:48,063 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:48,064 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:48,081 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d5a, negotiated timeout = 30000 2016-01-24 22:39:48,098 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d5a closed 2016-01-24 22:39:48,099 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:48,301 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:48,302 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:48,302 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:48,303 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:48,320 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d5b, negotiated timeout = 30000 2016-01-24 22:39:48,350 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d5b closed 2016-01-24 22:39:48,350 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:48,652 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:48,653 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:48,653 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:48,655 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:48,681 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d5c, negotiated timeout = 30000 2016-01-24 22:39:48,693 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d5c closed 2016-01-24 22:39:48,693 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:49,195 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:49,196 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:49,196 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:49,197 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:49,230 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d5d, negotiated timeout = 30000 2016-01-24 22:39:49,243 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d5d closed 2016-01-24 22:39:49,243 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:49,244 INFO [pool-9-thread-10] client.HBaseAdmin (HBaseAdmin.java:disableTable(971)) - Disabled KYLIN_81XD3XZMLG 2016-01-24 22:39:49,370 INFO [pool-9-thread-10] client.HBaseAdmin (HBaseAdmin.java:deleteTable(705)) - Deleted KYLIN_81XD3XZMLG 2016-01-24 22:39:49,371 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:49,372 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:49,372 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:49,373 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:49,457 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d5e, negotiated timeout = 30000 2016-01-24 22:39:49,470 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d5e closed 2016-01-24 22:39:49,470 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:49,475 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:49,475 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:49,476 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:49,476 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:49,482 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d5f, negotiated timeout = 30000 2016-01-24 22:39:49,494 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d5f closed 2016-01-24 22:39:49,494 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:49,496 INFO [pool-9-thread-10] client.HBaseAdmin (HBaseAdmin.java:call(917)) - Started disable of KYLIN_EDKPVB3BG2 2016-01-24 22:39:49,549 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:49,550 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:49,551 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:49,552 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:49,560 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d60, negotiated timeout = 30000 2016-01-24 22:39:49,686 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d60 closed 2016-01-24 22:39:49,687 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:49,788 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:49,789 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:49,789 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:49,791 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:49,806 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d61, negotiated timeout = 30000 2016-01-24 22:39:49,817 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d61 closed 2016-01-24 22:39:49,817 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:50,019 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:50,020 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:50,021 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:50,022 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:50,122 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d62, negotiated timeout = 30000 2016-01-24 22:39:50,140 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d62 closed 2016-01-24 22:39:50,140 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:50,442 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:50,443 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:50,444 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:50,445 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:50,498 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d63, negotiated timeout = 30000 2016-01-24 22:39:50,512 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d63 closed 2016-01-24 22:39:50,512 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:51,014 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:<init>(438)) - Initiating client connection, connectString=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> sessionTimeout=30000 watcher=catalogtracker-on-hconnection-0x7cf99a4d, quorum=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>, baseZNode=/hbase-unsecure 2016-01-24 22:39:51,015 INFO [pool-9-thread-10] zookeeper.RecoverableZooKeeper (RecoverableZooKeeper.java:<init>(120)) - Process identifier=catalogtracker-on-hconnection-0x7cf99a4d connecting to ZooKeeper ensemble=sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/> 2016-01-24 22:39:51,016 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:logStartConnect(975)) - Opening socket connection to server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>. Will not attempt to authenticate using SASL (unknown error) 2016-01-24 22:39:51,017 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:primeConnection(852)) - Socket connection established to sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, initiating session 2016-01-24 22:39:51,056 INFO [pool-9-thread-10-SendThread(sandbox.hortonworks.com:2181<http://sandbox.hortonworks.com:2181/>)] zookeeper.ClientCnxn (ClientCnxn.java:onConnected(1235)) - Session establishment complete on server sandbox.hortonworks.com/10.9.153.156:2181<http://sandbox.hortonworks.com/10.9.153.156:2181>, sessionid = 0x1523a5846471d64, negotiated timeout = 30000 2016-01-24 22:39:51,068 INFO [pool-9-thread-10] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d64 closed 2016-01-24 22:39:51,068 INFO [pool-9-thread-10-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down 2016-01-24 22:39:51,069 INFO [pool-9-thread-10] client.HBaseAdmin (HBaseAdmin.java:disableTable(971)) - Disabled KYLIN_EDKPVB3BG2 2016-01-24 22:39:51,190 INFO [pool-9-thread-10] client.HBaseAdmin (HBaseAdmin.java:deleteTable(705)) - Deleted KYLIN_EDKPVB3BG2 2016-01-24 22:39:51,197 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-07 from RUNNING to SUCCEED 2016-01-24 22:39:51,219 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from RUNNING to READY 2016-01-24 22:39:51,231 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(96)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} prepare to schedule 2016-01-24 22:39:51,232 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(100)) - CubingJob{id=d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1, name=test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49, state=READY} scheduled 2016-01-24 22:39:51,232 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> test_kylin_cube_with_slr_left_join_empty - 19700101000000_20130701000000 - MERGE - GMT-08:00 2016-01-24 21:35:49 <<<<<<<<<<<<< 2016-01-24 22:39:51,234 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 0 running, 1 actual running, 1 ready, 11 others 2016-01-24 22:39:51,237 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from READY to RUNNING 2016-01-24 22:39:51,245 INFO [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:execute(99)) - Executing >>>>>>>>>>>>> Garbage Collection <<<<<<<<<<<<< 2016-01-24 22:39:51,249 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-08 from READY to RUNNING 2016-01-24 22:39:51,280 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1-08 from RUNNING to SUCCEED 2016-01-24 22:39:51,307 INFO [pool-9-thread-10] manager.ExecutableManager (ExecutableManager.java:updateJobOutput(273)) - job id:d58ad4a7-7eea-4a42-9e0f-1267bd86d5c1 from RUNNING to SUCCEED 2016-01-24 22:39:51,307 WARN [pool-9-thread-10] execution.AbstractExecutable (AbstractExecutable.java:notifyUserStatusChange(208)) - no need to send email, user list is empty 2016-01-24 22:39:51,319 INFO [pool-8-thread-1] threadpool.DefaultScheduler (DefaultScheduler.java:run(106)) - Job Fetcher: 0 running, 0 actual running, 0 ready, 12 others 2016-01-24 22:39:54,738 ERROR [main] job.BuildCubeWithEngineTest (BuildCubeWithEngineTest.java:runTestAndAssertSucceed(169)) - java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4,597.364 sec <<< FAILURE! - in org.apache.kylin.job.BuildCubeWithEngineTest test(org.apache.kylin.job.BuildCubeWithEngineTest) Time elapsed: 4,596.904 sec <<< ERROR! java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException at org.apache.kylin.cube.CubeManager.checkNoBuildingSegment(CubeManager.java:538) at org.apache.kylin.cube.CubeManager.appendSegments(CubeManager.java:435) at org.apache.kylin.cube.CubeManager.appendSegments(CubeManager.java:430) at org.apache.kylin.cube.CubeManager.appendSegments(CubeManager.java:415) at org.apache.kylin.job.BuildCubeWithEngineTest.buildSegment(BuildCubeWithEngineTest.java:319) at org.apache.kylin.job.BuildCubeWithEngineTest.testLeftJoinCubeWithoutSlr(BuildCubeWithEngineTest.java:268) 2016-01-24 22:39:54,776 INFO [Thread-1] client.HConnectionManager$HConnectionImplementation (HConnectionManager.java:closeZooKeeperWatcher(1856)) - Closing zookeeper sessionid=0x1523a5846471d1f 2016-01-24 22:39:54,790 INFO [Thread-1] zookeeper.ZooKeeper (ZooKeeper.java:close(684)) - Session: 0x1523a5846471d1f closed 2016-01-24 22:39:54,790 INFO [main-EventThread] zookeeper.ClientCnxn (ClientCnxn.java:run(512)) - EventThread shut down Results : Tests in error: BuildCubeWithEngineTest.test:139->testLeft:149->runTestAndAssertSucceed:163 » Execution Tests run: 1, Failures: 0, Errors: 1, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Kylin:HadoopOLAPEngine ............................. SUCCESS [ 1.346 s] [INFO] Kylin:AtopCalcite .................................. SUCCESS [ 0.983 s] [INFO] Kylin:Core-Common .................................. SUCCESS [ 1.319 s] [INFO] Kylin:Core-Metadata ................................ SUCCESS [ 1.793 s] [INFO] Kylin:Core-Dictionary .............................. SUCCESS [ 0.671 s] [INFO] Kylin:Core-Cube .................................... SUCCESS [ 0.716 s] [INFO] Kylin:Core-Job ..................................... SUCCESS [ 0.688 s] [INFO] Kylin:Core-Storage ................................. SUCCESS [ 0.691 s] [INFO] Kylin:InvertedIndex ................................ SUCCESS [ 3.072 s] [INFO] Kylin:Engine-MR .................................... SUCCESS [ 2.117 s] [INFO] Kylin:Engine-Streaming ............................. SUCCESS [ 0.481 s] [INFO] Kylin:Storage-HBase ................................ SUCCESS [ 3.469 s] [INFO] Kylin:Spark ........................................ SUCCESS [ 2.491 s] [INFO] Kylin:Source-Hive .................................. SUCCESS [ 0.857 s] [INFO] Kylin:Source-Kafka ................................. SUCCESS [ 0.358 s] [INFO] Kylin:Query ........................................ SUCCESS [ 1.247 s] [INFO] Kylin:JDBC ......................................... SUCCESS [ 0.131 s] [INFO] Kylin:RESTServer ................................... SUCCESS [ 5.979 s] [INFO] Kylin:Assembly ..................................... FAILURE [ 01:16 h] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:17 h [INFO] Finished at: 2016-01-24T22:39:59-07:00 [INFO] Final Memory: 84M/2216M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project kylin-assembly: There are test failures. [ERROR] [ERROR] Please refer to <http://10.9.153.156:8888/job/2.x-staging-full-stagedcubing/ws/assembly/../target/surefire-reports<http://10.9.153.156:8888/job/2.x-staging-full-stagedcubing/ws/target/surefire-reports>> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :kylin-assembly Build step 'Invoke top-level Maven targets' marked build as failure Recording test results Skipping sonar analysis due to bad build status FAILURE -- Best regards, Shaofeng Shi
