Re: Re: [jira] [Commented] (KYLIN-2235) PowerBI get exception "array dimensions exceed supported ranges"
what's your point, i am confused wangxianbin1...@gmail.com From: cong.xi...@hand-china.com Date: 2017-06-16 17:55 To: dev Subject: Re: [jira] [Commented] (KYLIN-2235) PowerBI get exception "array dimensions exceed supported ranges" hello,you power bi can connect power bi? my kylin do not connect power bi cong.xi...@hand-china.com From: wangxianbin (JIRA) Date: 2017-06-16 17:52 To: issues Subject: [jira] [Commented] (KYLIN-2235) PowerBI get exception "array dimensions exceed supported ranges" [ https://issues.apache.org/jira/browse/KYLIN-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051696#comment-16051696 ] wangxianbin commented on KYLIN-2235: hi! have the same issue when we use excel with Kylin ODBC Driver v1.6 x64, os is x64, any update? > PowerBI get exception "array dimensions exceed supported ranges" > > > Key: KYLIN-2235 > URL: https://issues.apache.org/jira/browse/KYLIN-2235 > Project: Kylin > Issue Type: Bug > Components: Driver - ODBC >Affects Versions: v1.6.0 >Reporter: Dong Li > > Run SQL: > select KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME from KYLIN_CATEGORY_GROUPINGS > Then get exception: > "array dimensions exceed supported ranges" -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: Re: when build kylin cube,the job stopping at 77.78%,can't go on the job
hi kun! I don't know why we need such a extro config. I guess there is something I missed. best regards! wangxianbin1...@gmail.com From: zhangrongkun Date: 2016-05-06 10:14 To: dev Subject: Re: when build kylin cube,the job stopping at 77.78%,can't go on the job Accross add this config at my kylin_hive_conf.xml and kylin_job_conf.xml,My cube build successfully,the config is: hbase.zookeeper.quorum hadoop21:2181,hadoop25:2181,hadoop37:2181,hadoop45:2181,hadoop140:2181 -- View this message in context: http://apache-kylin.74782.x6.nabble.com/when-build-kylin-cube-the-job-stopping-at-77-78-can-t-go-on-the-job-tp4421p4438.html Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: Re: when build kylin cube,the job stopping at 77.78%,can't go on the job
hi kun! I mean check your hadoop mapreduce task status & log, there may have something goes wrong. notice that hbase client will try many times before throw Exception out, which means you need to wait for a while(on my case, over 30 mins), before you can see the error in mapreduce task log! best regards! wangxianbin1...@gmail.com From: zhangrongkun Date: 2016-05-05 18:55 To: dev Subject: Re: when build kylin cube,the job stopping at 77.78%,can't go on the job No! My kylin‘s log haven't any exception,and My HBase works well. there is my MRApp’s log： 2016-05-05 18:32:37,273 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 2 2016-05-05 18:32:37,274 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned to reduce 2016-05-05 18:32:37,274 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1461663034262_1777_01_10 to attempt_1461663034262_1777_r_00_0 2016-05-05 18:32:37,274 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned to reduce 2016-05-05 18:32:37,275 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1461663034262_1777_01_11 to attempt_1461663034262_1777_r_01_0 2016-05-05 18:32:37,275 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:7 AssignedReds:2 CompletedMaps:1 CompletedReds:0 ContAlloc:10 ContRel:0 HostLocal:2 RackLocal:6 2016-05-05 18:32:37,290 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop22 to /default-rack 2016-05-05 18:32:37,291 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1461663034262_1777_r_00_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-05-05 18:32:37,292 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved hadoop24 to /default-rack 2016-05-05 18:32:37,293 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1461663034262_1777_r_01_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED 2016-05-05 18:32:37,294 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1461663034262_1777_01_11 taskAttempt attempt_1461663034262_1777_r_01_0 2016-05-05 18:32:37,294 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1461663034262_1777_r_01_0 2016-05-05 18:32:37,295 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1461663034262_1777_01_10 taskAttempt attempt_1461663034262_1777_r_00_0 2016-05-05 18:32:37,295 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1461663034262_1777_r_00_0 2016-05-05 18:32:37,301 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1461663034262_1777_r_01_0 : 13562 2016-05-05 18:32:37,301 INFO [ContainerLauncher #9] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1461663034262_1777_r_00_0 : 13562 2016-05-05 18:32:37,301 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1461663034262_1777_r_01_0] using containerId: [container_1461663034262_1777_01_11 on NM: [hadoop24:45083] 2016-05-05 18:32:37,302 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1461663034262_1777_r_01_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-05-05 18:32:37,302 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1461663034262_1777_r_00_0] using containerId: [container_1461663034262_1777_01_10 on NM: [hadoop22:43623] 2016-05-05 18:32:37,303 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1461663034262_1777_r_00_0 TaskAttempt Transitioned from ASSIGNED to RUNNING 2016-05-05 18:32:37,303 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1461663034262_1777_r_01 2016-05-05 18:32:37,304 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1461663034262_1777_r_01 Task Transitioned
Re: when build kylin cube,the job stopping at 77.78%,can't go on the job
hi kun! check your yarn log, see if it is duplicated with https://issues.apache.org/jira/browse/KYLIN-1659 best regards! wangxianbin1...@gmail.com From: zhangrongkun Date: 2016-05-05 18:46 To: dev Subject: when build kylin cube,the job stopping at 77.78%,can't go on the job My cluster resource is enough,and the kylin.log haven't any exception <http://apache-kylin.74782.x6.nabble.com/file/n4421/QQ%E6%88%AA%E5%9B%BE20160505185528.png> -- View this message in context: http://apache-kylin.74782.x6.nabble.com/when-build-kylin-cube-the-job-stopping-at-77-78-can-t-go-on-the-job-tp4421.html Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: Re： hive table change
hi hongbin! can you give a more clear description, I can not understand "you'll find it helpful", did you miss something? best regards! wangxianbin1...@gmail.com 发件人： hongbin ma 发送时间： 2016-04-22 13:51 收件人： dev 主题： Re: 回复： hive table change yes, theoretically if you hive CLI does not co-exist on the server you deployed Kylin (which must be a hbase CLI), you'll find it helpful. However in most cases hbase CLI is also a hive CLI, then you don't have the problem On Fri, Apr 22, 2016 at 1:20 PM, wangxianbin1...@gmail.com < wangxianbin1...@gmail.com> wrote: > hi all! > > thanks hongbin & dong help to clarify this. > > just one more thing need to be confirmed, kylin.job.remote.cli.hostname > CLI(which can be remote) seem like will be used for create intermediate > flat table, not just for dev use, right? > > best regards! > > > > wangxianbin1...@gmail.com > > 发件人： Dong Li > 发送时间： 2016-04-22 10:35 > 收件人： dev > 主题： 回复： 回复： hive table change > Hello, > > > Try to set env var HIVE_CONF_DIR and HIVE_CONF before start kylin service: > > > bin/kylin.sh stop > export HIVE_CONF_DIR=The real conf path kylin want to access > export HIVE_CONF=The real conf path kylin want to access > bin/kylin.sh start > > > Thanks, > Dong Li > > > Original Message > Sender:耳东775620...@qq.com > Recipient:dev...@kylin.apache.org > Date:Thursday, Apr 21, 2016 19:04 > Subject:回复： 回复： hive table change > > > yes,as you said Kylin see the same tables as the hive shell in the server. > however in my cluster there is another app which invoke hive and create > some hive tables, of which the metadata and store location is different > from the hive shell. how can i make the kylin to access these tables? > -- 原始邮件 -- 发件人: "hongbin ma"; > mahong...@apache.org; 发送时间: 2016年4月21日(星期四) 晚上6:31 收件人: "dev" > dev@kylin.apache.org; 主题: Re: 回复： hive table change I want to clarify > that kylin.job.remote.cli.hostname is usually used for developing purpose, > it's not related to hive table syncing. The way how Kylin gets aware of > hive table is through HCatlog. When kylin starts, it will look for hive > settings where Kylin resides to initialize HCatlog. So basically kylin will > see same tables as the hive shell in the that server. On Thu, Apr 21, 2016 > at 3:20 PM, wangxianbin1...@gmail.com wangxianbin1...@gmail.com wrote: > hi! for clarifying, hive can deploy in remote mode, kylin access it by > "SSHClient" best regards!wangxianbin1...@gmail.com 发件人： 耳东 发送时间： > 2016-04-21 14:57 收件人： dev 主题： 回复： hive table change How does kylin > access the hive table , where can I configure to change the hive metadata > kylin access. -- 原始邮件 -- 发件人: " > wangxianbin1...@gmail.com";wangxianbin1...@gmail.com; 发送时间: > 2016年4月21日(星期四) 中午1:19 收件人: "dev"dev@kylin.apache.org; 主题: 回复: hive > table change hi! what do you mean by "original hive table position"? > do you mean hive "external table" or hive table that specific new hdfs > location by hive 'location' keywords? if it is so, you don't have to do > extro config if you mean hive that not deploy with kylin, it seem like > that it is not supported by kylin(need comfirm by others) best regards! >wangxianbin1...@gmail.com 发件人： 耳东 发送时间： 2016-04-21 11:34 收件人： dev > 主题： hive table change hi all： In my cluster there is another application > which create some hive tables not in the original hive table position. > where should I configure to access these hive tables？ -- Regards, *Bin > Mahone | 马洪宾* Apache Kylin: http://kylin.io Github: > https://github.com/binmahone > -- Regards, *Bin Mahone | 马洪宾* Apache Kylin: http://kylin.io Github: https://github.com/binmahone
????: hive table change
hi! what do you mean by "original hive table position"? do you mean hive "external table" or hive table that specific new hdfs location by hive 'location' keywords? if it is so, you don't have to do extro config if you mean hive that not deploy with kylin, it seem like that it is not supported by kylin(need comfirm by others) best regards! wangxianbin1...@gmail.com ?? 2016-04-21 11:34 dev ?? hive table change hi all?? In my cluster there is another application which create some hive tables not in the original hive table position. where should I configure to access these hive tables??
Re: build cube error
hi!
what do you mean? are you using hive view as lookup table?
if it is so, it is a known issue, check this out,
https://issues.apache.org/jira/browse/KYLIN-1077
best regards!
wangxianbin1...@gmail.com
From: 陈佛林
Date: 2016-04-13 16:51
To: dev
Subject: build cube error
all job at yarn are SUCCESS.
2016-04-13 15:54:58,765 WARN [http-bio-7070-exec-1]
service.CacheService:108 : skip cleaning cache for
668468ba-f470-4c37-9b12-d66aa44cef30
2016-04-13 15:54:58,903 ERROR [pool-5-thread-6]
execution.AbstractExecutable:62 : error execute
HadoopShellExecutable{id=4e9d2b2a-4f20-4b35-9dc6-bf2185f43486-02,
name=Build Dimension Dictionary, state=RUNNING}
java.io.IOException: java.lang.NullPointerException
at
org.apache.kylin.source.hive.HiveTable.getSignature(HiveTable.java:71)
at
org.apache.kylin.dict.lookup.SnapshotTable.(SnapshotTable.java:64)
at
org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:89)
at
org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:208)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:59)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:42)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:56)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at
org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:60)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at
org.apache.kylin.engine.mr.HadoopUtil.fixWindowsPath(HadoopUtil.java:78)
at org.apache.kylin.engine.mr.HadoopUtil.makeURI(HadoopUtil.java:70)
at
org.apache.kylin.engine.mr.HadoopUtil.getFileSystem(HadoopUtil.java:65)
at
org.apache.kylin.engine.mr.DFSFileTable.getSizeAndLastModified(DFSFileTable.java:78)
at
org.apache.kylin.source.hive.HiveTable.getSignature(HiveTable.java:56)
... 16 more
Re: Re: [jira] [Created] (KYLIN-1434) Kylin Job Monitor API: /kylin/api/jobs is too slow
hi all! I think hao hit the point, and I also think decouple job like data from kylin metadata(model, cube) is a good choice for kylin! best regards wangxianbin1...@gmail.com From: Hao Chen Date: 2016-02-25 15:36 To: dev Subject: Re: [jira] [Created] (KYLIN-1434) Kylin Job Monitor API: /kylin/api/jobs is too slow I think the solution KYLIN-1079 can resolve the problem by some way, though is not a perfect solution. The current row-key design of resource persistence is not very good for timeseries based data like kylin job history data, metric and so on, and the query performance and flexibility are not fast and scalable as well. Maybe it possible to consider another kinds of row-key design for such kinds of ts data for better performance and scalability like what we dose in Eagle, and what's more, kylin will never need to backup/restore such kinds of data as well like metadata so that it should be definitely decoupled from metadata store. Regards, Hao On Tue, Feb 23, 2016 at 5:13 PM, hongbin ma <mahong...@apache.org> wrote: > please check whether it is a duplicate with > https://issues.apache.org/jira/browse/KYLIN-1079 > > On Tue, Feb 23, 2016 at 3:28 PM, Hao Chen (JIRA) <j...@apache.org> wrote: > > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone >
Re: [jira] [Commented] (KYLIN-1082) Hive dependencies should be add to tmpjars
hi yanghong! do you mean hadoop-common jar? org.apache.hadoop hadoop-common 2.6.0 haven't found these class in it. wangxianbin1...@gmail.com From: Zhong Yanghong (JIRA) Date: 2016-01-27 22:15 To: issues Subject: [jira] [Commented] (KYLIN-1082) Hive dependencies should be add to tmpjars [ https://issues.apache.org/jira/browse/KYLIN-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119280#comment-15119280 ] Zhong Yanghong commented on KYLIN-1082: --- Maybe the previous clause is not good. For example, in the Class "CubeHFileJob", we imported some classes related to hbase, import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.client.HTable; import org.apache.hadoop.hbase.mapreduce.HFileOutputFormat; import org.apache.hadoop.hbase.mapreduce.KeyValueSortReducer; They are responsible for convert Cuboid to HBase. However, they have been included in the hadoop-common jars. > Hive dependencies should be add to tmpjars > -- > > Key: KYLIN-1082 > URL: https://issues.apache.org/jira/browse/KYLIN-1082 > Project: Kylin > Issue Type: Bug > Components: Environment , Job Engine >Reporter: liyang >Assignee: Zhong Yanghong > Labels: newbie > Fix For: v2.1, v1.3 > > Attachments: auto_hive_tmpjars_1_x_staging.patch, > auto_hive_tmpjars_2_x_staging.patch > > > Currently kylin assume all data nodes have hive deployment at exact same FS > location. However, a better position is to think hive as a client side app. > Then we need to ship hive jar with MR job every time. > This make deploy kylin a lot easier in cluster that does not have hive on all > data nodes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: Re: encouter Deserialization error when load hive table
HDP2.3.2, kylin 2.0-rc wangxianbin1...@gmail.com From: Li Yang Date: 2016-01-12 17:40 To: dev Subject: Re: Re: encouter Deserialization error when load hive table Then let's confirm your Kylin version and HDP version first. What are they? On Thu, Jan 7, 2016 at 4:03 PM, xianbin wang <wangxianbin1...@gmail.com> wrote: > hi all! > > I use HDP sandbox, there is only one node, table is loaded into hive by hdp > sandbox hive script, I don't think there will have a hive consistent > problem > > best regards! > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/encouter-Deserialization-error-when-load-hive-table-tp2888p3118.html > Sent from the Apache Kylin mailing list archive at Nabble.com. >
Re: Welcome new Apache Kylin committer: Luwei Chen
hi all! congratulations, lu wei! and now I know how it works now! best regards! wangxianbin1...@gmail.com From: Luke Han Date: 2015-12-30 21:47 To: dev Subject: Welcome new Apache Kylin committer: Luwei Chen I am very pleased to announce that the Project Management Committee (PMC) of Apache Kylin has asked Luwei Chen to become Apache Kylin committer , and she has already accepted. Luwei has already made many contribution to Kylin community, about website, documentation, UI and others as well. Welcome Luwei, our first female committer:) Please share with us a little about yourself, Luke On behalf of the Apache Kylin PPMC
Re: Re: encouter Deserialization error when load hive table
hi yang! hive does work, any other idea? best regards! wangxianbin1...@gmail.com From: Li Yang Date: 2015-12-29 16:15 To: dev Subject: Re: encouter Deserialization error when load hive table Try hive command from the Kylin node, does simple hive queries work? On Thu, Dec 24, 2015 at 2:03 PM, xianbin wang <wangxianbin1...@gmail.com> wrote: > anyone have a idea for such a error,when load hive table, error as follow: > > L4J [2015-12-24 13:54:39,354][INFO][org.apache.hadoop.mapreduce.Job] - Task > Id : attempt_1450856278246_0003_m_00_0, Status : FAILED > Error: java.io.IOException: Deserialization error: invalid stream header: > 926A2769 > at > org.apache.hive.hcatalog.common.HCatUtil.deserialize(HCatUtil.java:120) > at > org.apache.hive.hcatalog.mapreduce.HCatSplit.readFields(HCatSplit.java:132) > at > > org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:71) > at > > org.apache.hadoop.io.serializer.WritableSerialization$WritableDeserializer.deserialize(WritableSerialization.java:42) > at > org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:372) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:754) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) > Caused by: java.io.StreamCorruptedException: invalid stream header: > 926A2769 > at > java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:804) > at java.io.ObjectInputStream.(ObjectInputStream.java:299) > at > org.apache.hive.hcatalog.common.HCatUtil.deserialize(HCatUtil.java:117) > ... 11 more > > L4J [2015-12-24 13:54:41,105][INFO][org.apache.hadoop.mapreduce.Job] - map > 0% reduce 0% > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/encouter-Deserialization-error-when-load-hive-table-tp2888.html > Sent from the Apache Kylin mailing list archive at Nabble.com. >
Re: 答复: long time create HTable without error
hi all! the error log just tell you that your hadoop jobhistory service is not turn on, nothing else! I think you should follow luke suggestion! best regards! wangxianbin1...@gmail.com 发件人： 胡志华(万里通科技及数据中心商务智能团队数据分析组) 发送时间： 2015-12-30 09:23 收件人： 'dev@kylin.apache.org' 主题： 答复: long time create HTable without error Hi Luke, Thanks for your suggestion, but sandbox is suitable for personal experiment. We would like to use kylin on our own clusters(hadoop/hbase/hive), that's our actual usage scenario. I have refered to kylin.apache.org from beginning to the end, I can't find more suggest from the installation guide. My hbase cluster can create table, import data. But the kylin.log showed something. Sample cube building stopped at step 13 Create HTable , I will pick up some error log from kylin.log, [pool-7-thread-2]:[2015-12-29 21:08:47,804][ERROR][org.apache.kylin.job.common.HadoopCmdOutput.updateJobCounter(HadoopCmdOutput.java:100)] - java.net.ConnectException: Call From dw-server20-30.xs.paic.com.cn/172.16.20.30 to bihbasemaster:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused java.io.IOException: java.net.ConnectException: to bihbasemaster:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:343) at org.apache.hadoop.mapred.ClientServiceDelegate.getJobCounters(ClientServiceDelegate.java:380) at org.apache.hadoop.mapred.YARNRunner.getJobCounters(YARNRunner.java:557) at org.apache.hadoop.mapreduce.Job$7.run(Job.java:761) at org.apache.hadoop.mapreduce.Job$7.run(Job.java:758) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.Job.getCounters(Job.java:758) at org.apache.kylin.job.common.HadoopCmdOutput.updateJobCounter(HadoopCmdOutput.java:86) at org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:156) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.ConnectException: Call From dw-server20-30.xs.paic.com.cn/172.16.20.30 to bihbasemaster:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732) at org.apache.hadoop.ipc.Client.call(Client.java:1480) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy52.getCounters(Unknown Source) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getCounters(MRClientProtocolPBClientImpl.java:166) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) -邮件原件- 发件人: Luke Han [mailto:luke...@gmail.com] 发送时间: 2015年12月30日 8:30 收件人: dev@kylin.apache.org 主题: Re: long time create HTable without error Hi Zhihua, For more detail, please check installation guide first: http://kylin.apache.org/docs/install/index.html <http://kylin.apache.org/docs/install/index.html> No matter which distribution you pickup, but please just try to play with suggested one for quick start and then try to add your dataset. Thanks. Best Regards! - Luke Han On Tue, Dec 29, 2015 at 11:12 PM, Luke Han <luke...@gmail.com> wrote: &g
