I would like to suggest start experimentation with Hortonworks sandbox
(HDP) and Kylin binary package first, when you have more insight about the
entire process and how Kylin interactive with Hadoop/Hive/HBase, then move
to your own cluster with apache only distribution.
And please double check in your kylin.log file, there's should have more
detail idea about what's wrong.
Thanks.
Best Regards!
---------------------
Luke Han
On Tue, Dec 29, 2015 at 10:08 PM, 胡志华(万里通科技及数据中心商务智能团队数据分析组) <
huzhihua...@pingan.com.cn> wrote:
> Hi all,
>
> Hadoop2.7.1
> Hbase0.98.16
> Hive1.2.1
>
> My sample cube Is running with error and error, this time stoped
> at step 13 “Create HTable” for a long time without any error notification
>
>
> I found the log of hamster, as below
>
>
> 2015-12-29 21:18:02,345 INFO [FifoRpcScheduler.handler1-thread-18]
> master.HMaster: Client=root/null create 'KYLIN_VSPE13YZKF',
> {TABLE_ATTRIBUTES => {coprocessor$1 =>
> 'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
> coprocessor$2 =>
> 'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
> METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
> 'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}},
> {NAME => 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW',
> REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'LZO',
> MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'FALSE',
> BLOCKSIZE => '4194304', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
> => 'F2', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW',
> REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'LZO',
> MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'FALSE',
> BLOCKSIZE => '4194304', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
> 2015-12-29 21:18:02,368 INFO
> [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
> handler.CreateTableHandler: Create table KYLIN_VSPE13YZKF
> 2015-12-29 21:18:02,393 INFO [RegionOpenAndInitThread-KYLIN_VSPE13YZKF-1]
> regionserver.HRegion: creating HRegion KYLIN_VSPE13YZKF HTD ==
> 'KYLIN_VSPE13YZKF', {TABLE_ATTRIBUTES => {coprocessor$1 =>
> 'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
> coprocessor$2 =>
> 'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
> METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
> 'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}},
> {NAME => 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW',
> REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'LZO',
> MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'FALSE',
> BLOCKSIZE => '4194304', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
> => 'F2', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW',
> REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'LZO',
> MIN_VERSIONS => '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'FALSE',
> BLOCKSIZE => '4194304', IN_MEMORY => 'false', BLOCKCACHE => 'true'} RootDir
> = hdfs://bihbasemaster/hbase/.tmp Table name == KYLIN_VSPE13YZKF
> 2015-12-29 21:18:02,410 INFO [RegionOpenAndInitThread-KYLIN_VSPE13YZKF-1]
> regionserver.HRegion: Closed
> KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47.
> 2015-12-29 21:18:02,417 INFO
> [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0] catalog.MetaEditor: Added 1
> 2015-12-29 21:18:02,418 INFO
> [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0] master.AssignmentManager:
> Bulk assigning 1 region(s) across 4 server(s), round-robin=true
> 2015-12-29 21:18:02,424 INFO
> [dw-server20-30.wlt,60000,1451383344930-GeneralBulkAssigner-3]
> master.AssignmentManager: dw-server20-34.wlt,60020,1451383345797 unassigned
> znodes=1 of total=1
> 2015-12-29 21:18:02,424 INFO
> [dw-server20-30.wlt,60000,1451383344930-GeneralBulkAssigner-3]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=OFFLINE, ts=1451395082418, server=null} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=PENDING_OPEN, ts=1451395082424,
> server=dw-server20-34.wlt,60020,1451383345797}
> 2015-12-29 21:18:02,435 INFO
> [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0] master.AssignmentManager:
> Bulk assigning done
> 2015-12-29 21:18:02,438 INFO [AM.ZK.Worker-pool2-t127]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=PENDING_OPEN, ts=1451395082424,
> server=dw-server20-34.wlt,60020,1451383345797} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=OPENING, ts=1451395082438,
> server=dw-server20-34.wlt,60020,1451383345797}
> 2015-12-29 21:18:02,444 INFO
> [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
> handler.CreateTableHandler: failed. Null
> 2015-12-29 21:18:02,481 INFO [AM.ZK.Worker-pool2-t128]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=OPENING, ts=1451395082438,
> server=dw-server20-34.wlt,60020,1451383345797} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=CLOSED, ts=1451395082481,
> server=dw-server20-34.wlt,60020,1451383345797}
> 2015-12-29 21:18:02,481 INFO [AM.ZK.Worker-pool2-t128]
> master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region
> {ENCODED => ce534b19cceff6d3c8f5866fbbf9fd47, NAME =>
> 'KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47.',
> STARTKEY => '', ENDKEY => ''}
> 2015-12-29 21:18:02,481 INFO [AM.ZK.Worker-pool2-t128]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=CLOSED, ts=1451395082481,
> server=dw-server20-34.wlt,60020,1451383345797} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=OFFLINE, ts=1451395082481,
> server=dw-server20-34.wlt,60020,1451383345797}
> 2015-12-29 21:18:02,484 INFO [AM.ZK.Worker-pool2-t128]
> master.AssignmentManager: Assigning
> KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47. to
> dw-server20-31.wlt,60020,1451383345912
> 2015-12-29 21:18:02,484 INFO [AM.ZK.Worker-pool2-t128]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=OFFLINE, ts=1451395082481,
> server=dw-server20-34.wlt,60020,1451383345797} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=PENDING_OPEN, ts=1451395082484,
> server=dw-server20-31.wlt,60020,1451383345912}
> 2015-12-29 21:18:02,500 INFO [AM.ZK.Worker-pool2-t129]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=PENDING_OPEN, ts=1451395082484,
> server=dw-server20-31.wlt,60020,1451383345912} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=OPENING, ts=1451395082500,
> server=dw-server20-31.wlt,60020,1451383345912}
> 2015-12-29 21:18:02,546 INFO [AM.ZK.Worker-pool2-t131]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=OPENING, ts=1451395082501,
> server=dw-server20-31.wlt,60020,1451383345912} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=CLOSED, ts=1451395082546,
> server=dw-server20-31.wlt,60020,1451383345912}
> 2015-12-29 21:18:02,546 INFO [AM.ZK.Worker-pool2-t131]
> master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region
> {ENCODED => ce534b19cceff6d3c8f5866fbbf9fd47, NAME =>
> 'KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47.',
> STARTKEY => '', ENDKEY => ''}
> 2015-12-29 21:18:02,546 INFO [AM.ZK.Worker-pool2-t131]
> master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
> state=CLOSED, ts=1451395082546,
> server=dw-server20-31.wlt,60020,1451383345912} to
> {ce534b19cceff6d3c8f5866fbbf9fd47 state=OFFLINE, ts=1451395082546,
> server=dw-server20-31.wlt,60020,1451383345912}
>
>
>
>
>
> ********************************************************************************************************************************
> The information in this email is confidential and may be legally
> privileged. If you have received this email in error or are not the
> intended recipient, please immediately notify the sender and delete this
> message from your computer. Any use, distribution, or copying of this email
> other than by the intended recipient is strictly prohibited. All messages
> sent to and from us may be monitored to ensure compliance with internal
> policies and to protect our business.
> Emails are not secure and cannot be guaranteed to be error free as they
> can be intercepted, amended, lost or destroyed, or contain viruses. Anyone
> who communicates with us by email is taken to accept these risks.
>
> 收发邮件者请注意：
> 本邮件含保密信息，若误收本邮件，请务必通知发送人并直接删去，不得使用、传播或复制本邮件。
> 进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。
>
> ********************************************************************************************************************************
>
