Hi all,
Hadoop2.7.1
Hbase0.98.16
Hive1.2.1
My sample cube Is running with error and error, this time stoped at
step 13 “Create HTable” for a long time without any error notification
I found the log of hamster, as below
2015-12-29 21:18:02,345 INFO [FifoRpcScheduler.handler1-thread-18]
master.HMaster: Client=root/null create 'KYLIN_VSPE13YZKF', {TABLE_ATTRIBUTES
=> {coprocessor$1 =>
'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
coprocessor$2 =>
'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}}, {NAME
=> 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW',
REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'LZO', MIN_VERSIONS
=> '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE =>
'4194304', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'F2',
DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW', REPLICATION_SCOPE =>
'0', VERSIONS => '1', COMPRESSION => 'LZO', MIN_VERSIONS => '0', TTL =>
'FOREVER', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '4194304', IN_MEMORY =>
'false', BLOCKCACHE => 'true'}
2015-12-29 21:18:02,368 INFO [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
handler.CreateTableHandler: Create table KYLIN_VSPE13YZKF
2015-12-29 21:18:02,393 INFO [RegionOpenAndInitThread-KYLIN_VSPE13YZKF-1]
regionserver.HRegion: creating HRegion KYLIN_VSPE13YZKF HTD ==
'KYLIN_VSPE13YZKF', {TABLE_ATTRIBUTES => {coprocessor$1 =>
'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.endpoint.IIEndpoint|1000|',
coprocessor$2 =>
'hdfs://bihbasemaster/kylin/kylin_metadata/coprocessor/kylin-coprocessor-1.2-1.jar|org.apache.kylin.storage.hbase.coprocessor.observer.AggregateRegionObserver|1001|',
METADATA => {'KYLIN_HOST' => 'kylin_metadata', 'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy'}}, {NAME
=> 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW',
REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'LZO', MIN_VERSIONS
=> '0', TTL => 'FOREVER', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE =>
'4194304', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'F2',
DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'ROW', REPLICATION_SCOPE =>
'0', VERSIONS => '1', COMPRESSION => 'LZO', MIN_VERSIONS => '0', TTL =>
'FOREVER', KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '4194304', IN_MEMORY =>
'false', BLOCKCACHE => 'true'} RootDir = hdfs://bihbasemaster/hbase/.tmp Table
name == KYLIN_VSPE13YZKF
2015-12-29 21:18:02,410 INFO [RegionOpenAndInitThread-KYLIN_VSPE13YZKF-1]
regionserver.HRegion: Closed
KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47.
2015-12-29 21:18:02,417 INFO [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
catalog.MetaEditor: Added 1
2015-12-29 21:18:02,418 INFO [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
master.AssignmentManager: Bulk assigning 1 region(s) across 4 server(s),
round-robin=true
2015-12-29 21:18:02,424 INFO
[dw-server20-30.wlt,60000,1451383344930-GeneralBulkAssigner-3]
master.AssignmentManager: dw-server20-34.wlt,60020,1451383345797 unassigned
znodes=1 of total=1
2015-12-29 21:18:02,424 INFO
[dw-server20-30.wlt,60000,1451383344930-GeneralBulkAssigner-3]
master.RegionStates: Transition {ce534b19cceff6d3c8f5866fbbf9fd47
state=OFFLINE, ts=1451395082418, server=null} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=PENDING_OPEN, ts=1451395082424,
server=dw-server20-34.wlt,60020,1451383345797}
2015-12-29 21:18:02,435 INFO [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
master.AssignmentManager: Bulk assigning done
2015-12-29 21:18:02,438 INFO [AM.ZK.Worker-pool2-t127] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=PENDING_OPEN,
ts=1451395082424, server=dw-server20-34.wlt,60020,1451383345797} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=OPENING, ts=1451395082438,
server=dw-server20-34.wlt,60020,1451383345797}
2015-12-29 21:18:02,444 INFO [MASTER_TABLE_OPERATIONS-dw-server20-30:60000-0]
handler.CreateTableHandler: failed. Null
2015-12-29 21:18:02,481 INFO [AM.ZK.Worker-pool2-t128] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=OPENING, ts=1451395082438,
server=dw-server20-34.wlt,60020,1451383345797} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=CLOSED, ts=1451395082481,
server=dw-server20-34.wlt,60020,1451383345797}
2015-12-29 21:18:02,481 INFO [AM.ZK.Worker-pool2-t128]
master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region
{ENCODED => ce534b19cceff6d3c8f5866fbbf9fd47, NAME =>
'KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47.', STARTKEY
=> '', ENDKEY => ''}
2015-12-29 21:18:02,481 INFO [AM.ZK.Worker-pool2-t128] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=CLOSED, ts=1451395082481,
server=dw-server20-34.wlt,60020,1451383345797} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=OFFLINE, ts=1451395082481,
server=dw-server20-34.wlt,60020,1451383345797}
2015-12-29 21:18:02,484 INFO [AM.ZK.Worker-pool2-t128]
master.AssignmentManager: Assigning
KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47. to
dw-server20-31.wlt,60020,1451383345912
2015-12-29 21:18:02,484 INFO [AM.ZK.Worker-pool2-t128] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=OFFLINE, ts=1451395082481,
server=dw-server20-34.wlt,60020,1451383345797} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=PENDING_OPEN, ts=1451395082484,
server=dw-server20-31.wlt,60020,1451383345912}
2015-12-29 21:18:02,500 INFO [AM.ZK.Worker-pool2-t129] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=PENDING_OPEN,
ts=1451395082484, server=dw-server20-31.wlt,60020,1451383345912} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=OPENING, ts=1451395082500,
server=dw-server20-31.wlt,60020,1451383345912}
2015-12-29 21:18:02,546 INFO [AM.ZK.Worker-pool2-t131] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=OPENING, ts=1451395082501,
server=dw-server20-31.wlt,60020,1451383345912} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=CLOSED, ts=1451395082546,
server=dw-server20-31.wlt,60020,1451383345912}
2015-12-29 21:18:02,546 INFO [AM.ZK.Worker-pool2-t131]
master.AssignmentManager: Setting node as OFFLINED in ZooKeeper for region
{ENCODED => ce534b19cceff6d3c8f5866fbbf9fd47, NAME =>
'KYLIN_VSPE13YZKF,,1451395082310.ce534b19cceff6d3c8f5866fbbf9fd47.', STARTKEY
=> '', ENDKEY => ''}
2015-12-29 21:18:02,546 INFO [AM.ZK.Worker-pool2-t131] master.RegionStates:
Transition {ce534b19cceff6d3c8f5866fbbf9fd47 state=CLOSED, ts=1451395082546,
server=dw-server20-31.wlt,60020,1451383345912} to
{ce534b19cceff6d3c8f5866fbbf9fd47 state=OFFLINE, ts=1451395082546,
server=dw-server20-31.wlt,60020,1451383345912}
********************************************************************************************************************************
The information in this email is confidential and may be legally privileged. If
you have received this email in error or are not the intended recipient, please
immediately notify the sender and delete this message from your computer. Any
use, distribution, or copying of this email other than by the intended
recipient is strictly prohibited. All messages sent to and from us may be
monitored to ensure compliance with internal policies and to protect our
business.
Emails are not secure and cannot be guaranteed to be error free as they can be
intercepted, amended, lost or destroyed, or contain viruses. Anyone who
communicates with us by email is taken to accept these risks.
收发邮件者请注意:
本邮件含保密信息,若误收本邮件,请务必通知发送人并直接删去,不得使用、传播或复制本邮件。
进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。
********************************************************************************************************************************