Hi,
I am trying to install phoenix-4.12.0 (HBase-1.1) on HDP 2.6.2.0. As per
installation guide, I have copied the phoenix-4.12.0-HBase-1.1-server.jar
inside HBase lib directory. After restarting HBase using Ambari and connecting
through SqlLine, I can see phoenix system tables are getting created. I used
HBase shell to check them.
When I try to create a table, the region servers stops with the following
error. Could anyone please guide what is wrong here.
thanks
sumanta
DDL :
CREATE TABLE V5.USER (
ADMIN BOOLEAN,
KEYA VARCHAR,
KEYB VARCHAR,
ID INTEGER,
USERNAME VARCHAR,
CONSTRAINT PK PRIMARY KEY (KEYA)) COLUMN_ENCODED_BYTES=0;
Region Server Error:
2017-10-25 10:47:12,499 ERROR [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
coprocessor.CoprocessorHost: The coprocessor
org.apache.phoenix.hbase.index.Indexer threw
org.apache.hadoop.metrics2.MetricsException: Metrics source
RegionServer,sub=PhoenixIndexer already exists!
org.apache.hadoop.metrics2.MetricsException: Metrics source
RegionServer,sub=PhoenixIndexer already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:144)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:117)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:229)
at
org.apache.hadoop.hbase.metrics.BaseSourceImpl.<init>(BaseSourceImpl.java:74)
at
org.apache.phoenix.hbase.index.metrics.MetricsIndexerSourceImpl.<init>(MetricsIndexerSourceImpl.java:49)
at
org.apache.phoenix.hbase.index.metrics.MetricsIndexerSourceImpl.<init>(MetricsIndexerSourceImpl.java:44)
at
org.apache.phoenix.hbase.index.metrics.MetricsIndexerSourceFactory.create(MetricsIndexerSourceFactory.java:34)
at org.apache.phoenix.hbase.index.Indexer.start(Indexer.java:251)
at
org.apache.hadoop.hbase.coprocessor.CoprocessorHost$Environment.startup(CoprocessorHost.java:415)
....
2017-10-25 10:47:12,499 FATAL [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.HRegionServer: ABORTING region server
ip-172-30-3-197,16020,1508926506368: The coprocessor
org.apache.phoenix.hbase.index.Indexer threw
org.apache.hadoop.metrics2.MetricsException: Metrics source
RegionServer,sub=PhoenixIndexer already exists!
org.apache.hadoop.metrics2.MetricsException: Metrics source
RegionServer,sub=PhoenixIndexer already exists!
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:144)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:117)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:229)
at
org.apache.hadoop.hbase.metrics.BaseSourceImpl.<init>(BaseSourceImpl.java:74)
at
org.apache.phoenix.hbase.index.metrics.MetricsIndexerSourceImpl.<init>(MetricsIndexerSourceImpl.java:49)
at
org.apache.phoenix.hbase.index.metrics.MetricsIndexerSourceImpl.<init>(MetricsIndexerSourceImpl.java:44)
at
org.apache.phoenix.hbase.index.metrics.MetricsIndexerSourceFactory.create(MetricsIndexerSourceFactory.java:34)
at org.apache.phoenix.hbase.index.Indexer.start(Indexer.java:251)
at
org.apache.hadoop.hbase.coprocessor.CoprocessorHost$Environment.startup(CoprocessorHost
....
2017-10-25 10:47:12,499 FATAL [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.HRegionServer: RegionServer abort: loaded coprocessors are:
[org.apache.phoenix.coprocessor.MetaDataEndpointImpl,
org.apache.phoenix.coprocessor.ScanRegionObserver,
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver,
org.apache.phoenix.hbase.index.Indexer,
org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver,
org.apache.phoenix.coprocessor.ServerCachingEndpointImpl,
org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint,
org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint]
2017-
.....
2017-10-25 10:47:12,511 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.HRegionServer: STOPPED: The coprocessor
org.apache.phoenix.hbase.index.Indexer threw
org.apache.hadoop.metrics2.MetricsException: Metrics source
RegionServer,sub=PhoenixIndexer already exists!
2017-10-25 10:47:12,511 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.SplitLogWorker: Sending interrupt to stop the worker thread
2017-10-25 10:47:12,511 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HRegionServer: Stopping infoServer
2017-10-25 10:47:12,511 INFO [SplitLogWorker-ip-172-30-3-197:16020]
regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting.
2017-10-25 10:47:12,511 INFO [SplitLogWorker-ip-172-30-3-197:16020]
regionserver.SplitLogWorker: SplitLogWorker ip-172-30-3-197,16020,1508926506368
exiting
2017-10-25 10:47:12,512 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.RegionCoprocessorHost: Loaded coprocessor
org.apache.phoenix.coprocessor.GroupedAggregateRegionObserver from HTD of
V5.SENSOR successfully.
2017-10-25 10:47:12,512 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.RegionCoprocessorHost: Loaded coprocessor
org.apache.phoenix.coprocessor.ServerCachingEndpointImpl from HTD of V5.SENSOR
successfully.
2017-10-25 10:47:12,512 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.RegionCoprocessorHost: Loaded coprocessor
org.apache.phoenix.coprocessor.ScanRegionObserver from HTD of V5.SENSOR
successfully.
2017-10-25 10:47:12,512 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
mortbay.log: Stopped SelectChannelConnector@0.0.0.0:16030
2017-10-25 10:47:12,550 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.RegionCoprocessorHost: Loaded coprocessor
org.apache.phoenix.coprocessor.UngroupedAggregateRegionObserver from HTD of
V5.SENSOR successfully.
2017-10-25 10:47:12,562 INFO [StoreOpener-82ad4872c3e5354540025192dfc8faab-1]
hfile.CacheConfig: blockCache=LruBlockCache{blockCount=3, currentSize=441552,
freeSize=420666576, maxSize=421108128, heapSize=441552, minSize=400052704,
minFactor=0.95, multiSize=200026352, multiFactor=0.5, singleSize=100013176,
singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false,
cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false,
cacheDataCompressed=false, prefetchOnOpen=false
2017-10-25 10:47:12,563 INFO [StoreOpener-82ad4872c3e5354540025192dfc8faab-1]
compactions.CompactionConfiguration: size [134217728, 9223372036854775807);
files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point
2684354560; major period 604800000, major jitter 0.500000, min locality to
compact 0.000000; tiered compaction: max_age 9223372036854775807, base window
in milliseconds 21600000, windows per tier 4,incoming window min 6
2017-10-25 10:47:12,567 INFO [StoreOpener-82ad4872c3e5354540025192dfc8faab-1]
hfile.CacheConfig: blockCache=LruBlockCache{blockCount=3, currentSize=441552,
freeSize=420666576, maxSize=421108128, heapSize=441552, minSize=400052704,
minFactor=0.95, multiSize=200026352, multiFactor=0.5, singleSize=100013176,
singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false,
cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false,
cacheDataCompressed=false, prefetchOnOpen=false
2017-10-25 10:47:12,568 INFO [StoreOpener-82ad4872c3e5354540025192dfc8faab-1]
compactions.CompactionConfiguration: size [134217728, 9223372036854775807);
files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point
2684354560; major period 604800000, major jitter 0.500000, min locality to
compact 0.000000; tiered compaction: max_age 9223372036854775807, base window
in milliseconds 21600000, windows per tier 4,incoming window min 6
2017-10-25 10:47:12,579 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.HRegion: Onlined 82ad4872c3e5354540025192dfc8faab; next
sequenceid=2
2017-10-25 10:47:12,583 INFO
[StoreCloserThread-V5.SENSOR,,1508928431856.82ad4872c3e5354540025192dfc8faab.-1]
regionserver.HStore: Closed 0
2017-10-25 10:47:12,583 INFO
[StoreCloserThread-V5.SENSOR,,1508928431856.82ad4872c3e5354540025192dfc8faab.-1]
regionserver.HStore: Closed A
2017-10-25 10:47:12,595 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
regionserver.HRegion: Closed
V5.SENSOR,,1508928431856.82ad4872c3e5354540025192dfc8faab.
2017-10-25 10:47:12,595 INFO [RS_OPEN_REGION-ip-172-30-3-197:16020-1]
coordination.ZkOpenRegionCoordination: Opening of region {ENCODED =>
82ad4872c3e5354540025192dfc8faab, NAME =>
'V5.SENSOR,,1508928431856.82ad4872c3e5354540025192dfc8faab.', STARTKEY => '',
ENDKEY => ''} failed, transitioning from OPENING to FAILED_OPEN in ZK,
expecting version 1
2017-10-25 10:47:12,613 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HeapMemoryManager: Stoping HeapMemoryTuner chore.
2017-10-25 10:47:12,613 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
flush.RegionServerFlushTableProcedureManager: Stopping region server flush
procedure manager abruptly.
2017-10-25 10:47:12,613 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager
abruptly.
2017-10-25 10:47:12,614 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher:
MemStoreFlusher.0 exiting
2017-10-25 10:47:12,614 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher:
MemStoreFlusher.1 exiting
2017-10-25 10:47:12,622 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HRegionServer: aborting server ip-172-30-3-197,16020,1508926506368
2017-10-25 10:47:12,643 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
client.ConnectionManager$HConnectionImplementation: Closing zookeeper
sessionid=0x15f530637b40009
2017-10-25 10:47:12,645 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
zookeeper.ZooKeeper: Session: 0x15f530637b40009 closed
2017-10-25 10:47:12,645 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.CompactSplitThread: Waiting for Split Thread to finish...
2017-10-25 10:47:12,649 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.CompactSplitThread: Waiting for Merge Thread to finish...
2017-10-25 10:47:12,649 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.CompactSplitThread: Waiting for Large Compaction Thread to
finish...
2017-10-25 10:47:12,649 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.CompactSplitThread: Waiting for Small Compaction Thread to
finish...
2017-10-25 10:47:12,649 INFO
[regionserver/ip-172-30-3-197/172.30.3.197:16020-EventThread]
zookeeper.ClientCnxn: EventThread shut down
2017-10-25 10:47:12,651 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HRegionServer: Waiting on 4 regions to close
2017-10-25 10:47:12,668 INFO
[StoreCloserThread-SYSTEM.FUNCTION,,1508848466919.f16413f64ee499782448437db87576c6.-1]
regionserver.HStore: Closed 0
2017-10-25 10:47:12,669 INFO [RS_CLOSE_REGION-ip-172-30-3-197:16020-1]
regionserver.HRegion: Closed
SYSTEM.FUNCTION,,1508848466919.f16413f64ee499782448437db87576c6.
2017-10-25 10:47:12,669 INFO [StoreCloserThread-hbase:meta,,1.1588230740-1]
regionserver.HStore: Closed info
2017-10-25 10:47:12,669 ERROR [RS_CLOSE_META-ip-172-30-3-197:16020-0]
regionserver.HRegion: Memstore size is 264
2017-10-25 10:47:12,670 INFO
[StoreCloserThread-SYSTEM.MUTEX,,1508848451514.f73d5cf23255c18ec828d51c60be867f.-1]
regionserver.HStore: Closed 0
2017-10-25 10:47:12,671 INFO [RS_CLOSE_META-ip-172-30-3-197:16020-0]
regionserver.HRegion: Closed hbase:meta,,1.1588230740
2017-10-25 10:47:12,671 INFO [RS_CLOSE_REGION-ip-172-30-3-197:16020-0]
regionserver.HRegion: Closed
SYSTEM.MUTEX,,1508848451514.f73d5cf23255c18ec828d51c60be867f.
2017-10-25 10:47:12,671 INFO
[StoreCloserThread-hbase:namespace,,1508845641564.b7e3abbc6449bd697260f250745f6a20.-1]
regionserver.HStore: Closed info
2017-10-25 10:47:12,672 INFO [RS_CLOSE_REGION-ip-172-30-3-197:16020-2]
regionserver.HRegion: Closed
hbase:namespace,,1508845641564.b7e3abbc6449bd697260f250745f6a20.
2017-10-25 10:47:12,852 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HRegionServer: stopping server
ip-172-30-3-197,16020,1508926506368; all regions closed.
2017-10-25 10:47:12,879 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.Leases: regionserver/ip-172-30-3-197/172.30.3.197:16020 closing
leases
2017-10-25 10:47:12,879 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.Leases: regionserver/ip-172-30-3-197/172.30.3.197:16020 closed
leases
2017-10-25 10:47:12,879 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
hbase.ChoreService: Chore service for: ip-172-30-3-197,16020,1508926506368 had
[[ScheduledChore: Name: MovedRegionsCleaner for region
ip-172-30-3-197,16020,1508926506368 Period: 120000 Unit: MILLISECONDS],
[ScheduledChore: Name: ip-172-30-3-197,16020,1508926506368-MemstoreFlusherChore
Period: 10000 Unit: MILLISECONDS]] on shutdown
2017-10-25 10:47:14,998 INFO
[RS_OPEN_META-ip-172-30-3-197:16020-0-MetaLogRoller] regionserver.LogRoller:
LogRoller exiting.
2017-10-25 10:47:17,550 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl:
Stopping HBase metrics system...
2017-10-25 10:47:17,551 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase
metrics system stopped.
2017-10-25 10:47:18,052 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded
properties from hadoop-metrics2-hbase.properties
2017-10-25 10:47:18,053 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl:
Scheduled snapshot period at 10 second(s).
2017-10-25 10:47:18,053 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase
metrics system started
2017-10-25 10:47:19,396 INFO
[regionserver/ip-172-30-3-197/172.30.3.197:16020.logRoller]
regionserver.LogRoller: LogRoller exiting.
2017-10-25 10:47:19,396 INFO
[regionserver/ip-172-30-3-197/172.30.3.197:16020.leaseChecker]
regionserver.Leases:
regionserver/ip-172-30-3-197/172.30.3.197:16020.leaseChecker closing leases
2017-10-25 10:47:19,397 INFO
[regionserver/ip-172-30-3-197/172.30.3.197:16020.leaseChecker]
regionserver.Leases:
regionserver/ip-172-30-3-197/172.30.3.197:16020.leaseChecker closed leases
2017-10-25 10:47:19,403 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
ipc.RpcServer: Stopping server on 16020
2017-10-25 10:47:19,403 INFO [RpcServer.listener,port=16020] ipc.RpcServer:
RpcServer.listener,port=16020: stopping
2017-10-25 10:47:19,404 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: stopped
2017-10-25 10:47:19,404 INFO [RpcServer.responder] ipc.RpcServer:
RpcServer.responder: stopping
2017-10-25 10:47:19,411 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
zookeeper.ZooKeeper: Session: 0x15f530637b40008 closed
2017-10-25 10:47:19,411 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HRegionServer: stopping server
ip-172-30-3-197,16020,1508926506368; zookeeper connection closed.
2017-10-25 10:47:19,411 INFO [regionserver/ip-172-30-3-197/172.30.3.197:16020]
regionserver.HRegionServer: regionserver/ip-172-30-3-197/172.30.3.197:16020
exiting
2017-10-25 10:47:19,411 ERROR [main] regionserver.HRegionServerCommandLine:
Region server exiting
java.lang.RuntimeException: HRegionServer Aborted
at
org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:68)
at
org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2816)
2017-10-25 10:47:19,411 INFO [main-EventThread] zookeeper.ClientCnxn:
EventThread shut down
2017-10-25 10:47:19,415 INFO [pool-4-thread-1] regionserver.ShutdownHook:
Shutdown hook starting; hbase.shutdown.hook=true;
fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@6ea1bcdc
2017-10-25 10:47:19,415 INFO [pool-4-thread-1] regionserver.ShutdownHook:
Starting fs shutdown hook thread.
2017-10-25 10:47:19,416 INFO [pool-4-thread-1] regionserver.ShutdownHook:
Shutdown hook finished.
=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you
