[
https://issues.apache.org/jira/browse/HBASE-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586656#comment-16586656
]
Colin Garcia commented on HBASE-20307:
--------------------------------------
[~mdrob] [~stack], thanks for the responses! Makes sense.
Discussing this with others, we have a workaround proposal and want to see what
you think. I'll post a diff with the changes and a copy of the logs below. We
set the ZK logging level to WARN in the LoadTestTool class, which means right
now it only works for LoadTestTool (currently experimenting to see if it can be
added to ReadOnlyZKClient so that we don't have to add this code to each tool).
Here is an updated look at the logs:
{code:java}
~/hbase/bin(master*) » ./hbase ltt -tn TestTable -read 10:1000 -num_keys
10000000
Key range: [0..9999999]
Multi-gets (value of 1 means no multigets): 1
Percent of keys to verify: 10
Reader threads: 1000
2018-08-20 15:59:08,307 WARN [main] util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2018-08-20 15:59:08,526 INFO [main] zookeeper.ReadOnlyZKClient: Connect
0x03835c46 to localhost:2181 with session timeout=90000ms, retries 30, retry
interval 1000ms, keepAlive=60000ms
2018-08-20 15:59:08,574 INFO
[ReadOnlyZKClient-localhost:2181@0x03835c46-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
error)
2018-08-20 15:59:08,606 INFO
[ReadOnlyZKClient-localhost:2181@0x03835c46-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Socket connection established to
localhost/127.0.0.1:2181, initiating session
2018-08-20 15:59:08,614 INFO
[ReadOnlyZKClient-localhost:2181@0x03835c46-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
localhost/127.0.0.1:2181, sessionid = 0x165599020930005, negotiated timeout =
40000
2018-08-20 15:59:13,376 INFO [main] client.RpcRetryingCallerImpl: Call
exception, tries=6, retries=16, started=4634 ms ago, cancelled=false,
msg=org.apache.hadoop.hbase.PleaseHoldException: Master is initializing
2018-08-20 15:59:17,440 INFO [main] hbase.HBaseCommonTestingUtility: Number of
live regionservers: 1, pre-splitting table into 5 regions (regions per server:
5)
2018-08-20 15:59:17,579 WARN [main] hbase.HBaseCommonTestingUtility: Table
TestTable already exists, continuing
2018-08-20 15:59:17,580 INFO [main] client.ConnectionImplementation: Closing
master protocol: MasterService
2018-08-20 15:59:17,580 INFO [main] zookeeper.ReadOnlyZKClient: Close
zookeeper connection 0x03835c46 to localhost:2181
2018-08-20 15:59:17,583 INFO
[ReadOnlyZKClient-localhost:2181@0x03835c46-EventThread] zookeeper.ClientCnxn:
EventThread shut down for session: 0x165599020930005
2018-08-20 15:59:17,597 INFO [main] zookeeper.ReadOnlyZKClient: Connect
0x68fa0ba8 to localhost:2181 with session timeout=90000ms, retries 30, retry
interval 1000ms, keepAlive=60000ms
2018-08-20 15:59:17,598 INFO
[ReadOnlyZKClient-localhost:2181@0x68fa0ba8-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown
error)
2018-08-20 15:59:17,599 INFO
[ReadOnlyZKClient-localhost:2181@0x68fa0ba8-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Socket connection established to
localhost/127.0.0.1:2181, initiating session
2018-08-20 15:59:17,600 INFO
[ReadOnlyZKClient-localhost:2181@0x68fa0ba8-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
localhost/127.0.0.1:2181, sessionid = 0x165599020930006, negotiated timeout =
40000
2018-08-20 15:59:17,621 INFO [main] util.LoadTestTool: Disabling table
TestTable
2018-08-20 15:59:17,622 INFO [main] client.HBaseAdmin: Started disable of
TestTable
2018-08-20 15:59:18,068 INFO [main] client.HBaseAdmin: Operation: DISABLE,
Table Name: default:TestTable, procId: 54 completed
2018-08-20 15:59:18,219 INFO [main] util.LoadTestTool: Enabling table TestTable
2018-08-20 15:59:18,220 INFO [main] client.HBaseAdmin: Started enable of
TestTable
2018-08-20 15:59:18,963 INFO [main] client.HBaseAdmin: Operation: ENABLE,
Table Name: default:TestTable, procId: 61 completed
2018-08-20 15:59:18,963 INFO [main] client.ConnectionImplementation: Closing
master protocol: MasterService
2018-08-20 15:59:18,963 INFO [main] zookeeper.ReadOnlyZKClient: Close
zookeeper connection 0x68fa0ba8 to localhost:2181
2018-08-20 15:59:18,966 INFO
[ReadOnlyZKClient-localhost:2181@0x68fa0ba8-EventThread] zookeeper.ClientCnxn:
EventThread shut down for session: 0x165599020930006
2018-08-20 15:59:18,967 INFO [main] zookeeper.ReadOnlyZKClient: Connect
0x66b7550d to localhost:2181 with session timeout=90000ms, retries 30, retry
interval 1000ms, keepAlive=60000ms
2018-08-20 15:59:18,969 INFO
[ReadOnlyZKClient-localhost:2181@0x66b7550d-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL
(unknown error)
2018-08-20 15:59:18,969 INFO
[ReadOnlyZKClient-localhost:2181@0x66b7550d-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Socket connection established to
localhost/0:0:0:0:0:0:0:1:2181, initiating session
2018-08-20 15:59:18,970 INFO
[ReadOnlyZKClient-localhost:2181@0x66b7550d-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x165599020930007, negotiated
timeout = 40000
Starting to read data...
{code}
> LoadTestTool prints too much zookeeper logging
> ----------------------------------------------
>
> Key: HBASE-20307
> URL: https://issues.apache.org/jira/browse/HBASE-20307
> Project: HBase
> Issue Type: Bug
> Components: tooling
> Reporter: Mike Drob
> Priority: Major
> Labels: beginner
>
> When running ltt there is a ton of ZK related cruft that I probably don't
> care about. Hide it behind -verbose flag or point people at log4j
> configuration but don't print it by default.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
