[
https://issues.apache.org/jira/browse/HBASE-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586392#comment-16586392
]
Colin Garcia commented on HBASE-20307:
--------------------------------------
Hi [~mdrob], new to HBase and was looking to take this on. I've ran the
following command:
{code:java}
~/hbase/bin(master) » ./hbase ltt -tn TestTable -read 10:1000 -num_keys
10000000
{code}
And have posted the output below. I was wondering if we're looking to hide the
logs of the form:
[ReadOnlyZKClient-localhost*]? Will ReadOnlyZKClient be called for all the
various inputs?
Output for reference:
{code:java}
~/hbase/bin(master) » ./hbase ltt -tn TestTable -read 10:1000 -num_keys
10000000
Key range: [0..9999999] Multi-gets (value of 1 means no multigets): 1 Percent
of keys to verify: 10 Reader threads: 1000 2018-08-17 14:51:14,391 WARN [main]
util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable 2018-08-17 14:51:15,600
INFO [main] zookeeper.ReadOnlyZKClient: Connect 0x7193666c to localhost:2181
with session timeout=90000ms, retries 30, retry interval 1000ms,
keepAlive=60000ms 2018-08-17 14:51:15,610 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f,
built on 03/23/2017 10:13 GMT 2018-08-17 14:51:15,610 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Client
environment:host.name=colingarc-ltm8.internal.salesforce.com 2018-08-17
14:51:15,610 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client environment:java.version=1.8.0_181 2018-08-17
14:51:15,610 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
2018-08-17 14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client
environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre
2018-08-17 14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper:
cia/.m2/repository/javax/validation/validation-api/1.1.0.Final/validation-api-1.1.0.Final.jar:/Users/colin.garcia/hbase/hbase-examples/target/hbase-examples-3.0.0-SNAPSHOT.jar:/Users/colin.garcia/hbase/hbase-endpoint/target/hbase-endpoint-3.0.0-SNAPSHOT.jar:/Users/colin.garcia/.m2/repository/org/apache/curator/curator-framework/4.0.0/curator-framework-4.0.0.jar:/Users/colin.garcia/.m2/repository/org/apache/curator/curator-client/4.0.0/curator-client-4.0.0.jar:/Users/colin.garcia/.m2/repository/org/apache/curator/curator-recipes/4.0.0/curator-recipes-4.0.0.jar:/Users/colin.garcia/hbase/hbase-zookeeper/target/hbase-zookeeper-3.0.0-SNAPSHOT.jar:/Users/colin.garcia/hbase/hbase-rsgroup/target/hbase-rsgroup-3.0.0-SNAPSHOT.jar:/Users/colin.garcia/hbase/hbase-annotations/target/hbase-annotations-3.0.0-SNAPSHOT-tests.jar:/Users/colin.garcia/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/Users/colin.garcia/.m2/repository/junit/junit/4.12/junit-4.12.jar
2018-08-17 14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client
environment:java.library.path=/Users/colin.garcia/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
2018-08-17 14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/var/folders/ct/l2m2v7h95nb6n_cvp0jf73p1l_c_hb/T/
2018-08-17 14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 2018-08-17
14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client environment:os.name=Mac OS X 2018-08-17
14:51:15,611 INFO [ReadOnlyZKClient-localhost:2181@0x7193666c]
zookeeper.ZooKeeper: Client environment:os.arch=x86_64 2018-08-17 14:51:15,611
INFO [ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Client
environment:os.version=10.13.6 2018-08-17 14:51:15,611 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Client
environment:user.name=colin.garcia 2018-08-17 14:51:15,611 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Client
environment:user.home=/Users/colin.garcia 2018-08-17 14:51:15,611 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Client
environment:user.dir=/Users/colin.garcia/hbase/bin 2018-08-17 14:51:15,612 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Initiating
client connection, connectString=localhost:2181 sessionTimeout=90000
watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$25/1092711142@622bbd1a
2018-08-17 14:51:15,639 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL
(unknown error) 2018-08-17 14:51:15,664 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Socket connection established to
localhost/0:0:0:0:0:0:0:1:2181, initiating session 2018-08-17 14:51:15,673 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x16549dd669e0005, negotiated
timeout = 40000 2018-08-17 14:51:16,136 INFO [main]
hbase.HBaseCommonTestingUtility: Number of live regionservers: 1, pre-splitting
table into 5 regions (regions per server: 5) 2018-08-17 14:51:16,448 WARN
[main] hbase.HBaseCommonTestingUtility: Table TestTable already exists,
continuing 2018-08-17 14:51:16,449 INFO [main]
client.ConnectionImplementation: Closing master protocol: MasterService
2018-08-17 14:51:16,449 INFO [main] zookeeper.ReadOnlyZKClient: Close
zookeeper connection 0x7193666c to localhost:2181 2018-08-17 14:51:16,450 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c] zookeeper.ZooKeeper: Session:
0x16549dd669e0005 closed 2018-08-17 14:51:16,450 INFO
[ReadOnlyZKClient-localhost:2181@0x7193666c-EventThread] zookeeper.ClientCnxn:
EventThread shut down for session: 0x16549dd669e0005 2018-08-17 14:51:16,465
INFO [main] zookeeper.ReadOnlyZKClient: Connect 0x2b5f4d54 to localhost:2181
with session timeout=90000ms, retries 30, retry interval 1000ms,
keepAlive=60000ms 2018-08-17 14:51:16,465 INFO
[ReadOnlyZKClient-localhost:2181@0x2b5f4d54] zookeeper.ZooKeeper: Initiating
client connection, connectString=localhost:2181 sessionTimeout=90000
watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$25/1092711142@622bbd1a
2018-08-17 14:51:16,467 INFO
[ReadOnlyZKClient-localhost:2181@0x2b5f4d54-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL
(unknown error) 2018-08-17 14:51:16,467 INFO
[ReadOnlyZKClient-localhost:2181@0x2b5f4d54-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Socket connection established to
localhost/0:0:0:0:0:0:0:1:2181, initiating session 2018-08-17 14:51:16,468 INFO
[ReadOnlyZKClient-localhost:2181@0x2b5f4d54-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x16549dd669e0006, negotiated
timeout = 40000 2018-08-17 14:51:16,488 INFO [main] util.LoadTestTool:
Disabling table TestTable 2018-08-17 14:51:16,490 INFO [main]
client.HBaseAdmin: Started disable of TestTable 2018-08-17 14:51:17,749 INFO
[main] client.HBaseAdmin: Operation: DISABLE, Table Name: default:TestTable,
procId: 10 completed 2018-08-17 14:51:17,914 INFO [main] util.LoadTestTool:
Enabling table TestTable 2018-08-17 14:51:17,916 INFO [main]
client.HBaseAdmin: Started enable of TestTable 2018-08-17 14:51:18,653 INFO
[main] client.HBaseAdmin: Operation: ENABLE, Table Name: default:TestTable,
procId: 17 completed 2018-08-17 14:51:18,653 INFO [main]
client.ConnectionImplementation: Closing master protocol: MasterService
2018-08-17 14:51:18,653 INFO [main] zookeeper.ReadOnlyZKClient: Close
zookeeper connection 0x2b5f4d54 to localhost:2181 2018-08-17 14:51:18,654 INFO
[ReadOnlyZKClient-localhost:2181@0x2b5f4d54] zookeeper.ZooKeeper: Session:
0x16549dd669e0006 closed 2018-08-17 14:51:18,660 INFO
[ReadOnlyZKClient-localhost:2181@0x2b5f4d54-EventThread] zookeeper.ClientCnxn:
EventThread shut down for session: 0x16549dd669e0006 2018-08-17 14:51:18,663
INFO [main] zookeeper.ReadOnlyZKClient: Connect 0x774698ab to localhost:2181
with session timeout=90000ms, retries 30, retry interval 1000ms,
keepAlive=60000ms 2018-08-17 14:51:18,663 INFO
[ReadOnlyZKClient-localhost:2181@0x774698ab] zookeeper.ZooKeeper: Initiating
client connection, connectString=localhost:2181 sessionTimeout=90000
watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$25/1092711142@622bbd1a
2018-08-17 14:51:18,665 INFO
[ReadOnlyZKClient-localhost:2181@0x774698ab-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Opening socket connection to server
localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL
(unknown error) 2018-08-17 14:51:18,665 INFO
[ReadOnlyZKClient-localhost:2181@0x774698ab-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Socket connection established to
localhost/0:0:0:0:0:0:0:1:2181, initiating session 2018-08-17 14:51:18,666 INFO
[ReadOnlyZKClient-localhost:2181@0x774698ab-SendThread(localhost:2181)]
zookeeper.ClientCnxn: Session establishment complete on server
localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x16549dd669e0007, negotiated
timeout = 40000 Starting to read data... 2018-08-17 14:51:23,671 INFO
[MultiThreadedAction-ProgressReporter-1534542678668] util.MultiThreadedAction:
[R:1000] Keys=21473, cols=261.7 K, time=00:00:05 Overall: [keys/s= 4294,
latency=224.67 ms] Current: [keys/s=4294, latency=224.67 ms], verified=2110
^[[A2018-08-17 14:51:28,673 INFO
[MultiThreadedAction-ProgressReporter-1534542678668] util.MultiThreadedAction:
[R:1000] Keys=45654, cols=557.6 K, time=00:00:10 Overall: [keys/s= 4563,
latency=214.59 ms] Current: [keys/s=4836, latency=205.63 ms], verified=4540
{code}
> LoadTestTool prints too much zookeeper logging
> ----------------------------------------------
>
> Key: HBASE-20307
> URL: https://issues.apache.org/jira/browse/HBASE-20307
> Project: HBase
> Issue Type: Bug
> Components: tooling
> Reporter: Mike Drob
> Priority: Major
> Labels: beginner
>
> When running ltt there is a ton of ZK related cruft that I probably don't
> care about. Hide it behind -verbose flag or point people at log4j
> configuration but don't print it by default.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
