[kudu-CR] ksck: multi-thread the fetching of replica info from tablet servers

[Jean-Daniel Cryans (Code Review)]

Jean-Daniel Cryans has posted comments on this change.

Change subject: ksck: multi-thread the fetching of replica info from tablet 
servers
..


Patch Set 2: Code-Review+2

-- 
To view, visit http://gerrit.cloudera.org:8080/3705
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ib7784697fb227743dccaa98922fb958cd6a3270e
Gerrit-PatchSet: 2
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Todd Lipcon 
Gerrit-Reviewer: Jean-Daniel Cryans 
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy 
Gerrit-HasComments: No

[kudu-CR] ksck: multi-thread the fetching of replica info from tablet servers

[Kudu Jenkins (Code Review)]

Kudu Jenkins has posted comments on this change.

Change subject: ksck: multi-thread the fetching of replica info from tablet 
servers
..


Patch Set 2:

Build Started http://104.196.14.100/job/kudu-gerrit/2579/

-- 
To view, visit http://gerrit.cloudera.org:8080/3705
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ib7784697fb227743dccaa98922fb958cd6a3270e
Gerrit-PatchSet: 2
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Todd Lipcon 
Gerrit-Reviewer: Jean-Daniel Cryans 
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy 
Gerrit-HasComments: No

[kudu-CR] ksck: multi-thread the fetching of replica info from tablet servers

[Todd Lipcon (Code Review)]

Hello Jean-Daniel Cryans, Mike Percy,

I'd like you to do a code review.  Please visit

http://gerrit.cloudera.org:8080/3705

to review the following change.

Change subject: ksck: multi-thread the fetching of replica info from tablet 
servers
..

ksck: multi-thread the fetching of replica info from tablet servers

In clusters with a lot of tablets, fetching the data from each tablet server
can take a while (eg ~100ms per server from my laptop to a test cluster in our
datacenter). For a large cluster (~70 nodes), this makes ksck rather slow.

Multi-threading the fetching makes this much faster (5s vs original 31 seconds
for the above test cluster).

Change-Id: Ib7784697fb227743dccaa98922fb958cd6a3270e
---
M src/kudu/tools/ksck.cc
1 file changed, 22 insertions(+), 7 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/05/3705/1
-- 
To view, visit http://gerrit.cloudera.org:8080/3705
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: Ib7784697fb227743dccaa98922fb958cd6a3270e
Gerrit-PatchSet: 1
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Todd Lipcon 
Gerrit-Reviewer: Jean-Daniel Cryans 
Gerrit-Reviewer: Mike Percy 

[kudu-CR] ksck: multi-thread the fetching of replica info from tablet servers

[Kudu Jenkins (Code Review)]

Kudu Jenkins has posted comments on this change.

Change subject: ksck: multi-thread the fetching of replica info from tablet 
servers
..


Patch Set 1:

Build Started http://104.196.14.100/job/kudu-gerrit/2578/

-- 
To view, visit http://gerrit.cloudera.org:8080/3705
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: Ib7784697fb227743dccaa98922fb958cd6a3270e
Gerrit-PatchSet: 1
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Todd Lipcon 
Gerrit-Reviewer: Jean-Daniel Cryans 
Gerrit-Reviewer: Kudu Jenkins
Gerrit-Reviewer: Mike Percy 
Gerrit-HasComments: No