[kudu-CR] [tools] limit per-session error buffer space
Alexey Serbin has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/8396 ) Change subject: [tools] limit per-session error buffer space .. [tools] limit per-session error buffer space Introduced --error-buffer-size-bytes flag to control the size of the per-session error buffer. By default, the limit is set to 16MB per session (i.e. per worker thread). Prior to this patch, the per-session error buffer had no size limit and could grow very large because of huge number of errors during the run (e.g., because of duplicate value errors). I also updated the in-line documentation to add an example of using the tool for subsequent runs against the same table using the --seq-start flag. Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Reviewed-on: http://gerrit.cloudera.org:8080/8396 Reviewed-by: Adar DemboTested-by: Kudu Jenkins --- M src/kudu/tools/tool_action_perf.cc 1 file changed, 41 insertions(+), 11 deletions(-) Approvals: Adar Dembo: Looks good to me, approved Kudu Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 5 Gerrit-Owner: Alexey Serbin Gerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Alexey Serbin Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins
[kudu-CR] [tools] limit per-session error buffer space
Adar Dembo has posted comments on this change. ( http://gerrit.cloudera.org:8080/8396 ) Change subject: [tools] limit per-session error buffer space .. Patch Set 4: Code-Review+2 -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 4 Gerrit-Owner: Alexey SerbinGerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Alexey Serbin Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins Gerrit-Comment-Date: Thu, 26 Oct 2017 18:30:31 + Gerrit-HasComments: No
[kudu-CR] [tools] limit per-session error buffer space
Hello Dan Burkert, Kudu Jenkins, Adar Dembo, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/8396 to look at the new patch set (#4). Change subject: [tools] limit per-session error buffer space .. [tools] limit per-session error buffer space Introduced --error-buffer-size-bytes flag to control the size of the per-session error buffer. By default, the limit is set to 16MB per session (i.e. per worker thread). Prior to this patch, the per-session error buffer had no size limit and could grow very large because of huge number of errors during the run (e.g., because of duplicate value errors). I also updated the in-line documentation to add an example of using the tool for subsequent runs against the same table using the --seq-start flag. Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 --- M src/kudu/tools/tool_action_perf.cc 1 file changed, 41 insertions(+), 11 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/8396/4 -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 4 Gerrit-Owner: Alexey SerbinGerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins
[kudu-CR] [tools] limit per-session error buffer space
Alexey Serbin has posted comments on this change. ( http://gerrit.cloudera.org:8080/8396 ) Change subject: [tools] limit per-session error buffer space .. Patch Set 3: (4 comments) http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc File src/kudu/tools/tool_action_perf.cc: http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@88 PS3, Line 88: consider using the > Nit: simplify to "use the" Done http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@89 PS3, Line 89: Here is an example > Nit: "For example" (simpler) Done http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@185 PS3, Line 185: might > Nit: may Done http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@219 PS3, Line 219: "buffer space might impose an additional upper limit for the " > Nit: may Done -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 3 Gerrit-Owner: Alexey SerbinGerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Alexey Serbin Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins Gerrit-Comment-Date: Thu, 26 Oct 2017 18:09:32 + Gerrit-HasComments: Yes
[kudu-CR] [tools] limit per-session error buffer space
Adar Dembo has posted comments on this change. ( http://gerrit.cloudera.org:8080/8396 ) Change subject: [tools] limit per-session error buffer space .. Patch Set 3: (4 comments) http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc File src/kudu/tools/tool_action_perf.cc: http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@88 PS3, Line 88: consider using the Nit: simplify to "use the" http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@89 PS3, Line 89: Here is an example Nit: "For example" (simpler) http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@185 PS3, Line 185: might Nit: may http://gerrit.cloudera.org:8080/#/c/8396/3/src/kudu/tools/tool_action_perf.cc@219 PS3, Line 219: "buffer space might impose an additional upper limit for the " Nit: may -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 3 Gerrit-Owner: Alexey SerbinGerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins Gerrit-Comment-Date: Thu, 26 Oct 2017 17:47:08 + Gerrit-HasComments: Yes
[kudu-CR] [tools] limit per-session error buffer space
Hello Dan Burkert, Kudu Jenkins, Adar Dembo, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/8396 to look at the new patch set (#3). Change subject: [tools] limit per-session error buffer space .. [tools] limit per-session error buffer space Introduced --error-buffer-size-bytes flag to control the size of the per-session error buffer. By default, the limit is set to 16MB per session (i.e. per worker thread). Prior to this patch, the per-session error buffer had no size limit and could grow very large because of huge number of errors during the run (e.g., because of duplicate value errors). I also updated the in-line documentation to add an example of using the tool for subsequent runs against the same table using the --seq-start flag. Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 --- M src/kudu/tools/tool_action_perf.cc 1 file changed, 41 insertions(+), 11 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/8396/3 -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 3 Gerrit-Owner: Alexey SerbinGerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins
[kudu-CR] [tools] limit per-session error buffer space
Hello Dan Burkert, Kudu Jenkins, Adar Dembo, I'd like you to reexamine a change. Please visit http://gerrit.cloudera.org:8080/8396 to look at the new patch set (#2). Change subject: [tools] limit per-session error buffer space .. [tools] limit per-session error buffer space Introduced --error-buffer-size-bytes flag to control the size of the per-session error buffer. By default, the limit is set to 16MB per session (i.e. per worker thread). Prior to this patch, the per-session error buffer had no size limit and could grow very large because of huge number of errors during the run (e.g., because of duplicate value errors). Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 --- M src/kudu/tools/tool_action_perf.cc 1 file changed, 37 insertions(+), 7 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/8396/2 -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 2 Gerrit-Owner: Alexey SerbinGerrit-Reviewer: Adar Dembo Gerrit-Reviewer: Dan Burkert Gerrit-Reviewer: Kudu Jenkins
[kudu-CR] [tools] limit per-session error buffer space
Alexey Serbin has uploaded this change for review. ( http://gerrit.cloudera.org:8080/8396 Change subject: [tools] limit per-session error buffer space .. [tools] limit per-session error buffer space Introduced --error-buffer-size-bytes flag to control the size of the per-session error buffer. By default, the limit is set to 16MB per session (i.e. per worker thread). Prior to this patch, the per-session error buffer had no size limit and could grow very large because of huge number of errors during the run (e.g., because of duplicate value errors). Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 --- M src/kudu/tools/tool_action_perf.cc 1 file changed, 37 insertions(+), 6 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/96/8396/1 -- To view, visit http://gerrit.cloudera.org:8080/8396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I2b7663c52e57b2d3a1e11b22301b804da784fa74 Gerrit-Change-Number: 8396 Gerrit-PatchSet: 1 Gerrit-Owner: Alexey Serbin