[
https://issues.apache.org/jira/browse/HBASE-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829131#comment-13829131
]
Nick Dimiduk commented on HBASE-9931:
-------------------------------------
I see TableInputFormat already supports overriding many scanner properties via
config. Would it be sufficient to add another configuration point,
{{hbase.mapreduce.scan.batchsize}} perhaps?
> Optional setBatch for CopyTable to copy large rows in batches
> -------------------------------------------------------------
>
> Key: HBASE-9931
> URL: https://issues.apache.org/jira/browse/HBASE-9931
> Project: HBase
> Issue Type: Improvement
> Components: mapreduce
> Reporter: Dave Latham
>
> We've had CopyTable jobs fail because a small number of rows are wide enough
> to not fit into memory. If we could specify the batch size for CopyTable
> scans that shoud be able to break those large rows up into multiple
> iterations to save the heap.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
