[
https://issues.apache.org/jira/browse/KUDU-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741466#comment-17741466
]
ASF subversion and git services commented on KUDU-3459:
-------------------------------------------------------
Commit 277586441c849ac639d24d78b98c0c3bfcce06c8 in kudu's branch
refs/heads/master from xinghuayu007
[ https://gitbox.apache.org/repos/asf?p=kudu.git;h=277586441 ]
KUDU-3459 Download superblock piece by piece
Currently, Kudu downloads superblock once a time not piece
by piece. When superblock is very large, it may over the
size of the rpc maximum message size defined as:
--rpc_max_message_size. Then downloading superblock will
fail.
This patch provides another method to download superblock,
download superblock piece by piece. A new flag:
--tablet_copy_support_download_superblock_in_batch is added. The
original logic keep unchange. When find that superblock is very
large, it will switch into downloading superblock piece by piece
automatically, if the flag is set true.
Change-Id: I3a7c212784383e247566a4701965e2897de83303
Reviewed-on: http://gerrit.cloudera.org:8080/19620
Reviewed-by: Yingchun Lai <[email protected]>
Tested-by: Yingchun Lai <[email protected]>
> Download superblock may over the rpc maximum message size
> ---------------------------------------------------------
>
> Key: KUDU-3459
> URL: https://issues.apache.org/jira/browse/KUDU-3459
> Project: Kudu
> Issue Type: Improvement
> Reporter: Xixu Wang
> Priority: Major
> Attachments: image-2023-03-15-11-33-56-651.png,
> image-2023-03-15-11-40-39-264.png
>
>
> Copy tablet from remote using Kudu CLI tool may fail when the superblock is
> very large. The defined rpc_max_message_size is 52428800 bytes, but the size
> of superblock is 63M as Pic 2 shows.
> Currently, Kudu downloads superblock once a time not piece by piece. When
> superblock is very large, it will over the size of the rpc maximum message
> size.
> !image-2023-03-15-11-40-39-264.png!
>
> !image-2023-03-15-11-33-56-651.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
