[
https://issues.apache.org/jira/browse/RANGER-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538563#comment-17538563
]
Madhan Neethiraj edited comment on RANGER-3763 at 5/18/22 4:07 AM:
-------------------------------------------------------------------
[~amazingBoy_hbh] - thank you for the patch. It has now been committed in
master branch:
{noformat}
commit 6ed7b23439e648b9db9d9705e602389eacc55942 (HEAD -> master, origin/master,
origin/HEAD)
Author: Hoo199212 <[email protected]>
Date: Tue May 17 20:18:23 2022 +0800
RANGER-3763: added tagsync configuration for entities batch size in
AtlasREST
Signed-off-by: Madhan Neethiraj <[email protected]> {noformat}
Added support for following configuration in ranger-tagsync-site.xml:
{noformat}
ranger.tagsync.source.atlasrest.entities.batch.size=10000 {noformat}
was (Author: madhan.neethiraj):
[~amazingBoy_hbh] - thank you for the patch. It has now been committed in
master branch:
{noformat}
commit 6ed7b23439e648b9db9d9705e602389eacc55942 (HEAD -> master, origin/master,
origin/HEAD)
Author: Hoo199212 <[email protected]>
Date: Tue May 17 20:18:23 2022 +0800
RANGER-3763: added tagsync configuration for entities batch size in
AtlasREST
Signed-off-by: Madhan Neethiraj <[email protected]> {noformat}
> The max limit of the requested entities is not configurable in tagsync
> ----------------------------------------------------------------------
>
> Key: RANGER-3763
> URL: https://issues.apache.org/jira/browse/RANGER-3763
> Project: Ranger
> Issue Type: Improvement
> Components: tagsync
> Affects Versions: 1.2.0, 2.2.0
> Reporter: Binhua Hu
> Assignee: Binhua Hu
> Priority: Major
> Fix For: 3.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The requested entity size Is set to a fixed value(10000) in the Tagsync
> source code(AtlasRESTTagSource), which has the following problems
> 1. If the atlas server limits the request body size, tagsync needs to be
> repackaged to fit the server Settings
> 2. Debugging in the source code will print the full request body. If the
> requested entities size cannot be adjusted, the log view will be affected
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
