[
https://issues.apache.org/jira/browse/SENTRY-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16139477#comment-16139477
]
Hadoop QA commented on SENTRY-1898:
-----------------------------------
Here are the results of testing the latest attachment
https://issues.apache.org/jira/secure/attachment/12883427/SENTRY-1898.002.patch
against master.
{color:green}Overall:{color} +1 all checks pass
{color:green}SUCCESS:{color} all tests passed
Console output:
https://builds.apache.org/job/PreCommit-SENTRY-Build/3177/console
This message is automatically generated.
> Sentry no longer supports creating more than ~15 partitions at once
> -------------------------------------------------------------------
>
> Key: SENTRY-1898
> URL: https://issues.apache.org/jira/browse/SENTRY-1898
> Project: Sentry
> Issue Type: Bug
> Components: Sentry
> Affects Versions: 2.0.0
> Reporter: Na Li
> Assignee: Na Li
> Priority: Blocker
> Attachments: SENTRY-1898.001.patch, SENTRY-1898.002.patch
>
>
> Vamsee reported: I notice this problem on our stress cluster where we are
> creating a huge amounts of Hive metadata (Databases, Tables, and Partitions).
> During this process, multiple partitions of the table are being created at
> one go using:
> ALTER TABLE <TB> ADD PARTITION <PART1> ADD PARTITION <PART2>...
> I notice that when we add more than 20 partitions here in one sql statement,
> Sentry fails to process the transaction as we cross the 4000 character
> threshold on PATH change table.
> Every partition entry is of format:
> {"1":{"str":"test_hivemd_db_2017_08_15_08_14_27_2_0_8.test_hivemd_table_2017_08_15_08_14_27_2_0_0"},"2":{"lst":["lst",1,["str",6,"user","hive","warehouse","test_hivemd_db_2017_08_15_08_14_27_2_0_8.db","test_hivemd_table_2017_08_15_08_14_27_2_0_0","part=test_hivemd_partition_2017_08_15_08_14_27_2_0_1"]]},"3":{"lst":["lst",0]}}
> ~ 327 characters
> So to fit in 4000 characters, we are limited to 10-15 partitions to be
> created at one go.
> We should allow the big path update from hive.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
