[
https://issues.apache.org/jira/browse/SENTRY-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kalyan kumar kalvagadda updated SENTRY-2249:
--------------------------------------------
Description:
Currently each entry in full snapshot of HMS is persisted one entry at a time.
Instead it could be optimized by persisting the path entries in batches. DB
operations are expensive, reducing the number of database operations and around
trip time will help. This would decrease the time to persist the snapshot in to
database significantly.
Size of the batch could be configurable.
was:
Currently each entry in full snapshot of HMS is persisted one entry at a time.
Instead it could be optimized by persisting the entries in batches. DB
operations are expensive, reducing the number of database operations should
help. This would decrease the time to persist the snapshot in to database
significantly.
Size of the batch could be configurable.
> Persist HMS Full Snapshot in batches.
> -------------------------------------
>
> Key: SENTRY-2249
> URL: https://issues.apache.org/jira/browse/SENTRY-2249
> Project: Sentry
> Issue Type: Improvement
> Components: Sentry
> Affects Versions: 2.1.0
> Reporter: kalyan kumar kalvagadda
> Assignee: kalyan kumar kalvagadda
> Priority: Major
> Attachments: SENTRY-2249.001.patch, SENTRY-2249.002.patch,
> SENTRY-2249.003.patch
>
>
> Currently each entry in full snapshot of HMS is persisted one entry at a
> time. Instead it could be optimized by persisting the path entries in
> batches. DB operations are expensive, reducing the number of database
> operations and around trip time will help. This would decrease the time to
> persist the snapshot in to database significantly.
> Size of the batch could be configurable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
