[
https://issues.apache.org/jira/browse/ATLAS-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791032#comment-16791032
]
ASF subversion and git services commented on ATLAS-3054:
--------------------------------------------------------
Commit 48987881826c5cfe4f518d44e55a488535a13ef8 in atlas's branch
refs/heads/branch-1.0 from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=4898788 ]
ATLAS-3054: improved batch processing in notificaiton handler to avoid
processing of an entity multiple times - #2
(cherry picked from commit fc2a926cc7d0f0070c25f9afc68bf6a5a1bb6df2)
> notification processing to support batch-commits for faster processing of
> large messages
> ----------------------------------------------------------------------------------------
>
> Key: ATLAS-3054
> URL: https://issues.apache.org/jira/browse/ATLAS-3054
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Reporter: Madhan Neethiraj
> Assignee: Madhan Neethiraj
> Priority: Major
> Fix For: 1.2.0, 2.0.0
>
> Attachments: ATLAS-3054.patch
>
>
> Processing of notifications that create/update large number of entities (say
> in 1000s) take a significantly longer time to complete, compared to combined
> time it takes to create/update same number of entities using multiple smaller
> notifications.
> Instead of requiring notification producers to split such a large
> notification into multiple chunks, Atlas server should be enhanced to perform
> create/update operations in chunks - for faster processing of such large
> notifications.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)