[
https://issues.apache.org/jira/browse/ATLAS-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161966#comment-16161966
]
Ashutosh Mestry commented on ATLAS-2063:
----------------------------------------
Duplicate of: [ATLAS-204|https://issues.apache.org/jira/browse/ATLAS-2064]
> Compressed HiveHook Messages
> ----------------------------
>
> Key: ATLAS-2063
> URL: https://issues.apache.org/jira/browse/ATLAS-2063
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-intg
> Affects Versions: 0.8-incubating
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Fix For: trunk
>
>
> *Background*
> Messages posted by hooks to Atlas Kafka topics are JSON format.
> Kafka imposes a 1MB limit on the message size.
> Occasionally, depending on operations performed, this threshold is reached.
> This results in messages being dropped.
> The entities are thus not reflected in Atlas.
> *Solution*
> Applying compression to these message will alleviate the problem.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
