-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/62681/
-----------------------------------------------------------
(Updated Sept. 30, 2017, 9:58 p.m.)
Review request for atlas, Apoorv Naik, Ashutosh Mestry, Abhay Kulkarni, Sarath
Subramanian, and Suma Shivaprasad.
Changes
-------
Addressed for recent review comment and updates to log messages.
Bugs: ATLAS-2075
https://issues.apache.org/jira/browse/ATLAS-2075
Repository: atlas
Description
-------
Update notification module to compress and split large messages (> 1mb) that
can't be sent via Kafka. When such a message is sent, the message is first
compressed via GZip. If compressed message is within the size limit, the
message is sent via Kafka. If the compressed size is larger, then the message
is split into multiple small messages and sent via Kafka.
Notification consumer is updated to merge and uncompress messages before the
message is processed further.
Diffs (updated)
-----
notification/src/main/java/org/apache/atlas/notification/AbstractNotification.java
1f9404de
notification/src/main/java/org/apache/atlas/notification/AtlasNotificationMessageDeserializer.java
b1ac2fa0
Diff: https://reviews.apache.org/r/62681/diff/6/
Changes: https://reviews.apache.org/r/62681/diff/5-6/
Testing
-------
- verified that large messages are compressed and split by Atlas hook, before
sending to Kafka
- verified that Atlas server processes compressed, multi-part messages correctly
Thanks,
Madhan Neethiraj
