[
https://issues.apache.org/jira/browse/ATLAS-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaqi Shan updated ATLAS-2955:
------------------------------
Description: Our Hive clients will send more than 16000 Kafka messages to
Atlas every hour, which will cause Kafka consumer lag. We find that Atlas only
allows to create single instance for {{NotificationConsumer}} in version 1.0.0.
Will Atlas support multithreadind {{NotificationHookConsumer}} to increase
write performance later? (was: Our Hive clients will send more than 16000
Kafka messages to Atlas every hour, which will cause Kafka consumer lag. We
find that Atlas only allow to create single instance for
{{NotificationConsumer. }}in version 1.0.0. Will Atlas support multithreading
{{notificationHookConsumer}} to increase write performance later?)
> Support multithreading notificationHookConsumer
> -----------------------------------------------
>
> Key: ATLAS-2955
> URL: https://issues.apache.org/jira/browse/ATLAS-2955
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Affects Versions: 1.0.0
> Reporter: Jiaqi Shan
> Priority: Minor
>
> Our Hive clients will send more than 16000 Kafka messages to Atlas every
> hour, which will cause Kafka consumer lag. We find that Atlas only allows to
> create single instance for {{NotificationConsumer}} in version 1.0.0. Will
> Atlas support multithreadind {{NotificationHookConsumer}} to increase write
> performance later?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
