[
https://issues.apache.org/jira/browse/ATLAS-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaqi Shan updated ATLAS-2955:
------------------------------
Description:
Our Hive clients will send more than 16000 Kafka messages to Atlas every
hour, which will cause Kafka consumer lag. We find that Atlas only allows to
create single instance for {{NotificationConsumer}} in version 1.0.0.
Will Atlas support multithreadind {{NotificationHookConsumer}} to
increase write performance later?
was:Our Hive clients will send more than 16000 Kafka messages to Atlas every
hour, which will cause Kafka consumer lag. We find that Atlas only allows to
create single instance for {{NotificationConsumer}} in version 1.0.0. Will
Atlas support multithreadind {{NotificationHookConsumer}} to increase write
performance later?
> Support multithreading notificationHookConsumer
> -----------------------------------------------
>
> Key: ATLAS-2955
> URL: https://issues.apache.org/jira/browse/ATLAS-2955
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Affects Versions: 1.0.0
> Reporter: Jiaqi Shan
> Priority: Minor
>
> Our Hive clients will send more than 16000 Kafka messages to Atlas
> every hour, which will cause Kafka consumer lag. We find that Atlas only
> allows to create single instance for {{NotificationConsumer}} in version
> 1.0.0.
> Will Atlas support multithreadind {{NotificationHookConsumer}} to
> increase write performance later?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
