[
https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Serge Huber updated UNOMI-66:
-----------------------------
Description:
It would be really great to integrate Apache Kafka into Apache Unomi so that we
can push event data and other "heavy" operations into its messaging systems and
therefore make it easier to decouple some large scale operations that might
require a lot of processing power such as large segment updates, etc...
An interesting idea would be to put Kafka in "front" of Unomi to absorb the
traffic and then clients could use something like the [Kafka REST Proxy
|https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events
into Unomi.
This would also make it a lot easier to integrate with BigData systems such as
Apache Spark, Hadoop or others.
We might want at the same time to see if we can define a mechanism to get the
status of long-running operations.
was:
It would be really great to integrate Apache Kafka into Apache Unomi so that we
can push event data and other "heavy" operations into its messaging systems and
therefore make it easier to decouple some large scale operations that might
require a lot of processing power such as large segment updates, etc...
This would also make it a lot easier to integrate with BigData systems such as
Apache Spark, Hadoop or others.
We might want at the same time to see if we can define a mechanism to get the
status of long-running operations.
> Integrate Apache Kafka
> ----------------------
>
> Key: UNOMI-66
> URL: https://issues.apache.org/jira/browse/UNOMI-66
> Project: Apache Unomi
> Issue Type: Improvement
> Components: core
> Reporter: Serge Huber
> Priority: Major
> Fix For: 1.4.0-incubating
>
>
> It would be really great to integrate Apache Kafka into Apache Unomi so that
> we can push event data and other "heavy" operations into its messaging
> systems and therefore make it easier to decouple some large scale operations
> that might require a lot of processing power such as large segment updates,
> etc...
> An interesting idea would be to put Kafka in "front" of Unomi to absorb the
> traffic and then clients could use something like the [Kafka REST Proxy
> |https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events
> into Unomi.
> This would also make it a lot easier to integrate with BigData systems such
> as Apache Spark, Hadoop or others.
> We might want at the same time to see if we can define a mechanism to get the
> status of long-running operations.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
