[ 
https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Serge Huber updated UNOMI-66:
-----------------------------
    Description: 
It would be really great to integrate Apache Kafka into Apache Unomi so that we 
can push event data and other "heavy" operations into its messaging systems and 
therefore make it easier to decouple some large scale operations that might 
require a lot of processing power such as large segment updates, etc...

An interesting idea would be to put Kafka in "front" of Unomi to absorb the 
traffic and then clients could use something like the [Kafka REST Proxy 
|https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events 
into Unomi.

This would also make it a lot easier to integrate with BigData systems such as 
Apache Spark, Hadoop or others.

We might want at the same time to see if we can define a mechanism to get the 
status of long-running operations.

  was:
It would be really great to integrate Apache Kafka into Apache Unomi so that we 
can push event data and other "heavy" operations into its messaging systems and 
therefore make it easier to decouple some large scale operations that might 
require a lot of processing power such as large segment updates, etc... 

This would also make it a lot easier to integrate with BigData systems such as 
Apache Spark, Hadoop or others.

We might want at the same time to see if we can define a mechanism to get the 
status of long-running operations.


> Integrate Apache Kafka
> ----------------------
>
>                 Key: UNOMI-66
>                 URL: https://issues.apache.org/jira/browse/UNOMI-66
>             Project: Apache Unomi
>          Issue Type: Improvement
>          Components: core
>            Reporter: Serge Huber
>            Priority: Major
>             Fix For: 1.4.0-incubating
>
>
> It would be really great to integrate Apache Kafka into Apache Unomi so that 
> we can push event data and other "heavy" operations into its messaging 
> systems and therefore make it easier to decouple some large scale operations 
> that might require a lot of processing power such as large segment updates, 
> etc...
> An interesting idea would be to put Kafka in "front" of Unomi to absorb the 
> traffic and then clients could use something like the [Kafka REST Proxy 
> |https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events 
> into Unomi.
> This would also make it a lot easier to integrate with BigData systems such 
> as Apache Spark, Hadoop or others.
> We might want at the same time to see if we can define a mechanism to get the 
> status of long-running operations.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to