[jira] [Updated] (UNOMI-66) Integrate Apache Kafka
[ https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Huber updated UNOMI-66: - Description: It would be really great to integrate Apache Kafka into Apache Unomi so that we can push event data and other "heavy" operations into its messaging systems and therefore make it easier to decouple some large scale operations that might require a lot of processing power such as large segment updates, etc... An interesting idea would be to put Kafka in "front" of Unomi to absorb the traffic and then clients could use something like the [Kafka REST Proxy |https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events into Unomi. This would also make it a lot easier to integrate with BigData systems such as Apache Spark, Hadoop or others. We might want at the same time to see if we can define a mechanism to get the status of long-running operations. was: It would be really great to integrate Apache Kafka into Apache Unomi so that we can push event data and other "heavy" operations into its messaging systems and therefore make it easier to decouple some large scale operations that might require a lot of processing power such as large segment updates, etc... This would also make it a lot easier to integrate with BigData systems such as Apache Spark, Hadoop or others. We might want at the same time to see if we can define a mechanism to get the status of long-running operations. > Integrate Apache Kafka > -- > > Key: UNOMI-66 > URL: https://issues.apache.org/jira/browse/UNOMI-66 > Project: Apache Unomi > Issue Type: Improvement > Components: core >Reporter: Serge Huber >Priority: Major > Fix For: 1.4.0-incubating > > > It would be really great to integrate Apache Kafka into Apache Unomi so that > we can push event data and other "heavy" operations into its messaging > systems and therefore make it easier to decouple some large scale operations > that might require a lot of processing power such as large segment updates, > etc... > An interesting idea would be to put Kafka in "front" of Unomi to absorb the > traffic and then clients could use something like the [Kafka REST Proxy > |https://docs.confluent.io/1.0/kafka-rest/docs/intro.html] to insert events > into Unomi. > This would also make it a lot easier to integrate with BigData systems such > as Apache Spark, Hadoop or others. > We might want at the same time to see if we can define a mechanism to get the > status of long-running operations. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (UNOMI-66) Integrate Apache Kafka
[ https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Huber updated UNOMI-66: - Fix Version/s: (was: 1.3.0-incubating) 1.4.0-incubating > Integrate Apache Kafka > -- > > Key: UNOMI-66 > URL: https://issues.apache.org/jira/browse/UNOMI-66 > Project: Apache Unomi > Issue Type: Improvement > Components: core >Reporter: Serge Huber >Priority: Major > Fix For: 1.4.0-incubating > > > It would be really great to integrate Apache Kafka into Apache Unomi so that > we can push event data and other "heavy" operations into its messaging > systems and therefore make it easier to decouple some large scale operations > that might require a lot of processing power such as large segment updates, > etc... > This would also make it a lot easier to integrate with BigData systems such > as Apache Spark, Hadoop or others. > We might want at the same time to see if we can define a mechanism to get the > status of long-running operations. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (UNOMI-66) Integrate Apache Kafka
[ https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Huber updated UNOMI-66: - Issue Type: Improvement (was: Bug) > Integrate Apache Kafka > -- > > Key: UNOMI-66 > URL: https://issues.apache.org/jira/browse/UNOMI-66 > Project: Apache Unomi > Issue Type: Improvement > Components: core >Reporter: Serge Huber >Priority: Major > Fix For: 1.3.0-incubating > > > It would be really great to integrate Apache Kafka into Apache Unomi so that > we can push event data and other "heavy" operations into its messaging > systems and therefore make it easier to decouple some large scale operations > that might require a lot of processing power such as large segment updates, > etc... > This would also make it a lot easier to integrate with BigData systems such > as Apache Spark, Hadoop or others. > We might want at the same time to see if we can define a mechanism to get the > status of long-running operations. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (UNOMI-66) Integrate Apache Kafka
[ https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Huber updated UNOMI-66: - Fix Version/s: 1.3.0-incubating > Integrate Apache Kafka > -- > > Key: UNOMI-66 > URL: https://issues.apache.org/jira/browse/UNOMI-66 > Project: Apache Unomi > Issue Type: Bug > Components: core >Reporter: Serge Huber > Fix For: 1.3.0-incubating > > > It would be really great to integrate Apache Kafka into Apache Unomi so that > we can push event data and other "heavy" operations into its messaging > systems and therefore make it easier to decouple some large scale operations > that might require a lot of processing power such as large segment updates, > etc... > This would also make it a lot easier to integrate with BigData systems such > as Apache Spark, Hadoop or others. > We might want at the same time to see if we can define a mechanism to get the > status of long-running operations. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (UNOMI-66) Integrate Apache Kafka
[ https://issues.apache.org/jira/browse/UNOMI-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Huber updated UNOMI-66: - Description: It would be really great to integrate Apache Kafka into Apache Unomi so that we can push event data and other "heavy" operations into its messaging systems and therefore make it easier to decouple some large scale operations that might require a lot of processing power such as large segment updates, etc... This would also make it a lot easier to integrate with BigData systems such as Apache Spark, Hadoop or others. We might want at the same time to see if we can define a mechanism to get the status of long-running operations. was: It would be really great to integrate Apache Kafka into Apache Unomi so that we can push event data and other "heavy" operations into its messaging systems and therefore make it easier to decouple some large scale operations that might require a lot of processing power such as large segment updates, etc... This would also make it a lot easier to integrate with BigData systems such as Apache Spark, Hadoop or others. > Integrate Apache Kafka > -- > > Key: UNOMI-66 > URL: https://issues.apache.org/jira/browse/UNOMI-66 > Project: Apache Unomi > Issue Type: Bug > Components: core >Reporter: Serge Huber > > It would be really great to integrate Apache Kafka into Apache Unomi so that > we can push event data and other "heavy" operations into its messaging > systems and therefore make it easier to decouple some large scale operations > that might require a lot of processing power such as large segment updates, > etc... > This would also make it a lot easier to integrate with BigData systems such > as Apache Spark, Hadoop or others. > We might want at the same time to see if we can define a mechanism to get the > status of long-running operations. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
