[jira] [Updated] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francesco Chicchiriccò updated SYNCOPE-1617: Component/s: core > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature > Components: core >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > Fix For: 3.0.0 > > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francesco Chicchiriccò updated SYNCOPE-1617: Labels: (was: gsoc2021 mentor) > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature > Components: core >Reporter: Francesco Chicchiriccò >Priority: Major > Fix For: 3.0.0 > > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Updated] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francesco Chicchiriccò updated SYNCOPE-1617: Fix Version/s: 3.0.0 > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > Fix For: 3.0.0 > > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.20.7#820007)
Re: Debezium integration for live sync
Hi Francesco, I will look into the link you provided and will come back to you with questions if there are any. Regards, Infaz. On Fri, Mar 26, 2021 at 12:47 PM Francesco Chicchiriccò wrote: > On 13/03/21 18:18, Mohamed Infaz wrote: > > Hi All, > > I am interested in this project [1 ] and wanted to initiate a discussion > on > > it. I have cloned the syncope project and went through the codebase to > get > > a high-level understanding of it. > > > > I have used the Debezium framework before, and have a basic understanding > > of how we can convert a set of database tables, collection changes into a > > stream of events published to Kafka Topic, so that clients can then > consume the > > events. > > > > To scope out the project, can you please explain what you exactly meant > by > > External Resources. Which tables or collections mean by these? > Hi, > thanks for your interest and sorry for the delayed response. > > I think you should first make yourself a bit confident with Syncope > concepts: > > http://syncope.apache.org/docs/2.1/reference-guide.html > > In a nutshell, Syncope should be made enable to react and process Kafka > messages, treating them as input in the same way as it happens today for > the Provisioning layer, e.g. via REST or ConnId connectors. > > Hope this clarifies. > Regards. > > > [1] [SYNCOPE-1617] Debezium integration for live sync - ASF JIRA > > (apache.org) <https://issues.apache.org/jira/browse/SYNCOPE-1617> > > > > Regards, > > > > Infaz. > > > -- > Francesco Chicchiriccò > > Tirasa - Open Source Excellence > http://www.tirasa.net/ > > Member at The Apache Software Foundation > Syncope, Cocoon, Olingo, CXF, OpenJPA, PonyMail > http://home.apache.org/~ilgrosso/ > >
Re: Debezium integration for live sync
On 13/03/21 18:18, Mohamed Infaz wrote: Hi All, I am interested in this project [1 ] and wanted to initiate a discussion on it. I have cloned the syncope project and went through the codebase to get a high-level understanding of it. I have used the Debezium framework before, and have a basic understanding of how we can convert a set of database tables, collection changes into a stream of events published to Kafka Topic, so that clients can then consume the events. To scope out the project, can you please explain what you exactly meant by External Resources. Which tables or collections mean by these? Hi, thanks for your interest and sorry for the delayed response. I think you should first make yourself a bit confident with Syncope concepts: http://syncope.apache.org/docs/2.1/reference-guide.html In a nutshell, Syncope should be made enable to react and process Kafka messages, treating them as input in the same way as it happens today for the Provisioning layer, e.g. via REST or ConnId connectors. Hope this clarifies. Regards. [1] [SYNCOPE-1617] Debezium integration for live sync - ASF JIRA (apache.org) <https://issues.apache.org/jira/browse/SYNCOPE-1617> Regards, Infaz. -- Francesco Chicchiriccò Tirasa - Open Source Excellence http://www.tirasa.net/ Member at The Apache Software Foundation Syncope, Cocoon, Olingo, CXF, OpenJPA, PonyMail http://home.apache.org/~ilgrosso/
Debezium integration for live sync
Hi All, I am interested in this project [1 ] and wanted to initiate a discussion on it. I have cloned the syncope project and went through the codebase to get a high-level understanding of it. I have used the Debezium framework before, and have a basic understanding of how we can convert a set of database tables, collection changes into a stream of events published to Kafka Topic, so that clients can then consume the events. To scope out the project, can you please explain what you exactly meant by External Resources. Which tables or collections mean by these? [1] [SYNCOPE-1617] Debezium integration for live sync - ASF JIRA (apache.org) <https://issues.apache.org/jira/browse/SYNCOPE-1617> Regards, Infaz.
[jira] [Commented] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300590#comment-17300590 ] Mohamed Infaz commented on SYNCOPE-1617: Good day to you! I am interested in this project and have cloned the syncope project. I went through the codebase to get a high-level understanding of it. I have used the Debezium framework before, and have a basic understanding of how we can convert a set of database tables, collection changes into a stream of events published to Kafka Topic, so that clients can then consume the events. To scope out the project, can you please explain what you exactly meant by External Resources. Which tables or collections mean by these? > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Issue Comment Deleted] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Kumar Shukla updated SYNCOPE-1617: --- Comment: was deleted (was: Thanks for the info! I will talk into mailing list. Commenting in red was oopsie, Sorry for that.) > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287090#comment-17287090 ] Abhishek Kumar Shukla commented on SYNCOPE-1617: Thanks for the info! I will talk into mailing list. Commenting in red was oopsie, Sorry for that. > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Issue Comment Deleted] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francesco Chicchiriccò updated SYNCOPE-1617: Comment: was deleted (was: Hi [~babayaga] please have a look at https://community.apache.org/gsoc.html especially the timeline. Commenting(in red...) this issue is not the way to approach the community, subscribing the dev@ mailing list and ask there is definitely better.) > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Issue Comment Deleted] (SYNCOPE-1617) Debezium integration for live sync
[
https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Kumar Shukla updated SYNCOPE-1617:
---
Comment: was deleted
(was: *{color:#FF}Hey I am aiming this idea for GSOC 2021 as student. I
have done the setup of Debezium locally. I couldn't find any issues in github
repo. Can someone please guide me how to proceed further i.e resolve basic
issues/features? Thanks!{color}*)
> Debezium integration for live sync
> --
>
> Key: SYNCOPE-1617
> URL: https://issues.apache.org/jira/browse/SYNCOPE-1617
> Project: Syncope
> Issue Type: New Feature
>Reporter: Francesco Chicchiriccò
>Priority: Major
> Labels: gsoc2021, mentor
>
> [Debezium|https://debezium.io/] provides a mean to transform changes from
> RDBMS, MongoDB and Cassandra into Kafka messages.
> This tool can be leveraged to implement a listener-like approach to enable a
> "live-sync" mechanism from External Resources not requiring ConnId.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (SYNCOPE-1617) Debezium integration for live sync
[ https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286903#comment-17286903 ] Francesco Chicchiriccò commented on SYNCOPE-1617: - Hi [~babayaga] please have a look at https://community.apache.org/gsoc.html especially the timeline. Commenting(in red...) this issue is not the way to approach the community, subscribing the dev@ mailing list and ask there is definitely better. > Debezium integration for live sync > -- > > Key: SYNCOPE-1617 > URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 > Project: Syncope > Issue Type: New Feature >Reporter: Francesco Chicchiriccò >Priority: Major > Labels: gsoc2021, mentor > > [Debezium|https://debezium.io/] provides a mean to transform changes from > RDBMS, MongoDB and Cassandra into Kafka messages. > This tool can be leveraged to implement a listener-like approach to enable a > "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (SYNCOPE-1617) Debezium integration for live sync
[
https://issues.apache.org/jira/browse/SYNCOPE-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286899#comment-17286899
]
Abhishek Kumar Shukla commented on SYNCOPE-1617:
*{color:#FF}Hey I am aiming this idea for GSOC 2021 as student. I have done
the setup of Debezium locally. I couldn't find any issues in github repo. Can
someone please guide me how to proceed further i.e resolve basic
issues/features? Thanks!{color}*
> Debezium integration for live sync
> --
>
> Key: SYNCOPE-1617
> URL: https://issues.apache.org/jira/browse/SYNCOPE-1617
> Project: Syncope
> Issue Type: New Feature
>Reporter: Francesco Chicchiriccò
>Priority: Major
> Labels: gsoc2021, mentor
>
> [Debezium|https://debezium.io/] provides a mean to transform changes from
> RDBMS, MongoDB and Cassandra into Kafka messages.
> This tool can be leveraged to implement a listener-like approach to enable a
> "live-sync" mechanism from External Resources not requiring ConnId.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (SYNCOPE-1617) Debezium integration for live sync
Francesco Chicchiriccò created SYNCOPE-1617: --- Summary: Debezium integration for live sync Key: SYNCOPE-1617 URL: https://issues.apache.org/jira/browse/SYNCOPE-1617 Project: Syncope Issue Type: New Feature Reporter: Francesco Chicchiriccò [Debezium|https://debezium.io/] provides a mean to transform changes from RDBMS, MongoDB and Cassandra into Kafka messages. This tool can be leveraged to implement a listener-like approach to enable a "live-sync" mechanism from External Resources not requiring ConnId. -- This message was sent by Atlassian Jira (v8.3.4#803005)
