Re: Flink Jdbc streaming source support in 1.7.1 or in future?

2019-01-23 Thread Puneet Kinra
Then common way is to read in the cdc .writing generic operator wont be easy . On Wed, Jan 23, 2019 at 12:45 PM Manjusha Vuyyuru wrote: > But 'JDBCInputFormat' will exit once its done reading all data.I need > something like which keeps polling to mysql and fetch if there are any > updates or

Re: Flink Jdbc streaming source support in 1.7.1 or in future?

2019-01-23 Thread Fabian Hueske
I think this is very hard to build in a generic way. The common approach here would be to get access to the changelog stream of the table, writing it to a message queue / event log (like Kafka, Pulsar, Kinesis, ...) and ingesting the changes from the event log into a Flink application. You can of

Re: Flink Jdbc streaming source support in 1.7.1 or in future?

2019-01-22 Thread Manjusha Vuyyuru
But 'JDBCInputFormat' will exit once its done reading all data.I need something like which keeps polling to mysql and fetch if there are any updates or changes. Thanks, manju On Wed, Jan 23, 2019 at 7:10 AM Zhenghua Gao wrote: > Actually flink-connectors/flink-jdbc module provided a

Re: Flink Jdbc streaming source support in 1.7.1 or in future?

2019-01-22 Thread Zhenghua Gao
Actually flink-connectors/flink-jdbc module provided a JDBCInputFormat to read data from a database. u can have a try. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Flink Jdbc streaming source support in 1.7.1 or in future?

2019-01-21 Thread Manjusha Vuyyuru
Hello, Do flink 1.7.1 supports connection to relational database(mysql)? I want to use mysql as my streaming source to read some configuration.. Thanks, Manju