Re: Partitionable,Idempotent & Pollable JDBCInput

Thanks Dev! I think we should also add the following points to the design / assumptions / JIRA. Please suggest corrections if my understanding is incorrect. 1. This operator will create a configured number of non-polling static partitions for fetching the existing data in the table. And an

Re: Partitionable,Idempotent & Pollable JDBCInput

Finally we have a robust jdbc polling input operator. Since it is @evolving, we can make improvements over time as folks start using this operator. +1 for merging the PR. Regards, Ashwin. On Tue, Jul 12, 2016 at 11:17 AM, Devendra Tagare wrote: > All, > > We have

Partitionable,Idempotent & Pollable JDBCInput

All, We have created a JDBCPollInputOperator with the below features, 1. poll from external jdbc store asynchronously in the input operator. 2. polling frequency and batch size are configurable. 3.User can specify the polling query 4.User can specify the columns to fetch as a part of the result