[
https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993751#comment-16993751
]
Purushotham Pushpavanthar edited comment on HUDI-251 at 12/11/19 5:44 PM:
--------------------------------------------------------------------------
Hi [~taherk77], are you still working on this?
[~vinoth] If not I would like to work on this. Bringing JDBC incremental pull
into HUDI in a scalable way helps a lot.
was (Author: pushpavanthar):
Hi [~taherk77], are you still working on this?
If not I would like to work on this. Bringing JDBC incremental pull into HUDI
in a scalable way helps a lot.
> JDBC incremental load to HUDI with DeltaStreamer
> ------------------------------------------------
>
> Key: HUDI-251
> URL: https://issues.apache.org/jira/browse/HUDI-251
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: deltastreamer
> Reporter: Taher Koitawala
> Priority: Trivial
> Labels: pull-request-available
> Fix For: 0.5.1
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Mirroring RDBMS to HUDI is one of the most basic use cases of HUDI. Hence,
> for such use cases, DeltaStreamer should provide inbuilt support.
> DeltaSteamer should accept something like jdbc-source.properties where users
> can define the RDBMS connection properties along with a timestamp column and
> an interval which allows users to express how frequently HUDI should check
> with RDBMS data source for new inserts or updates.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
